2024-09-21T14:54:04.538 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T14:54:04.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T14:54:04.638 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909963 branch: reef description: rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_20.04} workloads/rbd-mirror-fsx-workunit} email: ceph-qa@ceph.com first_in_suite: false job_id: '7909963' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi meta: - desc: run two ceph clusters and install rbd-mirror - desc: configure the permissions for client.mirror - desc: 2 ceph clusters with 1 mon and 3 osds each - desc: run four rbd-mirror daemons per cluster - desc: run multiple FSX workloads to simulate cluster load and then verify that the images were replicated name: teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 30 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: reef ceph: conf: client: debug rbd: 20 debug rbd_mirror: 15 log to stderr: false rbd default features: 125 rbd mirror image policy type: none client.mirror.0: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid client.mirror.1: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid client.mirror.2: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid client.mirror.3: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: a477b1894d5c5a613f23260ca0e6b96d79652ba7 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - cluster1.mon.a - cluster1.mgr.x - cluster2.mgr.x - cluster1.osd.0 - cluster1.osd.1 - cluster1.osd.2 - cluster1.client.0 - cluster2.client.0 - - cluster2.mon.a - cluster2.osd.0 - cluster2.osd.1 - cluster2.osd.2 - cluster1.client.mirror - cluster1.client.mirror.0 - cluster1.client.mirror.1 - cluster1.client.mirror.2 - cluster1.client.mirror.3 - cluster1.client.mirror.4 - cluster1.client.mirror.5 - cluster1.client.mirror.6 - cluster2.client.mirror - cluster2.client.mirror.0 - cluster2.client.mirror.1 - cluster2.client.mirror.2 - cluster2.client.mirror.3 - cluster2.client.mirror.4 - cluster2.client.mirror.5 - cluster2.client.mirror.6 seed: 4623 sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 sleep_before_teardown: 0 subset: 80/128 suite: rbd suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_a477b1894d5c5a613f23260ca0e6b96d79652ba7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: a477b1894d5c5a613f23260ca0e6b96d79652ba7 targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: - rbd-mirror - ceph: cluster: cluster1 - ceph: cluster: cluster2 - exec: cluster1.client.mirror.0: - sudo ceph --cluster cluster1 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd' - rbd-mirror: client: cluster1.client.mirror.0 thrash: true - rbd-mirror: client: cluster1.client.mirror.1 thrash: true - rbd-mirror: client: cluster1.client.mirror.2 thrash: true - rbd-mirror: client: cluster1.client.mirror.3 thrash: true - rbd-mirror: client: cluster2.client.mirror.0 thrash: true - rbd-mirror: client: cluster2.client.mirror.1 thrash: true - rbd-mirror: client: cluster2.client.mirror.2 thrash: true - rbd-mirror: client: cluster2.client.mirror.3 thrash: true - rbd-mirror-thrash: cluster: cluster1 - rbd-mirror-thrash: cluster: cluster2 - workunit: clients: cluster1.client.mirror: - rbd/rbd_mirror_fsx_prepare.sh env: CEPH_ARGS: '' RBD_MIRROR_NOCLEANUP: '1' RBD_MIRROR_USE_EXISTING_CLUSTER: '1' RBD_MIRROR_USE_RBD_MIRROR: '1' - rbd_fsx: clients: - cluster1.client.mirror.0 - cluster1.client.mirror.1 - cluster1.client.mirror.2 - cluster1.client.mirror.3 - cluster1.client.mirror.4 - cluster1.client.mirror.5 keep_images: true ops: 6000 pool_name: mirror - workunit: clients: cluster1.client.mirror: - rbd/rbd_mirror_fsx_compare.sh env: CEPH_ARGS: '' RBD_MIRROR_USE_EXISTING_CLUSTER: '1' RBD_MIRROR_USE_RBD_MIRROR: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_22:16:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T14:54:04.639 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_a477b1894d5c5a613f23260ca0e6b96d79652ba7/qa; will attempt to use it 2024-09-21T14:54:04.639 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_a477b1894d5c5a613f23260ca0e6b96d79652ba7/qa/tasks 2024-09-21T14:54:04.640 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T14:54:04.641 INFO:teuthology.task.internal:Checking packages... 2024-09-21T14:54:04.662 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9' 2024-09-21T14:54:04.662 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T14:54:04.662 INFO:teuthology.packaging:ref: None 2024-09-21T14:54:04.662 INFO:teuthology.packaging:tag: None 2024-09-21T14:54:04.662 INFO:teuthology.packaging:branch: reef 2024-09-21T14:54:04.662 INFO:teuthology.packaging:sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-21T14:54:04.662 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=reef 2024-09-21T14:54:04.933 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-871-g6a1bdf85-1focal 2024-09-21T14:54:04.934 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T14:54:04.943 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T14:54:04.943 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T14:54:05.011 INFO:teuthology.task.internal:Saving configuration 2024-09-21T14:54:05.028 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T14:54:05.046 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T14:54:05.074 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909963', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 14:47:54.402883', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-21T14:54:05.095 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909963', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 14:47:54.404456', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-21T14:54:05.095 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T14:54:05.103 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'] 2024-09-21T14:54:05.103 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6'] 2024-09-21T14:54:05.103 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T14:54:05.184 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe9c8bcbac0>, signals=[15]) 2024-09-21T14:54:05.184 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T14:54:05.191 INFO:teuthology.task.internal:Opening connections... 2024-09-21T14:54:05.191 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-09-21T14:54:05.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T14:54:05.289 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2024-09-21T14:54:05.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T14:54:05.379 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T14:54:05.391 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-09-21T14:54:05.398 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-09-21T14:54:05.398 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-09-21T14:54:05.445 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Ubuntu" 2024-09-21T14:54:05.446 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-21T14:54:05.446 INFO:teuthology.orchestra.run.smithi082.stdout:ID=ubuntu 2024-09-21T14:54:05.446 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE=debian 2024-09-21T14:54:05.446 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-21T14:54:05.446 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="20.04" 2024-09-21T14:54:05.446 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-21T14:54:05.446 INFO:teuthology.orchestra.run.smithi082.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-21T14:54:05.446 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-21T14:54:05.446 INFO:teuthology.orchestra.run.smithi082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-21T14:54:05.446 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_CODENAME=focal 2024-09-21T14:54:05.446 INFO:teuthology.orchestra.run.smithi082.stdout:UBUNTU_CODENAME=focal 2024-09-21T14:54:05.447 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-09-21T14:54:05.469 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-09-21T14:54:05.476 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-09-21T14:54:05.477 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-09-21T14:54:05.529 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2024-09-21T14:54:05.529 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-21T14:54:05.529 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2024-09-21T14:54:05.529 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2024-09-21T14:54:05.529 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-21T14:54:05.529 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="20.04" 2024-09-21T14:54:05.530 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-21T14:54:05.530 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-21T14:54:05.530 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-21T14:54:05.530 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-21T14:54:05.530 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=focal 2024-09-21T14:54:05.530 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=focal 2024-09-21T14:54:05.530 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-09-21T14:54:05.552 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T14:54:05.562 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T14:54:05.631 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T14:54:05.632 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-09-21T14:54:05.634 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2024-09-21T14:54:05.639 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T14:54:05.659 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T14:54:05.659 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-09-21T14:54:05.661 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2024-09-21T14:54:05.701 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T14:54:05.762 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T14:54:05.778 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T14:54:05.778 INFO:teuthology.task.kernel:config {'cluster1.mon.a': {'kdb': 1, 'sha1': 'distro'}, 'cluster2.mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T14:54:05.779 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T14:54:05.779 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T14:54:05.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T14:54:05.785 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-09-21T14:54:05.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T14:54:05.786 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-09-21T14:54:05.793 INFO:teuthology.orchestra.run.smithi082.stdout:5.4.0-124-generic 2024-09-21T14:54:05.793 INFO:teuthology.task.kernel:Running kernel on smithi082: 5.4.0-124-generic 2024-09-21T14:54:05.793 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get clean 2024-09-21T14:54:05.795 INFO:teuthology.orchestra.run.smithi161.stdout:5.4.0-124-generic 2024-09-21T14:54:05.795 INFO:teuthology.task.kernel:Running kernel on smithi161: 5.4.0-124-generic 2024-09-21T14:54:05.795 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get clean 2024-09-21T14:54:05.887 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get update 2024-09-21T14:54:05.913 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2024-09-21T14:54:06.048 INFO:teuthology.orchestra.run.smithi082.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-21T14:54:06.053 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-21T14:54:06.053 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-21T14:54:06.055 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-21T14:54:06.132 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-21T14:54:06.161 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-21T14:54:06.243 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-21T14:54:06.321 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [818 kB] 2024-09-21T14:54:06.411 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,227 kB] 2024-09-21T14:54:06.442 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [818 kB] 2024-09-21T14:54:06.452 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [476 kB] 2024-09-21T14:54:06.456 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-21T14:54:06.456 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-21T14:54:06.456 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,156 kB] 2024-09-21T14:54:06.479 INFO:teuthology.orchestra.run.smithi082.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [441 kB] 2024-09-21T14:54:06.482 INFO:teuthology.orchestra.run.smithi082.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-21T14:54:06.482 INFO:teuthology.orchestra.run.smithi082.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,012 kB] 2024-09-21T14:54:06.489 INFO:teuthology.orchestra.run.smithi082.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-21T14:54:06.493 INFO:teuthology.orchestra.run.smithi082.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-21T14:54:06.495 INFO:teuthology.orchestra.run.smithi082.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.4 kB] 2024-09-21T14:54:06.495 INFO:teuthology.orchestra.run.smithi082.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-21T14:54:06.495 INFO:teuthology.orchestra.run.smithi082.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-21T14:54:06.495 INFO:teuthology.orchestra.run.smithi082.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-21T14:54:06.504 INFO:teuthology.orchestra.run.smithi082.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-21T14:54:06.527 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,227 kB] 2024-09-21T14:54:06.569 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [476 kB] 2024-09-21T14:54:06.572 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-21T14:54:06.572 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-21T14:54:06.573 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,156 kB] 2024-09-21T14:54:06.585 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,601 kB] 2024-09-21T14:54:06.596 INFO:teuthology.orchestra.run.smithi082.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-21T14:54:06.597 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [441 kB] 2024-09-21T14:54:06.600 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-21T14:54:06.600 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,012 kB] 2024-09-21T14:54:06.606 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-21T14:54:06.611 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-21T14:54:06.612 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.4 kB] 2024-09-21T14:54:06.612 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-21T14:54:06.613 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-21T14:54:06.613 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-21T14:54:06.621 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-21T14:54:06.693 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,037 kB] 2024-09-21T14:54:06.703 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [554 kB] 2024-09-21T14:54:06.708 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-21T14:54:06.708 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,283 kB] 2024-09-21T14:54:06.730 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-21T14:54:06.731 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [460 kB] 2024-09-21T14:54:06.734 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-21T14:54:06.734 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,232 kB] 2024-09-21T14:54:06.736 INFO:teuthology.orchestra.run.smithi082.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,601 kB] 2024-09-21T14:54:06.741 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [808 kB] 2024-09-21T14:54:06.747 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-21T14:54:06.749 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.3 kB] 2024-09-21T14:54:06.750 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-21T14:54:06.750 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-21T14:54:06.755 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-21T14:54:06.755 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-21T14:54:06.755 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-21T14:54:06.756 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-21T14:54:06.772 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-21T14:54:06.772 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-21T14:54:06.773 INFO:teuthology.orchestra.run.smithi161.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-21T14:54:06.773 INFO:teuthology.orchestra.run.smithi161.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-21T14:54:07.122 INFO:teuthology.orchestra.run.smithi082.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,037 kB] 2024-09-21T14:54:07.150 INFO:teuthology.orchestra.run.smithi082.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [554 kB] 2024-09-21T14:54:07.163 INFO:teuthology.orchestra.run.smithi082.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-21T14:54:07.164 INFO:teuthology.orchestra.run.smithi082.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,283 kB] 2024-09-21T14:54:07.264 INFO:teuthology.orchestra.run.smithi082.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-21T14:54:07.265 INFO:teuthology.orchestra.run.smithi082.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [460 kB] 2024-09-21T14:54:07.276 INFO:teuthology.orchestra.run.smithi082.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-21T14:54:07.280 INFO:teuthology.orchestra.run.smithi082.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [808 kB] 2024-09-21T14:54:07.302 INFO:teuthology.orchestra.run.smithi082.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,232 kB] 2024-09-21T14:54:07.335 INFO:teuthology.orchestra.run.smithi082.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-21T14:54:07.345 INFO:teuthology.orchestra.run.smithi082.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.3 kB] 2024-09-21T14:54:07.346 INFO:teuthology.orchestra.run.smithi082.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-21T14:54:07.347 INFO:teuthology.orchestra.run.smithi082.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-21T14:54:07.368 INFO:teuthology.orchestra.run.smithi082.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-21T14:54:07.369 INFO:teuthology.orchestra.run.smithi082.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-21T14:54:07.369 INFO:teuthology.orchestra.run.smithi082.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-21T14:54:07.370 INFO:teuthology.orchestra.run.smithi082.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-21T14:54:07.450 INFO:teuthology.orchestra.run.smithi082.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-21T14:54:07.451 INFO:teuthology.orchestra.run.smithi082.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-21T14:54:07.451 INFO:teuthology.orchestra.run.smithi082.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-21T14:54:07.451 INFO:teuthology.orchestra.run.smithi082.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-21T14:54:10.871 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 22.0 MB in 3s (7,616 kB/s) 2024-09-21T14:54:10.903 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 22.0 MB in 3s (7,405 kB/s) 2024-09-21T14:54:12.351 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2024-09-21T14:54:12.374 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-21T14:54:12.379 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T14:54:12.402 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T14:54:12.455 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2024-09-21T14:54:12.478 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-21T14:54:12.676 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2024-09-21T14:54:12.677 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2024-09-21T14:54:12.678 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-09-21T14:54:12.678 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-09-21T14:54:12.878 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2024-09-21T14:54:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: linux-generic linux-headers-5.4.0-196 linux-headers-5.4.0-196-generic 2024-09-21T14:54:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: linux-headers-generic linux-image-5.4.0-196-generic 2024-09-21T14:54:12.879 INFO:teuthology.orchestra.run.smithi161.stdout: linux-modules-5.4.0-196-generic linux-modules-extra-5.4.0-196-generic 2024-09-21T14:54:12.880 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2024-09-21T14:54:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-21T14:54:12.880 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2024-09-21T14:54:12.880 INFO:teuthology.orchestra.run.smithi161.stdout: thermald 2024-09-21T14:54:12.894 INFO:teuthology.orchestra.run.smithi082.stdout:The following additional packages will be installed: 2024-09-21T14:54:12.894 INFO:teuthology.orchestra.run.smithi082.stdout: linux-generic linux-headers-5.4.0-196 linux-headers-5.4.0-196-generic 2024-09-21T14:54:12.894 INFO:teuthology.orchestra.run.smithi082.stdout: linux-headers-generic linux-image-5.4.0-196-generic 2024-09-21T14:54:12.895 INFO:teuthology.orchestra.run.smithi082.stdout: linux-modules-5.4.0-196-generic linux-modules-extra-5.4.0-196-generic 2024-09-21T14:54:12.896 INFO:teuthology.orchestra.run.smithi082.stdout:Suggested packages: 2024-09-21T14:54:12.896 INFO:teuthology.orchestra.run.smithi082.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-21T14:54:12.896 INFO:teuthology.orchestra.run.smithi082.stdout:Recommended packages: 2024-09-21T14:54:12.896 INFO:teuthology.orchestra.run.smithi082.stdout: thermald 2024-09-21T14:54:12.937 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2024-09-21T14:54:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: linux-headers-5.4.0-196 linux-headers-5.4.0-196-generic 2024-09-21T14:54:12.937 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.4.0-196-generic linux-modules-5.4.0-196-generic 2024-09-21T14:54:12.938 INFO:teuthology.orchestra.run.smithi161.stdout: linux-modules-extra-5.4.0-196-generic 2024-09-21T14:54:12.939 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2024-09-21T14:54:12.939 INFO:teuthology.orchestra.run.smithi161.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-21T14:54:12.950 INFO:teuthology.orchestra.run.smithi082.stdout:The following NEW packages will be installed: 2024-09-21T14:54:12.950 INFO:teuthology.orchestra.run.smithi082.stdout: linux-headers-5.4.0-196 linux-headers-5.4.0-196-generic 2024-09-21T14:54:12.950 INFO:teuthology.orchestra.run.smithi082.stdout: linux-image-5.4.0-196-generic linux-modules-5.4.0-196-generic 2024-09-21T14:54:12.950 INFO:teuthology.orchestra.run.smithi082.stdout: linux-modules-extra-5.4.0-196-generic 2024-09-21T14:54:12.952 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages will be upgraded: 2024-09-21T14:54:12.953 INFO:teuthology.orchestra.run.smithi082.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-21T14:54:13.122 INFO:teuthology.orchestra.run.smithi161.stdout:3 upgraded, 5 newly installed, 0 to remove and 318 not upgraded. 2024-09-21T14:54:13.122 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 77.2 MB of archives. 2024-09-21T14:54:13.122 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-21T14:54:13.122 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-196-generic amd64 5.4.0-196.216 [15.0 MB] 2024-09-21T14:54:13.134 INFO:teuthology.orchestra.run.smithi082.stdout:3 upgraded, 5 newly installed, 0 to remove and 318 not upgraded. 2024-09-21T14:54:13.134 INFO:teuthology.orchestra.run.smithi082.stdout:Need to get 77.2 MB of archives. 2024-09-21T14:54:13.134 INFO:teuthology.orchestra.run.smithi082.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-21T14:54:13.135 INFO:teuthology.orchestra.run.smithi082.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-196-generic amd64 5.4.0-196.216 [15.0 MB] 2024-09-21T14:54:14.281 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-196-generic amd64 5.4.0-196.216 [10.5 MB] 2024-09-21T14:54:14.289 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-196-generic amd64 5.4.0-196.216 [10.5 MB] 2024-09-21T14:54:14.554 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-196-generic amd64 5.4.0-196.216 [39.2 MB] 2024-09-21T14:54:14.604 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-196-generic amd64 5.4.0-196.216 [39.2 MB] 2024-09-21T14:54:15.857 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.196.194 [1,900 B] 2024-09-21T14:54:15.857 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.196.194 [2,592 B] 2024-09-21T14:54:15.858 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-196 all 5.4.0-196.216 [11.0 MB] 2024-09-21T14:54:15.873 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.196.194 [1,900 B] 2024-09-21T14:54:15.873 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.196.194 [2,592 B] 2024-09-21T14:54:15.873 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-196 all 5.4.0-196.216 [11.0 MB] 2024-09-21T14:54:16.138 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-196-generic amd64 5.4.0-196.216 [1,386 kB] 2024-09-21T14:54:16.148 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-196-generic amd64 5.4.0-196.216 [1,386 kB] 2024-09-21T14:54:16.168 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.196.194 [2,460 B] 2024-09-21T14:54:16.204 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.196.194 [2,460 B] 2024-09-21T14:54:16.906 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 77.2 MB in 3s (23.8 MB/s) 2024-09-21T14:54:16.908 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 77.2 MB in 3s (23.7 MB/s) 2024-09-21T14:54:17.071 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-modules-5.4.0-196-generic. 2024-09-21T14:54:17.110 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-modules-5.4.0-196-generic. 2024-09-21T14:54:18.796 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-21T14:54:18.798 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-21T14:54:18.801 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../0-linux-modules-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-21T14:54:18.803 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../0-linux-modules-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-21T14:54:18.876 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-modules-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:18.882 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-modules-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-image-5.4.0-196-generic. 2024-09-21T14:54:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../1-linux-image-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-21T14:54:20.759 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-image-5.4.0-196-generic. 2024-09-21T14:54:20.773 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../1-linux-image-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-21T14:54:20.843 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:20.877 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-image-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:21.909 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-196-generic. 2024-09-21T14:54:21.924 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-21T14:54:21.959 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-modules-extra-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:22.037 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-196-generic. 2024-09-21T14:54:22.053 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-21T14:54:22.095 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-modules-extra-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:26.718 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../3-linux-generic_5.4.0.196.194_amd64.deb ... 2024-09-21T14:54:26.775 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../3-linux-generic_5.4.0.196.194_amd64.deb ... 2024-09-21T14:54:26.844 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-generic (5.4.0.196.194) over (5.4.0.124.125) ... 2024-09-21T14:54:26.902 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-generic (5.4.0.196.194) over (5.4.0.124.125) ... 2024-09-21T14:54:27.188 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.196.194_amd64.deb ... 2024-09-21T14:54:27.314 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-generic (5.4.0.196.194) over (5.4.0.124.125) ... 2024-09-21T14:54:27.596 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.196.194_amd64.deb ... 2024-09-21T14:54:27.650 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-headers-5.4.0-196. 2024-09-21T14:54:27.665 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../5-linux-headers-5.4.0-196_5.4.0-196.216_all.deb ... 2024-09-21T14:54:27.700 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-5.4.0-196 (5.4.0-196.216) ... 2024-09-21T14:54:27.722 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-image-generic (5.4.0.196.194) over (5.4.0.124.125) ... 2024-09-21T14:54:28.059 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-headers-5.4.0-196. 2024-09-21T14:54:28.072 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../5-linux-headers-5.4.0-196_5.4.0-196.216_all.deb ... 2024-09-21T14:54:28.117 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-headers-5.4.0-196 (5.4.0-196.216) ... 2024-09-21T14:54:33.060 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-headers-5.4.0-196-generic. 2024-09-21T14:54:33.081 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../6-linux-headers-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-21T14:54:33.118 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:33.569 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-headers-5.4.0-196-generic. 2024-09-21T14:54:33.590 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../6-linux-headers-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-21T14:54:33.627 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-headers-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:35.828 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.196.194_amd64.deb ... 2024-09-21T14:54:35.958 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-generic (5.4.0.196.194) over (5.4.0.124.125) ... 2024-09-21T14:54:36.302 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-5.4.0-196 (5.4.0-196.216) ... 2024-09-21T14:54:36.336 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.196.194_amd64.deb ... 2024-09-21T14:54:36.421 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:36.464 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-headers-generic (5.4.0.196.194) over (5.4.0.124.125) ... 2024-09-21T14:54:36.547 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-generic (5.4.0.196.194) ... 2024-09-21T14:54:36.673 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-modules-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-headers-5.4.0-196 (5.4.0-196.216) ... 2024-09-21T14:54:36.944 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-headers-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:37.070 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-headers-generic (5.4.0.196.194) ... 2024-09-21T14:54:37.195 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-modules-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:37.908 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:38.580 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-image-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:39.633 INFO:teuthology.orchestra.run.smithi161.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-196-generic 2024-09-21T14:54:39.633 INFO:teuthology.orchestra.run.smithi161.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-196-generic 2024-09-21T14:54:39.716 INFO:teuthology.orchestra.run.smithi082.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-196-generic 2024-09-21T14:54:39.716 INFO:teuthology.orchestra.run.smithi082.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-196-generic 2024-09-21T14:54:39.769 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-modules-extra-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:39.841 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-modules-extra-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:40.937 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-generic (5.4.0.196.194) ... 2024-09-21T14:54:41.042 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-image-generic (5.4.0.196.194) ... 2024-09-21T14:54:41.063 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-generic (5.4.0.196.194) ... 2024-09-21T14:54:41.168 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-generic (5.4.0.196.194) ... 2024-09-21T14:54:41.189 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for linux-image-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:41.270 INFO:teuthology.orchestra.run.smithi161.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-21T14:54:41.270 INFO:teuthology.orchestra.run.smithi161.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-196-generic 2024-09-21T14:54:41.294 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for linux-image-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-21T14:54:41.364 INFO:teuthology.orchestra.run.smithi082.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-21T14:54:41.365 INFO:teuthology.orchestra.run.smithi082.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-196-generic 2024-09-21T14:55:02.952 INFO:teuthology.orchestra.run.smithi082.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-21T14:55:02.952 INFO:teuthology.orchestra.run.smithi082.stdout:Sourcing file `/etc/default/grub' 2024-09-21T14:55:02.963 INFO:teuthology.orchestra.run.smithi082.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T14:55:02.981 INFO:teuthology.orchestra.run.smithi082.stdout:Generating grub configuration file ... 2024-09-21T14:55:03.187 INFO:teuthology.orchestra.run.smithi161.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-21T14:55:03.187 INFO:teuthology.orchestra.run.smithi161.stdout:Sourcing file `/etc/default/grub' 2024-09-21T14:55:03.201 INFO:teuthology.orchestra.run.smithi161.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T14:55:03.225 INFO:teuthology.orchestra.run.smithi161.stdout:Generating grub configuration file ... 2024-09-21T14:55:03.330 INFO:teuthology.orchestra.run.smithi082.stdout:Found linux image: /boot/vmlinuz-5.4.0-196-generic 2024-09-21T14:55:03.357 INFO:teuthology.orchestra.run.smithi082.stdout:Found initrd image: /boot/initrd.img-5.4.0-196-generic 2024-09-21T14:55:03.544 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-5.4.0-196-generic 2024-09-21T14:55:03.566 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-5.4.0-196-generic 2024-09-21T14:55:03.775 INFO:teuthology.orchestra.run.smithi082.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-21T14:55:03.789 INFO:teuthology.orchestra.run.smithi082.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-21T14:55:03.972 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-21T14:55:03.984 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-21T14:55:05.866 INFO:teuthology.orchestra.run.smithi082.stdout:done 2024-09-21T14:55:06.199 INFO:teuthology.orchestra.run.smithi161.stdout:done 2024-09-21T14:55:06.307 DEBUG:teuthology.orchestra.run.smithi082:> dpkg -s linux-image-generic 2024-09-21T14:55:06.361 INFO:teuthology.orchestra.run.smithi082.stdout:Package: linux-image-generic 2024-09-21T14:55:06.361 INFO:teuthology.orchestra.run.smithi082.stdout:Status: install ok installed 2024-09-21T14:55:06.361 INFO:teuthology.orchestra.run.smithi082.stdout:Priority: optional 2024-09-21T14:55:06.361 INFO:teuthology.orchestra.run.smithi082.stdout:Section: kernel 2024-09-21T14:55:06.361 INFO:teuthology.orchestra.run.smithi082.stdout:Installed-Size: 20 2024-09-21T14:55:06.362 INFO:teuthology.orchestra.run.smithi082.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T14:55:06.362 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: amd64 2024-09-21T14:55:06.362 INFO:teuthology.orchestra.run.smithi082.stdout:Source: linux-meta 2024-09-21T14:55:06.362 INFO:teuthology.orchestra.run.smithi082.stdout:Version: 5.4.0.196.194 2024-09-21T14:55:06.362 INFO:teuthology.orchestra.run.smithi082.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-21T14:55:06.362 INFO:teuthology.orchestra.run.smithi082.stdout:Depends: linux-image-5.4.0-196-generic, linux-modules-extra-5.4.0-196-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T14:55:06.362 INFO:teuthology.orchestra.run.smithi082.stdout:Recommends: thermald 2024-09-21T14:55:06.362 INFO:teuthology.orchestra.run.smithi082.stdout:Description: Generic Linux kernel image 2024-09-21T14:55:06.362 INFO:teuthology.orchestra.run.smithi082.stdout: This package will always depend on the latest generic kernel image 2024-09-21T14:55:06.362 INFO:teuthology.orchestra.run.smithi082.stdout: available. 2024-09-21T14:55:06.362 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-196-generic 2024-09-21T14:55:06.363 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T14:55:06.363 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T14:55:06.363 INFO:teuthology.task.kernel:Installing distro kernel on cluster1.mon.a... 2024-09-21T14:55:06.363 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T14:55:06.363 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get clean 2024-09-21T14:55:06.441 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get update 2024-09-21T14:55:06.579 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-21T14:55:06.585 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-21T14:55:06.588 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-21T14:55:06.602 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-21T14:55:06.625 DEBUG:teuthology.orchestra.run.smithi161:> dpkg -s linux-image-generic 2024-09-21T14:55:06.678 INFO:teuthology.orchestra.run.smithi161.stdout:Package: linux-image-generic 2024-09-21T14:55:06.678 INFO:teuthology.orchestra.run.smithi161.stdout:Status: install ok installed 2024-09-21T14:55:06.678 INFO:teuthology.orchestra.run.smithi161.stdout:Priority: optional 2024-09-21T14:55:06.678 INFO:teuthology.orchestra.run.smithi161.stdout:Section: kernel 2024-09-21T14:55:06.678 INFO:teuthology.orchestra.run.smithi161.stdout:Installed-Size: 20 2024-09-21T14:55:06.678 INFO:teuthology.orchestra.run.smithi161.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T14:55:06.678 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: amd64 2024-09-21T14:55:06.678 INFO:teuthology.orchestra.run.smithi161.stdout:Source: linux-meta 2024-09-21T14:55:06.678 INFO:teuthology.orchestra.run.smithi161.stdout:Version: 5.4.0.196.194 2024-09-21T14:55:06.678 INFO:teuthology.orchestra.run.smithi161.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-21T14:55:06.679 INFO:teuthology.orchestra.run.smithi161.stdout:Depends: linux-image-5.4.0-196-generic, linux-modules-extra-5.4.0-196-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T14:55:06.679 INFO:teuthology.orchestra.run.smithi161.stdout:Recommends: thermald 2024-09-21T14:55:06.679 INFO:teuthology.orchestra.run.smithi161.stdout:Description: Generic Linux kernel image 2024-09-21T14:55:06.679 INFO:teuthology.orchestra.run.smithi161.stdout: This package will always depend on the latest generic kernel image 2024-09-21T14:55:06.679 INFO:teuthology.orchestra.run.smithi161.stdout: available. 2024-09-21T14:55:06.679 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-196-generic 2024-09-21T14:55:06.679 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T14:55:06.679 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T14:55:06.679 INFO:teuthology.task.kernel:Installing distro kernel on cluster2.mon.a... 2024-09-21T14:55:06.679 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T14:55:06.679 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get clean 2024-09-21T14:55:06.784 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2024-09-21T14:55:06.923 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-21T14:55:06.923 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-21T14:55:06.929 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-21T14:55:06.947 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-21T14:55:08.473 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2024-09-21T14:55:08.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T14:55:08.570 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2024-09-21T14:55:08.789 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2024-09-21T14:55:08.790 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2024-09-21T14:55:08.801 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-21T14:55:08.826 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T14:55:08.898 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-21T14:55:09.024 INFO:teuthology.orchestra.run.smithi082.stdout:linux-image-generic is already the newest version (5.4.0.196.194). 2024-09-21T14:55:09.024 INFO:teuthology.orchestra.run.smithi082.stdout:0 upgraded, 0 newly installed, 0 to remove and 318 not upgraded. 2024-09-21T14:55:09.025 DEBUG:teuthology.orchestra.run.smithi082:> dpkg -s linux-image-generic 2024-09-21T14:55:09.045 INFO:teuthology.orchestra.run.smithi082.stdout:Package: linux-image-generic 2024-09-21T14:55:09.045 INFO:teuthology.orchestra.run.smithi082.stdout:Status: install ok installed 2024-09-21T14:55:09.045 INFO:teuthology.orchestra.run.smithi082.stdout:Priority: optional 2024-09-21T14:55:09.045 INFO:teuthology.orchestra.run.smithi082.stdout:Section: kernel 2024-09-21T14:55:09.045 INFO:teuthology.orchestra.run.smithi082.stdout:Installed-Size: 20 2024-09-21T14:55:09.045 INFO:teuthology.orchestra.run.smithi082.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T14:55:09.045 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: amd64 2024-09-21T14:55:09.046 INFO:teuthology.orchestra.run.smithi082.stdout:Source: linux-meta 2024-09-21T14:55:09.046 INFO:teuthology.orchestra.run.smithi082.stdout:Version: 5.4.0.196.194 2024-09-21T14:55:09.046 INFO:teuthology.orchestra.run.smithi082.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-21T14:55:09.046 INFO:teuthology.orchestra.run.smithi082.stdout:Depends: linux-image-5.4.0-196-generic, linux-modules-extra-5.4.0-196-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T14:55:09.046 INFO:teuthology.orchestra.run.smithi082.stdout:Recommends: thermald 2024-09-21T14:55:09.046 INFO:teuthology.orchestra.run.smithi082.stdout:Description: Generic Linux kernel image 2024-09-21T14:55:09.046 INFO:teuthology.orchestra.run.smithi082.stdout: This package will always depend on the latest generic kernel image 2024-09-21T14:55:09.046 INFO:teuthology.orchestra.run.smithi082.stdout: available. 2024-09-21T14:55:09.046 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-09-21T14:55:09.050 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.PdwM4qKfXF 2024-09-21T14:55:09.051 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub/grub.cfg /tmp/tmp.PdwM4qKfXF 2024-09-21T14:55:09.060 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.PdwM4qKfXF 2024-09-21T14:55:09.094 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-09-21T14:55:09.094 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-09-21T14:55:09.145 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.PdwM4qKfXF is 9KB 2024-09-21T14:55:09.159 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.PdwM4qKfXF 2024-09-21T14:55:09.165 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-21T14:55:09.222 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T14:55:09.222 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-21T14:55:09.222 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-21T14:55:09.267 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-196-generic 2024-09-21T14:55:09.268 DEBUG:teuthology.orchestra.run.smithi082:> sudo update-grub 2024-09-21T14:55:09.323 INFO:teuthology.orchestra.run.smithi161.stdout:linux-image-generic is already the newest version (5.4.0.196.194). 2024-09-21T14:55:09.323 INFO:teuthology.orchestra.run.smithi161.stdout:0 upgraded, 0 newly installed, 0 to remove and 318 not upgraded. 2024-09-21T14:55:09.325 DEBUG:teuthology.orchestra.run.smithi161:> dpkg -s linux-image-generic 2024-09-21T14:55:09.346 INFO:teuthology.orchestra.run.smithi161.stdout:Package: linux-image-generic 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:Status: install ok installed 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:Priority: optional 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:Section: kernel 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:Installed-Size: 20 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: amd64 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:Source: linux-meta 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:Version: 5.4.0.196.194 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:Depends: linux-image-5.4.0-196-generic, linux-modules-extra-5.4.0-196-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:Recommends: thermald 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:Description: Generic Linux kernel image 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: This package will always depend on the latest generic kernel image 2024-09-21T14:55:09.347 INFO:teuthology.orchestra.run.smithi161.stdout: available. 2024-09-21T14:55:09.348 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-09-21T14:55:09.393 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.59RusHoi4m 2024-09-21T14:55:09.393 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub/grub.cfg /tmp/tmp.59RusHoi4m 2024-09-21T14:55:09.407 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.59RusHoi4m 2024-09-21T14:55:09.440 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.59RusHoi4m is 9KB 2024-09-21T14:55:09.453 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.59RusHoi4m 2024-09-21T14:55:09.459 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-21T14:55:09.517 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T14:55:09.518 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-21T14:55:09.518 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-21T14:55:09.551 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-196-generic 2024-09-21T14:55:09.552 DEBUG:teuthology.orchestra.run.smithi161:> sudo update-grub 2024-09-21T14:55:10.637 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub' 2024-09-21T14:55:10.642 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T14:55:10.654 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-09-21T14:55:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub' 2024-09-21T14:55:10.850 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T14:55:10.865 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2024-09-21T14:55:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-5.4.0-196-generic 2024-09-21T14:55:10.902 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-5.4.0-196-generic 2024-09-21T14:55:11.117 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.4.0-196-generic 2024-09-21T14:55:11.129 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.4.0-196-generic 2024-09-21T14:55:11.296 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-21T14:55:11.308 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-21T14:55:11.532 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-21T14:55:11.544 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-21T14:55:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-09-21T14:55:12.289 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-09-21T14:55:12.715 INFO:teuthology.orchestra.run.smithi161.stderr:done 2024-09-21T14:55:12.717 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2024-09-21T14:55:42.318 INFO:teuthology.task.kernel:Checking client cluster1.mon.a for new kernel version... 2024-09-21T14:55:42.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-21T14:55:42.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T14:55:42.720 INFO:teuthology.task.kernel:Checking client cluster2.mon.a for new kernel version... 2024-09-21T14:55:42.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-21T14:55:42.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T14:56:00.751 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-09-21T14:56:01.263 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-21T14:56:09.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-21T14:56:09.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T14:56:10.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-21T14:56:10.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T14:56:12.815 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-09-21T14:56:13.327 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-21T14:56:24.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-21T14:56:24.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T14:56:25.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-21T14:56:25.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T14:56:43.247 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-09-21T14:56:43.759 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-21T14:56:58.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-21T14:56:58.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T14:56:58.511 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-09-21T14:56:58.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-21T14:56:58.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T14:56:59.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-21T14:56:59.105 INFO:teuthology.task.kernel:Checking kernel version of cluster1.mon.a, want "5.4.0-196-generic"... 2024-09-21T14:56:59.106 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-09-21T14:56:59.146 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-09-21T14:56:59.153 INFO:teuthology.orchestra.run.smithi082.stdout:5.4.0-196-generic 2024-09-21T14:56:59.153 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-196-generic vs 5.4.0-196-generic 2024-09-21T14:56:59.153 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T14:56:59.153 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-21T14:57:00.154 INFO:teuthology.task.kernel:Enabling kdb on cluster1.mon.a... 2024-09-21T14:57:00.154 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T14:57:00.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-21T14:57:00.236 INFO:teuthology.task.kernel:Checking kernel version of cluster2.mon.a, want "5.4.0-196-generic"... 2024-09-21T14:57:00.236 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-09-21T14:57:00.242 INFO:teuthology.orchestra.run.smithi161.stdout:5.4.0-196-generic 2024-09-21T14:57:00.242 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-196-generic vs 5.4.0-196-generic 2024-09-21T14:57:00.242 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T14:57:00.242 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-21T14:57:00.267 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2024-09-21T14:57:00.305 DEBUG:teuthology.parallel:result is None 2024-09-21T14:57:01.243 INFO:teuthology.task.kernel:Enabling kdb on cluster2.mon.a... 2024-09-21T14:57:01.243 DEBUG:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T14:57:01.465 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2024-09-21T14:57:01.509 DEBUG:teuthology.parallel:result is None 2024-09-21T14:57:01.509 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T14:57:01.515 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T14:57:01.516 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T14:57:01.518 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T14:57:01.525 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T14:57:01.567 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T14:57:01.608 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T14:57:01.608 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T14:57:01.610 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T14:57:01.640 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T14:57:01.659 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T14:57:01.659 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T14:57:01.661 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T14:57:01.677 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T14:57:01.686 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T14:57:01.686 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T14:57:01.697 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T14:57:01.699 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T14:57:01.705 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T14:57:01.705 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T14:57:01.707 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T14:57:01.760 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T14:57:01.768 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T14:57:01.768 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T14:57:01.771 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T14:57:01.776 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T14:57:01.781 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T14:57:01.830 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T14:57:01.830 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T14:57:01.847 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T14:57:01.855 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T14:57:01.905 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T14:57:01.905 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T14:57:01.946 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-09-21T14:57:01.948 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2024-09-21T14:57:02.000 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T14:57:02.007 INFO:teuthology.task.internal:Starting timer... 2024-09-21T14:57:02.007 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T14:57:02.028 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T14:57:02.061 DEBUG:teuthology.task.selinux:Excluding smithi082: OS 'ubuntu' does not support SELinux 2024-09-21T14:57:02.061 DEBUG:teuthology.task.selinux:Excluding smithi161: OS 'ubuntu' does not support SELinux 2024-09-21T14:57:02.061 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T14:57:02.061 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-21T14:57:02.061 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T14:57:02.061 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T14:57:02.095 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T14:57:02.104 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T14:57:02.105 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T15:02:32.118 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2024-09-21T15:02:32.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-21T15:02:32.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T15:02:32.227 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-09-21T15:02:32.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-21T15:02:32.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-21T15:02:32.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T15:02:32.448 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-09-21T15:02:32.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-21T15:02:32.568 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T15:02:32.578 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T15:02:32.578 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T15:02:32.578 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T15:02:32.581 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T15:02:32.581 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T15:02:32.612 INFO:teuthology.orchestra.run.smithi161.stdout:21 Sep 15:02:32 ntpd[13754]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-21T15:02:32.612 INFO:teuthology.orchestra.run.smithi161.stdout:21 Sep 15:02:32 ntpd[13754]: Command line: ntpd -gq 2024-09-21T15:02:32.614 INFO:teuthology.orchestra.run.smithi161.stdout:21 Sep 15:02:32 ntpd[13754]: proto: precision = 0.108 usec (-23) 2024-09-21T15:02:32.614 INFO:teuthology.orchestra.run.smithi161.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T15:02:32.614 INFO:teuthology.orchestra.run.smithi161.stdout:21 Sep 15:02:32 ntpd[13754]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T15:02:32.615 INFO:teuthology.orchestra.run.smithi161.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-21T15:02:32.616 INFO:teuthology.orchestra.run.smithi161.stdout:21 Sep 15:02:32 ntpd[13754]: restrict ::: KOD does nothing without LIMITED. 2024-09-21T15:02:32.616 INFO:teuthology.orchestra.run.smithi161.stdout:21 Sep 15:02:32 ntpd[13754]: Listen and drop on 0 v6wildcard [::]:123 2024-09-21T15:02:32.616 INFO:teuthology.orchestra.run.smithi161.stdout:21 Sep 15:02:32 ntpd[13754]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-21T15:02:32.616 INFO:teuthology.orchestra.run.smithi161.stdout:21 Sep 15:02:32 ntpd[13754]: Listen normally on 2 lo 127.0.0.1:123 2024-09-21T15:02:32.616 INFO:teuthology.orchestra.run.smithi161.stdout:21 Sep 15:02:32 ntpd[13754]: Listen normally on 3 enp3s0f1 172.21.15.161:123 2024-09-21T15:02:32.616 INFO:teuthology.orchestra.run.smithi161.stdout:21 Sep 15:02:32 ntpd[13754]: Listen normally on 4 lo [::1]:123 2024-09-21T15:02:32.616 INFO:teuthology.orchestra.run.smithi161.stdout:21 Sep 15:02:32 ntpd[13754]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7251%5]:123 2024-09-21T15:02:32.616 INFO:teuthology.orchestra.run.smithi161.stdout:21 Sep 15:02:32 ntpd[13754]: Listening on routing socket on fd #22 for interface updates 2024-09-21T15:02:32.617 INFO:teuthology.orchestra.run.smithi082.stdout:21 Sep 15:02:32 ntpd[13700]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-21T15:02:32.617 INFO:teuthology.orchestra.run.smithi082.stdout:21 Sep 15:02:32 ntpd[13700]: Command line: ntpd -gq 2024-09-21T15:02:32.617 INFO:teuthology.orchestra.run.smithi082.stdout:21 Sep 15:02:32 ntpd[13700]: proto: precision = 0.117 usec (-23) 2024-09-21T15:02:32.618 INFO:teuthology.orchestra.run.smithi082.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T15:02:32.618 INFO:teuthology.orchestra.run.smithi082.stdout:21 Sep 15:02:32 ntpd[13700]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T15:02:32.618 INFO:teuthology.orchestra.run.smithi082.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-21T15:02:32.619 INFO:teuthology.orchestra.run.smithi082.stdout:21 Sep 15:02:32 ntpd[13700]: restrict ::: KOD does nothing without LIMITED. 2024-09-21T15:02:32.619 INFO:teuthology.orchestra.run.smithi082.stdout:21 Sep 15:02:32 ntpd[13700]: Listen and drop on 0 v6wildcard [::]:123 2024-09-21T15:02:32.619 INFO:teuthology.orchestra.run.smithi082.stdout:21 Sep 15:02:32 ntpd[13700]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-21T15:02:32.619 INFO:teuthology.orchestra.run.smithi082.stdout:21 Sep 15:02:32 ntpd[13700]: Listen normally on 2 lo 127.0.0.1:123 2024-09-21T15:02:32.619 INFO:teuthology.orchestra.run.smithi082.stdout:21 Sep 15:02:32 ntpd[13700]: Listen normally on 3 enp3s0f1 172.21.15.82:123 2024-09-21T15:02:32.619 INFO:teuthology.orchestra.run.smithi082.stdout:21 Sep 15:02:32 ntpd[13700]: Listen normally on 4 lo [::1]:123 2024-09-21T15:02:32.620 INFO:teuthology.orchestra.run.smithi082.stdout:21 Sep 15:02:32 ntpd[13700]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3ff%5]:123 2024-09-21T15:02:32.620 INFO:teuthology.orchestra.run.smithi082.stdout:21 Sep 15:02:32 ntpd[13700]: Listening on routing socket on fd #22 for interface updates 2024-09-21T15:02:33.613 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:33 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:33.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:33 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:33.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:33 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:33.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:33 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:33.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:33 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:33.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:33 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:33.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:33 ntpd[13754]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:33.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:33 ntpd[13754]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:35.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:35 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:35.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:35 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:35.616 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:35 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:35.616 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:35 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:35.616 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:35 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:35.616 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:35 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:35.616 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:35 ntpd[13754]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:35.616 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:35 ntpd[13754]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:35.616 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:35 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:35.617 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:35 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:35.617 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:35 ntpd[13754]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:35.617 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:35 ntpd[13754]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:35 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:35 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:35 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:35 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:35 ntpd[13700]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:35 ntpd[13700]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:36.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:36 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:36.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:36 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:36.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:36 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:36.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:36 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:36.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:36 ntpd[13754]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:36.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:36 ntpd[13754]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:36.616 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:36 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:36.616 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:36 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:36.616 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:36 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:36.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:36 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:36.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:36 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:36.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:36 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:36.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:36 ntpd[13700]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:36.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:36 ntpd[13700]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:37.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:37 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:37.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:37 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:37.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:37 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:37.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:37 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:37.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:37 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:37.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:37 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:37.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:37 ntpd[13754]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:37.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:37 ntpd[13754]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:37.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:37 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:37.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:37 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:37.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:37 ntpd[13754]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:37.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:37 ntpd[13754]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:37.616 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:37 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:37.616 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:37 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:37.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:37 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:37.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:37 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:37.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:37 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:37.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:37 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:37.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:37 ntpd[13700]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:37.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:37 ntpd[13700]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:37.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:37 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:37.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:37 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:37.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:37 ntpd[13700]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:37.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:37 ntpd[13700]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:38 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:38 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:38 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:38 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:38 ntpd[13754]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:38 ntpd[13754]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:38.616 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:38 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:38.616 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:38 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:38.616 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:38 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:38.616 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:38 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:38.616 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:38 ntpd[13700]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:38.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:38 ntpd[13700]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:39.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:39 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:39.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:39 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:39.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:39 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:39.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:39 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:39.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:39 ntpd[13754]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:39.614 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:39 ntpd[13754]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:39.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:39 ntpd[13754]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:39.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:39 ntpd[13754]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:39.615 INFO:teuthology.orchestra.run.smithi161.stdout:21 Sep 15:02:39 ntpd[13754]: ntpd: time slew +0.000106 s 2024-09-21T15:02:39.615 INFO:teuthology.orchestra.run.smithi161.stdout:ntpd: time slew +0.000106s 2024-09-21T15:02:39.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:39 ntpd[13754]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-21T15:02:39.615 INFO:teuthology.orchestra.run.smithi161.stderr:21 Sep 15:02:39 ntpd[13754]: can't open /var/log/ntpstats/loopstats.20240921: Permission denied 2024-09-21T15:02:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:39 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:39 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:39 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:39 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:39 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:39 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:39 ntpd[13700]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:39 ntpd[13700]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:39 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:39 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:39 ntpd[13700]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:39 ntpd[13700]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:39.679 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T15:02:39.679 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2024-09-21T15:02:39.679 INFO:teuthology.orchestra.run.smithi161.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-21T15:02:39.679 INFO:teuthology.orchestra.run.smithi161.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-21T15:02:39.680 INFO:teuthology.orchestra.run.smithi161.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-21T15:02:39.680 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-21T15:02:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:40 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:40 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:40 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:40 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:40 ntpd[13700]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:40 ntpd[13700]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:41 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:41.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:41 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:41.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:41 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:41.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:41 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:41.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:41 ntpd[13700]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T15:02:41.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:41 ntpd[13700]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T15:02:41.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:41 ntpd[13700]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T15:02:41.617 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:41 ntpd[13700]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T15:02:41.617 INFO:teuthology.orchestra.run.smithi082.stdout:21 Sep 15:02:41 ntpd[13700]: ntpd: time slew +0.002833 s 2024-09-21T15:02:41.617 INFO:teuthology.orchestra.run.smithi082.stdout:ntpd: time slew +0.002833s 2024-09-21T15:02:41.618 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:41 ntpd[13700]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-21T15:02:41.618 INFO:teuthology.orchestra.run.smithi082.stderr:21 Sep 15:02:41 ntpd[13700]: can't open /var/log/ntpstats/loopstats.20240921: Permission denied 2024-09-21T15:02:41.688 INFO:teuthology.orchestra.run.smithi082.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T15:02:41.688 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================== 2024-09-21T15:02:41.688 INFO:teuthology.orchestra.run.smithi082.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-21T15:02:41.688 INFO:teuthology.orchestra.run.smithi082.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-21T15:02:41.688 INFO:teuthology.orchestra.run.smithi082.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-21T15:02:41.688 INFO:teuthology.orchestra.run.smithi082.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-21T15:02:41.689 INFO:teuthology.run_tasks:Running task install... 2024-09-21T15:02:41.703 DEBUG:teuthology.task.install:project ceph 2024-09-21T15:02:41.703 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}} 2024-09-21T15:02:41.703 DEBUG:teuthology.task.install:config {'extra_packages': ['rbd-mirror'], 'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'} 2024-09-21T15:02:41.703 INFO:teuthology.task.install:Using flavor: default 2024-09-21T15:02:41.713 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T15:02:41.713 INFO:teuthology.task.install:extra packages: ['rbd-mirror'] 2024-09-21T15:02:41.714 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-key list | grep Ceph 2024-09-21T15:02:41.714 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-key list | grep Ceph 2024-09-21T15:02:41.810 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-21T15:02:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-21T15:02:41.871 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-21T15:02:41.871 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph.com (release key) 2024-09-21T15:02:41.872 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, rbd-mirror on remote deb x86_64 2024-09-21T15:02:41.872 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-21T15:02:41.877 INFO:teuthology.orchestra.run.smithi082.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-21T15:02:41.878 INFO:teuthology.orchestra.run.smithi082.stdout:uid [ unknown] Ceph.com (release key) 2024-09-21T15:02:41.878 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, rbd-mirror on remote deb x86_64 2024-09-21T15:02:41.878 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-21T15:02:42.021 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default/ 2024-09-21T15:02:42.021 INFO:teuthology.task.install.deb:Package version is 18.2.4-855-g19e2a2be-1focal 2024-09-21T15:02:42.028 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default/ 2024-09-21T15:02:42.028 INFO:teuthology.task.install.deb:Package version is 18.2.4-855-g19e2a2be-1focal 2024-09-21T15:02:42.133 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:02:42.133 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-21T15:02:42.141 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:02:42.142 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-21T15:02:42.149 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2024-09-21T15:02:42.158 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get update 2024-09-21T15:02:42.290 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-21T15:02:42.346 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal InRelease 2024-09-21T15:02:42.348 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-21T15:02:42.368 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-21T15:02:42.391 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal Release.gpg 2024-09-21T15:02:42.400 INFO:teuthology.orchestra.run.smithi082.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal InRelease 2024-09-21T15:02:42.407 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-21T15:02:42.412 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main i386 Packages [3,426 B] 2024-09-21T15:02:42.422 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-21T15:02:42.444 INFO:teuthology.orchestra.run.smithi082.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal Release.gpg 2024-09-21T15:02:42.445 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-21T15:02:42.464 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-21T15:02:42.466 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-21T15:02:42.489 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-21T15:02:42.499 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main i386 Packages [3,426 B] 2024-09-21T15:02:42.545 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-21T15:02:42.579 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-21T15:02:42.627 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-21T15:02:42.952 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 28.7 kB in 1s (45.1 kB/s) 2024-09-21T15:02:43.017 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 28.7 kB in 1s (44.3 kB/s) 2024-09-21T15:02:44.114 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-21T15:02:44.140 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-855-g19e2a2be-1focal cephadm=18.2.4-855-g19e2a2be-1focal ceph-mds=18.2.4-855-g19e2a2be-1focal ceph-mgr=18.2.4-855-g19e2a2be-1focal ceph-common=18.2.4-855-g19e2a2be-1focal ceph-fuse=18.2.4-855-g19e2a2be-1focal ceph-test=18.2.4-855-g19e2a2be-1focal ceph-volume=18.2.4-855-g19e2a2be-1focal radosgw=18.2.4-855-g19e2a2be-1focal python3-rados=18.2.4-855-g19e2a2be-1focal python3-rgw=18.2.4-855-g19e2a2be-1focal python3-cephfs=18.2.4-855-g19e2a2be-1focal python3-rbd=18.2.4-855-g19e2a2be-1focal libcephfs2=18.2.4-855-g19e2a2be-1focal libcephfs-dev=18.2.4-855-g19e2a2be-1focal librados2=18.2.4-855-g19e2a2be-1focal librbd1=18.2.4-855-g19e2a2be-1focal rbd-fuse=18.2.4-855-g19e2a2be-1focal rbd-mirror=18.2.4-855-g19e2a2be-1focal 2024-09-21T15:02:44.179 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2024-09-21T15:02:44.206 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-855-g19e2a2be-1focal cephadm=18.2.4-855-g19e2a2be-1focal ceph-mds=18.2.4-855-g19e2a2be-1focal ceph-mgr=18.2.4-855-g19e2a2be-1focal ceph-common=18.2.4-855-g19e2a2be-1focal ceph-fuse=18.2.4-855-g19e2a2be-1focal ceph-test=18.2.4-855-g19e2a2be-1focal ceph-volume=18.2.4-855-g19e2a2be-1focal radosgw=18.2.4-855-g19e2a2be-1focal python3-rados=18.2.4-855-g19e2a2be-1focal python3-rgw=18.2.4-855-g19e2a2be-1focal python3-cephfs=18.2.4-855-g19e2a2be-1focal python3-rbd=18.2.4-855-g19e2a2be-1focal libcephfs2=18.2.4-855-g19e2a2be-1focal libcephfs-dev=18.2.4-855-g19e2a2be-1focal librados2=18.2.4-855-g19e2a2be-1focal librbd1=18.2.4-855-g19e2a2be-1focal rbd-fuse=18.2.4-855-g19e2a2be-1focal rbd-mirror=18.2.4-855-g19e2a2be-1focal 2024-09-21T15:02:44.211 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-09-21T15:02:44.280 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2024-09-21T15:02:44.426 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-09-21T15:02:44.426 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-09-21T15:02:44.488 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2024-09-21T15:02:44.489 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2024-09-21T15:02:44.620 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T15:02:44.622 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-21T15:02:44.622 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T15:02:44.622 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2024-09-21T15:02:44.622 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-21T15:02:44.622 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-21T15:02:44.622 INFO:teuthology.orchestra.run.smithi161.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-21T15:02:44.622 INFO:teuthology.orchestra.run.smithi161.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-21T15:02:44.622 INFO:teuthology.orchestra.run.smithi161.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-21T15:02:44.623 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-21T15:02:44.624 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-21T15:02:44.625 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-21T15:02:44.625 INFO:teuthology.orchestra.run.smithi161.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-21T15:02:44.625 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2024-09-21T15:02:44.625 INFO:teuthology.orchestra.run.smithi161.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-21T15:02:44.625 INFO:teuthology.orchestra.run.smithi161.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-21T15:02:44.625 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-21T15:02:44.625 INFO:teuthology.orchestra.run.smithi161.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-21T15:02:44.625 INFO:teuthology.orchestra.run.smithi161.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-21T15:02:44.626 INFO:teuthology.orchestra.run.smithi161.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-21T15:02:44.626 INFO:teuthology.orchestra.run.smithi161.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-21T15:02:44.626 INFO:teuthology.orchestra.run.smithi161.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-21T15:02:44.626 INFO:teuthology.orchestra.run.smithi161.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-21T15:02:44.626 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2024-09-21T15:02:44.626 INFO:teuthology.orchestra.run.smithi161.stdout: btrfs-tools 2024-09-21T15:02:44.678 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T15:02:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-21T15:02:44.681 INFO:teuthology.orchestra.run.smithi082.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T15:02:44.681 INFO:teuthology.orchestra.run.smithi082.stdout:The following additional packages will be installed: 2024-09-21T15:02:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-21T15:02:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-21T15:02:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-21T15:02:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-21T15:02:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-21T15:02:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-21T15:02:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-21T15:02:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-21T15:02:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-21T15:02:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-09-21T15:02:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-09-21T15:02:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-21T15:02:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-21T15:02:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-21T15:02:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-21T15:02:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-21T15:02:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-21T15:02:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-21T15:02:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-21T15:02:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-21T15:02:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-21T15:02:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-21T15:02:44.684 INFO:teuthology.orchestra.run.smithi082.stdout:Suggested packages: 2024-09-21T15:02:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-21T15:02:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-21T15:02:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-21T15:02:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-21T15:02:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-21T15:02:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-21T15:02:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-21T15:02:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-21T15:02:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-21T15:02:44.684 INFO:teuthology.orchestra.run.smithi082.stdout:Recommended packages: 2024-09-21T15:02:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: btrfs-tools 2024-09-21T15:02:44.745 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2024-09-21T15:02:44.745 INFO:teuthology.orchestra.run.smithi161.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-21T15:02:44.745 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-21T15:02:44.745 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-21T15:02:44.747 INFO:teuthology.orchestra.run.smithi161.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-09-21T15:02:44.747 INFO:teuthology.orchestra.run.smithi161.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-09-21T15:02:44.747 INFO:teuthology.orchestra.run.smithi161.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-21T15:02:44.747 INFO:teuthology.orchestra.run.smithi161.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-09-21T15:02:44.747 INFO:teuthology.orchestra.run.smithi161.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-09-21T15:02:44.747 INFO:teuthology.orchestra.run.smithi161.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-09-21T15:02:44.748 INFO:teuthology.orchestra.run.smithi161.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-09-21T15:02:44.749 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse 2024-09-21T15:02:44.749 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror socat xmlstarlet 2024-09-21T15:02:44.749 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2024-09-21T15:02:44.749 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 librbd1 2024-09-21T15:02:44.800 INFO:teuthology.orchestra.run.smithi082.stdout:The following NEW packages will be installed: 2024-09-21T15:02:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-21T15:02:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-21T15:02:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-21T15:02:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-09-21T15:02:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-09-21T15:02:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-21T15:02:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-09-21T15:02:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-09-21T15:02:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-09-21T15:02:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-09-21T15:02:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-21T15:02:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-09-21T15:02:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-21T15:02:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-21T15:02:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-21T15:02:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-21T15:02:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-21T15:02:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-21T15:02:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-09-21T15:02:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-09-21T15:02:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-21T15:02:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-09-21T15:02:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-09-21T15:02:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse 2024-09-21T15:02:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror socat xmlstarlet 2024-09-21T15:02:44.804 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages will be upgraded: 2024-09-21T15:02:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 librbd1 2024-09-21T15:02:44.869 INFO:teuthology.orchestra.run.smithi082.stdout:2 upgraded, 111 newly installed, 0 to remove and 297 not upgraded. 2024-09-21T15:02:44.869 INFO:teuthology.orchestra.run.smithi082.stdout:Need to get 202 MB of archives. 2024-09-21T15:02:44.869 INFO:teuthology.orchestra.run.smithi082.stdout:After this operation, 993 MB of additional disk space will be used. 2024-09-21T15:02:44.869 INFO:teuthology.orchestra.run.smithi082.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-21T15:02:44.900 INFO:teuthology.orchestra.run.smithi161.stdout:2 upgraded, 111 newly installed, 0 to remove and 297 not upgraded. 2024-09-21T15:02:44.900 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 202 MB of archives. 2024-09-21T15:02:44.900 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 993 MB of additional disk space will be used. 2024-09-21T15:02:44.900 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-855-g19e2a2be-1focal [3,453 kB] 2024-09-21T15:02:44.942 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-21T15:02:44.953 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-21T15:02:44.955 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-855-g19e2a2be-1focal [3,453 kB] 2024-09-21T15:02:44.956 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-21T15:02:44.974 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-21T15:02:45.028 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-21T15:02:45.030 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-21T15:02:45.036 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-21T15:02:45.038 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-21T15:02:45.038 INFO:teuthology.orchestra.run.smithi082.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-21T15:02:45.039 INFO:teuthology.orchestra.run.smithi082.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-21T15:02:45.040 INFO:teuthology.orchestra.run.smithi082.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-21T15:02:45.043 INFO:teuthology.orchestra.run.smithi082.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-21T15:02:45.043 INFO:teuthology.orchestra.run.smithi082.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-21T15:02:45.046 INFO:teuthology.orchestra.run.smithi082.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-21T15:02:45.062 INFO:teuthology.orchestra.run.smithi082.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-21T15:02:45.063 INFO:teuthology.orchestra.run.smithi082.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-21T15:02:45.063 INFO:teuthology.orchestra.run.smithi082.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-21T15:02:45.064 INFO:teuthology.orchestra.run.smithi082.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-21T15:02:45.064 INFO:teuthology.orchestra.run.smithi082.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-21T15:02:45.065 INFO:teuthology.orchestra.run.smithi082.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-21T15:02:45.067 INFO:teuthology.orchestra.run.smithi082.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-21T15:02:45.067 INFO:teuthology.orchestra.run.smithi082.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-21T15:02:45.069 INFO:teuthology.orchestra.run.smithi082.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-21T15:02:45.080 INFO:teuthology.orchestra.run.smithi082.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-21T15:02:45.081 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-855-g19e2a2be-1focal [4,044 kB] 2024-09-21T15:02:45.088 INFO:teuthology.orchestra.run.smithi082.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-21T15:02:45.093 INFO:teuthology.orchestra.run.smithi082.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-21T15:02:45.094 INFO:teuthology.orchestra.run.smithi082.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-21T15:02:45.094 INFO:teuthology.orchestra.run.smithi082.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-21T15:02:45.095 INFO:teuthology.orchestra.run.smithi082.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-21T15:02:45.096 INFO:teuthology.orchestra.run.smithi082.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-21T15:02:45.099 INFO:teuthology.orchestra.run.smithi082.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-21T15:02:45.100 INFO:teuthology.orchestra.run.smithi082.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-21T15:02:45.102 INFO:teuthology.orchestra.run.smithi082.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-21T15:02:45.115 INFO:teuthology.orchestra.run.smithi082.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-21T15:02:45.117 INFO:teuthology.orchestra.run.smithi082.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-21T15:02:45.118 INFO:teuthology.orchestra.run.smithi082.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-21T15:02:45.119 INFO:teuthology.orchestra.run.smithi082.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-21T15:02:45.119 INFO:teuthology.orchestra.run.smithi082.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-21T15:02:45.120 INFO:teuthology.orchestra.run.smithi082.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-21T15:02:45.132 INFO:teuthology.orchestra.run.smithi082.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-21T15:02:45.132 INFO:teuthology.orchestra.run.smithi082.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-21T15:02:45.133 INFO:teuthology.orchestra.run.smithi082.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-21T15:02:45.134 INFO:teuthology.orchestra.run.smithi082.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-21T15:02:45.149 INFO:teuthology.orchestra.run.smithi082.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-21T15:02:45.150 INFO:teuthology.orchestra.run.smithi082.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-21T15:02:45.152 INFO:teuthology.orchestra.run.smithi082.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-21T15:02:45.154 INFO:teuthology.orchestra.run.smithi082.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-21T15:02:45.156 INFO:teuthology.orchestra.run.smithi082.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-21T15:02:45.156 INFO:teuthology.orchestra.run.smithi082.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-21T15:02:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-855-g19e2a2be-1focal [4,044 kB] 2024-09-21T15:02:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-21T15:02:45.190 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-855-g19e2a2be-1focal [746 kB] 2024-09-21T15:02:45.201 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-855-g19e2a2be-1focal [388 kB] 2024-09-21T15:02:45.223 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-855-g19e2a2be-1focal [31.9 kB] 2024-09-21T15:02:45.228 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-855-g19e2a2be-1focal [201 kB] 2024-09-21T15:02:45.232 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-855-g19e2a2be-1focal [62.5 kB] 2024-09-21T15:02:45.233 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-855-g19e2a2be-1focal [367 kB] 2024-09-21T15:02:45.239 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-855-g19e2a2be-1focal [6,627 kB] 2024-09-21T15:02:45.246 INFO:teuthology.orchestra.run.smithi082.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-21T15:02:45.262 INFO:teuthology.orchestra.run.smithi082.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-21T15:02:45.264 INFO:teuthology.orchestra.run.smithi082.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-21T15:02:45.317 INFO:teuthology.orchestra.run.smithi082.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-21T15:02:45.317 INFO:teuthology.orchestra.run.smithi082.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-21T15:02:45.317 INFO:teuthology.orchestra.run.smithi082.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-855-g19e2a2be-1focal [746 kB] 2024-09-21T15:02:45.317 INFO:teuthology.orchestra.run.smithi082.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-21T15:02:45.318 INFO:teuthology.orchestra.run.smithi082.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-21T15:02:45.340 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-21T15:02:45.354 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-21T15:02:45.363 INFO:teuthology.orchestra.run.smithi082.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-855-g19e2a2be-1focal [388 kB] 2024-09-21T15:02:45.363 INFO:teuthology.orchestra.run.smithi082.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-21T15:02:45.364 INFO:teuthology.orchestra.run.smithi082.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-21T15:02:45.365 INFO:teuthology.orchestra.run.smithi082.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-21T15:02:45.366 INFO:teuthology.orchestra.run.smithi082.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-21T15:02:45.367 INFO:teuthology.orchestra.run.smithi082.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-21T15:02:45.368 INFO:teuthology.orchestra.run.smithi082.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-21T15:02:45.369 INFO:teuthology.orchestra.run.smithi082.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-855-g19e2a2be-1focal [31.9 kB] 2024-09-21T15:02:45.370 INFO:teuthology.orchestra.run.smithi082.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-855-g19e2a2be-1focal [201 kB] 2024-09-21T15:02:45.373 INFO:teuthology.orchestra.run.smithi082.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-855-g19e2a2be-1focal [62.5 kB] 2024-09-21T15:02:45.373 INFO:teuthology.orchestra.run.smithi082.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-21T15:02:45.374 INFO:teuthology.orchestra.run.smithi082.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-855-g19e2a2be-1focal [367 kB] 2024-09-21T15:02:45.376 INFO:teuthology.orchestra.run.smithi082.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-21T15:02:45.380 INFO:teuthology.orchestra.run.smithi082.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-855-g19e2a2be-1focal [6,627 kB] 2024-09-21T15:02:45.381 INFO:teuthology.orchestra.run.smithi082.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-21T15:02:45.397 INFO:teuthology.orchestra.run.smithi082.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-21T15:02:45.401 INFO:teuthology.orchestra.run.smithi082.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-21T15:02:45.405 INFO:teuthology.orchestra.run.smithi082.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-21T15:02:45.423 INFO:teuthology.orchestra.run.smithi082.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-21T15:02:45.425 INFO:teuthology.orchestra.run.smithi082.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-21T15:02:45.427 INFO:teuthology.orchestra.run.smithi082.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-21T15:02:45.437 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-855-g19e2a2be-1focal [113 kB] 2024-09-21T15:02:45.438 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-21T15:02:45.439 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-855-g19e2a2be-1focal [478 kB] 2024-09-21T15:02:45.470 INFO:teuthology.orchestra.run.smithi082.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-21T15:02:45.471 INFO:teuthology.orchestra.run.smithi082.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-21T15:02:45.471 INFO:teuthology.orchestra.run.smithi082.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-21T15:02:45.471 INFO:teuthology.orchestra.run.smithi082.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-21T15:02:45.472 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-855-g19e2a2be-1focal [25.2 MB] 2024-09-21T15:02:45.483 INFO:teuthology.orchestra.run.smithi082.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-21T15:02:45.483 INFO:teuthology.orchestra.run.smithi082.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-21T15:02:45.484 INFO:teuthology.orchestra.run.smithi082.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-21T15:02:45.485 INFO:teuthology.orchestra.run.smithi082.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-21T15:02:45.485 INFO:teuthology.orchestra.run.smithi082.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-21T15:02:45.582 INFO:teuthology.orchestra.run.smithi082.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-855-g19e2a2be-1focal [113 kB] 2024-09-21T15:02:45.584 INFO:teuthology.orchestra.run.smithi082.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-855-g19e2a2be-1focal [478 kB] 2024-09-21T15:02:45.629 INFO:teuthology.orchestra.run.smithi082.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-855-g19e2a2be-1focal [25.2 MB] 2024-09-21T15:02:45.680 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-21T15:02:45.689 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-21T15:02:45.717 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-21T15:02:45.726 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-21T15:02:45.727 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-21T15:02:45.730 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-21T15:02:45.732 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-21T15:02:45.743 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-21T15:02:45.745 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-21T15:02:45.762 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-21T15:02:45.832 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-21T15:02:45.833 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-21T15:02:45.834 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-21T15:02:45.836 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-21T15:02:45.837 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-21T15:02:45.838 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-21T15:02:45.840 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-21T15:02:45.842 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-21T15:02:45.845 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-21T15:02:45.925 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-21T15:02:45.926 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-21T15:02:45.935 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-21T15:02:45.936 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-21T15:02:45.937 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-21T15:02:45.938 INFO:teuthology.orchestra.run.smithi161.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-21T15:02:45.939 INFO:teuthology.orchestra.run.smithi161.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-21T15:02:45.941 INFO:teuthology.orchestra.run.smithi161.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-21T15:02:46.007 INFO:teuthology.orchestra.run.smithi161.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-21T15:02:46.012 INFO:teuthology.orchestra.run.smithi161.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-21T15:02:46.088 INFO:teuthology.orchestra.run.smithi161.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-21T15:02:46.090 INFO:teuthology.orchestra.run.smithi161.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-21T15:02:46.091 INFO:teuthology.orchestra.run.smithi161.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-21T15:02:46.092 INFO:teuthology.orchestra.run.smithi161.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-21T15:02:46.093 INFO:teuthology.orchestra.run.smithi161.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-21T15:02:46.094 INFO:teuthology.orchestra.run.smithi161.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-21T15:02:46.095 INFO:teuthology.orchestra.run.smithi161.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-21T15:02:46.096 INFO:teuthology.orchestra.run.smithi161.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-21T15:02:46.169 INFO:teuthology.orchestra.run.smithi161.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-21T15:02:46.170 INFO:teuthology.orchestra.run.smithi161.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-21T15:02:46.178 INFO:teuthology.orchestra.run.smithi161.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-21T15:02:46.179 INFO:teuthology.orchestra.run.smithi161.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-21T15:02:46.182 INFO:teuthology.orchestra.run.smithi161.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-21T15:02:46.183 INFO:teuthology.orchestra.run.smithi161.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-21T15:02:46.251 INFO:teuthology.orchestra.run.smithi161.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-21T15:02:46.252 INFO:teuthology.orchestra.run.smithi161.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-21T15:02:46.253 INFO:teuthology.orchestra.run.smithi161.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-21T15:02:46.396 INFO:teuthology.orchestra.run.smithi161.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-855-g19e2a2be-1focal [9,605 kB] 2024-09-21T15:02:46.533 INFO:teuthology.orchestra.run.smithi161.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-21T15:02:46.536 INFO:teuthology.orchestra.run.smithi082.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-855-g19e2a2be-1focal [9,605 kB] 2024-09-21T15:02:46.638 INFO:teuthology.orchestra.run.smithi161.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-21T15:02:46.638 INFO:teuthology.orchestra.run.smithi161.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-855-g19e2a2be-1focal [238 kB] 2024-09-21T15:02:46.640 INFO:teuthology.orchestra.run.smithi161.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-21T15:02:46.644 INFO:teuthology.orchestra.run.smithi161.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-855-g19e2a2be-1focal [148 kB] 2024-09-21T15:02:46.647 INFO:teuthology.orchestra.run.smithi161.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-855-g19e2a2be-1focal [1,574 kB] 2024-09-21T15:02:46.658 INFO:teuthology.orchestra.run.smithi161.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-855-g19e2a2be-1focal [6,640 kB] 2024-09-21T15:02:46.677 INFO:teuthology.orchestra.run.smithi161.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-21T15:02:46.677 INFO:teuthology.orchestra.run.smithi161.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-21T15:02:46.678 INFO:teuthology.orchestra.run.smithi161.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-21T15:02:46.679 INFO:teuthology.orchestra.run.smithi161.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-21T15:02:46.679 INFO:teuthology.orchestra.run.smithi161.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-21T15:02:46.680 INFO:teuthology.orchestra.run.smithi161.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-21T15:02:46.680 INFO:teuthology.orchestra.run.smithi161.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-21T15:02:46.738 INFO:teuthology.orchestra.run.smithi161.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-21T15:02:46.739 INFO:teuthology.orchestra.run.smithi161.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-21T15:02:46.794 INFO:teuthology.orchestra.run.smithi082.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-855-g19e2a2be-1focal [238 kB] 2024-09-21T15:02:46.820 INFO:teuthology.orchestra.run.smithi161.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-21T15:02:46.822 INFO:teuthology.orchestra.run.smithi082.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-855-g19e2a2be-1focal [148 kB] 2024-09-21T15:02:46.825 INFO:teuthology.orchestra.run.smithi161.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-21T15:02:46.825 INFO:teuthology.orchestra.run.smithi082.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-855-g19e2a2be-1focal [1,574 kB] 2024-09-21T15:02:46.828 INFO:teuthology.orchestra.run.smithi161.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-21T15:02:46.832 INFO:teuthology.orchestra.run.smithi161.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-21T15:02:46.834 INFO:teuthology.orchestra.run.smithi161.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-21T15:02:46.837 INFO:teuthology.orchestra.run.smithi161.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-21T15:02:46.839 INFO:teuthology.orchestra.run.smithi161.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-21T15:02:46.845 INFO:teuthology.orchestra.run.smithi161.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-855-g19e2a2be-1focal [24.5 MB] 2024-09-21T15:02:46.877 INFO:teuthology.orchestra.run.smithi082.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-855-g19e2a2be-1focal [6,640 kB] 2024-09-21T15:02:46.911 INFO:teuthology.orchestra.run.smithi161.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-21T15:02:46.916 INFO:teuthology.orchestra.run.smithi161.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-21T15:02:46.918 INFO:teuthology.orchestra.run.smithi161.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-21T15:02:47.078 INFO:teuthology.orchestra.run.smithi161.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-21T15:02:47.079 INFO:teuthology.orchestra.run.smithi161.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-21T15:02:47.079 INFO:teuthology.orchestra.run.smithi161.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-21T15:02:47.109 INFO:teuthology.orchestra.run.smithi082.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-855-g19e2a2be-1focal [24.5 MB] 2024-09-21T15:02:47.109 INFO:teuthology.orchestra.run.smithi161.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-21T15:02:47.146 INFO:teuthology.orchestra.run.smithi161.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-21T15:02:47.146 INFO:teuthology.orchestra.run.smithi161.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-21T15:02:47.148 INFO:teuthology.orchestra.run.smithi161.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-21T15:02:47.148 INFO:teuthology.orchestra.run.smithi161.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-21T15:02:47.149 INFO:teuthology.orchestra.run.smithi161.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-21T15:02:47.646 INFO:teuthology.orchestra.run.smithi161.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-855-g19e2a2be-1focal [13.7 kB] 2024-09-21T15:02:47.647 INFO:teuthology.orchestra.run.smithi161.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-855-g19e2a2be-1focal [856 kB] 2024-09-21T15:02:47.658 INFO:teuthology.orchestra.run.smithi161.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-855-g19e2a2be-1focal [2,295 kB] 2024-09-21T15:02:47.690 INFO:teuthology.orchestra.run.smithi161.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-855-g19e2a2be-1focal [239 kB] 2024-09-21T15:02:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-855-g19e2a2be-1focal [143 kB] 2024-09-21T15:02:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-855-g19e2a2be-1focal [7,015 kB] 2024-09-21T15:02:47.910 INFO:teuthology.orchestra.run.smithi161.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-855-g19e2a2be-1focal [7,893 kB] 2024-09-21T15:02:48.122 INFO:teuthology.orchestra.run.smithi082.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-855-g19e2a2be-1focal [13.7 kB] 2024-09-21T15:02:48.123 INFO:teuthology.orchestra.run.smithi161.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-855-g19e2a2be-1focal [13.9 kB] 2024-09-21T15:02:48.123 INFO:teuthology.orchestra.run.smithi161.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-855-g19e2a2be-1focal [46.9 MB] 2024-09-21T15:02:48.123 INFO:teuthology.orchestra.run.smithi082.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-855-g19e2a2be-1focal [856 kB] 2024-09-21T15:02:48.136 INFO:teuthology.orchestra.run.smithi082.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-855-g19e2a2be-1focal [2,295 kB] 2024-09-21T15:02:48.153 INFO:teuthology.orchestra.run.smithi082.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-855-g19e2a2be-1focal [239 kB] 2024-09-21T15:02:48.155 INFO:teuthology.orchestra.run.smithi082.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-855-g19e2a2be-1focal [143 kB] 2024-09-21T15:02:48.156 INFO:teuthology.orchestra.run.smithi082.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-855-g19e2a2be-1focal [7,015 kB] 2024-09-21T15:02:48.405 INFO:teuthology.orchestra.run.smithi082.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-855-g19e2a2be-1focal [7,893 kB] 2024-09-21T15:02:48.691 INFO:teuthology.orchestra.run.smithi082.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-855-g19e2a2be-1focal [13.9 kB] 2024-09-21T15:02:48.691 INFO:teuthology.orchestra.run.smithi082.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-855-g19e2a2be-1focal [46.9 MB] 2024-09-21T15:02:49.740 INFO:teuthology.orchestra.run.smithi161.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-855-g19e2a2be-1focal [120 kB] 2024-09-21T15:02:49.743 INFO:teuthology.orchestra.run.smithi161.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-855-g19e2a2be-1focal [37.4 kB] 2024-09-21T15:02:49.744 INFO:teuthology.orchestra.run.smithi161.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-855-g19e2a2be-1focal [13.5 MB] 2024-09-21T15:02:50.070 INFO:teuthology.orchestra.run.smithi161.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-855-g19e2a2be-1focal [108 kB] 2024-09-21T15:02:50.074 INFO:teuthology.orchestra.run.smithi161.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 rbd-mirror amd64 18.2.4-855-g19e2a2be-1focal [3,476 kB] 2024-09-21T15:02:50.426 INFO:teuthology.orchestra.run.smithi082.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-855-g19e2a2be-1focal [120 kB] 2024-09-21T15:02:50.428 INFO:teuthology.orchestra.run.smithi082.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-855-g19e2a2be-1focal [37.4 kB] 2024-09-21T15:02:50.429 INFO:teuthology.orchestra.run.smithi082.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-855-g19e2a2be-1focal [13.5 MB] 2024-09-21T15:02:50.604 INFO:teuthology.orchestra.run.smithi082.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-855-g19e2a2be-1focal [108 kB] 2024-09-21T15:02:50.605 INFO:teuthology.orchestra.run.smithi082.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/focal/flavors/default focal/main amd64 rbd-mirror amd64 18.2.4-855-g19e2a2be-1focal [3,476 kB] 2024-09-21T15:02:50.827 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 202 MB in 5s (37.4 MB/s) 2024-09-21T15:02:51.010 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-21T15:02:51.069 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-21T15:02:51.074 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-21T15:02:51.159 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-21T15:02:51.317 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 202 MB in 6s (34.5 MB/s) 2024-09-21T15:02:51.489 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-21T15:02:51.529 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-21T15:02:51.545 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-21T15:02:51.548 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-21T15:02:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-21T15:02:51.587 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-21T15:02:51.662 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-21T15:02:51.948 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-21T15:02:51.966 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-21T15:02:52.007 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-21T15:02:52.016 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-21T15:02:52.033 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-21T15:02:52.099 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-21T15:02:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-21T15:02:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-21T15:02:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-21T15:02:52.493 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-21T15:02:52.510 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-21T15:02:52.571 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-21T15:02:52.939 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-21T15:02:52.958 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-21T15:02:53.008 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-21T15:02:53.080 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-21T15:02:53.095 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-21T15:02:53.163 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-21T15:02:53.516 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-21T15:02:53.525 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-21T15:02:53.533 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-21T15:02:53.541 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-21T15:02:53.574 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-21T15:02:53.584 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-21T15:02:53.944 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-21T15:02:53.945 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-21T15:02:53.961 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-21T15:02:53.961 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-21T15:02:54.002 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-21T15:02:54.003 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-21T15:02:54.365 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../007-librbd1_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:02:54.415 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-21T15:02:54.431 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-21T15:02:54.473 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-21T15:02:54.514 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librbd1 (18.2.4-855-g19e2a2be-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-21T15:02:54.893 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../007-librbd1_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:02:55.018 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librbd1 (18.2.4-855-g19e2a2be-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-21T15:02:55.210 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../008-librados2_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:02:55.335 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librados2 (18.2.4-855-g19e2a2be-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-21T15:02:55.708 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../008-librados2_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:02:55.806 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librados2 (18.2.4-855-g19e2a2be-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-21T15:02:56.080 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs2. 2024-09-21T15:02:56.096 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../009-libcephfs2_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:02:56.138 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs2 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:02:56.508 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rados. 2024-09-21T15:02:56.523 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../010-python3-rados_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:02:56.566 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rados (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:02:56.577 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libcephfs2. 2024-09-21T15:02:56.593 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../009-libcephfs2_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:02:56.635 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libcephfs2 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:02:56.935 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-21T15:02:56.951 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:02:56.987 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rados. 2024-09-21T15:02:57.002 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-argparse (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:02:57.003 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../010-python3-rados_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:02:57.046 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rados (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:02:57.263 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cephfs. 2024-09-21T15:02:57.278 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../012-python3-cephfs_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:02:57.321 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cephfs (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:02:57.398 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-21T15:02:57.414 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:02:57.458 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-ceph-argparse (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:02:57.674 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-21T15:02:57.690 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:02:57.718 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cephfs. 2024-09-21T15:02:57.731 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-common (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:02:57.735 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../012-python3-cephfs_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:02:57.767 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cephfs (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:02:58.051 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-prettytable. 2024-09-21T15:02:58.069 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-09-21T15:02:58.118 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-21T15:02:58.120 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-21T15:02:58.136 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:02:58.178 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-ceph-common (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:02:58.371 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rbd. 2024-09-21T15:02:58.388 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../015-python3-rbd_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:02:58.429 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rbd (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:02:58.498 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-prettytable. 2024-09-21T15:02:58.514 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-09-21T15:02:58.573 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-21T15:02:58.798 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-21T15:02:58.814 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-21T15:02:58.826 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rbd. 2024-09-21T15:02:58.841 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../015-python3-rbd_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:02:58.856 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-21T15:02:58.884 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rbd (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:02:59.212 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-21T15:02:59.226 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-21T15:02:59.227 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-21T15:02:59.244 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-21T15:02:59.261 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-21T15:02:59.284 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-21T15:02:59.648 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-21T15:02:59.654 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-21T15:02:59.664 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-21T15:02:59.670 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-21T15:02:59.706 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-21T15:02:59.712 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-21T15:03:00.059 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-21T15:03:00.064 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librgw2. 2024-09-21T15:03:00.075 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../019-librgw2_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:00.076 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-21T15:03:00.114 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librgw2 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:00.186 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-21T15:03:00.479 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librgw2. 2024-09-21T15:03:00.497 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../019-librgw2_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:00.584 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librgw2 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:01.284 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rgw. 2024-09-21T15:03:01.299 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:01.358 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rgw (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:01.472 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rgw. 2024-09-21T15:03:01.488 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:01.530 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rgw (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:01.695 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liboath0. 2024-09-21T15:03:01.711 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-21T15:03:01.770 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-21T15:03:01.850 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liboath0. 2024-09-21T15:03:01.869 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-21T15:03:01.900 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-21T15:03:02.047 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libradosstriper1. 2024-09-21T15:03:02.065 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:02.105 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libradosstriper1 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libradosstriper1. 2024-09-21T15:03:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:02.286 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libradosstriper1 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:02.600 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-common. 2024-09-21T15:03:02.618 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../023-ceph-common_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:02.692 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-common (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:02.723 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-common. 2024-09-21T15:03:02.743 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../023-ceph-common_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:02.802 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-common (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:05.205 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-base. 2024-09-21T15:03:05.232 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../024-ceph-base_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:05.265 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-base (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:05.288 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-base. 2024-09-21T15:03:05.304 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../024-ceph-base_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:05.358 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-base (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:06.493 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-21T15:03:06.510 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-21T15:03:06.551 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-21T15:03:06.618 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-21T15:03:06.633 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-21T15:03:06.667 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-21T15:03:06.913 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-natsort. 2024-09-21T15:03:06.932 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-09-21T15:03:06.971 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-21T15:03:06.987 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-natsort. 2024-09-21T15:03:07.007 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-09-21T15:03:07.062 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-21T15:03:07.299 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-logutils. 2024-09-21T15:03:07.315 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-09-21T15:03:07.332 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-logutils. 2024-09-21T15:03:07.348 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-09-21T15:03:07.357 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-21T15:03:07.382 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-21T15:03:07.684 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-21T15:03:07.693 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-21T15:03:07.702 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-21T15:03:07.709 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-21T15:03:07.742 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-21T15:03:07.751 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-21T15:03:08.054 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-mako. 2024-09-21T15:03:08.072 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-21T15:03:08.087 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-mako. 2024-09-21T15:03:08.105 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-21T15:03:08.120 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-21T15:03:08.145 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-21T15:03:08.423 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-21T15:03:08.442 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-21T15:03:08.457 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-21T15:03:08.473 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-21T15:03:08.481 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-21T15:03:08.515 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-21T15:03:08.743 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-21T15:03:08.760 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-21T15:03:08.801 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-21T15:03:08.827 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-21T15:03:08.842 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-21T15:03:08.885 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-21T15:03:09.128 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webob. 2024-09-21T15:03:09.138 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webob. 2024-09-21T15:03:09.148 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-21T15:03:09.156 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-21T15:03:09.187 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-21T15:03:09.204 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-21T15:03:09.482 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-21T15:03:09.500 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-21T15:03:09.523 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-21T15:03:09.539 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-21T15:03:09.540 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-21T15:03:09.581 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-21T15:03:09.860 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-bs4. 2024-09-21T15:03:09.876 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-09-21T15:03:09.908 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bs4. 2024-09-21T15:03:09.918 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-21T15:03:09.926 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-09-21T15:03:09.967 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-21T15:03:10.289 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-waitress. 2024-09-21T15:03:10.305 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-21T15:03:10.341 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-21T15:03:10.353 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-waitress. 2024-09-21T15:03:10.369 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-21T15:03:10.415 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-21T15:03:10.649 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-tempita. 2024-09-21T15:03:10.665 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-09-21T15:03:10.707 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-21T15:03:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempita. 2024-09-21T15:03:10.784 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-09-21T15:03:10.823 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-21T15:03:11.027 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-paste. 2024-09-21T15:03:11.043 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-21T15:03:11.085 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-21T15:03:11.109 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-paste. 2024-09-21T15:03:11.128 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-21T15:03:11.167 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-21T15:03:11.406 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-21T15:03:11.422 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-21T15:03:11.463 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-21T15:03:11.529 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-21T15:03:11.546 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-21T15:03:11.586 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-21T15:03:11.791 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-21T15:03:11.807 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-21T15:03:11.849 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-21T15:03:11.914 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-21T15:03:11.931 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-21T15:03:11.972 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-21T15:03:12.153 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webtest. 2024-09-21T15:03:12.169 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-09-21T15:03:12.211 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-21T15:03:12.292 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webtest. 2024-09-21T15:03:12.308 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-09-21T15:03:12.350 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-21T15:03:12.547 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pecan. 2024-09-21T15:03:12.564 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-21T15:03:12.605 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-21T15:03:12.703 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pecan. 2024-09-21T15:03:12.719 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-21T15:03:12.761 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-21T15:03:12.952 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-21T15:03:12.971 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-21T15:03:13.010 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-21T15:03:13.116 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-21T15:03:13.132 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-21T15:03:13.174 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-21T15:03:13.294 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-21T15:03:13.311 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:03:13.352 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:13.498 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-21T15:03:13.515 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:03:13.556 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:13.725 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-21T15:03:13.741 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:13.782 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:13.953 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-21T15:03:13.970 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:14.020 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:14.119 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-21T15:03:14.135 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-21T15:03:14.177 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-21T15:03:14.381 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-21T15:03:14.398 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-21T15:03:14.439 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-21T15:03:14.488 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cryptography. 2024-09-21T15:03:14.505 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-21T15:03:14.546 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-21T15:03:14.788 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cryptography. 2024-09-21T15:03:14.808 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-21T15:03:14.858 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-21T15:03:14.883 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-openssl. 2024-09-21T15:03:14.903 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-21T15:03:14.958 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-21T15:03:15.254 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-openssl. 2024-09-21T15:03:15.271 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-21T15:03:15.295 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr. 2024-09-21T15:03:15.312 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-21T15:03:15.312 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../048-ceph-mgr_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:15.353 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:15.648 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr. 2024-09-21T15:03:15.666 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../048-ceph-mgr_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:15.723 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:15.832 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mon. 2024-09-21T15:03:15.848 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../049-ceph-mon_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:15.890 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mon (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:16.226 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mon. 2024-09-21T15:03:16.245 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../049-ceph-mon_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:16.284 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mon (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:17.506 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-osd. 2024-09-21T15:03:17.522 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../050-ceph-osd_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:17.564 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-osd (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:17.884 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-osd. 2024-09-21T15:03:17.904 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../050-ceph-osd_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:17.942 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-osd (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:19.800 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph. 2024-09-21T15:03:19.816 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../051-ceph_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:19.850 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:20.087 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph. 2024-09-21T15:03:20.105 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../051-ceph_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:20.127 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-fuse. 2024-09-21T15:03:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../052-ceph-fuse_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:20.153 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:20.185 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-fuse (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:20.513 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-fuse. 2024-09-21T15:03:20.530 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../052-ceph-fuse_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-fuse (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:20.588 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mds. 2024-09-21T15:03:20.607 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../053-ceph-mds_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:20.646 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mds (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:21.024 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mds. 2024-09-21T15:03:21.041 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../053-ceph-mds_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:21.082 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mds (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:21.174 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephadm. 2024-09-21T15:03:21.194 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../054-cephadm_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:21.232 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephadm (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:21.586 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephadm. 2024-09-21T15:03:21.586 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-21T15:03:21.601 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-21T15:03:21.604 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../054-cephadm_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:21.643 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephadm (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:21.643 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-21T15:03:21.996 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-21T15:03:22.014 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-21T15:03:22.031 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-jinja2. 2024-09-21T15:03:22.050 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-21T15:03:22.053 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-21T15:03:22.088 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-21T15:03:22.432 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jinja2. 2024-09-21T15:03:22.450 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-21T15:03:22.458 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-21T15:03:22.476 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:03:22.490 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-21T15:03:22.516 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:22.843 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-21T15:03:22.861 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:03:22.895 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-jwt. 2024-09-21T15:03:22.901 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:22.912 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-21T15:03:22.953 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-21T15:03:23.239 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-attr. 2024-09-21T15:03:23.256 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-09-21T15:03:23.288 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jwt. 2024-09-21T15:03:23.297 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-21T15:03:23.306 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-21T15:03:23.346 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-21T15:03:23.650 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pluggy. 2024-09-21T15:03:23.670 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-09-21T15:03:23.699 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-attr. 2024-09-21T15:03:23.708 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-21T15:03:23.715 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-09-21T15:03:23.757 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-21T15:03:24.028 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-py. 2024-09-21T15:03:24.047 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-21T15:03:24.086 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-21T15:03:24.110 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pluggy. 2024-09-21T15:03:24.126 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-09-21T15:03:24.168 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-21T15:03:24.414 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-21T15:03:24.435 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-21T15:03:24.506 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-21T15:03:24.513 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-py. 2024-09-21T15:03:24.530 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-21T15:03:24.562 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-21T15:03:24.809 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-packaging. 2024-09-21T15:03:24.825 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-09-21T15:03:24.857 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-21T15:03:24.867 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-21T15:03:24.874 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-21T15:03:24.932 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-21T15:03:25.211 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-21T15:03:25.229 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-21T15:03:25.234 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-packaging. 2024-09-21T15:03:25.250 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-09-21T15:03:25.269 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-21T15:03:25.309 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-21T15:03:25.581 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pytest. 2024-09-21T15:03:25.599 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-09-21T15:03:25.620 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-21T15:03:25.638 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-21T15:03:25.640 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-21T15:03:25.687 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-21T15:03:25.975 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-21T15:03:25.992 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-09-21T15:03:26.014 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pytest. 2024-09-21T15:03:26.030 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-09-21T15:03:26.033 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-21T15:03:26.072 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-21T15:03:26.303 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjs-underscore. 2024-09-21T15:03:26.320 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-21T15:03:26.361 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-21T15:03:26.459 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-21T15:03:26.475 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-09-21T15:03:26.517 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-21T15:03:26.631 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-21T15:03:26.651 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-21T15:03:26.690 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-21T15:03:26.786 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjs-underscore. 2024-09-21T15:03:26.803 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-21T15:03:26.844 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-21T15:03:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-routes. 2024-09-21T15:03:27.025 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-09-21T15:03:27.091 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-21T15:03:27.139 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-21T15:03:27.160 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-21T15:03:27.200 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-21T15:03:27.395 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-21T15:03:27.415 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:03:27.453 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:27.486 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-routes. 2024-09-21T15:03:27.504 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-09-21T15:03:27.544 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-21T15:03:27.880 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-21T15:03:27.900 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:03:27.947 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:28.875 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-decorator. 2024-09-21T15:03:28.892 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-21T15:03:28.933 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-21T15:03:29.245 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-21T15:03:29.263 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-21T15:03:29.303 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-21T15:03:29.369 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-decorator. 2024-09-21T15:03:29.388 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-21T15:03:29.443 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-21T15:03:29.597 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-scipy. 2024-09-21T15:03:29.615 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-21T15:03:29.655 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-21T15:03:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-21T15:03:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-21T15:03:29.804 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-21T15:03:30.141 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-scipy. 2024-09-21T15:03:30.158 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-21T15:03:30.199 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-21T15:03:31.014 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-21T15:03:31.033 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-21T15:03:31.072 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-21T15:03:31.516 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-21T15:03:31.533 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-21T15:03:31.574 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-21T15:03:31.626 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-joblib. 2024-09-21T15:03:31.642 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-09-21T15:03:31.684 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-21T15:03:32.130 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-sklearn. 2024-09-21T15:03:32.146 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-21T15:03:32.187 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-21T15:03:32.194 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-joblib. 2024-09-21T15:03:32.211 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-09-21T15:03:32.252 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-21T15:03:32.639 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn. 2024-09-21T15:03:32.657 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-21T15:03:32.696 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-21T15:03:33.279 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-21T15:03:33.297 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:03:33.337 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:33.738 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-21T15:03:33.755 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:03:33.796 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:34.475 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cachetools. 2024-09-21T15:03:34.491 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-09-21T15:03:34.532 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-21T15:03:34.861 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-21T15:03:34.877 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-21T15:03:34.900 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cachetools. 2024-09-21T15:03:34.910 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-21T15:03:34.918 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-09-21T15:03:34.958 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-21T15:03:35.239 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-21T15:03:35.259 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-21T15:03:35.296 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-21T15:03:35.319 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-21T15:03:35.335 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-21T15:03:35.377 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-21T15:03:35.711 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rsa. 2024-09-21T15:03:35.729 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-09-21T15:03:35.730 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-21T15:03:35.747 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-21T15:03:35.769 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-21T15:03:35.797 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-21T15:03:36.081 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-google-auth. 2024-09-21T15:03:36.098 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-09-21T15:03:36.139 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-21T15:03:36.220 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rsa. 2024-09-21T15:03:36.240 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-09-21T15:03:36.277 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-21T15:03:36.460 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-blinker. 2024-09-21T15:03:36.479 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-21T15:03:36.518 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-21T15:03:36.615 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-google-auth. 2024-09-21T15:03:36.631 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-09-21T15:03:36.665 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-21T15:03:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-21T15:03:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-21T15:03:36.908 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-21T15:03:36.979 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-blinker. 2024-09-21T15:03:36.997 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-21T15:03:37.038 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-21T15:03:37.272 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-21T15:03:37.289 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-21T15:03:37.330 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-21T15:03:37.349 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-21T15:03:37.369 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-21T15:03:37.407 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-21T15:03:37.641 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-websocket. 2024-09-21T15:03:37.657 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-21T15:03:37.716 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-21T15:03:37.761 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-21T15:03:37.778 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-21T15:03:37.819 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-21T15:03:38.053 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-21T15:03:38.072 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-21T15:03:38.110 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-21T15:03:38.155 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-websocket. 2024-09-21T15:03:38.174 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-21T15:03:38.213 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-21T15:03:38.525 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-21T15:03:38.542 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-21T15:03:38.608 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-21T15:03:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-21T15:03:38.701 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:03:38.741 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:39.077 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-21T15:03:39.096 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-09-21T15:03:39.135 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-21T15:03:39.139 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-21T15:03:39.158 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:03:39.197 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:39.517 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-21T15:03:39.533 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-21T15:03:39.558 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-21T15:03:39.574 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-21T15:03:39.575 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-09-21T15:03:39.619 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-21T15:03:39.878 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package jq. 2024-09-21T15:03:39.896 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-21T15:03:39.936 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-21T15:03:39.989 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-21T15:03:40.006 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-21T15:03:40.047 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-21T15:03:40.172 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package socat. 2024-09-21T15:03:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-09-21T15:03:40.229 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-21T15:03:40.317 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package jq. 2024-09-21T15:03:40.334 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-21T15:03:40.400 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-21T15:03:40.560 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package xmlstarlet. 2024-09-21T15:03:40.577 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-21T15:03:40.618 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-21T15:03:40.653 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package socat. 2024-09-21T15:03:40.670 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-09-21T15:03:40.710 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-21T15:03:40.989 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-test. 2024-09-21T15:03:41.006 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../094-ceph-test_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:41.047 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-test (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:41.074 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package xmlstarlet. 2024-09-21T15:03:41.092 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-21T15:03:41.132 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-21T15:03:41.529 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-test. 2024-09-21T15:03:41.545 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../094-ceph-test_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:41.586 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-test (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-volume. 2024-09-21T15:03:45.185 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../095-ceph-volume_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:03:45.225 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-volume (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:45.538 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-21T15:03:45.556 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-21T15:03:45.587 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-21T15:03:45.807 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-volume. 2024-09-21T15:03:45.824 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../095-ceph-volume_18.2.4-855-g19e2a2be-1focal_all.deb ... 2024-09-21T15:03:45.886 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-volume (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:46.149 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-21T15:03:46.168 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:46.169 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-21T15:03:46.186 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-21T15:03:46.207 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libcephfs-dev (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:46.226 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-21T15:03:46.618 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package nvme-cli. 2024-09-21T15:03:46.635 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-21T15:03:46.694 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-21T15:03:46.730 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-21T15:03:46.749 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:46.821 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs-dev (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:47.014 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-21T15:03:47.031 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-21T15:03:47.072 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-21T15:03:47.241 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package nvme-cli. 2024-09-21T15:03:47.261 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-21T15:03:47.317 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-21T15:03:47.443 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-21T15:03:47.461 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-21T15:03:47.535 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-21T15:03:47.629 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-21T15:03:47.646 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-21T15:03:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-21T15:03:48.066 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-21T15:03:48.083 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-21T15:03:48.149 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-21T15:03:49.108 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-21T15:03:49.127 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-21T15:03:49.166 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-21T15:03:49.519 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webencodings. 2024-09-21T15:03:49.537 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-21T15:03:49.577 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-21T15:03:49.789 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-21T15:03:49.808 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-21T15:03:49.839 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-21T15:03:49.913 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-html5lib. 2024-09-21T15:03:49.932 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-09-21T15:03:49.970 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-21T15:03:50.167 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webencodings. 2024-09-21T15:03:50.184 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-21T15:03:50.225 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-21T15:03:50.291 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-21T15:03:50.309 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-21T15:03:50.349 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-21T15:03:50.553 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-html5lib. 2024-09-21T15:03:50.571 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-09-21T15:03:50.611 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-21T15:03:50.827 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pastescript. 2024-09-21T15:03:50.843 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-09-21T15:03:50.885 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-21T15:03:50.980 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-21T15:03:50.998 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-21T15:03:51.038 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-21T15:03:51.188 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-psutil. 2024-09-21T15:03:51.206 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-21T15:03:51.254 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-21T15:03:51.508 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastescript. 2024-09-21T15:03:51.527 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-09-21T15:03:51.567 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-21T15:03:51.583 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-21T15:03:51.599 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-21T15:03:51.640 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-21T15:03:51.912 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-psutil. 2024-09-21T15:03:51.928 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-21T15:03:51.970 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-21T15:03:51.976 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-simplejson. 2024-09-21T15:03:51.994 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-21T15:03:52.034 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-21T15:03:52.306 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-21T15:03:52.326 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-21T15:03:52.337 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-21T15:03:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-21T15:03:52.364 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-21T15:03:52.395 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-21T15:03:52.675 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplejson. 2024-09-21T15:03:52.692 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-21T15:03:52.758 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-21T15:03:53.002 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-21T15:03:53.020 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-21T15:03:53.060 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-21T15:03:53.094 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package radosgw. 2024-09-21T15:03:53.110 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../110-radosgw_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:53.151 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking radosgw (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:53.767 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package radosgw. 2024-09-21T15:03:53.784 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../110-radosgw_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:53.824 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking radosgw (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:54.579 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package rbd-fuse. 2024-09-21T15:03:54.596 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../111-rbd-fuse_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:54.638 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking rbd-fuse (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:54.999 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package rbd-mirror. 2024-09-21T15:03:55.015 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../112-rbd-mirror_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:55.057 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking rbd-mirror (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:55.230 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-fuse. 2024-09-21T15:03:55.248 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../111-rbd-fuse_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:55.288 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-fuse (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:55.641 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-mirror. 2024-09-21T15:03:55.659 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../112-rbd-mirror_18.2.4-855-g19e2a2be-1focal_amd64.deb ... 2024-09-21T15:03:55.699 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-mirror (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:55.718 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-21T15:03:56.028 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-21T15:03:56.154 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-21T15:03:56.280 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-21T15:03:56.310 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-21T15:03:56.509 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephadm (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:56.620 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-21T15:03:56.746 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-21T15:03:56.897 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-21T15:03:57.085 INFO:teuthology.orchestra.run.smithi082.stdout:Adding system user cephadm....done 2024-09-21T15:03:57.092 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephadm (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:03:57.248 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-21T15:03:57.374 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-21T15:03:57.652 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user cephadm....done 2024-09-21T15:03:57.708 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-21T15:03:57.840 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-21T15:03:57.966 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-21T15:03:57.968 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-21T15:03:58.102 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-21T15:03:58.238 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-21T15:03:58.301 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-21T15:03:58.581 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-21T15:03:58.589 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-21T15:03:58.721 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-21T15:03:58.847 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-21T15:03:58.983 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-21T15:03:59.173 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-21T15:03:59.242 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-21T15:03:59.502 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-21T15:03:59.567 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-21T15:03:59.803 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-21T15:03:59.834 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-21T15:04:00.095 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-ceph-argparse (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:00.102 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-21T15:04:00.403 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-21T15:04:00.421 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-21T15:04:00.564 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-21T15:04:00.696 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-argparse (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:00.840 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-21T15:04:00.989 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-21T15:04:01.115 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-21T15:04:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-21T15:04:01.275 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-21T15:04:01.407 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-21T15:04:01.643 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-21T15:04:01.700 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-21T15:04:01.851 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-21T15:04:01.936 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-21T15:04:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-21T15:04:02.244 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-21T15:04:02.537 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-21T15:04:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-21T15:04:02.830 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-21T15:04:02.881 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-21T15:04:03.156 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-21T15:04:03.207 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-21T15:04:03.431 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-21T15:04:03.483 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-21T15:04:03.791 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-21T15:04:04.075 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-21T15:04:04.159 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-21T15:04:04.285 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-21T15:04:04.411 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-21T15:04:04.651 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-21T15:04:04.721 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-21T15:04:04.777 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-21T15:04:04.903 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-21T15:04:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-21T15:04:05.179 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-21T15:04:05.490 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-21T15:04:05.589 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-21T15:04:05.858 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-21T15:04:05.949 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-21T15:04:05.984 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-ceph-common (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:06.285 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-21T15:04:06.334 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-21T15:04:06.419 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-21T15:04:06.493 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-common (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:06.762 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-21T15:04:06.819 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-21T15:04:06.888 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-21T15:04:06.979 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-21T15:04:07.014 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-21T15:04:07.315 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-21T15:04:07.355 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-21T15:04:07.481 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-21T15:04:07.607 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-21T15:04:07.658 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-21T15:04:07.784 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-21T15:04:07.900 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-21T15:04:07.910 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-21T15:04:08.223 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-21T15:04:08.237 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-21T15:04:08.377 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-21T15:04:08.504 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-21T15:04:08.511 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-21T15:04:08.789 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-21T15:04:08.829 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-21T15:04:08.914 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-21T15:04:09.138 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-21T15:04:09.215 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-21T15:04:09.439 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-21T15:04:09.491 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-21T15:04:09.590 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-21T15:04:09.776 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-21T15:04:09.866 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-21T15:04:10.138 INFO:teuthology.orchestra.run.smithi082.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-21T15:04:10.159 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-21T15:04:10.387 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-21T15:04:10.477 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-21T15:04:10.513 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-21T15:04:10.839 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-21T15:04:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-21T15:04:11.138 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-21T15:04:11.173 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-21T15:04:11.264 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-21T15:04:11.332 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-21T15:04:11.458 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-21T15:04:11.615 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-21T15:04:11.818 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-21T15:04:11.957 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-21T15:04:12.083 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-21T15:04:12.102 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-21T15:04:12.209 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-21T15:04:12.552 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-21T15:04:12.845 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-21T15:04:13.560 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-21T15:04:13.685 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-21T15:04:14.053 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-21T15:04:14.309 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-21T15:04:14.363 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-21T15:04:14.434 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-21T15:04:14.673 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-21T15:04:14.798 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-21T15:04:14.836 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-21T15:04:15.112 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-21T15:04:15.141 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-21T15:04:15.422 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-21T15:04:15.485 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-21T15:04:15.547 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-21T15:04:15.861 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-21T15:04:15.890 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-21T15:04:16.200 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-21T15:04:16.229 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-21T15:04:16.627 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-21T15:04:16.945 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-21T15:04:17.259 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-21T15:04:17.385 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-21T15:04:17.511 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-21T15:04:17.662 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-21T15:04:17.955 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-21T15:04:17.974 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-21T15:04:18.103 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-21T15:04:18.125 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-21T15:04:18.251 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-21T15:04:18.377 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-21T15:04:18.407 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-21T15:04:18.670 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-21T15:04:18.692 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-21T15:04:18.796 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-21T15:04:18.976 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-21T15:04:19.097 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-21T15:04:19.320 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librados2 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:19.382 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-21T15:04:19.480 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-21T15:04:19.606 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librgw2 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:19.708 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-21T15:04:19.757 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:19.951 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libcephfs2 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:20.034 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librados2 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:20.069 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-21T15:04:20.161 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-21T15:04:20.287 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librgw2 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:20.379 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libradosstriper1 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:20.429 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:20.505 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-21T15:04:20.640 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs2 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:20.791 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-21T15:04:20.831 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librbd1 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:20.957 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:21.067 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-fuse (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:21.093 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libradosstriper1 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:21.260 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-21T15:04:21.266 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T15:04:21.266 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T15:04:21.562 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librbd1 (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:21.713 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:21.726 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libcephfs-dev (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:21.847 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-fuse (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:21.869 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rados (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:21.995 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-21T15:04:22.071 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T15:04:22.072 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T15:04:22.524 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs-dev (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:22.675 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rados (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:22.784 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-21T15:04:22.916 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rbd (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:23.042 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up rbd-fuse (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:23.168 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rgw (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:23.293 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cephfs (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:23.442 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-common (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:23.704 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rbd (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:23.830 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-fuse (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:23.981 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rgw (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:24.022 INFO:teuthology.orchestra.run.smithi082.stdout:Adding group ceph....done 2024-09-21T15:04:24.107 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cephfs (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:24.233 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-common (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:24.382 INFO:teuthology.orchestra.run.smithi082.stdout:Adding system user ceph....done 2024-09-21T15:04:24.584 INFO:teuthology.orchestra.run.smithi082.stdout:Setting system user ceph properties....done 2024-09-21T15:04:24.607 INFO:teuthology.orchestra.run.smithi082.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-21T15:04:24.762 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-21T15:04:24.803 INFO:teuthology.orchestra.run.smithi161.stdout:Adding group ceph....done 2024-09-21T15:04:25.083 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-21T15:04:25.187 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user ceph....done 2024-09-21T15:04:25.371 INFO:teuthology.orchestra.run.smithi161.stdout:Setting system user ceph properties....done 2024-09-21T15:04:25.396 INFO:teuthology.orchestra.run.smithi161.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-21T15:04:25.546 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-21T15:04:25.593 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-test (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:25.755 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up radosgw (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:25.871 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-21T15:04:26.228 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T15:04:26.228 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T15:04:26.334 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-test (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:26.460 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up radosgw (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:26.725 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-base (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:26.932 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T15:04:26.932 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T15:04:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-21T15:04:27.387 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-base (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:27.535 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mds (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:27.791 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T15:04:27.791 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T15:04:27.795 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-21T15:04:28.238 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mds (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:28.253 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up rbd-mirror (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:28.468 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T15:04:28.468 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T15:04:28.489 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T15:04:28.489 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T15:04:28.915 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-mirror (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:28.946 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:29.141 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T15:04:29.141 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T15:04:29.176 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T15:04:29.176 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T15:04:29.574 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:29.693 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-osd (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:29.804 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T15:04:29.804 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T15:04:30.251 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-osd (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:30.442 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T15:04:30.442 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T15:04:30.747 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T15:04:30.748 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T15:04:30.917 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:31.042 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:31.185 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mon (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:31.211 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:31.337 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:31.409 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T15:04:31.409 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T15:04:31.480 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mon (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:31.728 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T15:04:31.728 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T15:04:31.887 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:32.030 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:32.155 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:32.172 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:32.281 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-volume (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:32.315 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:32.474 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:32.617 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-volume (18.2.4-855-g19e2a2be-1focal) ... 2024-09-21T15:04:32.660 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-21T15:04:32.811 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-21T15:04:32.970 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-21T15:04:33.104 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-21T15:04:33.122 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-21T15:04:33.398 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-21T15:04:35.943 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-21T15:04:36.284 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-21T15:04:36.525 INFO:teuthology.orchestra.run.smithi082.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-21T15:04:36.530 DEBUG:teuthology.parallel:result is None 2024-09-21T15:04:36.900 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-21T15:04:36.905 DEBUG:teuthology.parallel:result is None 2024-09-21T15:04:36.905 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-21T15:04:37.055 DEBUG:teuthology.orchestra.run.smithi082:> dpkg-query -W -f '${Version}' ceph 2024-09-21T15:04:37.079 INFO:teuthology.orchestra.run.smithi082.stdout:18.2.4-855-g19e2a2be-1focal 2024-09-21T15:04:37.079 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-855-g19e2a2be-1focal 2024-09-21T15:04:37.079 INFO:teuthology.task.install:The correct ceph version 18.2.4-855-g19e2a2be-1focal is installed. 2024-09-21T15:04:37.081 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-21T15:04:37.218 DEBUG:teuthology.orchestra.run.smithi161:> dpkg-query -W -f '${Version}' ceph 2024-09-21T15:04:37.240 INFO:teuthology.orchestra.run.smithi161.stdout:18.2.4-855-g19e2a2be-1focal 2024-09-21T15:04:37.241 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-855-g19e2a2be-1focal 2024-09-21T15:04:37.241 INFO:teuthology.task.install:The correct ceph version 18.2.4-855-g19e2a2be-1focal is installed. 2024-09-21T15:04:37.242 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T15:04:37.242 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:37.242 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T15:04:37.259 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:37.259 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T15:04:37.274 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T15:04:37.274 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:37.274 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T15:04:37.287 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T15:04:37.303 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:37.303 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T15:04:37.316 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T15:04:37.373 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T15:04:37.373 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:37.374 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T15:04:37.389 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T15:04:37.400 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:37.400 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T15:04:37.414 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T15:04:37.425 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T15:04:37.425 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:37.426 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T15:04:37.439 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T15:04:37.496 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:37.497 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T15:04:37.512 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T15:04:37.527 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T15:04:37.590 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T15:04:37.591 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /var/log/ceph 2024-09-21T15:04:37.593 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2024-09-21T15:04:37.607 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T15:04:37.607 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T15:04:37.651 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T15:04:37.666 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T15:04:37.666 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T15:04:37.668 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T15:04:37.698 INFO:tasks.ceph:Creating ceph cluster cluster1... 2024-09-21T15:04:37.698 INFO:tasks.ceph:config {'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'none'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'cluster1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T15:04:37.698 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909963', 'branch': 'reef', 'description': 'rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_20.04} workloads/rbd-mirror-fsx-workunit}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7909963', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': 'run two ceph clusters and install rbd-mirror'}, {'desc': 'configure the permissions for client.mirror'}, {'desc': '2 ceph clusters with 1 mon and 3 osds each'}, {'desc': 'run four rbd-mirror daemons per cluster'}, {'desc': 'run multiple FSX workloads to simulate cluster load and then verify that the images were replicated'}], 'name': 'teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'none'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': 'a477b1894d5c5a613f23260ca0e6b96d79652ba7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'], ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6']], 'seed': 4623, 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9', 'sleep_before_teardown': 0, 'subset': '80/128', 'suite': 'rbd', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_a477b1894d5c5a613f23260ca0e6b96d79652ba7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'a477b1894d5c5a613f23260ca0e6b96d79652ba7', 'targets': {'smithi082.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': ['rbd-mirror'], 'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}}, {'ceph': {'cluster': 'cluster1', 'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'none'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}}, {'ceph': {'cluster': 'cluster2'}}, {'exec': {'cluster1.client.mirror.0': ["sudo ceph --cluster cluster1 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'"]}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.0', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.1', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.2', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.3', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.0', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.1', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.2', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.3', 'thrash': True}}, {'rbd-mirror-thrash': {'cluster': 'cluster1'}}, {'rbd-mirror-thrash': {'cluster': 'cluster2'}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/rbd_mirror_fsx_prepare.sh']}, 'env': {'CEPH_ARGS': '', 'RBD_MIRROR_NOCLEANUP': '1', 'RBD_MIRROR_USE_EXISTING_CLUSTER': '1', 'RBD_MIRROR_USE_RBD_MIRROR': '1'}}}, {'rbd_fsx': {'clients': ['cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5'], 'keep_images': True, 'ops': 6000, 'pool_name': 'mirror'}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/rbd_mirror_fsx_compare.sh']}, 'env': {'CEPH_ARGS': '', 'RBD_MIRROR_USE_EXISTING_CLUSTER': '1', 'RBD_MIRROR_USE_RBD_MIRROR': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_22:16:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T15:04:37.698 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/cluster1.data 2024-09-21T15:04:37.701 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/cluster1.data 2024-09-21T15:04:37.729 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T15:04:37.751 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T15:04:37.768 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:37.768 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T15:04:37.774 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T15:04:37.774 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-09-21T15:04:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T15:04:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T15:04:37.824 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 369 Links: 1 2024-09-21T15:04:37.824 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T15:04:37.824 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-21 15:01:07.516718005 +0000 2024-09-21T15:04:37.824 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-21 15:01:07.512718098 +0000 2024-09-21T15:04:37.824 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-21 15:01:07.512718098 +0000 2024-09-21T15:04:37.825 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-09-21T15:04:37.825 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T15:04:37.840 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-21T15:04:37.841 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-21T15:04:37.841 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000437424 s, 1.2 MB/s 2024-09-21T15:04:37.842 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T15:04:37.850 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-09-21T15:04:37.900 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T15:04:37.900 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T15:04:37.901 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 378 Links: 1 2024-09-21T15:04:37.901 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T15:04:37.901 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-21 15:01:07.908708963 +0000 2024-09-21T15:04:37.901 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-21 15:01:07.904709055 +0000 2024-09-21T15:04:37.901 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-21 15:01:07.904709055 +0000 2024-09-21T15:04:37.901 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-09-21T15:04:37.901 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T15:04:37.912 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-21T15:04:37.912 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-21T15:04:37.912 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000402315 s, 1.3 MB/s 2024-09-21T15:04:37.914 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T15:04:37.922 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-09-21T15:04:37.972 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T15:04:37.972 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T15:04:37.972 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 381 Links: 1 2024-09-21T15:04:37.972 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T15:04:37.972 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-21 15:01:08.552694108 +0000 2024-09-21T15:04:37.973 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-21 15:01:08.336699091 +0000 2024-09-21T15:04:37.973 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-21 15:01:08.336699091 +0000 2024-09-21T15:04:37.973 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-09-21T15:04:37.973 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T15:04:37.985 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-21T15:04:37.985 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-21T15:04:37.985 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000426625 s, 1.2 MB/s 2024-09-21T15:04:37.986 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T15:04:37.995 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-09-21T15:04:38.000 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T15:04:38.000 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T15:04:38.000 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 388 Links: 1 2024-09-21T15:04:38.000 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T15:04:38.000 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-21 15:01:08.976684328 +0000 2024-09-21T15:04:38.000 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-21 15:01:08.792688572 +0000 2024-09-21T15:04:38.000 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-21 15:01:08.792688572 +0000 2024-09-21T15:04:38.000 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-09-21T15:04:38.000 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T15:04:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-21T15:04:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-21T15:04:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000363816 s, 1.4 MB/s 2024-09-21T15:04:38.013 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T15:04:38.062 INFO:tasks.ceph:osd dev map: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-21T15:04:38.062 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-21T15:04:38.062 INFO:tasks.ceph:Generating config... 2024-09-21T15:04:38.063 INFO:tasks.ceph:[client] debug rbd = 20 2024-09-21T15:04:38.063 INFO:tasks.ceph:[client] debug rbd_mirror = 15 2024-09-21T15:04:38.063 INFO:tasks.ceph:[client] log to stderr = False 2024-09-21T15:04:38.063 INFO:tasks.ceph:[client] rbd default features = 125 2024-09-21T15:04:38.063 INFO:tasks.ceph:[client] rbd mirror image policy type = none 2024-09-21T15:04:38.063 INFO:tasks.ceph:[client.mirror.0] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:04:38.063 INFO:tasks.ceph:[client.mirror.0] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:04:38.063 INFO:tasks.ceph:[client.mirror.1] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:04:38.063 INFO:tasks.ceph:[client.mirror.1] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:04:38.063 INFO:tasks.ceph:[client.mirror.2] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:04:38.064 INFO:tasks.ceph:[client.mirror.2] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:04:38.064 INFO:tasks.ceph:[client.mirror.3] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:04:38.064 INFO:tasks.ceph:[client.mirror.3] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:04:38.064 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-21T15:04:38.064 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-21T15:04:38.064 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-21T15:04:38.064 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T15:04:38.064 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T15:04:38.064 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T15:04:38.064 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T15:04:38.064 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T15:04:38.064 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T15:04:38.064 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-21T15:04:38.064 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-21T15:04:38.064 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T15:04:38.064 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T15:04:38.064 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T15:04:38.065 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T15:04:38.065 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T15:04:38.065 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T15:04:38.065 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T15:04:38.065 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T15:04:38.065 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T15:04:38.065 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T15:04:38.065 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T15:04:38.065 INFO:tasks.ceph:Setting up cluster1.mon.a... 2024-09-21T15:04:38.065 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/cluster1.keyring 2024-09-21T15:04:38.101 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/cluster1.keyring 2024-09-21T15:04:38.109 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/cluster1.keyring 2024-09-21T15:04:38.148 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/cluster1.keyring 2024-09-21T15:04:38.161 DEBUG:tasks.ceph:Ceph mon addresses: [('cluster1.mon.a', '172.21.15.82')] 2024-09-21T15:04:38.161 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.82', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'none'}, 'mon.a': {}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}} 2024-09-21T15:04:38.162 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:38.162 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T15:04:38.167 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.82 --print /home/ubuntu/cephtest/cluster1.monmap 2024-09-21T15:04:38.250 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: monmap file /home/ubuntu/cephtest/cluster1.monmap 2024-09-21T15:04:38.250 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: generated fsid 3d5e90c8-5967-4045-8599-22a44e1f8eb4 2024-09-21T15:04:38.250 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = pacific 2024-09-21T15:04:38.250 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 0 2024-09-21T15:04:38.250 INFO:teuthology.orchestra.run.smithi082.stdout:fsid 3d5e90c8-5967-4045-8599-22a44e1f8eb4 2024-09-21T15:04:38.250 INFO:teuthology.orchestra.run.smithi082.stdout:last_changed 2024-09-21T15:04:38.251744+0000 2024-09-21T15:04:38.250 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-21T15:04:38.251744+0000 2024-09-21T15:04:38.250 INFO:teuthology.orchestra.run.smithi082.stdout:min_mon_release 16 (pacific) 2024-09-21T15:04:38.250 INFO:teuthology.orchestra.run.smithi082.stdout:election_strategy: 1 2024-09-21T15:04:38.250 INFO:teuthology.orchestra.run.smithi082.stdout:0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-09-21T15:04:38.250 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/cluster1.monmap (1 monitors) 2024-09-21T15:04:38.251 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T15:04:38.258 INFO:tasks.ceph:Writing /etc/ceph/cluster1.conf for FSID 3d5e90c8-5967-4045-8599-22a44e1f8eb4... 2024-09-21T15:04:38.259 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster1.conf && sudo chmod 0644 /etc/ceph/cluster1.conf > /dev/null 2024-09-21T15:04:38.261 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster1.conf && sudo chmod 0644 /etc/ceph/cluster1.conf > /dev/null 2024-09-21T15:04:38.292 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-09-21T15:04:38.292 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.293 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2024-09-21T15:04:38.294 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = 172.21.15.82 2024-09-21T15:04:38.295 INFO:teuthology.orchestra.run.smithi082.stdout: mon client directed command retry = 5 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on pool no app = False 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: ms inject socket failures = 5000 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 3d5e90c8-5967-4045-8599-22a44e1f8eb4 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2024-09-21T15:04:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2024-09-21T15:04:38.297 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore compression algorithm = snappy 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore compression mode = aggressive 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 1/20 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 1/20 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 4/10 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.298 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2024-09-21T15:04:38.299 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2024-09-21T15:04:38.300 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout: debug rbd = 20 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout: debug rbd_mirror = 15 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout: log to stderr = False 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout: rbd default features = 125 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout: rbd mirror image policy type = none 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.0] 2024-09-21T15:04:38.301 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:04:38.302 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:04:38.302 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.1] 2024-09-21T15:04:38.302 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:04:38.302 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:04:38.302 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.2] 2024-09-21T15:04:38.302 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:04:38.302 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:04:38.302 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.3] 2024-09-21T15:04:38.302 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:04:38.302 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2024-09-21T15:04:38.303 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T15:04:38.304 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = 172.21.15.82 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: mon client directed command retry = 5 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on pool no app = False 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: ms inject socket failures = 5000 2024-09-21T15:04:38.305 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = 3d5e90c8-5967-4045-8599-22a44e1f8eb4 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2024-09-21T15:04:38.306 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2024-09-21T15:04:38.307 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore compression algorithm = snappy 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore compression mode = aggressive 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 1/20 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 1/20 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 4/10 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2024-09-21T15:04:38.308 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2024-09-21T15:04:38.309 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2024-09-21T15:04:38.310 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout: debug rbd = 20 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout: debug rbd_mirror = 15 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout: log to stderr = False 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout: rbd default features = 125 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout: rbd mirror image policy type = none 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.0] 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.1] 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:04:38.311 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.2] 2024-09-21T15:04:38.312 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:04:38.312 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:04:38.312 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.3] 2024-09-21T15:04:38.312 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:04:38.312 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:04:38.313 INFO:tasks.ceph:Creating admin key on cluster1.mon.a... 2024-09-21T15:04:38.313 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/cluster1.keyring 2024-09-21T15:04:38.407 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T15:04:38.407 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:38.407 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/cluster1.keyring of=/dev/stdout 2024-09-21T15:04:38.414 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:38.414 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/cluster1.monmap of=/dev/stdout 2024-09-21T15:04:38.420 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2024-09-21T15:04:38.420 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:38.420 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/cluster1.keyring 2024-09-21T15:04:38.420 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/cluster1.keyring 2024-09-21T15:04:38.444 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:38.444 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/cluster1.monmap 2024-09-21T15:04:38.492 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2024-09-21T15:04:38.492 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:38.492 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/cluster1.keyring 2024-09-21T15:04:38.492 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/cluster1.keyring 2024-09-21T15:04:38.518 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:38.519 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/cluster1.monmap 2024-09-21T15:04:38.524 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T15:04:38.524 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T15:04:38.524 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mgr/cluster1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/cluster1-x/keyring 2024-09-21T15:04:38.573 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mgr/cluster1-x/keyring 2024-09-21T15:04:38.576 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T15:04:38.576 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T15:04:38.576 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/cluster1.client.0.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.0.keyring 2024-09-21T15:04:38.612 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/cluster1.client.0.keyring 2024-09-21T15:04:38.625 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror /etc/ceph/cluster1.client.mirror.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.keyring 2024-09-21T15:04:38.666 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster1.client.mirror.keyring 2024-09-21T15:04:38.698 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.0 /etc/ceph/cluster1.client.mirror.0.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.0.keyring 2024-09-21T15:04:38.740 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster1.client.mirror.0.keyring 2024-09-21T15:04:38.753 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.1 /etc/ceph/cluster1.client.mirror.1.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.1.keyring 2024-09-21T15:04:38.789 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster1.client.mirror.1.keyring 2024-09-21T15:04:38.800 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.2 /etc/ceph/cluster1.client.mirror.2.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.2.keyring 2024-09-21T15:04:38.884 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster1.client.mirror.2.keyring 2024-09-21T15:04:38.897 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.3 /etc/ceph/cluster1.client.mirror.3.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.3.keyring 2024-09-21T15:04:38.933 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster1.client.mirror.3.keyring 2024-09-21T15:04:38.944 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.4 /etc/ceph/cluster1.client.mirror.4.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.4.keyring 2024-09-21T15:04:38.983 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster1.client.mirror.4.keyring 2024-09-21T15:04:38.994 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.5 /etc/ceph/cluster1.client.mirror.5.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.5.keyring 2024-09-21T15:04:39.029 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster1.client.mirror.5.keyring 2024-09-21T15:04:39.042 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.6 /etc/ceph/cluster1.client.mirror.6.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.6.keyring 2024-09-21T15:04:39.123 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster1.client.mirror.6.keyring 2024-09-21T15:04:39.136 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T15:04:39.137 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-21T15:04:39.137 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/cluster1-0 2024-09-21T15:04:39.153 INFO:tasks.ceph:roles_to_devs: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-21T15:04:39.153 INFO:tasks.ceph:role: cluster1.osd.0 2024-09-21T15:04:39.153 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-21T15:04:39.153 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T15:04:39.674 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T15:04:39.674 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T15:04:39.674 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T15:04:39.674 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2024-09-21T15:04:39.674 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T15:04:39.674 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-09-21T15:04:39.674 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T15:04:39.674 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T15:04:39.674 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T15:04:39.675 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T15:04:39.676 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-09-21T15:04:39.676 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/cluster1-0 2024-09-21T15:04:39.771 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-0 2024-09-21T15:04:39.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T15:04:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T15:04:39.783 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/cluster1-1 2024-09-21T15:04:39.796 INFO:tasks.ceph:roles_to_devs: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-21T15:04:39.796 INFO:tasks.ceph:role: cluster1.osd.1 2024-09-21T15:04:39.796 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-21T15:04:39.796 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T15:04:40.324 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T15:04:40.324 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T15:04:40.324 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T15:04:40.324 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2024-09-21T15:04:40.324 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T15:04:40.325 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-09-21T15:04:40.325 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T15:04:40.325 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T15:04:40.325 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T15:04:40.325 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T15:04:40.326 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-09-21T15:04:40.327 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/cluster1-1 2024-09-21T15:04:40.389 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-1 2024-09-21T15:04:40.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T15:04:40.400 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T15:04:40.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/cluster1-2 2024-09-21T15:04:40.412 INFO:tasks.ceph:roles_to_devs: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-21T15:04:40.412 INFO:tasks.ceph:role: cluster1.osd.2 2024-09-21T15:04:40.412 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-21T15:04:40.412 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T15:04:40.927 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T15:04:40.928 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T15:04:40.928 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T15:04:40.928 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 2024-09-21T15:04:40.928 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T15:04:40.928 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-09-21T15:04:40.928 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T15:04:40.928 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T15:04:40.928 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T15:04:40.928 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T15:04:40.930 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-09-21T15:04:40.930 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/cluster1-2 2024-09-21T15:04:40.986 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-2 2024-09-21T15:04:40.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T15:04:41.000 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T15:04:41.000 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/cluster1.monmap 2024-09-21T15:04:41.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:41.070+0000 7fec8db5e880 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-0/keyring: can't open /var/lib/ceph/osd/cluster1-0/keyring: (2) No such file or directory 2024-09-21T15:04:41.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:41.070+0000 7fec8db5e880 -1 created new key in keyring /var/lib/ceph/osd/cluster1-0/keyring 2024-09-21T15:04:41.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:41.070+0000 7fec8db5e880 -1 bluestore(/var/lib/ceph/osd/cluster1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-0/block: (2) No such file or directory 2024-09-21T15:04:41.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:41.070+0000 7fec8db5e880 -1 bluestore(/var/lib/ceph/osd/cluster1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-0/block: (2) No such file or directory 2024-09-21T15:04:41.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:41.070+0000 7fec8db5e880 -1 bluestore(/var/lib/ceph/osd/cluster1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-0/block: (2) No such file or directory 2024-09-21T15:04:41.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:41.070+0000 7fec8db5e880 -1 bluestore(/var/lib/ceph/osd/cluster1-0) _read_fsid unparsable uuid 2024-09-21T15:04:44.073 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-0 2024-09-21T15:04:44.088 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/cluster1.monmap 2024-09-21T15:04:44.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:44.174+0000 7f56f7b88880 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-1/keyring: can't open /var/lib/ceph/osd/cluster1-1/keyring: (2) No such file or directory 2024-09-21T15:04:44.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:44.174+0000 7f56f7b88880 -1 created new key in keyring /var/lib/ceph/osd/cluster1-1/keyring 2024-09-21T15:04:44.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:44.174+0000 7f56f7b88880 -1 bluestore(/var/lib/ceph/osd/cluster1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-1/block: (2) No such file or directory 2024-09-21T15:04:44.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:44.174+0000 7f56f7b88880 -1 bluestore(/var/lib/ceph/osd/cluster1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-1/block: (2) No such file or directory 2024-09-21T15:04:44.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:44.174+0000 7f56f7b88880 -1 bluestore(/var/lib/ceph/osd/cluster1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-1/block: (2) No such file or directory 2024-09-21T15:04:44.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:44.174+0000 7f56f7b88880 -1 bluestore(/var/lib/ceph/osd/cluster1-1) _read_fsid unparsable uuid 2024-09-21T15:04:47.205 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-1 2024-09-21T15:04:47.221 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/cluster1.monmap 2024-09-21T15:04:47.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:47.266+0000 7fdb7a81b880 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-2/keyring: can't open /var/lib/ceph/osd/cluster1-2/keyring: (2) No such file or directory 2024-09-21T15:04:47.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:47.266+0000 7fdb7a81b880 -1 created new key in keyring /var/lib/ceph/osd/cluster1-2/keyring 2024-09-21T15:04:47.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:47.266+0000 7fdb7a81b880 -1 bluestore(/var/lib/ceph/osd/cluster1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-2/block: (2) No such file or directory 2024-09-21T15:04:47.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:47.266+0000 7fdb7a81b880 -1 bluestore(/var/lib/ceph/osd/cluster1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-2/block: (2) No such file or directory 2024-09-21T15:04:47.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:47.266+0000 7fdb7a81b880 -1 bluestore(/var/lib/ceph/osd/cluster1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-2/block: (2) No such file or directory 2024-09-21T15:04:47.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:04:47.266+0000 7fdb7a81b880 -1 bluestore(/var/lib/ceph/osd/cluster1-2) _read_fsid unparsable uuid 2024-09-21T15:04:50.265 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-2 2024-09-21T15:04:50.282 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T15:04:50.282 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:50.283 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mgr/cluster1-x/keyring of=/dev/stdout 2024-09-21T15:04:50.298 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:50.298 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/cluster1-0/keyring of=/dev/stdout 2024-09-21T15:04:50.308 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:50.308 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/cluster1-1/keyring of=/dev/stdout 2024-09-21T15:04:50.320 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:50.320 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/cluster1-2/keyring of=/dev/stdout 2024-09-21T15:04:50.335 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:50.335 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/cluster1.client.0.keyring of=/dev/stdout 2024-09-21T15:04:50.341 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:50.341 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster1.client.mirror.keyring of=/dev/stdout 2024-09-21T15:04:50.348 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:50.348 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster1.client.mirror.0.keyring of=/dev/stdout 2024-09-21T15:04:50.355 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:50.355 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster1.client.mirror.1.keyring of=/dev/stdout 2024-09-21T15:04:50.404 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:50.405 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster1.client.mirror.2.keyring of=/dev/stdout 2024-09-21T15:04:50.411 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:50.411 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster1.client.mirror.3.keyring of=/dev/stdout 2024-09-21T15:04:50.418 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:50.418 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster1.client.mirror.4.keyring of=/dev/stdout 2024-09-21T15:04:50.424 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:50.424 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster1.client.mirror.5.keyring of=/dev/stdout 2024-09-21T15:04:50.473 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:04:50.473 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster1.client.mirror.6.keyring of=/dev/stdout 2024-09-21T15:04:50.480 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T15:04:50.480 DEBUG:teuthology.orchestra.run.smithi082:> sudo tee -a /etc/ceph/cluster1.keyring 2024-09-21T15:04:50.495 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.x] 2024-09-21T15:04:50.495 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCG4O5mzUJWIhAAhqeIHfr5qfZTtWogWLJfcg== 2024-09-21T15:04:50.495 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.0] 2024-09-21T15:04:50.495 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCJ4O5mj3FcBBAAuIz4+Wx+rClup4tiDi70Kg== 2024-09-21T15:04:50.495 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.1] 2024-09-21T15:04:50.495 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCM4O5mSfiyChAAAU3b9X8L5O7dWvqgL4XTYQ== 2024-09-21T15:04:50.495 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.2] 2024-09-21T15:04:50.495 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCP4O5m4CIcEBAAPfie9lZMdft/ANsqjcusQg== 2024-09-21T15:04:50.495 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-09-21T15:04:50.495 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCG4O5moNanJBAAPQLsa7RW+LMFs/JWF1Jhqg== 2024-09-21T15:04:50.495 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror] 2024-09-21T15:04:50.495 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCG4O5mtvi0JxAAsMgYekcV8NvTjA19cUcfRg== 2024-09-21T15:04:50.495 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.0] 2024-09-21T15:04:50.496 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCG4O5m1PwZLBAAuXM6np5lO72OOaMM7+rukQ== 2024-09-21T15:04:50.496 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.1] 2024-09-21T15:04:50.496 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCG4O5mXlYRLxAAV2JDC6LrVrTehtiyqGHWJg== 2024-09-21T15:04:50.496 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.2] 2024-09-21T15:04:50.496 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCG4O5mZ1a3NBAAvdavNek64+Fnuxy1llfUbQ== 2024-09-21T15:04:50.496 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.3] 2024-09-21T15:04:50.496 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCG4O5mS1+iNxAA9s0Mzeu0XOz1265WhGOgnw== 2024-09-21T15:04:50.496 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.4] 2024-09-21T15:04:50.496 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCG4O5mfV6TOhAA6WMHgSaZENM5pD0LQ4AUiA== 2024-09-21T15:04:50.496 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.5] 2024-09-21T15:04:50.496 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCH4O5mGmXDARAA6QKfURaurFSHrsNgwKsWQw== 2024-09-21T15:04:50.496 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.6] 2024-09-21T15:04:50.496 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQCH4O5mXMdXBxAA0NvOEEhzpQl05iBv6tdoQg== 2024-09-21T15:04:50.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T15:04:50.593 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T15:04:50.642 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T15:04:50.687 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T15:04:50.730 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:04:50.775 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:04:50.829 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:04:50.876 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:04:50.922 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:04:50.968 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:04:51.015 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.4 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:04:51.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.5 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:04:51.108 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.6 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:04:51.154 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T15:04:51.154 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/cluster1-a 2024-09-21T15:04:51.164 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster cluster1 --mkfs -i a --monmap /home/ubuntu/cephtest/cluster1.monmap --keyring /etc/ceph/cluster1.keyring 2024-09-21T15:04:51.247 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/cluster1-a 2024-09-21T15:04:51.262 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/cluster1.monmap 2024-09-21T15:04:51.311 INFO:tasks.ceph:Starting mon daemons in cluster cluster1... 2024-09-21T15:04:51.311 INFO:tasks.ceph.cluster1.mon.a:Restarting daemon 2024-09-21T15:04:51.312 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster cluster1 -i a 2024-09-21T15:04:51.314 INFO:tasks.ceph.cluster1.mon.a:Started 2024-09-21T15:04:51.314 INFO:tasks.ceph:Starting mgr daemons in cluster cluster1... 2024-09-21T15:04:51.314 INFO:tasks.ceph.cluster1.mgr.x:Restarting daemon 2024-09-21T15:04:51.314 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster cluster1 -i x 2024-09-21T15:04:51.316 INFO:tasks.ceph.cluster1.mgr.x:Started 2024-09-21T15:04:51.316 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T15:04:51.316 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster cluster1 osd crush tunables default 2024-09-21T15:04:51.570 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2024-09-21T15:04:51.581 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T15:04:51.581 INFO:tasks.ceph:Starting osd daemons in cluster cluster1... 2024-09-21T15:04:51.582 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:51.582 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/cluster1-0/fsid of=/dev/stdout 2024-09-21T15:04:51.597 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:51.597 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/cluster1-1/fsid of=/dev/stdout 2024-09-21T15:04:51.653 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:04:51.654 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/cluster1-2/fsid of=/dev/stdout 2024-09-21T15:04:51.668 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster cluster1 osd new 750f15d1-ed0f-415d-8d81-053598e8966f 0 2024-09-21T15:04:51.719 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:51.718+0000 7f816a1cd2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T15:04:51.870 INFO:teuthology.orchestra.run.smithi082.stdout:0 2024-09-21T15:04:51.883 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster cluster1 osd new 871323ec-1b6a-401b-9971-073189a1a664 1 2024-09-21T15:04:52.085 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-09-21T15:04:52.098 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster cluster1 osd new f249cce2-e258-47b8-88ad-519b283e30c5 2 2024-09-21T15:04:52.305 INFO:teuthology.orchestra.run.smithi082.stdout:2 2024-09-21T15:04:52.318 INFO:tasks.ceph.cluster1.osd.0:Restarting daemon 2024-09-21T15:04:52.318 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 0 2024-09-21T15:04:52.320 INFO:tasks.ceph.cluster1.osd.0:Started 2024-09-21T15:04:52.320 INFO:tasks.ceph.cluster1.osd.1:Restarting daemon 2024-09-21T15:04:52.320 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 1 2024-09-21T15:04:52.322 INFO:tasks.ceph.cluster1.osd.1:Started 2024-09-21T15:04:52.322 INFO:tasks.ceph.cluster1.osd.2:Restarting daemon 2024-09-21T15:04:52.322 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 2 2024-09-21T15:04:52.324 INFO:tasks.ceph.cluster1.osd.2:Started 2024-09-21T15:04:52.324 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2024-09-21T15:04:52.459 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:52.458+0000 7f816a1cd2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T15:04:52.516 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:52.514+0000 7f816a1cd2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T15:04:52.523 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:04:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"fsid":"3d5e90c8-5967-4045-8599-22a44e1f8eb4","created":"2024-09-21T15:04:51.454600+0000","modified":"2024-09-21T15:04:52.304975+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T15:04:52.304975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"750f15d1-ed0f-415d-8d81-053598e8966f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"871323ec-1b6a-401b-9971-073189a1a664","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f249cce2-e258-47b8-88ad-519b283e30c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:04:52.536 INFO:tasks.ceph.ceph_manager.cluster1:[] 2024-09-21T15:04:52.536 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T15:04:52.686 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:52.682+0000 7f816a1cd2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T15:04:52.687 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:04:52.686+0000 7f7fe2d58880 -1 Falling back to public interface 2024-09-21T15:04:52.696 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:04:52.694+0000 7f1eaf086880 -1 Falling back to public interface 2024-09-21T15:04:52.839 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster1 osd dump --format=json 2024-09-21T15:04:52.903 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:52.902+0000 7f816a1cd2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T15:04:52.955 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:52.954+0000 7f816a1cd2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T15:04:52.959 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:04:52.958+0000 7f2f06bda880 -1 Falling back to public interface 2024-09-21T15:04:53.016 INFO:teuthology.misc.health.smithi082.stdout: 2024-09-21T15:04:53.016 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":5,"fsid":"3d5e90c8-5967-4045-8599-22a44e1f8eb4","created":"2024-09-21T15:04:51.454600+0000","modified":"2024-09-21T15:04:52.304975+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T15:04:52.304975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"750f15d1-ed0f-415d-8d81-053598e8966f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"871323ec-1b6a-401b-9971-073189a1a664","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f249cce2-e258-47b8-88ad-519b283e30c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:04:53.027 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-21T15:04:53.134 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:53.134+0000 7f816a1cd2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T15:04:53.198 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:53.198+0000 7f816a1cd2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T15:04:53.262 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:53.262+0000 7f816a1cd2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T15:04:53.643 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:53.642+0000 7f816a1cd2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T15:04:53.758 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:53.758+0000 7f816a1cd2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T15:04:54.086 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:54.086+0000 7f816a1cd2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T15:04:54.271 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:54.270+0000 7f816a1cd2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T15:04:54.338 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:54.338+0000 7f816a1cd2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T15:04:54.497 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:54.494+0000 7f816a1cd2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T15:04:55.233 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:55.230+0000 7f816a1cd2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T15:04:55.301 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:55.298+0000 7f816a1cd2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T15:04:55.454 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:55.450+0000 7f816a1cd2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T15:04:55.519 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:55.518+0000 7f816a1cd2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T15:04:55.525 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:04:55.522+0000 7f7fe2d58880 -1 osd.2 0 log_to_monitors true 2024-09-21T15:04:55.594 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:55.594+0000 7f816a1cd2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T15:04:55.928 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:55.926+0000 7f816a1cd2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T15:04:55.999 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:55.998+0000 7f816a1cd2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T15:04:56.513 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:04:56.510+0000 7f1eaf086880 -1 osd.0 0 log_to_monitors true 2024-09-21T15:04:56.566 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:04:56.566+0000 7f2f06bda880 -1 osd.1 0 log_to_monitors true 2024-09-21T15:04:56.687 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:56.686+0000 7f816a1cd2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T15:04:57.722 INFO:tasks.ceph.cluster1.mgr.x.smithi082.stderr:2024-09-21T15:04:57.722+0000 7f8150d41700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-21T15:04:57.817 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:04:57.814+0000 7f7fdeb97700 -1 osd.2 0 waiting for initial osdmap 2024-09-21T15:04:57.824 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:04:57.822+0000 7f7fd6646700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T15:04:58.870 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:04:58.870+0000 7f1eab84c700 -1 osd.0 0 waiting for initial osdmap 2024-09-21T15:04:58.876 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:04:58.874+0000 7f1ea2974700 -1 osd.0 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T15:04:58.925 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:04:58.922+0000 7f2f02a19700 -1 osd.1 0 waiting for initial osdmap 2024-09-21T15:04:58.929 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:04:58.926+0000 7f2efa4c8700 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T15:04:59.331 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster1 osd dump --format=json 2024-09-21T15:04:59.629 INFO:teuthology.misc.health.smithi082.stdout: 2024-09-21T15:04:59.629 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":9,"fsid":"3d5e90c8-5967-4045-8599-22a44e1f8eb4","created":"2024-09-21T15:04:51.454600+0000","modified":"2024-09-21T15:04:58.820918+0000","last_up_change":"2024-09-21T15:04:58.820918+0000","last_in_change":"2024-09-21T15:04:52.304975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"750f15d1-ed0f-415d-8d81-053598e8966f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"871323ec-1b6a-401b-9971-073189a1a664","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f249cce2-e258-47b8-88ad-519b283e30c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6801","nonce":2593475992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6803","nonce":2593475992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6807","nonce":2593475992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6805","nonce":2593475992}]},"public_addr":"172.21.15.82:6801/2593475992","cluster_addr":"172.21.15.82:6803/2593475992","heartbeat_back_addr":"172.21.15.82:6807/2593475992","heartbeat_front_addr":"172.21.15.82:6805/2593475992","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:04:59.641 DEBUG:teuthology.misc:1 of 3 OSDs are up 2024-09-21T15:05:05.945 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster1 osd dump --format=json 2024-09-21T15:05:06.245 INFO:teuthology.misc.health.smithi082.stdout: 2024-09-21T15:05:06.246 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":13,"fsid":"3d5e90c8-5967-4045-8599-22a44e1f8eb4","created":"2024-09-21T15:04:51.454600+0000","modified":"2024-09-21T15:05:02.889648+0000","last_up_change":"2024-09-21T15:04:59.874492+0000","last_in_change":"2024-09-21T15:04:52.304975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T15:05:00.775669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"750f15d1-ed0f-415d-8d81-053598e8966f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6809","nonce":3539582657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6811","nonce":3539582657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6815","nonce":3539582657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6813","nonce":3539582657}]},"public_addr":"172.21.15.82:6809/3539582657","cluster_addr":"172.21.15.82:6811/3539582657","heartbeat_back_addr":"172.21.15.82:6815/3539582657","heartbeat_front_addr":"172.21.15.82:6813/3539582657","state":["exists","up"]},{"osd":1,"uuid":"871323ec-1b6a-401b-9971-073189a1a664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6817","nonce":411510261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6819","nonce":411510261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6823","nonce":411510261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6821","nonce":411510261}]},"public_addr":"172.21.15.82:6817/411510261","cluster_addr":"172.21.15.82:6819/411510261","heartbeat_back_addr":"172.21.15.82:6823/411510261","heartbeat_front_addr":"172.21.15.82:6821/411510261","state":["exists","up"]},{"osd":2,"uuid":"f249cce2-e258-47b8-88ad-519b283e30c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6801","nonce":2593475992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6803","nonce":2593475992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6807","nonce":2593475992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6805","nonce":2593475992}]},"public_addr":"172.21.15.82:6801/2593475992","cluster_addr":"172.21.15.82:6803/2593475992","heartbeat_back_addr":"172.21.15.82:6807/2593475992","heartbeat_front_addr":"172.21.15.82:6805/2593475992","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:04:57.485717+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:04:58.927768+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:04:56.529375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:05:06.258 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-21T15:05:06.258 INFO:tasks.ceph:Creating RBD pool 2024-09-21T15:05:06.258 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster cluster1 osd pool create rbd 8 2024-09-21T15:05:06.910 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'rbd' created 2024-09-21T15:05:06.924 DEBUG:teuthology.orchestra.run.smithi082:> rbd --cluster cluster1 pool init rbd 2024-09-21T15:05:09.933 INFO:tasks.ceph:Starting mds daemons in cluster cluster1... 2024-09-21T15:05:09.934 INFO:tasks.ceph:Waiting until cluster1 daemons up and pgs clean... 2024-09-21T15:05:09.934 INFO:tasks.ceph.ceph_manager.cluster1:waiting for mgr available 2024-09-21T15:05:09.934 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 mgr dump --format=json 2024-09-21T15:05:09.934 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T15:05:10.287 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:10.301 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1882859435},{"type":"v1","addr":"172.21.15.82:6825","nonce":1882859435}]},"active_addr":"172.21.15.82:6825/1882859435","active_change":"2024-09-21T15:04:56.710274+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1877258202}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":698047323}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":74160353}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2922923017}]}]} 2024-09-21T15:05:10.303 INFO:tasks.ceph.ceph_manager.cluster1:mgr available! 2024-09-21T15:05:10.303 INFO:tasks.ceph.ceph_manager.cluster1:waiting for all up 2024-09-21T15:05:10.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2024-09-21T15:05:10.606 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:10.607 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"fsid":"3d5e90c8-5967-4045-8599-22a44e1f8eb4","created":"2024-09-21T15:04:51.454600+0000","modified":"2024-09-21T15:05:09.915512+0000","last_up_change":"2024-09-21T15:04:59.874492+0000","last_in_change":"2024-09-21T15:04:52.304975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T15:05:00.775669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T15:05:06.609957+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"750f15d1-ed0f-415d-8d81-053598e8966f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6809","nonce":3539582657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6811","nonce":3539582657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6815","nonce":3539582657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6813","nonce":3539582657}]},"public_addr":"172.21.15.82:6809/3539582657","cluster_addr":"172.21.15.82:6811/3539582657","heartbeat_back_addr":"172.21.15.82:6815/3539582657","heartbeat_front_addr":"172.21.15.82:6813/3539582657","state":["exists","up"]},{"osd":1,"uuid":"871323ec-1b6a-401b-9971-073189a1a664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6817","nonce":411510261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6819","nonce":411510261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6823","nonce":411510261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6821","nonce":411510261}]},"public_addr":"172.21.15.82:6817/411510261","cluster_addr":"172.21.15.82:6819/411510261","heartbeat_back_addr":"172.21.15.82:6823/411510261","heartbeat_front_addr":"172.21.15.82:6821/411510261","state":["exists","up"]},{"osd":2,"uuid":"f249cce2-e258-47b8-88ad-519b283e30c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6801","nonce":2593475992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6803","nonce":2593475992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6807","nonce":2593475992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6805","nonce":2593475992}]},"public_addr":"172.21.15.82:6801/2593475992","cluster_addr":"172.21.15.82:6803/2593475992","heartbeat_back_addr":"172.21.15.82:6807/2593475992","heartbeat_front_addr":"172.21.15.82:6805/2593475992","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:04:57.485717+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:04:58.927768+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:04:56.529375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:05:10.620 INFO:tasks.ceph.ceph_manager.cluster1:all up! 2024-09-21T15:05:10.620 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2024-09-21T15:05:10.929 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:10.929 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"fsid":"3d5e90c8-5967-4045-8599-22a44e1f8eb4","created":"2024-09-21T15:04:51.454600+0000","modified":"2024-09-21T15:05:09.915512+0000","last_up_change":"2024-09-21T15:04:59.874492+0000","last_in_change":"2024-09-21T15:04:52.304975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T15:05:00.775669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T15:05:06.609957+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"750f15d1-ed0f-415d-8d81-053598e8966f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6809","nonce":3539582657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6811","nonce":3539582657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6815","nonce":3539582657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6813","nonce":3539582657}]},"public_addr":"172.21.15.82:6809/3539582657","cluster_addr":"172.21.15.82:6811/3539582657","heartbeat_back_addr":"172.21.15.82:6815/3539582657","heartbeat_front_addr":"172.21.15.82:6813/3539582657","state":["exists","up"]},{"osd":1,"uuid":"871323ec-1b6a-401b-9971-073189a1a664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6817","nonce":411510261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6819","nonce":411510261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6823","nonce":411510261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6821","nonce":411510261}]},"public_addr":"172.21.15.82:6817/411510261","cluster_addr":"172.21.15.82:6819/411510261","heartbeat_back_addr":"172.21.15.82:6823/411510261","heartbeat_front_addr":"172.21.15.82:6821/411510261","state":["exists","up"]},{"osd":2,"uuid":"f249cce2-e258-47b8-88ad-519b283e30c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6801","nonce":2593475992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6803","nonce":2593475992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6807","nonce":2593475992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6805","nonce":2593475992}]},"public_addr":"172.21.15.82:6801/2593475992","cluster_addr":"172.21.15.82:6803/2593475992","heartbeat_back_addr":"172.21.15.82:6807/2593475992","heartbeat_front_addr":"172.21.15.82:6805/2593475992","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:04:57.485717+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:04:58.927768+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:04:56.529375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:05:10.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.0 flush_pg_stats 2024-09-21T15:05:10.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.1 flush_pg_stats 2024-09-21T15:05:10.948 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.2 flush_pg_stats 2024-09-21T15:05:11.086 INFO:teuthology.orchestra.run.smithi082.stdout:42949672965 2024-09-21T15:05:11.087 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.1 2024-09-21T15:05:11.093 INFO:teuthology.orchestra.run.smithi082.stdout:38654705669 2024-09-21T15:05:11.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.2 2024-09-21T15:05:11.106 INFO:teuthology.orchestra.run.smithi082.stdout:42949672967 2024-09-21T15:05:11.107 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.0 2024-09-21T15:05:11.377 INFO:teuthology.orchestra.run.smithi082.stdout:38654705668 2024-09-21T15:05:11.391 INFO:tasks.ceph.ceph_manager.cluster1:need seq 38654705669 got 38654705668 for osd.2 2024-09-21T15:05:11.394 INFO:teuthology.orchestra.run.smithi082.stdout:42949672963 2024-09-21T15:05:11.401 INFO:teuthology.orchestra.run.smithi082.stdout:42949672965 2024-09-21T15:05:11.408 INFO:tasks.ceph.ceph_manager.cluster1:need seq 42949672965 got 42949672963 for osd.1 2024-09-21T15:05:11.415 INFO:tasks.ceph.ceph_manager.cluster1:need seq 42949672967 got 42949672965 for osd.0 2024-09-21T15:05:12.394 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.2 2024-09-21T15:05:12.409 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.1 2024-09-21T15:05:12.415 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.0 2024-09-21T15:05:12.738 INFO:teuthology.orchestra.run.smithi082.stdout:38654705668 2024-09-21T15:05:12.742 INFO:teuthology.orchestra.run.smithi082.stdout:42949672963 2024-09-21T15:05:12.743 INFO:teuthology.orchestra.run.smithi082.stdout:42949672965 2024-09-21T15:05:12.754 INFO:tasks.ceph.ceph_manager.cluster1:need seq 38654705669 got 38654705668 for osd.2 2024-09-21T15:05:12.757 INFO:tasks.ceph.ceph_manager.cluster1:need seq 42949672965 got 42949672963 for osd.1 2024-09-21T15:05:12.758 INFO:tasks.ceph.ceph_manager.cluster1:need seq 42949672967 got 42949672965 for osd.0 2024-09-21T15:05:13.754 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.2 2024-09-21T15:05:13.758 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.1 2024-09-21T15:05:13.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.0 2024-09-21T15:05:14.095 INFO:teuthology.orchestra.run.smithi082.stdout:42949672965 2024-09-21T15:05:14.096 INFO:teuthology.orchestra.run.smithi082.stdout:38654705669 2024-09-21T15:05:14.109 INFO:tasks.ceph.ceph_manager.cluster1:need seq 42949672965 got 42949672965 for osd.1 2024-09-21T15:05:14.109 DEBUG:teuthology.parallel:result is None 2024-09-21T15:05:14.114 INFO:tasks.ceph.ceph_manager.cluster1:need seq 38654705669 got 38654705669 for osd.2 2024-09-21T15:05:14.114 DEBUG:teuthology.parallel:result is None 2024-09-21T15:05:14.151 INFO:teuthology.orchestra.run.smithi082.stdout:42949672967 2024-09-21T15:05:14.165 INFO:tasks.ceph.ceph_manager.cluster1:need seq 42949672967 got 42949672967 for osd.0 2024-09-21T15:05:14.165 DEBUG:teuthology.parallel:result is None 2024-09-21T15:05:14.165 INFO:tasks.ceph.ceph_manager.cluster1:waiting for clean 2024-09-21T15:05:14.165 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-21T15:05:14.447 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:14.450 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-09-21T15:05:14.460 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-21T15:05:12.718326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93908,"kb_used_data":552,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021612,"statfs":{"total":289910292480,"available":289814130688,"internally_reserved":0,"allocated":565248,"data_stored":1303980,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.817773"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:09.930127+0000","last_change":"2024-09-21T15:05:09.930127+0000","last_active":"2024-09-21T15:05:09.930127+0000","last_peered":"2024-09-21T15:05:09.930127+0000","last_clean":"2024-09-21T15:05:09.930127+0000","last_became_active":"2024-09-21T15:05:07.916481+0000","last_became_peered":"2024-09-21T15:05:07.916481+0000","last_unstale":"2024-09-21T15:05:09.930127+0000","last_undegraded":"2024-09-21T15:05:09.930127+0000","last_fullsized":"2024-09-21T15:05:09.930127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048236600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:09.931310+0000","last_change":"2024-09-21T15:05:09.931310+0000","last_active":"2024-09-21T15:05:09.931310+0000","last_peered":"2024-09-21T15:05:09.931310+0000","last_clean":"2024-09-21T15:05:09.931310+0000","last_became_active":"2024-09-21T15:05:07.916495+0000","last_became_peered":"2024-09-21T15:05:07.916495+0000","last_unstale":"2024-09-21T15:05:09.931310+0000","last_undegraded":"2024-09-21T15:05:09.931310+0000","last_fullsized":"2024-09-21T15:05:09.931310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:25:19.376301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093939900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:09.930815+0000","last_change":"2024-09-21T15:05:09.930815+0000","last_active":"2024-09-21T15:05:09.930815+0000","last_peered":"2024-09-21T15:05:09.930815+0000","last_clean":"2024-09-21T15:05:09.930815+0000","last_became_active":"2024-09-21T15:05:07.916830+0000","last_became_peered":"2024-09-21T15:05:07.916830+0000","last_unstale":"2024-09-21T15:05:09.930815+0000","last_undegraded":"2024-09-21T15:05:09.930815+0000","last_fullsized":"2024-09-21T15:05:09.930815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:26.265612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001265777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:09.930647+0000","last_change":"2024-09-21T15:05:09.930647+0000","last_active":"2024-09-21T15:05:09.930647+0000","last_peered":"2024-09-21T15:05:09.930647+0000","last_clean":"2024-09-21T15:05:09.930647+0000","last_became_active":"2024-09-21T15:05:07.918599+0000","last_became_peered":"2024-09-21T15:05:07.918599+0000","last_unstale":"2024-09-21T15:05:09.930647+0000","last_undegraded":"2024-09-21T15:05:09.930647+0000","last_fullsized":"2024-09-21T15:05:09.930647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:08:34.822279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000967993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:09.928952+0000","last_change":"2024-09-21T15:05:09.923617+0000","last_active":"2024-09-21T15:05:09.928952+0000","last_peered":"2024-09-21T15:05:09.928952+0000","last_clean":"2024-09-21T15:05:09.928952+0000","last_became_active":"2024-09-21T15:05:07.916081+0000","last_became_peered":"2024-09-21T15:05:07.916081+0000","last_unstale":"2024-09-21T15:05:09.928952+0000","last_undegraded":"2024-09-21T15:05:09.928952+0000","last_fullsized":"2024-09-21T15:05:09.928952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:33.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095993999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:10.685724+0000","last_change":"2024-09-21T15:05:10.686046+0000","last_active":"2024-09-21T15:05:10.685724+0000","last_peered":"2024-09-21T15:05:10.685724+0000","last_clean":"2024-09-21T15:05:10.685724+0000","last_became_active":"2024-09-21T15:05:07.913149+0000","last_became_peered":"2024-09-21T15:05:07.913149+0000","last_unstale":"2024-09-21T15:05:10.685724+0000","last_undegraded":"2024-09-21T15:05:10.685724+0000","last_fullsized":"2024-09-21T15:05:10.685724+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:53:47.519519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052522500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:10.685649+0000","last_change":"2024-09-21T15:05:10.686020+0000","last_active":"2024-09-21T15:05:10.685649+0000","last_peered":"2024-09-21T15:05:10.685649+0000","last_clean":"2024-09-21T15:05:10.685649+0000","last_became_active":"2024-09-21T15:05:07.913759+0000","last_became_peered":"2024-09-21T15:05:07.913759+0000","last_unstale":"2024-09-21T15:05:10.685649+0000","last_undegraded":"2024-09-21T15:05:10.685649+0000","last_fullsized":"2024-09-21T15:05:10.685649+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:36:54.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057150799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:09.930081+0000","last_change":"2024-09-21T15:05:09.930081+0000","last_active":"2024-09-21T15:05:09.930081+0000","last_peered":"2024-09-21T15:05:09.930081+0000","last_clean":"2024-09-21T15:05:09.930081+0000","last_became_active":"2024-09-21T15:05:07.915480+0000","last_became_peered":"2024-09-21T15:05:07.915480+0000","last_unstale":"2024-09-21T15:05:09.930081+0000","last_undegraded":"2024-09-21T15:05:09.930081+0000","last_fullsized":"2024-09-21T15:05:09.930081+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:32:33.185743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048513700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'97","reported_seq":141,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T15:05:08.931512+0000","last_change":"2024-09-21T15:05:02.181720+0000","last_active":"2024-09-21T15:05:08.931512+0000","last_peered":"2024-09-21T15:05:08.931512+0000","last_clean":"2024-09-21T15:05:08.931512+0000","last_became_active":"2024-09-21T15:05:02.179509+0000","last_became_peered":"2024-09-21T15:05:02.179509+0000","last_unstale":"2024-09-21T15:05:08.931512+0000","last_undegraded":"2024-09-21T15:05:08.931512+0000","last_fullsized":"2024-09-21T15:05:08.931512+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:00.877892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:00.877892+0000","last_clean_scrub_stamp":"2024-09-21T15:05:00.877892+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:38.099227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":632643,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":0,"up_from":10,"seq":42949672967,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":632643,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":139264,"data_stored":38694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:05:14.461 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-21T15:05:14.751 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-09-21T15:05:14.769 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-21T15:05:14.718902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93908,"kb_used_data":552,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021612,"statfs":{"total":289910292480,"available":289814130688,"internally_reserved":0,"allocated":565248,"data_stored":1303980,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.817036"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:09.930127+0000","last_change":"2024-09-21T15:05:09.930127+0000","last_active":"2024-09-21T15:05:09.930127+0000","last_peered":"2024-09-21T15:05:09.930127+0000","last_clean":"2024-09-21T15:05:09.930127+0000","last_became_active":"2024-09-21T15:05:07.916481+0000","last_became_peered":"2024-09-21T15:05:07.916481+0000","last_unstale":"2024-09-21T15:05:09.930127+0000","last_undegraded":"2024-09-21T15:05:09.930127+0000","last_fullsized":"2024-09-21T15:05:09.930127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048236600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:09.931310+0000","last_change":"2024-09-21T15:05:09.931310+0000","last_active":"2024-09-21T15:05:09.931310+0000","last_peered":"2024-09-21T15:05:09.931310+0000","last_clean":"2024-09-21T15:05:09.931310+0000","last_became_active":"2024-09-21T15:05:07.916495+0000","last_became_peered":"2024-09-21T15:05:07.916495+0000","last_unstale":"2024-09-21T15:05:09.931310+0000","last_undegraded":"2024-09-21T15:05:09.931310+0000","last_fullsized":"2024-09-21T15:05:09.931310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:25:19.376301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093939900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:09.930815+0000","last_change":"2024-09-21T15:05:09.930815+0000","last_active":"2024-09-21T15:05:09.930815+0000","last_peered":"2024-09-21T15:05:09.930815+0000","last_clean":"2024-09-21T15:05:09.930815+0000","last_became_active":"2024-09-21T15:05:07.916830+0000","last_became_peered":"2024-09-21T15:05:07.916830+0000","last_unstale":"2024-09-21T15:05:09.930815+0000","last_undegraded":"2024-09-21T15:05:09.930815+0000","last_fullsized":"2024-09-21T15:05:09.930815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:26.265612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001265777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:09.930647+0000","last_change":"2024-09-21T15:05:09.930647+0000","last_active":"2024-09-21T15:05:09.930647+0000","last_peered":"2024-09-21T15:05:09.930647+0000","last_clean":"2024-09-21T15:05:09.930647+0000","last_became_active":"2024-09-21T15:05:07.918599+0000","last_became_peered":"2024-09-21T15:05:07.918599+0000","last_unstale":"2024-09-21T15:05:09.930647+0000","last_undegraded":"2024-09-21T15:05:09.930647+0000","last_fullsized":"2024-09-21T15:05:09.930647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:08:34.822279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000967993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:09.928952+0000","last_change":"2024-09-21T15:05:09.923617+0000","last_active":"2024-09-21T15:05:09.928952+0000","last_peered":"2024-09-21T15:05:09.928952+0000","last_clean":"2024-09-21T15:05:09.928952+0000","last_became_active":"2024-09-21T15:05:07.916081+0000","last_became_peered":"2024-09-21T15:05:07.916081+0000","last_unstale":"2024-09-21T15:05:09.928952+0000","last_undegraded":"2024-09-21T15:05:09.928952+0000","last_fullsized":"2024-09-21T15:05:09.928952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:33.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095993999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:10.685724+0000","last_change":"2024-09-21T15:05:10.686046+0000","last_active":"2024-09-21T15:05:10.685724+0000","last_peered":"2024-09-21T15:05:10.685724+0000","last_clean":"2024-09-21T15:05:10.685724+0000","last_became_active":"2024-09-21T15:05:07.913149+0000","last_became_peered":"2024-09-21T15:05:07.913149+0000","last_unstale":"2024-09-21T15:05:10.685724+0000","last_undegraded":"2024-09-21T15:05:10.685724+0000","last_fullsized":"2024-09-21T15:05:10.685724+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:53:47.519519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052522500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:10.685649+0000","last_change":"2024-09-21T15:05:10.686020+0000","last_active":"2024-09-21T15:05:10.685649+0000","last_peered":"2024-09-21T15:05:10.685649+0000","last_clean":"2024-09-21T15:05:10.685649+0000","last_became_active":"2024-09-21T15:05:07.913759+0000","last_became_peered":"2024-09-21T15:05:07.913759+0000","last_unstale":"2024-09-21T15:05:10.685649+0000","last_undegraded":"2024-09-21T15:05:10.685649+0000","last_fullsized":"2024-09-21T15:05:10.685649+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:36:54.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057150799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-21T15:05:09.930081+0000","last_change":"2024-09-21T15:05:09.930081+0000","last_active":"2024-09-21T15:05:09.930081+0000","last_peered":"2024-09-21T15:05:09.930081+0000","last_clean":"2024-09-21T15:05:09.930081+0000","last_became_active":"2024-09-21T15:05:07.915480+0000","last_became_peered":"2024-09-21T15:05:07.915480+0000","last_unstale":"2024-09-21T15:05:09.930081+0000","last_undegraded":"2024-09-21T15:05:09.930081+0000","last_fullsized":"2024-09-21T15:05:09.930081+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:32:33.185743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048513700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'97","reported_seq":141,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-21T15:05:08.931512+0000","last_change":"2024-09-21T15:05:02.181720+0000","last_active":"2024-09-21T15:05:08.931512+0000","last_peered":"2024-09-21T15:05:08.931512+0000","last_clean":"2024-09-21T15:05:08.931512+0000","last_became_active":"2024-09-21T15:05:02.179509+0000","last_became_peered":"2024-09-21T15:05:02.179509+0000","last_unstale":"2024-09-21T15:05:08.931512+0000","last_undegraded":"2024-09-21T15:05:08.931512+0000","last_fullsized":"2024-09-21T15:05:08.931512+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:00.877892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:00.877892+0000","last_clean_scrub_stamp":"2024-09-21T15:05:00.877892+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:38.099227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":632643,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":0,"up_from":10,"seq":42949672967,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":632643,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":139264,"data_stored":38694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:05:14.770 INFO:tasks.ceph.ceph_manager.cluster1:clean! 2024-09-21T15:05:14.770 INFO:tasks.ceph:Waiting until ceph cluster cluster1 is healthy... 2024-09-21T15:05:14.770 INFO:tasks.ceph.ceph_manager.cluster1:wait_until_healthy 2024-09-21T15:05:14.770 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 health --format=json 2024-09-21T15:05:15.097 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T15:05:15.110 INFO:tasks.ceph.ceph_manager.cluster1:wait_until_healthy done 2024-09-21T15:05:15.110 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T15:05:15.119 INFO:tasks.ceph:Creating ceph cluster cluster2... 2024-09-21T15:05:15.119 INFO:tasks.ceph:config {'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'none'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'cluster2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T15:05:15.120 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909963', 'branch': 'reef', 'description': 'rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_20.04} workloads/rbd-mirror-fsx-workunit}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7909963', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': 'run two ceph clusters and install rbd-mirror'}, {'desc': 'configure the permissions for client.mirror'}, {'desc': '2 ceph clusters with 1 mon and 3 osds each'}, {'desc': 'run four rbd-mirror daemons per cluster'}, {'desc': 'run multiple FSX workloads to simulate cluster load and then verify that the images were replicated'}], 'name': 'teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'none'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': 'a477b1894d5c5a613f23260ca0e6b96d79652ba7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'], ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6']], 'seed': 4623, 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9', 'sleep_before_teardown': 0, 'subset': '80/128', 'suite': 'rbd', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_a477b1894d5c5a613f23260ca0e6b96d79652ba7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'a477b1894d5c5a613f23260ca0e6b96d79652ba7', 'targets': {'smithi082.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': ['rbd-mirror'], 'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}}, {'ceph': {'cluster': 'cluster1', 'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'none'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}}, {'ceph': {'cluster': 'cluster2', 'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'none'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}}, {'exec': {'cluster1.client.mirror.0': ["sudo ceph --cluster cluster1 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'"]}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.0', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.1', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.2', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.3', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.0', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.1', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.2', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.3', 'thrash': True}}, {'rbd-mirror-thrash': {'cluster': 'cluster1'}}, {'rbd-mirror-thrash': {'cluster': 'cluster2'}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/rbd_mirror_fsx_prepare.sh']}, 'env': {'CEPH_ARGS': '', 'RBD_MIRROR_NOCLEANUP': '1', 'RBD_MIRROR_USE_EXISTING_CLUSTER': '1', 'RBD_MIRROR_USE_RBD_MIRROR': '1'}}}, {'rbd_fsx': {'clients': ['cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5'], 'keep_images': True, 'ops': 6000, 'pool_name': 'mirror'}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/rbd_mirror_fsx_compare.sh']}, 'env': {'CEPH_ARGS': '', 'RBD_MIRROR_USE_EXISTING_CLUSTER': '1', 'RBD_MIRROR_USE_RBD_MIRROR': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_22:16:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T15:05:15.120 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/cluster2.data 2024-09-21T15:05:15.122 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/cluster2.data 2024-09-21T15:05:15.130 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T15:05:15.132 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T15:05:15.186 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:15.187 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T15:05:15.191 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T15:05:15.191 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2024-09-21T15:05:15.198 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T15:05:15.198 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T15:05:15.198 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 358 Links: 1 2024-09-21T15:05:15.199 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T15:05:15.199 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-21 15:01:09.245896139 +0000 2024-09-21T15:05:15.199 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-21 15:01:09.025901202 +0000 2024-09-21T15:05:15.199 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-21 15:01:09.025901202 +0000 2024-09-21T15:05:15.199 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-09-21T15:05:15.199 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T15:05:15.209 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-21T15:05:15.209 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-21T15:05:15.209 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000372301 s, 1.4 MB/s 2024-09-21T15:05:15.210 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T15:05:15.263 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2024-09-21T15:05:15.269 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T15:05:15.269 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T15:05:15.269 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 364 Links: 1 2024-09-21T15:05:15.269 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T15:05:15.269 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-21 15:01:09.681886105 +0000 2024-09-21T15:05:15.269 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-21 15:01:09.465891076 +0000 2024-09-21T15:05:15.269 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-21 15:01:09.465891076 +0000 2024-09-21T15:05:15.270 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-09-21T15:05:15.270 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T15:05:15.281 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-21T15:05:15.281 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-21T15:05:15.282 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000424728 s, 1.2 MB/s 2024-09-21T15:05:15.282 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T15:05:15.289 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2024-09-21T15:05:15.295 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T15:05:15.295 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T15:05:15.295 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 373 Links: 1 2024-09-21T15:05:15.295 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T15:05:15.295 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-21 15:01:10.089876716 +0000 2024-09-21T15:05:15.295 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-21 15:01:09.897881134 +0000 2024-09-21T15:05:15.295 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-21 15:01:09.897881134 +0000 2024-09-21T15:05:15.295 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-09-21T15:05:15.295 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T15:05:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-21T15:05:15.307 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-21T15:05:15.307 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000392291 s, 1.3 MB/s 2024-09-21T15:05:15.308 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T15:05:15.359 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2024-09-21T15:05:15.365 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T15:05:15.365 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T15:05:15.365 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 378 Links: 1 2024-09-21T15:05:15.365 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T15:05:15.365 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-21 15:01:10.505867143 +0000 2024-09-21T15:05:15.365 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-21 15:01:10.301871837 +0000 2024-09-21T15:05:15.365 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-21 15:01:10.301871837 +0000 2024-09-21T15:05:15.365 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-09-21T15:05:15.366 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T15:05:15.377 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-21T15:05:15.377 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-21T15:05:15.378 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000368496 s, 1.4 MB/s 2024-09-21T15:05:15.378 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T15:05:15.431 INFO:tasks.ceph:osd dev map: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-21T15:05:15.431 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-21T15:05:15.431 INFO:tasks.ceph:Generating config... 2024-09-21T15:05:15.432 INFO:tasks.ceph:[client] debug rbd = 20 2024-09-21T15:05:15.432 INFO:tasks.ceph:[client] debug rbd_mirror = 15 2024-09-21T15:05:15.432 INFO:tasks.ceph:[client] log to stderr = False 2024-09-21T15:05:15.432 INFO:tasks.ceph:[client] rbd default features = 125 2024-09-21T15:05:15.432 INFO:tasks.ceph:[client] rbd mirror image policy type = none 2024-09-21T15:05:15.432 INFO:tasks.ceph:[client.mirror.0] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:05:15.433 INFO:tasks.ceph:[client.mirror.0] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:05:15.433 INFO:tasks.ceph:[client.mirror.1] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:05:15.433 INFO:tasks.ceph:[client.mirror.1] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:05:15.433 INFO:tasks.ceph:[client.mirror.2] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:05:15.433 INFO:tasks.ceph:[client.mirror.2] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:05:15.433 INFO:tasks.ceph:[client.mirror.3] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:05:15.433 INFO:tasks.ceph:[client.mirror.3] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:05:15.433 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-21T15:05:15.433 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-21T15:05:15.433 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-21T15:05:15.433 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T15:05:15.433 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T15:05:15.433 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T15:05:15.433 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T15:05:15.434 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T15:05:15.434 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T15:05:15.435 INFO:tasks.ceph:Setting up cluster2.mon.a... 2024-09-21T15:05:15.435 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/cluster2.keyring 2024-09-21T15:05:15.473 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster2.keyring 2024-09-21T15:05:15.476 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/cluster2.keyring 2024-09-21T15:05:15.516 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/cluster2.keyring 2024-09-21T15:05:15.530 DEBUG:tasks.ceph:Ceph mon addresses: [('cluster2.mon.a', '172.21.15.161')] 2024-09-21T15:05:15.531 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.161', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'none'}, 'mon.a': {}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}} 2024-09-21T15:05:15.531 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:15.531 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T15:05:15.581 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.161 --print /home/ubuntu/cephtest/cluster2.monmap 2024-09-21T15:05:15.620 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: monmap file /home/ubuntu/cephtest/cluster2.monmap 2024-09-21T15:05:15.620 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: generated fsid 8334776e-26c5-4f44-8f06-b169be5e91ca 2024-09-21T15:05:15.620 INFO:teuthology.orchestra.run.smithi161.stdout:setting min_mon_release = pacific 2024-09-21T15:05:15.620 INFO:teuthology.orchestra.run.smithi161.stdout:epoch 0 2024-09-21T15:05:15.620 INFO:teuthology.orchestra.run.smithi161.stdout:fsid 8334776e-26c5-4f44-8f06-b169be5e91ca 2024-09-21T15:05:15.620 INFO:teuthology.orchestra.run.smithi161.stdout:last_changed 2024-09-21T15:05:15.619447+0000 2024-09-21T15:05:15.621 INFO:teuthology.orchestra.run.smithi161.stdout:created 2024-09-21T15:05:15.619447+0000 2024-09-21T15:05:15.621 INFO:teuthology.orchestra.run.smithi161.stdout:min_mon_release 16 (pacific) 2024-09-21T15:05:15.621 INFO:teuthology.orchestra.run.smithi161.stdout:election_strategy: 1 2024-09-21T15:05:15.621 INFO:teuthology.orchestra.run.smithi161.stdout:0: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.a 2024-09-21T15:05:15.621 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/cluster2.monmap (1 monitors) 2024-09-21T15:05:15.622 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T15:05:15.627 INFO:tasks.ceph:Writing /etc/ceph/cluster2.conf for FSID 8334776e-26c5-4f44-8f06-b169be5e91ca... 2024-09-21T15:05:15.628 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster2.conf && sudo chmod 0644 /etc/ceph/cluster2.conf > /dev/null 2024-09-21T15:05:15.630 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster2.conf && sudo chmod 0644 /etc/ceph/cluster2.conf > /dev/null 2024-09-21T15:05:15.662 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-09-21T15:05:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2024-09-21T15:05:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T15:05:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2024-09-21T15:05:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2024-09-21T15:05:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2024-09-21T15:05:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2024-09-21T15:05:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2024-09-21T15:05:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = 172.21.15.161 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: mon client directed command retry = 5 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on pool no app = False 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: ms inject socket failures = 5000 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 8334776e-26c5-4f44-8f06-b169be5e91ca 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2024-09-21T15:05:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore compression algorithm = snappy 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore compression mode = aggressive 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 1/20 2024-09-21T15:05:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 1/20 2024-09-21T15:05:15.668 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-09-21T15:05:15.668 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2024-09-21T15:05:15.668 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 4/10 2024-09-21T15:05:15.668 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T15:05:15.668 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2024-09-21T15:05:15.668 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2024-09-21T15:05:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2024-09-21T15:05:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2024-09-21T15:05:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.669 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-09-21T15:05:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: debug rbd = 20 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: debug rbd_mirror = 15 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: log to stderr = False 2024-09-21T15:05:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: rbd default features = 125 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: rbd mirror image policy type = none 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.0] 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.1] 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.2] 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout:[client.mirror.3] 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:05:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:05:15.675 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2024-09-21T15:05:15.675 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2024-09-21T15:05:15.675 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T15:05:15.675 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2024-09-21T15:05:15.675 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.675 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2024-09-21T15:05:15.675 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.675 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2024-09-21T15:05:15.675 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.675 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2024-09-21T15:05:15.675 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2024-09-21T15:05:15.676 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2024-09-21T15:05:15.677 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = 172.21.15.161 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: mon client directed command retry = 5 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on pool no app = False 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: ms inject socket failures = 5000 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = 8334776e-26c5-4f44-8f06-b169be5e91ca 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2024-09-21T15:05:15.678 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2024-09-21T15:05:15.679 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore compression algorithm = snappy 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore compression mode = aggressive 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 1/20 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 1/20 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 4/10 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2024-09-21T15:05:15.680 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-09-21T15:05:15.681 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2024-09-21T15:05:15.682 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-09-21T15:05:15.682 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2024-09-21T15:05:15.682 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2024-09-21T15:05:15.682 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-09-21T15:05:15.682 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2024-09-21T15:05:15.682 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2024-09-21T15:05:15.682 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-09-21T15:05:15.682 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.682 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T15:05:15.682 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T15:05:15.682 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T15:05:15.682 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.683 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T15:05:15.683 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T15:05:15.683 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T15:05:15.683 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.683 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2024-09-21T15:05:15.683 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2024-09-21T15:05:15.683 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.683 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2024-09-21T15:05:15.683 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:15.683 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout: debug rbd = 20 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout: debug rbd_mirror = 15 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout: log to stderr = False 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout: rbd default features = 125 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout: rbd mirror image policy type = none 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.0] 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:05:15.684 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:05:15.685 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.1] 2024-09-21T15:05:15.685 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:05:15.685 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:05:15.685 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.2] 2024-09-21T15:05:15.685 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:05:15.685 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:05:15.685 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.3] 2024-09-21T15:05:15.685 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2024-09-21T15:05:15.685 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2024-09-21T15:05:15.685 INFO:tasks.ceph:Creating admin key on cluster2.mon.a... 2024-09-21T15:05:15.685 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/cluster2.keyring 2024-09-21T15:05:15.773 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T15:05:15.773 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:15.773 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster2.keyring of=/dev/stdout 2024-09-21T15:05:15.780 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:15.780 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/cluster2.monmap of=/dev/stdout 2024-09-21T15:05:15.787 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2024-09-21T15:05:15.787 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:05:15.787 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/cluster2.keyring 2024-09-21T15:05:15.787 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/cluster2.keyring 2024-09-21T15:05:15.813 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:05:15.813 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/cluster2.monmap 2024-09-21T15:05:15.860 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2024-09-21T15:05:15.860 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:15.860 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/cluster2.keyring 2024-09-21T15:05:15.860 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/cluster2.keyring 2024-09-21T15:05:15.887 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:15.888 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/cluster2.monmap 2024-09-21T15:05:15.937 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T15:05:15.937 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T15:05:15.937 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mgr/cluster2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/cluster2-x/keyring 2024-09-21T15:05:15.984 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mgr/cluster2-x/keyring 2024-09-21T15:05:15.987 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T15:05:15.987 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T15:05:15.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/cluster2.client.0.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.0.keyring 2024-09-21T15:05:16.024 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/cluster2.client.0.keyring 2024-09-21T15:05:16.037 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror /etc/ceph/cluster2.client.mirror.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.keyring 2024-09-21T15:05:16.078 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster2.client.mirror.keyring 2024-09-21T15:05:16.091 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.0 /etc/ceph/cluster2.client.mirror.0.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.0.keyring 2024-09-21T15:05:16.129 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster2.client.mirror.0.keyring 2024-09-21T15:05:16.143 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.1 /etc/ceph/cluster2.client.mirror.1.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.1.keyring 2024-09-21T15:05:16.234 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster2.client.mirror.1.keyring 2024-09-21T15:05:16.248 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.2 /etc/ceph/cluster2.client.mirror.2.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.2.keyring 2024-09-21T15:05:16.287 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster2.client.mirror.2.keyring 2024-09-21T15:05:16.300 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.3 /etc/ceph/cluster2.client.mirror.3.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.3.keyring 2024-09-21T15:05:16.337 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster2.client.mirror.3.keyring 2024-09-21T15:05:16.351 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.4 /etc/ceph/cluster2.client.mirror.4.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.4.keyring 2024-09-21T15:05:16.436 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster2.client.mirror.4.keyring 2024-09-21T15:05:16.448 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.5 /etc/ceph/cluster2.client.mirror.5.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.5.keyring 2024-09-21T15:05:16.488 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster2.client.mirror.5.keyring 2024-09-21T15:05:16.502 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.6 /etc/ceph/cluster2.client.mirror.6.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.6.keyring 2024-09-21T15:05:16.539 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/cluster2.client.mirror.6.keyring 2024-09-21T15:05:16.553 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T15:05:16.553 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-21T15:05:16.554 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/cluster2-0 2024-09-21T15:05:16.610 INFO:tasks.ceph:roles_to_devs: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-21T15:05:16.610 INFO:tasks.ceph:role: cluster2.osd.0 2024-09-21T15:05:16.610 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2024-09-21T15:05:16.610 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T15:05:17.136 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T15:05:17.137 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T15:05:17.137 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T15:05:17.137 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 2024-09-21T15:05:17.137 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T15:05:17.137 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-09-21T15:05:17.137 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T15:05:17.137 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T15:05:17.137 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T15:05:17.137 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T15:05:17.139 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-09-21T15:05:17.139 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/cluster2-0 2024-09-21T15:05:17.213 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-0 2024-09-21T15:05:17.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T15:05:17.225 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T15:05:17.225 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/cluster2-1 2024-09-21T15:05:17.235 INFO:tasks.ceph:roles_to_devs: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-21T15:05:17.235 INFO:tasks.ceph:role: cluster2.osd.1 2024-09-21T15:05:17.235 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2024-09-21T15:05:17.236 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T15:05:17.742 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T15:05:17.742 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T15:05:17.742 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T15:05:17.743 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 2024-09-21T15:05:17.743 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T15:05:17.743 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-09-21T15:05:17.743 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T15:05:17.743 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T15:05:17.743 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T15:05:17.743 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T15:05:17.745 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-09-21T15:05:17.745 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/cluster2-1 2024-09-21T15:05:17.820 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-1 2024-09-21T15:05:17.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T15:05:17.831 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T15:05:17.831 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/cluster2-2 2024-09-21T15:05:17.843 INFO:tasks.ceph:roles_to_devs: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2024-09-21T15:05:17.843 INFO:tasks.ceph:role: cluster2.osd.2 2024-09-21T15:05:17.843 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2024-09-21T15:05:17.843 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T15:05:18.356 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T15:05:18.356 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T15:05:18.356 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T15:05:18.356 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 2024-09-21T15:05:18.356 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T15:05:18.356 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-09-21T15:05:18.356 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T15:05:18.356 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T15:05:18.356 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T15:05:18.357 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T15:05:18.358 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-09-21T15:05:18.358 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/cluster2-2 2024-09-21T15:05:18.413 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-2 2024-09-21T15:05:18.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T15:05:18.426 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T15:05:18.426 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/cluster2.monmap 2024-09-21T15:05:18.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:18.544+0000 7f4728d86880 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-0/keyring: can't open /var/lib/ceph/osd/cluster2-0/keyring: (2) No such file or directory 2024-09-21T15:05:18.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:18.544+0000 7f4728d86880 -1 created new key in keyring /var/lib/ceph/osd/cluster2-0/keyring 2024-09-21T15:05:18.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:18.544+0000 7f4728d86880 -1 bluestore(/var/lib/ceph/osd/cluster2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-0/block: (2) No such file or directory 2024-09-21T15:05:18.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:18.544+0000 7f4728d86880 -1 bluestore(/var/lib/ceph/osd/cluster2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-0/block: (2) No such file or directory 2024-09-21T15:05:18.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:18.544+0000 7f4728d86880 -1 bluestore(/var/lib/ceph/osd/cluster2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-0/block: (2) No such file or directory 2024-09-21T15:05:18.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:18.544+0000 7f4728d86880 -1 bluestore(/var/lib/ceph/osd/cluster2-0) _read_fsid unparsable uuid 2024-09-21T15:05:21.547 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-0 2024-09-21T15:05:21.563 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/cluster2.monmap 2024-09-21T15:05:21.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:21.600+0000 7fcf89bf9880 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-1/keyring: can't open /var/lib/ceph/osd/cluster2-1/keyring: (2) No such file or directory 2024-09-21T15:05:21.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:21.600+0000 7fcf89bf9880 -1 created new key in keyring /var/lib/ceph/osd/cluster2-1/keyring 2024-09-21T15:05:21.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:21.600+0000 7fcf89bf9880 -1 bluestore(/var/lib/ceph/osd/cluster2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-1/block: (2) No such file or directory 2024-09-21T15:05:21.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:21.600+0000 7fcf89bf9880 -1 bluestore(/var/lib/ceph/osd/cluster2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-1/block: (2) No such file or directory 2024-09-21T15:05:21.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:21.600+0000 7fcf89bf9880 -1 bluestore(/var/lib/ceph/osd/cluster2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-1/block: (2) No such file or directory 2024-09-21T15:05:21.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:21.600+0000 7fcf89bf9880 -1 bluestore(/var/lib/ceph/osd/cluster2-1) _read_fsid unparsable uuid 2024-09-21T15:05:24.590 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-1 2024-09-21T15:05:24.646 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/cluster2.monmap 2024-09-21T15:05:24.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:24.688+0000 7f068c6c6880 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-2/keyring: can't open /var/lib/ceph/osd/cluster2-2/keyring: (2) No such file or directory 2024-09-21T15:05:24.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:24.688+0000 7f068c6c6880 -1 created new key in keyring /var/lib/ceph/osd/cluster2-2/keyring 2024-09-21T15:05:24.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:24.688+0000 7f068c6c6880 -1 bluestore(/var/lib/ceph/osd/cluster2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-2/block: (2) No such file or directory 2024-09-21T15:05:24.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:24.688+0000 7f068c6c6880 -1 bluestore(/var/lib/ceph/osd/cluster2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-2/block: (2) No such file or directory 2024-09-21T15:05:24.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:24.688+0000 7f068c6c6880 -1 bluestore(/var/lib/ceph/osd/cluster2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-2/block: (2) No such file or directory 2024-09-21T15:05:24.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-21T15:05:24.688+0000 7f068c6c6880 -1 bluestore(/var/lib/ceph/osd/cluster2-2) _read_fsid unparsable uuid 2024-09-21T15:05:27.677 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-2 2024-09-21T15:05:27.694 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T15:05:27.694 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:05:27.694 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mgr/cluster2-x/keyring of=/dev/stdout 2024-09-21T15:05:27.711 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:27.711 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/cluster2-0/keyring of=/dev/stdout 2024-09-21T15:05:27.753 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:27.754 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/cluster2-1/keyring of=/dev/stdout 2024-09-21T15:05:27.769 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:27.769 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/cluster2-2/keyring of=/dev/stdout 2024-09-21T15:05:27.778 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-21T15:05:27.778 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/cluster2.client.0.keyring of=/dev/stdout 2024-09-21T15:05:27.785 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:27.785 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster2.client.mirror.keyring of=/dev/stdout 2024-09-21T15:05:27.792 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:27.792 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster2.client.mirror.0.keyring of=/dev/stdout 2024-09-21T15:05:27.841 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:27.841 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster2.client.mirror.1.keyring of=/dev/stdout 2024-09-21T15:05:27.847 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:27.847 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster2.client.mirror.2.keyring of=/dev/stdout 2024-09-21T15:05:27.853 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:27.853 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster2.client.mirror.3.keyring of=/dev/stdout 2024-09-21T15:05:27.859 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:27.859 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster2.client.mirror.4.keyring of=/dev/stdout 2024-09-21T15:05:27.864 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:27.864 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster2.client.mirror.5.keyring of=/dev/stdout 2024-09-21T15:05:27.913 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:27.913 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/cluster2.client.mirror.6.keyring of=/dev/stdout 2024-09-21T15:05:27.919 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T15:05:27.919 DEBUG:teuthology.orchestra.run.smithi161:> sudo tee -a /etc/ceph/cluster2.keyring 2024-09-21T15:05:27.931 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.x] 2024-09-21T15:05:27.931 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCr4O5m2z7YOhAAjzAotMj/Jl8LfZVLCtwJQA== 2024-09-21T15:05:27.931 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2024-09-21T15:05:27.931 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCu4O5m/FiuIBAAs6/JW/D9uajzlMyxryHRpw== 2024-09-21T15:05:27.931 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2024-09-21T15:05:27.931 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCx4O5mkUn2IxAA4AgzGyTgf49ClshyC0ycVQ== 2024-09-21T15:05:27.931 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2024-09-21T15:05:27.931 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC04O5ml21AKRAAW+Mq+QL66Q/3dXvoVF+hRA== 2024-09-21T15:05:27.931 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCs4O5mYTmXARAAYTLsBJGh7O8f/Z8AfzrtbA== 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror] 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCs4O5mAeyqBBAAhEo33j3T1aeMwSIV1HXS7A== 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.0] 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCs4O5mHba0BxAA8Aec+v9x7SNUro+k4/OcMQ== 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.1] 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCs4O5mVlrzDRAA4n2WV6ckR9Qh2gF3D+/a7w== 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.2] 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCs4O5mi7AfERAAZTlV2muXqU4IUr2dB0sMQA== 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.3] 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCs4O5mK68aFBAAWWWHENgZsojO5c8dXQKf2Q== 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.4] 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCs4O5m6or+GRAAd63rRY8kTiM1JyXeWV1CZw== 2024-09-21T15:05:27.932 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.5] 2024-09-21T15:05:27.933 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCs4O5mjq0eHRAAv345E8KX1VPNaiziRl4wnA== 2024-09-21T15:05:27.933 INFO:teuthology.orchestra.run.smithi161.stdout:[client.mirror.6] 2024-09-21T15:05:27.933 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCs4O5mWKojIBAAVU4OiKupSp+8wnIMeP8e9w== 2024-09-21T15:05:27.933 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T15:05:27.977 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T15:05:28.021 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T15:05:28.069 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T15:05:28.117 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:05:28.164 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:05:28.210 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:05:28.255 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:05:28.302 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:05:28.351 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:05:28.399 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.4 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:05:28.450 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.5 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:05:28.494 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.6 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T15:05:28.541 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T15:05:28.542 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/cluster2-a 2024-09-21T15:05:28.555 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster cluster2 --mkfs -i a --monmap /home/ubuntu/cephtest/cluster2.monmap --keyring /etc/ceph/cluster2.keyring 2024-09-21T15:05:28.636 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/cluster2-a 2024-09-21T15:05:28.653 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/cluster2.monmap 2024-09-21T15:05:28.700 INFO:tasks.ceph:Starting mon daemons in cluster cluster2... 2024-09-21T15:05:28.700 INFO:tasks.ceph.cluster2.mon.a:Restarting daemon 2024-09-21T15:05:28.701 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster cluster2 -i a 2024-09-21T15:05:28.703 INFO:tasks.ceph.cluster2.mon.a:Started 2024-09-21T15:05:28.703 INFO:tasks.ceph:Starting mgr daemons in cluster cluster2... 2024-09-21T15:05:28.703 INFO:tasks.ceph.cluster2.mgr.x:Restarting daemon 2024-09-21T15:05:28.703 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster cluster2 -i x 2024-09-21T15:05:28.705 INFO:tasks.ceph.cluster2.mgr.x:Started 2024-09-21T15:05:28.706 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T15:05:28.706 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster cluster2 osd crush tunables default 2024-09-21T15:05:28.957 INFO:teuthology.orchestra.run.smithi161.stderr:adjusted tunables profile to default 2024-09-21T15:05:28.967 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T15:05:28.967 INFO:tasks.ceph:Starting osd daemons in cluster cluster2... 2024-09-21T15:05:28.967 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:28.968 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/cluster2-0/fsid of=/dev/stdout 2024-09-21T15:05:28.982 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:28.982 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/cluster2-1/fsid of=/dev/stdout 2024-09-21T15:05:28.992 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:05:28.992 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/cluster2-2/fsid of=/dev/stdout 2024-09-21T15:05:29.006 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster cluster2 osd new 3882a0de-b08f-4844-8b28-46a529e12dc2 0 2024-09-21T15:05:29.087 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:29.085+0000 7ff929c592c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T15:05:29.262 INFO:teuthology.orchestra.run.smithi161.stdout:0 2024-09-21T15:05:29.274 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster cluster2 osd new 96aa5752-0c0b-40a8-ac6d-8780067f5d2c 1 2024-09-21T15:05:29.482 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-09-21T15:05:29.495 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster cluster2 osd new 48d4bf2e-61c6-4adc-b48b-988ba4768f3b 2 2024-09-21T15:05:29.499 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:29.497+0000 7ff929c592c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T15:05:29.550 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:29.545+0000 7ff929c592c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T15:05:29.702 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:29.701+0000 7ff929c592c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T15:05:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:2 2024-09-21T15:05:29.715 INFO:tasks.ceph.cluster2.osd.0:Restarting daemon 2024-09-21T15:05:29.716 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 0 2024-09-21T15:05:29.718 INFO:tasks.ceph.cluster2.osd.0:Started 2024-09-21T15:05:29.718 INFO:tasks.ceph.cluster2.osd.1:Restarting daemon 2024-09-21T15:05:29.718 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 1 2024-09-21T15:05:29.720 INFO:tasks.ceph.cluster2.osd.1:Started 2024-09-21T15:05:29.720 INFO:tasks.ceph.cluster2.osd.2:Restarting daemon 2024-09-21T15:05:29.720 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 2 2024-09-21T15:05:29.722 INFO:tasks.ceph.cluster2.osd.2:Started 2024-09-21T15:05:29.723 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2024-09-21T15:05:29.888 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:29.885+0000 7ff929c592c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T15:05:29.914 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:29.914 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":5,"fsid":"8334776e-26c5-4f44-8f06-b169be5e91ca","created":"2024-09-21T15:05:28.839197+0000","modified":"2024-09-21T15:05:29.699542+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T15:05:29.699542+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3882a0de-b08f-4844-8b28-46a529e12dc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96aa5752-0c0b-40a8-ac6d-8780067f5d2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"48d4bf2e-61c6-4adc-b48b-988ba4768f3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:05:29.927 INFO:tasks.ceph.ceph_manager.cluster2:[] 2024-09-21T15:05:29.927 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T15:05:29.938 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:29.937+0000 7ff929c592c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T15:05:30.092 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:30.089+0000 7ff929c592c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T15:05:30.104 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:05:30.100+0000 7ff766813880 -1 Falling back to public interface 2024-09-21T15:05:30.151 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:30.149+0000 7ff929c592c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T15:05:30.211 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:30.209+0000 7ff929c592c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T15:05:30.229 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster2 osd dump --format=json 2024-09-21T15:05:30.356 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:05:30.351+0000 7f6c42659880 -1 Falling back to public interface 2024-09-21T15:05:30.360 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:05:30.355+0000 7f53044b5880 -1 Falling back to public interface 2024-09-21T15:05:30.426 INFO:teuthology.misc.health.smithi161.stdout: 2024-09-21T15:05:30.426 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":5,"fsid":"8334776e-26c5-4f44-8f06-b169be5e91ca","created":"2024-09-21T15:05:28.839197+0000","modified":"2024-09-21T15:05:29.699542+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T15:05:29.699542+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3882a0de-b08f-4844-8b28-46a529e12dc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96aa5752-0c0b-40a8-ac6d-8780067f5d2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"48d4bf2e-61c6-4adc-b48b-988ba4768f3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:05:30.438 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-21T15:05:30.507 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:30.505+0000 7ff929c592c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T15:05:30.620 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:30.617+0000 7ff929c592c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T15:05:30.939 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:30.937+0000 7ff929c592c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T15:05:31.120 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:31.117+0000 7ff929c592c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T15:05:31.186 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:31.181+0000 7ff929c592c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T15:05:31.344 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:31.341+0000 7ff929c592c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T15:05:31.490 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:31.489+0000 7ff929c592c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T15:05:31.546 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:31.541+0000 7ff929c592c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T15:05:31.614 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:31.613+0000 7ff929c592c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T15:05:31.672 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:31.669+0000 7ff929c592c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T15:05:31.736 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:31.733+0000 7ff929c592c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T15:05:32.016 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:32.013+0000 7ff929c592c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T15:05:32.079 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:32.077+0000 7ff929c592c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T15:05:32.601 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:32.597+0000 7ff929c592c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T15:05:33.678 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:05:33.671+0000 7f53044b5880 -1 osd.1 0 log_to_monitors true 2024-09-21T15:05:33.825 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:05:33.819+0000 7f6c42659880 -1 osd.0 0 log_to_monitors true 2024-09-21T15:05:33.902 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:05:33.895+0000 7ff766813880 -1 osd.2 0 log_to_monitors true 2024-09-21T15:05:34.633 INFO:tasks.ceph.cluster2.mgr.x.smithi082.stderr:2024-09-21T15:05:34.629+0000 7ff910a13700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-21T15:05:36.740 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster2 osd dump --format=json 2024-09-21T15:05:37.011 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:05:37.007+0000 7f6c3e498700 -1 osd.0 0 waiting for initial osdmap 2024-09-21T15:05:37.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:05:37.011+0000 7f6c35f47700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T15:05:37.075 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:05:37.071+0000 7f5300c7b700 -1 osd.1 0 waiting for initial osdmap 2024-09-21T15:05:37.080 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:05:37.075+0000 7f52f7da3700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T15:05:37.082 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:05:37.075+0000 7ff762652700 -1 osd.2 0 waiting for initial osdmap 2024-09-21T15:05:37.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:05:37.083+0000 7ff75a101700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T15:05:37.129 INFO:teuthology.misc.health.smithi161.stdout: 2024-09-21T15:05:37.129 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":7,"fsid":"8334776e-26c5-4f44-8f06-b169be5e91ca","created":"2024-09-21T15:05:28.839197+0000","modified":"2024-09-21T15:05:35.684635+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T15:05:29.699542+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3882a0de-b08f-4844-8b28-46a529e12dc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96aa5752-0c0b-40a8-ac6d-8780067f5d2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"48d4bf2e-61c6-4adc-b48b-988ba4768f3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:05:37.141 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-21T15:05:43.445 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster2 osd dump --format=json 2024-09-21T15:05:43.752 INFO:teuthology.misc.health.smithi161.stdout: 2024-09-21T15:05:43.752 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":11,"fsid":"8334776e-26c5-4f44-8f06-b169be5e91ca","created":"2024-09-21T15:05:28.839197+0000","modified":"2024-09-21T15:05:41.021401+0000","last_up_change":"2024-09-21T15:05:38.011857+0000","last_in_change":"2024-09-21T15:05:29.699542+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T15:05:38.697784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3882a0de-b08f-4844-8b28-46a529e12dc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6809","nonce":770292651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6811","nonce":770292651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6815","nonce":770292651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6813","nonce":770292651}]},"public_addr":"172.21.15.161:6809/770292651","cluster_addr":"172.21.15.161:6811/770292651","heartbeat_back_addr":"172.21.15.161:6815/770292651","heartbeat_front_addr":"172.21.15.161:6813/770292651","state":["exists","up"]},{"osd":1,"uuid":"96aa5752-0c0b-40a8-ac6d-8780067f5d2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6817","nonce":772781101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6819","nonce":772781101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6823","nonce":772781101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6821","nonce":772781101}]},"public_addr":"172.21.15.161:6817/772781101","cluster_addr":"172.21.15.161:6819/772781101","heartbeat_back_addr":"172.21.15.161:6823/772781101","heartbeat_front_addr":"172.21.15.161:6821/772781101","state":["exists","up"]},{"osd":2,"uuid":"48d4bf2e-61c6-4adc-b48b-988ba4768f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6801","nonce":4255713326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6803","nonce":4255713326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6807","nonce":4255713326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6805","nonce":4255713326}]},"public_addr":"172.21.15.161:6801/4255713326","cluster_addr":"172.21.15.161:6803/4255713326","heartbeat_back_addr":"172.21.15.161:6807/4255713326","heartbeat_front_addr":"172.21.15.161:6805/4255713326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:05:34.876975+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:05:34.692650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:05:34.917712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:05:43.765 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-21T15:05:43.765 INFO:tasks.ceph:Creating RBD pool 2024-09-21T15:05:43.766 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster cluster2 osd pool create rbd 8 2024-09-21T15:05:45.064 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'rbd' created 2024-09-21T15:05:45.077 DEBUG:teuthology.orchestra.run.smithi161:> rbd --cluster cluster2 pool init rbd 2024-09-21T15:05:48.090 INFO:tasks.ceph:Starting mds daemons in cluster cluster2... 2024-09-21T15:05:48.091 INFO:tasks.ceph:Waiting until cluster2 daemons up and pgs clean... 2024-09-21T15:05:48.091 INFO:tasks.ceph.ceph_manager.cluster2:waiting for mgr available 2024-09-21T15:05:48.091 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 mgr dump --format=json 2024-09-21T15:05:48.091 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T15:05:48.446 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:48.460 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":245866120},{"type":"v1","addr":"172.21.15.82:6827","nonce":245866120}]},"active_addr":"172.21.15.82:6827/245866120","active_change":"2024-09-21T15:05:32.619919+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2886426140}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2721053998}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":4183998521}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2554976503}]}]} 2024-09-21T15:05:48.462 INFO:tasks.ceph.ceph_manager.cluster2:mgr available! 2024-09-21T15:05:48.462 INFO:tasks.ceph.ceph_manager.cluster2:waiting for all up 2024-09-21T15:05:48.462 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2024-09-21T15:05:48.756 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:48.757 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":15,"fsid":"8334776e-26c5-4f44-8f06-b169be5e91ca","created":"2024-09-21T15:05:28.839197+0000","modified":"2024-09-21T15:05:48.065829+0000","last_up_change":"2024-09-21T15:05:38.011857+0000","last_in_change":"2024-09-21T15:05:29.699542+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T15:05:38.697784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T15:05:44.115975+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3882a0de-b08f-4844-8b28-46a529e12dc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6809","nonce":770292651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6811","nonce":770292651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6815","nonce":770292651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6813","nonce":770292651}]},"public_addr":"172.21.15.161:6809/770292651","cluster_addr":"172.21.15.161:6811/770292651","heartbeat_back_addr":"172.21.15.161:6815/770292651","heartbeat_front_addr":"172.21.15.161:6813/770292651","state":["exists","up"]},{"osd":1,"uuid":"96aa5752-0c0b-40a8-ac6d-8780067f5d2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6817","nonce":772781101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6819","nonce":772781101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6823","nonce":772781101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6821","nonce":772781101}]},"public_addr":"172.21.15.161:6817/772781101","cluster_addr":"172.21.15.161:6819/772781101","heartbeat_back_addr":"172.21.15.161:6823/772781101","heartbeat_front_addr":"172.21.15.161:6821/772781101","state":["exists","up"]},{"osd":2,"uuid":"48d4bf2e-61c6-4adc-b48b-988ba4768f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6801","nonce":4255713326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6803","nonce":4255713326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6807","nonce":4255713326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6805","nonce":4255713326}]},"public_addr":"172.21.15.161:6801/4255713326","cluster_addr":"172.21.15.161:6803/4255713326","heartbeat_back_addr":"172.21.15.161:6807/4255713326","heartbeat_front_addr":"172.21.15.161:6805/4255713326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:05:34.876975+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:05:34.692650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:05:34.917712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:05:48.770 INFO:tasks.ceph.ceph_manager.cluster2:all up! 2024-09-21T15:05:48.771 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2024-09-21T15:05:49.073 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:49.073 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":15,"fsid":"8334776e-26c5-4f44-8f06-b169be5e91ca","created":"2024-09-21T15:05:28.839197+0000","modified":"2024-09-21T15:05:48.065829+0000","last_up_change":"2024-09-21T15:05:38.011857+0000","last_in_change":"2024-09-21T15:05:29.699542+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T15:05:38.697784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T15:05:44.115975+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3882a0de-b08f-4844-8b28-46a529e12dc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6809","nonce":770292651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6811","nonce":770292651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6815","nonce":770292651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6813","nonce":770292651}]},"public_addr":"172.21.15.161:6809/770292651","cluster_addr":"172.21.15.161:6811/770292651","heartbeat_back_addr":"172.21.15.161:6815/770292651","heartbeat_front_addr":"172.21.15.161:6813/770292651","state":["exists","up"]},{"osd":1,"uuid":"96aa5752-0c0b-40a8-ac6d-8780067f5d2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6817","nonce":772781101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6819","nonce":772781101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6823","nonce":772781101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6821","nonce":772781101}]},"public_addr":"172.21.15.161:6817/772781101","cluster_addr":"172.21.15.161:6819/772781101","heartbeat_back_addr":"172.21.15.161:6823/772781101","heartbeat_front_addr":"172.21.15.161:6821/772781101","state":["exists","up"]},{"osd":2,"uuid":"48d4bf2e-61c6-4adc-b48b-988ba4768f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6801","nonce":4255713326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6803","nonce":4255713326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6807","nonce":4255713326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6805","nonce":4255713326}]},"public_addr":"172.21.15.161:6801/4255713326","cluster_addr":"172.21.15.161:6803/4255713326","heartbeat_back_addr":"172.21.15.161:6807/4255713326","heartbeat_front_addr":"172.21.15.161:6805/4255713326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:05:34.876975+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:05:34.692650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:05:34.917712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:05:49.088 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.0 flush_pg_stats 2024-09-21T15:05:49.088 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.1 flush_pg_stats 2024-09-21T15:05:49.089 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.2 flush_pg_stats 2024-09-21T15:05:49.221 INFO:teuthology.orchestra.run.smithi161.stdout:34359738375 2024-09-21T15:05:49.222 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.0 2024-09-21T15:05:49.238 INFO:teuthology.orchestra.run.smithi161.stdout:34359738374 2024-09-21T15:05:49.238 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.2 2024-09-21T15:05:49.249 INFO:teuthology.orchestra.run.smithi161.stdout:34359738373 2024-09-21T15:05:49.250 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.1 2024-09-21T15:05:49.514 INFO:teuthology.orchestra.run.smithi161.stdout:34359738373 2024-09-21T15:05:49.528 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738375 got 34359738373 for osd.0 2024-09-21T15:05:49.529 INFO:teuthology.orchestra.run.smithi161.stdout:34359738371 2024-09-21T15:05:49.542 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738373 got 34359738371 for osd.1 2024-09-21T15:05:49.549 INFO:teuthology.orchestra.run.smithi161.stdout:34359738372 2024-09-21T15:05:49.563 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738374 got 34359738372 for osd.2 2024-09-21T15:05:50.529 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.0 2024-09-21T15:05:50.543 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.1 2024-09-21T15:05:50.564 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.2 2024-09-21T15:05:50.844 INFO:teuthology.orchestra.run.smithi161.stdout:34359738373 2024-09-21T15:05:50.862 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738375 got 34359738373 for osd.0 2024-09-21T15:05:50.868 INFO:teuthology.orchestra.run.smithi161.stdout:34359738372 2024-09-21T15:05:50.876 INFO:teuthology.orchestra.run.smithi161.stdout:34359738371 2024-09-21T15:05:50.882 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738374 got 34359738372 for osd.2 2024-09-21T15:05:50.889 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738373 got 34359738371 for osd.1 2024-09-21T15:05:51.863 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.0 2024-09-21T15:05:51.882 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.2 2024-09-21T15:05:51.890 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.1 2024-09-21T15:05:52.174 INFO:teuthology.orchestra.run.smithi161.stdout:34359738375 2024-09-21T15:05:52.187 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738375 got 34359738375 for osd.0 2024-09-21T15:05:52.188 DEBUG:teuthology.parallel:result is None 2024-09-21T15:05:52.210 INFO:teuthology.orchestra.run.smithi161.stdout:34359738374 2024-09-21T15:05:52.218 INFO:teuthology.orchestra.run.smithi161.stdout:34359738373 2024-09-21T15:05:52.223 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738374 got 34359738374 for osd.2 2024-09-21T15:05:52.223 DEBUG:teuthology.parallel:result is None 2024-09-21T15:05:52.233 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738373 got 34359738373 for osd.1 2024-09-21T15:05:52.233 DEBUG:teuthology.parallel:result is None 2024-09-21T15:05:52.233 INFO:tasks.ceph.ceph_manager.cluster2:waiting for clean 2024-09-21T15:05:52.233 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-21T15:05:52.533 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:52.536 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-09-21T15:05:52.548 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-21T15:05:50.635625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81572,"kb_used_data":512,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033948,"statfs":{"total":289910292480,"available":289826762752,"internally_reserved":0,"allocated":524288,"data_stored":1295851,"data_compressed":60350,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.582964"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.084470+0000","last_change":"2024-09-21T15:05:48.084470+0000","last_active":"2024-09-21T15:05:48.084470+0000","last_peered":"2024-09-21T15:05:48.084470+0000","last_clean":"2024-09-21T15:05:48.084470+0000","last_became_active":"2024-09-21T15:05:46.074075+0000","last_became_peered":"2024-09-21T15:05:46.074075+0000","last_unstale":"2024-09-21T15:05:48.084470+0000","last_undegraded":"2024-09-21T15:05:48.084470+0000","last_fullsized":"2024-09-21T15:05:48.084470+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:27:06.084591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081259799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.084948+0000","last_change":"2024-09-21T15:05:48.084948+0000","last_active":"2024-09-21T15:05:48.084948+0000","last_peered":"2024-09-21T15:05:48.084948+0000","last_clean":"2024-09-21T15:05:48.084948+0000","last_became_active":"2024-09-21T15:05:46.070093+0000","last_became_peered":"2024-09-21T15:05:46.070093+0000","last_unstale":"2024-09-21T15:05:48.084948+0000","last_undegraded":"2024-09-21T15:05:48.084948+0000","last_fullsized":"2024-09-21T15:05:48.084948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:44.968622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001263908,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.084157+0000","last_change":"2024-09-21T15:05:48.084157+0000","last_active":"2024-09-21T15:05:48.084157+0000","last_peered":"2024-09-21T15:05:48.084157+0000","last_clean":"2024-09-21T15:05:48.084157+0000","last_became_active":"2024-09-21T15:05:46.074031+0000","last_became_peered":"2024-09-21T15:05:46.074031+0000","last_unstale":"2024-09-21T15:05:48.084157+0000","last_undegraded":"2024-09-21T15:05:48.084157+0000","last_fullsized":"2024-09-21T15:05:48.084157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:56.980131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058148599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.085081+0000","last_change":"2024-09-21T15:05:48.085081+0000","last_active":"2024-09-21T15:05:48.085081+0000","last_peered":"2024-09-21T15:05:48.085081+0000","last_clean":"2024-09-21T15:05:48.085081+0000","last_became_active":"2024-09-21T15:05:46.073780+0000","last_became_peered":"2024-09-21T15:05:46.073780+0000","last_unstale":"2024-09-21T15:05:48.085081+0000","last_undegraded":"2024-09-21T15:05:48.085081+0000","last_fullsized":"2024-09-21T15:05:48.085081+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:08.087343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001316731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.082506+0000","last_change":"2024-09-21T15:05:48.081253+0000","last_active":"2024-09-21T15:05:48.082506+0000","last_peered":"2024-09-21T15:05:48.082506+0000","last_clean":"2024-09-21T15:05:48.082506+0000","last_became_active":"2024-09-21T15:05:46.068146+0000","last_became_peered":"2024-09-21T15:05:46.068146+0000","last_unstale":"2024-09-21T15:05:48.082506+0000","last_undegraded":"2024-09-21T15:05:48.082506+0000","last_fullsized":"2024-09-21T15:05:48.082506+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:18.171320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001686313,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.075744+0000","last_change":"2024-09-21T15:05:48.075744+0000","last_active":"2024-09-21T15:05:48.075744+0000","last_peered":"2024-09-21T15:05:48.075744+0000","last_clean":"2024-09-21T15:05:48.075744+0000","last_became_active":"2024-09-21T15:05:46.071491+0000","last_became_peered":"2024-09-21T15:05:46.071491+0000","last_unstale":"2024-09-21T15:05:48.075744+0000","last_undegraded":"2024-09-21T15:05:48.075744+0000","last_fullsized":"2024-09-21T15:05:48.075744+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:05:19.661233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066534299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.075940+0000","last_change":"2024-09-21T15:05:48.075940+0000","last_active":"2024-09-21T15:05:48.075940+0000","last_peered":"2024-09-21T15:05:48.075940+0000","last_clean":"2024-09-21T15:05:48.075940+0000","last_became_active":"2024-09-21T15:05:46.070050+0000","last_became_peered":"2024-09-21T15:05:46.070050+0000","last_unstale":"2024-09-21T15:05:48.075940+0000","last_undegraded":"2024-09-21T15:05:48.075940+0000","last_fullsized":"2024-09-21T15:05:48.075940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:29.810140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079646399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.084287+0000","last_change":"2024-09-21T15:05:48.084287+0000","last_active":"2024-09-21T15:05:48.084287+0000","last_peered":"2024-09-21T15:05:48.084287+0000","last_clean":"2024-09-21T15:05:48.084287+0000","last_became_active":"2024-09-21T15:05:46.069593+0000","last_became_peered":"2024-09-21T15:05:46.069593+0000","last_unstale":"2024-09-21T15:05:48.084287+0000","last_undegraded":"2024-09-21T15:05:48.084287+0000","last_fullsized":"2024-09-21T15:05:48.084287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:33:51.293048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067986000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-21T15:05:47.061506+0000","last_change":"2024-09-21T15:05:40.236152+0000","last_active":"2024-09-21T15:05:47.061506+0000","last_peered":"2024-09-21T15:05:47.061506+0000","last_clean":"2024-09-21T15:05:47.061506+0000","last_became_active":"2024-09-21T15:05:40.233945+0000","last_became_peered":"2024-09-21T15:05:40.233945+0000","last_unstale":"2024-09-21T15:05:47.061506+0000","last_undegraded":"2024-09-21T15:05:47.061506+0000","last_fullsized":"2024-09-21T15:05:47.061506+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:39.013738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:39.013738+0000","last_clean_scrub_stamp":"2024-09-21T15:05:39.013738+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:02.256703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60350,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":38359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":628746,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":628746,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:05:52.549 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-21T15:05:52.852 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:52.856 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-09-21T15:05:52.866 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-21T15:05:52.636169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81572,"kb_used_data":512,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033948,"statfs":{"total":289910292480,"available":289826762752,"internally_reserved":0,"allocated":524288,"data_stored":1295851,"data_compressed":60350,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.575398"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.084470+0000","last_change":"2024-09-21T15:05:48.084470+0000","last_active":"2024-09-21T15:05:48.084470+0000","last_peered":"2024-09-21T15:05:48.084470+0000","last_clean":"2024-09-21T15:05:48.084470+0000","last_became_active":"2024-09-21T15:05:46.074075+0000","last_became_peered":"2024-09-21T15:05:46.074075+0000","last_unstale":"2024-09-21T15:05:48.084470+0000","last_undegraded":"2024-09-21T15:05:48.084470+0000","last_fullsized":"2024-09-21T15:05:48.084470+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:27:06.084591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081259799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.084948+0000","last_change":"2024-09-21T15:05:48.084948+0000","last_active":"2024-09-21T15:05:48.084948+0000","last_peered":"2024-09-21T15:05:48.084948+0000","last_clean":"2024-09-21T15:05:48.084948+0000","last_became_active":"2024-09-21T15:05:46.070093+0000","last_became_peered":"2024-09-21T15:05:46.070093+0000","last_unstale":"2024-09-21T15:05:48.084948+0000","last_undegraded":"2024-09-21T15:05:48.084948+0000","last_fullsized":"2024-09-21T15:05:48.084948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:44.968622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001263908,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.084157+0000","last_change":"2024-09-21T15:05:48.084157+0000","last_active":"2024-09-21T15:05:48.084157+0000","last_peered":"2024-09-21T15:05:48.084157+0000","last_clean":"2024-09-21T15:05:48.084157+0000","last_became_active":"2024-09-21T15:05:46.074031+0000","last_became_peered":"2024-09-21T15:05:46.074031+0000","last_unstale":"2024-09-21T15:05:48.084157+0000","last_undegraded":"2024-09-21T15:05:48.084157+0000","last_fullsized":"2024-09-21T15:05:48.084157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:56.980131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058148599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.085081+0000","last_change":"2024-09-21T15:05:48.085081+0000","last_active":"2024-09-21T15:05:48.085081+0000","last_peered":"2024-09-21T15:05:48.085081+0000","last_clean":"2024-09-21T15:05:48.085081+0000","last_became_active":"2024-09-21T15:05:46.073780+0000","last_became_peered":"2024-09-21T15:05:46.073780+0000","last_unstale":"2024-09-21T15:05:48.085081+0000","last_undegraded":"2024-09-21T15:05:48.085081+0000","last_fullsized":"2024-09-21T15:05:48.085081+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:08.087343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001316731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.082506+0000","last_change":"2024-09-21T15:05:48.081253+0000","last_active":"2024-09-21T15:05:48.082506+0000","last_peered":"2024-09-21T15:05:48.082506+0000","last_clean":"2024-09-21T15:05:48.082506+0000","last_became_active":"2024-09-21T15:05:46.068146+0000","last_became_peered":"2024-09-21T15:05:46.068146+0000","last_unstale":"2024-09-21T15:05:48.082506+0000","last_undegraded":"2024-09-21T15:05:48.082506+0000","last_fullsized":"2024-09-21T15:05:48.082506+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:18.171320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001686313,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.075744+0000","last_change":"2024-09-21T15:05:48.075744+0000","last_active":"2024-09-21T15:05:48.075744+0000","last_peered":"2024-09-21T15:05:48.075744+0000","last_clean":"2024-09-21T15:05:48.075744+0000","last_became_active":"2024-09-21T15:05:46.071491+0000","last_became_peered":"2024-09-21T15:05:46.071491+0000","last_unstale":"2024-09-21T15:05:48.075744+0000","last_undegraded":"2024-09-21T15:05:48.075744+0000","last_fullsized":"2024-09-21T15:05:48.075744+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:05:19.661233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066534299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.075940+0000","last_change":"2024-09-21T15:05:48.075940+0000","last_active":"2024-09-21T15:05:48.075940+0000","last_peered":"2024-09-21T15:05:48.075940+0000","last_clean":"2024-09-21T15:05:48.075940+0000","last_became_active":"2024-09-21T15:05:46.070050+0000","last_became_peered":"2024-09-21T15:05:46.070050+0000","last_unstale":"2024-09-21T15:05:48.075940+0000","last_undegraded":"2024-09-21T15:05:48.075940+0000","last_fullsized":"2024-09-21T15:05:48.075940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:29.810140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079646399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T15:05:48.084287+0000","last_change":"2024-09-21T15:05:48.084287+0000","last_active":"2024-09-21T15:05:48.084287+0000","last_peered":"2024-09-21T15:05:48.084287+0000","last_clean":"2024-09-21T15:05:48.084287+0000","last_became_active":"2024-09-21T15:05:46.069593+0000","last_became_peered":"2024-09-21T15:05:46.069593+0000","last_unstale":"2024-09-21T15:05:48.084287+0000","last_undegraded":"2024-09-21T15:05:48.084287+0000","last_fullsized":"2024-09-21T15:05:48.084287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:33:51.293048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067986000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-21T15:05:47.061506+0000","last_change":"2024-09-21T15:05:40.236152+0000","last_active":"2024-09-21T15:05:47.061506+0000","last_peered":"2024-09-21T15:05:47.061506+0000","last_clean":"2024-09-21T15:05:47.061506+0000","last_became_active":"2024-09-21T15:05:40.233945+0000","last_became_peered":"2024-09-21T15:05:40.233945+0000","last_unstale":"2024-09-21T15:05:47.061506+0000","last_undegraded":"2024-09-21T15:05:47.061506+0000","last_fullsized":"2024-09-21T15:05:47.061506+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:39.013738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:39.013738+0000","last_clean_scrub_stamp":"2024-09-21T15:05:39.013738+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:02.256703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60350,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":38359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":628746,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":628746,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:05:52.867 INFO:tasks.ceph.ceph_manager.cluster2:clean! 2024-09-21T15:05:52.867 INFO:tasks.ceph:Waiting until ceph cluster cluster2 is healthy... 2024-09-21T15:05:52.867 INFO:tasks.ceph.ceph_manager.cluster2:wait_until_healthy 2024-09-21T15:05:52.867 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 health --format=json 2024-09-21T15:05:53.199 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:05:53.199 INFO:teuthology.orchestra.run.smithi161.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T15:05:53.214 INFO:tasks.ceph.ceph_manager.cluster2:wait_until_healthy done 2024-09-21T15:05:53.214 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T15:05:53.223 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T15:05:53.223 INFO:teuthology.task.exec:Running commands on role cluster1.client.mirror.0 host ubuntu@smithi161.front.sepia.ceph.com 2024-09-21T15:05:53.223 DEBUG:teuthology.orchestra.run.smithi161:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror mon '"'"'profile rbd-mirror-peer'"'"' osd '"'"'profile rbd'"'"'' 2024-09-21T15:05:53.616 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.mirror 2024-09-21T15:05:53.629 DEBUG:teuthology.orchestra.run.smithi161:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.0 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2024-09-21T15:05:54.023 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.mirror.0 2024-09-21T15:05:54.036 DEBUG:teuthology.orchestra.run.smithi161:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.1 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2024-09-21T15:05:54.422 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.mirror.1 2024-09-21T15:05:54.435 DEBUG:teuthology.orchestra.run.smithi161:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.2 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2024-09-21T15:05:54.822 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.mirror.2 2024-09-21T15:05:54.835 DEBUG:teuthology.orchestra.run.smithi161:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.3 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2024-09-21T15:05:55.214 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.mirror.3 2024-09-21T15:05:55.226 DEBUG:teuthology.orchestra.run.smithi161:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror mon '"'"'profile rbd-mirror-peer'"'"' osd '"'"'profile rbd'"'"'' 2024-09-21T15:05:55.623 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.mirror 2024-09-21T15:05:55.635 DEBUG:teuthology.orchestra.run.smithi161:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.0 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2024-09-21T15:05:56.026 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.mirror.0 2024-09-21T15:05:56.039 DEBUG:teuthology.orchestra.run.smithi161:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.1 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2024-09-21T15:05:56.417 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.mirror.1 2024-09-21T15:05:56.429 DEBUG:teuthology.orchestra.run.smithi161:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.2 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2024-09-21T15:05:56.815 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.mirror.2 2024-09-21T15:05:56.828 DEBUG:teuthology.orchestra.run.smithi161:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.3 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2024-09-21T15:05:57.219 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.mirror.3 2024-09-21T15:05:57.231 INFO:teuthology.run_tasks:Running task rbd-mirror... 2024-09-21T15:05:57.242 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Restarting daemon 2024-09-21T15:05:57.242 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 2024-09-21T15:05:57.244 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Started 2024-09-21T15:05:57.244 INFO:teuthology.run_tasks:Running task rbd-mirror... 2024-09-21T15:05:57.292 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2024-09-21T15:05:57.292 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2024-09-21T15:05:57.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2024-09-21T15:05:57.295 INFO:teuthology.run_tasks:Running task rbd-mirror... 2024-09-21T15:05:57.328 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Restarting daemon 2024-09-21T15:05:57.328 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 2024-09-21T15:05:57.329 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Started 2024-09-21T15:05:57.330 INFO:teuthology.run_tasks:Running task rbd-mirror... 2024-09-21T15:05:57.361 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Restarting daemon 2024-09-21T15:05:57.362 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.3 2024-09-21T15:05:57.364 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Started 2024-09-21T15:05:57.364 INFO:teuthology.run_tasks:Running task rbd-mirror... 2024-09-21T15:05:57.394 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2024-09-21T15:05:57.395 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2024-09-21T15:05:57.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2024-09-21T15:05:57.396 INFO:teuthology.run_tasks:Running task rbd-mirror... 2024-09-21T15:05:57.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2024-09-21T15:05:57.428 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2024-09-21T15:05:57.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2024-09-21T15:05:57.431 INFO:teuthology.run_tasks:Running task rbd-mirror... 2024-09-21T15:05:57.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Restarting daemon 2024-09-21T15:05:57.462 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 2024-09-21T15:05:57.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Started 2024-09-21T15:05:57.464 INFO:teuthology.run_tasks:Running task rbd-mirror... 2024-09-21T15:05:57.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Restarting daemon 2024-09-21T15:05:57.495 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.3 2024-09-21T15:05:57.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Started 2024-09-21T15:05:57.497 INFO:teuthology.run_tasks:Running task rbd-mirror-thrash... 2024-09-21T15:05:57.530 INFO:tasks.rbd_mirror_thrash:rbd_mirror_thrash using random seed: 1726931157 2024-09-21T15:05:57.530 DEBUG:tasks.rbd_mirror_thrash:Yielding 2024-09-21T15:05:57.531 INFO:teuthology.run_tasks:Running task rbd-mirror-thrash... 2024-09-21T15:05:57.578 INFO:tasks.rbd_mirror_thrash:rbd_mirror_thrash using random seed: 1726931157 2024-09-21T15:05:57.578 DEBUG:tasks.rbd_mirror_thrash:Yielding 2024-09-21T15:05:57.578 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T15:05:57.617 INFO:tasks.workunit:Pulling workunits from ref a477b1894d5c5a613f23260ca0e6b96d79652ba7 2024-09-21T15:05:57.617 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T15:05:57.617 DEBUG:teuthology.orchestra.run.smithi161:> stat -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2024-09-21T15:05:57.617 INFO:tasks.rbd_mirror_thrash:starting thrash for cluster cluster1 2024-09-21T15:05:57.618 INFO:tasks.rbd_mirror_thrash:waiting for 70 secs before thrashing 2024-09-21T15:05:57.618 INFO:tasks.rbd_mirror_thrash:starting thrash for cluster cluster2 2024-09-21T15:05:57.618 INFO:tasks.rbd_mirror_thrash:waiting for 104 secs before thrashing 2024-09-21T15:05:57.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T15:05:57.625 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.cluster1.mirror': No such file or directory 2024-09-21T15:05:57.625 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2024-09-21T15:05:57.673 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.cluster1.mirror 2024-09-21T15:05:57.673 DEBUG:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror && mkdir -- client.mirror 2024-09-21T15:05:57.680 INFO:tasks.workunit:timeout=3h 2024-09-21T15:05:57.680 INFO:tasks.workunit:cleanup=True 2024-09-21T15:05:57.680 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/clone.cluster1.client.mirror && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.cluster1.client.mirror && cd /home/ubuntu/cephtest/clone.cluster1.client.mirror && git checkout a477b1894d5c5a613f23260ca0e6b96d79652ba7 2024-09-21T15:05:57.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:Cloning into '/home/ubuntu/cephtest/clone.cluster1.client.mirror'... 2024-09-21T15:06:55.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:Note: switching to 'a477b1894d5c5a613f23260ca0e6b96d79652ba7'. 2024-09-21T15:06:55.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:06:55.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T15:06:55.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T15:06:55.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T15:06:55.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:06:55.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T15:06:55.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T15:06:55.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:06:55.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: git switch -c 2024-09-21T15:06:55.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:06:55.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:Or undo this operation with: 2024-09-21T15:06:55.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:06:55.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: git switch - 2024-09-21T15:06:55.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:06:55.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T15:06:55.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:06:55.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:HEAD is now at a477b1894d5 Merge pull request #59761 from rhcs-dashboard/reef-hosts-selection-show-only-10-entries-fix 2024-09-21T15:06:55.399 DEBUG:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror 2024-09-21T15:06:55.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T15:06:55.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/direct_io' 2024-09-21T15:06:55.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T15:06:56.247 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T15:06:56.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T15:06:56.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/direct_io' 2024-09-21T15:06:56.386 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/fs' 2024-09-21T15:06:56.386 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T15:06:56.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/fs' 2024-09-21T15:06:56.453 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:06:56.453 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror of=/dev/stdout 2024-09-21T15:06:56.504 INFO:tasks.workunit:Running workunits matching rbd/rbd_mirror_fsx_prepare.sh on cluster1.client.mirror... 2024-09-21T15:06:56.505 INFO:tasks.workunit:Running workunit rbd/rbd_mirror_fsx_prepare.sh... 2024-09-21T15:06:56.505 DEBUG:teuthology.orchestra.run.smithi161:workunit test rbd/rbd_mirror_fsx_prepare.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a477b1894d5c5a613f23260ca0e6b96d79652ba7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS='' RBD_MIRROR_NOCLEANUP=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_fsx_prepare.sh 2024-09-21T15:06:56.520 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ dirname /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_fsx_prepare.sh 2024-09-21T15:06:56.521 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ . /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_helpers.sh 2024-09-21T15:06:56.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ type xmlstarlet 2024-09-21T15:06:56.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ XMLSTARLET=xmlstarlet 2024-09-21T15:06:56.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ RBD_MIRROR_INSTANCES=2 2024-09-21T15:06:56.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CLUSTER1=cluster1 2024-09-21T15:06:56.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CLUSTER2=cluster2 2024-09-21T15:06:56.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ PEER_CLUSTER_SUFFIX= 2024-09-21T15:06:56.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ POOL=mirror 2024-09-21T15:06:56.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ PARENT_POOL=mirror_parent 2024-09-21T15:06:56.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ NS1=ns1 2024-09-21T15:06:56.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ NS2=ns2 2024-09-21T15:06:56.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ TEMPDIR= 2024-09-21T15:06:56.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CEPH_ID=mirror 2024-09-21T15:06:56.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ RBD_IMAGE_FEATURES=layering,exclusive-lock,journaling 2024-09-21T15:06:56.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ MIRROR_USER_ID_PREFIX=mirror. 2024-09-21T15:06:56.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ MIRROR_POOL_MODE=pool 2024-09-21T15:06:56.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ MIRROR_IMAGE_MODE=journal 2024-09-21T15:06:56.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ export 'CEPH_ARGS=--id mirror' 2024-09-21T15:06:56.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CEPH_ARGS='--id mirror' 2024-09-21T15:06:56.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ LAST_MIRROR_INSTANCE=1 2024-09-21T15:06:56.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++++ dirname /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_fsx_prepare.sh 2024-09-21T15:06:56.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+++ readlink -f /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/../../../src 2024-09-21T15:06:56.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror/src 2024-09-21T15:06:56.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CEPH_BIN=. 2024-09-21T15:06:56.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CEPH_SRC=. 2024-09-21T15:06:56.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ '[' -e CMakeCache.txt ']' 2024-09-21T15:06:56.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ '[' 0 -gt 0 ']' 2024-09-21T15:06:56.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ setup 2024-09-21T15:06:56.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local c 2024-09-21T15:06:56.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ trap 'cleanup $?' INT TERM EXIT 2024-09-21T15:06:56.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ setup_tempdir 2024-09-21T15:06:56.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -n '' ']' 2024-09-21T15:06:56.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ mktemp -d 2024-09-21T15:06:56.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ TEMPDIR=/tmp/tmp.P7Xke8W7NB 2024-09-21T15:06:56.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -z 1 ']' 2024-09-21T15:06:56.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ setup_pools cluster1 cluster2 2024-09-21T15:06:56.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:06:56.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local remote_cluster=cluster2 2024-09-21T15:06:56.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local mon_map_file 2024-09-21T15:06:56.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local mon_addr 2024-09-21T15:06:56.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local admin_key_file 2024-09-21T15:06:56.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local uuid 2024-09-21T15:06:56.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:06:56.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ ceph --cluster cluster1 osd pool create mirror 64 64 2024-09-21T15:06:57.952 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:pool 'mirror' already exists 2024-09-21T15:06:57.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:06:57.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ ceph --cluster cluster1 osd pool create mirror_parent 64 64 2024-09-21T15:06:58.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:pool 'mirror_parent' already exists 2024-09-21T15:06:58.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:06:58.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 pool init mirror 2024-09-21T15:07:01.880 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:07:01.880 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 pool init mirror_parent 2024-09-21T15:07:04.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -n '' ']' 2024-09-21T15:07:04.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:07:04.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 mirror pool enable --site-name cluster1 mirror pool 2024-09-21T15:07:04.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 mirror pool enable mirror_parent image 2024-09-21T15:07:05.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 namespace create mirror/ns1 2024-09-21T15:07:05.096 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 namespace create mirror/ns2 2024-09-21T15:07:05.156 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 mirror pool enable mirror/ns1 pool 2024-09-21T15:07:05.222 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 mirror pool enable mirror/ns2 image 2024-09-21T15:07:05.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -z ']' 2024-09-21T15:07:05.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -z ']' 2024-09-21T15:07:05.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ peer_add cluster1 mirror cluster2 2024-09-21T15:07:05.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:07:05.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ shift 2024-09-21T15:07:05.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:07:05.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ shift 2024-09-21T15:07:05.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local client_cluster=cluster2 2024-09-21T15:07:05.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ shift 2024-09-21T15:07:05.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local remote_cluster=cluster2 2024-09-21T15:07:05.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local uuid_var_name 2024-09-21T15:07:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -n '' ']' 2024-09-21T15:07:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local error_code 2024-09-21T15:07:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local peer_uuid 2024-09-21T15:07:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 16 32 2024-09-21T15:07:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ set +e 2024-09-21T15:07:05.286 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 mirror pool peer add mirror cluster2 2024-09-21T15:07:05.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ peer_uuid=9a4e6efa-32b3-4945-8bfc-5f560d2e72d5 2024-09-21T15:07:05.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ error_code=0 2024-09-21T15:07:05.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ set -e 2024-09-21T15:07:05.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 0 -eq 17 ']' 2024-09-21T15:07:05.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ test 0 -eq 0 2024-09-21T15:07:05.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -n '' ']' 2024-09-21T15:07:05.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:07:05.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ peer_add cluster1 mirror_parent cluster2 2024-09-21T15:07:05.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:07:05.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ shift 2024-09-21T15:07:05.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror_parent 2024-09-21T15:07:05.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ shift 2024-09-21T15:07:05.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local client_cluster=cluster2 2024-09-21T15:07:05.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ shift 2024-09-21T15:07:05.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local remote_cluster=cluster2 2024-09-21T15:07:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local uuid_var_name 2024-09-21T15:07:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -n '' ']' 2024-09-21T15:07:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local error_code 2024-09-21T15:07:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local peer_uuid 2024-09-21T15:07:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 16 32 2024-09-21T15:07:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ set +e 2024-09-21T15:07:05.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 mirror pool peer add mirror_parent cluster2 2024-09-21T15:07:05.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ peer_uuid=4f16af0a-7cd2-4b69-8a42-36d7e099cc03 2024-09-21T15:07:05.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ error_code=0 2024-09-21T15:07:05.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ set -e 2024-09-21T15:07:05.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 0 -eq 17 ']' 2024-09-21T15:07:05.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ test 0 -eq 0 2024-09-21T15:07:05.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -n '' ']' 2024-09-21T15:07:05.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:07:05.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ setup_pools cluster2 cluster1 2024-09-21T15:07:05.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:07:05.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local remote_cluster=cluster1 2024-09-21T15:07:05.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local mon_map_file 2024-09-21T15:07:05.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local mon_addr 2024-09-21T15:07:05.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local admin_key_file 2024-09-21T15:07:05.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local uuid 2024-09-21T15:07:05.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:07:05.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ ceph --cluster cluster2 osd pool create mirror 64 64 2024-09-21T15:07:06.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:pool 'mirror' already exists 2024-09-21T15:07:06.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:07:06.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ ceph --cluster cluster2 osd pool create mirror_parent 64 64 2024-09-21T15:07:07.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:pool 'mirror_parent' already exists 2024-09-21T15:07:07.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:07:07.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 pool init mirror 2024-09-21T15:07:07.618 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.0 2024-09-21T15:07:07.619 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Sent signal 15 2024-09-21T15:07:07.619 INFO:tasks.rbd_mirror_thrash:waiting for 9 secs before reviving daemons 2024-09-21T15:07:07.620 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:07:07.615+0000 7fde0480a700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 (PID: 24772) UID: 1000 2024-09-21T15:07:09.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:07:09.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 pool init mirror_parent 2024-09-21T15:07:12.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -n '' ']' 2024-09-21T15:07:12.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:07:12.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 mirror pool enable --site-name cluster2 mirror pool 2024-09-21T15:07:13.021 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 mirror pool enable mirror_parent image 2024-09-21T15:07:13.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 namespace create mirror/ns1 2024-09-21T15:07:13.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 namespace create mirror/ns2 2024-09-21T15:07:13.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 mirror pool enable mirror/ns1 pool 2024-09-21T15:07:13.243 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 mirror pool enable mirror/ns2 image 2024-09-21T15:07:13.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -z ']' 2024-09-21T15:07:13.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -z ']' 2024-09-21T15:07:13.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ peer_add cluster2 mirror cluster1 2024-09-21T15:07:13.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:07:13.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ shift 2024-09-21T15:07:13.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:07:13.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ shift 2024-09-21T15:07:13.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local client_cluster=cluster1 2024-09-21T15:07:13.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ shift 2024-09-21T15:07:13.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local remote_cluster=cluster1 2024-09-21T15:07:13.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local uuid_var_name 2024-09-21T15:07:13.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -n '' ']' 2024-09-21T15:07:13.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local error_code 2024-09-21T15:07:13.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local peer_uuid 2024-09-21T15:07:13.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 16 32 2024-09-21T15:07:13.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ set +e 2024-09-21T15:07:13.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 mirror pool peer add mirror cluster1 2024-09-21T15:07:13.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ peer_uuid=12379e00-1a24-40fe-9186-cefbef07d8f4 2024-09-21T15:07:13.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ error_code=0 2024-09-21T15:07:13.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ set -e 2024-09-21T15:07:13.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 0 -eq 17 ']' 2024-09-21T15:07:13.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ test 0 -eq 0 2024-09-21T15:07:13.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -n '' ']' 2024-09-21T15:07:13.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:07:13.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ peer_add cluster2 mirror_parent cluster1 2024-09-21T15:07:13.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:07:13.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ shift 2024-09-21T15:07:13.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror_parent 2024-09-21T15:07:13.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ shift 2024-09-21T15:07:13.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local client_cluster=cluster1 2024-09-21T15:07:13.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ shift 2024-09-21T15:07:13.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local remote_cluster=cluster1 2024-09-21T15:07:13.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local uuid_var_name 2024-09-21T15:07:13.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -n '' ']' 2024-09-21T15:07:13.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local error_code 2024-09-21T15:07:13.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local peer_uuid 2024-09-21T15:07:13.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 16 32 2024-09-21T15:07:13.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ set +e 2024-09-21T15:07:13.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 mirror pool peer add mirror_parent cluster1 2024-09-21T15:07:13.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ peer_uuid=ff695777-2ca9-49d8-b02b-448935c6380f 2024-09-21T15:07:13.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ error_code=0 2024-09-21T15:07:13.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ set -e 2024-09-21T15:07:13.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 0 -eq 17 ']' 2024-09-21T15:07:13.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ test 0 -eq 0 2024-09-21T15:07:13.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -n '' ']' 2024-09-21T15:07:13.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:07:13.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -n '' ']' 2024-09-21T15:07:13.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cleanup 0 2024-09-21T15:07:13.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local error_code=0 2024-09-21T15:07:13.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ set +e 2024-09-21T15:07:13.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 0 -ne 0 ']' 2024-09-21T15:07:13.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -z 1 ']' 2024-09-21T15:07:13.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 0 -eq 0 ']' 2024-09-21T15:07:13.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ echo OK 2024-09-21T15:07:13.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:OK 2024-09-21T15:07:13.411 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ exit 0 2024-09-21T15:07:13.411 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T15:07:13.411 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp 2024-09-21T15:07:13.422 INFO:tasks.workunit:Stopping ['rbd/rbd_mirror_fsx_prepare.sh'] on cluster1.client.mirror... 2024-09-21T15:07:13.422 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.cluster1.client.mirror /home/ubuntu/cephtest/clone.cluster1.client.mirror 2024-09-21T15:07:13.671 DEBUG:teuthology.parallel:result is None 2024-09-21T15:07:13.672 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror 2024-09-21T15:07:13.687 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror 2024-09-21T15:07:13.687 DEBUG:teuthology.orchestra.run.smithi161:> rmdir -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2024-09-21T15:07:13.701 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror 2024-09-21T15:07:13.701 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-21T15:07:13.715 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-21T15:07:13.716 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.0 2024-09-21T15:07:13.716 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.1 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.1 2024-09-21T15:07:13.717 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.2 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.2 2024-09-21T15:07:13.717 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.3 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.3 2024-09-21T15:07:13.718 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.4 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.4 2024-09-21T15:07:13.718 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.5 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.5 2024-09-21T15:07:13.744 INFO:teuthology.orchestra.run.smithi161.stdout:mapped writes DISABLED 2024-09-21T15:07:13.745 INFO:teuthology.orchestra.run.smithi161.stdout:mapped reads DISABLED 2024-09-21T15:07:13.745 INFO:teuthology.orchestra.run.smithi161.stdout:Seed set to 9756 2024-09-21T15:07:13.745 INFO:teuthology.orchestra.run.smithi161.stdout:mapped writes DISABLED 2024-09-21T15:07:13.745 INFO:teuthology.orchestra.run.smithi161.stdout:mapped reads DISABLED 2024-09-21T15:07:13.745 INFO:teuthology.orchestra.run.smithi161.stdout:Seed set to 347 2024-09-21T15:07:13.749 INFO:teuthology.orchestra.run.smithi161.stdout:mapped writes DISABLED 2024-09-21T15:07:13.749 INFO:teuthology.orchestra.run.smithi161.stdout:mapped reads DISABLED 2024-09-21T15:07:13.749 INFO:teuthology.orchestra.run.smithi161.stdout:Seed set to 2563 2024-09-21T15:07:13.750 INFO:teuthology.orchestra.run.smithi161.stdout:mapped writes DISABLED 2024-09-21T15:07:13.750 INFO:teuthology.orchestra.run.smithi161.stdout:mapped reads DISABLED 2024-09-21T15:07:13.750 INFO:teuthology.orchestra.run.smithi161.stdout:Seed set to 3519 2024-09-21T15:07:13.750 INFO:teuthology.orchestra.run.smithi161.stdout:mapped writes DISABLED 2024-09-21T15:07:13.750 INFO:teuthology.orchestra.run.smithi161.stdout:mapped reads DISABLED 2024-09-21T15:07:13.750 INFO:teuthology.orchestra.run.smithi161.stdout:Seed set to 8882 2024-09-21T15:07:13.750 INFO:teuthology.orchestra.run.smithi161.stdout:mapped writes DISABLED 2024-09-21T15:07:13.751 INFO:teuthology.orchestra.run.smithi161.stdout:mapped reads DISABLED 2024-09-21T15:07:13.751 INFO:teuthology.orchestra.run.smithi161.stdout:Seed set to 4152 2024-09-21T15:07:15.823 INFO:teuthology.orchestra.run.smithi161.stdout:skipping zero length punch hole 2024-09-21T15:07:15.824 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:15.824 INFO:teuthology.orchestra.run.smithi161.stdout:skipping zero size read 2024-09-21T15:07:15.826 INFO:teuthology.orchestra.run.smithi161.stdout:skipping zero size read 2024-09-21T15:07:15.848 INFO:teuthology.orchestra.run.smithi161.stdout:5 write 0x4dfbba4 thru 0x4dfd8ae (0x1d0b bytes) 2024-09-21T15:07:15.857 INFO:teuthology.orchestra.run.smithi161.stdout:6 punch from 0x23316bd to 0x23353f9, (0x3d3c bytes) 2024-09-21T15:07:15.864 INFO:teuthology.orchestra.run.smithi161.stdout:2 write 0xd63cc1d thru 0xd643b76 (0x6f5a bytes) 2024-09-21T15:07:15.873 INFO:teuthology.orchestra.run.smithi161.stdout:4 read 0x938204 thru 0x9435d4 (0xb3d1 bytes) 2024-09-21T15:07:15.873 INFO:teuthology.orchestra.run.smithi161.stdout:6 writesame 0xca9d30f thru 0xcaa18d3 data_size 0x1(0x45c5 bytes) 2024-09-21T15:07:15.880 INFO:teuthology.orchestra.run.smithi161.stdout:7 write 0x59e6abb thru 0x59e70e9 (0x62f bytes) 2024-09-21T15:07:15.888 INFO:teuthology.orchestra.run.smithi161.stdout:7 read 0x74bd299 thru 0x74c3bac (0x6914 bytes) 2024-09-21T15:07:15.888 INFO:teuthology.orchestra.run.smithi161.stdout:8 write 0x6b09d6b thru 0x6b12435 (0x86cb bytes) 2024-09-21T15:07:15.892 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xc9b4273 2024-09-21T15:07:15.896 INFO:teuthology.orchestra.run.smithi161.stdout:9 write 0xbcf87f1 thru 0xbcf9227 (0xa37 bytes) 2024-09-21T15:07:15.901 INFO:teuthology.orchestra.run.smithi161.stdout:8 trunc from 0x59e70ea to 0xc9b4273 2024-09-21T15:07:15.902 INFO:teuthology.orchestra.run.smithi161.stdout:10 read 0x99f8000 thru 0x9a0055b (0x855c bytes) 2024-09-21T15:07:15.902 INFO:teuthology.orchestra.run.smithi161.stdout:11 writesame 0x6a2bb0c thru 0x6a2d605 data_size 0x3(0x1afa bytes) 2024-09-21T15:07:15.910 INFO:teuthology.orchestra.run.smithi161.stdout:13 write 0x6c3f8c6 thru 0x6c4ebd6 (0xf311 bytes) 2024-09-21T15:07:15.924 INFO:teuthology.orchestra.run.smithi161.stdout:15 read 0x93561d4 thru 0x936013e (0x9f6b bytes) 2024-09-21T15:07:15.925 INFO:teuthology.orchestra.run.smithi161.stdout:16 read 0x59c3348 thru 0x59c8dce (0x5a87 bytes) 2024-09-21T15:07:15.925 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xa6e390d 2024-09-21T15:07:15.929 INFO:teuthology.orchestra.run.smithi161.stdout:10 write 0x9ec897 thru 0x9f5684 (0x8dee bytes) 2024-09-21T15:07:15.930 INFO:teuthology.orchestra.run.smithi161.stdout:19 trunc from 0xd643b77 to 0xa6e390d 2024-09-21T15:07:15.940 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:15.940 INFO:teuthology.orchestra.run.smithi161.stdout:12 writesame 0x93147f thru 0x9384c9 data_size 0x13(0x704b bytes) 2024-09-21T15:07:15.947 INFO:teuthology.orchestra.run.smithi161.stdout:14 read 0x978df55 thru 0x97951ae (0x725a bytes) 2024-09-21T15:07:15.947 INFO:teuthology.orchestra.run.smithi161.stdout:15 write 0x55bcc84 thru 0x55c3ed2 (0x724f bytes) 2024-09-21T15:07:15.958 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:15.959 INFO:teuthology.orchestra.run.smithi161.stdout:18 write 0xc9930fe thru 0xc99fdcf (0xccd2 bytes) 2024-09-21T15:07:15.967 INFO:teuthology.orchestra.run.smithi161.stdout:20 read 0x856c9c9 thru 0x8573d22 (0x735a bytes) 2024-09-21T15:07:15.969 INFO:teuthology.orchestra.run.smithi161.stdout:19 read 0x9e9d11e thru 0x9eaad5c (0xdc3f bytes) 2024-09-21T15:07:15.975 INFO:teuthology.orchestra.run.smithi161.stdout:21 trunc from 0xa6e390d to 0x554e900 2024-09-21T15:07:15.982 INFO:teuthology.orchestra.run.smithi161.stdout:20 trunc from 0xc9b4273 to 0x36f2f37 2024-09-21T15:07:16.016 INFO:teuthology.orchestra.run.smithi161.stdout:23 punch from 0xcbfde7 to 0xccac5c, (0xae75 bytes) 2024-09-21T15:07:16.016 INFO:teuthology.orchestra.run.smithi161.stdout:25 writesame 0x31f3a01 thru 0x31fc86f data_size 0x1(0x8e6f bytes) 2024-09-21T15:07:16.047 INFO:teuthology.orchestra.run.smithi161.stdout:21 read 0x35baa8f thru 0x35be10a (0x367c bytes) 2024-09-21T15:07:16.047 INFO:teuthology.orchestra.run.smithi161.stdout:22 read 0x78a587 thru 0x79534b (0xadc5 bytes) 2024-09-21T15:07:16.048 INFO:teuthology.orchestra.run.smithi161.stdout:26 punch from 0x3ca9dee to 0x3cb23c3, (0x85d5 bytes) 2024-09-21T15:07:16.048 INFO:teuthology.orchestra.run.smithi161.stdout:28 punch from 0x15c3ca1 to 0x15cce91, (0x91f0 bytes) 2024-09-21T15:07:16.048 INFO:teuthology.orchestra.run.smithi161.stdout:29 read 0x448f6c1 thru 0x449ab2f (0xb46f bytes) 2024-09-21T15:07:16.048 INFO:teuthology.orchestra.run.smithi161.stdout:23 write 0x17247b8 thru 0x17298bd (0x5106 bytes) 2024-09-21T15:07:16.048 INFO:teuthology.orchestra.run.smithi161.stdout:32 writesame 0x3c91850 thru 0x3c93ab8 data_size 0x1(0x2269 bytes) 2024-09-21T15:07:16.056 INFO:teuthology.orchestra.run.smithi161.stdout:24 read 0x16d37f4 thru 0x16dec4f (0xb45c bytes) 2024-09-21T15:07:16.056 INFO:teuthology.orchestra.run.smithi161.stdout:25 read 0x27ceb81 thru 0x27de894 (0xfd14 bytes) 2024-09-21T15:07:16.057 INFO:teuthology.orchestra.run.smithi161.stdout:26 read 0x123d208 thru 0x124c3b9 (0xf1b2 bytes) 2024-09-21T15:07:16.057 INFO:teuthology.orchestra.run.smithi161.stdout:27 write 0xa11575 thru 0xa147be (0x324a bytes) 2024-09-21T15:07:16.061 INFO:teuthology.orchestra.run.smithi161.stdout:28 writesame 0x3206bea thru 0x3209633 data_size 0x1(0x2a4a bytes) 2024-09-21T15:07:16.078 INFO:teuthology.orchestra.run.smithi161.stdout:29 trunc from 0x36f2f37 to 0x56e63d1 2024-09-21T15:07:16.086 INFO:teuthology.orchestra.run.smithi161.stdout:33 writesame 0xbd1743c thru 0xbd2034b data_size 0x70(0x8f10 bytes) 2024-09-21T15:07:16.089 INFO:teuthology.orchestra.run.smithi161.stdout:34 write 0x5fc0dda thru 0x5fced49 (0xdf70 bytes) 2024-09-21T15:07:16.100 INFO:teuthology.orchestra.run.smithi161.stdout:30 punch from 0x4ef2ae4 to 0x4ef4198, (0x16b4 bytes) 2024-09-21T15:07:16.100 INFO:teuthology.orchestra.run.smithi161.stdout:32 write 0x4d0a388 thru 0x4d0d84e (0x34c7 bytes) 2024-09-21T15:07:16.100 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:16.100 INFO:teuthology.orchestra.run.smithi161.stdout:36 writesame 0x3de9f6b thru 0x3df91c8 data_size 0x36(0xf25e bytes) 2024-09-21T15:07:16.107 INFO:teuthology.orchestra.run.smithi161.stdout:33 punch from 0x974247 to 0x97b442, (0x71fb bytes) 2024-09-21T15:07:16.107 INFO:teuthology.orchestra.run.smithi161.stdout:35 clone 1 order 23 su 32768 sc 12 2024-09-21T15:07:16.119 INFO:teuthology.orchestra.run.smithi161.stdout:38 trunc from 0xbd2034c to 0x1f38703 2024-09-21T15:07:16.151 INFO:teuthology.orchestra.run.smithi161.stdout:39 trunc from 0x1f38703 to 0x1b16f5a 2024-09-21T15:07:16.174 INFO:teuthology.orchestra.run.smithi161.stdout:40 read 0xb92576 thru 0xb9c1b2 (0x9c3d bytes) 2024-09-21T15:07:16.175 INFO:teuthology.orchestra.run.smithi161.stdout:41 read 0x1556984 thru 0x15602af (0x992c bytes) 2024-09-21T15:07:16.175 INFO:teuthology.orchestra.run.smithi161.stdout:42 read 0xea540 thru 0xf4224 (0x9ce5 bytes) 2024-09-21T15:07:16.198 INFO:teuthology.orchestra.run.smithi161.stdout:43 writesame 0x3237685 thru 0x3238787 data_size 0x5(0x1103 bytes) 2024-09-21T15:07:16.201 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:16.201 INFO:teuthology.orchestra.run.smithi161.stdout:45 punch from 0x123e2ff to 0x124bc59, (0xd95a bytes) 2024-09-21T15:07:16.201 INFO:teuthology.orchestra.run.smithi161.stdout:46 read 0x297b191 thru 0x297db41 (0x29b1 bytes) 2024-09-21T15:07:16.236 INFO:teuthology.orchestra.run.smithi161.stdout:47 writesame 0x742141c thru 0x742edd5 data_size 0x3a(0xd9ba bytes) 2024-09-21T15:07:16.239 INFO:teuthology.orchestra.run.smithi161.stdout:48 read 0x1fc0af6 thru 0x1fc3391 (0x289c bytes) 2024-09-21T15:07:16.239 INFO:teuthology.orchestra.run.smithi161.stdout:50 read 0x6257aab thru 0x6262af1 (0xb047 bytes) 2024-09-21T15:07:16.239 INFO:teuthology.orchestra.run.smithi161.stdout:51 read 0xc6e9b4 thru 0xc71d0a (0x3357 bytes) 2024-09-21T15:07:16.239 INFO:teuthology.orchestra.run.smithi161.stdout:54 read 0x4a15b46 thru 0x4a253bf (0xf87a bytes) 2024-09-21T15:07:16.239 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:16.239 INFO:teuthology.orchestra.run.smithi161.stdout:56 writesame 0x7107cea thru 0x7107ff5 data_size 0xf(0x30c bytes) 2024-09-21T15:07:16.252 INFO:teuthology.orchestra.run.smithi161.stdout:59 read 0x2a05856 thru 0x2a07ab4 (0x225f bytes) 2024-09-21T15:07:16.252 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:16.252 INFO:teuthology.orchestra.run.smithi161.stdout:61 writesame 0x5014012 thru 0x501be60 data_size 0x1d(0x7e4f bytes) 2024-09-21T15:07:16.267 INFO:teuthology.orchestra.run.smithi161.stdout:62 read 0x21ac50f thru 0x21ba391 (0xde83 bytes) 2024-09-21T15:07:16.307 INFO:teuthology.orchestra.run.smithi161.stdout:63 write 0xb4c6ffb thru 0xb4d2fe3 (0xbfe9 bytes) 2024-09-21T15:07:16.317 INFO:teuthology.orchestra.run.smithi161.stdout:64 read 0x3f9d118 thru 0x3fa97dc (0xc6c5 bytes) 2024-09-21T15:07:16.317 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:16.317 INFO:teuthology.orchestra.run.smithi161.stdout:67 read 0x5d46ba4 thru 0x5d52f18 (0xc375 bytes) 2024-09-21T15:07:16.317 INFO:teuthology.orchestra.run.smithi161.stdout:68 write 0x368ab76 thru 0x36978b6 (0xcd41 bytes) 2024-09-21T15:07:16.325 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xdcdd4c2 2024-09-21T15:07:16.327 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0x7c33776 2024-09-21T15:07:16.334 INFO:teuthology.orchestra.run.smithi161.stdout:69 trunc from 0xb4d2fe4 to 0xdcdd4c2 2024-09-21T15:07:16.342 INFO:teuthology.orchestra.run.smithi161.stdout:1 trunc from 0x0 to 0x7c33776 2024-09-21T15:07:16.362 INFO:teuthology.orchestra.run.smithi161.stdout:2 write 0x579ffe thru 0x5828f3 (0x88f6 bytes) 2024-09-21T15:07:16.371 INFO:teuthology.orchestra.run.smithi161.stdout:3 read 0x153226d thru 0x1540e00 (0xeb94 bytes) 2024-09-21T15:07:16.371 INFO:teuthology.orchestra.run.smithi161.stdout:5 write 0x63fd56d thru 0x6405af2 (0x8586 bytes) 2024-09-21T15:07:16.378 INFO:teuthology.orchestra.run.smithi161.stdout:70 write 0xe786503 thru 0xe786ce8 (0x7e6 bytes) 2024-09-21T15:07:16.380 INFO:teuthology.orchestra.run.smithi161.stdout:6 clone 1 order 25 su 2097152 sc 10 2024-09-21T15:07:16.392 INFO:teuthology.orchestra.run.smithi161.stdout:71 writesame 0x73952a3 thru 0x739d55c data_size 0x1d(0x82ba bytes) 2024-09-21T15:07:16.397 INFO:teuthology.orchestra.run.smithi161.stdout:72 read 0xbadc7e2 thru 0xbae15c3 (0x4de2 bytes) 2024-09-21T15:07:16.397 INFO:teuthology.orchestra.run.smithi161.stdout:74 writesame 0xce8b851 thru 0xce9a993 data_size 0x1(0xf143 bytes) 2024-09-21T15:07:16.447 INFO:teuthology.orchestra.run.smithi161.stdout:77 write 0xce20212 thru 0xce2509e (0x4e8d bytes) 2024-09-21T15:07:16.454 INFO:teuthology.orchestra.run.smithi161.stdout:79 writesame 0x4cbd911 thru 0x4ccd6e9 data_size 0x29(0xfdd9 bytes) 2024-09-21T15:07:16.473 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:16.473 INFO:teuthology.orchestra.run.smithi161.stdout:81 write 0xe6fd0f8 thru 0xe700aae (0x39b7 bytes) 2024-09-21T15:07:16.484 INFO:teuthology.orchestra.run.smithi161.stdout:82 read 0xb4f525b thru 0xb50432d (0xf0d3 bytes) 2024-09-21T15:07:16.485 INFO:teuthology.orchestra.run.smithi161.stdout:83 punch from 0x9b2b4af to 0x9b32553, (0x70a4 bytes) 2024-09-21T15:07:16.485 INFO:teuthology.orchestra.run.smithi161.stdout:84 read 0xa0a2f4f thru 0xa0ae742 (0xb7f4 bytes) 2024-09-21T15:07:16.485 INFO:teuthology.orchestra.run.smithi161.stdout:85 writesame 0xa5ea95d thru 0xa5f90bc data_size 0x30(0xe760 bytes) 2024-09-21T15:07:16.499 INFO:teuthology.orchestra.run.smithi161.stdout:86 read 0xdef9cfb thru 0xdf025cc (0x88d2 bytes) 2024-09-21T15:07:16.499 INFO:teuthology.orchestra.run.smithi161.stdout:87 read 0x171fa2f thru 0x172274c (0x2d1e bytes) 2024-09-21T15:07:16.499 INFO:teuthology.orchestra.run.smithi161.stdout:88 punch from 0x1a0f139 to 0x1a1aec1, (0xbd88 bytes) 2024-09-21T15:07:16.500 INFO:teuthology.orchestra.run.smithi161.stdout:89 read 0x3c26941 thru 0x3c35700 (0xedc0 bytes) 2024-09-21T15:07:16.500 INFO:teuthology.orchestra.run.smithi161.stdout:91 write 0xd88c3c6 thru 0xd88db53 (0x178e bytes) 2024-09-21T15:07:16.510 INFO:teuthology.orchestra.run.smithi161.stdout:92 writesame 0x6927c0e thru 0x69369f1 data_size 0x74(0xede4 bytes) 2024-09-21T15:07:16.524 INFO:teuthology.orchestra.run.smithi161.stdout:93 read 0x7eb6e43 thru 0x7ebacfc (0x3eba bytes) 2024-09-21T15:07:16.524 INFO:teuthology.orchestra.run.smithi161.stdout:94 punch from 0x4f27414 to 0x4f35b62, (0xe74e bytes) 2024-09-21T15:07:16.524 INFO:teuthology.orchestra.run.smithi161.stdout:96 read 0x5395722 thru 0x539e88b (0x916a bytes) 2024-09-21T15:07:16.525 INFO:teuthology.orchestra.run.smithi161.stdout:97 punch from 0x4e63d7d to 0x4e736e0, (0xf963 bytes) 2024-09-21T15:07:16.525 INFO:teuthology.orchestra.run.smithi161.stdout:99 writesame 0x2198306 thru 0x21a4c05 data_size 0x1(0xc900 bytes) 2024-09-21T15:07:16.565 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:16.565 INFO:teuthology.orchestra.run.smithi161.stdout:105 read 0x6cd82a9 thru 0x6cdafad (0x2d05 bytes) 2024-09-21T15:07:16.565 INFO:teuthology.orchestra.run.smithi161.stdout:106 write 0xa0fb20c thru 0xa105105 (0x9efa bytes) 2024-09-21T15:07:16.573 INFO:teuthology.orchestra.run.smithi161.stdout:107 write 0x57d68a3 thru 0x57e595a (0xf0b8 bytes) 2024-09-21T15:07:16.581 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:16.581 INFO:teuthology.orchestra.run.smithi161.stdout:111 read 0x85c29a7 thru 0x85c53af (0x2a09 bytes) 2024-09-21T15:07:16.581 INFO:teuthology.orchestra.run.smithi161.stdout:112 writesame 0x60d7d44 thru 0x60e13fd data_size 0x76(0x96ba bytes) 2024-09-21T15:07:16.592 INFO:teuthology.orchestra.run.smithi161.stdout:114 write 0xe5bc81 thru 0xe62118 (0x6498 bytes) 2024-09-21T15:07:16.607 INFO:teuthology.orchestra.run.smithi161.stdout:115 read 0x530af76 thru 0x53165ee (0xb679 bytes) 2024-09-21T15:07:16.607 INFO:teuthology.orchestra.run.smithi161.stdout:116 write 0x89bf95 thru 0x8a36ea (0x7756 bytes) 2024-09-21T15:07:16.614 INFO:teuthology.orchestra.run.smithi161.stdout:2 write 0x5a16da6 thru 0x5a1a591 (0x37ec bytes) 2024-09-21T15:07:16.616 INFO:teuthology.orchestra.run.smithi161.stdout:118 read 0x59c6d7b thru 0x59cf991 (0x8c17 bytes) 2024-09-21T15:07:16.616 INFO:teuthology.orchestra.run.smithi161.stdout:119 writesame 0x30a301e thru 0x30a9029 data_size 0x12(0x600c bytes) 2024-09-21T15:07:16.620 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.0 2024-09-21T15:07:16.620 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:07:16.620 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.0 2024-09-21T15:07:16.620 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Restarting daemon 2024-09-21T15:07:16.621 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 2024-09-21T15:07:16.623 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Started 2024-09-21T15:07:16.623 INFO:tasks.rbd_mirror_thrash:waiting for 62 secs before thrashing 2024-09-21T15:07:16.623 INFO:teuthology.orchestra.run.smithi161.stdout:3 writesame 0x24a5af6 thru 0x24b28c3 data_size 0x9(0xcdce bytes) 2024-09-21T15:07:16.644 INFO:teuthology.orchestra.run.smithi161.stdout:120 trunc from 0xe786ce9 to 0x116da2f 2024-09-21T15:07:16.682 INFO:teuthology.orchestra.run.smithi161.stdout:4 write 0xe891335 thru 0xe899e0f (0x8adb bytes) 2024-09-21T15:07:16.691 INFO:teuthology.orchestra.run.smithi161.stdout:121 trunc from 0x116da2f to 0x10da14a 2024-09-21T15:07:16.693 INFO:teuthology.orchestra.run.smithi161.stdout:6 write 0x27db523 thru 0x27e3a87 (0x8565 bytes) 2024-09-21T15:07:16.700 INFO:teuthology.orchestra.run.smithi161.stdout:8 writesame 0x73a927e thru 0x73a9e51 data_size 0x2(0xbd4 bytes) 2024-09-21T15:07:16.709 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:07:16.707+0000 7f2fdadcaa80 -1 asok(0x55f20c40e000) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok': (17) File exists 2024-09-21T15:07:16.713 INFO:teuthology.orchestra.run.smithi161.stdout:9 read 0x5f903f2 thru 0x5f9d517 (0xd126 bytes) 2024-09-21T15:07:16.713 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:16.713 INFO:teuthology.orchestra.run.smithi161.stdout:11 write 0x6fa7f6e thru 0x6fac090 (0x4123 bytes) 2024-09-21T15:07:16.727 INFO:teuthology.orchestra.run.smithi161.stdout:12 read 0x52a19df thru 0x52aa70c (0x8d2e bytes) 2024-09-21T15:07:16.727 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:16.727 INFO:teuthology.orchestra.run.smithi161.stdout:15 write 0x7c34a87 thru 0x7c3bdc1 (0x733b bytes) 2024-09-21T15:07:16.735 INFO:teuthology.orchestra.run.smithi161.stdout:16 read 0x34c4998 thru 0x34cf2f9 (0xa962 bytes) 2024-09-21T15:07:16.736 INFO:teuthology.orchestra.run.smithi161.stdout:17 write 0x6baabf3 thru 0x6bb7ae9 (0xcef7 bytes) 2024-09-21T15:07:16.742 INFO:teuthology.orchestra.run.smithi161.stdout:36 write 0x2bf6228 thru 0x2c01d0d (0xbae6 bytes) 2024-09-21T15:07:16.743 INFO:teuthology.orchestra.run.smithi161.stdout:122 writesame 0x40ee3b7 thru 0x40ef24b data_size 0x1(0xe95 bytes) 2024-09-21T15:07:16.745 INFO:teuthology.orchestra.run.smithi161.stdout:18 write 0x3f784b1 thru 0x3f847a9 (0xc2f9 bytes) 2024-09-21T15:07:16.746 INFO:teuthology.orchestra.run.smithi161.stdout:123 punch from 0x119742b to 0x119caeb, (0x56c0 bytes) 2024-09-21T15:07:16.746 INFO:teuthology.orchestra.run.smithi161.stdout:124 read 0x239413d thru 0x239f56f (0xb433 bytes) 2024-09-21T15:07:16.746 INFO:teuthology.orchestra.run.smithi161.stdout:126 punch from 0x12b5eb0 to 0x12b7ed8, (0x2028 bytes) 2024-09-21T15:07:16.746 INFO:teuthology.orchestra.run.smithi161.stdout:127 punch from 0x173d8d7 to 0x174b730, (0xde59 bytes) 2024-09-21T15:07:16.746 INFO:teuthology.orchestra.run.smithi161.stdout:129 read 0xc30f61 thru 0xc3e93e (0xd9de bytes) 2024-09-21T15:07:16.747 INFO:teuthology.orchestra.run.smithi161.stdout:130 writesame 0x2916b76 thru 0x2922a6f data_size 0x5(0xbefa bytes) 2024-09-21T15:07:16.748 INFO:teuthology.orchestra.run.smithi161.stdout:7 read 0x63e8277 thru 0x63ed52e (0x52b8 bytes) 2024-09-21T15:07:16.757 INFO:teuthology.orchestra.run.smithi161.stdout:19 read 0x38be81b thru 0x38c3a35 (0x521b bytes) 2024-09-21T15:07:16.757 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0x6f30927 2024-09-21T15:07:16.758 INFO:teuthology.orchestra.run.smithi161.stdout:131 writesame 0x22a8276 thru 0x22ad313 data_size 0x2(0x509e bytes) 2024-09-21T15:07:16.768 INFO:teuthology.orchestra.run.smithi161.stdout:20 trunc from 0xe899e10 to 0x6f30927 2024-09-21T15:07:16.769 INFO:teuthology.orchestra.run.smithi161.stdout:8 read 0x6964786 thru 0x696c4ec (0x7d67 bytes) 2024-09-21T15:07:16.769 INFO:teuthology.orchestra.run.smithi161.stdout:9 punch from 0x35c3878 to 0x35c90c4, (0x584c bytes) 2024-09-21T15:07:16.770 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:16.795 INFO:teuthology.orchestra.run.smithi161.stdout:10 write 0x8d4cf05 thru 0x8d52ab0 (0x5bac bytes) 2024-09-21T15:07:16.805 INFO:teuthology.orchestra.run.smithi161.stdout:37 trunc from 0x56e63d1 to 0x195ee80 2024-09-21T15:07:16.807 INFO:teuthology.orchestra.run.smithi161.stdout:11 read 0x55071b9 thru 0x551048f (0x92d7 bytes) 2024-09-21T15:07:16.807 INFO:teuthology.orchestra.run.smithi161.stdout:12 punch from 0x29fb391 to 0x2a093c2, (0xe031 bytes) 2024-09-21T15:07:16.807 INFO:teuthology.orchestra.run.smithi161.stdout:15 write 0x8a2cc3c thru 0x8a33569 (0x692e bytes) 2024-09-21T15:07:16.812 INFO:teuthology.orchestra.run.smithi161.stdout:133 writesame 0x7ccb463 thru 0x7cd8def data_size 0x3d(0xd98d bytes) 2024-09-21T15:07:16.818 INFO:teuthology.orchestra.run.smithi161.stdout:134 read 0x2dca9b7 thru 0x2dd7adc (0xd126 bytes) 2024-09-21T15:07:16.818 INFO:teuthology.orchestra.run.smithi161.stdout:136 write 0x211f57c thru 0x2129f85 (0xaa0a bytes) 2024-09-21T15:07:16.825 INFO:teuthology.orchestra.run.smithi161.stdout:17 write 0x83c689f thru 0x83d00e6 (0x9848 bytes) 2024-09-21T15:07:16.829 INFO:teuthology.orchestra.run.smithi161.stdout:138 punch from 0x6a41724 to 0x6a4c8fd, (0xb1d9 bytes) 2024-09-21T15:07:16.833 INFO:teuthology.orchestra.run.smithi161.stdout:21 punch from 0x4ebf91d to 0x4ecbbec, (0xc2cf bytes) 2024-09-21T15:07:16.834 INFO:teuthology.orchestra.run.smithi161.stdout:23 read 0xe63d9f thru 0xe69b3b (0x5d9d bytes) 2024-09-21T15:07:16.834 INFO:teuthology.orchestra.run.smithi161.stdout:24 writesame 0x692ea45 thru 0x693e2e9 data_size 0x1(0xf8a5 bytes) 2024-09-21T15:07:16.882 INFO:teuthology.orchestra.run.smithi161.stdout:25 write 0x2161d8b thru 0x216a9b3 (0x8c29 bytes) 2024-09-21T15:07:16.891 INFO:teuthology.orchestra.run.smithi161.stdout:139 write 0x9c67f6c thru 0x9c73e4a (0xbedf bytes) 2024-09-21T15:07:16.893 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:16.893 INFO:teuthology.orchestra.run.smithi161.stdout:27 write 0x16f594c thru 0x16fc731 (0x6de6 bytes) 2024-09-21T15:07:16.903 INFO:teuthology.orchestra.run.smithi161.stdout:140 read 0x56c15c thru 0x56df15 (0x1dba bytes) 2024-09-21T15:07:16.903 INFO:teuthology.orchestra.run.smithi161.stdout:141 write 0x2285777 thru 0x2287799 (0x2023 bytes) 2024-09-21T15:07:16.909 INFO:teuthology.orchestra.run.smithi161.stdout:19 write 0xad18ec6 thru 0xad22342 (0x947d bytes) 2024-09-21T15:07:16.924 INFO:teuthology.orchestra.run.smithi161.stdout:20 writesame 0x7cf65a3 thru 0x7cfcfa8 data_size 0x29(0x6a06 bytes) 2024-09-21T15:07:16.938 INFO:teuthology.orchestra.run.smithi161.stdout:21 writesame 0x50cd512 thru 0x50d2b59 data_size 0x16(0x5648 bytes) 2024-09-21T15:07:16.949 INFO:teuthology.orchestra.run.smithi161.stdout:22 write 0x959d173 thru 0x959fa83 (0x2911 bytes) 2024-09-21T15:07:16.951 INFO:teuthology.orchestra.run.smithi161.stdout:29 write 0x9201804 thru 0x9208e9f (0x769c bytes) 2024-09-21T15:07:16.960 INFO:teuthology.orchestra.run.smithi161.stdout:142 write 0xd2acc42 thru 0xd2b74b0 (0xa86f bytes) 2024-09-21T15:07:16.967 INFO:teuthology.orchestra.run.smithi161.stdout:30 read 0x66d0c80 thru 0x66db751 (0xaad2 bytes) 2024-09-21T15:07:16.968 INFO:teuthology.orchestra.run.smithi161.stdout:31 write 0x8196161 thru 0x819b212 (0x50b2 bytes) 2024-09-21T15:07:16.968 INFO:teuthology.orchestra.run.smithi161.stdout:23 writesame 0x2d4115c thru 0x2d4f7c3 data_size 0x65(0xe668 bytes) 2024-09-21T15:07:16.970 INFO:teuthology.orchestra.run.smithi161.stdout:38 write 0x2f31a65 thru 0x2f3db62 (0xc0fe bytes) 2024-09-21T15:07:16.979 INFO:teuthology.orchestra.run.smithi161.stdout:24 write 0x169cd2d thru 0x16a9293 (0xc567 bytes) 2024-09-21T15:07:16.979 INFO:teuthology.orchestra.run.smithi161.stdout:143 read 0x4c7a1c thru 0x4d2ad4 (0xb0b9 bytes) 2024-09-21T15:07:16.979 INFO:teuthology.orchestra.run.smithi161.stdout:145 read 0x6373046 thru 0x6373499 (0x454 bytes) 2024-09-21T15:07:16.979 INFO:teuthology.orchestra.run.smithi161.stdout:146 punch from 0xb2b4e69 to 0xb2bad05, (0x5e9c bytes) 2024-09-21T15:07:16.979 INFO:teuthology.orchestra.run.smithi161.stdout:147 write 0x17cbf5e thru 0x17d01a2 (0x4245 bytes) 2024-09-21T15:07:16.980 INFO:teuthology.orchestra.run.smithi161.stdout:40 punch from 0x6ac451 to 0x6ad852, (0x1401 bytes) 2024-09-21T15:07:16.982 INFO:teuthology.orchestra.run.smithi161.stdout:32 read 0x515bb1d thru 0x5165425 (0x9909 bytes) 2024-09-21T15:07:16.982 INFO:teuthology.orchestra.run.smithi161.stdout:33 write 0x825ae63 thru 0x82670bc (0xc25a bytes) 2024-09-21T15:07:16.989 INFO:teuthology.orchestra.run.smithi161.stdout:148 punch from 0xa020981 to 0xa02f35e, (0xe9dd bytes) 2024-09-21T15:07:16.993 INFO:teuthology.orchestra.run.smithi161.stdout:25 write 0x5759884 thru 0x575fff4 (0x6771 bytes) 2024-09-21T15:07:17.012 INFO:teuthology.orchestra.run.smithi161.stdout:151 trunc from 0xd2b74b1 to 0x1b87345 2024-09-21T15:07:17.016 INFO:teuthology.orchestra.run.smithi161.stdout:27 trunc from 0xad22343 to 0x1b3ba16 2024-09-21T15:07:17.037 INFO:teuthology.orchestra.run.smithi161.stdout:34 writesame 0xee69b81 thru 0xee6b27f data_size 0x7(0x16ff bytes) 2024-09-21T15:07:17.039 INFO:teuthology.orchestra.run.smithi161.stdout:35 punch from 0x6bfda3 to 0x6cd19c, (0xd3f9 bytes) 2024-09-21T15:07:17.039 INFO:teuthology.orchestra.run.smithi161.stdout:37 write 0x17ad90a thru 0x17b9cd3 (0xc3ca bytes) 2024-09-21T15:07:17.043 INFO:teuthology.orchestra.run.smithi161.stdout:41 write 0xcaae143 thru 0xcab64d9 (0x8397 bytes) 2024-09-21T15:07:17.049 INFO:teuthology.orchestra.run.smithi161.stdout:40 read 0x6370ed0 thru 0x6373ec0 (0x2ff1 bytes) 2024-09-21T15:07:17.049 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.049 INFO:teuthology.orchestra.run.smithi161.stdout:45 write 0x248c4f8 thru 0x248ed4b (0x2854 bytes) 2024-09-21T15:07:17.060 INFO:teuthology.orchestra.run.smithi161.stdout:46 write 0xb934bc2 thru 0xb93fa34 (0xae73 bytes) 2024-09-21T15:07:17.062 INFO:teuthology.orchestra.run.smithi161.stdout:29 trunc from 0x1b3ba16 to 0x173ff0c 2024-09-21T15:07:17.067 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.068 INFO:teuthology.orchestra.run.smithi161.stdout:43 punch from 0xcab6007 to 0xcab64da, (0x4d3 bytes) 2024-09-21T15:07:17.068 INFO:teuthology.orchestra.run.smithi161.stdout:44 read 0xc53e0d9 thru 0xc53e60c (0x534 bytes) 2024-09-21T15:07:17.068 INFO:teuthology.orchestra.run.smithi161.stdout:152 read 0x12e0167 thru 0x12e8142 (0x7fdc bytes) 2024-09-21T15:07:17.073 INFO:teuthology.orchestra.run.smithi161.stdout:47 read 0x4b2db thru 0x5206f (0x6d95 bytes) 2024-09-21T15:07:17.073 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.074 INFO:teuthology.orchestra.run.smithi161.stdout:55 read 0x3d4cad thru 0x3d9bfe (0x4f52 bytes) 2024-09-21T15:07:17.083 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xe2b77ad 2024-09-21T15:07:17.089 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.089 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.101 INFO:teuthology.orchestra.run.smithi161.stdout:56 trunc from 0xee6b280 to 0x2f3e8db 2024-09-21T15:07:17.101 INFO:teuthology.orchestra.run.smithi161.stdout:45 trunc from 0xcab64da to 0x161250b 2024-09-21T15:07:17.114 INFO:teuthology.orchestra.run.smithi161.stdout:3 trunc from 0x0 to 0xe2b77ad 2024-09-21T15:07:17.117 INFO:teuthology.orchestra.run.smithi161.stdout:153 writesame 0xbeed47f thru 0xbef6556 data_size 0x78(0x90d8 bytes) 2024-09-21T15:07:17.121 INFO:teuthology.orchestra.run.smithi161.stdout:155 read 0xaddaba6 thru 0xade43fb (0x9856 bytes) 2024-09-21T15:07:17.121 INFO:teuthology.orchestra.run.smithi161.stdout:158 writesame 0x1e06e6b thru 0x1e0c526 data_size 0xe(0x56bc bytes) 2024-09-21T15:07:17.131 INFO:teuthology.orchestra.run.smithi161.stdout:34 writesame 0x7045115 thru 0x704d9fa data_size 0x42(0x88e6 bytes) 2024-09-21T15:07:17.131 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.139 INFO:teuthology.orchestra.run.smithi161.stdout:37 read 0x2120d4e thru 0x2130491 (0xf744 bytes) 2024-09-21T15:07:17.140 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.140 INFO:teuthology.orchestra.run.smithi161.stdout:40 punch from 0x58535e8 to 0x58574f0, (0x3f08 bytes) 2024-09-21T15:07:17.140 INFO:teuthology.orchestra.run.smithi161.stdout:5 punch from 0x3ee4e08 to 0x3eeebd8, (0x9dd0 bytes) 2024-09-21T15:07:17.141 INFO:teuthology.orchestra.run.smithi161.stdout:6 punch from 0x8161f0f to 0x816c756, (0xa847 bytes) 2024-09-21T15:07:17.141 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.141 INFO:teuthology.orchestra.run.smithi161.stdout:10 writesame 0x9285c39 thru 0x92913a1 data_size 0x6f(0xb769 bytes) 2024-09-21T15:07:17.143 INFO:teuthology.orchestra.run.smithi161.stdout:41 trunc from 0x704d9fb to 0x536e09f 2024-09-21T15:07:17.153 INFO:teuthology.orchestra.run.smithi161.stdout:46 read 0x14585e2 thru 0x146659f (0xdfbe bytes) 2024-09-21T15:07:17.154 INFO:teuthology.orchestra.run.smithi161.stdout:12 punch from 0x938efdd to 0x939cc9c, (0xdcbf bytes) 2024-09-21T15:07:17.154 INFO:teuthology.orchestra.run.smithi161.stdout:13 write 0x1f7c054 thru 0x1f84147 (0x80f4 bytes) 2024-09-21T15:07:17.155 INFO:teuthology.orchestra.run.smithi161.stdout:47 flatten 2024-09-21T15:07:17.168 INFO:teuthology.orchestra.run.smithi161.stdout:162 write 0xbfd4316 thru 0xbfe273e (0xe429 bytes) 2024-09-21T15:07:17.173 INFO:teuthology.orchestra.run.smithi161.stdout:16 write 0x62aadfa thru 0x62b82e5 (0xd4ec bytes) 2024-09-21T15:07:17.181 INFO:teuthology.orchestra.run.smithi161.stdout:57 write 0x5817ab8 thru 0x581de48 (0x6391 bytes) 2024-09-21T15:07:17.189 INFO:teuthology.orchestra.run.smithi161.stdout:163 writesame 0x31f921d thru 0x31fd45f data_size 0x1(0x4243 bytes) 2024-09-21T15:07:17.193 INFO:teuthology.orchestra.run.smithi161.stdout:18 write 0x7b8dacf thru 0x7b97e88 (0xa3ba bytes) 2024-09-21T15:07:17.197 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0x7c8e73a 2024-09-21T15:07:17.206 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.206 INFO:teuthology.orchestra.run.smithi161.stdout:165 clone 1 order 25 su 262144 sc 12 2024-09-21T15:07:17.209 INFO:teuthology.orchestra.run.smithi161.stdout:43 trunc from 0x536e09f to 0x7c8e73a 2024-09-21T15:07:17.209 INFO:teuthology.orchestra.run.smithi161.stdout:19 write 0x85f5014 thru 0x85f831f (0x330c bytes) 2024-09-21T15:07:17.220 INFO:teuthology.orchestra.run.smithi161.stdout:23 read 0x722113e thru 0x722aaf0 (0x99b3 bytes) 2024-09-21T15:07:17.221 INFO:teuthology.orchestra.run.smithi161.stdout:24 punch from 0x1fd7a51 to 0x1fe4c81, (0xd230 bytes) 2024-09-21T15:07:17.221 INFO:teuthology.orchestra.run.smithi161.stdout:25 writesame 0x5dd2546 thru 0x5de097c data_size 0x25(0xe437 bytes) 2024-09-21T15:07:17.229 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.229 INFO:teuthology.orchestra.run.smithi161.stdout:45 punch from 0x1f99c95 to 0x1f9f2c6, (0x5631 bytes) 2024-09-21T15:07:17.229 INFO:teuthology.orchestra.run.smithi161.stdout:46 clone 2 order 25 su 524288 sc 10 2024-09-21T15:07:17.234 INFO:teuthology.orchestra.run.smithi161.stdout:26 write 0x9db081d thru 0x9dbc0a5 (0xb889 bytes) 2024-09-21T15:07:17.242 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.243 INFO:teuthology.orchestra.run.smithi161.stdout:29 write 0x69c739f thru 0x69cbc19 (0x487b bytes) 2024-09-21T15:07:17.246 INFO:teuthology.orchestra.run.smithi161.stdout:48 writesame 0xb686ac5 thru 0xb68869b data_size 0x1(0x1bd7 bytes) 2024-09-21T15:07:17.246 INFO:teuthology.orchestra.run.smithi161.stdout:58 write 0xb2ffce9 thru 0xb305869 (0x5b81 bytes) 2024-09-21T15:07:17.247 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0x5679833 2024-09-21T15:07:17.249 INFO:teuthology.orchestra.run.smithi161.stdout:52 punch from 0x1190638 to 0x1192acd, (0x2495 bytes) 2024-09-21T15:07:17.249 INFO:teuthology.orchestra.run.smithi161.stdout:54 read 0x44443bc thru 0x445382a (0xf46f bytes) 2024-09-21T15:07:17.250 INFO:teuthology.orchestra.run.smithi161.stdout:55 read 0x2c5afd8 thru 0x2c6ae0d (0xfe36 bytes) 2024-09-21T15:07:17.250 INFO:teuthology.orchestra.run.smithi161.stdout:30 punch from 0x6d198fa to 0x6d1cd72, (0x3478 bytes) 2024-09-21T15:07:17.251 INFO:teuthology.orchestra.run.smithi161.stdout:56 read 0x24de465 thru 0x24e9784 (0xb320 bytes) 2024-09-21T15:07:17.252 INFO:teuthology.orchestra.run.smithi161.stdout:57 punch from 0x647c9b4 to 0x647d66e, (0xcba bytes) 2024-09-21T15:07:17.252 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xe4c653c 2024-09-21T15:07:17.254 INFO:teuthology.orchestra.run.smithi161.stdout:31 trunc from 0xe2b77ad to 0xcf61bc9 2024-09-21T15:07:17.255 INFO:teuthology.orchestra.run.smithi161.stdout:59 write 0x48f4c7e thru 0x48fd924 (0x8ca7 bytes) 2024-09-21T15:07:17.259 INFO:teuthology.orchestra.run.smithi161.stdout:59 trunc from 0xb68869c to 0xe4c653c 2024-09-21T15:07:17.259 INFO:teuthology.orchestra.run.smithi161.stdout:3 trunc from 0x0 to 0x5679833 2024-09-21T15:07:17.285 INFO:teuthology.orchestra.run.smithi161.stdout:32 writesame 0xb2b86bd thru 0xb2be968 data_size 0x1e(0x62ac bytes) 2024-09-21T15:07:17.289 INFO:teuthology.orchestra.run.smithi161.stdout:60 punch from 0x61178fb to 0x6118d5e, (0x1463 bytes) 2024-09-21T15:07:17.289 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.289 INFO:teuthology.orchestra.run.smithi161.stdout:62 read 0xbe12e52 thru 0xbe2139d (0xe54c bytes) 2024-09-21T15:07:17.290 INFO:teuthology.orchestra.run.smithi161.stdout:63 punch from 0x1d00916 to 0x1d019ca, (0x10b4 bytes) 2024-09-21T15:07:17.290 INFO:teuthology.orchestra.run.smithi161.stdout:66 punch from 0xd0b48e4 to 0xd0b7cfd, (0x3419 bytes) 2024-09-21T15:07:17.294 INFO:teuthology.orchestra.run.smithi161.stdout:60 writesame 0xb9b84dc thru 0xb9bbad4 data_size 0x1(0x35f9 bytes) 2024-09-21T15:07:17.295 INFO:teuthology.orchestra.run.smithi161.stdout:67 trunc from 0xe4c653c to 0xc04e9cf 2024-09-21T15:07:17.296 INFO:teuthology.orchestra.run.smithi161.stdout:34 punch from 0xa743a2a to 0xa74cb91, (0x9167 bytes) 2024-09-21T15:07:17.296 INFO:teuthology.orchestra.run.smithi161.stdout:35 writesame 0xa2de903 thru 0xa2e2755 data_size 0x1(0x3e53 bytes) 2024-09-21T15:07:17.297 INFO:teuthology.orchestra.run.smithi161.stdout:61 writesame 0x41325aa thru 0x41414fc data_size 0x1(0xef53 bytes) 2024-09-21T15:07:17.316 INFO:teuthology.orchestra.run.smithi161.stdout:5 write 0x63d1dc8 thru 0x63d9b07 (0x7d40 bytes) 2024-09-21T15:07:17.318 INFO:teuthology.orchestra.run.smithi161.stdout:36 read 0x54cbdd5 thru 0x54d8ab8 (0xcce4 bytes) 2024-09-21T15:07:17.318 INFO:teuthology.orchestra.run.smithi161.stdout:37 read 0xb805e82 thru 0xb81452c (0xe6ab bytes) 2024-09-21T15:07:17.318 INFO:teuthology.orchestra.run.smithi161.stdout:38 punch from 0x28eb300 to 0x28f88e3, (0xd5e3 bytes) 2024-09-21T15:07:17.319 INFO:teuthology.orchestra.run.smithi161.stdout:42 read 0x50650c8 thru 0x506d220 (0x8159 bytes) 2024-09-21T15:07:17.319 INFO:teuthology.orchestra.run.smithi161.stdout:43 writesame 0x69af9b thru 0x69b5a0 data_size 0x3(0x606 bytes) 2024-09-21T15:07:17.334 INFO:teuthology.orchestra.run.smithi161.stdout:44 write 0xa211d5e thru 0xa21fae6 (0xdd89 bytes) 2024-09-21T15:07:17.335 INFO:teuthology.orchestra.run.smithi161.stdout:7 read 0x61b079 thru 0x621ac6 (0x6a4e bytes) 2024-09-21T15:07:17.335 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xc11d88e 2024-09-21T15:07:17.350 INFO:teuthology.orchestra.run.smithi161.stdout:8 trunc from 0x63d9b08 to 0xc11d88e 2024-09-21T15:07:17.352 INFO:teuthology.orchestra.run.smithi161.stdout:62 read 0x346fdbe thru 0x3472166 (0x23a9 bytes) 2024-09-21T15:07:17.352 INFO:teuthology.orchestra.run.smithi161.stdout:63 read 0x97e165f thru 0x97e99df (0x8381 bytes) 2024-09-21T15:07:17.353 INFO:teuthology.orchestra.run.smithi161.stdout:64 write 0x9b3e951 thru 0x9b47676 (0x8d26 bytes) 2024-09-21T15:07:17.356 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.356 INFO:teuthology.orchestra.run.smithi161.stdout:46 write 0xb49fd3d thru 0xb4a1c48 (0x1f0c bytes) 2024-09-21T15:07:17.357 INFO:teuthology.orchestra.run.smithi161.stdout:69 write 0x9397809 thru 0x93a1ba7 (0xa39f bytes) 2024-09-21T15:07:17.368 INFO:teuthology.orchestra.run.smithi161.stdout:65 punch from 0x7faba7b to 0x7fb89b1, (0xcf36 bytes) 2024-09-21T15:07:17.368 INFO:teuthology.orchestra.run.smithi161.stdout:66 writesame 0x450d7fb thru 0x451926f data_size 0x7(0xba75 bytes) 2024-09-21T15:07:17.368 INFO:teuthology.orchestra.run.smithi161.stdout:48 write 0x7bcbe8 thru 0x7c1619 (0x4a32 bytes) 2024-09-21T15:07:17.377 INFO:teuthology.orchestra.run.smithi161.stdout:49 write 0x7389145 thru 0x738fb71 (0x6a2d bytes) 2024-09-21T15:07:17.382 INFO:teuthology.orchestra.run.smithi161.stdout:9 punch from 0x6b58e1a to 0x6b63dcd, (0xafb3 bytes) 2024-09-21T15:07:17.382 INFO:teuthology.orchestra.run.smithi161.stdout:10 read 0x6bee2b2 thru 0x6bf563b (0x738a bytes) 2024-09-21T15:07:17.382 INFO:teuthology.orchestra.run.smithi161.stdout:11 read 0xbf362a2 thru 0xbf3c22a (0x5f89 bytes) 2024-09-21T15:07:17.383 INFO:teuthology.orchestra.run.smithi161.stdout:71 write 0xa094929 thru 0xa09d431 (0x8b09 bytes) 2024-09-21T15:07:17.383 INFO:teuthology.orchestra.run.smithi161.stdout:12 write 0x2ed010c thru 0x2ede19a (0xe08f bytes) 2024-09-21T15:07:17.392 INFO:teuthology.orchestra.run.smithi161.stdout:72 punch from 0xae5dc70 to 0xae62133, (0x44c3 bytes) 2024-09-21T15:07:17.392 INFO:teuthology.orchestra.run.smithi161.stdout:73 punch from 0x97e1008 to 0x97e145c, (0x454 bytes) 2024-09-21T15:07:17.393 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.393 INFO:teuthology.orchestra.run.smithi161.stdout:13 write 0xb5d2d49 thru 0xb5d8e8a (0x6142 bytes) 2024-09-21T15:07:17.403 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.403 INFO:teuthology.orchestra.run.smithi161.stdout:15 read 0x81f22e4 thru 0x81ff11f (0xce3c bytes) 2024-09-21T15:07:17.403 INFO:teuthology.orchestra.run.smithi161.stdout:16 writesame 0x15e42f6 thru 0x15e63aa data_size 0x1(0x20b5 bytes) 2024-09-21T15:07:17.413 INFO:teuthology.orchestra.run.smithi161.stdout:68 writesame 0xdad7d47 thru 0xdae5a4a data_size 0xa4(0xdd04 bytes) 2024-09-21T15:07:17.414 INFO:teuthology.orchestra.run.smithi161.stdout:19 punch from 0x93fa6fa to 0x940721c, (0xcb22 bytes) 2024-09-21T15:07:17.414 INFO:teuthology.orchestra.run.smithi161.stdout:23 writesame 0x373baba thru 0x3746b52 data_size 0x1(0xb099 bytes) 2024-09-21T15:07:17.416 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xb076c5f 2024-09-21T15:07:17.420 INFO:teuthology.orchestra.run.smithi161.stdout:50 write 0xeb96129 thru 0xeba3e6f (0xdd47 bytes) 2024-09-21T15:07:17.422 INFO:teuthology.orchestra.run.smithi161.stdout:69 trunc from 0xdae5a4b to 0xb076c5f 2024-09-21T15:07:17.427 INFO:teuthology.orchestra.run.smithi161.stdout:75 write 0xe17753e thru 0xe1813c9 (0x9e8c bytes) 2024-09-21T15:07:17.443 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.448 INFO:teuthology.orchestra.run.smithi161.stdout:52 writesame 0xba1298d thru 0xba1444b data_size 0x1(0x1abf bytes) 2024-09-21T15:07:17.457 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.457 INFO:teuthology.orchestra.run.smithi161.stdout:77 read 0x994ac40 thru 0x994b224 (0x5e5 bytes) 2024-09-21T15:07:17.457 INFO:teuthology.orchestra.run.smithi161.stdout:78 read 0x2c3d922 thru 0x2c3e2f7 (0x9d6 bytes) 2024-09-21T15:07:17.465 INFO:teuthology.orchestra.run.smithi161.stdout:53 read 0x45689f9 thru 0x4576d0e (0xe316 bytes) 2024-09-21T15:07:17.466 INFO:teuthology.orchestra.run.smithi161.stdout:54 write 0xcfbf89e thru 0xcfc60c6 (0x6829 bytes) 2024-09-21T15:07:17.468 INFO:teuthology.orchestra.run.smithi161.stdout:79 trunc from 0xe1813ca to 0x9a6f84c 2024-09-21T15:07:17.483 INFO:teuthology.orchestra.run.smithi161.stdout:72 punch from 0x6a8647d to 0x6a870a9, (0xc2c bytes) 2024-09-21T15:07:17.483 INFO:teuthology.orchestra.run.smithi161.stdout:75 write 0x821efbf thru 0x822b1b3 (0xc1f5 bytes) 2024-09-21T15:07:17.485 INFO:teuthology.orchestra.run.smithi161.stdout:25 writesame 0xc290fc0 thru 0xc29db35 data_size 0x3(0xcb76 bytes) 2024-09-21T15:07:17.485 INFO:teuthology.orchestra.run.smithi161.stdout:55 writesame 0x99d2d96 thru 0x99d8f23 data_size 0x1(0x618e bytes) 2024-09-21T15:07:17.488 INFO:teuthology.orchestra.run.smithi161.stdout:27 write 0x8f22d58 thru 0x8f2f4f8 (0xc7a1 bytes) 2024-09-21T15:07:17.499 INFO:teuthology.orchestra.run.smithi161.stdout:76 write 0x144726e thru 0x1450792 (0x9525 bytes) 2024-09-21T15:07:17.517 INFO:teuthology.orchestra.run.smithi161.stdout:77 write 0x24f6b2b thru 0x24f8df3 (0x22c9 bytes) 2024-09-21T15:07:17.518 INFO:teuthology.orchestra.run.smithi161.stdout:56 trunc from 0xeba3e70 to 0xdb1cdd0 2024-09-21T15:07:17.522 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xcbc98cc 2024-09-21T15:07:17.527 INFO:teuthology.orchestra.run.smithi161.stdout:78 trunc from 0xb076c5f to 0xcbc98cc 2024-09-21T15:07:17.527 INFO:teuthology.orchestra.run.smithi161.stdout:28 trunc from 0xc29db36 to 0x8229226 2024-09-21T15:07:17.541 INFO:teuthology.orchestra.run.smithi161.stdout:80 trunc from 0x9a6f84c to 0x31c94fb 2024-09-21T15:07:17.556 INFO:teuthology.orchestra.run.smithi161.stdout:57 writesame 0x13d8e20 thru 0x13e2539 data_size 0x3f(0x971a bytes) 2024-09-21T15:07:17.574 INFO:teuthology.orchestra.run.smithi161.stdout:59 write 0x252c3c7 thru 0x2531975 (0x55af bytes) 2024-09-21T15:07:17.582 INFO:teuthology.orchestra.run.smithi161.stdout:30 write 0x162a6e3 thru 0x162b167 (0xa85 bytes) 2024-09-21T15:07:17.586 INFO:teuthology.orchestra.run.smithi161.stdout:60 punch from 0xb349393 to 0xb34c0fb, (0x2d68 bytes) 2024-09-21T15:07:17.586 INFO:teuthology.orchestra.run.smithi161.stdout:80 trunc from 0xcbc98cc to 0x104c298 2024-09-21T15:07:17.587 INFO:teuthology.orchestra.run.smithi161.stdout:61 clone 1 order 19 su 16384 sc 14 2024-09-21T15:07:17.589 INFO:teuthology.orchestra.run.smithi161.stdout:31 read 0x4d328d6 thru 0x4d3d22b (0xa956 bytes) 2024-09-21T15:07:17.597 INFO:teuthology.orchestra.run.smithi161.stdout:81 trunc from 0x31c94fb to 0x6c4460e 2024-09-21T15:07:17.622 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.622 INFO:teuthology.orchestra.run.smithi161.stdout:83 punch from 0x3501961 to 0x350ecb3, (0xd352 bytes) 2024-09-21T15:07:17.622 INFO:teuthology.orchestra.run.smithi161.stdout:84 read 0x183d08e thru 0x1841c8b (0x4bfe bytes) 2024-09-21T15:07:17.623 INFO:teuthology.orchestra.run.smithi161.stdout:86 read 0x1419446 thru 0x141f203 (0x5dbe bytes) 2024-09-21T15:07:17.624 INFO:teuthology.orchestra.run.smithi161.stdout:87 writesame 0x58c7b25 thru 0x58ca25b data_size 0x1(0x2737 bytes) 2024-09-21T15:07:17.627 INFO:teuthology.orchestra.run.smithi161.stdout:33 writesame 0xbd0f8c6 thru 0xbd12d22 data_size 0x7(0x345d bytes) 2024-09-21T15:07:17.629 INFO:teuthology.orchestra.run.smithi161.stdout:83 punch from 0x7500c9 to 0x757cf0, (0x7c27 bytes) 2024-09-21T15:07:17.633 INFO:teuthology.orchestra.run.smithi161.stdout:34 write 0xb459ef4 thru 0xb468d6c (0xee79 bytes) 2024-09-21T15:07:17.634 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.634 INFO:teuthology.orchestra.run.smithi161.stdout:91 read 0x33b8cee thru 0x33bad48 (0x205b bytes) 2024-09-21T15:07:17.635 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.636 INFO:teuthology.orchestra.run.smithi161.stdout:93 trunc from 0x6c4460e to 0x69032ab 2024-09-21T15:07:17.643 INFO:teuthology.orchestra.run.smithi161.stdout:36 write 0x91ff319 thru 0x9201690 (0x2378 bytes) 2024-09-21T15:07:17.645 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone1 from 0x7c8e73a (overlap 0x173ff0c) to 0x14ecbf1 2024-09-21T15:07:17.650 INFO:teuthology.orchestra.run.smithi161.stdout:37 write 0xde19ae thru 0xde1dd1 (0x424 bytes) 2024-09-21T15:07:17.658 INFO:teuthology.orchestra.run.smithi161.stdout:38 write 0x9cba0aa thru 0x9cbfb7a (0x5ad1 bytes) 2024-09-21T15:07:17.659 INFO:teuthology.orchestra.run.smithi161.stdout:94 write 0xeae5e6 thru 0xebb02e (0xca49 bytes) 2024-09-21T15:07:17.669 INFO:teuthology.orchestra.run.smithi161.stdout:95 punch from 0x3cb46b3 to 0x3cb7230, (0x2b7d bytes) 2024-09-21T15:07:17.669 INFO:teuthology.orchestra.run.smithi161.stdout:96 read 0x3bef94c thru 0x3bf1245 (0x18fa bytes) 2024-09-21T15:07:17.670 INFO:teuthology.orchestra.run.smithi161.stdout:97 punch from 0x17de3d3 to 0x17e3342, (0x4f6f bytes) 2024-09-21T15:07:17.670 INFO:teuthology.orchestra.run.smithi161.stdout:99 punch from 0xc1fd8 to 0xcd8f1, (0xb919 bytes) 2024-09-21T15:07:17.670 INFO:teuthology.orchestra.run.smithi161.stdout:100 read 0x3e45775 thru 0x3e4ddbc (0x8648 bytes) 2024-09-21T15:07:17.671 INFO:teuthology.orchestra.run.smithi161.stdout:101 write 0x5184690 thru 0x51909f5 (0xc366 bytes) 2024-09-21T15:07:17.673 INFO:teuthology.orchestra.run.smithi161.stdout:39 write 0x76e3fc1 thru 0x76f062a (0xc66a bytes) 2024-09-21T15:07:17.678 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.682 INFO:teuthology.orchestra.run.smithi161.stdout:84 write 0xc65dc6a thru 0xc65ef77 (0x130e bytes) 2024-09-21T15:07:17.700 INFO:teuthology.orchestra.run.smithi161.stdout:85 trunc from 0xc65ef78 to 0x7fadc1d 2024-09-21T15:07:17.715 INFO:teuthology.orchestra.run.smithi161.stdout:103 write 0xb9b80cc thru 0xb9c7208 (0xf13d bytes) 2024-09-21T15:07:17.724 INFO:teuthology.orchestra.run.smithi161.stdout:42 writesame 0xdd3a226 thru 0xdd3f566 data_size 0x1(0x5341 bytes) 2024-09-21T15:07:17.729 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.729 INFO:teuthology.orchestra.run.smithi161.stdout:44 write 0x23abc21 thru 0x23b2360 (0x6740 bytes) 2024-09-21T15:07:17.729 INFO:teuthology.orchestra.run.smithi161.stdout:104 punch from 0x7c7da76 to 0x7c8c164, (0xe6ee bytes) 2024-09-21T15:07:17.730 INFO:teuthology.orchestra.run.smithi161.stdout:105 read 0x71d9fec thru 0x71e27f9 (0x880e bytes) 2024-09-21T15:07:17.730 INFO:teuthology.orchestra.run.smithi161.stdout:108 read 0x889bf01 thru 0x889e606 (0x2706 bytes) 2024-09-21T15:07:17.730 INFO:teuthology.orchestra.run.smithi161.stdout:109 punch from 0x72bfce9 to 0x72c9413, (0x972a bytes) 2024-09-21T15:07:17.737 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xe39f529 2024-09-21T15:07:17.739 INFO:teuthology.orchestra.run.smithi161.stdout:46 trunc from 0xdd3f567 to 0xe39f529 2024-09-21T15:07:17.739 INFO:teuthology.orchestra.run.smithi161.stdout:86 write 0x798cd0 thru 0x7a834c (0xf67d bytes) 2024-09-21T15:07:17.746 INFO:teuthology.orchestra.run.smithi161.stdout:110 trunc from 0xb9c7209 to 0x295487d 2024-09-21T15:07:17.758 INFO:teuthology.orchestra.run.smithi161.stdout:87 trunc from 0x7fadc1d to 0xc4a5665 2024-09-21T15:07:17.762 INFO:teuthology.orchestra.run.smithi161.stdout:47 write 0x2f3c4bb thru 0x2f45440 (0x8f86 bytes) 2024-09-21T15:07:17.769 INFO:teuthology.orchestra.run.smithi161.stdout:48 writesame 0x992b2c1 thru 0x9939bc8 data_size 0x4(0xe908 bytes) 2024-09-21T15:07:17.781 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #0, image image_cluster1.client.mirror.3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent1 2024-09-21T15:07:17.788 INFO:teuthology.orchestra.run.smithi161.stdout:112 read 0x142fb83 thru 0x143955b (0x99d9 bytes) 2024-09-21T15:07:17.789 INFO:teuthology.orchestra.run.smithi161.stdout:113 punch from 0x15b796 to 0x162cf9, (0x7563 bytes) 2024-09-21T15:07:17.806 INFO:teuthology.orchestra.run.smithi161.stdout:89 trunc from 0xc4a5665 to 0x344c856 2024-09-21T15:07:17.806 INFO:teuthology.orchestra.run.smithi161.stdout:166 writesame 0x7c59931 thru 0x7c5b7fb data_size 0x1(0x1ecb bytes) 2024-09-21T15:07:17.811 INFO:teuthology.orchestra.run.smithi161.stdout:50 trunc from 0xe39f529 to 0x1212032 2024-09-21T15:07:17.827 INFO:teuthology.orchestra.run.smithi161.stdout:114 write 0x5b1078a thru 0x5b1151e (0xd95 bytes) 2024-09-21T15:07:17.864 INFO:teuthology.orchestra.run.smithi161.stdout:167 read 0x363ae9a thru 0x36458d9 (0xaa40 bytes) 2024-09-21T15:07:17.865 INFO:teuthology.orchestra.run.smithi161.stdout:168 read 0x20de6eb thru 0x20ecb1a (0xe430 bytes) 2024-09-21T15:07:17.865 INFO:teuthology.orchestra.run.smithi161.stdout:169 punch from 0x92b9548 to 0x92c59ae, (0xc466 bytes) 2024-09-21T15:07:17.865 INFO:teuthology.orchestra.run.smithi161.stdout:170 write 0x7c2d298 thru 0x7c36361 (0x90ca bytes) 2024-09-21T15:07:17.873 INFO:teuthology.orchestra.run.smithi161.stdout:90 writesame 0x6f79ab6 thru 0x6f863c1 data_size 0x6(0xc90c bytes) 2024-09-21T15:07:17.876 INFO:teuthology.orchestra.run.smithi161.stdout:91 punch from 0x1dc3869 to 0x1dcf81e, (0xbfb5 bytes) 2024-09-21T15:07:17.876 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.877 INFO:teuthology.orchestra.run.smithi161.stdout:94 read 0x53e5d5 thru 0x54540b (0x6e37 bytes) 2024-09-21T15:07:17.877 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.888 INFO:teuthology.orchestra.run.smithi161.stdout:171 read 0x5cd6281 thru 0x5ce53fc (0xf17c bytes) 2024-09-21T15:07:17.891 INFO:teuthology.orchestra.run.smithi161.stdout:115 write 0xce90b50 thru 0xce9f1ef (0xe6a0 bytes) 2024-09-21T15:07:17.901 INFO:teuthology.orchestra.run.smithi161.stdout:172 trunc from 0xbfe273f to 0x6542da7 2024-09-21T15:07:17.903 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.903 INFO:teuthology.orchestra.run.smithi161.stdout:119 punch from 0x93617a4 to 0x9363fd4, (0x2830 bytes) 2024-09-21T15:07:17.904 INFO:teuthology.orchestra.run.smithi161.stdout:54 write 0x4015f99 thru 0x4016748 (0x7b0 bytes) 2024-09-21T15:07:17.908 INFO:teuthology.orchestra.run.smithi161.stdout:120 trunc from 0xce9f1f0 to 0xa116ef7 2024-09-21T15:07:17.915 INFO:teuthology.orchestra.run.smithi161.stdout:96 write 0xe3aae43 thru 0xe3ad441 (0x25ff bytes) 2024-09-21T15:07:17.915 INFO:teuthology.orchestra.run.smithi161.stdout:56 trunc from 0x4016749 to 0x6174180 2024-09-21T15:07:17.926 INFO:teuthology.orchestra.run.smithi161.stdout:97 punch from 0x9f0f582 to 0x9f0f591, (0xf bytes) 2024-09-21T15:07:17.926 INFO:teuthology.orchestra.run.smithi161.stdout:98 write 0x3d28dc3 thru 0x3d31b81 (0x8dbf bytes) 2024-09-21T15:07:17.942 INFO:teuthology.orchestra.run.smithi161.stdout:100 writesame 0xd557890 thru 0xd55dd7e data_size 0x57(0x64ef bytes) 2024-09-21T15:07:17.943 INFO:teuthology.orchestra.run.smithi161.stdout:57 write 0x4fa8830 thru 0x4fae3f1 (0x5bc2 bytes) 2024-09-21T15:07:17.955 INFO:teuthology.orchestra.run.smithi161.stdout:122 punch from 0x454dabf to 0x455cd90, (0xf2d1 bytes) 2024-09-21T15:07:17.955 INFO:teuthology.orchestra.run.smithi161.stdout:123 punch from 0x356445a to 0x3573e6f, (0xfa15 bytes) 2024-09-21T15:07:17.955 INFO:teuthology.orchestra.run.smithi161.stdout:124 trunc from 0xa116ef7 to 0xa760ddc 2024-09-21T15:07:17.959 INFO:teuthology.orchestra.run.smithi161.stdout:58 write 0x2a3168f thru 0x2a31868 (0x1da bytes) 2024-09-21T15:07:17.960 INFO:teuthology.orchestra.run.smithi161.stdout:101 writesame 0x5dbd11f thru 0x5dc8c52 data_size 0x2(0xbb34 bytes) 2024-09-21T15:07:17.963 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.964 INFO:teuthology.orchestra.run.smithi161.stdout:176 read 0x1ee37e8 thru 0x1ef23ad (0xebc6 bytes) 2024-09-21T15:07:17.964 INFO:teuthology.orchestra.run.smithi161.stdout:178 write 0x4d10e94 thru 0x4d1144b (0x5b8 bytes) 2024-09-21T15:07:17.979 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.979 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.979 INFO:teuthology.orchestra.run.smithi161.stdout:181 write 0x62d6335 thru 0x62d6e34 (0xb00 bytes) 2024-09-21T15:07:17.980 INFO:teuthology.orchestra.run.smithi161.stdout:59 punch from 0x1daa8c9 to 0x1daca15, (0x214c bytes) 2024-09-21T15:07:17.980 INFO:teuthology.orchestra.run.smithi161.stdout:60 write 0x3834f17 thru 0x383795e (0x2a48 bytes) 2024-09-21T15:07:17.985 INFO:teuthology.orchestra.run.smithi161.stdout:102 read 0xb0ada9b thru 0xb0b7d34 (0xa29a bytes) 2024-09-21T15:07:17.985 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:17.988 INFO:teuthology.orchestra.run.smithi161.stdout:125 write 0xa33c514 thru 0xa345cba (0x97a7 bytes) 2024-09-21T15:07:18.006 INFO:teuthology.orchestra.run.smithi161.stdout:103 trunc from 0xe3ad442 to 0x399fe9d 2024-09-21T15:07:18.006 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.007 INFO:teuthology.orchestra.run.smithi161.stdout:128 read 0x4cd2914 thru 0x4cd50a5 (0x2792 bytes) 2024-09-21T15:07:18.008 INFO:teuthology.orchestra.run.smithi161.stdout:131 write 0x2d1ad77 thru 0x2d1dffc (0x3286 bytes) 2024-09-21T15:07:18.014 INFO:teuthology.orchestra.run.smithi161.stdout:132 punch from 0x2608b35 to 0x260f181, (0x664c bytes) 2024-09-21T15:07:18.014 INFO:teuthology.orchestra.run.smithi161.stdout:134 write 0xa331050 thru 0xa334de2 (0x3d93 bytes) 2024-09-21T15:07:18.025 INFO:teuthology.orchestra.run.smithi161.stdout:62 write 0x6de04a8 thru 0x6df0245 (0xfd9e bytes) 2024-09-21T15:07:18.026 INFO:teuthology.orchestra.run.smithi161.stdout:137 writesame 0x2c8d968 thru 0x2c945f6 data_size 0x1(0x6c8f bytes) 2024-09-21T15:07:18.027 INFO:teuthology.orchestra.run.smithi161.stdout:183 write 0x95430b7 thru 0x9551e95 (0xeddf bytes) 2024-09-21T15:07:18.038 INFO:teuthology.orchestra.run.smithi161.stdout:184 writesame 0x1945765 thru 0x194b95f data_size 0x9(0x61fb bytes) 2024-09-21T15:07:18.043 INFO:teuthology.orchestra.run.smithi161.stdout:138 write 0x6e8b8e6 thru 0x6e95326 (0x9a41 bytes) 2024-09-21T15:07:18.043 INFO:teuthology.orchestra.run.smithi161.stdout:188 writesame 0x40ecde8 thru 0x40f5399 data_size 0x2(0x85b2 bytes) 2024-09-21T15:07:18.051 INFO:teuthology.orchestra.run.smithi161.stdout:104 clone 1 order 23 su 2097152 sc 15 2024-09-21T15:07:18.058 INFO:teuthology.orchestra.run.smithi161.stdout:189 read 0x17e7dfe thru 0x17f74df (0xf6e2 bytes) 2024-09-21T15:07:18.059 INFO:teuthology.orchestra.run.smithi161.stdout:190 write 0x2540c87 thru 0x2549984 (0x8cfe bytes) 2024-09-21T15:07:18.061 INFO:teuthology.orchestra.run.smithi161.stdout:140 write 0x367f199 thru 0x36849ac (0x5814 bytes) 2024-09-21T15:07:18.066 INFO:teuthology.orchestra.run.smithi161.stdout:191 read 0x4917e14 thru 0x49252e5 (0xd4d2 bytes) 2024-09-21T15:07:18.066 INFO:teuthology.orchestra.run.smithi161.stdout:192 read 0x7a419af thru 0x7a439d1 (0x2023 bytes) 2024-09-21T15:07:18.067 INFO:teuthology.orchestra.run.smithi161.stdout:193 read 0x4d6d366 thru 0x4d7c6ce (0xf369 bytes) 2024-09-21T15:07:18.068 INFO:teuthology.orchestra.run.smithi161.stdout:194 trunc from 0x9551e96 to 0x99135c4 2024-09-21T15:07:18.071 INFO:teuthology.orchestra.run.smithi161.stdout:142 write 0x2016067 thru 0x201d141 (0x70db bytes) 2024-09-21T15:07:18.085 INFO:teuthology.orchestra.run.smithi161.stdout:63 writesame 0xaeb268d thru 0xaec10fc data_size 0x2c(0xea70 bytes) 2024-09-21T15:07:18.099 INFO:teuthology.orchestra.run.smithi161.stdout:195 read 0x91b4d14 thru 0x91c2c95 (0xdf82 bytes) 2024-09-21T15:07:18.100 INFO:teuthology.orchestra.run.smithi161.stdout:196 write 0x4d81cda thru 0x4d8a5c0 (0x88e7 bytes) 2024-09-21T15:07:18.107 INFO:teuthology.orchestra.run.smithi161.stdout:64 trunc from 0xaec10fd to 0x22f5fd7 2024-09-21T15:07:18.114 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.117 INFO:teuthology.orchestra.run.smithi161.stdout:199 trunc from 0x99135c4 to 0xb665a90 2024-09-21T15:07:18.121 INFO:teuthology.orchestra.run.smithi161.stdout:47 write 0x7f658fe thru 0x7f6e221 (0x8924 bytes) 2024-09-21T15:07:18.123 INFO:teuthology.orchestra.run.smithi161.stdout:143 write 0xec60cc9 thru 0xec63052 (0x238a bytes) 2024-09-21T15:07:18.143 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.143 INFO:teuthology.orchestra.run.smithi161.stdout:145 read 0xd52e32e thru 0xd52f260 (0xf33 bytes) 2024-09-21T15:07:18.143 INFO:teuthology.orchestra.run.smithi161.stdout:146 write 0xa1ca219 thru 0xa1d0eae (0x6c96 bytes) 2024-09-21T15:07:18.158 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.158 INFO:teuthology.orchestra.run.smithi161.stdout:149 read 0xa1b0472 thru 0xa1b7c89 (0x7818 bytes) 2024-09-21T15:07:18.159 INFO:teuthology.orchestra.run.smithi161.stdout:150 read 0xbc3e795 thru 0xbc44b70 (0x63dc bytes) 2024-09-21T15:07:18.159 INFO:teuthology.orchestra.run.smithi161.stdout:151 punch from 0x55e388 to 0x569766, (0xb3de bytes) 2024-09-21T15:07:18.159 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.159 INFO:teuthology.orchestra.run.smithi161.stdout:153 writesame 0x69f4e32 thru 0x69fdbc5 data_size 0xd(0x8d94 bytes) 2024-09-21T15:07:18.166 INFO:teuthology.orchestra.run.smithi161.stdout:48 trunc from 0x7f6e222 to 0x6a640e 2024-09-21T15:07:18.171 INFO:teuthology.orchestra.run.smithi161.stdout:201 trunc from 0xb665a90 to 0x6ef7d97 2024-09-21T15:07:18.171 INFO:teuthology.orchestra.run.smithi161.stdout:154 writesame 0x51c9a8d thru 0x51cdca4 data_size 0x5e(0x4218 bytes) 2024-09-21T15:07:18.178 INFO:teuthology.orchestra.run.smithi161.stdout:155 read 0xe6cdea3 thru 0xe6ce0f5 (0x253 bytes) 2024-09-21T15:07:18.179 INFO:teuthology.orchestra.run.smithi161.stdout:156 punch from 0xbda6e68 to 0xbdac2d3, (0x546b bytes) 2024-09-21T15:07:18.179 INFO:teuthology.orchestra.run.smithi161.stdout:157 read 0xc56eb7b thru 0xc5732cc (0x4752 bytes) 2024-09-21T15:07:18.195 INFO:teuthology.orchestra.run.smithi161.stdout:158 trunc from 0xec63053 to 0x5874bf6 2024-09-21T15:07:18.211 INFO:teuthology.orchestra.run.smithi161.stdout:202 writesame 0x4f47790 thru 0x4f4d840 data_size 0x25(0x60b1 bytes) 2024-09-21T15:07:18.214 INFO:teuthology.orchestra.run.smithi161.stdout:66 writesame 0xd53e992 thru 0xd547fdf data_size 0x79(0x964e bytes) 2024-09-21T15:07:18.217 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.217 INFO:teuthology.orchestra.run.smithi161.stdout:68 read 0x66d26bd thru 0x66e17ba (0xf0fe bytes) 2024-09-21T15:07:18.217 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.217 INFO:teuthology.orchestra.run.smithi161.stdout:70 writesame 0x870d758 thru 0x871a2d9 data_size 0x39(0xcb82 bytes) 2024-09-21T15:07:18.219 INFO:teuthology.orchestra.run.smithi161.stdout:203 read 0x643ba15 thru 0x643f59c (0x3b88 bytes) 2024-09-21T15:07:18.220 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.220 INFO:teuthology.orchestra.run.smithi161.stdout:206 read 0x8c9747 thru 0x8d12d4 (0x7b8e bytes) 2024-09-21T15:07:18.229 INFO:teuthology.orchestra.run.smithi161.stdout:71 read 0x83df9d3 thru 0x83e3c8d (0x42bb bytes) 2024-09-21T15:07:18.229 INFO:teuthology.orchestra.run.smithi161.stdout:72 punch from 0x7538eb5 to 0x754594d, (0xca98 bytes) 2024-09-21T15:07:18.230 INFO:teuthology.orchestra.run.smithi161.stdout:73 write 0x4f95c1e thru 0x4f9796d (0x1d50 bytes) 2024-09-21T15:07:18.240 INFO:teuthology.orchestra.run.smithi161.stdout:159 write 0x4e1b7de thru 0x4e1f459 (0x3c7c bytes) 2024-09-21T15:07:18.241 INFO:teuthology.orchestra.run.smithi161.stdout:50 write 0x1491054 thru 0x14996be (0x866b bytes) 2024-09-21T15:07:18.243 INFO:teuthology.orchestra.run.smithi161.stdout:74 read 0xc488ff thru 0xc53e8b (0xb58d bytes) 2024-09-21T15:07:18.244 INFO:teuthology.orchestra.run.smithi161.stdout:76 writesame 0x9aa1a0a thru 0x9aaedbb data_size 0x7(0xd3b2 bytes) 2024-09-21T15:07:18.250 INFO:teuthology.orchestra.run.smithi161.stdout:160 read 0x17b5613 thru 0x17bd5c5 (0x7fb3 bytes) 2024-09-21T15:07:18.259 INFO:teuthology.orchestra.run.smithi161.stdout:78 write 0xd1b14af thru 0xd1b7179 (0x5ccb bytes) 2024-09-21T15:07:18.264 INFO:teuthology.orchestra.run.smithi161.stdout:207 writesame 0xa322d0c thru 0xa32ffb1 data_size 0x3b(0xd2a6 bytes) 2024-09-21T15:07:18.273 INFO:teuthology.orchestra.run.smithi161.stdout:208 write 0x75af81b thru 0x75bad24 (0xb50a bytes) 2024-09-21T15:07:18.278 INFO:teuthology.orchestra.run.smithi161.stdout:79 punch from 0x86d7926 to 0x86d9da0, (0x247a bytes) 2024-09-21T15:07:18.278 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.278 INFO:teuthology.orchestra.run.smithi161.stdout:81 read 0xce431dd thru 0xce4cb60 (0x9984 bytes) 2024-09-21T15:07:18.278 INFO:teuthology.orchestra.run.smithi161.stdout:82 write 0x9cbae0f thru 0x9ccaaaa (0xfc9c bytes) 2024-09-21T15:07:18.287 INFO:teuthology.orchestra.run.smithi161.stdout:209 trunc from 0xa32ffb2 to 0x9df59bd 2024-09-21T15:07:18.293 INFO:teuthology.orchestra.run.smithi161.stdout:83 read 0x8029fc1 thru 0x80396f7 (0xf737 bytes) 2024-09-21T15:07:18.293 INFO:teuthology.orchestra.run.smithi161.stdout:161 write 0x93b3405 thru 0x93b35bd (0x1b9 bytes) 2024-09-21T15:07:18.293 INFO:teuthology.orchestra.run.smithi161.stdout:84 write 0x3c83e83 thru 0x3c9194f (0xdacd bytes) 2024-09-21T15:07:18.308 INFO:teuthology.orchestra.run.smithi161.stdout:162 write 0x403d731 thru 0x4041176 (0x3a46 bytes) 2024-09-21T15:07:18.309 INFO:teuthology.orchestra.run.smithi161.stdout:51 write 0xd6f4542 thru 0xd6fda7d (0x953c bytes) 2024-09-21T15:07:18.311 INFO:teuthology.orchestra.run.smithi161.stdout:85 write 0x5815f68 thru 0x5818b1f (0x2bb8 bytes) 2024-09-21T15:07:18.315 INFO:teuthology.orchestra.run.smithi161.stdout:163 punch from 0x5e57fe8 to 0x5e5abc9, (0x2be1 bytes) 2024-09-21T15:07:18.316 INFO:teuthology.orchestra.run.smithi161.stdout:52 writesame 0x643ade9 thru 0x64440e9 data_size 0x1(0x9301 bytes) 2024-09-21T15:07:18.319 INFO:teuthology.orchestra.run.smithi161.stdout:86 read 0xc11f719 thru 0xc1220ba (0x29a2 bytes) 2024-09-21T15:07:18.319 INFO:teuthology.orchestra.run.smithi161.stdout:87 write 0x34a9da3 thru 0x34aacb6 (0xf14 bytes) 2024-09-21T15:07:18.326 INFO:teuthology.orchestra.run.smithi161.stdout:210 write 0x685ceb6 thru 0x686c794 (0xf8df bytes) 2024-09-21T15:07:18.332 INFO:teuthology.orchestra.run.smithi161.stdout:165 trunc from 0x93b35be to 0x1c2dde7 2024-09-21T15:07:18.341 INFO:teuthology.orchestra.run.smithi161.stdout:53 write 0x1a34caf thru 0x1a43b8c (0xeede bytes) 2024-09-21T15:07:18.345 INFO:teuthology.orchestra.run.smithi161.stdout:211 trunc from 0x9df59bd to 0x617fd42 2024-09-21T15:07:18.349 INFO:teuthology.orchestra.run.smithi161.stdout:54 clone 3 order 23 su 65536 sc 15 2024-09-21T15:07:18.350 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.350 INFO:teuthology.orchestra.run.smithi161.stdout:89 punch from 0xb4f5894 to 0xb4fb2a2, (0x5a0e bytes) 2024-09-21T15:07:18.350 INFO:teuthology.orchestra.run.smithi161.stdout:91 read 0x1a8f308 thru 0x1a97446 (0x813f bytes) 2024-09-21T15:07:18.351 INFO:teuthology.orchestra.run.smithi161.stdout:93 read 0x8d3001b thru 0x8d355f7 (0x55dd bytes) 2024-09-21T15:07:18.351 INFO:teuthology.orchestra.run.smithi161.stdout:94 punch from 0x903660c to 0x903757a, (0xf6e bytes) 2024-09-21T15:07:18.351 INFO:teuthology.orchestra.run.smithi161.stdout:95 punch from 0x5cbd7a to 0x5cf998, (0x3c1e bytes) 2024-09-21T15:07:18.351 INFO:teuthology.orchestra.run.smithi161.stdout:97 write 0xc2907ee thru 0xc2939da (0x31ed bytes) 2024-09-21T15:07:18.369 INFO:teuthology.orchestra.run.smithi161.stdout:98 write 0x639e71f thru 0x63a898f (0xa271 bytes) 2024-09-21T15:07:18.382 INFO:teuthology.orchestra.run.smithi161.stdout:99 write 0x7d9f884 thru 0x7da9ef9 (0xa676 bytes) 2024-09-21T15:07:18.387 INFO:teuthology.orchestra.run.smithi161.stdout:212 punch from 0x2731ff7 to 0x2735885, (0x388e bytes) 2024-09-21T15:07:18.387 INFO:teuthology.orchestra.run.smithi161.stdout:213 read 0x609b2c1 thru 0x609f771 (0x44b1 bytes) 2024-09-21T15:07:18.387 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.388 INFO:teuthology.orchestra.run.smithi161.stdout:214 read 0x26cc1df thru 0x26cc70f (0x531 bytes) 2024-09-21T15:07:18.389 INFO:teuthology.orchestra.run.smithi161.stdout:215 read 0x123c319 thru 0x123fc9f (0x3987 bytes) 2024-09-21T15:07:18.409 INFO:teuthology.orchestra.run.smithi161.stdout:100 trunc from 0xd547fe0 to 0x6f7abcf 2024-09-21T15:07:18.412 INFO:teuthology.orchestra.run.smithi161.stdout:168 write 0x344c457 thru 0x3454b04 (0x86ae bytes) 2024-09-21T15:07:18.415 INFO:teuthology.orchestra.run.smithi161.stdout:217 write 0x650442f thru 0x65083c7 (0x3f99 bytes) 2024-09-21T15:07:18.423 INFO:teuthology.orchestra.run.smithi161.stdout:169 punch from 0x299721e to 0x29a225a, (0xb03c bytes) 2024-09-21T15:07:18.423 INFO:teuthology.orchestra.run.smithi161.stdout:170 write 0x2f9421b thru 0x2f98343 (0x4129 bytes) 2024-09-21T15:07:18.442 INFO:teuthology.orchestra.run.smithi161.stdout:102 punch from 0x4b3d9f9 to 0x4b4cb8d, (0xf194 bytes) 2024-09-21T15:07:18.442 INFO:teuthology.orchestra.run.smithi161.stdout:103 read 0x4001404 thru 0x400fb45 (0xe742 bytes) 2024-09-21T15:07:18.442 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.459 INFO:teuthology.orchestra.run.smithi161.stdout:219 write 0xb5a0717 thru 0xb5a9078 (0x8962 bytes) 2024-09-21T15:07:18.469 INFO:teuthology.orchestra.run.smithi161.stdout:171 writesame 0xb54adfa thru 0xb5509a1 data_size 0xe(0x5ba8 bytes) 2024-09-21T15:07:18.476 INFO:teuthology.orchestra.run.smithi161.stdout:172 read 0xa273a19 thru 0xa28279a (0xed82 bytes) 2024-09-21T15:07:18.476 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.476 INFO:teuthology.orchestra.run.smithi161.stdout:174 read 0x83cbd33 thru 0x83d5740 (0x9a0e bytes) 2024-09-21T15:07:18.476 INFO:teuthology.orchestra.run.smithi161.stdout:177 read 0x6ba3043 thru 0x6babca8 (0x8c66 bytes) 2024-09-21T15:07:18.476 INFO:teuthology.orchestra.run.smithi161.stdout:178 read 0xae52aa3 thru 0xae57dab (0x5309 bytes) 2024-09-21T15:07:18.476 INFO:teuthology.orchestra.run.smithi161.stdout:179 read 0x1858b7c thru 0x18674ce (0xe953 bytes) 2024-09-21T15:07:18.477 INFO:teuthology.orchestra.run.smithi161.stdout:180 writesame 0x4c8af6b thru 0x4c8b1d4 data_size 0x3(0x26a bytes) 2024-09-21T15:07:18.480 INFO:teuthology.orchestra.run.smithi161.stdout:107 write 0xa18d3e7 thru 0xa196e2f (0x9a49 bytes) 2024-09-21T15:07:18.483 INFO:teuthology.orchestra.run.smithi161.stdout:181 punch from 0x342b809 to 0x342e171, (0x2968 bytes) 2024-09-21T15:07:18.483 INFO:teuthology.orchestra.run.smithi161.stdout:182 clone 2 order 18 su 8192 sc 6 2024-09-21T15:07:18.499 INFO:teuthology.orchestra.run.smithi161.stdout:110 punch from 0x4307e54 to 0x43162e0, (0xe48c bytes) 2024-09-21T15:07:18.503 INFO:teuthology.orchestra.run.smithi161.stdout:220 writesame 0xc801da6 thru 0xc80bd35 data_size 0x94(0x9f90 bytes) 2024-09-21T15:07:18.516 INFO:teuthology.orchestra.run.smithi161.stdout:221 punch from 0x792b99b to 0x792e35a, (0x29bf bytes) 2024-09-21T15:07:18.517 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xe2a547a 2024-09-21T15:07:18.521 INFO:teuthology.orchestra.run.smithi161.stdout:223 trunc from 0xc80bd36 to 0xe2a547a 2024-09-21T15:07:18.544 INFO:teuthology.orchestra.run.smithi161.stdout:111 write 0xbc98d19 thru 0xbca2db5 (0xa09d bytes) 2024-09-21T15:07:18.558 INFO:teuthology.orchestra.run.smithi161.stdout:112 write 0x606c5c9 thru 0x6073211 (0x6c49 bytes) 2024-09-21T15:07:18.571 INFO:teuthology.orchestra.run.smithi161.stdout:113 clone 1 order 18 su 4096 sc 14 2024-09-21T15:07:18.571 INFO:teuthology.orchestra.run.smithi161.stdout:224 trunc from 0xe2a547a to 0x4cff02f 2024-09-21T15:07:18.625 INFO:teuthology.orchestra.run.smithi161.stdout:225 writesame 0x60d7c3b thru 0x60e6212 data_size 0x14(0xe5d8 bytes) 2024-09-21T15:07:18.641 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone2 from 0xd6fda7e (overlap 0x6a640e) to 0x0 2024-09-21T15:07:18.681 INFO:teuthology.orchestra.run.smithi161.stdout:226 write 0xc9670e9 thru 0xc96b860 (0x4778 bytes) 2024-09-21T15:07:18.690 INFO:teuthology.orchestra.run.smithi161.stdout:227 read 0x2e7b5a7 thru 0x2e7bc18 (0x672 bytes) 2024-09-21T15:07:18.691 INFO:teuthology.orchestra.run.smithi161.stdout:228 read 0x4c888dd thru 0x4c889a0 (0xc4 bytes) 2024-09-21T15:07:18.692 INFO:teuthology.orchestra.run.smithi161.stdout:230 read 0xbf753c0 thru 0xbf7547f (0xc0 bytes) 2024-09-21T15:07:18.692 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.693 INFO:teuthology.orchestra.run.smithi161.stdout:233 write 0x17c47bb thru 0x17d18a6 (0xd0ec bytes) 2024-09-21T15:07:18.701 INFO:teuthology.orchestra.run.smithi161.stdout:235 writesame 0x4b150d5 thru 0x4b15b2f data_size 0x1(0xa5b bytes) 2024-09-21T15:07:18.710 INFO:teuthology.orchestra.run.smithi161.stdout:239 read 0x55b7ebc thru 0x55bae33 (0x2f78 bytes) 2024-09-21T15:07:18.711 INFO:teuthology.orchestra.run.smithi161.stdout:241 write 0xc3a6e4 thru 0xc3fa90 (0x53ad bytes) 2024-09-21T15:07:18.716 INFO:teuthology.orchestra.run.smithi161.stdout:242 punch from 0x3273d1d to 0x327dc33, (0x9f16 bytes) 2024-09-21T15:07:18.726 INFO:teuthology.orchestra.run.smithi161.stdout:105 read 0x3952c5a thru 0x395ea4d (0xbdf4 bytes) 2024-09-21T15:07:18.729 INFO:teuthology.orchestra.run.smithi161.stdout:244 trunc from 0xc96b861 to 0x4f7d092 2024-09-21T15:07:18.748 INFO:teuthology.orchestra.run.smithi161.stdout:106 read 0xb7bf05 thru 0xb7c2eb (0x3e7 bytes) 2024-09-21T15:07:18.767 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.767 INFO:teuthology.orchestra.run.smithi161.stdout:247 read 0x1fa8526 thru 0x1faadd4 (0x28af bytes) 2024-09-21T15:07:18.767 INFO:teuthology.orchestra.run.smithi161.stdout:248 write 0x22f79e3 thru 0x2303259 (0xb877 bytes) 2024-09-21T15:07:18.771 INFO:teuthology.orchestra.run.smithi161.stdout:108 writesame 0x3a84f82 thru 0x3a864c6 data_size 0xf(0x1545 bytes) 2024-09-21T15:07:18.781 INFO:teuthology.orchestra.run.smithi161.stdout:109 read 0x337ecd6 thru 0x3382ad3 (0x3dfe bytes) 2024-09-21T15:07:18.781 INFO:teuthology.orchestra.run.smithi161.stdout:110 punch from 0x1082ca1 to 0x1089cb0, (0x700f bytes) 2024-09-21T15:07:18.782 INFO:teuthology.orchestra.run.smithi161.stdout:113 read 0x18885d0 thru 0x1894cf3 (0xc724 bytes) 2024-09-21T15:07:18.783 INFO:teuthology.orchestra.run.smithi161.stdout:250 trunc from 0x4f7d092 to 0x1164c14 2024-09-21T15:07:18.825 INFO:teuthology.orchestra.run.smithi161.stdout:62 write 0x6d8fffb thru 0x6d9f1d3 (0xf1d9 bytes) 2024-09-21T15:07:18.827 INFO:teuthology.orchestra.run.smithi161.stdout:114 write 0xee03673 thru 0xee0db62 (0xa4f0 bytes) 2024-09-21T15:07:18.836 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.836 INFO:teuthology.orchestra.run.smithi161.stdout:117 write 0x88e7d3b thru 0x88e8959 (0xc1f bytes) 2024-09-21T15:07:18.843 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xd411866 2024-09-21T15:07:18.846 INFO:teuthology.orchestra.run.smithi161.stdout:118 trunc from 0xee0db63 to 0xd411866 2024-09-21T15:07:18.860 INFO:teuthology.orchestra.run.smithi161.stdout:251 writesame 0xad4f00a thru 0xad53ac2 data_size 0x25(0x4ab9 bytes) 2024-09-21T15:07:18.872 INFO:teuthology.orchestra.run.smithi161.stdout:63 trunc from 0xdb1cdd0 to 0xb2e935d 2024-09-21T15:07:18.872 INFO:teuthology.orchestra.run.smithi161.stdout:255 trunc from 0xad53ac3 to 0x9352e28 2024-09-21T15:07:18.897 INFO:teuthology.orchestra.run.smithi161.stdout:119 trunc from 0xd411866 to 0x7bb1de 2024-09-21T15:07:18.968 INFO:teuthology.orchestra.run.smithi161.stdout:121 punch from 0x486ca1 to 0x496832, (0xfb91 bytes) 2024-09-21T15:07:18.968 INFO:teuthology.orchestra.run.smithi161.stdout:122 punch from 0x279ecf to 0x2815cd, (0x76fe bytes) 2024-09-21T15:07:18.975 INFO:teuthology.orchestra.run.smithi161.stdout:257 write 0xba27503 thru 0xba29886 (0x2384 bytes) 2024-09-21T15:07:18.975 INFO:teuthology.orchestra.run.smithi161.stdout:123 trunc from 0x7bb1de to 0x39e9af8 2024-09-21T15:07:18.987 INFO:teuthology.orchestra.run.smithi161.stdout:258 punch from 0x26b5ec1 to 0x26b7cb2, (0x1df1 bytes) 2024-09-21T15:07:18.988 INFO:teuthology.orchestra.run.smithi161.stdout:260 write 0xb9ab29f thru 0xb9abf19 (0xc7b bytes) 2024-09-21T15:07:18.991 INFO:teuthology.orchestra.run.smithi161.stdout:125 read 0x113dead thru 0x114a061 (0xc1b5 bytes) 2024-09-21T15:07:18.992 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.992 INFO:teuthology.orchestra.run.smithi161.stdout:262 punch from 0x986df17 to 0x98733ca, (0x54b3 bytes) 2024-09-21T15:07:18.992 INFO:teuthology.orchestra.run.smithi161.stdout:263 read 0x6565002 thru 0x6568a83 (0x3a82 bytes) 2024-09-21T15:07:18.993 INFO:teuthology.orchestra.run.smithi161.stdout:264 read 0x1fe6c59 thru 0x1ff50fd (0xe4a5 bytes) 2024-09-21T15:07:18.994 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:18.994 INFO:teuthology.orchestra.run.smithi161.stdout:267 writesame 0x79d79c6 thru 0x79d8c32 data_size 0x1(0x126d bytes) 2024-09-21T15:07:19.004 INFO:teuthology.orchestra.run.smithi161.stdout:66 write 0x9614cb7 thru 0x961c494 (0x77de bytes) 2024-09-21T15:07:19.006 INFO:teuthology.orchestra.run.smithi161.stdout:269 read 0x9966f43 thru 0x9974c1a (0xdcd8 bytes) 2024-09-21T15:07:19.007 INFO:teuthology.orchestra.run.smithi161.stdout:270 write 0x6ec486a thru 0x6ecd56f (0x8d06 bytes) 2024-09-21T15:07:19.017 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #1, image image_cluster1.client.mirror.3-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent2 2024-09-21T15:07:19.019 INFO:teuthology.orchestra.run.smithi161.stdout:271 read 0x91c35a4 thru 0x91ccf13 (0x9970 bytes) 2024-09-21T15:07:19.020 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.020 INFO:teuthology.orchestra.run.smithi161.stdout:273 read 0x64ebf7 thru 0x65b216 (0xc620 bytes) 2024-09-21T15:07:19.021 INFO:teuthology.orchestra.run.smithi161.stdout:274 write 0x3de204 thru 0x3dfd13 (0x1b10 bytes) 2024-09-21T15:07:19.024 INFO:teuthology.orchestra.run.smithi161.stdout:126 write 0x557cd4e thru 0x5582772 (0x5a25 bytes) 2024-09-21T15:07:19.029 INFO:teuthology.orchestra.run.smithi161.stdout:67 write 0xa841b74 thru 0xa8428c8 (0xd55 bytes) 2024-09-21T15:07:19.039 INFO:teuthology.orchestra.run.smithi161.stdout:128 trunc from 0x5582773 to 0x66e91ff 2024-09-21T15:07:19.042 INFO:teuthology.orchestra.run.smithi161.stdout:68 write 0x47691b7 thru 0x47777ca (0xe614 bytes) 2024-09-21T15:07:19.049 INFO:teuthology.orchestra.run.smithi161.stdout:275 trunc from 0xba29887 to 0x61bb1f 2024-09-21T15:07:19.067 INFO:teuthology.orchestra.run.smithi161.stdout:69 punch from 0x6c949b7 to 0x6ca20ff, (0xd748 bytes) 2024-09-21T15:07:19.069 INFO:teuthology.orchestra.run.smithi161.stdout:71 trunc from 0xb2e935d to 0xa50acb9 2024-09-21T15:07:19.075 INFO:teuthology.orchestra.run.smithi161.stdout:129 write 0x5973bc4 thru 0x597fd97 (0xc1d4 bytes) 2024-09-21T15:07:19.111 INFO:teuthology.orchestra.run.smithi161.stdout:131 trunc from 0x66e91ff to 0x8712db 2024-09-21T15:07:19.112 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xa56f981 2024-09-21T15:07:19.118 INFO:teuthology.orchestra.run.smithi161.stdout:57 trunc from 0xd6fda7e to 0xa56f981 2024-09-21T15:07:19.154 INFO:teuthology.orchestra.run.smithi161.stdout:276 write 0xc7af54b thru 0xc7b2de6 (0x389c bytes) 2024-09-21T15:07:19.227 INFO:teuthology.orchestra.run.smithi161.stdout:277 read 0x45d9cce thru 0x45e9211 (0xf544 bytes) 2024-09-21T15:07:19.227 INFO:teuthology.orchestra.run.smithi161.stdout:278 write 0x1c7a362 thru 0x1c7ba61 (0x1700 bytes) 2024-09-21T15:07:19.236 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xe706dde 2024-09-21T15:07:19.241 INFO:teuthology.orchestra.run.smithi161.stdout:279 write 0x71e1b1 thru 0x71eebb (0xd0b bytes) 2024-09-21T15:07:19.246 INFO:teuthology.orchestra.run.smithi161.stdout:72 write 0x4a6187a thru 0x4a63c27 (0x23ae bytes) 2024-09-21T15:07:19.247 INFO:teuthology.orchestra.run.smithi161.stdout:280 read 0x255267f thru 0x255cf16 (0xa898 bytes) 2024-09-21T15:07:19.248 INFO:teuthology.orchestra.run.smithi161.stdout:281 punch from 0xa93d5a4 to 0xa93f5e9, (0x2045 bytes) 2024-09-21T15:07:19.248 INFO:teuthology.orchestra.run.smithi161.stdout:282 writesame 0x5863915 thru 0x58659e6 data_size 0x1(0x20d2 bytes) 2024-09-21T15:07:19.259 INFO:teuthology.orchestra.run.smithi161.stdout:284 write 0x79c8676 thru 0x79d4852 (0xc1dd bytes) 2024-09-21T15:07:19.260 INFO:teuthology.orchestra.run.smithi161.stdout:58 write 0x6d08c3b thru 0x6d11278 (0x863e bytes) 2024-09-21T15:07:19.264 INFO:teuthology.orchestra.run.smithi161.stdout:132 trunc from 0x8712db to 0xe706dde 2024-09-21T15:07:19.273 INFO:teuthology.orchestra.run.smithi161.stdout:73 trunc from 0xa50acb9 to 0x324a61d 2024-09-21T15:07:19.273 INFO:teuthology.orchestra.run.smithi161.stdout:286 read 0xc1141e3 thru 0xc1187cc (0x45ea bytes) 2024-09-21T15:07:19.274 INFO:teuthology.orchestra.run.smithi161.stdout:287 write 0x28f46e1 thru 0x2901abe (0xd3de bytes) 2024-09-21T15:07:19.290 INFO:teuthology.orchestra.run.smithi161.stdout:288 read 0x50915e4 thru 0x5093fb8 (0x29d5 bytes) 2024-09-21T15:07:19.292 INFO:teuthology.orchestra.run.smithi161.stdout:290 read 0x48fc88 thru 0x49f8b6 (0xfc2f bytes) 2024-09-21T15:07:19.292 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.292 INFO:teuthology.orchestra.run.smithi161.stdout:134 punch from 0x29108e3 to 0x291b465, (0xab82 bytes) 2024-09-21T15:07:19.292 INFO:teuthology.orchestra.run.smithi161.stdout:136 write 0xa054bb8 thru 0xa060ee4 (0xc32d bytes) 2024-09-21T15:07:19.293 INFO:teuthology.orchestra.run.smithi161.stdout:291 punch from 0x2271bec to 0x2274209, (0x261d bytes) 2024-09-21T15:07:19.293 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.293 INFO:teuthology.orchestra.run.smithi161.stdout:294 read 0x6d730dc thru 0x6d7b123 (0x8048 bytes) 2024-09-21T15:07:19.294 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.294 INFO:teuthology.orchestra.run.smithi161.stdout:297 read 0xad11ba3 thru 0xad1d328 (0xb786 bytes) 2024-09-21T15:07:19.295 INFO:teuthology.orchestra.run.smithi161.stdout:298 write 0xc68a3af thru 0xc69a02b (0xfc7d bytes) 2024-09-21T15:07:19.299 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.299 INFO:teuthology.orchestra.run.smithi161.stdout:60 writesame 0x483a7c0 thru 0x483b6d0 data_size 0x1(0xf11 bytes) 2024-09-21T15:07:19.303 INFO:teuthology.orchestra.run.smithi161.stdout:137 punch from 0x6ae49eb to 0x6ae86df, (0x3cf4 bytes) 2024-09-21T15:07:19.304 INFO:teuthology.orchestra.run.smithi161.stdout:138 read 0x80036c9 thru 0x800dd48 (0xa680 bytes) 2024-09-21T15:07:19.304 INFO:teuthology.orchestra.run.smithi161.stdout:140 writesame 0x6b1a1c0 thru 0x6b20777 data_size 0x38(0x65b8 bytes) 2024-09-21T15:07:19.306 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.306 INFO:teuthology.orchestra.run.smithi161.stdout:300 writesame 0xa0b2e64 thru 0xa0b3e3e data_size 0x29(0xfdb bytes) 2024-09-21T15:07:19.314 INFO:teuthology.orchestra.run.smithi161.stdout:301 write 0xb88206f thru 0xb8879b3 (0x5945 bytes) 2024-09-21T15:07:19.318 INFO:teuthology.orchestra.run.smithi161.stdout:141 write 0x22aa34f thru 0x22b00ff (0x5db1 bytes) 2024-09-21T15:07:19.327 INFO:teuthology.orchestra.run.smithi161.stdout:304 punch from 0x37d754a to 0x37e51ec, (0xdca2 bytes) 2024-09-21T15:07:19.327 INFO:teuthology.orchestra.run.smithi161.stdout:305 write 0x1090846 thru 0x10a024d (0xfa08 bytes) 2024-09-21T15:07:19.334 INFO:teuthology.orchestra.run.smithi161.stdout:62 trunc from 0xa56f981 to 0x718e4dd 2024-09-21T15:07:19.336 INFO:teuthology.orchestra.run.smithi161.stdout:142 punch from 0x52d1cd5 to 0x52d5d2f, (0x405a bytes) 2024-09-21T15:07:19.336 INFO:teuthology.orchestra.run.smithi161.stdout:146 write 0x86f15c4 thru 0x8700132 (0xeb6f bytes) 2024-09-21T15:07:19.338 INFO:teuthology.orchestra.run.smithi161.stdout:307 writesame 0x5d04b50 thru 0x5d09975 data_size 0x7(0x4e26 bytes) 2024-09-21T15:07:19.348 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.354 INFO:teuthology.orchestra.run.smithi161.stdout:147 read 0x671d1ca thru 0x6726b1b (0x9952 bytes) 2024-09-21T15:07:19.354 INFO:teuthology.orchestra.run.smithi161.stdout:148 writesame 0x2cc9641 thru 0x2cd91c3 data_size 0x1f(0xfb83 bytes) 2024-09-21T15:07:19.372 INFO:teuthology.orchestra.run.smithi161.stdout:149 punch from 0x6ee6a17 to 0x6ef3bff, (0xd1e8 bytes) 2024-09-21T15:07:19.372 INFO:teuthology.orchestra.run.smithi161.stdout:151 writesame 0xdbd3ced thru 0xdbe0402 data_size 0x11(0xc716 bytes) 2024-09-21T15:07:19.425 INFO:teuthology.orchestra.run.smithi161.stdout:152 read 0x704ba7e thru 0x7058609 (0xcb8c bytes) 2024-09-21T15:07:19.425 INFO:teuthology.orchestra.run.smithi161.stdout:154 read 0x73af150 thru 0x73b2a2e (0x38df bytes) 2024-09-21T15:07:19.425 INFO:teuthology.orchestra.run.smithi161.stdout:157 read 0xd0cbbc1 thru 0xd0d1ab1 (0x5ef1 bytes) 2024-09-21T15:07:19.442 INFO:teuthology.orchestra.run.smithi161.stdout:158 trunc from 0xe706dde to 0x6295334 2024-09-21T15:07:19.444 INFO:teuthology.orchestra.run.smithi161.stdout:310 write 0xd4bc380 thru 0xd4c777a (0xb3fb bytes) 2024-09-21T15:07:19.454 INFO:teuthology.orchestra.run.smithi161.stdout:76 write 0xb422385 thru 0xb4322e8 (0xff64 bytes) 2024-09-21T15:07:19.462 INFO:teuthology.orchestra.run.smithi161.stdout:311 writesame 0x263037 thru 0x26ce96 data_size 0x70(0x9e60 bytes) 2024-09-21T15:07:19.476 INFO:teuthology.orchestra.run.smithi161.stdout:312 write 0xb84e5e1 thru 0xb858071 (0x9a91 bytes) 2024-09-21T15:07:19.490 INFO:teuthology.orchestra.run.smithi161.stdout:63 punch from 0x214f140 to 0x215db22, (0xe9e2 bytes) 2024-09-21T15:07:19.490 INFO:teuthology.orchestra.run.smithi161.stdout:65 write 0xd6705e thru 0xd6a394 (0x3337 bytes) 2024-09-21T15:07:19.499 INFO:teuthology.orchestra.run.smithi161.stdout:66 read 0x2fc4c56 thru 0x2fd0092 (0xb43d bytes) 2024-09-21T15:07:19.500 INFO:teuthology.orchestra.run.smithi161.stdout:67 writesame 0x3576ba6 thru 0x3584538 data_size 0x49(0xd993 bytes) 2024-09-21T15:07:19.501 INFO:teuthology.orchestra.run.smithi161.stdout:313 read 0x674e9dd thru 0x6756bc5 (0x81e9 bytes) 2024-09-21T15:07:19.502 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.520 INFO:teuthology.orchestra.run.smithi161.stdout:315 trunc from 0xd4c777b to 0x5b88639 2024-09-21T15:07:19.523 INFO:teuthology.orchestra.run.smithi161.stdout:159 read 0x25dbf43 thru 0x25e8ec5 (0xcf83 bytes) 2024-09-21T15:07:19.524 INFO:teuthology.orchestra.run.smithi161.stdout:160 punch from 0x22a380 to 0x22e8ff, (0x457f bytes) 2024-09-21T15:07:19.525 INFO:teuthology.orchestra.run.smithi161.stdout:161 read 0x3325fcf thru 0x3331ed7 (0xbf09 bytes) 2024-09-21T15:07:19.525 INFO:teuthology.orchestra.run.smithi161.stdout:164 read 0x2aeddf4 thru 0x2aedf26 (0x133 bytes) 2024-09-21T15:07:19.525 INFO:teuthology.orchestra.run.smithi161.stdout:165 punch from 0x31c025f to 0x31c30f9, (0x2e9a bytes) 2024-09-21T15:07:19.533 INFO:teuthology.orchestra.run.smithi161.stdout:77 write 0xbe682d9 thru 0xbe6cd53 (0x4a7b bytes) 2024-09-21T15:07:19.551 INFO:teuthology.orchestra.run.smithi161.stdout:78 write 0xb8006ea thru 0xb8065f3 (0x5f0a bytes) 2024-09-21T15:07:19.559 INFO:teuthology.orchestra.run.smithi161.stdout:166 write 0xa4e6691 thru 0xa4f4e4e (0xe7be bytes) 2024-09-21T15:07:19.561 INFO:teuthology.orchestra.run.smithi161.stdout:69 write 0x9377d6a thru 0x937e523 (0x67ba bytes) 2024-09-21T15:07:19.568 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.568 INFO:teuthology.orchestra.run.smithi161.stdout:80 writesame 0x4312784 thru 0x431ec17 data_size 0x2e(0xc494 bytes) 2024-09-21T15:07:19.572 INFO:teuthology.orchestra.run.smithi161.stdout:70 read 0x6af6c13 thru 0x6afbb9a (0x4f88 bytes) 2024-09-21T15:07:19.572 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.572 INFO:teuthology.orchestra.run.smithi161.stdout:72 write 0x3cdc527 thru 0x3ce5adc (0x95b6 bytes) 2024-09-21T15:07:19.575 INFO:teuthology.orchestra.run.smithi161.stdout:316 trunc from 0x5b88639 to 0xa6b45c 2024-09-21T15:07:19.579 INFO:teuthology.orchestra.run.smithi161.stdout:73 read 0x65b84fa thru 0x65bc970 (0x4477 bytes) 2024-09-21T15:07:19.580 INFO:teuthology.orchestra.run.smithi161.stdout:74 writesame 0x3d91108 thru 0x3d94fe1 data_size 0x5(0x3eda bytes) 2024-09-21T15:07:19.582 INFO:teuthology.orchestra.run.smithi161.stdout:168 trunc from 0xa4f4e4f to 0x4c3df4b 2024-09-21T15:07:19.587 INFO:teuthology.orchestra.run.smithi161.stdout:82 read 0x9f7e136 thru 0x9f85a4d (0x7918 bytes) 2024-09-21T15:07:19.587 INFO:teuthology.orchestra.run.smithi161.stdout:84 punch from 0x58a8ac3 to 0x58ad2b1, (0x47ee bytes) 2024-09-21T15:07:19.587 INFO:teuthology.orchestra.run.smithi161.stdout:85 read 0x333bef3 thru 0x334457e (0x868c bytes) 2024-09-21T15:07:19.588 INFO:teuthology.orchestra.run.smithi161.stdout:86 write 0x830f009 thru 0x83136ad (0x46a5 bytes) 2024-09-21T15:07:19.592 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xb6ea2fe 2024-09-21T15:07:19.597 INFO:teuthology.orchestra.run.smithi161.stdout:75 trunc from 0x937e524 to 0xb6ea2fe 2024-09-21T15:07:19.604 INFO:teuthology.orchestra.run.smithi161.stdout:87 write 0x9579dac thru 0x95811f2 (0x7447 bytes) 2024-09-21T15:07:19.613 INFO:teuthology.orchestra.run.smithi161.stdout:317 punch from 0x7d23a3 to 0x7d9cca, (0x7927 bytes) 2024-09-21T15:07:19.622 INFO:teuthology.orchestra.run.smithi161.stdout:88 read 0x33e87f5 thru 0x33f3532 (0xad3e bytes) 2024-09-21T15:07:19.623 INFO:teuthology.orchestra.run.smithi161.stdout:89 read 0x7c9416d thru 0x7ca37ce (0xf662 bytes) 2024-09-21T15:07:19.623 INFO:teuthology.orchestra.run.smithi161.stdout:90 write 0x2b3d4e4 thru 0x2b45093 (0x7bb0 bytes) 2024-09-21T15:07:19.634 INFO:teuthology.orchestra.run.smithi161.stdout:173 punch from 0x8f2f99 to 0x8fa41c, (0x7483 bytes) 2024-09-21T15:07:19.634 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.634 INFO:teuthology.orchestra.run.smithi161.stdout:179 read 0x305f0aa thru 0x3063471 (0x43c8 bytes) 2024-09-21T15:07:19.634 INFO:teuthology.orchestra.run.smithi161.stdout:180 punch from 0x4794768 to 0x479aa71, (0x6309 bytes) 2024-09-21T15:07:19.639 INFO:teuthology.orchestra.run.smithi161.stdout:76 trunc from 0xb6ea2fe to 0x950fc9c 2024-09-21T15:07:19.645 INFO:teuthology.orchestra.run.smithi161.stdout:91 write 0xb2b5b86 thru 0xb2b9da9 (0x4224 bytes) 2024-09-21T15:07:19.659 INFO:teuthology.orchestra.run.smithi161.stdout:319 writesame 0x8364328 thru 0x8366767 data_size 0x4(0x2440 bytes) 2024-09-21T15:07:19.671 INFO:teuthology.orchestra.run.smithi161.stdout:92 trunc from 0xbe6cd54 to 0x855da81 2024-09-21T15:07:19.674 INFO:teuthology.orchestra.run.smithi161.stdout:78 read 0x142cd9a thru 0x14319ca (0x4c31 bytes) 2024-09-21T15:07:19.674 INFO:teuthology.orchestra.run.smithi161.stdout:182 write 0x8c8001f thru 0x8c89c54 (0x9c36 bytes) 2024-09-21T15:07:19.674 INFO:teuthology.orchestra.run.smithi161.stdout:79 write 0x8a7fbb2 thru 0x8a843ae (0x47fd bytes) 2024-09-21T15:07:19.687 INFO:teuthology.orchestra.run.smithi161.stdout:80 punch from 0x11239f2 to 0x1128e94, (0x54a2 bytes) 2024-09-21T15:07:19.688 INFO:teuthology.orchestra.run.smithi161.stdout:81 read 0xf9e3f5 thru 0xfad97b (0xf587 bytes) 2024-09-21T15:07:19.689 INFO:teuthology.orchestra.run.smithi161.stdout:183 writesame 0x318e50 thru 0x31c0fc data_size 0x1(0x32ad bytes) 2024-09-21T15:07:19.698 INFO:teuthology.orchestra.run.smithi161.stdout:320 write 0x9fd5b7e thru 0x9fe0d70 (0xb1f3 bytes) 2024-09-21T15:07:19.700 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.700 INFO:teuthology.orchestra.run.smithi161.stdout:185 punch from 0x78e8365 to 0x78edc76, (0x5911 bytes) 2024-09-21T15:07:19.709 INFO:teuthology.orchestra.run.smithi161.stdout:321 punch from 0x1e16b3e to 0x1e22173, (0xb635 bytes) 2024-09-21T15:07:19.728 INFO:teuthology.orchestra.run.smithi161.stdout:323 trunc from 0x9fe0d71 to 0x44bf96 2024-09-21T15:07:19.729 INFO:teuthology.orchestra.run.smithi161.stdout:186 write 0x99ec406 thru 0x99facb3 (0xe8ae bytes) 2024-09-21T15:07:19.731 INFO:teuthology.orchestra.run.smithi161.stdout:82 writesame 0xe3e0eca thru 0xe3ebefe data_size 0x1(0xb035 bytes) 2024-09-21T15:07:19.738 INFO:teuthology.orchestra.run.smithi161.stdout:83 writesame 0x5b087ec thru 0x5b0e5af data_size 0x22(0x5dc4 bytes) 2024-09-21T15:07:19.745 INFO:teuthology.orchestra.run.smithi161.stdout:187 punch from 0x73aba76 to 0x73b90a8, (0xd632 bytes) 2024-09-21T15:07:19.747 INFO:teuthology.orchestra.run.smithi161.stdout:93 writesame 0xd1213d7 thru 0xd122395 data_size 0x1(0xfbf bytes) 2024-09-21T15:07:19.749 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.758 INFO:teuthology.orchestra.run.smithi161.stdout:189 trunc from 0x99facb4 to 0x4cb4ddc 2024-09-21T15:07:19.766 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.766 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.768 INFO:teuthology.orchestra.run.smithi161.stdout:95 trunc from 0xd122396 to 0x58ab44d 2024-09-21T15:07:19.776 INFO:teuthology.orchestra.run.smithi161.stdout:84 trunc from 0xe3ebeff to 0x2154743 2024-09-21T15:07:19.799 INFO:teuthology.orchestra.run.smithi161.stdout:190 punch from 0x2f0b0ff to 0x2f12313, (0x7214 bytes) 2024-09-21T15:07:19.799 INFO:teuthology.orchestra.run.smithi161.stdout:192 read 0x11ac7b9 thru 0x11b30b7 (0x68ff bytes) 2024-09-21T15:07:19.808 INFO:teuthology.orchestra.run.smithi161.stdout:327 writesame 0x88ed2a7 thru 0x88f116e data_size 0xe(0x3ec8 bytes) 2024-09-21T15:07:19.818 INFO:teuthology.orchestra.run.smithi161.stdout:328 trunc from 0x88f116f to 0x85448d3 2024-09-21T15:07:19.826 INFO:teuthology.orchestra.run.smithi161.stdout:97 clone 2 order 19 su 131072 sc 8 2024-09-21T15:07:19.836 INFO:teuthology.orchestra.run.smithi161.stdout:193 write 0x9215466 thru 0x921592f (0x4ca bytes) 2024-09-21T15:07:19.843 INFO:teuthology.orchestra.run.smithi161.stdout:85 trunc from 0x2154743 to 0x83eb82f 2024-09-21T15:07:19.847 INFO:teuthology.orchestra.run.smithi161.stdout:114 punch from 0x3ee6e11 to 0x3eecf5d, (0x614c bytes) 2024-09-21T15:07:19.849 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.849 INFO:teuthology.orchestra.run.smithi161.stdout:331 read 0xa6030d thru 0xa6370c (0x3400 bytes) 2024-09-21T15:07:19.849 INFO:teuthology.orchestra.run.smithi161.stdout:332 read 0x48e795e thru 0x48f6a0e (0xf0b1 bytes) 2024-09-21T15:07:19.850 INFO:teuthology.orchestra.run.smithi161.stdout:333 read 0x59812d0 thru 0x5986900 (0x5631 bytes) 2024-09-21T15:07:19.856 INFO:teuthology.orchestra.run.smithi161.stdout:195 trunc from 0x9215930 to 0x2fdd7b8 2024-09-21T15:07:19.861 INFO:teuthology.orchestra.run.smithi161.stdout:335 trunc from 0x85448d3 to 0x31298bd 2024-09-21T15:07:19.863 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.863 INFO:teuthology.orchestra.run.smithi161.stdout:88 write 0x489d725 thru 0x489dba2 (0x47e bytes) 2024-09-21T15:07:19.868 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #0, image image_cluster1.client.mirror.1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent1 2024-09-21T15:07:19.872 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:19.894 INFO:teuthology.orchestra.run.smithi161.stdout:115 write 0xee553fd thru 0xee63953 (0xe557 bytes) 2024-09-21T15:07:19.910 INFO:teuthology.orchestra.run.smithi161.stdout:196 write 0xb42f39 thru 0xb4f146 (0xc20e bytes) 2024-09-21T15:07:19.912 INFO:teuthology.orchestra.run.smithi161.stdout:90 write 0xa6130a5 thru 0xa61f32e (0xc28a bytes) 2024-09-21T15:07:19.923 INFO:teuthology.orchestra.run.smithi161.stdout:337 writesame 0x32ea4e5 thru 0x32eb701 data_size 0x1(0x121d bytes) 2024-09-21T15:07:19.933 INFO:teuthology.orchestra.run.smithi161.stdout:117 write 0xacf904b thru 0xad08b91 (0xfb47 bytes) 2024-09-21T15:07:19.933 INFO:teuthology.orchestra.run.smithi161.stdout:338 punch from 0x32d49fc to 0x32d5629, (0xc2d bytes) 2024-09-21T15:07:19.933 INFO:teuthology.orchestra.run.smithi161.stdout:197 writesame 0x2e6e27b thru 0x2e7bf2f data_size 0x1(0xdcb5 bytes) 2024-09-21T15:07:19.981 INFO:teuthology.orchestra.run.smithi161.stdout:118 write 0x43ffea7 thru 0x4405284 (0x53de bytes) 2024-09-21T15:07:19.985 INFO:teuthology.orchestra.run.smithi161.stdout:91 write 0xb6262a1 thru 0xb62ea7f (0x87df bytes) 2024-09-21T15:07:19.993 INFO:teuthology.orchestra.run.smithi161.stdout:342 writesame 0xabd1d38 thru 0xabd9bc5 data_size 0x61(0x7e8e bytes) 2024-09-21T15:07:20.005 INFO:teuthology.orchestra.run.smithi161.stdout:119 read 0xd3a3e39 thru 0xd3afab3 (0xbc7b bytes) 2024-09-21T15:07:20.006 INFO:teuthology.orchestra.run.smithi161.stdout:343 writesame 0xa711c7a thru 0xa712f8c data_size 0x1(0x1313 bytes) 2024-09-21T15:07:20.006 INFO:teuthology.orchestra.run.smithi161.stdout:120 punch from 0x52f4866 to 0x52fd510, (0x8caa bytes) 2024-09-21T15:07:20.006 INFO:teuthology.orchestra.run.smithi161.stdout:121 punch from 0x43c4bd3 to 0x43c6c8e, (0x20bb bytes) 2024-09-21T15:07:20.006 INFO:teuthology.orchestra.run.smithi161.stdout:93 write 0x83c7d13 thru 0x83d1c8a (0x9f78 bytes) 2024-09-21T15:07:20.017 INFO:teuthology.orchestra.run.smithi161.stdout:344 write 0xf5d6da thru 0xf6b66d (0xdf94 bytes) 2024-09-21T15:07:20.027 INFO:teuthology.orchestra.run.smithi161.stdout:198 writesame 0x691ffc3 thru 0x69243d0 data_size 0x1f(0x440e bytes) 2024-09-21T15:07:20.028 INFO:teuthology.orchestra.run.smithi161.stdout:122 trunc from 0xee63954 to 0x39a2072 2024-09-21T15:07:20.030 INFO:teuthology.orchestra.run.smithi161.stdout:94 trunc from 0xb62ea80 to 0x6e62673 2024-09-21T15:07:20.037 INFO:teuthology.orchestra.run.smithi161.stdout:346 trunc from 0xabd9bc6 to 0xd50b6d8 2024-09-21T15:07:20.038 INFO:teuthology.orchestra.run.smithi161.stdout:199 trunc from 0x69243d1 to 0x4a63660 2024-09-21T15:07:20.073 INFO:teuthology.orchestra.run.smithi161.stdout:349 read 0x573d291 thru 0x574b8e2 (0xe652 bytes) 2024-09-21T15:07:20.074 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.074 INFO:teuthology.orchestra.run.smithi161.stdout:351 write 0xb35be05 thru 0xb35e8b1 (0x2aad bytes) 2024-09-21T15:07:20.086 INFO:teuthology.orchestra.run.smithi161.stdout:352 read 0x706767d thru 0x706f451 (0x7dd5 bytes) 2024-09-21T15:07:20.086 INFO:teuthology.orchestra.run.smithi161.stdout:183 writesame 0x22d3660 thru 0x22e2ec1 data_size 0x1(0xf862 bytes) 2024-09-21T15:07:20.087 INFO:teuthology.orchestra.run.smithi161.stdout:201 trunc from 0x4a63660 to 0x6ae004c 2024-09-21T15:07:20.087 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.087 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.087 INFO:teuthology.orchestra.run.smithi161.stdout:355 trunc from 0xd50b6d8 to 0xd9f937f 2024-09-21T15:07:20.099 INFO:teuthology.orchestra.run.smithi161.stdout:95 read 0x50420a5 thru 0x504cf64 (0xaec0 bytes) 2024-09-21T15:07:20.110 INFO:teuthology.orchestra.run.smithi161.stdout:203 read 0x1b08f0 thru 0x1bafc9 (0xa6da bytes) 2024-09-21T15:07:20.112 INFO:teuthology.orchestra.run.smithi161.stdout:204 read 0x41fa58d thru 0x41fe86b (0x42df bytes) 2024-09-21T15:07:20.114 INFO:teuthology.orchestra.run.smithi161.stdout:205 punch from 0x2d10811 to 0x2d19eab, (0x969a bytes) 2024-09-21T15:07:20.115 INFO:teuthology.orchestra.run.smithi161.stdout:206 read 0x2e22b73 thru 0x2e300a2 (0xd530 bytes) 2024-09-21T15:07:20.119 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.119 INFO:teuthology.orchestra.run.smithi161.stdout:209 write 0x624a32f thru 0x624f32f (0x5001 bytes) 2024-09-21T15:07:20.121 INFO:teuthology.orchestra.run.smithi161.stdout:356 punch from 0x1c18f87 to 0x1c21b47, (0x8bc0 bytes) 2024-09-21T15:07:20.121 INFO:teuthology.orchestra.run.smithi161.stdout:357 punch from 0x74d7b3b to 0x74e5649, (0xdb0e bytes) 2024-09-21T15:07:20.121 INFO:teuthology.orchestra.run.smithi161.stdout:358 writesame 0x3cd6a3 thru 0x3da11d data_size 0x7(0xca7b bytes) 2024-09-21T15:07:20.129 INFO:teuthology.orchestra.run.smithi161.stdout:96 write 0x815e2fc thru 0x816633a (0x803f bytes) 2024-09-21T15:07:20.139 INFO:teuthology.orchestra.run.smithi161.stdout:359 read 0x95b6ce0 thru 0x95b7f1d (0x123e bytes) 2024-09-21T15:07:20.140 INFO:teuthology.orchestra.run.smithi161.stdout:361 write 0x474a40e thru 0x475116a (0x6d5d bytes) 2024-09-21T15:07:20.141 INFO:teuthology.orchestra.run.smithi161.stdout:211 writesame 0x3270884 thru 0x327959b data_size 0x81(0x8d18 bytes) 2024-09-21T15:07:20.146 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.150 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.151 INFO:teuthology.orchestra.run.smithi161.stdout:98 punch from 0xa2fbba to 0xa3c9a7, (0xcded bytes) 2024-09-21T15:07:20.151 INFO:teuthology.orchestra.run.smithi161.stdout:100 read 0x7e1a41 thru 0x7ecfbc (0xb57c bytes) 2024-09-21T15:07:20.151 INFO:teuthology.orchestra.run.smithi161.stdout:363 write 0xd14f24f thru 0xd14facc (0x87e bytes) 2024-09-21T15:07:20.152 INFO:teuthology.orchestra.run.smithi161.stdout:102 punch from 0x38f7653 to 0x3900cbd, (0x966a bytes) 2024-09-21T15:07:20.152 INFO:teuthology.orchestra.run.smithi161.stdout:103 write 0xd9e7aa thru 0xda36d8 (0x4f2f bytes) 2024-09-21T15:07:20.155 INFO:teuthology.orchestra.run.smithi161.stdout:364 writesame 0xc992de8 thru 0xc99eeb2 data_size 0x1(0xc0cb bytes) 2024-09-21T15:07:20.158 INFO:teuthology.orchestra.run.smithi161.stdout:104 clone 4 order 24 su 65536 sc 9 2024-09-21T15:07:20.159 INFO:teuthology.orchestra.run.smithi161.stdout:123 write 0xe4ed838 thru 0xe4f27ca (0x4f93 bytes) 2024-09-21T15:07:20.200 INFO:teuthology.orchestra.run.smithi161.stdout:365 trunc from 0xd9f937f to 0x8ed3471 2024-09-21T15:07:20.201 INFO:teuthology.orchestra.run.smithi161.stdout:186 writesame 0xe61cc27 thru 0xe6236cb data_size 0x1(0x6aa5 bytes) 2024-09-21T15:07:20.203 INFO:teuthology.orchestra.run.smithi161.stdout:125 write 0x69f20b9 thru 0x69f8e4f (0x6d97 bytes) 2024-09-21T15:07:20.203 INFO:teuthology.orchestra.run.smithi161.stdout:187 writesame 0x18a5ffe thru 0x18ab069 data_size 0x2(0x506c bytes) 2024-09-21T15:07:20.206 INFO:teuthology.orchestra.run.smithi161.stdout:212 write 0x7d7b13a thru 0x7d87606 (0xc4cd bytes) 2024-09-21T15:07:20.228 INFO:teuthology.orchestra.run.smithi161.stdout:213 write 0x4a586a1 thru 0x4a681b3 (0xfb13 bytes) 2024-09-21T15:07:20.232 INFO:teuthology.orchestra.run.smithi161.stdout:126 read 0xb24caaa thru 0xb2583d8 (0xb92f bytes) 2024-09-21T15:07:20.233 INFO:teuthology.orchestra.run.smithi161.stdout:127 read 0x3842cdc thru 0x384887f (0x5ba4 bytes) 2024-09-21T15:07:20.234 INFO:teuthology.orchestra.run.smithi161.stdout:128 read 0x1ce01d7 thru 0x1ce7105 (0x6f2f bytes) 2024-09-21T15:07:20.234 INFO:teuthology.orchestra.run.smithi161.stdout:129 punch from 0x1472b68 to 0x1480074, (0xd50c bytes) 2024-09-21T15:07:20.235 INFO:teuthology.orchestra.run.smithi161.stdout:131 writesame 0xc72d5f4 thru 0xc730c9b data_size 0x42(0x36a8 bytes) 2024-09-21T15:07:20.235 INFO:teuthology.orchestra.run.smithi161.stdout:188 write 0xe3ffb1a thru 0xe404e7f (0x5366 bytes) 2024-09-21T15:07:20.238 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.238 INFO:teuthology.orchestra.run.smithi161.stdout:217 read 0x5db2801 thru 0x5db82e5 (0x5ae5 bytes) 2024-09-21T15:07:20.242 INFO:teuthology.orchestra.run.smithi161.stdout:218 flatten 2024-09-21T15:07:20.247 INFO:teuthology.orchestra.run.smithi161.stdout:132 writesame 0x28d4768 thru 0x28d7b74 data_size 0x29(0x340d bytes) 2024-09-21T15:07:20.252 INFO:teuthology.orchestra.run.smithi161.stdout:366 write 0x192e931 thru 0x1937f3e (0x960e bytes) 2024-09-21T15:07:20.262 INFO:teuthology.orchestra.run.smithi161.stdout:367 read 0x210ae8c thru 0x2111100 (0x6275 bytes) 2024-09-21T15:07:20.262 INFO:teuthology.orchestra.run.smithi161.stdout:133 punch from 0xcfe6050 to 0xcfea719, (0x46c9 bytes) 2024-09-21T15:07:20.262 INFO:teuthology.orchestra.run.smithi161.stdout:134 writesame 0x535a5d6 thru 0x535af4a data_size 0x3(0x975 bytes) 2024-09-21T15:07:20.264 INFO:teuthology.orchestra.run.smithi161.stdout:189 trunc from 0xe6236cc to 0x68fc081 2024-09-21T15:07:20.266 INFO:teuthology.orchestra.run.smithi161.stdout:219 read 0x59f51e3 thru 0x5a04b21 (0xf93f bytes) 2024-09-21T15:07:20.267 INFO:teuthology.orchestra.run.smithi161.stdout:221 read 0x4cc0b17 thru 0x4cc6cb8 (0x61a2 bytes) 2024-09-21T15:07:20.267 INFO:teuthology.orchestra.run.smithi161.stdout:222 write 0x2bb8d7e thru 0x2bc5f3e (0xd1c1 bytes) 2024-09-21T15:07:20.268 INFO:teuthology.orchestra.run.smithi161.stdout:135 read 0xa971e58 thru 0xa976d4a (0x4ef3 bytes) 2024-09-21T15:07:20.268 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.268 INFO:teuthology.orchestra.run.smithi161.stdout:138 read 0x1b2f185 thru 0x1b36da4 (0x7c20 bytes) 2024-09-21T15:07:20.268 INFO:teuthology.orchestra.run.smithi161.stdout:139 writesame 0x22afff1 thru 0x22b8530 data_size 0x40(0x8540 bytes) 2024-09-21T15:07:20.278 INFO:teuthology.orchestra.run.smithi161.stdout:223 punch from 0x203024e to 0x2032bdf, (0x2991 bytes) 2024-09-21T15:07:20.278 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.278 INFO:teuthology.orchestra.run.smithi161.stdout:225 punch from 0x3bea71e to 0x3bf70a3, (0xc985 bytes) 2024-09-21T15:07:20.282 INFO:teuthology.orchestra.run.smithi161.stdout:226 trunc from 0x7d87607 to 0x58b7f7e 2024-09-21T15:07:20.296 INFO:teuthology.orchestra.run.smithi161.stdout:140 punch from 0xb39623c to 0xb397848, (0x160c bytes) 2024-09-21T15:07:20.296 INFO:teuthology.orchestra.run.smithi161.stdout:141 write 0x12b3376 thru 0x12c1646 (0xe2d1 bytes) 2024-09-21T15:07:20.312 INFO:teuthology.orchestra.run.smithi161.stdout:370 write 0xbf1940b thru 0xbf21902 (0x84f8 bytes) 2024-09-21T15:07:20.324 INFO:teuthology.orchestra.run.smithi161.stdout:372 read 0x3dde57e thru 0x3dea81c (0xc29f bytes) 2024-09-21T15:07:20.325 INFO:teuthology.orchestra.run.smithi161.stdout:373 read 0x7ebab56 thru 0x7ebafbb (0x466 bytes) 2024-09-21T15:07:20.326 INFO:teuthology.orchestra.run.smithi161.stdout:374 writesame 0x71dc41f thru 0x71e3bae data_size 0x8(0x7790 bytes) 2024-09-21T15:07:20.336 INFO:teuthology.orchestra.run.smithi161.stdout:142 write 0xa712f6c thru 0xa71e762 (0xb7f7 bytes) 2024-09-21T15:07:20.337 INFO:teuthology.orchestra.run.smithi161.stdout:375 writesame 0x9348cc2 thru 0x9351fd5 data_size 0x2(0x9314 bytes) 2024-09-21T15:07:20.340 INFO:teuthology.orchestra.run.smithi161.stdout:190 trunc from 0x68fc081 to 0x94a1e08 2024-09-21T15:07:20.355 INFO:teuthology.orchestra.run.smithi161.stdout:376 write 0x50947d7 thru 0x509a7ae (0x5fd8 bytes) 2024-09-21T15:07:20.362 INFO:teuthology.orchestra.run.smithi161.stdout:144 read 0xb50d7f1 thru 0xb515615 (0x7e25 bytes) 2024-09-21T15:07:20.363 INFO:teuthology.orchestra.run.smithi161.stdout:145 write 0xbb45254 thru 0xbb4d966 (0x8713 bytes) 2024-09-21T15:07:20.365 INFO:teuthology.orchestra.run.smithi161.stdout:377 read 0x6ea4af8 thru 0x6eaa7ed (0x5cf6 bytes) 2024-09-21T15:07:20.366 INFO:teuthology.orchestra.run.smithi161.stdout:378 write 0x376ce10 thru 0x376d793 (0x984 bytes) 2024-09-21T15:07:20.380 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.382 INFO:teuthology.orchestra.run.smithi161.stdout:191 writesame 0x842a901 thru 0x842bb5f data_size 0x1(0x125f bytes) 2024-09-21T15:07:20.383 INFO:teuthology.orchestra.run.smithi161.stdout:146 read 0x3770bb2 thru 0x377cb20 (0xbf6f bytes) 2024-09-21T15:07:20.386 INFO:teuthology.orchestra.run.smithi161.stdout:147 write 0x36a769c thru 0x36b49d6 (0xd33b bytes) 2024-09-21T15:07:20.392 INFO:teuthology.orchestra.run.smithi161.stdout:192 write 0x8e4d4df thru 0x8e589bd (0xb4df bytes) 2024-09-21T15:07:20.402 INFO:teuthology.orchestra.run.smithi161.stdout:380 trunc from 0xbf21903 to 0x354292 2024-09-21T15:07:20.457 INFO:teuthology.orchestra.run.smithi161.stdout:227 write 0xdab1f7c thru 0xdab7dd3 (0x5e58 bytes) 2024-09-21T15:07:20.480 INFO:teuthology.orchestra.run.smithi161.stdout:384 write 0x82ad3fb thru 0x82b0dc5 (0x39cb bytes) 2024-09-21T15:07:20.489 INFO:teuthology.orchestra.run.smithi161.stdout:193 read 0xd1fd82 thru 0xd204f1 (0x770 bytes) 2024-09-21T15:07:20.490 INFO:teuthology.orchestra.run.smithi161.stdout:385 trunc from 0x82b0dc6 to 0x7e5745e 2024-09-21T15:07:20.490 INFO:teuthology.orchestra.run.smithi161.stdout:195 write 0x7d08721 thru 0x7d10e83 (0x8763 bytes) 2024-09-21T15:07:20.505 INFO:teuthology.orchestra.run.smithi161.stdout:196 writesame 0x5871897 thru 0x587f294 data_size 0x6(0xd9fe bytes) 2024-09-21T15:07:20.529 INFO:teuthology.orchestra.run.smithi161.stdout:228 read 0x693e8b thru 0x69c38c (0x8502 bytes) 2024-09-21T15:07:20.530 INFO:teuthology.orchestra.run.smithi161.stdout:229 writesame 0xf4702c thru 0xf487b7 data_size 0x16(0x178c bytes) 2024-09-21T15:07:20.538 INFO:teuthology.orchestra.run.smithi161.stdout:230 punch from 0xa71c94f to 0xa71f035, (0x26e6 bytes) 2024-09-21T15:07:20.538 INFO:teuthology.orchestra.run.smithi161.stdout:231 read 0x2a781fc thru 0x2a8482d (0xc632 bytes) 2024-09-21T15:07:20.539 INFO:teuthology.orchestra.run.smithi161.stdout:232 write 0xd92130d thru 0xd92bd7c (0xaa70 bytes) 2024-09-21T15:07:20.550 INFO:teuthology.orchestra.run.smithi161.stdout:388 write 0x8472a8f thru 0x8473e04 (0x1376 bytes) 2024-09-21T15:07:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.567 INFO:teuthology.orchestra.run.smithi161.stdout:197 writesame 0x85a723d thru 0x85b4cab data_size 0x1(0xda6f bytes) 2024-09-21T15:07:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:394 trunc from 0x8473e05 to 0x3af3b66 2024-09-21T15:07:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:234 punch from 0x96175b9 to 0x96204c7, (0x8f0e bytes) 2024-09-21T15:07:20.586 INFO:teuthology.orchestra.run.smithi161.stdout:148 read 0x651b3a1 thru 0x652a5fc (0xf25c bytes) 2024-09-21T15:07:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:235 writesame 0x752f2e thru 0x756d55 data_size 0x34(0x3e28 bytes) 2024-09-21T15:07:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:150 write 0xba650ab thru 0xba74f01 (0xfe57 bytes) 2024-09-21T15:07:20.590 INFO:teuthology.orchestra.run.smithi161.stdout:198 write 0x262510d thru 0x262a942 (0x5836 bytes) 2024-09-21T15:07:20.604 INFO:teuthology.orchestra.run.smithi161.stdout:236 write 0x4fd571c thru 0x4fe43ed (0xecd2 bytes) 2024-09-21T15:07:20.622 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xeb71096 2024-09-21T15:07:20.624 INFO:teuthology.orchestra.run.smithi161.stdout:237 trunc from 0xdab7dd4 to 0xeb71096 2024-09-21T15:07:20.626 INFO:teuthology.orchestra.run.smithi161.stdout:151 trunc from 0xe4f27cb to 0xb2baa51 2024-09-21T15:07:20.635 INFO:teuthology.orchestra.run.smithi161.stdout:199 trunc from 0x94a1e08 to 0x318bb28 2024-09-21T15:07:20.646 INFO:teuthology.orchestra.run.smithi161.stdout:239 read 0x66110ed thru 0x6611b2f (0xa43 bytes) 2024-09-21T15:07:20.647 INFO:teuthology.orchestra.run.smithi161.stdout:240 writesame 0xba862c4 thru 0xba8f7f3 data_size 0x70(0x9530 bytes) 2024-09-21T15:07:20.653 INFO:teuthology.orchestra.run.smithi161.stdout:243 write 0x136dd6e thru 0x137ca98 (0xed2b bytes) 2024-09-21T15:07:20.663 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.667 INFO:teuthology.orchestra.run.smithi161.stdout:246 trunc from 0xeb71096 to 0xcc5a7aa 2024-09-21T15:07:20.667 INFO:teuthology.orchestra.run.smithi161.stdout:395 writesame 0x9ca3c14 thru 0x9caddc3 data_size 0x1(0xa1b0 bytes) 2024-09-21T15:07:20.679 INFO:teuthology.orchestra.run.smithi161.stdout:399 read 0x6e6a0b4 thru 0x6e78cde (0xec2b bytes) 2024-09-21T15:07:20.680 INFO:teuthology.orchestra.run.smithi161.stdout:400 read 0x64d5ca5 thru 0x64d8df9 (0x3155 bytes) 2024-09-21T15:07:20.686 INFO:teuthology.orchestra.run.smithi161.stdout:152 punch from 0x3f43001 to 0x3f47820, (0x481f bytes) 2024-09-21T15:07:20.708 INFO:teuthology.orchestra.run.smithi161.stdout:153 trunc from 0xb2baa51 to 0x107cdb 2024-09-21T15:07:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:247 punch from 0x29d5de2 to 0x29dd71a, (0x7938 bytes) 2024-09-21T15:07:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:248 write 0x8549bc5 thru 0x855619c (0xc5d8 bytes) 2024-09-21T15:07:20.722 INFO:teuthology.orchestra.run.smithi161.stdout:402 writesame 0xa20b6e3 thru 0xa218549 data_size 0x67(0xce67 bytes) 2024-09-21T15:07:20.728 INFO:teuthology.orchestra.run.smithi161.stdout:200 trunc from 0x318bb28 to 0x2c4852 2024-09-21T15:07:20.735 INFO:teuthology.orchestra.run.smithi161.stdout:403 punch from 0x77b908b to 0x77c4044, (0xafb9 bytes) 2024-09-21T15:07:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:405 punch from 0x5561926 to 0x556ffcc, (0xe6a6 bytes) 2024-09-21T15:07:20.736 INFO:teuthology.orchestra.run.smithi161.stdout:408 read 0xe2443a thru 0xe32f41 (0xeb08 bytes) 2024-09-21T15:07:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:409 writesame 0x56c0b79 thru 0x56c4bbd data_size 0x1(0x4045 bytes) 2024-09-21T15:07:20.740 INFO:teuthology.orchestra.run.smithi161.stdout:250 read 0x7cc7e3 thru 0x7d69fe (0xa21c bytes) 2024-09-21T15:07:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:251 punch from 0x3e543e3 to 0x3e6263f, (0xe25c bytes) 2024-09-21T15:07:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:252 punch from 0x5aad739 to 0x5abc335, (0xebfc bytes) 2024-09-21T15:07:20.741 INFO:teuthology.orchestra.run.smithi161.stdout:253 writesame 0xae1d8e thru 0xaefebd data_size 0x18(0xe130 bytes) 2024-09-21T15:07:20.754 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.755 INFO:teuthology.orchestra.run.smithi161.stdout:254 punch from 0x1ed735 to 0x1fd339, (0xfc04 bytes) 2024-09-21T15:07:20.756 INFO:teuthology.orchestra.run.smithi161.stdout:257 write 0x3350557 thru 0x335cd6d (0xc817 bytes) 2024-09-21T15:07:20.768 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone3 from 0x816633b (overlap 0x2154743) to 0x6aa7da 2024-09-21T15:07:20.795 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.5-clone1 intact 2024-09-21T15:07:20.808 INFO:teuthology.orchestra.run.smithi161.stdout:411 write 0xb813865 thru 0xb8154ce (0x1c6a bytes) 2024-09-21T15:07:20.817 INFO:teuthology.orchestra.run.smithi161.stdout:413 write 0x69f0fdc thru 0x69f5a0f (0x4a34 bytes) 2024-09-21T15:07:20.820 INFO:teuthology.orchestra.run.smithi161.stdout:258 write 0xd61958c thru 0xd621408 (0x7e7d bytes) 2024-09-21T15:07:20.822 INFO:teuthology.orchestra.run.smithi161.stdout:201 punch from 0x10415f to 0x10b0ea, (0x6f8b bytes) 2024-09-21T15:07:20.824 INFO:teuthology.orchestra.run.smithi161.stdout:154 punch from 0x63a83 to 0x73588, (0xfb05 bytes) 2024-09-21T15:07:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:415 read 0x1b63285 thru 0x1b6e4a2 (0xb21e bytes) 2024-09-21T15:07:20.825 INFO:teuthology.orchestra.run.smithi161.stdout:155 flatten 2024-09-21T15:07:20.837 INFO:teuthology.orchestra.run.smithi161.stdout:259 writesame 0x9c6e5bb thru 0x9c79e0f data_size 0x1(0xb855 bytes) 2024-09-21T15:07:20.848 INFO:teuthology.orchestra.run.smithi161.stdout:416 trunc from 0xb8154cf to 0x593f41 2024-09-21T15:07:20.850 INFO:teuthology.orchestra.run.smithi161.stdout:156 punch from 0xfefa1 to 0x1049d9, (0x5a38 bytes) 2024-09-21T15:07:20.850 INFO:teuthology.orchestra.run.smithi161.stdout:157 read 0xf7f5c thru 0xfa644 (0x26e9 bytes) 2024-09-21T15:07:20.872 INFO:teuthology.orchestra.run.smithi161.stdout:260 read 0x3e9ae28 thru 0x3ea339c (0x8575 bytes) 2024-09-21T15:07:20.876 INFO:teuthology.orchestra.run.smithi161.stdout:261 write 0xe6754e thru 0xe6811f (0xbd2 bytes) 2024-09-21T15:07:20.881 INFO:teuthology.orchestra.run.smithi161.stdout:262 write 0x22f18a5 thru 0x22f3cb8 (0x2414 bytes) 2024-09-21T15:07:20.888 INFO:teuthology.orchestra.run.smithi161.stdout:202 write 0xb8e0439 thru 0xb8ea448 (0xa010 bytes) 2024-09-21T15:07:20.888 INFO:teuthology.orchestra.run.smithi161.stdout:263 write 0x8ee8cd9 thru 0x8eefaba (0x6de2 bytes) 2024-09-21T15:07:20.892 INFO:teuthology.orchestra.run.smithi161.stdout:418 read 0x13d94a thru 0x14771e (0x9dd5 bytes) 2024-09-21T15:07:20.892 INFO:teuthology.orchestra.run.smithi161.stdout:158 write 0x530b7b5 thru 0x531091f (0x516b bytes) 2024-09-21T15:07:20.900 INFO:teuthology.orchestra.run.smithi161.stdout:264 write 0xb530f8a thru 0xb53cd11 (0xbd88 bytes) 2024-09-21T15:07:20.902 INFO:teuthology.orchestra.run.smithi161.stdout:419 trunc from 0x593f41 to 0x455a4a5 2024-09-21T15:07:20.904 INFO:teuthology.orchestra.run.smithi161.stdout:203 read 0x9448cb thru 0x95035d (0xba93 bytes) 2024-09-21T15:07:20.912 INFO:teuthology.orchestra.run.smithi161.stdout:160 read 0x15450d2 thru 0x154eeae (0x9ddd bytes) 2024-09-21T15:07:20.929 INFO:teuthology.orchestra.run.smithi161.stdout:421 read 0x16d5c07 thru 0x16da256 (0x4650 bytes) 2024-09-21T15:07:20.935 INFO:teuthology.orchestra.run.smithi161.stdout:204 write 0xc9dd7fe thru 0xc9deba9 (0x13ac bytes) 2024-09-21T15:07:20.938 INFO:teuthology.orchestra.run.smithi161.stdout:265 trunc from 0xd621409 to 0x3194091 2024-09-21T15:07:20.938 INFO:teuthology.orchestra.run.smithi161.stdout:423 trunc from 0x455a4a5 to 0x84f0058 2024-09-21T15:07:20.940 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #0, image image_cluster1.client.mirror.5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent1 2024-09-21T15:07:20.941 INFO:teuthology.orchestra.run.smithi161.stdout:161 write 0x802e1c9 thru 0x803aaa6 (0xc8de bytes) 2024-09-21T15:07:20.949 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.950 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:20.950 INFO:teuthology.orchestra.run.smithi161.stdout:208 read 0x7888b0d thru 0x78902aa (0x779e bytes) 2024-09-21T15:07:20.962 INFO:teuthology.orchestra.run.smithi161.stdout:209 trunc from 0xc9debaa to 0x650920d 2024-09-21T15:07:20.970 INFO:teuthology.orchestra.run.smithi161.stdout:425 trunc from 0x84f0058 to 0x7c6f4cd 2024-09-21T15:07:20.971 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #2, image image_cluster1.client.mirror.3-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent3 2024-09-21T15:07:20.974 INFO:teuthology.orchestra.run.smithi161.stdout:162 read 0x28b7c8 thru 0x29a585 (0xedbe bytes) 2024-09-21T15:07:20.975 INFO:teuthology.orchestra.run.smithi161.stdout:163 read 0x5c1c8c8 thru 0x5c1f5cf (0x2d08 bytes) 2024-09-21T15:07:20.980 INFO:teuthology.orchestra.run.smithi161.stdout:164 trunc from 0x803aaa7 to 0x59bddfb 2024-09-21T15:07:21.001 INFO:teuthology.orchestra.run.smithi161.stdout:427 read 0x422695f thru 0x42363c0 (0xfa62 bytes) 2024-09-21T15:07:21.002 INFO:teuthology.orchestra.run.smithi161.stdout:428 read 0x490b2f2 thru 0x490f219 (0x3f28 bytes) 2024-09-21T15:07:21.007 INFO:teuthology.orchestra.run.smithi161.stdout:429 trunc from 0x7c6f4cd to 0x56a8ce4 2024-09-21T15:07:21.007 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.013 INFO:teuthology.orchestra.run.smithi161.stdout:105 punch from 0x95e9cf to 0x9601de, (0x180f bytes) 2024-09-21T15:07:21.034 INFO:teuthology.orchestra.run.smithi161.stdout:165 punch from 0x13a4be5 to 0x13a6674, (0x1a8f bytes) 2024-09-21T15:07:21.034 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.035 INFO:teuthology.orchestra.run.smithi161.stdout:266 writesame 0x53ea9b3 thru 0x53eaae7 data_size 0x1(0x135 bytes) 2024-09-21T15:07:21.038 INFO:teuthology.orchestra.run.smithi161.stdout:107 write 0x21d9b09 thru 0x21e4929 (0xae21 bytes) 2024-09-21T15:07:21.050 INFO:teuthology.orchestra.run.smithi161.stdout:430 trunc from 0x56a8ce4 to 0x87ebbf4 2024-09-21T15:07:21.064 INFO:teuthology.orchestra.run.smithi161.stdout:216 write 0xbffe139 thru 0xc0004ca (0x2392 bytes) 2024-09-21T15:07:21.073 INFO:teuthology.orchestra.run.smithi161.stdout:267 write 0x592e846 thru 0x593922f (0xa9ea bytes) 2024-09-21T15:07:21.086 INFO:teuthology.orchestra.run.smithi161.stdout:217 writesame 0x5020c97 thru 0x502a745 data_size 0x1(0x9aaf bytes) 2024-09-21T15:07:21.089 INFO:teuthology.orchestra.run.smithi161.stdout:167 write 0x6aa694d thru 0x6ab659b (0xfc4f bytes) 2024-09-21T15:07:21.093 INFO:teuthology.orchestra.run.smithi161.stdout:268 read 0x2fd5b96 thru 0x2fe3fa8 (0xe413 bytes) 2024-09-21T15:07:21.094 INFO:teuthology.orchestra.run.smithi161.stdout:269 write 0x475f400 thru 0x4762c24 (0x3825 bytes) 2024-09-21T15:07:21.105 INFO:teuthology.orchestra.run.smithi161.stdout:431 write 0x45d512 thru 0x467a4f (0xa53e bytes) 2024-09-21T15:07:21.106 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.106 INFO:teuthology.orchestra.run.smithi161.stdout:272 read 0xdefb9a thru 0xdf97e5 (0x9c4c bytes) 2024-09-21T15:07:21.107 INFO:teuthology.orchestra.run.smithi161.stdout:274 punch from 0x36b46b3 to 0x36b7ff9, (0x3946 bytes) 2024-09-21T15:07:21.115 INFO:teuthology.orchestra.run.smithi161.stdout:218 read 0x67a6c7c thru 0x67b3905 (0xcc8a bytes) 2024-09-21T15:07:21.115 INFO:teuthology.orchestra.run.smithi161.stdout:219 write 0x2aa7ea thru 0x2b30fc (0x8913 bytes) 2024-09-21T15:07:21.116 INFO:teuthology.orchestra.run.smithi161.stdout:275 trunc from 0x5939230 to 0x1b75df8 2024-09-21T15:07:21.123 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.123 INFO:teuthology.orchestra.run.smithi161.stdout:169 write 0xc07003 thru 0xc0b7da (0x47d8 bytes) 2024-09-21T15:07:21.128 INFO:teuthology.orchestra.run.smithi161.stdout:220 write 0x3baf9f1 thru 0x3bbf2c5 (0xf8d5 bytes) 2024-09-21T15:07:21.135 INFO:teuthology.orchestra.run.smithi161.stdout:432 trunc from 0x87ebbf4 to 0x1a837c5 2024-09-21T15:07:21.135 INFO:teuthology.orchestra.run.smithi161.stdout:108 write 0xcda4908 thru 0xcdb4546 (0xfc3f bytes) 2024-09-21T15:07:21.147 INFO:teuthology.orchestra.run.smithi161.stdout:221 read 0x57e194 thru 0x588e22 (0xac8f bytes) 2024-09-21T15:07:21.148 INFO:teuthology.orchestra.run.smithi161.stdout:225 read 0x9c0f9e2 thru 0x9c13746 (0x3d65 bytes) 2024-09-21T15:07:21.148 INFO:teuthology.orchestra.run.smithi161.stdout:226 writesame 0x3831fc6 thru 0x383cc72 data_size 0x15(0xacad bytes) 2024-09-21T15:07:21.148 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.151 INFO:teuthology.orchestra.run.smithi161.stdout:171 trunc from 0x6ab659c to 0x58a21dc 2024-09-21T15:07:21.158 INFO:teuthology.orchestra.run.smithi161.stdout:109 trunc from 0xcdb4547 to 0xa72d6c1 2024-09-21T15:07:21.161 INFO:teuthology.orchestra.run.smithi161.stdout:276 read 0xa2dc0b thru 0xa37f04 (0xa2fa bytes) 2024-09-21T15:07:21.162 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.166 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.166 INFO:teuthology.orchestra.run.smithi161.stdout:229 read 0xb9dae20 thru 0xb9e9d97 (0xef78 bytes) 2024-09-21T15:07:21.176 INFO:teuthology.orchestra.run.smithi161.stdout:230 trunc from 0xc0004cb to 0x7b8b0df 2024-09-21T15:07:21.178 INFO:teuthology.orchestra.run.smithi161.stdout:278 trunc from 0x1b75df8 to 0x88b9903 2024-09-21T15:07:21.180 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.201 INFO:teuthology.orchestra.run.smithi161.stdout:111 read 0x572ad9f thru 0x57346f3 (0x9955 bytes) 2024-09-21T15:07:21.202 INFO:teuthology.orchestra.run.smithi161.stdout:172 read 0x3f8f9db thru 0x3f98e3a (0x9460 bytes) 2024-09-21T15:07:21.202 INFO:teuthology.orchestra.run.smithi161.stdout:173 read 0x3bb4a26 thru 0x3bbe47a (0x9a55 bytes) 2024-09-21T15:07:21.206 INFO:teuthology.orchestra.run.smithi161.stdout:279 read 0x65d5d0b thru 0x65e163b (0xb931 bytes) 2024-09-21T15:07:21.207 INFO:teuthology.orchestra.run.smithi161.stdout:281 writesame 0x5997745 thru 0x5999fe9 data_size 0x1(0x28a5 bytes) 2024-09-21T15:07:21.211 INFO:teuthology.orchestra.run.smithi161.stdout:112 trunc from 0xa72d6c1 to 0x5ef9d8f 2024-09-21T15:07:21.212 INFO:teuthology.orchestra.run.smithi161.stdout:175 trunc from 0x58a21dc to 0x3d75ea 2024-09-21T15:07:21.221 INFO:teuthology.orchestra.run.smithi161.stdout:434 writesame 0x9ae121a thru 0x9ae3573 data_size 0xa(0x235a bytes) 2024-09-21T15:07:21.228 INFO:teuthology.orchestra.run.smithi161.stdout:436 read 0x4917e1a thru 0x49219eb (0x9bd2 bytes) 2024-09-21T15:07:21.229 INFO:teuthology.orchestra.run.smithi161.stdout:437 punch from 0x575e5cd to 0x57636ea, (0x511d bytes) 2024-09-21T15:07:21.229 INFO:teuthology.orchestra.run.smithi161.stdout:231 read 0x33e00be thru 0x33e8ebc (0x8dff bytes) 2024-09-21T15:07:21.229 INFO:teuthology.orchestra.run.smithi161.stdout:439 read 0x7b58a50 thru 0x7b5da22 (0x4fd3 bytes) 2024-09-21T15:07:21.230 INFO:teuthology.orchestra.run.smithi161.stdout:232 read 0x191b304 thru 0x1927544 (0xc241 bytes) 2024-09-21T15:07:21.230 INFO:teuthology.orchestra.run.smithi161.stdout:234 read 0x6fa9f70 thru 0x6fae21a (0x42ab bytes) 2024-09-21T15:07:21.230 INFO:teuthology.orchestra.run.smithi161.stdout:441 writesame 0x21fa397 thru 0x220156e data_size 0x4(0x71d8 bytes) 2024-09-21T15:07:21.238 INFO:teuthology.orchestra.run.smithi161.stdout:282 trunc from 0x88b9903 to 0xd1b03be 2024-09-21T15:07:21.249 INFO:teuthology.orchestra.run.smithi161.stdout:442 trunc from 0x9ae3574 to 0xcd24753 2024-09-21T15:07:21.335 INFO:teuthology.orchestra.run.smithi161.stdout:283 write 0x110d3e thru 0x1179d9 (0x6c9c bytes) 2024-09-21T15:07:21.336 INFO:teuthology.orchestra.run.smithi161.stdout:235 write 0xce07d85 thru 0xce0f611 (0x788d bytes) 2024-09-21T15:07:21.343 INFO:teuthology.orchestra.run.smithi161.stdout:284 punch from 0x3c9bb87 to 0x3c9d1ab, (0x1624 bytes) 2024-09-21T15:07:21.350 INFO:teuthology.orchestra.run.smithi161.stdout:443 writesame 0x4170ae7 thru 0x4175cf0 data_size 0x1(0x520a bytes) 2024-09-21T15:07:21.352 INFO:teuthology.orchestra.run.smithi161.stdout:286 trunc from 0xd1b03be to 0x7f29834 2024-09-21T15:07:21.360 INFO:teuthology.orchestra.run.smithi161.stdout:178 writesame 0xcf5a776 thru 0xcf657b4 data_size 0x1(0xb03f bytes) 2024-09-21T15:07:21.373 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.374 INFO:teuthology.orchestra.run.smithi161.stdout:447 writesame 0xc2bb6ed thru 0xc2bd50c data_size 0x8(0x1e20 bytes) 2024-09-21T15:07:21.374 INFO:teuthology.orchestra.run.smithi161.stdout:237 read 0x5d3ad8 thru 0x5dd412 (0x993b bytes) 2024-09-21T15:07:21.374 INFO:teuthology.orchestra.run.smithi161.stdout:238 read 0x4b7b93f thru 0x4b890b5 (0xd777 bytes) 2024-09-21T15:07:21.375 INFO:teuthology.orchestra.run.smithi161.stdout:239 write 0x2c06377 thru 0x2c158cd (0xf557 bytes) 2024-09-21T15:07:21.381 INFO:teuthology.orchestra.run.smithi161.stdout:448 read 0xb32c421 thru 0xb32fe9b (0x3a7b bytes) 2024-09-21T15:07:21.382 INFO:teuthology.orchestra.run.smithi161.stdout:450 writesame 0x85b987f thru 0x85c5c99 data_size 0x1(0xc41b bytes) 2024-09-21T15:07:21.384 INFO:teuthology.orchestra.run.smithi161.stdout:179 trunc from 0xcf657b5 to 0x4ef8f16 2024-09-21T15:07:21.390 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.390 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.390 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.390 INFO:teuthology.orchestra.run.smithi161.stdout:291 read 0x63dd96b thru 0x63e6442 (0x8ad8 bytes) 2024-09-21T15:07:21.391 INFO:teuthology.orchestra.run.smithi161.stdout:113 writesame 0xe38554 thru 0xe4397a data_size 0x1(0xb427 bytes) 2024-09-21T15:07:21.395 INFO:teuthology.orchestra.run.smithi161.stdout:293 trunc from 0x7f29834 to 0xb274f3f 2024-09-21T15:07:21.412 INFO:teuthology.orchestra.run.smithi161.stdout:241 read 0xb3b0868 thru 0xb3b9f12 (0x96ab bytes) 2024-09-21T15:07:21.424 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.424 INFO:teuthology.orchestra.run.smithi161.stdout:181 punch from 0x4b6d1a6 to 0x4b745a3, (0x73fd bytes) 2024-09-21T15:07:21.424 INFO:teuthology.orchestra.run.smithi161.stdout:182 punch from 0x22765fa to 0x2284b48, (0xe54e bytes) 2024-09-21T15:07:21.424 INFO:teuthology.orchestra.run.smithi161.stdout:184 write 0x295a8f9 thru 0x296879d (0xdea5 bytes) 2024-09-21T15:07:21.432 INFO:teuthology.orchestra.run.smithi161.stdout:298 read 0x9612676 thru 0x961ac36 (0x85c1 bytes) 2024-09-21T15:07:21.434 INFO:teuthology.orchestra.run.smithi161.stdout:452 trunc from 0xcd24753 to 0x2445e57 2024-09-21T15:07:21.440 INFO:teuthology.orchestra.run.smithi161.stdout:242 trunc from 0xce0f612 to 0x154cf10 2024-09-21T15:07:21.450 INFO:teuthology.orchestra.run.smithi161.stdout:299 trunc from 0xb274f3f to 0x1bb548b 2024-09-21T15:07:21.452 INFO:teuthology.orchestra.run.smithi161.stdout:185 read 0xae095c thru 0xae58a5 (0x4f4a bytes) 2024-09-21T15:07:21.457 INFO:teuthology.orchestra.run.smithi161.stdout:186 trunc from 0x4ef8f16 to 0x80f176b 2024-09-21T15:07:21.465 INFO:teuthology.orchestra.run.smithi161.stdout:114 write 0x82a42ef thru 0x82a8d06 (0x4a18 bytes) 2024-09-21T15:07:21.475 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.475 INFO:teuthology.orchestra.run.smithi161.stdout:116 write 0x61ca6c9 thru 0x61cd4ab (0x2de3 bytes) 2024-09-21T15:07:21.480 INFO:teuthology.orchestra.run.smithi161.stdout:98 writesame 0xa3cc97d thru 0xa3d677e data_size 0x19(0x9e02 bytes) 2024-09-21T15:07:21.488 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.489 INFO:teuthology.orchestra.run.smithi161.stdout:118 writesame 0x4a366e2 thru 0x4a3b010 data_size 0x5(0x492f bytes) 2024-09-21T15:07:21.489 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.489 INFO:teuthology.orchestra.run.smithi161.stdout:101 read 0x95e765c thru 0x95f440c (0xcdb1 bytes) 2024-09-21T15:07:21.489 INFO:teuthology.orchestra.run.smithi161.stdout:102 read 0x45023b3 thru 0x4502e06 (0xa54 bytes) 2024-09-21T15:07:21.489 INFO:teuthology.orchestra.run.smithi161.stdout:103 read 0x8f41f00 thru 0x8f43539 (0x163a bytes) 2024-09-21T15:07:21.489 INFO:teuthology.orchestra.run.smithi161.stdout:105 writesame 0x3e33cd1 thru 0x3e39141 data_size 0x1(0x5471 bytes) 2024-09-21T15:07:21.502 INFO:teuthology.orchestra.run.smithi161.stdout:119 write 0x3426939 thru 0x3427096 (0x75e bytes) 2024-09-21T15:07:21.505 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.506 INFO:teuthology.orchestra.run.smithi161.stdout:300 read 0x8cf7f0 thru 0x8dc0b9 (0xc8ca bytes) 2024-09-21T15:07:21.507 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.507 INFO:teuthology.orchestra.run.smithi161.stdout:302 punch from 0x121fc9a to 0x1220fd0, (0x1336 bytes) 2024-09-21T15:07:21.507 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.507 INFO:teuthology.orchestra.run.smithi161.stdout:304 punch from 0x8ca323 to 0x8cf90c, (0x55e9 bytes) 2024-09-21T15:07:21.507 INFO:teuthology.orchestra.run.smithi161.stdout:305 read 0xd5f410 thru 0xd66c70 (0x7861 bytes) 2024-09-21T15:07:21.512 INFO:teuthology.orchestra.run.smithi161.stdout:306 trunc from 0x1bb548b to 0x366400a 2024-09-21T15:07:21.517 INFO:teuthology.orchestra.run.smithi161.stdout:120 trunc from 0x82a8d07 to 0x91ef220 2024-09-21T15:07:21.521 INFO:teuthology.orchestra.run.smithi161.stdout:106 trunc from 0xa3d677f to 0xa2f2f12 2024-09-21T15:07:21.527 INFO:teuthology.orchestra.run.smithi161.stdout:453 write 0x5333a0f thru 0x533c17d (0x876f bytes) 2024-09-21T15:07:21.537 INFO:teuthology.orchestra.run.smithi161.stdout:454 read 0x3a7f6db thru 0x3a843c3 (0x4ce9 bytes) 2024-09-21T15:07:21.544 INFO:teuthology.orchestra.run.smithi161.stdout:189 writesame 0xbe323a2 thru 0xbe373bd data_size 0x6(0x501c bytes) 2024-09-21T15:07:21.544 INFO:teuthology.orchestra.run.smithi161.stdout:308 read 0x2cf6bd2 thru 0x2cfb446 (0x4875 bytes) 2024-09-21T15:07:21.550 INFO:teuthology.orchestra.run.smithi161.stdout:456 trunc from 0x533c17e to 0xa12ede8 2024-09-21T15:07:21.550 INFO:teuthology.orchestra.run.smithi161.stdout:243 write 0x4d201be thru 0x4d229be (0x2801 bytes) 2024-09-21T15:07:21.556 INFO:teuthology.orchestra.run.smithi161.stdout:107 trunc from 0xa2f2f12 to 0x8801e3c 2024-09-21T15:07:21.558 INFO:teuthology.orchestra.run.smithi161.stdout:309 trunc from 0x366400a to 0x7d8da47 2024-09-21T15:07:21.561 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.561 INFO:teuthology.orchestra.run.smithi161.stdout:247 punch from 0x367c100 to 0x367f7ac, (0x36ac bytes) 2024-09-21T15:07:21.567 INFO:teuthology.orchestra.run.smithi161.stdout:248 trunc from 0x4d229bf to 0x1030b0c 2024-09-21T15:07:21.571 INFO:teuthology.orchestra.run.smithi161.stdout:122 write 0x9d696da thru 0x9d70933 (0x725a bytes) 2024-09-21T15:07:21.577 INFO:teuthology.orchestra.run.smithi161.stdout:457 punch from 0x5096f4a to 0x5099e85, (0x2f3b bytes) 2024-09-21T15:07:21.577 INFO:teuthology.orchestra.run.smithi161.stdout:109 write 0x4c410b4 thru 0x4c428ca (0x1817 bytes) 2024-09-21T15:07:21.577 INFO:teuthology.orchestra.run.smithi161.stdout:460 read 0x3cac2f1 thru 0x3cbb978 (0xf688 bytes) 2024-09-21T15:07:21.578 INFO:teuthology.orchestra.run.smithi161.stdout:461 punch from 0x556c460 to 0x5579dc3, (0xd963 bytes) 2024-09-21T15:07:21.578 INFO:teuthology.orchestra.run.smithi161.stdout:462 write 0x86366d6 thru 0x86392e5 (0x2c10 bytes) 2024-09-21T15:07:21.581 INFO:teuthology.orchestra.run.smithi161.stdout:190 write 0xda275b4 thru 0xda289d6 (0x1423 bytes) 2024-09-21T15:07:21.583 INFO:teuthology.orchestra.run.smithi161.stdout:311 writesame 0x687c2ab thru 0x687d216 data_size 0x2a(0xf6c bytes) 2024-09-21T15:07:21.586 INFO:teuthology.orchestra.run.smithi161.stdout:463 write 0x3593fd thru 0x368ae6 (0xf6ea bytes) 2024-09-21T15:07:21.590 INFO:teuthology.orchestra.run.smithi161.stdout:123 writesame 0x66e2158 thru 0x66ef1d1 data_size 0x2d(0xd07a bytes) 2024-09-21T15:07:21.595 INFO:teuthology.orchestra.run.smithi161.stdout:191 read 0x98242a thru 0x9832c1 (0xe98 bytes) 2024-09-21T15:07:21.595 INFO:teuthology.orchestra.run.smithi161.stdout:192 read 0x57cf29 thru 0x586d1d (0x9df5 bytes) 2024-09-21T15:07:21.596 INFO:teuthology.orchestra.run.smithi161.stdout:464 read 0x5f1adb5 thru 0x5f1c6be (0x190a bytes) 2024-09-21T15:07:21.596 INFO:teuthology.orchestra.run.smithi161.stdout:466 read 0x2166a73 thru 0x216cb17 (0x60a5 bytes) 2024-09-21T15:07:21.597 INFO:teuthology.orchestra.run.smithi161.stdout:124 read 0x1707fc thru 0x17d12d (0xc932 bytes) 2024-09-21T15:07:21.597 INFO:teuthology.orchestra.run.smithi161.stdout:125 read 0x8f38c9e thru 0x8f3c54b (0x38ae bytes) 2024-09-21T15:07:21.598 INFO:teuthology.orchestra.run.smithi161.stdout:127 write 0x85a82f thru 0x868704 (0xded6 bytes) 2024-09-21T15:07:21.604 INFO:teuthology.orchestra.run.smithi161.stdout:468 trunc from 0xa12ede8 to 0x7577338 2024-09-21T15:07:21.607 INFO:teuthology.orchestra.run.smithi161.stdout:312 trunc from 0x7d8da47 to 0x2b2e096 2024-09-21T15:07:21.608 INFO:teuthology.orchestra.run.smithi161.stdout:128 write 0x343b1c1 thru 0x344a31a (0xf15a bytes) 2024-09-21T15:07:21.609 INFO:teuthology.orchestra.run.smithi161.stdout:249 punch from 0x6f52f9 to 0x6f8f7e, (0x3c85 bytes) 2024-09-21T15:07:21.609 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.621 INFO:teuthology.orchestra.run.smithi161.stdout:129 read 0x1032292 thru 0x103949f (0x720e bytes) 2024-09-21T15:07:21.622 INFO:teuthology.orchestra.run.smithi161.stdout:130 read 0x86d7d4c thru 0x86e0beb (0x8ea0 bytes) 2024-09-21T15:07:21.624 INFO:teuthology.orchestra.run.smithi161.stdout:132 writesame 0x8c11cb5 thru 0x8c1232e data_size 0x1(0x67a bytes) 2024-09-21T15:07:21.632 INFO:teuthology.orchestra.run.smithi161.stdout:133 read 0x5967ace thru 0x597750a (0xfa3d bytes) 2024-09-21T15:07:21.633 INFO:teuthology.orchestra.run.smithi161.stdout:194 writesame 0xe19a4fb thru 0xe1a88d1 data_size 0x2f(0xe3d7 bytes) 2024-09-21T15:07:21.633 INFO:teuthology.orchestra.run.smithi161.stdout:134 write 0x69c3351 thru 0x69cdda3 (0xaa53 bytes) 2024-09-21T15:07:21.636 INFO:teuthology.orchestra.run.smithi161.stdout:195 writesame 0xbfdcfea thru 0xbfe3aa9 data_size 0x40(0x6ac0 bytes) 2024-09-21T15:07:21.640 INFO:teuthology.orchestra.run.smithi161.stdout:110 write 0xbee2205 thru 0xbee9658 (0x7454 bytes) 2024-09-21T15:07:21.642 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.642 INFO:teuthology.orchestra.run.smithi161.stdout:139 write 0x2cdbc8b thru 0x2ceb553 (0xf8c9 bytes) 2024-09-21T15:07:21.650 INFO:teuthology.orchestra.run.smithi161.stdout:313 punch from 0x1a64e4d to 0x1a6dab0, (0x8c63 bytes) 2024-09-21T15:07:21.654 INFO:teuthology.orchestra.run.smithi161.stdout:252 writesame 0x12e7b40 thru 0x12eee24 data_size 0x1(0x72e5 bytes) 2024-09-21T15:07:21.654 INFO:teuthology.orchestra.run.smithi161.stdout:111 clone 3 order 21 su 1048576 sc 10 2024-09-21T15:07:21.656 INFO:teuthology.orchestra.run.smithi161.stdout:140 write 0x573de78 thru 0x574462e (0x67b7 bytes) 2024-09-21T15:07:21.657 INFO:teuthology.orchestra.run.smithi161.stdout:196 write 0xc8a688c thru 0xc8b1510 (0xac85 bytes) 2024-09-21T15:07:21.657 INFO:teuthology.orchestra.run.smithi161.stdout:254 punch from 0x3f3593 to 0x402138, (0xeba5 bytes) 2024-09-21T15:07:21.676 INFO:teuthology.orchestra.run.smithi161.stdout:469 write 0x94486a7 thru 0x9452269 (0x9bc3 bytes) 2024-09-21T15:07:21.681 INFO:teuthology.orchestra.run.smithi161.stdout:197 read 0x5bf6e2b thru 0x5bfd6c5 (0x689b bytes) 2024-09-21T15:07:21.682 INFO:teuthology.orchestra.run.smithi161.stdout:198 writesame 0x71a4a7f thru 0x71ab5c6 data_size 0x4(0x6b48 bytes) 2024-09-21T15:07:21.691 INFO:teuthology.orchestra.run.smithi161.stdout:470 trunc from 0x945226a to 0xa93cc8d 2024-09-21T15:07:21.693 INFO:teuthology.orchestra.run.smithi161.stdout:314 writesame 0xabbeefa thru 0xabcc97f data_size 0x53(0xda86 bytes) 2024-09-21T15:07:21.697 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.698 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.698 INFO:teuthology.orchestra.run.smithi161.stdout:320 punch from 0xa85ae9f to 0xa862b9d, (0x7cfe bytes) 2024-09-21T15:07:21.698 INFO:teuthology.orchestra.run.smithi161.stdout:321 punch from 0x1213ca6 to 0x12190dc, (0x5436 bytes) 2024-09-21T15:07:21.698 INFO:teuthology.orchestra.run.smithi161.stdout:324 write 0x46df60a thru 0x46e2d12 (0x3709 bytes) 2024-09-21T15:07:21.703 INFO:teuthology.orchestra.run.smithi161.stdout:199 read 0x162df60 thru 0x1637871 (0x9912 bytes) 2024-09-21T15:07:21.703 INFO:teuthology.orchestra.run.smithi161.stdout:141 write 0xc84fd5e thru 0xc85d7b3 (0xda56 bytes) 2024-09-21T15:07:21.706 INFO:teuthology.orchestra.run.smithi161.stdout:200 trunc from 0xe1a88d2 to 0xc993a21 2024-09-21T15:07:21.709 INFO:teuthology.orchestra.run.smithi161.stdout:255 writesame 0x7fe2ebc thru 0x7fe6a08 data_size 0x13(0x3b4d bytes) 2024-09-21T15:07:21.712 INFO:teuthology.orchestra.run.smithi161.stdout:257 punch from 0x1bde0a4 to 0x1bea261, (0xc1bd bytes) 2024-09-21T15:07:21.712 INFO:teuthology.orchestra.run.smithi161.stdout:258 read 0x15d49c8 thru 0x15dfc08 (0xb241 bytes) 2024-09-21T15:07:21.712 INFO:teuthology.orchestra.run.smithi161.stdout:259 punch from 0x5a45ee6 to 0x5a4d84d, (0x7967 bytes) 2024-09-21T15:07:21.712 INFO:teuthology.orchestra.run.smithi161.stdout:260 punch from 0x34ab2b7 to 0x34b8c18, (0xd961 bytes) 2024-09-21T15:07:21.713 INFO:teuthology.orchestra.run.smithi161.stdout:261 write 0x21c1ab1 thru 0x21c4752 (0x2ca2 bytes) 2024-09-21T15:07:21.721 INFO:teuthology.orchestra.run.smithi161.stdout:142 read 0x714bf68 thru 0x715432c (0x83c5 bytes) 2024-09-21T15:07:21.722 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.722 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.722 INFO:teuthology.orchestra.run.smithi161.stdout:146 read 0x8d259ad thru 0x8d301c4 (0xa818 bytes) 2024-09-21T15:07:21.723 INFO:teuthology.orchestra.run.smithi161.stdout:148 punch from 0x54185cc to 0x5421803, (0x9237 bytes) 2024-09-21T15:07:21.723 INFO:teuthology.orchestra.run.smithi161.stdout:149 punch from 0x5ff246c to 0x5ffae9b, (0x8a2f bytes) 2024-09-21T15:07:21.723 INFO:teuthology.orchestra.run.smithi161.stdout:150 write 0x3251ef5 thru 0x325f623 (0xd72f bytes) 2024-09-21T15:07:21.724 INFO:teuthology.orchestra.run.smithi161.stdout:472 punch from 0xa7d8f67 to 0xa7d9262, (0x2fb bytes) 2024-09-21T15:07:21.724 INFO:teuthology.orchestra.run.smithi161.stdout:473 read 0x993f4ba thru 0x993ffb3 (0xafa bytes) 2024-09-21T15:07:21.725 INFO:teuthology.orchestra.run.smithi161.stdout:474 read 0x5bc11 thru 0x5f231 (0x3621 bytes) 2024-09-21T15:07:21.726 INFO:teuthology.orchestra.run.smithi161.stdout:475 punch from 0x7169aee to 0x71710cc, (0x75de bytes) 2024-09-21T15:07:21.726 INFO:teuthology.orchestra.run.smithi161.stdout:477 read 0xa5e05b3 thru 0xa5e6e4b (0x6899 bytes) 2024-09-21T15:07:21.727 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.727 INFO:teuthology.orchestra.run.smithi161.stdout:480 write 0x38296ec thru 0x38388ef (0xf204 bytes) 2024-09-21T15:07:21.730 INFO:teuthology.orchestra.run.smithi161.stdout:263 read 0x10e5e2e thru 0x10ea20c (0x43df bytes) 2024-09-21T15:07:21.730 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.731 INFO:teuthology.orchestra.run.smithi161.stdout:265 write 0x40d54cb thru 0x40de0d6 (0x8c0c bytes) 2024-09-21T15:07:21.733 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.733 INFO:teuthology.orchestra.run.smithi161.stdout:152 write 0x2635755 thru 0x263f139 (0x99e5 bytes) 2024-09-21T15:07:21.745 INFO:teuthology.orchestra.run.smithi161.stdout:481 punch from 0x3c17fa0 to 0x3c227bd, (0xa81d bytes) 2024-09-21T15:07:21.745 INFO:teuthology.orchestra.run.smithi161.stdout:482 writesame 0x4486945 thru 0x448abba data_size 0x2f(0x4276 bytes) 2024-09-21T15:07:21.746 INFO:teuthology.orchestra.run.smithi161.stdout:153 read 0x67b50f thru 0x67f49d (0x3f8f bytes) 2024-09-21T15:07:21.747 INFO:teuthology.orchestra.run.smithi161.stdout:154 writesame 0x821fc7a thru 0x822d875 data_size 0x9c(0xdbfc bytes) 2024-09-21T15:07:21.753 INFO:teuthology.orchestra.run.smithi161.stdout:325 write 0xe6686cf thru 0xe669b18 (0x144a bytes) 2024-09-21T15:07:21.757 INFO:teuthology.orchestra.run.smithi161.stdout:483 writesame 0x46cb89d thru 0x46d7ad6 data_size 0x3(0xc23a bytes) 2024-09-21T15:07:21.759 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.760 INFO:teuthology.orchestra.run.smithi161.stdout:156 write 0x8103bed thru 0x810ea08 (0xae1c bytes) 2024-09-21T15:07:21.763 INFO:teuthology.orchestra.run.smithi161.stdout:328 write 0xb258176 thru 0xb263b42 (0xb9cd bytes) 2024-09-21T15:07:21.771 INFO:teuthology.orchestra.run.smithi161.stdout:158 write 0x21693d8 thru 0x21779ab (0xe5d4 bytes) 2024-09-21T15:07:21.771 INFO:teuthology.orchestra.run.smithi161.stdout:485 read 0x48c594f thru 0x48c6279 (0x92b bytes) 2024-09-21T15:07:21.772 INFO:teuthology.orchestra.run.smithi161.stdout:486 read 0x277ae6c thru 0x27835fd (0x8792 bytes) 2024-09-21T15:07:21.773 INFO:teuthology.orchestra.run.smithi161.stdout:487 punch from 0x29f594a to 0x29fc736, (0x6dec bytes) 2024-09-21T15:07:21.773 INFO:teuthology.orchestra.run.smithi161.stdout:490 write 0x14c8d0a thru 0x14c9f3d (0x1234 bytes) 2024-09-21T15:07:21.774 INFO:teuthology.orchestra.run.smithi161.stdout:329 write 0x59de619 thru 0x59deddf (0x7c7 bytes) 2024-09-21T15:07:21.783 INFO:teuthology.orchestra.run.smithi161.stdout:492 write 0x99cb758 thru 0x99cf20d (0x3ab6 bytes) 2024-09-21T15:07:21.783 INFO:teuthology.orchestra.run.smithi161.stdout:160 read 0x50174e0 thru 0x502492b (0xd44c bytes) 2024-09-21T15:07:21.784 INFO:teuthology.orchestra.run.smithi161.stdout:161 read 0x1f6f830 thru 0x1f7e0d5 (0xe8a6 bytes) 2024-09-21T15:07:21.785 INFO:teuthology.orchestra.run.smithi161.stdout:162 read 0x1fc2d03 thru 0x1fc53f9 (0x26f7 bytes) 2024-09-21T15:07:21.785 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.791 INFO:teuthology.orchestra.run.smithi161.stdout:493 read 0x8f8f16a thru 0x8f9c5cc (0xd463 bytes) 2024-09-21T15:07:21.791 INFO:teuthology.orchestra.run.smithi161.stdout:330 punch from 0x34addf to 0x34b34d, (0x56e bytes) 2024-09-21T15:07:21.792 INFO:teuthology.orchestra.run.smithi161.stdout:331 write 0xc56c25a thru 0xc577bd1 (0xb978 bytes) 2024-09-21T15:07:21.798 INFO:teuthology.orchestra.run.smithi161.stdout:266 write 0xb1f8717 thru 0xb1fcccc (0x45b6 bytes) 2024-09-21T15:07:21.799 INFO:teuthology.orchestra.run.smithi161.stdout:495 trunc from 0xa93cc8d to 0xdd4fd11 2024-09-21T15:07:21.805 INFO:teuthology.orchestra.run.smithi161.stdout:201 write 0xe849b54 thru 0xe850b34 (0x6fe1 bytes) 2024-09-21T15:07:21.810 INFO:teuthology.orchestra.run.smithi161.stdout:165 trunc from 0xc85d7b4 to 0x740b12 2024-09-21T15:07:21.811 INFO:teuthology.orchestra.run.smithi161.stdout:336 trunc from 0xe669b19 to 0xb257c91 2024-09-21T15:07:21.811 INFO:teuthology.orchestra.run.smithi161.stdout:267 read 0x3bc65b1 thru 0x3bcd940 (0x7390 bytes) 2024-09-21T15:07:21.820 INFO:teuthology.orchestra.run.smithi161.stdout:268 trunc from 0xb1fcccd to 0x5d0e7f1 2024-09-21T15:07:21.826 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.827 INFO:teuthology.orchestra.run.smithi161.stdout:204 write 0xda82dea thru 0xda8bbb2 (0x8dc9 bytes) 2024-09-21T15:07:21.833 INFO:teuthology.orchestra.run.smithi161.stdout:496 write 0xcf2abb2 thru 0xcf38a6d (0xdebc bytes) 2024-09-21T15:07:21.851 INFO:teuthology.orchestra.run.smithi161.stdout:337 read 0x986eb5b thru 0x9877b78 (0x901e bytes) 2024-09-21T15:07:21.851 INFO:teuthology.orchestra.run.smithi161.stdout:339 read 0x37511e0 thru 0x375f48c (0xe2ad bytes) 2024-09-21T15:07:21.851 INFO:teuthology.orchestra.run.smithi161.stdout:340 writesame 0x5397d40 thru 0x539c733 data_size 0x2(0x49f4 bytes) 2024-09-21T15:07:21.854 INFO:teuthology.orchestra.run.smithi161.stdout:206 punch from 0xd4e8eec to 0xd4f5049, (0xc15d bytes) 2024-09-21T15:07:21.854 INFO:teuthology.orchestra.run.smithi161.stdout:207 read 0xace4ba thru 0xad50e5 (0x6c2c bytes) 2024-09-21T15:07:21.855 INFO:teuthology.orchestra.run.smithi161.stdout:497 punch from 0x88dde45 to 0x88ed34f, (0xf50a bytes) 2024-09-21T15:07:21.855 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.855 INFO:teuthology.orchestra.run.smithi161.stdout:500 punch from 0x57df0e5 to 0x57e265a, (0x3575 bytes) 2024-09-21T15:07:21.855 INFO:teuthology.orchestra.run.smithi161.stdout:501 read 0x8e951bc thru 0x8e96cf6 (0x1b3b bytes) 2024-09-21T15:07:21.855 INFO:teuthology.orchestra.run.smithi161.stdout:505 write 0x2657bf4 thru 0x265e356 (0x6763 bytes) 2024-09-21T15:07:21.861 INFO:teuthology.orchestra.run.smithi161.stdout:506 read 0xa0ef0f2 thru 0xa0f383b (0x474a bytes) 2024-09-21T15:07:21.867 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.867 INFO:teuthology.orchestra.run.smithi161.stdout:343 punch from 0x78564ad to 0x785cd1f, (0x6872 bytes) 2024-09-21T15:07:21.867 INFO:teuthology.orchestra.run.smithi161.stdout:344 writesame 0x36d9111 thru 0x36dde62 data_size 0x3(0x4d52 bytes) 2024-09-21T15:07:21.868 INFO:teuthology.orchestra.run.smithi161.stdout:208 trunc from 0xe850b35 to 0xa05f4ca 2024-09-21T15:07:21.872 INFO:teuthology.orchestra.run.smithi161.stdout:507 trunc from 0xdd4fd11 to 0xa5076ba 2024-09-21T15:07:21.911 INFO:teuthology.orchestra.run.smithi161.stdout:270 writesame 0x69fc247 thru 0x6a05005 data_size 0x1(0x8dbf bytes) 2024-09-21T15:07:21.912 INFO:teuthology.orchestra.run.smithi161.stdout:166 write 0x8627116 thru 0x8629432 (0x231d bytes) 2024-09-21T15:07:21.915 INFO:teuthology.orchestra.run.smithi161.stdout:345 writesame 0xbc0dbd4 thru 0xbc15d28 data_size 0x1(0x8155 bytes) 2024-09-21T15:07:21.920 INFO:teuthology.orchestra.run.smithi161.stdout:508 trunc from 0xa5076ba to 0x86ff823 2024-09-21T15:07:21.920 INFO:teuthology.orchestra.run.smithi161.stdout:346 punch from 0x69f94c7 to 0x6a07448, (0xdf81 bytes) 2024-09-21T15:07:21.921 INFO:teuthology.orchestra.run.smithi161.stdout:347 writesame 0x46b2b28 thru 0x46ba23f data_size 0x25(0x7718 bytes) 2024-09-21T15:07:21.924 INFO:teuthology.orchestra.run.smithi161.stdout:168 read 0x4745a52 thru 0x4746214 (0x7c3 bytes) 2024-09-21T15:07:21.924 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.924 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.931 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.931 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.931 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:21.931 INFO:teuthology.orchestra.run.smithi161.stdout:352 writesame 0x103c174 thru 0x1049644 data_size 0x2b(0xd4d1 bytes) 2024-09-21T15:07:21.933 INFO:teuthology.orchestra.run.smithi161.stdout:209 punch from 0x98a18a0 to 0x98a1bd3, (0x333 bytes) 2024-09-21T15:07:21.933 INFO:teuthology.orchestra.run.smithi161.stdout:210 writesame 0xa06341 thru 0xa0e43a data_size 0x3(0x80fa bytes) 2024-09-21T15:07:21.951 INFO:teuthology.orchestra.run.smithi161.stdout:353 trunc from 0xbc15d29 to 0xe704802 2024-09-21T15:07:21.963 INFO:teuthology.orchestra.run.smithi161.stdout:509 read 0x56b860 thru 0x5700b6 (0x4857 bytes) 2024-09-21T15:07:21.964 INFO:teuthology.orchestra.run.smithi161.stdout:510 writesame 0x6285a08 thru 0x6292f2b data_size 0x6(0xd524 bytes) 2024-09-21T15:07:21.966 INFO:teuthology.orchestra.run.smithi161.stdout:211 writesame 0x8bfa3b1 thru 0x8c0756c data_size 0x4(0xd1bc bytes) 2024-09-21T15:07:21.969 INFO:teuthology.orchestra.run.smithi161.stdout:171 write 0xd5773b5 thru 0xd57c30b (0x4f57 bytes) 2024-09-21T15:07:21.972 INFO:teuthology.orchestra.run.smithi161.stdout:271 writesame 0xa33e0ed thru 0xa33f511 data_size 0x9(0x1425 bytes) 2024-09-21T15:07:21.975 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xe59153d 2024-09-21T15:07:21.979 INFO:teuthology.orchestra.run.smithi161.stdout:272 read 0x851dde3 thru 0x851fb01 (0x1d1f bytes) 2024-09-21T15:07:21.979 INFO:teuthology.orchestra.run.smithi161.stdout:273 read 0x2bbca31 thru 0x2bbf823 (0x2df3 bytes) 2024-09-21T15:07:21.979 INFO:teuthology.orchestra.run.smithi161.stdout:274 read 0x8b75a7a thru 0x8b80e87 (0xb40e bytes) 2024-09-21T15:07:21.983 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xe2a1727 2024-09-21T15:07:21.985 INFO:teuthology.orchestra.run.smithi161.stdout:172 trunc from 0xd57c30c to 0xe2a1727 2024-09-21T15:07:21.990 INFO:teuthology.orchestra.run.smithi161.stdout:511 trunc from 0x86ff823 to 0xe59153d 2024-09-21T15:07:21.994 INFO:teuthology.orchestra.run.smithi161.stdout:355 write 0x1c3a174 thru 0x1c43da7 (0x9c34 bytes) 2024-09-21T15:07:22.001 INFO:teuthology.orchestra.run.smithi161.stdout:356 writesame 0xc341ca8 thru 0xc350ef0 data_size 0x19(0xf249 bytes) 2024-09-21T15:07:22.002 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.002 INFO:teuthology.orchestra.run.smithi161.stdout:215 read 0x8e44d77 thru 0x8e52b0c (0xdd96 bytes) 2024-09-21T15:07:22.004 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.004 INFO:teuthology.orchestra.run.smithi161.stdout:218 read 0x24afd52 thru 0x24b651d (0x67cc bytes) 2024-09-21T15:07:22.004 INFO:teuthology.orchestra.run.smithi161.stdout:220 punch from 0x3fd7222 to 0x3fd9e87, (0x2c65 bytes) 2024-09-21T15:07:22.004 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.005 INFO:teuthology.orchestra.run.smithi161.stdout:222 trunc from 0xa05f4ca to 0x8f4c271 2024-09-21T15:07:22.016 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.016 INFO:teuthology.orchestra.run.smithi161.stdout:358 write 0xc97d625 thru 0xc97e675 (0x1051 bytes) 2024-09-21T15:07:22.020 INFO:teuthology.orchestra.run.smithi161.stdout:276 writesame 0xa9408b5 thru 0xa945299 data_size 0x1(0x49e5 bytes) 2024-09-21T15:07:22.027 INFO:teuthology.orchestra.run.smithi161.stdout:513 write 0x19e21ee thru 0x19f1098 (0xeeab bytes) 2024-09-21T15:07:22.030 INFO:teuthology.orchestra.run.smithi161.stdout:359 write 0x51cbcbb thru 0x51cd241 (0x1587 bytes) 2024-09-21T15:07:22.036 INFO:teuthology.orchestra.run.smithi161.stdout:514 write 0xc305060 thru 0xc30e76a (0x970b bytes) 2024-09-21T15:07:22.036 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.037 INFO:teuthology.orchestra.run.smithi161.stdout:173 read 0xde2594 thru 0xdecbd9 (0xa646 bytes) 2024-09-21T15:07:22.038 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.038 INFO:teuthology.orchestra.run.smithi161.stdout:175 read 0x70ca7d2 thru 0x70d9347 (0xeb76 bytes) 2024-09-21T15:07:22.042 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.046 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.046 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.050 INFO:teuthology.orchestra.run.smithi161.stdout:516 trunc from 0xe59153d to 0xb304768 2024-09-21T15:07:22.054 INFO:teuthology.orchestra.run.smithi161.stdout:277 writesame 0xbf2dde8 thru 0xbf3aa08 data_size 0x1(0xcc21 bytes) 2024-09-21T15:07:22.058 INFO:teuthology.orchestra.run.smithi161.stdout:278 writesame 0x5b5c475 thru 0x5b68276 data_size 0x43(0xbe02 bytes) 2024-09-21T15:07:22.060 INFO:teuthology.orchestra.run.smithi161.stdout:228 trunc from 0x8f4c271 to 0xc9ea479 2024-09-21T15:07:22.063 INFO:teuthology.orchestra.run.smithi161.stdout:176 trunc from 0xe2a1727 to 0x2d494f6 2024-09-21T15:07:22.070 INFO:teuthology.orchestra.run.smithi161.stdout:361 trunc from 0xe704802 to 0xaecb71 2024-09-21T15:07:22.084 INFO:teuthology.orchestra.run.smithi161.stdout:280 write 0x708f7 thru 0x7fa10 (0xf11a bytes) 2024-09-21T15:07:22.103 INFO:teuthology.orchestra.run.smithi161.stdout:517 write 0x5c1ab55 thru 0x5c1dbf1 (0x309d bytes) 2024-09-21T15:07:22.107 INFO:teuthology.orchestra.run.smithi161.stdout:229 write 0xc1a3ea5 thru 0xc1ae5dc (0xa738 bytes) 2024-09-21T15:07:22.115 INFO:teuthology.orchestra.run.smithi161.stdout:518 punch from 0x8ca0bf to 0x8d545a, (0xb39b bytes) 2024-09-21T15:07:22.115 INFO:teuthology.orchestra.run.smithi161.stdout:520 write 0x2e55831 thru 0x2e58e5e (0x362e bytes) 2024-09-21T15:07:22.123 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.123 INFO:teuthology.orchestra.run.smithi161.stdout:282 read 0xaebd160 thru 0xaec19cc (0x486d bytes) 2024-09-21T15:07:22.123 INFO:teuthology.orchestra.run.smithi161.stdout:283 read 0x5a4afc9 thru 0x5a554d8 (0xa510 bytes) 2024-09-21T15:07:22.129 INFO:teuthology.orchestra.run.smithi161.stdout:177 read 0xb7e2e thru 0xc5806 (0xd9d9 bytes) 2024-09-21T15:07:22.135 INFO:teuthology.orchestra.run.smithi161.stdout:178 punch from 0x2b1e2ea to 0x2b1eee5, (0xbfb bytes) 2024-09-21T15:07:22.135 INFO:teuthology.orchestra.run.smithi161.stdout:181 read 0x188be3d thru 0x188f600 (0x37c4 bytes) 2024-09-21T15:07:22.135 INFO:teuthology.orchestra.run.smithi161.stdout:182 read 0x1fe7315 thru 0x1ff3b77 (0xc863 bytes) 2024-09-21T15:07:22.136 INFO:teuthology.orchestra.run.smithi161.stdout:183 read 0x1198934 thru 0x11a17d9 (0x8ea6 bytes) 2024-09-21T15:07:22.147 INFO:teuthology.orchestra.run.smithi161.stdout:284 trunc from 0xbf3aa09 to 0x19f6d93 2024-09-21T15:07:22.149 INFO:teuthology.orchestra.run.smithi161.stdout:230 trunc from 0xc9ea479 to 0x80fd853 2024-09-21T15:07:22.150 INFO:teuthology.orchestra.run.smithi161.stdout:521 trunc from 0xb304768 to 0x7f2effb 2024-09-21T15:07:22.186 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.186 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.186 INFO:teuthology.orchestra.run.smithi161.stdout:526 read 0x4b6a6c6 thru 0x4b718ac (0x71e7 bytes) 2024-09-21T15:07:22.187 INFO:teuthology.orchestra.run.smithi161.stdout:362 write 0x51202c6 thru 0x5123552 (0x328d bytes) 2024-09-21T15:07:22.187 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.187 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.187 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.187 INFO:teuthology.orchestra.run.smithi161.stdout:532 read 0x31530e8 thru 0x3154e31 (0x1d4a bytes) 2024-09-21T15:07:22.191 INFO:teuthology.orchestra.run.smithi161.stdout:533 read 0x3631163 thru 0x363e1ec (0xd08a bytes) 2024-09-21T15:07:22.191 INFO:teuthology.orchestra.run.smithi161.stdout:184 write 0xe0e686a thru 0xe0f3b5f (0xd2f6 bytes) 2024-09-21T15:07:22.195 INFO:teuthology.orchestra.run.smithi161.stdout:232 write 0x583b394 thru 0x5848304 (0xcf71 bytes) 2024-09-21T15:07:22.195 INFO:teuthology.orchestra.run.smithi161.stdout:285 trunc from 0x19f6d93 to 0x38e68b3 2024-09-21T15:07:22.202 INFO:teuthology.orchestra.run.smithi161.stdout:364 read 0x3c03b95 thru 0x3c0f8aa (0xbd16 bytes) 2024-09-21T15:07:22.204 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.205 INFO:teuthology.orchestra.run.smithi161.stdout:186 writesame 0x1b3f90d thru 0x1b44fdb data_size 0x1(0x56cf bytes) 2024-09-21T15:07:22.218 INFO:teuthology.orchestra.run.smithi161.stdout:367 trunc from 0x5123553 to 0xcd3788e 2024-09-21T15:07:22.225 INFO:teuthology.orchestra.run.smithi161.stdout:187 write 0x513156d thru 0x5133755 (0x21e9 bytes) 2024-09-21T15:07:22.227 INFO:teuthology.orchestra.run.smithi161.stdout:233 read 0x4e570d8 thru 0x4e5b7ec (0x4715 bytes) 2024-09-21T15:07:22.230 INFO:teuthology.orchestra.run.smithi161.stdout:188 writesame 0x52ff41 thru 0x53431d data_size 0x1(0x43dd bytes) 2024-09-21T15:07:22.232 INFO:teuthology.orchestra.run.smithi161.stdout:534 writesame 0xadafdcf thru 0xadbf575 data_size 0x7(0xf7a7 bytes) 2024-09-21T15:07:22.236 INFO:teuthology.orchestra.run.smithi161.stdout:286 punch from 0x25de385 to 0x25ed8bb, (0xf536 bytes) 2024-09-21T15:07:22.236 INFO:teuthology.orchestra.run.smithi161.stdout:287 punch from 0x111abb5 to 0x1120c7b, (0x60c6 bytes) 2024-09-21T15:07:22.236 INFO:teuthology.orchestra.run.smithi161.stdout:288 punch from 0x2ffd730 to 0x300d6c0, (0xff90 bytes) 2024-09-21T15:07:22.236 INFO:teuthology.orchestra.run.smithi161.stdout:289 punch from 0x35cddae to 0x35d2ccc, (0x4f1e bytes) 2024-09-21T15:07:22.236 INFO:teuthology.orchestra.run.smithi161.stdout:290 read 0xeb2b43 thru 0xeb9d0a (0x71c8 bytes) 2024-09-21T15:07:22.236 INFO:teuthology.orchestra.run.smithi161.stdout:291 write 0x56663 thru 0x56777 (0x115 bytes) 2024-09-21T15:07:22.243 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.243 INFO:teuthology.orchestra.run.smithi161.stdout:192 writesame 0x631442b thru 0x6323e4e data_size 0xe(0xfa24 bytes) 2024-09-21T15:07:22.246 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.246 INFO:teuthology.orchestra.run.smithi161.stdout:296 punch from 0x293e0e to 0x2a0c3c, (0xce2e bytes) 2024-09-21T15:07:22.246 INFO:teuthology.orchestra.run.smithi161.stdout:297 read 0x19ad40f thru 0x19b64ec (0x90de bytes) 2024-09-21T15:07:22.246 INFO:teuthology.orchestra.run.smithi161.stdout:298 read 0x14c853d thru 0x14c922a (0xcee bytes) 2024-09-21T15:07:22.246 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.249 INFO:teuthology.orchestra.run.smithi161.stdout:535 trunc from 0xadbf576 to 0xc96f299 2024-09-21T15:07:22.261 INFO:teuthology.orchestra.run.smithi161.stdout:235 writesame 0xa6aadc1 thru 0xa6b0e1d data_size 0x3(0x605d bytes) 2024-09-21T15:07:22.264 INFO:teuthology.orchestra.run.smithi161.stdout:368 trunc from 0xcd3788e to 0x70398c0 2024-09-21T15:07:22.270 INFO:teuthology.orchestra.run.smithi161.stdout:301 trunc from 0x38e68b3 to 0xdbc4c47 2024-09-21T15:07:22.271 INFO:teuthology.orchestra.run.smithi161.stdout:193 trunc from 0xe0f3b60 to 0x5af85d9 2024-09-21T15:07:22.273 INFO:teuthology.orchestra.run.smithi161.stdout:537 write 0x9e9e8f8 thru 0x9ea478b (0x5e94 bytes) 2024-09-21T15:07:22.279 INFO:teuthology.orchestra.run.smithi161.stdout:538 write 0xaf0627 thru 0xaf2c15 (0x25ef bytes) 2024-09-21T15:07:22.285 INFO:teuthology.orchestra.run.smithi161.stdout:369 writesame 0x557a828 thru 0x5585580 data_size 0x1(0xad59 bytes) 2024-09-21T15:07:22.286 INFO:teuthology.orchestra.run.smithi161.stdout:539 writesame 0x85b0e48 thru 0x85bb253 data_size 0x2(0xa40c bytes) 2024-09-21T15:07:22.305 INFO:teuthology.orchestra.run.smithi161.stdout:236 writesame 0xd6c5799 thru 0xd6d0ec4 data_size 0x26(0xb72c bytes) 2024-09-21T15:07:22.306 INFO:teuthology.orchestra.run.smithi161.stdout:302 write 0x10214b5 thru 0x1031237 (0xfd83 bytes) 2024-09-21T15:07:22.318 INFO:teuthology.orchestra.run.smithi161.stdout:238 punch from 0x7ef1227 to 0x7ef8158, (0x6f31 bytes) 2024-09-21T15:07:22.318 INFO:teuthology.orchestra.run.smithi161.stdout:240 read 0xc2ac32d thru 0xc2af577 (0x324b bytes) 2024-09-21T15:07:22.318 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.318 INFO:teuthology.orchestra.run.smithi161.stdout:242 write 0x92e4094 thru 0x92f187a (0xd7e7 bytes) 2024-09-21T15:07:22.325 INFO:teuthology.orchestra.run.smithi161.stdout:370 read 0x5a74d6a thru 0x5a7fb44 (0xaddb bytes) 2024-09-21T15:07:22.335 INFO:teuthology.orchestra.run.smithi161.stdout:303 writesame 0xdb551ce thru 0xdb58924 data_size 0x1(0x3757 bytes) 2024-09-21T15:07:22.338 INFO:teuthology.orchestra.run.smithi161.stdout:194 read 0x170079b thru 0x1706b33 (0x6399 bytes) 2024-09-21T15:07:22.339 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.347 INFO:teuthology.orchestra.run.smithi161.stdout:196 trunc from 0x5af85d9 to 0x20541a7 2024-09-21T15:07:22.355 INFO:teuthology.orchestra.run.smithi161.stdout:243 read 0xba592d6 thru 0xba688f5 (0xf620 bytes) 2024-09-21T15:07:22.355 INFO:teuthology.orchestra.run.smithi161.stdout:244 write 0x97bc9d0 thru 0x97be001 (0x1632 bytes) 2024-09-21T15:07:22.361 INFO:teuthology.orchestra.run.smithi161.stdout:541 writesame 0xdbe5f94 thru 0xdbec136 data_size 0x1(0x61a3 bytes) 2024-09-21T15:07:22.368 INFO:teuthology.orchestra.run.smithi161.stdout:304 trunc from 0xdbc4c47 to 0xda5c8ef 2024-09-21T15:07:22.368 INFO:teuthology.orchestra.run.smithi161.stdout:542 write 0x77d5396 thru 0x77e4d3b (0xf9a6 bytes) 2024-09-21T15:07:22.370 INFO:teuthology.orchestra.run.smithi161.stdout:245 read 0x3fc0bfb thru 0x3fd066e (0xfa74 bytes) 2024-09-21T15:07:22.371 INFO:teuthology.orchestra.run.smithi161.stdout:246 clone 2 order 20 su 4096 sc 10 2024-09-21T15:07:22.376 INFO:teuthology.orchestra.run.smithi161.stdout:371 write 0xd091500 thru 0xd09c9ab (0xb4ac bytes) 2024-09-21T15:07:22.385 INFO:teuthology.orchestra.run.smithi161.stdout:372 writesame 0x42470a1 thru 0x424ec43 data_size 0x1(0x7ba3 bytes) 2024-09-21T15:07:22.398 INFO:teuthology.orchestra.run.smithi161.stdout:197 trunc from 0x20541a7 to 0x8d4f648 2024-09-21T15:07:22.400 INFO:teuthology.orchestra.run.smithi161.stdout:305 writesame 0x9829e2c thru 0x982e369 data_size 0x1(0x453e bytes) 2024-09-21T15:07:22.401 INFO:teuthology.orchestra.run.smithi161.stdout:543 write 0xea88ff3 thru 0xea97f09 (0xef17 bytes) 2024-09-21T15:07:22.411 INFO:teuthology.orchestra.run.smithi161.stdout:373 writesame 0xb654683 thru 0xb66398d data_size 0x1(0xf30b bytes) 2024-09-21T15:07:22.413 INFO:teuthology.orchestra.run.smithi161.stdout:545 writesame 0xd4fe122 thru 0xd5030f8 data_size 0x9(0x4fd7 bytes) 2024-09-21T15:07:22.420 INFO:teuthology.orchestra.run.smithi161.stdout:307 read 0x6b754ae thru 0x6b7aafe (0x5651 bytes) 2024-09-21T15:07:22.420 INFO:teuthology.orchestra.run.smithi161.stdout:308 clone 3 order 23 su 32768 sc 15 2024-09-21T15:07:22.443 INFO:teuthology.orchestra.run.smithi161.stdout:198 write 0x53d438b thru 0x53d8f2f (0x4ba5 bytes) 2024-09-21T15:07:22.444 INFO:teuthology.orchestra.run.smithi161.stdout:546 read 0xa7d67fd thru 0xa7d97dd (0x2fe1 bytes) 2024-09-21T15:07:22.445 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.445 INFO:teuthology.orchestra.run.smithi161.stdout:548 read 0xe212b48 thru 0xe21b3c5 (0x887e bytes) 2024-09-21T15:07:22.446 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.456 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.456 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.456 INFO:teuthology.orchestra.run.smithi161.stdout:202 read 0x408a756 thru 0x408e61e (0x3ec9 bytes) 2024-09-21T15:07:22.456 INFO:teuthology.orchestra.run.smithi161.stdout:374 writesame 0x800c8c2 thru 0x80181f7 data_size 0x2(0xb936 bytes) 2024-09-21T15:07:22.457 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.457 INFO:teuthology.orchestra.run.smithi161.stdout:204 read 0x1fe28cb thru 0x1fe9636 (0x6d6c bytes) 2024-09-21T15:07:22.465 INFO:teuthology.orchestra.run.smithi161.stdout:551 trunc from 0xea97f0a to 0x5da0d5f 2024-09-21T15:07:22.477 INFO:teuthology.orchestra.run.smithi161.stdout:376 writesame 0x5f64c5c thru 0x5f70947 data_size 0x4(0xbcec bytes) 2024-09-21T15:07:22.502 INFO:teuthology.orchestra.run.smithi161.stdout:377 write 0x8dd1193 thru 0x8dd4a27 (0x3895 bytes) 2024-09-21T15:07:22.525 INFO:teuthology.orchestra.run.smithi161.stdout:205 writesame 0xdfb37c2 thru 0xdfbf93a data_size 0x1(0xc179 bytes) 2024-09-21T15:07:22.528 INFO:teuthology.orchestra.run.smithi161.stdout:206 write 0x974146f thru 0x974dba1 (0xc733 bytes) 2024-09-21T15:07:22.543 INFO:teuthology.orchestra.run.smithi161.stdout:207 read 0x983a023 thru 0x983f37b (0x5359 bytes) 2024-09-21T15:07:22.543 INFO:teuthology.orchestra.run.smithi161.stdout:210 punch from 0x38af623 to 0x38b92a8, (0x9c85 bytes) 2024-09-21T15:07:22.543 INFO:teuthology.orchestra.run.smithi161.stdout:211 read 0x397b1d5 thru 0x397ff29 (0x4d55 bytes) 2024-09-21T15:07:22.544 INFO:teuthology.orchestra.run.smithi161.stdout:212 read 0x475727c thru 0x47664e4 (0xf269 bytes) 2024-09-21T15:07:22.545 INFO:teuthology.orchestra.run.smithi161.stdout:213 read 0x6d39675 thru 0x6d3fa29 (0x63b5 bytes) 2024-09-21T15:07:22.546 INFO:teuthology.orchestra.run.smithi161.stdout:214 write 0x4a5449b thru 0x4a615af (0xd115 bytes) 2024-09-21T15:07:22.553 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.553 INFO:teuthology.orchestra.run.smithi161.stdout:217 writesame 0x45b2a5b thru 0x45b92d1 data_size 0x1(0x6877 bytes) 2024-09-21T15:07:22.554 INFO:teuthology.orchestra.run.smithi161.stdout:378 trunc from 0xd09c9ac to 0xe2cd63 2024-09-21T15:07:22.574 INFO:teuthology.orchestra.run.smithi161.stdout:219 write 0x33fec2b thru 0x3403479 (0x484f bytes) 2024-09-21T15:07:22.575 INFO:teuthology.orchestra.run.smithi161.stdout:552 writesame 0xdb93bd5 thru 0xdb94874 data_size 0x1(0xca0 bytes) 2024-09-21T15:07:22.583 INFO:teuthology.orchestra.run.smithi161.stdout:553 write 0xf93bfa thru 0xfa2f62 (0xf369 bytes) 2024-09-21T15:07:22.584 INFO:teuthology.orchestra.run.smithi161.stdout:220 read 0x8271203 thru 0x8280125 (0xef23 bytes) 2024-09-21T15:07:22.584 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.584 INFO:teuthology.orchestra.run.smithi161.stdout:222 read 0x753c678 thru 0x7548d9a (0xc723 bytes) 2024-09-21T15:07:22.585 INFO:teuthology.orchestra.run.smithi161.stdout:223 writesame 0x9f635e0 thru 0x9f67e73 data_size 0xa(0x4894 bytes) 2024-09-21T15:07:22.591 INFO:teuthology.orchestra.run.smithi161.stdout:555 writesame 0x96fae9e thru 0x9704d0b data_size 0x7(0x9e6e bytes) 2024-09-21T15:07:22.598 INFO:teuthology.orchestra.run.smithi161.stdout:224 writesame 0x730fac thru 0x73eec4 data_size 0x29(0xdf19 bytes) 2024-09-21T15:07:22.607 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.607 INFO:teuthology.orchestra.run.smithi161.stdout:226 read 0x62b6118 thru 0x62b69b0 (0x899 bytes) 2024-09-21T15:07:22.612 INFO:teuthology.orchestra.run.smithi161.stdout:380 clone 2 order 18 su 131072 sc 6 2024-09-21T15:07:22.613 INFO:teuthology.orchestra.run.smithi161.stdout:227 trunc from 0xdfbf93b to 0xbbff2cf 2024-09-21T15:07:22.629 INFO:teuthology.orchestra.run.smithi161.stdout:557 trunc from 0xdb94875 to 0x1166ea9 2024-09-21T15:07:22.650 INFO:teuthology.orchestra.run.smithi161.stdout:228 read 0x6d305a2 thru 0x6d3ea60 (0xe4bf bytes) 2024-09-21T15:07:22.651 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.651 INFO:teuthology.orchestra.run.smithi161.stdout:233 read 0x92fab9f thru 0x92fbe66 (0x12c8 bytes) 2024-09-21T15:07:22.654 INFO:teuthology.orchestra.run.smithi161.stdout:235 trunc from 0xbbff2cf to 0xab4a80f 2024-09-21T15:07:22.671 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.1-clone2 2024-09-21T15:07:22.683 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.5-clone2 2024-09-21T15:07:22.695 INFO:teuthology.orchestra.run.smithi161.stdout:558 write 0x6187a28 thru 0x618ef1d (0x74f6 bytes) 2024-09-21T15:07:22.704 INFO:teuthology.orchestra.run.smithi161.stdout:236 write 0xebb582f thru 0xebc46b7 (0xee89 bytes) 2024-09-21T15:07:22.711 INFO:teuthology.orchestra.run.smithi161.stdout:560 trunc from 0x618ef1e to 0x209af04 2024-09-21T15:07:22.716 INFO:teuthology.orchestra.run.smithi161.stdout:237 read 0xb63c089 thru 0xb642cb4 (0x6c2c bytes) 2024-09-21T15:07:22.716 INFO:teuthology.orchestra.run.smithi161.stdout:238 clone 5 order 21 su 524288 sc 2 2024-09-21T15:07:22.772 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.809 INFO:teuthology.orchestra.run.smithi161.stdout:563 write 0x97e877e thru 0x97f4ada (0xc35d bytes) 2024-09-21T15:07:22.818 INFO:teuthology.orchestra.run.smithi161.stdout:564 read 0x41bbf65 thru 0x41bd29b (0x1337 bytes) 2024-09-21T15:07:22.828 INFO:teuthology.orchestra.run.smithi161.stdout:565 trunc from 0x97f4adb to 0x4052a32 2024-09-21T15:07:22.867 INFO:teuthology.orchestra.run.smithi161.stdout:567 read 0x20c171c thru 0x20c366a (0x1f4f bytes) 2024-09-21T15:07:22.880 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.894 INFO:teuthology.orchestra.run.smithi161.stdout:570 write 0xb525141 thru 0xb52e1f9 (0x90b9 bytes) 2024-09-21T15:07:22.896 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #0, image image_cluster1.client.mirror.4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent1 2024-09-21T15:07:22.899 INFO:teuthology.orchestra.run.smithi161.stdout:571 read 0x93f8106 thru 0x9403ae5 (0xb9e0 bytes) 2024-09-21T15:07:22.900 INFO:teuthology.orchestra.run.smithi161.stdout:572 read 0x721db31 thru 0x7221086 (0x3556 bytes) 2024-09-21T15:07:22.900 INFO:teuthology.orchestra.run.smithi161.stdout:573 punch from 0xa37fdbf to 0xa387e97, (0x80d8 bytes) 2024-09-21T15:07:22.900 INFO:teuthology.orchestra.run.smithi161.stdout:574 writesame 0x7ff8e34 thru 0x8007869 data_size 0x9(0xea36 bytes) 2024-09-21T15:07:22.906 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.906 INFO:teuthology.orchestra.run.smithi161.stdout:576 read 0x52c41a4 thru 0x52d3e43 (0xfca0 bytes) 2024-09-21T15:07:22.918 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #1, image image_cluster1.client.mirror.1-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent2 2024-09-21T15:07:22.930 INFO:teuthology.orchestra.run.smithi161.stdout:578 write 0xc02d789 thru 0xc039e3e (0xc6b6 bytes) 2024-09-21T15:07:22.941 INFO:teuthology.orchestra.run.smithi161.stdout:580 write 0x8284cb1 thru 0x829436b (0xf6bb bytes) 2024-09-21T15:07:22.949 INFO:teuthology.orchestra.run.smithi161.stdout:582 read 0x469d1a0 thru 0x46a6b52 (0x99b3 bytes) 2024-09-21T15:07:22.950 INFO:teuthology.orchestra.run.smithi161.stdout:585 read 0x5191796 thru 0x519bb6b (0xa3d6 bytes) 2024-09-21T15:07:22.951 INFO:teuthology.orchestra.run.smithi161.stdout:586 read 0xbdf45ff thru 0xbdfd04a (0x8a4c bytes) 2024-09-21T15:07:22.952 INFO:teuthology.orchestra.run.smithi161.stdout:588 read 0x3dc63c1 thru 0x3dc740b (0x104b bytes) 2024-09-21T15:07:22.952 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.953 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:22.953 INFO:teuthology.orchestra.run.smithi161.stdout:593 read 0x3cbf790 thru 0x3cc4344 (0x4bb5 bytes) 2024-09-21T15:07:22.953 INFO:teuthology.orchestra.run.smithi161.stdout:594 punch from 0xaf49608 to 0xaf4ccaf, (0x36a7 bytes) 2024-09-21T15:07:22.955 INFO:teuthology.orchestra.run.smithi161.stdout:595 trunc from 0xc039e3f to 0xb6a7ef8 2024-09-21T15:07:22.988 INFO:teuthology.orchestra.run.smithi161.stdout:596 write 0x6400599 thru 0x6402739 (0x21a1 bytes) 2024-09-21T15:07:22.994 INFO:teuthology.orchestra.run.smithi161.stdout:597 write 0x46cb961 thru 0x46ccd0c (0x13ac bytes) 2024-09-21T15:07:23.002 INFO:teuthology.orchestra.run.smithi161.stdout:598 punch from 0x2f60a83 to 0x2f61ade, (0x105b bytes) 2024-09-21T15:07:23.002 INFO:teuthology.orchestra.run.smithi161.stdout:599 write 0x376bf34 thru 0x3771551 (0x561e bytes) 2024-09-21T15:07:23.010 INFO:teuthology.orchestra.run.smithi161.stdout:600 write 0x2106309 thru 0x2109c46 (0x393e bytes) 2024-09-21T15:07:23.020 INFO:teuthology.orchestra.run.smithi161.stdout:601 write 0xa71327e thru 0xa7180be (0x4e41 bytes) 2024-09-21T15:07:23.030 INFO:teuthology.orchestra.run.smithi161.stdout:602 read 0xb124811 thru 0xb128e0e (0x45fe bytes) 2024-09-21T15:07:23.059 INFO:teuthology.orchestra.run.smithi161.stdout:603 write 0xe7a8825 thru 0xe7b767e (0xee5a bytes) 2024-09-21T15:07:23.073 INFO:teuthology.orchestra.run.smithi161.stdout:604 punch from 0xd2c89df to 0xd2d58e2, (0xcf03 bytes) 2024-09-21T15:07:23.086 INFO:teuthology.orchestra.run.smithi161.stdout:605 trunc from 0xe7b767f to 0x7ab3a48 2024-09-21T15:07:23.109 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #1, image image_cluster1.client.mirror.5-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent2 2024-09-21T15:07:23.116 INFO:teuthology.orchestra.run.smithi161.stdout:606 read 0x63c39d4 thru 0x63c6d09 (0x3336 bytes) 2024-09-21T15:07:23.145 INFO:teuthology.orchestra.run.smithi161.stdout:607 writesame 0xbb5143e thru 0xbb527ed data_size 0x38(0x13b0 bytes) 2024-09-21T15:07:23.149 INFO:teuthology.orchestra.run.smithi161.stdout:608 write 0x3bd7997 thru 0x3bdbb18 (0x4182 bytes) 2024-09-21T15:07:23.156 INFO:teuthology.orchestra.run.smithi161.stdout:609 writesame 0x21968c3 thru 0x2199080 data_size 0x1(0x27be bytes) 2024-09-21T15:07:23.187 INFO:teuthology.orchestra.run.smithi161.stdout:610 trunc from 0xbb527ee to 0x11250ab 2024-09-21T15:07:23.256 INFO:teuthology.orchestra.run.smithi161.stdout:611 read 0x2869fd thru 0x28b21a (0x481e bytes) 2024-09-21T15:07:23.257 INFO:teuthology.orchestra.run.smithi161.stdout:612 read 0x8164f0 thru 0x81f824 (0x9335 bytes) 2024-09-21T15:07:23.301 INFO:teuthology.orchestra.run.smithi161.stdout:613 write 0xe2dcfcb thru 0xe2eab3f (0xdb75 bytes) 2024-09-21T15:07:23.309 INFO:teuthology.orchestra.run.smithi161.stdout:247 read 0x8cb753a thru 0x8cc4418 (0xcedf bytes) 2024-09-21T15:07:23.316 INFO:teuthology.orchestra.run.smithi161.stdout:614 read 0xb8094e7 thru 0xb8183ff (0xef19 bytes) 2024-09-21T15:07:23.317 INFO:teuthology.orchestra.run.smithi161.stdout:615 read 0x254199d thru 0x25432c6 (0x192a bytes) 2024-09-21T15:07:23.318 INFO:teuthology.orchestra.run.smithi161.stdout:616 writesame 0x7191e7d thru 0x719e121 data_size 0x1(0xc2a5 bytes) 2024-09-21T15:07:23.322 INFO:teuthology.orchestra.run.smithi161.stdout:309 read 0x3646bb7 thru 0x3651fa1 (0xb3eb bytes) 2024-09-21T15:07:23.369 INFO:teuthology.orchestra.run.smithi161.stdout:250 read 0x3013dea thru 0x301f96d (0xbb84 bytes) 2024-09-21T15:07:23.370 INFO:teuthology.orchestra.run.smithi161.stdout:253 read 0x28ae527 thru 0x28b161c (0x30f6 bytes) 2024-09-21T15:07:23.371 INFO:teuthology.orchestra.run.smithi161.stdout:255 write 0x88c085e thru 0x88cbf8b (0xb72e bytes) 2024-09-21T15:07:23.372 INFO:teuthology.orchestra.run.smithi161.stdout:617 trunc from 0xe2eab40 to 0x69a2a67 2024-09-21T15:07:23.373 INFO:teuthology.orchestra.run.smithi161.stdout:310 write 0x3a3be41 thru 0x3a3d059 (0x1219 bytes) 2024-09-21T15:07:23.413 INFO:teuthology.orchestra.run.smithi161.stdout:311 read 0x9ed495f thru 0x9edaba9 (0x624b bytes) 2024-09-21T15:07:23.414 INFO:teuthology.orchestra.run.smithi161.stdout:313 write 0x31771da thru 0x317c6fa (0x5521 bytes) 2024-09-21T15:07:23.431 INFO:teuthology.orchestra.run.smithi161.stdout:258 trunc from 0xd6d0ec5 to 0x60817df 2024-09-21T15:07:23.439 INFO:teuthology.orchestra.run.smithi161.stdout:619 write 0x808b60e thru 0x8094460 (0x8e53 bytes) 2024-09-21T15:07:23.446 INFO:teuthology.orchestra.run.smithi161.stdout:314 write 0x9cbcc5e thru 0x9cc6567 (0x990a bytes) 2024-09-21T15:07:23.451 INFO:teuthology.orchestra.run.smithi161.stdout:113 writesame 0xc778539 thru 0xc7840e8 data_size 0x21(0xbbb0 bytes) 2024-09-21T15:07:23.458 INFO:teuthology.orchestra.run.smithi161.stdout:114 write 0xbe9adc5 thru 0xbea63bf (0xb5fb bytes) 2024-09-21T15:07:23.480 INFO:teuthology.orchestra.run.smithi161.stdout:116 read 0x1c45382 thru 0x1c50106 (0xad85 bytes) 2024-09-21T15:07:23.480 INFO:teuthology.orchestra.run.smithi161.stdout:117 writesame 0xb87d14f thru 0xb881edd data_size 0x37(0x4d8f bytes) 2024-09-21T15:07:23.483 INFO:teuthology.orchestra.run.smithi161.stdout:315 write 0x5431dfb thru 0x543cfd7 (0xb1dd bytes) 2024-09-21T15:07:23.488 INFO:teuthology.orchestra.run.smithi161.stdout:620 writesame 0x928a82a thru 0x9295e70 data_size 0x1(0xb647 bytes) 2024-09-21T15:07:23.493 INFO:teuthology.orchestra.run.smithi161.stdout:118 write 0x6950d1e thru 0x695ead5 (0xddb8 bytes) 2024-09-21T15:07:23.497 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.510 INFO:teuthology.orchestra.run.smithi161.stdout:624 trunc from 0x9295e71 to 0x29acd7b 2024-09-21T15:07:23.514 INFO:teuthology.orchestra.run.smithi161.stdout:119 read 0xbf82ebd thru 0xbf8330a (0x44e bytes) 2024-09-21T15:07:23.514 INFO:teuthology.orchestra.run.smithi161.stdout:120 write 0xa870e42 thru 0xa88090e (0xfacd bytes) 2024-09-21T15:07:23.531 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.531 INFO:teuthology.orchestra.run.smithi161.stdout:317 write 0x525ffef thru 0x526a4a8 (0xa4ba bytes) 2024-09-21T15:07:23.533 INFO:teuthology.orchestra.run.smithi161.stdout:121 write 0xa1bd32c thru 0xa1bdf8e (0xc63 bytes) 2024-09-21T15:07:23.542 INFO:teuthology.orchestra.run.smithi161.stdout:122 punch from 0x3005d3e to 0x300cd3b, (0x6ffd bytes) 2024-09-21T15:07:23.542 INFO:teuthology.orchestra.run.smithi161.stdout:123 punch from 0x571ce93 to 0x5726532, (0x969f bytes) 2024-09-21T15:07:23.548 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.565 INFO:teuthology.orchestra.run.smithi161.stdout:124 writesame 0xded1057 thru 0xded2f4b data_size 0x5(0x1ef5 bytes) 2024-09-21T15:07:23.566 INFO:teuthology.orchestra.run.smithi161.stdout:259 writesame 0x9283cab thru 0x9288153 data_size 0x7(0x44a9 bytes) 2024-09-21T15:07:23.568 INFO:teuthology.orchestra.run.smithi161.stdout:126 read 0xa74e685 thru 0xa756816 (0x8192 bytes) 2024-09-21T15:07:23.568 INFO:teuthology.orchestra.run.smithi161.stdout:260 read 0x2db822a thru 0x2dbb80c (0x35e3 bytes) 2024-09-21T15:07:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:128 punch from 0x45a850e to 0x45aeaff, (0x65f1 bytes) 2024-09-21T15:07:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:130 read 0x41387c thru 0x41d554 (0x9cd9 bytes) 2024-09-21T15:07:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:131 punch from 0xc07e863 to 0xc089d4f, (0xb4ec bytes) 2024-09-21T15:07:23.569 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.573 INFO:teuthology.orchestra.run.smithi161.stdout:318 write 0xaf65c55 thru 0xaf68aca (0x2e76 bytes) 2024-09-21T15:07:23.576 INFO:teuthology.orchestra.run.smithi161.stdout:626 write 0x9cd79d3 thru 0x9ce1cb8 (0xa2e6 bytes) 2024-09-21T15:07:23.587 INFO:teuthology.orchestra.run.smithi161.stdout:133 trunc from 0xded2f4c to 0x14e1959 2024-09-21T15:07:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:627 read 0x2e62395 thru 0x2e6fbbe (0xd82a bytes) 2024-09-21T15:07:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:629 write 0x66b8fda thru 0x66bc30d (0x3334 bytes) 2024-09-21T15:07:23.601 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.601 INFO:teuthology.orchestra.run.smithi161.stdout:633 punch from 0x7ae3421 to 0x7aefcf9, (0xc8d8 bytes) 2024-09-21T15:07:23.601 INFO:teuthology.orchestra.run.smithi161.stdout:634 writesame 0x6d8815f thru 0x6d8c70b data_size 0x1(0x45ad bytes) 2024-09-21T15:07:23.605 INFO:teuthology.orchestra.run.smithi161.stdout:263 writesame 0xa0790f6 thru 0xa081b7e data_size 0x5(0x8a89 bytes) 2024-09-21T15:07:23.609 INFO:teuthology.orchestra.run.smithi161.stdout:319 write 0x77b1ba4 thru 0x77b4f9d (0x33fa bytes) 2024-09-21T15:07:23.613 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.613 INFO:teuthology.orchestra.run.smithi161.stdout:267 punch from 0x305a584 to 0x3065217, (0xac93 bytes) 2024-09-21T15:07:23.613 INFO:teuthology.orchestra.run.smithi161.stdout:268 punch from 0x2cb5485 to 0x2cbe62f, (0x91aa bytes) 2024-09-21T15:07:23.621 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.621 INFO:teuthology.orchestra.run.smithi161.stdout:636 writesame 0x23206c6 thru 0x2330213 data_size 0x13(0xfb4e bytes) 2024-09-21T15:07:23.646 INFO:teuthology.orchestra.run.smithi161.stdout:322 write 0x25eb74 thru 0x2687b9 (0x9c46 bytes) 2024-09-21T15:07:23.649 INFO:teuthology.orchestra.run.smithi161.stdout:639 trunc from 0x9ce1cb9 to 0x3348081 2024-09-21T15:07:23.665 INFO:teuthology.orchestra.run.smithi161.stdout:269 writesame 0xebbcdb0 thru 0xebc1c19 data_size 0x1(0x4e6a bytes) 2024-09-21T15:07:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:134 read 0x1261568 thru 0x1266c45 (0x56de bytes) 2024-09-21T15:07:23.689 INFO:teuthology.orchestra.run.smithi161.stdout:275 trunc from 0xebc1c1a to 0x738945a 2024-09-21T15:07:23.692 INFO:teuthology.orchestra.run.smithi161.stdout:640 read 0x1d88ad4 thru 0x1d89002 (0x52f bytes) 2024-09-21T15:07:23.693 INFO:teuthology.orchestra.run.smithi161.stdout:641 write 0x2238215 thru 0x223832e (0x11a bytes) 2024-09-21T15:07:23.715 INFO:teuthology.orchestra.run.smithi161.stdout:276 read 0x209c5c5 thru 0x20a2b9e (0x65da bytes) 2024-09-21T15:07:23.715 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone4 from 0xebc46b8 (overlap 0x740b12) to 0x5cd5a8 2024-09-21T15:07:23.716 INFO:teuthology.orchestra.run.smithi161.stdout:278 read 0x6245064 thru 0x624fce9 (0xac86 bytes) 2024-09-21T15:07:23.717 INFO:teuthology.orchestra.run.smithi161.stdout:279 write 0x354c87e thru 0x355703a (0xa7bd bytes) 2024-09-21T15:07:23.717 INFO:teuthology.orchestra.run.smithi161.stdout:136 writesame 0xad7aae0 thru 0xad897ff data_size 0x70(0xed20 bytes) 2024-09-21T15:07:23.718 INFO:teuthology.orchestra.run.smithi161.stdout:323 trunc from 0xda5c8ef to 0x5366ec8 2024-09-21T15:07:23.721 INFO:teuthology.orchestra.run.smithi161.stdout:140 read 0x692baf5 thru 0x6937693 (0xbb9f bytes) 2024-09-21T15:07:23.730 INFO:teuthology.orchestra.run.smithi161.stdout:141 trunc from 0xad89800 to 0x6b0051d 2024-09-21T15:07:23.748 INFO:teuthology.orchestra.run.smithi161.stdout:642 write 0xc228462 thru 0xc2381d2 (0xfd71 bytes) 2024-09-21T15:07:23.748 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #0, image image_cluster1.client.mirror.0 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent1 2024-09-21T15:07:23.760 INFO:teuthology.orchestra.run.smithi161.stdout:643 writesame 0xbaf73c3 thru 0xbafc709 data_size 0x1(0x5347 bytes) 2024-09-21T15:07:23.770 INFO:teuthology.orchestra.run.smithi161.stdout:281 read 0x72e1041 thru 0x72e2eb5 (0x1e75 bytes) 2024-09-21T15:07:23.770 INFO:teuthology.orchestra.run.smithi161.stdout:143 write 0x69adffd thru 0x69b701f (0x9023 bytes) 2024-09-21T15:07:23.775 INFO:teuthology.orchestra.run.smithi161.stdout:282 trunc from 0x738945a to 0xaba22b6 2024-09-21T15:07:23.785 INFO:teuthology.orchestra.run.smithi161.stdout:644 read 0x684ba5b thru 0x685248a (0x6a30 bytes) 2024-09-21T15:07:23.786 INFO:teuthology.orchestra.run.smithi161.stdout:645 writesame 0x23e2799 thru 0x23f084c data_size 0x49(0xe0b4 bytes) 2024-09-21T15:07:23.790 INFO:teuthology.orchestra.run.smithi161.stdout:146 read 0x188736f thru 0x18897dc (0x246e bytes) 2024-09-21T15:07:23.790 INFO:teuthology.orchestra.run.smithi161.stdout:147 read 0x42c48a9 thru 0x42c5e69 (0x15c1 bytes) 2024-09-21T15:07:23.790 INFO:teuthology.orchestra.run.smithi161.stdout:148 read 0xaa1461 thru 0xaa4b8b (0x372b bytes) 2024-09-21T15:07:23.790 INFO:teuthology.orchestra.run.smithi161.stdout:149 write 0xd1db57 thru 0xd2059c (0x2a46 bytes) 2024-09-21T15:07:23.796 INFO:teuthology.orchestra.run.smithi161.stdout:646 trunc from 0xc2381d3 to 0x905f68a 2024-09-21T15:07:23.802 INFO:teuthology.orchestra.run.smithi161.stdout:284 read 0x21a502 thru 0x21fafa (0x55f9 bytes) 2024-09-21T15:07:23.804 INFO:teuthology.orchestra.run.smithi161.stdout:285 punch from 0x2d414d5 to 0x2d41b91, (0x6bc bytes) 2024-09-21T15:07:23.804 INFO:teuthology.orchestra.run.smithi161.stdout:286 read 0x67ee8db thru 0x67f8b57 (0xa27d bytes) 2024-09-21T15:07:23.804 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.805 INFO:teuthology.orchestra.run.smithi161.stdout:288 write 0x21d1633 thru 0x21dbb7e (0xa54c bytes) 2024-09-21T15:07:23.845 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xe9874e6 2024-09-21T15:07:23.845 INFO:teuthology.orchestra.run.smithi161.stdout:152 write 0x82a4f39 thru 0x82a92af (0x4377 bytes) 2024-09-21T15:07:23.856 INFO:teuthology.orchestra.run.smithi161.stdout:324 trunc from 0x5366ec8 to 0xe9874e6 2024-09-21T15:07:23.859 INFO:teuthology.orchestra.run.smithi161.stdout:153 read 0x1ec57fd thru 0x1ed0c81 (0xb485 bytes) 2024-09-21T15:07:23.860 INFO:teuthology.orchestra.run.smithi161.stdout:155 trunc from 0x82a92b0 to 0x853b94b 2024-09-21T15:07:23.860 INFO:teuthology.orchestra.run.smithi161.stdout:289 read 0x5e66a86 thru 0x5e67dd2 (0x134d bytes) 2024-09-21T15:07:23.861 INFO:teuthology.orchestra.run.smithi161.stdout:290 write 0x4d6b595 thru 0x4d74639 (0x90a5 bytes) 2024-09-21T15:07:23.869 INFO:teuthology.orchestra.run.smithi161.stdout:647 write 0xa497359 thru 0xa49b2b0 (0x3f58 bytes) 2024-09-21T15:07:23.880 INFO:teuthology.orchestra.run.smithi161.stdout:326 read 0x58a42b5 thru 0x58a499f (0x6eb bytes) 2024-09-21T15:07:23.881 INFO:teuthology.orchestra.run.smithi161.stdout:327 read 0x84645e thru 0x84793e (0x14e1 bytes) 2024-09-21T15:07:23.883 INFO:teuthology.orchestra.run.smithi161.stdout:328 trunc from 0xe9874e6 to 0xddef944 2024-09-21T15:07:23.899 INFO:teuthology.orchestra.run.smithi161.stdout:157 write 0x92a1ee thru 0x92b8f8 (0x170b bytes) 2024-09-21T15:07:23.912 INFO:teuthology.orchestra.run.smithi161.stdout:291 read 0x407fc60 thru 0x4089414 (0x97b5 bytes) 2024-09-21T15:07:23.913 INFO:teuthology.orchestra.run.smithi161.stdout:292 write 0x1e9c927 thru 0x1ea46c4 (0x7d9e bytes) 2024-09-21T15:07:23.916 INFO:teuthology.orchestra.run.smithi161.stdout:158 punch from 0x3da1fdf to 0x3da747b, (0x549c bytes) 2024-09-21T15:07:23.916 INFO:teuthology.orchestra.run.smithi161.stdout:159 write 0x6d6b304 thru 0x6d704b1 (0x51ae bytes) 2024-09-21T15:07:23.919 INFO:teuthology.orchestra.run.smithi161.stdout:330 write 0xaefd8f7 thru 0xaf07adf (0xa1e9 bytes) 2024-09-21T15:07:23.920 INFO:teuthology.orchestra.run.smithi161.stdout:649 write 0xbfff608 thru 0xc009a0c (0xa405 bytes) 2024-09-21T15:07:23.929 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #3, image image_cluster1.client.mirror.3-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent4 2024-09-21T15:07:23.930 INFO:teuthology.orchestra.run.smithi161.stdout:295 read 0x50f11fc thru 0x50faded (0x9bf2 bytes) 2024-09-21T15:07:23.930 INFO:teuthology.orchestra.run.smithi161.stdout:296 writesame 0x46d99be thru 0x46e928e data_size 0x1(0xf8d1 bytes) 2024-09-21T15:07:23.934 INFO:teuthology.orchestra.run.smithi161.stdout:650 write 0x91113a thru 0x916a6a (0x5931 bytes) 2024-09-21T15:07:23.944 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.944 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.948 INFO:teuthology.orchestra.run.smithi161.stdout:160 punch from 0x6969112 to 0x696b7c0, (0x26ae bytes) 2024-09-21T15:07:23.951 INFO:teuthology.orchestra.run.smithi161.stdout:335 trunc from 0xddef944 to 0xa276377 2024-09-21T15:07:23.957 INFO:teuthology.orchestra.run.smithi161.stdout:297 read 0xaabce18 thru 0xaacb995 (0xeb7e bytes) 2024-09-21T15:07:23.959 INFO:teuthology.orchestra.run.smithi161.stdout:651 write 0xb50e3dc thru 0xb519d61 (0xb986 bytes) 2024-09-21T15:07:23.966 INFO:teuthology.orchestra.run.smithi161.stdout:652 punch from 0x1adf4ac to 0x1ae1d0b, (0x285f bytes) 2024-09-21T15:07:23.967 INFO:teuthology.orchestra.run.smithi161.stdout:653 writesame 0x71ab3d0 thru 0x71b0679 data_size 0x3(0x52aa bytes) 2024-09-21T15:07:23.974 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.974 INFO:teuthology.orchestra.run.smithi161.stdout:656 writesame 0x2134470 thru 0x2138583 data_size 0x23(0x4114 bytes) 2024-09-21T15:07:23.975 INFO:teuthology.orchestra.run.smithi161.stdout:298 trunc from 0xaba22b6 to 0xec3f9f 2024-09-21T15:07:23.979 INFO:teuthology.orchestra.run.smithi161.stdout:161 writesame 0x9f840bb thru 0x9f8705c data_size 0x43(0x2fa2 bytes) 2024-09-21T15:07:23.984 INFO:teuthology.orchestra.run.smithi161.stdout:381 write 0x7102ab9 thru 0x71113f3 (0xe93b bytes) 2024-09-21T15:07:23.987 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.987 INFO:teuthology.orchestra.run.smithi161.stdout:164 read 0x3f4f4f6 thru 0x3f5dab9 (0xe5c4 bytes) 2024-09-21T15:07:23.987 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.987 INFO:teuthology.orchestra.run.smithi161.stdout:658 punch from 0x2aa2c20 to 0x2aab29c, (0x867c bytes) 2024-09-21T15:07:23.987 INFO:teuthology.orchestra.run.smithi161.stdout:659 write 0x51d52d8 thru 0x51d623f (0xf68 bytes) 2024-09-21T15:07:23.988 INFO:teuthology.orchestra.run.smithi161.stdout:166 writesame 0x2e088bb thru 0x2e15fc3 data_size 0x1(0xd709 bytes) 2024-09-21T15:07:23.989 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.989 INFO:teuthology.orchestra.run.smithi161.stdout:337 punch from 0x3b9cfa2 to 0x3b9d497, (0x4f5 bytes) 2024-09-21T15:07:23.989 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.989 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.990 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:23.990 INFO:teuthology.orchestra.run.smithi161.stdout:341 read 0x321bca4 thru 0x32285be (0xc91b bytes) 2024-09-21T15:07:24.001 INFO:teuthology.orchestra.run.smithi161.stdout:660 write 0xac732aa thru 0xac74012 (0xd69 bytes) 2024-09-21T15:07:24.002 INFO:teuthology.orchestra.run.smithi161.stdout:345 trunc from 0xa276377 to 0x3cf6fa7 2024-09-21T15:07:24.003 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.003 INFO:teuthology.orchestra.run.smithi161.stdout:386 read 0x30d0215 thru 0x30d0a8f (0x87b bytes) 2024-09-21T15:07:24.004 INFO:teuthology.orchestra.run.smithi161.stdout:239 punch from 0xbd51657 to 0xbd5890c, (0x72b5 bytes) 2024-09-21T15:07:24.013 INFO:teuthology.orchestra.run.smithi161.stdout:388 trunc from 0x71113f4 to 0x21c8740 2024-09-21T15:07:24.027 INFO:teuthology.orchestra.run.smithi161.stdout:661 read 0x3251023 thru 0x325421e (0x31fc bytes) 2024-09-21T15:07:24.028 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.028 INFO:teuthology.orchestra.run.smithi161.stdout:664 read 0x2693253 thru 0x269925d (0x600b bytes) 2024-09-21T15:07:24.030 INFO:teuthology.orchestra.run.smithi161.stdout:665 read 0xae78090 thru 0xae810c8 (0x9039 bytes) 2024-09-21T15:07:24.031 INFO:teuthology.orchestra.run.smithi161.stdout:666 punch from 0x537a1c7 to 0x537d840, (0x3679 bytes) 2024-09-21T15:07:24.031 INFO:teuthology.orchestra.run.smithi161.stdout:667 read 0xdf3326 thru 0xdf3422 (0xfd bytes) 2024-09-21T15:07:24.031 INFO:teuthology.orchestra.run.smithi161.stdout:668 write 0xbc60494 thru 0xbc663fc (0x5f69 bytes) 2024-09-21T15:07:24.036 INFO:teuthology.orchestra.run.smithi161.stdout:167 write 0x6d6c78c thru 0x6d71cd6 (0x554b bytes) 2024-09-21T15:07:24.045 INFO:teuthology.orchestra.run.smithi161.stdout:669 writesame 0x136a104 thru 0x13745d3 data_size 0x18(0xa4d0 bytes) 2024-09-21T15:07:24.050 INFO:teuthology.orchestra.run.smithi161.stdout:168 punch from 0x1d9bdd2 to 0x1da7da6, (0xbfd4 bytes) 2024-09-21T15:07:24.050 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.050 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xec22750 2024-09-21T15:07:24.053 INFO:teuthology.orchestra.run.smithi161.stdout:670 read 0x334d1e0 thru 0x334fd53 (0x2b74 bytes) 2024-09-21T15:07:24.054 INFO:teuthology.orchestra.run.smithi161.stdout:671 write 0x31c8fda thru 0x31d4817 (0xb83e bytes) 2024-09-21T15:07:24.061 INFO:teuthology.orchestra.run.smithi161.stdout:672 read 0x3b9be4c thru 0x3ba8e39 (0xcfee bytes) 2024-09-21T15:07:24.062 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.062 INFO:teuthology.orchestra.run.smithi161.stdout:675 read 0x77a654f thru 0x77aa4fd (0x3faf bytes) 2024-09-21T15:07:24.063 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.063 INFO:teuthology.orchestra.run.smithi161.stdout:678 read 0x2e57783 thru 0x2e60b7a (0x93f8 bytes) 2024-09-21T15:07:24.063 INFO:teuthology.orchestra.run.smithi161.stdout:679 clone 2 order 18 su 131072 sc 2 2024-09-21T15:07:24.066 INFO:teuthology.orchestra.run.smithi161.stdout:346 write 0x1484aae thru 0x1487ae5 (0x3038 bytes) 2024-09-21T15:07:24.066 INFO:teuthology.orchestra.run.smithi161.stdout:241 trunc from 0xebc46b8 to 0x4ef9f6e 2024-09-21T15:07:24.067 INFO:teuthology.orchestra.run.smithi161.stdout:170 trunc from 0x9f8705d to 0xec22750 2024-09-21T15:07:24.068 INFO:teuthology.orchestra.run.smithi161.stdout:391 punch from 0x8f59b4 to 0x8fdcf7, (0x8343 bytes) 2024-09-21T15:07:24.068 INFO:teuthology.orchestra.run.smithi161.stdout:392 read 0x74b543 thru 0x7524ee (0x6fac bytes) 2024-09-21T15:07:24.069 INFO:teuthology.orchestra.run.smithi161.stdout:393 read 0x41f87a thru 0x41feb1 (0x638 bytes) 2024-09-21T15:07:24.069 INFO:teuthology.orchestra.run.smithi161.stdout:396 read 0xb82f5d thru 0xb8b602 (0x86a6 bytes) 2024-09-21T15:07:24.077 INFO:teuthology.orchestra.run.smithi161.stdout:347 punch from 0x2fea4e9 to 0x2ff9d2c, (0xf843 bytes) 2024-09-21T15:07:24.085 INFO:teuthology.orchestra.run.smithi161.stdout:397 trunc from 0x21c8740 to 0xb90194c 2024-09-21T15:07:24.096 INFO:teuthology.orchestra.run.smithi161.stdout:171 write 0x312a9cf thru 0x312da05 (0x3037 bytes) 2024-09-21T15:07:24.096 INFO:teuthology.orchestra.run.smithi161.stdout:242 read 0x2ec6ddf thru 0x2ecf0b4 (0x82d6 bytes) 2024-09-21T15:07:24.097 INFO:teuthology.orchestra.run.smithi161.stdout:243 punch from 0x2060678 to 0x2069eb9, (0x9841 bytes) 2024-09-21T15:07:24.097 INFO:teuthology.orchestra.run.smithi161.stdout:246 punch from 0x7054a6 to 0x705ac2, (0x61c bytes) 2024-09-21T15:07:24.107 INFO:teuthology.orchestra.run.smithi161.stdout:398 punch from 0x4e68eae to 0x4e70605, (0x7757 bytes) 2024-09-21T15:07:24.107 INFO:teuthology.orchestra.run.smithi161.stdout:399 write 0xa5ca391 thru 0xa5ce52e (0x419e bytes) 2024-09-21T15:07:24.111 INFO:teuthology.orchestra.run.smithi161.stdout:348 write 0x8849781 thru 0x884fd45 (0x65c5 bytes) 2024-09-21T15:07:24.113 INFO:teuthology.orchestra.run.smithi161.stdout:173 read 0xa89189f thru 0xa89fd64 (0xe4c6 bytes) 2024-09-21T15:07:24.114 INFO:teuthology.orchestra.run.smithi161.stdout:175 writesame 0xb03b1fd thru 0xb0456ab data_size 0x3(0xa4af bytes) 2024-09-21T15:07:24.128 INFO:teuthology.orchestra.run.smithi161.stdout:401 write 0x13d6a4 thru 0x141873 (0x41d0 bytes) 2024-09-21T15:07:24.140 INFO:teuthology.orchestra.run.smithi161.stdout:177 read 0x5548220 thru 0x5551843 (0x9624 bytes) 2024-09-21T15:07:24.141 INFO:teuthology.orchestra.run.smithi161.stdout:349 trunc from 0x884fd46 to 0xbe4d5f4 2024-09-21T15:07:24.149 INFO:teuthology.orchestra.run.smithi161.stdout:178 trunc from 0xec22750 to 0xafab2ca 2024-09-21T15:07:24.149 INFO:teuthology.orchestra.run.smithi161.stdout:404 trunc from 0xb90194c to 0xc44546e 2024-09-21T15:07:24.153 INFO:teuthology.orchestra.run.smithi161.stdout:248 writesame 0xe66e87a thru 0xe67a14a data_size 0x15(0xb8d1 bytes) 2024-09-21T15:07:24.155 INFO:teuthology.orchestra.run.smithi161.stdout:299 writesame 0xab7233f thru 0xab77a19 data_size 0x1(0x56db bytes) 2024-09-21T15:07:24.157 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.157 INFO:teuthology.orchestra.run.smithi161.stdout:250 read 0x2be2185 thru 0x2bea322 (0x819e bytes) 2024-09-21T15:07:24.160 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.166 INFO:teuthology.orchestra.run.smithi161.stdout:251 trunc from 0xe67a14b to 0x9eb4c8a 2024-09-21T15:07:24.173 INFO:teuthology.orchestra.run.smithi161.stdout:350 read 0x8fda984 thru 0x8fea207 (0xf884 bytes) 2024-09-21T15:07:24.173 INFO:teuthology.orchestra.run.smithi161.stdout:301 trunc from 0xab77a1a to 0x3fe0933 2024-09-21T15:07:24.174 INFO:teuthology.orchestra.run.smithi161.stdout:351 read 0x8a1f991 thru 0x8a26731 (0x6da1 bytes) 2024-09-21T15:07:24.176 INFO:teuthology.orchestra.run.smithi161.stdout:353 trunc from 0xbe4d5f4 to 0xa95a9e1 2024-09-21T15:07:24.189 INFO:teuthology.orchestra.run.smithi161.stdout:406 write 0xbc1b46a thru 0xbc29266 (0xddfd bytes) 2024-09-21T15:07:24.208 INFO:teuthology.orchestra.run.smithi161.stdout:252 read 0x7201a2e thru 0x72077ed (0x5dc0 bytes) 2024-09-21T15:07:24.209 INFO:teuthology.orchestra.run.smithi161.stdout:407 read 0x22f4afb thru 0x22fe678 (0x9b7e bytes) 2024-09-21T15:07:24.209 INFO:teuthology.orchestra.run.smithi161.stdout:409 punch from 0x2d83425 to 0x2d8bdf3, (0x89ce bytes) 2024-09-21T15:07:24.209 INFO:teuthology.orchestra.run.smithi161.stdout:410 read 0x3e68b90 thru 0x3e6e12a (0x559b bytes) 2024-09-21T15:07:24.209 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.209 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.209 INFO:teuthology.orchestra.run.smithi161.stdout:413 read 0x3da0efd thru 0x3dabe31 (0xaf35 bytes) 2024-09-21T15:07:24.210 INFO:teuthology.orchestra.run.smithi161.stdout:415 write 0x977140d thru 0x9775f90 (0x4b84 bytes) 2024-09-21T15:07:24.215 INFO:teuthology.orchestra.run.smithi161.stdout:355 read 0xb84978 thru 0xb93c13 (0xf29c bytes) 2024-09-21T15:07:24.217 INFO:teuthology.orchestra.run.smithi161.stdout:302 write 0x39548ad thru 0x3959289 (0x49dd bytes) 2024-09-21T15:07:24.222 INFO:teuthology.orchestra.run.smithi161.stdout:417 read 0x80692bb thru 0x8071fe1 (0x8d27 bytes) 2024-09-21T15:07:24.223 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.223 INFO:teuthology.orchestra.run.smithi161.stdout:419 read 0x1b86d14 thru 0x1b8ac73 (0x3f60 bytes) 2024-09-21T15:07:24.223 INFO:teuthology.orchestra.run.smithi161.stdout:421 writesame 0x246f13c thru 0x247af1d data_size 0x5(0xbde2 bytes) 2024-09-21T15:07:24.225 INFO:teuthology.orchestra.run.smithi161.stdout:179 write 0xc2cab8c thru 0xc2da0ed (0xf562 bytes) 2024-09-21T15:07:24.231 INFO:teuthology.orchestra.run.smithi161.stdout:253 write 0xa042391 thru 0xa051b0f (0xf77f bytes) 2024-09-21T15:07:24.241 INFO:teuthology.orchestra.run.smithi161.stdout:180 read 0x79f48aa thru 0x7a01323 (0xca7a bytes) 2024-09-21T15:07:24.241 INFO:teuthology.orchestra.run.smithi161.stdout:181 writesame 0x97aaab2 thru 0x97b264d data_size 0x36(0x7b9c bytes) 2024-09-21T15:07:24.242 INFO:teuthology.orchestra.run.smithi161.stdout:422 writesame 0x71e1584 thru 0x71ed6d3 data_size 0x18(0xc150 bytes) 2024-09-21T15:07:24.242 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.242 INFO:teuthology.orchestra.run.smithi161.stdout:305 write 0x3c893a2 thru 0x3c90b15 (0x7774 bytes) 2024-09-21T15:07:24.249 INFO:teuthology.orchestra.run.smithi161.stdout:356 writesame 0xbcb68df thru 0xbcc5c9e data_size 0x27(0xf3c0 bytes) 2024-09-21T15:07:24.255 INFO:teuthology.orchestra.run.smithi161.stdout:184 read 0xb4232f8 thru 0xb43082d (0xd536 bytes) 2024-09-21T15:07:24.256 INFO:teuthology.orchestra.run.smithi161.stdout:185 writesame 0xbd17637 thru 0xbd1cffc data_size 0x1(0x59c6 bytes) 2024-09-21T15:07:24.256 INFO:teuthology.orchestra.run.smithi161.stdout:357 write 0x223e1a8 thru 0x224a1af (0xc008 bytes) 2024-09-21T15:07:24.261 INFO:teuthology.orchestra.run.smithi161.stdout:423 trunc from 0xc44546e to 0x8fce875 2024-09-21T15:07:24.270 INFO:teuthology.orchestra.run.smithi161.stdout:359 write 0x72d1556 thru 0x72d9d7f (0x882a bytes) 2024-09-21T15:07:24.286 INFO:teuthology.orchestra.run.smithi161.stdout:362 punch from 0xa54b678 to 0xa555c6e, (0xa5f6 bytes) 2024-09-21T15:07:24.286 INFO:teuthology.orchestra.run.smithi161.stdout:364 punch from 0x62f3a09 to 0x63039ca, (0xffc1 bytes) 2024-09-21T15:07:24.286 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.286 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.293 INFO:teuthology.orchestra.run.smithi161.stdout:255 write 0xa51271f thru 0xa51e7d5 (0xc0b7 bytes) 2024-09-21T15:07:24.300 INFO:teuthology.orchestra.run.smithi161.stdout:186 trunc from 0xc2da0ee to 0x403e4e7 2024-09-21T15:07:24.302 INFO:teuthology.orchestra.run.smithi161.stdout:368 trunc from 0xbcc5c9f to 0x426ce9f 2024-09-21T15:07:24.313 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.313 INFO:teuthology.orchestra.run.smithi161.stdout:257 write 0x7dbab2a thru 0x7dbfdde (0x52b5 bytes) 2024-09-21T15:07:24.314 INFO:teuthology.orchestra.run.smithi161.stdout:306 write 0xa26e04c thru 0xa27d58b (0xf540 bytes) 2024-09-21T15:07:24.335 INFO:teuthology.orchestra.run.smithi161.stdout:258 writesame 0x9a09448 thru 0x9a102f9 data_size 0x3(0x6eb2 bytes) 2024-09-21T15:07:24.338 INFO:teuthology.orchestra.run.smithi161.stdout:308 read 0x6dd050c thru 0x6ddc655 (0xc14a bytes) 2024-09-21T15:07:24.338 INFO:teuthology.orchestra.run.smithi161.stdout:309 read 0x8ad071d thru 0x8adaea0 (0xa784 bytes) 2024-09-21T15:07:24.339 INFO:teuthology.orchestra.run.smithi161.stdout:424 trunc from 0x8fce875 to 0x2b749af 2024-09-21T15:07:24.339 INFO:teuthology.orchestra.run.smithi161.stdout:310 read 0x4e343b4 thru 0x4e3fd23 (0xb970 bytes) 2024-09-21T15:07:24.339 INFO:teuthology.orchestra.run.smithi161.stdout:311 read 0x2216b10 thru 0x221f2a0 (0x8791 bytes) 2024-09-21T15:07:24.340 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.340 INFO:teuthology.orchestra.run.smithi161.stdout:314 read 0x9e3bc61 thru 0x9e4731f (0xb6bf bytes) 2024-09-21T15:07:24.340 INFO:teuthology.orchestra.run.smithi161.stdout:315 write 0x4725272 thru 0x4730910 (0xb69f bytes) 2024-09-21T15:07:24.352 INFO:teuthology.orchestra.run.smithi161.stdout:259 writesame 0x51b404e thru 0x51bc819 data_size 0x6(0x87cc bytes) 2024-09-21T15:07:24.356 INFO:teuthology.orchestra.run.smithi161.stdout:187 punch from 0x33b2540 to 0x33be044, (0xbb04 bytes) 2024-09-21T15:07:24.356 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.367 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.367 INFO:teuthology.orchestra.run.smithi161.stdout:261 punch from 0x76c95fd to 0x76d74b6, (0xdeb9 bytes) 2024-09-21T15:07:24.367 INFO:teuthology.orchestra.run.smithi161.stdout:262 read 0x2571153 thru 0x25768c0 (0x576e bytes) 2024-09-21T15:07:24.373 INFO:teuthology.orchestra.run.smithi161.stdout:369 flatten 2024-09-21T15:07:24.374 INFO:teuthology.orchestra.run.smithi161.stdout:263 trunc from 0xa51e7d6 to 0xce02eb0 2024-09-21T15:07:24.374 INFO:teuthology.orchestra.run.smithi161.stdout:425 read 0x211161d thru 0x21125dd (0xfc1 bytes) 2024-09-21T15:07:24.374 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xee0d054 2024-09-21T15:07:24.388 INFO:teuthology.orchestra.run.smithi161.stdout:317 writesame 0xb92421e thru 0xb92c45f data_size 0x1(0x8242 bytes) 2024-09-21T15:07:24.394 INFO:teuthology.orchestra.run.smithi161.stdout:320 write 0x35a0361 thru 0x35a525c (0x4efc bytes) 2024-09-21T15:07:24.395 INFO:teuthology.orchestra.run.smithi161.stdout:426 trunc from 0x2b749af to 0xee0d054 2024-09-21T15:07:24.402 INFO:teuthology.orchestra.run.smithi161.stdout:371 trunc from 0x426ce9f to 0x15e1713 2024-09-21T15:07:24.403 INFO:teuthology.orchestra.run.smithi161.stdout:264 write 0xb473de2 thru 0xb47a5f5 (0x6814 bytes) 2024-09-21T15:07:24.410 INFO:teuthology.orchestra.run.smithi161.stdout:190 writesame 0xe4972dc thru 0xe49875e data_size 0x1(0x1483 bytes) 2024-09-21T15:07:24.414 INFO:teuthology.orchestra.run.smithi161.stdout:321 write 0xaad5cdd thru 0xaad8f5b (0x327f bytes) 2024-09-21T15:07:24.417 INFO:teuthology.orchestra.run.smithi161.stdout:191 punch from 0x4c8f220 to 0x4c950e6, (0x5ec6 bytes) 2024-09-21T15:07:24.417 INFO:teuthology.orchestra.run.smithi161.stdout:192 punch from 0xbdf1931 to 0xbdf6f34, (0x5603 bytes) 2024-09-21T15:07:24.417 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.420 INFO:teuthology.orchestra.run.smithi161.stdout:265 read 0xca72424 thru 0xca75c24 (0x3801 bytes) 2024-09-21T15:07:24.424 INFO:teuthology.orchestra.run.smithi161.stdout:266 trunc from 0xce02eb0 to 0xb38369d 2024-09-21T15:07:24.429 INFO:teuthology.orchestra.run.smithi161.stdout:195 trunc from 0xe49875f to 0x861f8ba 2024-09-21T15:07:24.431 INFO:teuthology.orchestra.run.smithi161.stdout:427 write 0x1606bf0 thru 0x1608f8a (0x239b bytes) 2024-09-21T15:07:24.440 INFO:teuthology.orchestra.run.smithi161.stdout:373 read 0x112fc69 thru 0x113b728 (0xbac0 bytes) 2024-09-21T15:07:24.440 INFO:teuthology.orchestra.run.smithi161.stdout:322 trunc from 0xb92c460 to 0x7321f20 2024-09-21T15:07:24.443 INFO:teuthology.orchestra.run.smithi161.stdout:429 read 0x81a3fc3 thru 0x81b252c (0xe56a bytes) 2024-09-21T15:07:24.443 INFO:teuthology.orchestra.run.smithi161.stdout:430 punch from 0xd383d5a to 0xd38d2f4, (0x959a bytes) 2024-09-21T15:07:24.443 INFO:teuthology.orchestra.run.smithi161.stdout:431 read 0xa7fa159 thru 0xa80426f (0xa117 bytes) 2024-09-21T15:07:24.444 INFO:teuthology.orchestra.run.smithi161.stdout:432 read 0x39bb3c5 thru 0x39bd75f (0x239b bytes) 2024-09-21T15:07:24.444 INFO:teuthology.orchestra.run.smithi161.stdout:433 punch from 0xc62e61b to 0xc6300e5, (0x1aca bytes) 2024-09-21T15:07:24.444 INFO:teuthology.orchestra.run.smithi161.stdout:434 writesame 0x198df48 thru 0x1994847 data_size 0x50(0x6900 bytes) 2024-09-21T15:07:24.464 INFO:teuthology.orchestra.run.smithi161.stdout:435 write 0xe22ac5d thru 0xe2377cc (0xcb70 bytes) 2024-09-21T15:07:24.472 INFO:teuthology.orchestra.run.smithi161.stdout:196 read 0xcc4112 thru 0xcd0bc3 (0xcab2 bytes) 2024-09-21T15:07:24.475 INFO:teuthology.orchestra.run.smithi161.stdout:197 trunc from 0x861f8ba to 0x924ff3a 2024-09-21T15:07:24.476 INFO:teuthology.orchestra.run.smithi161.stdout:436 read 0x2c55dbe thru 0x2c55f5a (0x19d bytes) 2024-09-21T15:07:24.477 INFO:teuthology.orchestra.run.smithi161.stdout:437 write 0x4a3ee8b thru 0x4a4e12f (0xf2a5 bytes) 2024-09-21T15:07:24.480 INFO:teuthology.orchestra.run.smithi161.stdout:374 writesame 0x51cd21d thru 0x51d8be6 data_size 0x3(0xb9ca bytes) 2024-09-21T15:07:24.481 INFO:teuthology.orchestra.run.smithi161.stdout:267 trunc from 0xb38369d to 0xe115267 2024-09-21T15:07:24.490 INFO:teuthology.orchestra.run.smithi161.stdout:439 punch from 0xb50ee1 to 0xb5345b, (0x257a bytes) 2024-09-21T15:07:24.490 INFO:teuthology.orchestra.run.smithi161.stdout:440 write 0xc2f508c thru 0xc2fcc3b (0x7bb0 bytes) 2024-09-21T15:07:24.497 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.497 INFO:teuthology.orchestra.run.smithi161.stdout:324 write 0x55f1f56 thru 0x55fcdde (0xae89 bytes) 2024-09-21T15:07:24.512 INFO:teuthology.orchestra.run.smithi161.stdout:441 read 0xa04916e thru 0xa05750b (0xe39e bytes) 2024-09-21T15:07:24.512 INFO:teuthology.orchestra.run.smithi161.stdout:444 punch from 0x1b08f8 to 0x1b2f7c, (0x2684 bytes) 2024-09-21T15:07:24.512 INFO:teuthology.orchestra.run.smithi161.stdout:445 writesame 0x5027abc thru 0x50354d6 data_size 0xd(0xda1b bytes) 2024-09-21T15:07:24.515 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.516 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.516 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.516 INFO:teuthology.orchestra.run.smithi161.stdout:272 read 0x1fff74 thru 0x20fbe9 (0xfc76 bytes) 2024-09-21T15:07:24.517 INFO:teuthology.orchestra.run.smithi161.stdout:273 write 0x13f6dcb thru 0x140040a (0x9640 bytes) 2024-09-21T15:07:24.530 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.530 INFO:teuthology.orchestra.run.smithi161.stdout:447 write 0xbae3fc4 thru 0xbaf2d32 (0xed6f bytes) 2024-09-21T15:07:24.530 INFO:teuthology.orchestra.run.smithi161.stdout:325 read 0x37e3d77 thru 0x37eb2af (0x7539 bytes) 2024-09-21T15:07:24.532 INFO:teuthology.orchestra.run.smithi161.stdout:326 read 0x5b358c2 thru 0x5b4563c (0xfd7b bytes) 2024-09-21T15:07:24.532 INFO:teuthology.orchestra.run.smithi161.stdout:327 read 0x250e30b thru 0x251262c (0x4322 bytes) 2024-09-21T15:07:24.539 INFO:teuthology.orchestra.run.smithi161.stdout:274 write 0x83406f8 thru 0x834cffc (0xc905 bytes) 2024-09-21T15:07:24.544 INFO:teuthology.orchestra.run.smithi161.stdout:449 write 0xc05550b thru 0xc05ac32 (0x5728 bytes) 2024-09-21T15:07:24.545 INFO:teuthology.orchestra.run.smithi161.stdout:198 writesame 0xe91e7b2 thru 0xe92a751 data_size 0x38(0xbfa0 bytes) 2024-09-21T15:07:24.545 INFO:teuthology.orchestra.run.smithi161.stdout:377 write 0x62c87e3 thru 0x62ceb0d (0x632b bytes) 2024-09-21T15:07:24.552 INFO:teuthology.orchestra.run.smithi161.stdout:199 writesame 0x4493e98 thru 0x4494e7c data_size 0x1(0xfe5 bytes) 2024-09-21T15:07:24.555 INFO:teuthology.orchestra.run.smithi161.stdout:378 read 0x300e908 thru 0x30127da (0x3ed3 bytes) 2024-09-21T15:07:24.555 INFO:teuthology.orchestra.run.smithi161.stdout:275 writesame 0x41c1714 thru 0x41c32c8 data_size 0x1(0x1bb5 bytes) 2024-09-21T15:07:24.556 INFO:teuthology.orchestra.run.smithi161.stdout:379 read 0x22b17d4 thru 0x22bb4c3 (0x9cf0 bytes) 2024-09-21T15:07:24.557 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.557 INFO:teuthology.orchestra.run.smithi161.stdout:381 writesame 0x60e10cc thru 0x60e5b9e data_size 0x5(0x4ad3 bytes) 2024-09-21T15:07:24.557 INFO:teuthology.orchestra.run.smithi161.stdout:451 writesame 0x4c9dd1e thru 0x4ca2fba data_size 0x1(0x529d bytes) 2024-09-21T15:07:24.569 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.569 INFO:teuthology.orchestra.run.smithi161.stdout:202 writesame 0x596f1a9 thru 0x59707ca data_size 0x1(0x1622 bytes) 2024-09-21T15:07:24.571 INFO:teuthology.orchestra.run.smithi161.stdout:276 writesame 0x7f7d7a6 thru 0x7f82c74 data_size 0x3(0x54cf bytes) 2024-09-21T15:07:24.576 INFO:teuthology.orchestra.run.smithi161.stdout:383 read 0xb37f5f thru 0xb3de46 (0x5ee8 bytes) 2024-09-21T15:07:24.576 INFO:teuthology.orchestra.run.smithi161.stdout:328 writesame 0x972f715 thru 0x973aa55 data_size 0x1(0xb341 bytes) 2024-09-21T15:07:24.577 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.577 INFO:teuthology.orchestra.run.smithi161.stdout:389 punch from 0x56d941e to 0x56e820b, (0xeded bytes) 2024-09-21T15:07:24.582 INFO:teuthology.orchestra.run.smithi161.stdout:452 write 0x825fdc4 thru 0x8265ae2 (0x5d1f bytes) 2024-09-21T15:07:24.583 INFO:teuthology.orchestra.run.smithi161.stdout:203 write 0x316e157 thru 0x317a3df (0xc289 bytes) 2024-09-21T15:07:24.590 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.590 INFO:teuthology.orchestra.run.smithi161.stdout:281 trunc from 0xe115267 to 0xe10362e 2024-09-21T15:07:24.593 INFO:teuthology.orchestra.run.smithi161.stdout:204 read 0xc029642 thru 0xc03797e (0xe33d bytes) 2024-09-21T15:07:24.593 INFO:teuthology.orchestra.run.smithi161.stdout:205 write 0x79cd2fd thru 0x79dc92c (0xf630 bytes) 2024-09-21T15:07:24.598 INFO:teuthology.orchestra.run.smithi161.stdout:453 read 0xd9c5a45 thru 0xd9ca2f5 (0x48b1 bytes) 2024-09-21T15:07:24.599 INFO:teuthology.orchestra.run.smithi161.stdout:454 write 0xb81e1e0 thru 0xb82611d (0x7f3e bytes) 2024-09-21T15:07:24.606 INFO:teuthology.orchestra.run.smithi161.stdout:206 write 0x3b0c912 thru 0x3b1b45b (0xeb4a bytes) 2024-09-21T15:07:24.609 INFO:teuthology.orchestra.run.smithi161.stdout:455 write 0x9172c04 thru 0x9180d1f (0xe11c bytes) 2024-09-21T15:07:24.613 INFO:teuthology.orchestra.run.smithi161.stdout:207 read 0x21969a4 thru 0x219f45e (0x8abb bytes) 2024-09-21T15:07:24.613 INFO:teuthology.orchestra.run.smithi161.stdout:210 write 0x44e11dc thru 0x44e24ce (0x12f3 bytes) 2024-09-21T15:07:24.614 INFO:teuthology.orchestra.run.smithi161.stdout:390 write 0x8316a84 thru 0x831e397 (0x7914 bytes) 2024-09-21T15:07:24.624 INFO:teuthology.orchestra.run.smithi161.stdout:211 punch from 0x850d91e to 0x8517244, (0x9926 bytes) 2024-09-21T15:07:24.624 INFO:teuthology.orchestra.run.smithi161.stdout:212 punch from 0x8bc1bc6 to 0x8bc4833, (0x2c6d bytes) 2024-09-21T15:07:24.624 INFO:teuthology.orchestra.run.smithi161.stdout:214 punch from 0xabbeceb to 0xabc7cf2, (0x9007 bytes) 2024-09-21T15:07:24.629 INFO:teuthology.orchestra.run.smithi161.stdout:456 read 0xd47cae5 thru 0xd487cb0 (0xb1cc bytes) 2024-09-21T15:07:24.631 INFO:teuthology.orchestra.run.smithi161.stdout:282 punch from 0x79d9e22 to 0x79e29bc, (0x8b9a bytes) 2024-09-21T15:07:24.631 INFO:teuthology.orchestra.run.smithi161.stdout:329 write 0xedd1d53 thru 0xedd877b (0x6a29 bytes) 2024-09-21T15:07:24.632 INFO:teuthology.orchestra.run.smithi161.stdout:283 writesame 0x5dde85d thru 0x5de6ea8 data_size 0x5a(0x864c bytes) 2024-09-21T15:07:24.635 INFO:teuthology.orchestra.run.smithi161.stdout:215 trunc from 0xe92a752 to 0xa97f716 2024-09-21T15:07:24.637 INFO:teuthology.orchestra.run.smithi161.stdout:392 writesame 0x3f86a57 thru 0x3f9583e data_size 0x2e(0xede8 bytes) 2024-09-21T15:07:24.642 INFO:teuthology.orchestra.run.smithi161.stdout:457 trunc from 0xee0d054 to 0x8c03526 2024-09-21T15:07:24.643 INFO:teuthology.orchestra.run.smithi161.stdout:285 write 0x2bc7601 thru 0x2bd12b3 (0x9cb3 bytes) 2024-09-21T15:07:24.655 INFO:teuthology.orchestra.run.smithi161.stdout:330 trunc from 0xedd877c to 0xe152c40 2024-09-21T15:07:24.663 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.663 INFO:teuthology.orchestra.run.smithi161.stdout:287 read 0x4da4427 thru 0x4db04d6 (0xc0b0 bytes) 2024-09-21T15:07:24.664 INFO:teuthology.orchestra.run.smithi161.stdout:289 write 0xd84688a thru 0xd84b525 (0x4c9c bytes) 2024-09-21T15:07:24.683 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.684 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.684 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.684 INFO:teuthology.orchestra.run.smithi161.stdout:293 write 0xabb42ed thru 0xabc08af (0xc5c3 bytes) 2024-09-21T15:07:24.695 INFO:teuthology.orchestra.run.smithi161.stdout:393 writesame 0x930a662 thru 0x93129fd data_size 0x2(0x839c bytes) 2024-09-21T15:07:24.697 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone1 from 0xc009a0d (overlap 0x354292) to 0x254833 2024-09-21T15:07:24.699 INFO:teuthology.orchestra.run.smithi161.stdout:294 writesame 0x3020499 thru 0x30207bd data_size 0x7(0x325 bytes) 2024-09-21T15:07:24.708 INFO:teuthology.orchestra.run.smithi161.stdout:332 read 0xdb5a6cf thru 0xdb68d8f (0xe6c1 bytes) 2024-09-21T15:07:24.710 INFO:teuthology.orchestra.run.smithi161.stdout:216 write 0xe7467d1 thru 0xe74c607 (0x5e37 bytes) 2024-09-21T15:07:24.712 INFO:teuthology.orchestra.run.smithi161.stdout:394 trunc from 0x93129fe to 0xc884313 2024-09-21T15:07:24.715 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.722 INFO:teuthology.orchestra.run.smithi161.stdout:295 read 0x86e8e08 thru 0x86f4897 (0xba90 bytes) 2024-09-21T15:07:24.723 INFO:teuthology.orchestra.run.smithi161.stdout:217 read 0x419ed7a thru 0x41a9b62 (0xade9 bytes) 2024-09-21T15:07:24.723 INFO:teuthology.orchestra.run.smithi161.stdout:218 write 0xc5d5525 thru 0xc5d7035 (0x1b11 bytes) 2024-09-21T15:07:24.723 INFO:teuthology.orchestra.run.smithi161.stdout:296 writesame 0x6cd2a19 thru 0x6ce1d1d data_size 0x1(0xf305 bytes) 2024-09-21T15:07:24.725 INFO:teuthology.orchestra.run.smithi161.stdout:334 trunc from 0xe152c40 to 0x5b61f8b 2024-09-21T15:07:24.747 INFO:teuthology.orchestra.run.smithi161.stdout:395 write 0x79018e4 thru 0x79039b6 (0x20d3 bytes) 2024-09-21T15:07:24.749 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.749 INFO:teuthology.orchestra.run.smithi161.stdout:221 read 0x4bda79c thru 0x4be61b2 (0xba17 bytes) 2024-09-21T15:07:24.749 INFO:teuthology.orchestra.run.smithi161.stdout:222 writesame 0x850007f thru 0x850227a data_size 0x4b(0x21fc bytes) 2024-09-21T15:07:24.774 INFO:teuthology.orchestra.run.smithi161.stdout:223 write 0x792b83a thru 0x7936663 (0xae2a bytes) 2024-09-21T15:07:24.778 INFO:teuthology.orchestra.run.smithi161.stdout:297 read 0xc445553 thru 0xc4547aa (0xf258 bytes) 2024-09-21T15:07:24.778 INFO:teuthology.orchestra.run.smithi161.stdout:298 write 0x5bf73a2 thru 0x5c047d2 (0xd431 bytes) 2024-09-21T15:07:24.782 INFO:teuthology.orchestra.run.smithi161.stdout:459 writesame 0xdf4a2c8 thru 0xdf51e93 data_size 0x4c(0x7bcc bytes) 2024-09-21T15:07:24.785 INFO:teuthology.orchestra.run.smithi161.stdout:224 read 0x41cd58b thru 0x41d083d (0x32b3 bytes) 2024-09-21T15:07:24.786 INFO:teuthology.orchestra.run.smithi161.stdout:461 read 0x9c68523 thru 0x9c6853a (0x18 bytes) 2024-09-21T15:07:24.786 INFO:teuthology.orchestra.run.smithi161.stdout:225 write 0x3383495 thru 0x3389e87 (0x69f3 bytes) 2024-09-21T15:07:24.786 INFO:teuthology.orchestra.run.smithi161.stdout:335 trunc from 0x5b61f8b to 0xc3f63a 2024-09-21T15:07:24.793 INFO:teuthology.orchestra.run.smithi161.stdout:399 trunc from 0xc884313 to 0x2e54fbc 2024-09-21T15:07:24.795 INFO:teuthology.orchestra.run.smithi161.stdout:300 clone 6 order 23 su 4194304 sc 2 2024-09-21T15:07:24.797 INFO:teuthology.orchestra.run.smithi161.stdout:226 punch from 0x46c6111 to 0x46cd2e0, (0x71cf bytes) 2024-09-21T15:07:24.797 INFO:teuthology.orchestra.run.smithi161.stdout:227 read 0x4e4203c thru 0x4e4d712 (0xb6d7 bytes) 2024-09-21T15:07:24.799 INFO:teuthology.orchestra.run.smithi161.stdout:228 write 0x1e9182f thru 0x1e926ce (0xea0 bytes) 2024-09-21T15:07:24.800 INFO:teuthology.orchestra.run.smithi161.stdout:462 trunc from 0xdf51e94 to 0x63bfc41 2024-09-21T15:07:24.815 INFO:teuthology.orchestra.run.smithi161.stdout:229 read 0x1053fce thru 0x1056ffd (0x3030 bytes) 2024-09-21T15:07:24.815 INFO:teuthology.orchestra.run.smithi161.stdout:230 read 0xc8cb572 thru 0xc8d700c (0xba9b bytes) 2024-09-21T15:07:24.820 INFO:teuthology.orchestra.run.smithi161.stdout:231 trunc from 0xe74c608 to 0xbf94ff2 2024-09-21T15:07:24.838 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #0, image image_cluster1.client.mirror.2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent1 2024-09-21T15:07:24.850 INFO:teuthology.orchestra.run.smithi161.stdout:463 writesame 0x464a242 thru 0x4652cb4 data_size 0x1(0x8a73 bytes) 2024-09-21T15:07:24.851 INFO:teuthology.orchestra.run.smithi161.stdout:336 punch from 0x7ae798 to 0x7b4dae, (0x6616 bytes) 2024-09-21T15:07:24.851 INFO:teuthology.orchestra.run.smithi161.stdout:337 read 0x6458ae thru 0x652e28 (0xd57b bytes) 2024-09-21T15:07:24.852 INFO:teuthology.orchestra.run.smithi161.stdout:402 punch from 0x3a9f0c to 0x3b9669, (0xf75d bytes) 2024-09-21T15:07:24.878 INFO:teuthology.orchestra.run.smithi161.stdout:338 write 0x1eb38f6 thru 0x1ec1487 (0xdb92 bytes) 2024-09-21T15:07:24.880 INFO:teuthology.orchestra.run.smithi161.stdout:466 read 0x6248d48 thru 0x62536ef (0xa9a8 bytes) 2024-09-21T15:07:24.899 INFO:teuthology.orchestra.run.smithi161.stdout:403 write 0x4691c80 thru 0x469aebd (0x923e bytes) 2024-09-21T15:07:24.910 INFO:teuthology.orchestra.run.smithi161.stdout:404 read 0x2d206f3 thru 0x2d2935a (0x8c68 bytes) 2024-09-21T15:07:24.912 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.912 INFO:teuthology.orchestra.run.smithi161.stdout:406 punch from 0x445d96b to 0x4463685, (0x5d1a bytes) 2024-09-21T15:07:24.912 INFO:teuthology.orchestra.run.smithi161.stdout:408 writesame 0x1ef92e0 thru 0x1efb4b4 data_size 0x1(0x21d5 bytes) 2024-09-21T15:07:24.921 INFO:teuthology.orchestra.run.smithi161.stdout:232 writesame 0xcbdcac5 thru 0xcbe40c1 data_size 0x7(0x75fd bytes) 2024-09-21T15:07:24.923 INFO:teuthology.orchestra.run.smithi161.stdout:467 write 0x6ec147e thru 0x6ec1b30 (0x6b3 bytes) 2024-09-21T15:07:24.924 INFO:teuthology.orchestra.run.smithi161.stdout:409 read 0x40d7b55 thru 0x40dc9cc (0x4e78 bytes) 2024-09-21T15:07:24.924 INFO:teuthology.orchestra.run.smithi161.stdout:410 write 0x2605428 thru 0x2611504 (0xc0dd bytes) 2024-09-21T15:07:24.928 INFO:teuthology.orchestra.run.smithi161.stdout:233 read 0x86bc434 thru 0x86cc0fd (0xfcca bytes) 2024-09-21T15:07:24.933 INFO:teuthology.orchestra.run.smithi161.stdout:235 trunc from 0xcbe40c2 to 0xac30d6a 2024-09-21T15:07:24.945 INFO:teuthology.orchestra.run.smithi161.stdout:340 write 0x3648bf1 thru 0x36571af (0xe5bf bytes) 2024-09-21T15:07:24.979 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.979 INFO:teuthology.orchestra.run.smithi161.stdout:237 punch from 0x98a8bae to 0x98b3062, (0xa4b4 bytes) 2024-09-21T15:07:24.979 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:24.979 INFO:teuthology.orchestra.run.smithi161.stdout:239 read 0x29835fe thru 0x298a44d (0x6e50 bytes) 2024-09-21T15:07:24.980 INFO:teuthology.orchestra.run.smithi161.stdout:240 write 0x85ae76e thru 0x85b2c86 (0x4519 bytes) 2024-09-21T15:07:24.989 INFO:teuthology.orchestra.run.smithi161.stdout:411 write 0xa934343 thru 0xa9413a7 (0xd065 bytes) 2024-09-21T15:07:24.997 INFO:teuthology.orchestra.run.smithi161.stdout:242 trunc from 0xac30d6a to 0x9999fc4 2024-09-21T15:07:25.002 INFO:teuthology.orchestra.run.smithi161.stdout:468 write 0xd0106ab thru 0xd018493 (0x7de9 bytes) 2024-09-21T15:07:25.005 INFO:teuthology.orchestra.run.smithi161.stdout:414 writesame 0x86b834c thru 0x86c4a9e data_size 0x49(0xc753 bytes) 2024-09-21T15:07:25.010 INFO:teuthology.orchestra.run.smithi161.stdout:341 write 0x639d5b2 thru 0x63a40ea (0x6b39 bytes) 2024-09-21T15:07:25.015 INFO:teuthology.orchestra.run.smithi161.stdout:469 write 0xcd163a thru 0xcd495f (0x3326 bytes) 2024-09-21T15:07:25.016 INFO:teuthology.orchestra.run.smithi161.stdout:417 read 0x8276783 thru 0x827cf6e (0x67ec bytes) 2024-09-21T15:07:25.016 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.016 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.016 INFO:teuthology.orchestra.run.smithi161.stdout:421 read 0x31ca24c thru 0x31d57b3 (0xb568 bytes) 2024-09-21T15:07:25.017 INFO:teuthology.orchestra.run.smithi161.stdout:422 trunc from 0xa9413a8 to 0xa97f38b 2024-09-21T15:07:25.023 INFO:teuthology.orchestra.run.smithi161.stdout:243 read 0x63a3165 thru 0x63aa93c (0x77d8 bytes) 2024-09-21T15:07:25.031 INFO:teuthology.orchestra.run.smithi161.stdout:470 write 0x488a966 thru 0x48990e2 (0xe77d bytes) 2024-09-21T15:07:25.050 INFO:teuthology.orchestra.run.smithi161.stdout:471 punch from 0x849596 to 0x84b3f4, (0x1e5e bytes) 2024-09-21T15:07:25.050 INFO:teuthology.orchestra.run.smithi161.stdout:472 writesame 0x1d36e2 thru 0x1da8f3 data_size 0x5d(0x7212 bytes) 2024-09-21T15:07:25.062 INFO:teuthology.orchestra.run.smithi161.stdout:423 punch from 0x9aa9f62 to 0x9aab08f, (0x112d bytes) 2024-09-21T15:07:25.062 INFO:teuthology.orchestra.run.smithi161.stdout:424 read 0x7a8cf2c thru 0x7a9163f (0x4714 bytes) 2024-09-21T15:07:25.064 INFO:teuthology.orchestra.run.smithi161.stdout:473 write 0x38666fa thru 0x3866ee1 (0x7e8 bytes) 2024-09-21T15:07:25.065 INFO:teuthology.orchestra.run.smithi161.stdout:244 write 0xbbb7887 thru 0xbbb8d26 (0x14a0 bytes) 2024-09-21T15:07:25.071 INFO:teuthology.orchestra.run.smithi161.stdout:342 write 0x6e9cc25 thru 0x6ea69f9 (0x9dd5 bytes) 2024-09-21T15:07:25.079 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.079 INFO:teuthology.orchestra.run.smithi161.stdout:246 punch from 0x2c84fe to 0x2d3170, (0xac72 bytes) 2024-09-21T15:07:25.079 INFO:teuthology.orchestra.run.smithi161.stdout:474 write 0xa699528 thru 0xa6a600e (0xcae7 bytes) 2024-09-21T15:07:25.100 INFO:teuthology.orchestra.run.smithi161.stdout:344 read 0xe7aa07 thru 0xe8a7b6 (0xfdb0 bytes) 2024-09-21T15:07:25.100 INFO:teuthology.orchestra.run.smithi161.stdout:425 write 0xb964319 thru 0xb97109e (0xcd86 bytes) 2024-09-21T15:07:25.115 INFO:teuthology.orchestra.run.smithi161.stdout:247 writesame 0xca84384 thru 0xca93572 data_size 0x5(0xf1ef bytes) 2024-09-21T15:07:25.119 INFO:teuthology.orchestra.run.smithi161.stdout:427 writesame 0x3606c77 thru 0x3611c75 data_size 0x1(0xafff bytes) 2024-09-21T15:07:25.121 INFO:teuthology.orchestra.run.smithi161.stdout:249 write 0x2970b5f thru 0x297a722 (0x9bc4 bytes) 2024-09-21T15:07:25.148 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.148 INFO:teuthology.orchestra.run.smithi161.stdout:475 write 0xeb37a49 thru 0xeb3fa1b (0x7fd3 bytes) 2024-09-21T15:07:25.151 INFO:teuthology.orchestra.run.smithi161.stdout:250 write 0x1f0e14c thru 0x1f162c7 (0x817c bytes) 2024-09-21T15:07:25.157 INFO:teuthology.orchestra.run.smithi161.stdout:430 trunc from 0xb97109f to 0x5c3d867 2024-09-21T15:07:25.157 INFO:teuthology.orchestra.run.smithi161.stdout:345 writesame 0xe74e0c0 thru 0xe75cf20 data_size 0x5(0xee61 bytes) 2024-09-21T15:07:25.160 INFO:teuthology.orchestra.run.smithi161.stdout:479 read 0x77173fb thru 0x771987f (0x2485 bytes) 2024-09-21T15:07:25.160 INFO:teuthology.orchestra.run.smithi161.stdout:480 writesame 0xc1b3d70 thru 0xc1b607e data_size 0x5(0x230f bytes) 2024-09-21T15:07:25.180 INFO:teuthology.orchestra.run.smithi161.stdout:252 trunc from 0xca93573 to 0x4dcf41f 2024-09-21T15:07:25.185 INFO:teuthology.orchestra.run.smithi161.stdout:347 trunc from 0xe75cf21 to 0x7437a5b 2024-09-21T15:07:25.193 INFO:teuthology.orchestra.run.smithi161.stdout:481 trunc from 0xeb3fa1c to 0x55d7644 2024-09-21T15:07:25.199 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.199 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.199 INFO:teuthology.orchestra.run.smithi161.stdout:435 write 0x1fac8a3 thru 0x1fb3e02 (0x7560 bytes) 2024-09-21T15:07:25.211 INFO:teuthology.orchestra.run.smithi161.stdout:436 read 0x465904c thru 0x4661313 (0x82c8 bytes) 2024-09-21T15:07:25.212 INFO:teuthology.orchestra.run.smithi161.stdout:437 punch from 0x3c8a455 to 0x3c93ae8, (0x9693 bytes) 2024-09-21T15:07:25.212 INFO:teuthology.orchestra.run.smithi161.stdout:439 writesame 0x21c8187 thru 0x21d2032 data_size 0x1e(0x9eac bytes) 2024-09-21T15:07:25.225 INFO:teuthology.orchestra.run.smithi161.stdout:348 trunc from 0x7437a5b to 0x44442b0 2024-09-21T15:07:25.225 INFO:teuthology.orchestra.run.smithi161.stdout:440 read 0x3e97bb3 thru 0x3e9a97b (0x2dc9 bytes) 2024-09-21T15:07:25.226 INFO:teuthology.orchestra.run.smithi161.stdout:441 read 0x5912f38 thru 0x5920168 (0xd231 bytes) 2024-09-21T15:07:25.236 INFO:teuthology.orchestra.run.smithi161.stdout:681 punch from 0x6270374 to 0x627fb45, (0xf7d1 bytes) 2024-09-21T15:07:25.247 INFO:teuthology.orchestra.run.smithi161.stdout:482 read 0x356d9d9 thru 0x356ec6e (0x1296 bytes) 2024-09-21T15:07:25.261 INFO:teuthology.orchestra.run.smithi161.stdout:682 read 0xad5bce8 thru 0xad5dd62 (0x207b bytes) 2024-09-21T15:07:25.261 INFO:teuthology.orchestra.run.smithi161.stdout:683 read 0x5bdafc1 thru 0x5be3d1a (0x8d5a bytes) 2024-09-21T15:07:25.262 INFO:teuthology.orchestra.run.smithi161.stdout:684 read 0x597f7ac thru 0x598dc1c (0xe471 bytes) 2024-09-21T15:07:25.265 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.265 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.265 INFO:teuthology.orchestra.run.smithi161.stdout:689 punch from 0xabe274e to 0xabeb456, (0x8d08 bytes) 2024-09-21T15:07:25.265 INFO:teuthology.orchestra.run.smithi161.stdout:690 read 0x6d9749a thru 0x6d9d24e (0x5db5 bytes) 2024-09-21T15:07:25.265 INFO:teuthology.orchestra.run.smithi161.stdout:693 writesame 0x675fd73 thru 0x6761ff8 data_size 0x9(0x2286 bytes) 2024-09-21T15:07:25.270 INFO:teuthology.orchestra.run.smithi161.stdout:443 writesame 0x787fcc9 thru 0x788af0a data_size 0x1(0xb242 bytes) 2024-09-21T15:07:25.277 INFO:teuthology.orchestra.run.smithi161.stdout:253 write 0xc3166db thru 0xc31c637 (0x5f5d bytes) 2024-09-21T15:07:25.278 INFO:teuthology.orchestra.run.smithi161.stdout:445 write 0x1235dab thru 0x1245a79 (0xfccf bytes) 2024-09-21T15:07:25.281 INFO:teuthology.orchestra.run.smithi161.stdout:350 writesame 0x1bcd12a thru 0x1bd8284 data_size 0x1(0xb15b bytes) 2024-09-21T15:07:25.285 INFO:teuthology.orchestra.run.smithi161.stdout:483 writesame 0x8c5ef7f thru 0x8c6980c data_size 0x19(0xa88e bytes) 2024-09-21T15:07:25.290 INFO:teuthology.orchestra.run.smithi161.stdout:484 read 0x51bb523 thru 0x51bfd7d (0x485b bytes) 2024-09-21T15:07:25.290 INFO:teuthology.orchestra.run.smithi161.stdout:485 read 0x2a5ce2f thru 0x2a6a92e (0xdb00 bytes) 2024-09-21T15:07:25.290 INFO:teuthology.orchestra.run.smithi161.stdout:487 read 0x35e05d1 thru 0x35e3dc1 (0x37f1 bytes) 2024-09-21T15:07:25.290 INFO:teuthology.orchestra.run.smithi161.stdout:488 read 0x7ed4780 thru 0x7ee0356 (0xbbd7 bytes) 2024-09-21T15:07:25.290 INFO:teuthology.orchestra.run.smithi161.stdout:490 punch from 0x464abd to 0x468b28, (0x406b bytes) 2024-09-21T15:07:25.291 INFO:teuthology.orchestra.run.smithi161.stdout:491 read 0x3b2d9a8 thru 0x3b2de0d (0x466 bytes) 2024-09-21T15:07:25.291 INFO:teuthology.orchestra.run.smithi161.stdout:493 punch from 0x3c5daa8 to 0x3c5dd43, (0x29b bytes) 2024-09-21T15:07:25.291 INFO:teuthology.orchestra.run.smithi161.stdout:494 writesame 0x62aba97 thru 0x62b3cee data_size 0x61(0x8258 bytes) 2024-09-21T15:07:25.291 INFO:teuthology.orchestra.run.smithi161.stdout:446 write 0x632bb90 thru 0x632ffe3 (0x4454 bytes) 2024-09-21T15:07:25.295 INFO:teuthology.orchestra.run.smithi161.stdout:694 trunc from 0xc009a0d to 0x8d91556 2024-09-21T15:07:25.307 INFO:teuthology.orchestra.run.smithi161.stdout:254 punch from 0x6afb0a5 to 0x6b0571a, (0xa675 bytes) 2024-09-21T15:07:25.307 INFO:teuthology.orchestra.run.smithi161.stdout:255 clone 4 order 18 su 32768 sc 2 2024-09-21T15:07:25.308 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.311 INFO:teuthology.orchestra.run.smithi161.stdout:448 punch from 0x4a7bfe2 to 0x4a82e7c, (0x6e9a bytes) 2024-09-21T15:07:25.317 INFO:teuthology.orchestra.run.smithi161.stdout:352 read 0x3ae4a0e thru 0x3aeeed9 (0xa4cc bytes) 2024-09-21T15:07:25.318 INFO:teuthology.orchestra.run.smithi161.stdout:354 punch from 0x2e038bb to 0x2e0c207, (0x894c bytes) 2024-09-21T15:07:25.318 INFO:teuthology.orchestra.run.smithi161.stdout:355 read 0x377b31 thru 0x37b67d (0x3b4d bytes) 2024-09-21T15:07:25.319 INFO:teuthology.orchestra.run.smithi161.stdout:356 write 0x2b9b4d1 thru 0x2ba4988 (0x94b8 bytes) 2024-09-21T15:07:25.321 INFO:teuthology.orchestra.run.smithi161.stdout:496 trunc from 0x8c6980d to 0xc76dd10 2024-09-21T15:07:25.326 INFO:teuthology.orchestra.run.smithi161.stdout:449 trunc from 0x788af0b to 0x195378c 2024-09-21T15:07:25.344 INFO:teuthology.orchestra.run.smithi161.stdout:357 punch from 0x3e0b0ea to 0x3e0f600, (0x4516 bytes) 2024-09-21T15:07:25.344 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.345 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.345 INFO:teuthology.orchestra.run.smithi161.stdout:360 read 0x1905019 thru 0x19060ba (0x10a2 bytes) 2024-09-21T15:07:25.351 INFO:teuthology.orchestra.run.smithi161.stdout:497 punch from 0x4082ed4 to 0x40929db, (0xfb07 bytes) 2024-09-21T15:07:25.351 INFO:teuthology.orchestra.run.smithi161.stdout:498 write 0xb4446f1 thru 0xb448eba (0x47ca bytes) 2024-09-21T15:07:25.365 INFO:teuthology.orchestra.run.smithi161.stdout:499 write 0x40df2e7 thru 0x40ef109 (0xfe23 bytes) 2024-09-21T15:07:25.380 INFO:teuthology.orchestra.run.smithi161.stdout:501 read 0xf4058d thru 0xf47180 (0x6bf4 bytes) 2024-09-21T15:07:25.386 INFO:teuthology.orchestra.run.smithi161.stdout:361 writesame 0x7acc671 thru 0x7acc819 data_size 0x5(0x1a9 bytes) 2024-09-21T15:07:25.386 INFO:teuthology.orchestra.run.smithi161.stdout:695 write 0xc80cf32 thru 0xc815801 (0x88d0 bytes) 2024-09-21T15:07:25.392 INFO:teuthology.orchestra.run.smithi161.stdout:450 writesame 0x66a1161 thru 0x66a2f1a data_size 0x5(0x1dba bytes) 2024-09-21T15:07:25.395 INFO:teuthology.orchestra.run.smithi161.stdout:696 write 0x7ed8893 thru 0x7ee5e3f (0xd5ad bytes) 2024-09-21T15:07:25.400 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.400 INFO:teuthology.orchestra.run.smithi161.stdout:453 write 0x1957f08 thru 0x195d3ec (0x54e5 bytes) 2024-09-21T15:07:25.415 INFO:teuthology.orchestra.run.smithi161.stdout:502 write 0xe94ad3a thru 0xe9557f7 (0xaabe bytes) 2024-09-21T15:07:25.417 INFO:teuthology.orchestra.run.smithi161.stdout:698 trunc from 0xc815802 to 0xe0222c7 2024-09-21T15:07:25.417 INFO:teuthology.orchestra.run.smithi161.stdout:454 clone 4 order 23 su 262144 sc 8 2024-09-21T15:07:25.431 INFO:teuthology.orchestra.run.smithi161.stdout:503 read 0x5b9df92 thru 0x5baa58b (0xc5fa bytes) 2024-09-21T15:07:25.436 INFO:teuthology.orchestra.run.smithi161.stdout:504 trunc from 0xe9557f8 to 0xccd7f10 2024-09-21T15:07:25.438 INFO:teuthology.orchestra.run.smithi161.stdout:362 writesame 0xadb17ae thru 0xadb1d09 data_size 0xe(0x55c bytes) 2024-09-21T15:07:25.442 INFO:teuthology.orchestra.run.smithi161.stdout:363 punch from 0x1421327 to 0x1429cb3, (0x898c bytes) 2024-09-21T15:07:25.442 INFO:teuthology.orchestra.run.smithi161.stdout:365 write 0x9dcfabe thru 0x9dd1125 (0x1668 bytes) 2024-09-21T15:07:25.452 INFO:teuthology.orchestra.run.smithi161.stdout:699 punch from 0xc958072 to 0xc95efd1, (0x6f5f bytes) 2024-09-21T15:07:25.452 INFO:teuthology.orchestra.run.smithi161.stdout:700 write 0x1e26633 thru 0x1e352d5 (0xeca3 bytes) 2024-09-21T15:07:25.459 INFO:teuthology.orchestra.run.smithi161.stdout:367 read 0x71c4aed thru 0x71cdc22 (0x9136 bytes) 2024-09-21T15:07:25.459 INFO:teuthology.orchestra.run.smithi161.stdout:368 read 0xa5c89df thru 0xa5c8b65 (0x187 bytes) 2024-09-21T15:07:25.460 INFO:teuthology.orchestra.run.smithi161.stdout:370 read 0x72e82d2 thru 0x72e9a85 (0x17b4 bytes) 2024-09-21T15:07:25.471 INFO:teuthology.orchestra.run.smithi161.stdout:702 read 0xb37ae8c thru 0xb386e95 (0xc00a bytes) 2024-09-21T15:07:25.480 INFO:teuthology.orchestra.run.smithi161.stdout:703 trunc from 0xe0222c7 to 0xa1f8177 2024-09-21T15:07:25.493 INFO:teuthology.orchestra.run.smithi161.stdout:506 punch from 0x3c9c3a2 to 0x3cabb74, (0xf7d2 bytes) 2024-09-21T15:07:25.493 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.494 INFO:teuthology.orchestra.run.smithi161.stdout:510 flatten 2024-09-21T15:07:25.497 INFO:teuthology.orchestra.run.smithi161.stdout:371 write 0xb10611e thru 0xb11102d (0xaf10 bytes) 2024-09-21T15:07:25.531 INFO:teuthology.orchestra.run.smithi161.stdout:704 read 0xa11c021 thru 0xa11db03 (0x1ae3 bytes) 2024-09-21T15:07:25.537 INFO:teuthology.orchestra.run.smithi161.stdout:372 write 0x5f97381 thru 0x5f9c231 (0x4eb1 bytes) 2024-09-21T15:07:25.547 INFO:teuthology.orchestra.run.smithi161.stdout:705 trunc from 0xa1f8177 to 0x38ef3b7 2024-09-21T15:07:25.555 INFO:teuthology.orchestra.run.smithi161.stdout:373 write 0x4975b30 thru 0x49773ce (0x189f bytes) 2024-09-21T15:07:25.560 INFO:teuthology.orchestra.run.smithi161.stdout:511 punch from 0xc1da146 to 0xc1e9ddc, (0xfc96 bytes) 2024-09-21T15:07:25.560 INFO:teuthology.orchestra.run.smithi161.stdout:512 read 0x2c96174 thru 0x2ca5c85 (0xfb12 bytes) 2024-09-21T15:07:25.560 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.560 INFO:teuthology.orchestra.run.smithi161.stdout:514 write 0x484a9ed thru 0x4850b37 (0x614b bytes) 2024-09-21T15:07:25.573 INFO:teuthology.orchestra.run.smithi161.stdout:515 read 0x2773f09 thru 0x277d718 (0x9810 bytes) 2024-09-21T15:07:25.573 INFO:teuthology.orchestra.run.smithi161.stdout:516 punch from 0x9b70a08 to 0x9b78fe6, (0x85de bytes) 2024-09-21T15:07:25.595 INFO:teuthology.orchestra.run.smithi161.stdout:375 write 0xb7fb92b thru 0xb80a70e (0xede4 bytes) 2024-09-21T15:07:25.599 INFO:teuthology.orchestra.run.smithi161.stdout:517 trunc from 0xccd7f10 to 0x208a3d 2024-09-21T15:07:25.628 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.628 INFO:teuthology.orchestra.run.smithi161.stdout:377 write 0x80cf01 thru 0x80d3e4 (0x4e4 bytes) 2024-09-21T15:07:25.645 INFO:teuthology.orchestra.run.smithi161.stdout:706 writesame 0xd712719 thru 0xd7225ac data_size 0x6(0xfe94 bytes) 2024-09-21T15:07:25.652 INFO:teuthology.orchestra.run.smithi161.stdout:708 write 0x63d62ba thru 0x63dd9f5 (0x773c bytes) 2024-09-21T15:07:25.659 INFO:teuthology.orchestra.run.smithi161.stdout:378 punch from 0x1a404e8 to 0x1a4810e, (0x7c26 bytes) 2024-09-21T15:07:25.659 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.663 INFO:teuthology.orchestra.run.smithi161.stdout:709 punch from 0xc3b2d4a to 0xc3be1e9, (0xb49f bytes) 2024-09-21T15:07:25.663 INFO:teuthology.orchestra.run.smithi161.stdout:710 write 0xa6594c3 thru 0xa65e3cd (0x4f0b bytes) 2024-09-21T15:07:25.666 INFO:teuthology.orchestra.run.smithi161.stdout:519 read 0xf3536 thru 0xf903b (0x5b06 bytes) 2024-09-21T15:07:25.666 INFO:teuthology.orchestra.run.smithi161.stdout:520 clone 3 order 18 su 8192 sc 5 2024-09-21T15:07:25.668 INFO:teuthology.orchestra.run.smithi161.stdout:380 trunc from 0xb80a70f to 0x6c0885b 2024-09-21T15:07:25.703 INFO:teuthology.orchestra.run.smithi161.stdout:711 trunc from 0xd7225ad to 0xa9a38f 2024-09-21T15:07:25.703 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.5-clone3 intact 2024-09-21T15:07:25.712 INFO:teuthology.orchestra.run.smithi161.stdout:381 read 0x19fc401 thru 0x1a03f07 (0x7b07 bytes) 2024-09-21T15:07:25.714 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.748 INFO:teuthology.orchestra.run.smithi161.stdout:385 write 0xa106f7c thru 0xa116b2e (0xfbb3 bytes) 2024-09-21T15:07:25.749 INFO:teuthology.orchestra.run.smithi161.stdout:712 read 0x82c4d thru 0x90848 (0xdbfc bytes) 2024-09-21T15:07:25.752 INFO:teuthology.orchestra.run.smithi161.stdout:713 trunc from 0xa9a38f to 0x11f22b1 2024-09-21T15:07:25.754 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone5 from 0xe10362e (overlap 0x4ef9f6e) to 0x17b163a 2024-09-21T15:07:25.789 INFO:teuthology.orchestra.run.smithi161.stdout:386 read 0x6f2177 thru 0x6f7f78 (0x5e02 bytes) 2024-09-21T15:07:25.791 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.794 INFO:teuthology.orchestra.run.smithi161.stdout:389 trunc from 0xa116b2f to 0x83c558b 2024-09-21T15:07:25.838 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #2, image image_cluster1.client.mirror.1-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent3 2024-09-21T15:07:25.847 INFO:teuthology.orchestra.run.smithi161.stdout:714 write 0x37d4312 thru 0x37d9618 (0x5307 bytes) 2024-09-21T15:07:25.863 INFO:teuthology.orchestra.run.smithi161.stdout:390 punch from 0x7c42e54 to 0x7c4e45b, (0xb607 bytes) 2024-09-21T15:07:25.863 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.863 INFO:teuthology.orchestra.run.smithi161.stdout:393 read 0x3182fd2 thru 0x318e4e2 (0xb511 bytes) 2024-09-21T15:07:25.891 INFO:teuthology.orchestra.run.smithi161.stdout:395 write 0xc21a1d5 thru 0xc223086 (0x8eb2 bytes) 2024-09-21T15:07:25.899 INFO:teuthology.orchestra.run.smithi161.stdout:715 writesame 0x9a911e0 thru 0x9a99075 data_size 0x21(0x7e96 bytes) 2024-09-21T15:07:25.914 INFO:teuthology.orchestra.run.smithi161.stdout:716 trunc from 0x9a99076 to 0xe0e7a02 2024-09-21T15:07:25.916 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #2, image image_cluster1.client.mirror.5-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent3 2024-09-21T15:07:25.941 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.945 INFO:teuthology.orchestra.run.smithi161.stdout:397 writesame 0xd2da1d1 thru 0xd2e3d7a data_size 0x19(0x9baa bytes) 2024-09-21T15:07:25.948 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:25.961 INFO:teuthology.orchestra.run.smithi161.stdout:719 trunc from 0xe0e7a02 to 0x345226e 2024-09-21T15:07:25.974 INFO:teuthology.orchestra.run.smithi161.stdout:399 trunc from 0xd2e3d7b to 0x66719c 2024-09-21T15:07:25.991 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.038 INFO:teuthology.orchestra.run.smithi161.stdout:721 writesame 0xa3e2e71 thru 0xa3f262a data_size 0x25(0xf7ba bytes) 2024-09-21T15:07:26.073 INFO:teuthology.orchestra.run.smithi161.stdout:723 read 0x672d17e thru 0x673715f (0x9fe2 bytes) 2024-09-21T15:07:26.074 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.074 INFO:teuthology.orchestra.run.smithi161.stdout:725 read 0x11e6e5b thru 0x11ee3cf (0x7575 bytes) 2024-09-21T15:07:26.074 INFO:teuthology.orchestra.run.smithi161.stdout:727 read 0x78b1467 thru 0x78b2ca7 (0x1841 bytes) 2024-09-21T15:07:26.074 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.074 INFO:teuthology.orchestra.run.smithi161.stdout:729 writesame 0x6b1927a thru 0x6b23e43 data_size 0xb(0xabca bytes) 2024-09-21T15:07:26.088 INFO:teuthology.orchestra.run.smithi161.stdout:731 write 0x5db7deb thru 0x5dc107d (0x9293 bytes) 2024-09-21T15:07:26.102 INFO:teuthology.orchestra.run.smithi161.stdout:733 read 0x9e3860c thru 0x9e45050 (0xca45 bytes) 2024-09-21T15:07:26.105 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.105 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xecf69fd 2024-09-21T15:07:26.122 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #4, image image_cluster1.client.mirror.3-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent5 2024-09-21T15:07:26.131 INFO:teuthology.orchestra.run.smithi161.stdout:737 write 0xe35b186 thru 0xe3696d8 (0xe553 bytes) 2024-09-21T15:07:26.136 INFO:teuthology.orchestra.run.smithi161.stdout:402 trunc from 0x66719c to 0xecf69fd 2024-09-21T15:07:26.141 INFO:teuthology.orchestra.run.smithi161.stdout:738 write 0x84ee614 thru 0x84f8270 (0x9c5d bytes) 2024-09-21T15:07:26.154 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.154 INFO:teuthology.orchestra.run.smithi161.stdout:742 read 0xabb75f thru 0xacaeb9 (0xf75b bytes) 2024-09-21T15:07:26.154 INFO:teuthology.orchestra.run.smithi161.stdout:743 read 0x522eda9 thru 0x5234128 (0x5380 bytes) 2024-09-21T15:07:26.155 INFO:teuthology.orchestra.run.smithi161.stdout:744 punch from 0x8f5cd43 to 0x8f61882, (0x4b3f bytes) 2024-09-21T15:07:26.157 INFO:teuthology.orchestra.run.smithi161.stdout:745 trunc from 0xe3696d9 to 0xd19109c 2024-09-21T15:07:26.160 INFO:teuthology.orchestra.run.smithi161.stdout:403 read 0xca54ab8 thru 0xca63049 (0xe592 bytes) 2024-09-21T15:07:26.160 INFO:teuthology.orchestra.run.smithi161.stdout:404 write 0x620925 thru 0x621de2 (0x14be bytes) 2024-09-21T15:07:26.173 INFO:teuthology.orchestra.run.smithi161.stdout:405 punch from 0x9ca73f1 to 0x9cb6743, (0xf352 bytes) 2024-09-21T15:07:26.173 INFO:teuthology.orchestra.run.smithi161.stdout:406 read 0x8a3a26e thru 0x8a49d07 (0xfa9a bytes) 2024-09-21T15:07:26.174 INFO:teuthology.orchestra.run.smithi161.stdout:407 write 0xbaf5a4b thru 0xbb02784 (0xcd3a bytes) 2024-09-21T15:07:26.188 INFO:teuthology.orchestra.run.smithi161.stdout:301 trunc from 0xe10362e to 0x21b3467 2024-09-21T15:07:26.208 INFO:teuthology.orchestra.run.smithi161.stdout:747 writesame 0x6ef451 thru 0x6f4b92 data_size 0x66(0x5742 bytes) 2024-09-21T15:07:26.210 INFO:teuthology.orchestra.run.smithi161.stdout:408 writesame 0x2f66b92 thru 0x2f725a8 data_size 0x1(0xba17 bytes) 2024-09-21T15:07:26.230 INFO:teuthology.orchestra.run.smithi161.stdout:748 writesame 0x11a80b2 thru 0x11b69b0 data_size 0x1(0xe8ff bytes) 2024-09-21T15:07:26.270 INFO:teuthology.orchestra.run.smithi161.stdout:409 trunc from 0xecf69fd to 0x4799adf 2024-09-21T15:07:26.273 INFO:teuthology.orchestra.run.smithi161.stdout:750 writesame 0xc10d73 thru 0xc17953 data_size 0x1(0x6be1 bytes) 2024-09-21T15:07:26.286 INFO:teuthology.orchestra.run.smithi161.stdout:302 read 0x11b4881 thru 0x11b5867 (0xfe7 bytes) 2024-09-21T15:07:26.287 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.287 INFO:teuthology.orchestra.run.smithi161.stdout:305 read 0x1f7806c thru 0x1f78dca (0xd5f bytes) 2024-09-21T15:07:26.302 INFO:teuthology.orchestra.run.smithi161.stdout:306 read 0x20bee21 thru 0x20c3094 (0x4274 bytes) 2024-09-21T15:07:26.302 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.302 INFO:teuthology.orchestra.run.smithi161.stdout:752 punch from 0x22a85c5 to 0x22abd90, (0x37cb bytes) 2024-09-21T15:07:26.302 INFO:teuthology.orchestra.run.smithi161.stdout:753 writesame 0x85604d2 thru 0x856f6b5 data_size 0x4(0xf1e4 bytes) 2024-09-21T15:07:26.303 INFO:teuthology.orchestra.run.smithi161.stdout:307 read 0x1088772 thru 0x1090ebe (0x874d bytes) 2024-09-21T15:07:26.303 INFO:teuthology.orchestra.run.smithi161.stdout:308 read 0x19e1fc1 thru 0x19f1e5d (0xfe9d bytes) 2024-09-21T15:07:26.304 INFO:teuthology.orchestra.run.smithi161.stdout:310 read 0x214ded7 thru 0x215602c (0x8156 bytes) 2024-09-21T15:07:26.305 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.305 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.305 INFO:teuthology.orchestra.run.smithi161.stdout:313 read 0x16c7f44 thru 0x16ce6d1 (0x678e bytes) 2024-09-21T15:07:26.309 INFO:teuthology.orchestra.run.smithi161.stdout:455 write 0x375c4ec thru 0x375ddf2 (0x1907 bytes) 2024-09-21T15:07:26.324 INFO:teuthology.orchestra.run.smithi161.stdout:754 punch from 0xb358c74 to 0xb362f3a, (0xa2c6 bytes) 2024-09-21T15:07:26.324 INFO:teuthology.orchestra.run.smithi161.stdout:755 read 0x2fad014 thru 0x2fb9719 (0xc706 bytes) 2024-09-21T15:07:26.325 INFO:teuthology.orchestra.run.smithi161.stdout:756 write 0xc23c7fd thru 0xc242219 (0x5a1d bytes) 2024-09-21T15:07:26.332 INFO:teuthology.orchestra.run.smithi161.stdout:410 read 0x3babc3b thru 0x3bbb9db (0xfda1 bytes) 2024-09-21T15:07:26.352 INFO:teuthology.orchestra.run.smithi161.stdout:314 write 0xda46ff3 thru 0xda54893 (0xd8a1 bytes) 2024-09-21T15:07:26.365 INFO:teuthology.orchestra.run.smithi161.stdout:315 writesame 0xd6096a2 thru 0xd615891 data_size 0x3a(0xc1f0 bytes) 2024-09-21T15:07:26.368 INFO:teuthology.orchestra.run.smithi161.stdout:413 write 0x7862934 thru 0x786a20b (0x78d8 bytes) 2024-09-21T15:07:26.377 INFO:teuthology.orchestra.run.smithi161.stdout:757 writesame 0xed6f27d thru 0xed72fd1 data_size 0x1(0x3d55 bytes) 2024-09-21T15:07:26.380 INFO:teuthology.orchestra.run.smithi161.stdout:758 writesame 0x54352ab thru 0x5439f18 data_size 0x9(0x4c6e bytes) 2024-09-21T15:07:26.383 INFO:teuthology.orchestra.run.smithi161.stdout:256 read 0xa983c04 thru 0xa98b1a3 (0x75a0 bytes) 2024-09-21T15:07:26.388 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.389 INFO:teuthology.orchestra.run.smithi161.stdout:415 read 0xbca361 thru 0xbd3c83 (0x9923 bytes) 2024-09-21T15:07:26.390 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.390 INFO:teuthology.orchestra.run.smithi161.stdout:761 punch from 0xda7b15e to 0xda80250, (0x50f2 bytes) 2024-09-21T15:07:26.391 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.391 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.391 INFO:teuthology.orchestra.run.smithi161.stdout:764 writesame 0xe5a28b1 thru 0xe5a320a data_size 0x15(0x95a bytes) 2024-09-21T15:07:26.392 INFO:teuthology.orchestra.run.smithi161.stdout:316 trunc from 0xda54894 to 0x8297072 2024-09-21T15:07:26.401 INFO:teuthology.orchestra.run.smithi161.stdout:257 read 0x6b9775 thru 0x6c187e (0x810a bytes) 2024-09-21T15:07:26.402 INFO:teuthology.orchestra.run.smithi161.stdout:258 punch from 0x51ba6dd to 0x51be291, (0x3bb4 bytes) 2024-09-21T15:07:26.403 INFO:teuthology.orchestra.run.smithi161.stdout:259 read 0x84a2e9a thru 0x84a3f28 (0x108f bytes) 2024-09-21T15:07:26.403 INFO:teuthology.orchestra.run.smithi161.stdout:767 read 0xe59b18d thru 0xe5a8e60 (0xdcd4 bytes) 2024-09-21T15:07:26.403 INFO:teuthology.orchestra.run.smithi161.stdout:261 write 0x9cff04f thru 0x9d0efa1 (0xff53 bytes) 2024-09-21T15:07:26.405 INFO:teuthology.orchestra.run.smithi161.stdout:768 read 0x25cf89b thru 0x25d6eb3 (0x7619 bytes) 2024-09-21T15:07:26.405 INFO:teuthology.orchestra.run.smithi161.stdout:770 write 0x74f5843 thru 0x74fcdec (0x75aa bytes) 2024-09-21T15:07:26.411 INFO:teuthology.orchestra.run.smithi161.stdout:456 write 0x9419e3a thru 0x942889f (0xea66 bytes) 2024-09-21T15:07:26.417 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.417 INFO:teuthology.orchestra.run.smithi161.stdout:773 writesame 0x382c204 thru 0x3836343 data_size 0x8(0xa140 bytes) 2024-09-21T15:07:26.423 INFO:teuthology.orchestra.run.smithi161.stdout:457 read 0x5f6990a thru 0x5f76c72 (0xd369 bytes) 2024-09-21T15:07:26.424 INFO:teuthology.orchestra.run.smithi161.stdout:459 read 0x4dbcbc7 thru 0x4dcbc7f (0xf0b9 bytes) 2024-09-21T15:07:26.424 INFO:teuthology.orchestra.run.smithi161.stdout:416 write 0x8ef4f6f thru 0x8f02710 (0xd7a2 bytes) 2024-09-21T15:07:26.433 INFO:teuthology.orchestra.run.smithi161.stdout:263 trunc from 0xc31c638 to 0x790a04c 2024-09-21T15:07:26.433 INFO:teuthology.orchestra.run.smithi161.stdout:775 punch from 0x50a2c4f to 0x50ac942, (0x9cf3 bytes) 2024-09-21T15:07:26.433 INFO:teuthology.orchestra.run.smithi161.stdout:777 writesame 0x96c65ea thru 0x96d4ae8 data_size 0x1(0xe4ff bytes) 2024-09-21T15:07:26.436 INFO:teuthology.orchestra.run.smithi161.stdout:318 read 0x106aa89 thru 0x10740ec (0x9664 bytes) 2024-09-21T15:07:26.437 INFO:teuthology.orchestra.run.smithi161.stdout:320 write 0x6e74c75 thru 0x6e79707 (0x4a93 bytes) 2024-09-21T15:07:26.473 INFO:teuthology.orchestra.run.smithi161.stdout:322 clone 7 order 20 su 262144 sc 4 2024-09-21T15:07:26.478 INFO:teuthology.orchestra.run.smithi161.stdout:460 write 0xb912166 thru 0xb91bf59 (0x9df4 bytes) 2024-09-21T15:07:26.479 INFO:teuthology.orchestra.run.smithi161.stdout:417 read 0x47d9385 thru 0x47e1123 (0x7d9f bytes) 2024-09-21T15:07:26.480 INFO:teuthology.orchestra.run.smithi161.stdout:418 write 0x4949fd3 thru 0x49533f0 (0x941e bytes) 2024-09-21T15:07:26.487 INFO:teuthology.orchestra.run.smithi161.stdout:778 trunc from 0xed72fd2 to 0xd0a1284 2024-09-21T15:07:26.521 INFO:teuthology.orchestra.run.smithi161.stdout:419 trunc from 0x8f02711 to 0xdffda35 2024-09-21T15:07:26.522 INFO:teuthology.orchestra.run.smithi161.stdout:265 trunc from 0x790a04c to 0x20839fd 2024-09-21T15:07:26.522 INFO:teuthology.orchestra.run.smithi161.stdout:462 trunc from 0xb91bf5a to 0xfc1992 2024-09-21T15:07:26.535 INFO:teuthology.orchestra.run.smithi161.stdout:779 writesame 0x4d3a753 thru 0x4d3b56e data_size 0xe(0xe1c bytes) 2024-09-21T15:07:26.547 INFO:teuthology.orchestra.run.smithi161.stdout:780 read 0x116ec72 thru 0x11747cb (0x5b5a bytes) 2024-09-21T15:07:26.547 INFO:teuthology.orchestra.run.smithi161.stdout:781 read 0x3c0971c thru 0x3c0cb85 (0x346a bytes) 2024-09-21T15:07:26.547 INFO:teuthology.orchestra.run.smithi161.stdout:782 writesame 0x94252b1 thru 0x942c013 data_size 0x1(0x6d63 bytes) 2024-09-21T15:07:26.560 INFO:teuthology.orchestra.run.smithi161.stdout:420 punch from 0xccee643 to 0xccfa709, (0xc0c6 bytes) 2024-09-21T15:07:26.560 INFO:teuthology.orchestra.run.smithi161.stdout:421 write 0x2eda210 thru 0x2ee792c (0xd71d bytes) 2024-09-21T15:07:26.606 INFO:teuthology.orchestra.run.smithi161.stdout:783 trunc from 0xd0a1284 to 0xe192031 2024-09-21T15:07:26.640 INFO:teuthology.orchestra.run.smithi161.stdout:422 punch from 0xc827f0 to 0xc913fc, (0xec0c bytes) 2024-09-21T15:07:26.640 INFO:teuthology.orchestra.run.smithi161.stdout:423 read 0x5ba46db thru 0x5ba7410 (0x2d36 bytes) 2024-09-21T15:07:26.646 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.656 INFO:teuthology.orchestra.run.smithi161.stdout:425 trunc from 0xdffda35 to 0x63da9ad 2024-09-21T15:07:26.665 INFO:teuthology.orchestra.run.smithi161.stdout:268 trunc from 0x20839fd to 0xad1f786 2024-09-21T15:07:26.665 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.665 INFO:teuthology.orchestra.run.smithi161.stdout:787 read 0x7a21dad thru 0x7a2cc55 (0xaea9 bytes) 2024-09-21T15:07:26.665 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.665 INFO:teuthology.orchestra.run.smithi161.stdout:789 writesame 0x49124c5 thru 0x491ad78 data_size 0x1a(0x88b4 bytes) 2024-09-21T15:07:26.677 INFO:teuthology.orchestra.run.smithi161.stdout:790 read 0xc10de9c thru 0xc11d61f (0xf784 bytes) 2024-09-21T15:07:26.677 INFO:teuthology.orchestra.run.smithi161.stdout:791 punch from 0x77f0677 to 0x77faaca, (0xa453 bytes) 2024-09-21T15:07:26.678 INFO:teuthology.orchestra.run.smithi161.stdout:792 read 0x38aaa2a thru 0x38b4e6e (0xa445 bytes) 2024-09-21T15:07:26.678 INFO:teuthology.orchestra.run.smithi161.stdout:793 writesame 0x2f29790 thru 0x2f3112e data_size 0x1(0x799f bytes) 2024-09-21T15:07:26.723 INFO:teuthology.orchestra.run.smithi161.stdout:428 punch from 0x1ffb0a0 to 0x200209d, (0x6ffd bytes) 2024-09-21T15:07:26.723 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.723 INFO:teuthology.orchestra.run.smithi161.stdout:431 read 0x56e43dd thru 0x56e8566 (0x418a bytes) 2024-09-21T15:07:26.723 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.723 INFO:teuthology.orchestra.run.smithi161.stdout:434 write 0x5caf08 thru 0x5d30ec (0x81e5 bytes) 2024-09-21T15:07:26.724 INFO:teuthology.orchestra.run.smithi161.stdout:795 trunc from 0xe192031 to 0x666a8ad 2024-09-21T15:07:26.728 INFO:teuthology.orchestra.run.smithi161.stdout:269 write 0xcf08709 thru 0xcf0ae7b (0x2773 bytes) 2024-09-21T15:07:26.737 INFO:teuthology.orchestra.run.smithi161.stdout:436 flatten 2024-09-21T15:07:26.742 INFO:teuthology.orchestra.run.smithi161.stdout:271 read 0x2306f44 thru 0x2315f1a (0xefd7 bytes) 2024-09-21T15:07:26.742 INFO:teuthology.orchestra.run.smithi161.stdout:272 read 0x2089a9d thru 0x2094fb3 (0xb517 bytes) 2024-09-21T15:07:26.744 INFO:teuthology.orchestra.run.smithi161.stdout:273 write 0x3c2789b thru 0x3c3138b (0x9af1 bytes) 2024-09-21T15:07:26.748 INFO:teuthology.orchestra.run.smithi161.stdout:465 trunc from 0xfc1992 to 0x377b383 2024-09-21T15:07:26.761 INFO:teuthology.orchestra.run.smithi161.stdout:275 read 0x8fb65b1 thru 0x8fbd9bd (0x740d bytes) 2024-09-21T15:07:26.761 INFO:teuthology.orchestra.run.smithi161.stdout:276 writesame 0x5620ebc thru 0x56234dc data_size 0x1(0x2621 bytes) 2024-09-21T15:07:26.774 INFO:teuthology.orchestra.run.smithi161.stdout:437 read 0x2582e3f thru 0x259286c (0xfa2e bytes) 2024-09-21T15:07:26.775 INFO:teuthology.orchestra.run.smithi161.stdout:439 writesame 0x536f477 thru 0x5379e67 data_size 0x4d(0xa9f1 bytes) 2024-09-21T15:07:26.778 INFO:teuthology.orchestra.run.smithi161.stdout:797 write 0x62a15ba thru 0x62ad09c (0xbae3 bytes) 2024-09-21T15:07:26.779 INFO:teuthology.orchestra.run.smithi161.stdout:277 write 0x7c04c3a thru 0x7c063ba (0x1781 bytes) 2024-09-21T15:07:26.780 INFO:teuthology.orchestra.run.smithi161.stdout:466 write 0x15def37 thru 0x15e48fa (0x59c4 bytes) 2024-09-21T15:07:26.792 INFO:teuthology.orchestra.run.smithi161.stdout:798 writesame 0x3efee93 thru 0x3f09947 data_size 0x7(0xaab5 bytes) 2024-09-21T15:07:26.796 INFO:teuthology.orchestra.run.smithi161.stdout:278 write 0xc2df9a9 thru 0xc2e3b17 (0x416f bytes) 2024-09-21T15:07:26.799 INFO:teuthology.orchestra.run.smithi161.stdout:468 read 0x3309839 thru 0x330ac59 (0x1421 bytes) 2024-09-21T15:07:26.800 INFO:teuthology.orchestra.run.smithi161.stdout:469 read 0x1e838cd thru 0x1e8f4a9 (0xbbdd bytes) 2024-09-21T15:07:26.806 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.806 INFO:teuthology.orchestra.run.smithi161.stdout:282 read 0x90bbff7 thru 0x90cb3d0 (0xf3da bytes) 2024-09-21T15:07:26.806 INFO:teuthology.orchestra.run.smithi161.stdout:283 write 0x13644ba thru 0x1367813 (0x335a bytes) 2024-09-21T15:07:26.807 INFO:teuthology.orchestra.run.smithi161.stdout:799 read 0x1edcabf thru 0x1ee4899 (0x7ddb bytes) 2024-09-21T15:07:26.807 INFO:teuthology.orchestra.run.smithi161.stdout:800 write 0x2958790 thru 0x295c5d9 (0x3e4a bytes) 2024-09-21T15:07:26.810 INFO:teuthology.orchestra.run.smithi161.stdout:441 trunc from 0x63da9ad to 0xa7a80af 2024-09-21T15:07:26.820 INFO:teuthology.orchestra.run.smithi161.stdout:284 punch from 0x92211f6 to 0x9223e68, (0x2c72 bytes) 2024-09-21T15:07:26.820 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.820 INFO:teuthology.orchestra.run.smithi161.stdout:286 punch from 0x89b1d4c to 0x89beba8, (0xce5c bytes) 2024-09-21T15:07:26.820 INFO:teuthology.orchestra.run.smithi161.stdout:801 read 0x10e1b3f thru 0x10f0800 (0xecc2 bytes) 2024-09-21T15:07:26.820 INFO:teuthology.orchestra.run.smithi161.stdout:802 read 0x3dd2e6a thru 0x3dd8d68 (0x5eff bytes) 2024-09-21T15:07:26.821 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.821 INFO:teuthology.orchestra.run.smithi161.stdout:805 punch from 0x1dcb3b2 to 0x1dd2fe8, (0x7c36 bytes) 2024-09-21T15:07:26.821 INFO:teuthology.orchestra.run.smithi161.stdout:806 write 0x48c8227 thru 0x48d1140 (0x8f1a bytes) 2024-09-21T15:07:26.822 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.3-clone6 2024-09-21T15:07:26.846 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.846 INFO:teuthology.orchestra.run.smithi161.stdout:810 write 0x59d00c9 thru 0x59dac2d (0xab65 bytes) 2024-09-21T15:07:26.855 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #1, image image_cluster1.client.mirror.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent2 2024-09-21T15:07:26.861 INFO:teuthology.orchestra.run.smithi161.stdout:811 writesame 0x3c90168 thru 0x3c9748e data_size 0x1(0x7327 bytes) 2024-09-21T15:07:26.861 INFO:teuthology.orchestra.run.smithi161.stdout:470 write 0x8d94b66 thru 0x8da2a4f (0xdeea bytes) 2024-09-21T15:07:26.871 INFO:teuthology.orchestra.run.smithi161.stdout:288 write 0xe6617e1 thru 0xe6655cb (0x3deb bytes) 2024-09-21T15:07:26.876 INFO:teuthology.orchestra.run.smithi161.stdout:442 write 0xae72d7f thru 0xae77c43 (0x4ec5 bytes) 2024-09-21T15:07:26.898 INFO:teuthology.orchestra.run.smithi161.stdout:812 write 0x457ebf7 thru 0x458e9ff (0xfe09 bytes) 2024-09-21T15:07:26.918 INFO:teuthology.orchestra.run.smithi161.stdout:471 trunc from 0x8da2a50 to 0xb992c 2024-09-21T15:07:26.918 INFO:teuthology.orchestra.run.smithi161.stdout:443 write 0x7f30c50 thru 0x7f3af73 (0xa324 bytes) 2024-09-21T15:07:26.923 INFO:teuthology.orchestra.run.smithi161.stdout:814 write 0x5766b91 thru 0x5775731 (0xeba1 bytes) 2024-09-21T15:07:26.937 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.937 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.937 INFO:teuthology.orchestra.run.smithi161.stdout:819 trunc from 0x666a8ad to 0x66307d3 2024-09-21T15:07:26.944 INFO:teuthology.orchestra.run.smithi161.stdout:444 punch from 0x41ef016 to 0x41f4338, (0x5322 bytes) 2024-09-21T15:07:26.952 INFO:teuthology.orchestra.run.smithi161.stdout:445 trunc from 0xae77c44 to 0xd9e7179 2024-09-21T15:07:26.958 INFO:teuthology.orchestra.run.smithi161.stdout:289 write 0xeda3569 thru 0xeda6b17 (0x35af bytes) 2024-09-21T15:07:26.969 INFO:teuthology.orchestra.run.smithi161.stdout:290 read 0x85619f8 thru 0x85660e7 (0x46f0 bytes) 2024-09-21T15:07:26.976 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.976 INFO:teuthology.orchestra.run.smithi161.stdout:822 read 0x3f5f4ca thru 0x3f624bf (0x2ff6 bytes) 2024-09-21T15:07:26.982 INFO:teuthology.orchestra.run.smithi161.stdout:446 read 0xa1e43c3 thru 0xa1eb228 (0x6e66 bytes) 2024-09-21T15:07:26.986 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:26.991 INFO:teuthology.orchestra.run.smithi161.stdout:447 trunc from 0xd9e7179 to 0xbb84ee7 2024-09-21T15:07:27.000 INFO:teuthology.orchestra.run.smithi161.stdout:291 trunc from 0xeda6b18 to 0x297ade2 2024-09-21T15:07:27.013 INFO:teuthology.orchestra.run.smithi161.stdout:473 write 0xfd46c7 thru 0xfe298d (0xe2c7 bytes) 2024-09-21T15:07:27.014 INFO:teuthology.orchestra.run.smithi161.stdout:526 trunc from 0x208a3d to 0xdac83c8 2024-09-21T15:07:27.026 INFO:teuthology.orchestra.run.smithi161.stdout:448 read 0x3472819 thru 0x3475c77 (0x345f bytes) 2024-09-21T15:07:27.029 INFO:teuthology.orchestra.run.smithi161.stdout:824 write 0xee48039 thru 0xee4f4b2 (0x747a bytes) 2024-09-21T15:07:27.040 INFO:teuthology.orchestra.run.smithi161.stdout:825 read 0xa67c32b thru 0xa684dfc (0x8ad2 bytes) 2024-09-21T15:07:27.040 INFO:teuthology.orchestra.run.smithi161.stdout:827 read 0xe345775 thru 0xe353b38 (0xe3c4 bytes) 2024-09-21T15:07:27.040 INFO:teuthology.orchestra.run.smithi161.stdout:828 read 0x145ca61 thru 0x146a5a2 (0xdb42 bytes) 2024-09-21T15:07:27.045 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.050 INFO:teuthology.orchestra.run.smithi161.stdout:829 trunc from 0xee4f4b3 to 0x8fc4620 2024-09-21T15:07:27.051 INFO:teuthology.orchestra.run.smithi161.stdout:449 writesame 0xeafdba3 thru 0xeb00b87 data_size 0x3d(0x2fe5 bytes) 2024-09-21T15:07:27.055 INFO:teuthology.orchestra.run.smithi161.stdout:454 writesame 0xe622568 thru 0xe626aff data_size 0x22(0x4598 bytes) 2024-09-21T15:07:27.055 INFO:teuthology.orchestra.run.smithi161.stdout:527 read 0x5b1bbfa thru 0x5b2ab54 (0xef5b bytes) 2024-09-21T15:07:27.056 INFO:teuthology.orchestra.run.smithi161.stdout:528 writesame 0x791b37c thru 0x791d823 data_size 0x2(0x24a8 bytes) 2024-09-21T15:07:27.072 INFO:teuthology.orchestra.run.smithi161.stdout:455 read 0xbf4efc7 thru 0xbf5773f (0x8779 bytes) 2024-09-21T15:07:27.073 INFO:teuthology.orchestra.run.smithi161.stdout:456 write 0x83d90b7 thru 0x83e5a3a (0xc984 bytes) 2024-09-21T15:07:27.074 INFO:teuthology.orchestra.run.smithi161.stdout:293 write 0x32ef736 thru 0x32f1b14 (0x23df bytes) 2024-09-21T15:07:27.076 INFO:teuthology.orchestra.run.smithi161.stdout:477 writesame 0xa10d688 thru 0xa1193da data_size 0x1(0xbd53 bytes) 2024-09-21T15:07:27.087 INFO:teuthology.orchestra.run.smithi161.stdout:478 read 0x9dcaafe thru 0x9dda9e7 (0xfeea bytes) 2024-09-21T15:07:27.095 INFO:teuthology.orchestra.run.smithi161.stdout:294 punch from 0xe3636e to 0xe3ef49, (0x8bdb bytes) 2024-09-21T15:07:27.095 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.095 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.100 INFO:teuthology.orchestra.run.smithi161.stdout:457 punch from 0xe3431fd to 0xe34a0c5, (0x6ec8 bytes) 2024-09-21T15:07:27.100 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.100 INFO:teuthology.orchestra.run.smithi161.stdout:459 read 0x18578bf thru 0x1861e2e (0xa570 bytes) 2024-09-21T15:07:27.101 INFO:teuthology.orchestra.run.smithi161.stdout:461 read 0xc770c19 thru 0xc776fff (0x63e7 bytes) 2024-09-21T15:07:27.101 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.101 INFO:teuthology.orchestra.run.smithi161.stdout:464 punch from 0x5578cdb to 0x5579ad3, (0xdf8 bytes) 2024-09-21T15:07:27.101 INFO:teuthology.orchestra.run.smithi161.stdout:466 punch from 0xadbe56c to 0xadcb060, (0xcaf4 bytes) 2024-09-21T15:07:27.101 INFO:teuthology.orchestra.run.smithi161.stdout:467 writesame 0x625033d thru 0x625c7e0 data_size 0x2(0xc4a4 bytes) 2024-09-21T15:07:27.106 INFO:teuthology.orchestra.run.smithi161.stdout:479 trunc from 0xa1193db to 0x123270a 2024-09-21T15:07:27.107 INFO:teuthology.orchestra.run.smithi161.stdout:830 read 0x22f3d81 thru 0x22f97a5 (0x5a25 bytes) 2024-09-21T15:07:27.107 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.107 INFO:teuthology.orchestra.run.smithi161.stdout:832 read 0x601fd12 thru 0x602c6e2 (0xc9d1 bytes) 2024-09-21T15:07:27.107 INFO:teuthology.orchestra.run.smithi161.stdout:833 write 0x56ace31 thru 0x56bae9a (0xe06a bytes) 2024-09-21T15:07:27.119 INFO:teuthology.orchestra.run.smithi161.stdout:834 write 0x51fcfb1 thru 0x5209bc0 (0xcc10 bytes) 2024-09-21T15:07:27.121 INFO:teuthology.orchestra.run.smithi161.stdout:529 writesame 0xe3eac46 thru 0xe3edb5b data_size 0x52(0x2f16 bytes) 2024-09-21T15:07:27.128 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.128 INFO:teuthology.orchestra.run.smithi161.stdout:533 read 0x7dfbd59 thru 0x7dfd849 (0x1af1 bytes) 2024-09-21T15:07:27.129 INFO:teuthology.orchestra.run.smithi161.stdout:534 writesame 0xbb24b91 thru 0xbb2e015 data_size 0x1(0x9485 bytes) 2024-09-21T15:07:27.131 INFO:teuthology.orchestra.run.smithi161.stdout:468 punch from 0xbca976f to 0xbcaf0ca, (0x595b bytes) 2024-09-21T15:07:27.131 INFO:teuthology.orchestra.run.smithi161.stdout:470 writesame 0x85975eb thru 0x859d88a data_size 0x30(0x62a0 bytes) 2024-09-21T15:07:27.141 INFO:teuthology.orchestra.run.smithi161.stdout:835 writesame 0x442b93 thru 0x45248d data_size 0x1(0xf8fb bytes) 2024-09-21T15:07:27.153 INFO:teuthology.orchestra.run.smithi161.stdout:471 read 0xbc89643 thru 0xbc995b0 (0xff6e bytes) 2024-09-21T15:07:27.154 INFO:teuthology.orchestra.run.smithi161.stdout:480 read 0x10ee220 thru 0x10fdace (0xf8af bytes) 2024-09-21T15:07:27.154 INFO:teuthology.orchestra.run.smithi161.stdout:481 punch from 0xaef904 to 0xafbc44, (0xc340 bytes) 2024-09-21T15:07:27.155 INFO:teuthology.orchestra.run.smithi161.stdout:472 clone 3 order 21 su 262144 sc 9 2024-09-21T15:07:27.155 INFO:teuthology.orchestra.run.smithi161.stdout:482 read 0x3ca4f0 thru 0x3d91eb (0xecfc bytes) 2024-09-21T15:07:27.155 INFO:teuthology.orchestra.run.smithi161.stdout:483 write 0x1101a33 thru 0x110c7ca (0xad98 bytes) 2024-09-21T15:07:27.159 INFO:teuthology.orchestra.run.smithi161.stdout:297 write 0xd3d99bd thru 0xd3e42ac (0xa8f0 bytes) 2024-09-21T15:07:27.161 INFO:teuthology.orchestra.run.smithi161.stdout:535 punch from 0x3cd7797 to 0x3ce3f86, (0xc7ef bytes) 2024-09-21T15:07:27.161 INFO:teuthology.orchestra.run.smithi161.stdout:536 read 0x565cd45 thru 0x56658b5 (0x8b71 bytes) 2024-09-21T15:07:27.161 INFO:teuthology.orchestra.run.smithi161.stdout:537 read 0x42ba94d thru 0x42ca74c (0xfe00 bytes) 2024-09-21T15:07:27.162 INFO:teuthology.orchestra.run.smithi161.stdout:538 writesame 0xbfa6a8f thru 0xbfb116f data_size 0x11(0xa6e1 bytes) 2024-09-21T15:07:27.172 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #5, image image_cluster1.client.mirror.3-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent6 2024-09-21T15:07:27.178 INFO:teuthology.orchestra.run.smithi161.stdout:299 write 0x9a312c2 thru 0x9a33207 (0x1f46 bytes) 2024-09-21T15:07:27.201 INFO:teuthology.orchestra.run.smithi161.stdout:301 read 0x7b0bb2 thru 0x7b9458 (0x88a7 bytes) 2024-09-21T15:07:27.202 INFO:teuthology.orchestra.run.smithi161.stdout:302 read 0xa3d0d4 thru 0xa453ad (0x82da bytes) 2024-09-21T15:07:27.203 INFO:teuthology.orchestra.run.smithi161.stdout:303 write 0xcf01d15 thru 0xcf09d41 (0x802d bytes) 2024-09-21T15:07:27.203 INFO:teuthology.orchestra.run.smithi161.stdout:539 write 0x322e4af thru 0x3233def (0x5941 bytes) 2024-09-21T15:07:27.210 INFO:teuthology.orchestra.run.smithi161.stdout:836 read 0x528910c thru 0x5294bae (0xbaa3 bytes) 2024-09-21T15:07:27.222 INFO:teuthology.orchestra.run.smithi161.stdout:837 trunc from 0x8fc4620 to 0x376bded 2024-09-21T15:07:27.222 INFO:teuthology.orchestra.run.smithi161.stdout:540 read 0x6017dca thru 0x6026888 (0xeabf bytes) 2024-09-21T15:07:27.222 INFO:teuthology.orchestra.run.smithi161.stdout:541 write 0xce6498 thru 0xcecdaa (0x6913 bytes) 2024-09-21T15:07:27.226 INFO:teuthology.orchestra.run.smithi161.stdout:304 writesame 0x75038ed thru 0x750638d data_size 0x1(0x2aa1 bytes) 2024-09-21T15:07:27.231 INFO:teuthology.orchestra.run.smithi161.stdout:484 write 0x94a0c9a thru 0x94ac5a9 (0xb910 bytes) 2024-09-21T15:07:27.240 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.240 INFO:teuthology.orchestra.run.smithi161.stdout:543 read 0x374e706 thru 0x375c493 (0xdd8e bytes) 2024-09-21T15:07:27.240 INFO:teuthology.orchestra.run.smithi161.stdout:545 write 0x92fa13d thru 0x9308b83 (0xea47 bytes) 2024-09-21T15:07:27.282 INFO:teuthology.orchestra.run.smithi161.stdout:546 trunc from 0xe3edb5c to 0x6fc88c3 2024-09-21T15:07:27.287 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.291 INFO:teuthology.orchestra.run.smithi161.stdout:305 write 0xeaafad1 thru 0xeab7632 (0x7b62 bytes) 2024-09-21T15:07:27.292 INFO:teuthology.orchestra.run.smithi161.stdout:486 write 0x9d68e96 thru 0x9d6d5ce (0x4739 bytes) 2024-09-21T15:07:27.304 INFO:teuthology.orchestra.run.smithi161.stdout:324 write 0x2833368 thru 0x2833c51 (0x8ea bytes) 2024-09-21T15:07:27.305 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.305 INFO:teuthology.orchestra.run.smithi161.stdout:489 punch from 0x8783810 to 0x8791505, (0xdcf5 bytes) 2024-09-21T15:07:27.306 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.306 INFO:teuthology.orchestra.run.smithi161.stdout:307 writesame 0x10c5f3c thru 0x10c84d3 data_size 0xc(0x2598 bytes) 2024-09-21T15:07:27.322 INFO:teuthology.orchestra.run.smithi161.stdout:839 write 0x53d5c11 thru 0x53dae67 (0x5257 bytes) 2024-09-21T15:07:27.325 INFO:teuthology.orchestra.run.smithi161.stdout:309 write 0x398d9cd thru 0x3996fe7 (0x961b bytes) 2024-09-21T15:07:27.347 INFO:teuthology.orchestra.run.smithi161.stdout:310 punch from 0x42b9c02 to 0x42bf296, (0x5694 bytes) 2024-09-21T15:07:27.348 INFO:teuthology.orchestra.run.smithi161.stdout:325 punch from 0x25a340 to 0x26a315, (0xffd5 bytes) 2024-09-21T15:07:27.349 INFO:teuthology.orchestra.run.smithi161.stdout:491 writesame 0xc5f45aa thru 0xc5ffd6d data_size 0x26(0xb7c4 bytes) 2024-09-21T15:07:27.361 INFO:teuthology.orchestra.run.smithi161.stdout:328 trunc from 0x8297072 to 0xc56c933 2024-09-21T15:07:27.361 INFO:teuthology.orchestra.run.smithi161.stdout:547 write 0xd0186c4 thru 0xd01abb4 (0x24f1 bytes) 2024-09-21T15:07:27.362 INFO:teuthology.orchestra.run.smithi161.stdout:493 trunc from 0xc5ffd6e to 0x81ca046 2024-09-21T15:07:27.372 INFO:teuthology.orchestra.run.smithi161.stdout:311 trunc from 0xeab7633 to 0x58cb9d0 2024-09-21T15:07:27.374 INFO:teuthology.orchestra.run.smithi161.stdout:548 punch from 0xcd488e2 to 0xcd4b662, (0x2d80 bytes) 2024-09-21T15:07:27.381 INFO:teuthology.orchestra.run.smithi161.stdout:549 trunc from 0xd01abb5 to 0x9cb7741 2024-09-21T15:07:27.395 INFO:teuthology.orchestra.run.smithi161.stdout:329 read 0x92290b thru 0x923ce8 (0x13de bytes) 2024-09-21T15:07:27.395 INFO:teuthology.orchestra.run.smithi161.stdout:330 punch from 0x4e21737 to 0x4e25a7c, (0x4345 bytes) 2024-09-21T15:07:27.396 INFO:teuthology.orchestra.run.smithi161.stdout:331 read 0x2ca8443 thru 0x2cb4359 (0xbf17 bytes) 2024-09-21T15:07:27.396 INFO:teuthology.orchestra.run.smithi161.stdout:334 write 0x94fb82f thru 0x94fc6c2 (0xe94 bytes) 2024-09-21T15:07:27.400 INFO:teuthology.orchestra.run.smithi161.stdout:840 write 0xa7ff47d thru 0xa80cceb (0xd86f bytes) 2024-09-21T15:07:27.401 INFO:teuthology.orchestra.run.smithi161.stdout:494 write 0x2fc5787 thru 0x2fd4d68 (0xf5e2 bytes) 2024-09-21T15:07:27.406 INFO:teuthology.orchestra.run.smithi161.stdout:335 punch from 0x1704b4e to 0x171115f, (0xc611 bytes) 2024-09-21T15:07:27.406 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.406 INFO:teuthology.orchestra.run.smithi161.stdout:337 write 0x9ad8d5 thru 0x9bc135 (0xe861 bytes) 2024-09-21T15:07:27.422 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.422 INFO:teuthology.orchestra.run.smithi161.stdout:314 punch from 0x27373dd to 0x2747141, (0xfd64 bytes) 2024-09-21T15:07:27.425 INFO:teuthology.orchestra.run.smithi161.stdout:339 punch from 0x888a778 to 0x888ca38, (0x22c0 bytes) 2024-09-21T15:07:27.425 INFO:teuthology.orchestra.run.smithi161.stdout:340 read 0xa7cac3d thru 0xa7d5d39 (0xb0fd bytes) 2024-09-21T15:07:27.425 INFO:teuthology.orchestra.run.smithi161.stdout:341 punch from 0xa897c62 to 0xa89c0c5, (0x4463 bytes) 2024-09-21T15:07:27.425 INFO:teuthology.orchestra.run.smithi161.stdout:342 read 0x2e7b3c2 thru 0x2e7e949 (0x3588 bytes) 2024-09-21T15:07:27.427 INFO:teuthology.orchestra.run.smithi161.stdout:495 trunc from 0x81ca046 to 0x34c2c68 2024-09-21T15:07:27.428 INFO:teuthology.orchestra.run.smithi161.stdout:550 write 0x18d68e2 thru 0x18d76d4 (0xdf3 bytes) 2024-09-21T15:07:27.437 INFO:teuthology.orchestra.run.smithi161.stdout:841 trunc from 0xa80ccec to 0x1d9a28a 2024-09-21T15:07:27.440 INFO:teuthology.orchestra.run.smithi161.stdout:343 trunc from 0xc56c933 to 0x5478668 2024-09-21T15:07:27.440 INFO:teuthology.orchestra.run.smithi161.stdout:551 read 0x287c8c5 thru 0x2889a85 (0xd1c1 bytes) 2024-09-21T15:07:27.440 INFO:teuthology.orchestra.run.smithi161.stdout:552 punch from 0x8da7114 to 0x8da854f, (0x143b bytes) 2024-09-21T15:07:27.440 INFO:teuthology.orchestra.run.smithi161.stdout:553 read 0x86b1b7e thru 0x86bcf8a (0xb40d bytes) 2024-09-21T15:07:27.441 INFO:teuthology.orchestra.run.smithi161.stdout:554 writesame 0x531c7c thru 0x53a558 data_size 0x11(0x88dd bytes) 2024-09-21T15:07:27.457 INFO:teuthology.orchestra.run.smithi161.stdout:556 punch from 0x28c7a1f to 0x28cc846, (0x4e27 bytes) 2024-09-21T15:07:27.457 INFO:teuthology.orchestra.run.smithi161.stdout:557 read 0x5609ed1 thru 0x56167a0 (0xc8d0 bytes) 2024-09-21T15:07:27.457 INFO:teuthology.orchestra.run.smithi161.stdout:558 writesame 0x299138 thru 0x2a657e data_size 0x1(0xd447 bytes) 2024-09-21T15:07:27.459 INFO:teuthology.orchestra.run.smithi161.stdout:316 write 0x87bcd7c thru 0x87c27c7 (0x5a4c bytes) 2024-09-21T15:07:27.475 INFO:teuthology.orchestra.run.smithi161.stdout:496 trunc from 0x34c2c68 to 0x4876cf9 2024-09-21T15:07:27.488 INFO:teuthology.orchestra.run.smithi161.stdout:561 read 0x4a1b10e thru 0x4a2156c (0x645f bytes) 2024-09-21T15:07:27.488 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.488 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.488 INFO:teuthology.orchestra.run.smithi161.stdout:566 read 0x30cb7f7 thru 0x30cea39 (0x3243 bytes) 2024-09-21T15:07:27.505 INFO:teuthology.orchestra.run.smithi161.stdout:497 punch from 0x16b4167 to 0x16c35d4, (0xf46d bytes) 2024-09-21T15:07:27.505 INFO:teuthology.orchestra.run.smithi161.stdout:499 read 0x3f14cd3 thru 0x3f1c54a (0x7878 bytes) 2024-09-21T15:07:27.525 INFO:teuthology.orchestra.run.smithi161.stdout:500 trunc from 0x4876cf9 to 0xc0bef98 2024-09-21T15:07:27.535 INFO:teuthology.orchestra.run.smithi161.stdout:317 write 0xe7ec07f thru 0xe7f0f4e (0x4ed0 bytes) 2024-09-21T15:07:27.536 INFO:teuthology.orchestra.run.smithi161.stdout:568 write 0x9cdc59c thru 0x9ce33e7 (0x6e4c bytes) 2024-09-21T15:07:27.553 INFO:teuthology.orchestra.run.smithi161.stdout:318 read 0x93d0390 thru 0x93d34d3 (0x3144 bytes) 2024-09-21T15:07:27.553 INFO:teuthology.orchestra.run.smithi161.stdout:319 punch from 0x3e3973b to 0x3e42afc, (0x93c1 bytes) 2024-09-21T15:07:27.554 INFO:teuthology.orchestra.run.smithi161.stdout:320 read 0x50309af thru 0x503ca19 (0xc06b bytes) 2024-09-21T15:07:27.554 INFO:teuthology.orchestra.run.smithi161.stdout:321 clone 5 order 19 su 65536 sc 7 2024-09-21T15:07:27.559 INFO:teuthology.orchestra.run.smithi161.stdout:569 punch from 0x8a8d01f to 0x8a9cf40, (0xff21 bytes) 2024-09-21T15:07:27.559 INFO:teuthology.orchestra.run.smithi161.stdout:570 punch from 0x3c19742 to 0x3c291e8, (0xfaa6 bytes) 2024-09-21T15:07:27.559 INFO:teuthology.orchestra.run.smithi161.stdout:571 punch from 0x60ce3b5 to 0x60dc3dd, (0xe028 bytes) 2024-09-21T15:07:27.564 INFO:teuthology.orchestra.run.smithi161.stdout:344 writesame 0xddea5bc thru 0xddf1c7b data_size 0x5f(0x76c0 bytes) 2024-09-21T15:07:27.564 INFO:teuthology.orchestra.run.smithi161.stdout:502 writesame 0x53f362 thru 0x54da64 data_size 0x3(0xe703 bytes) 2024-09-21T15:07:27.565 INFO:teuthology.orchestra.run.smithi161.stdout:842 write 0xc63a3ed thru 0xc63fcdf (0x58f3 bytes) 2024-09-21T15:07:27.567 INFO:teuthology.orchestra.run.smithi161.stdout:345 read 0x982e914 thru 0x983d6f5 (0xede2 bytes) 2024-09-21T15:07:27.567 INFO:teuthology.orchestra.run.smithi161.stdout:346 write 0x459bb0a thru 0x459fe43 (0x433a bytes) 2024-09-21T15:07:27.579 INFO:teuthology.orchestra.run.smithi161.stdout:349 writesame 0x179f19a thru 0x17a2637 data_size 0xf(0x349e bytes) 2024-09-21T15:07:27.580 INFO:teuthology.orchestra.run.smithi161.stdout:504 writesame 0x4bc0992 thru 0x4bc9b2f data_size 0x39(0x919e bytes) 2024-09-21T15:07:27.588 INFO:teuthology.orchestra.run.smithi161.stdout:572 write 0xa6c9e5b thru 0xa6d6be1 (0xcd87 bytes) 2024-09-21T15:07:27.595 INFO:teuthology.orchestra.run.smithi161.stdout:505 punch from 0x4b8ee2e to 0x4b9b95f, (0xcb31 bytes) 2024-09-21T15:07:27.599 INFO:teuthology.orchestra.run.smithi161.stdout:350 write 0x2bc5976 thru 0x2bcb407 (0x5a92 bytes) 2024-09-21T15:07:27.610 INFO:teuthology.orchestra.run.smithi161.stdout:507 trunc from 0xc0bef98 to 0x33b916c 2024-09-21T15:07:27.613 INFO:teuthology.orchestra.run.smithi161.stdout:573 write 0x46fecaf thru 0x47008e1 (0x1c33 bytes) 2024-09-21T15:07:27.619 INFO:teuthology.orchestra.run.smithi161.stdout:844 write 0xd57fdf6 thru 0xd582abd (0x2cc8 bytes) 2024-09-21T15:07:27.625 INFO:teuthology.orchestra.run.smithi161.stdout:353 write 0x23b100e thru 0x23be6f4 (0xd6e7 bytes) 2024-09-21T15:07:27.638 INFO:teuthology.orchestra.run.smithi161.stdout:575 trunc from 0xa6d6be2 to 0xcec953a 2024-09-21T15:07:27.643 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.643 INFO:teuthology.orchestra.run.smithi161.stdout:848 punch from 0xb1a8c16 to 0xb1aee1f, (0x6209 bytes) 2024-09-21T15:07:27.643 INFO:teuthology.orchestra.run.smithi161.stdout:851 write 0x156347d thru 0x1570adb (0xd65f bytes) 2024-09-21T15:07:27.643 INFO:teuthology.orchestra.run.smithi161.stdout:354 write 0xc6bde0e thru 0xc6c62e8 (0x84db bytes) 2024-09-21T15:07:27.656 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.656 INFO:teuthology.orchestra.run.smithi161.stdout:854 punch from 0xb50b4e4 to 0xb51b361, (0xfe7d bytes) 2024-09-21T15:07:27.657 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xe96072d 2024-09-21T15:07:27.657 INFO:teuthology.orchestra.run.smithi161.stdout:855 trunc from 0xd582abe to 0xdd1f20d 2024-09-21T15:07:27.658 INFO:teuthology.orchestra.run.smithi161.stdout:355 trunc from 0xddf1c7c to 0xe96072d 2024-09-21T15:07:27.669 INFO:teuthology.orchestra.run.smithi161.stdout:576 read 0x6cd9298 thru 0x6cda1f2 (0xf5b bytes) 2024-09-21T15:07:27.669 INFO:teuthology.orchestra.run.smithi161.stdout:577 punch from 0x83606ea to 0x83680ea, (0x7a00 bytes) 2024-09-21T15:07:27.669 INFO:teuthology.orchestra.run.smithi161.stdout:578 read 0x2dc8390 thru 0x2dcc532 (0x41a3 bytes) 2024-09-21T15:07:27.669 INFO:teuthology.orchestra.run.smithi161.stdout:580 punch from 0x24ff6f to 0x258230, (0x82c1 bytes) 2024-09-21T15:07:27.669 INFO:teuthology.orchestra.run.smithi161.stdout:581 write 0xaebe7f0 thru 0xaece67e (0xfe8f bytes) 2024-09-21T15:07:27.670 INFO:teuthology.orchestra.run.smithi161.stdout:508 punch from 0x326e243 to 0x3276259, (0x8016 bytes) 2024-09-21T15:07:27.670 INFO:teuthology.orchestra.run.smithi161.stdout:509 read 0x22fe602 thru 0x230cc93 (0xe692 bytes) 2024-09-21T15:07:27.685 INFO:teuthology.orchestra.run.smithi161.stdout:358 writesame 0x111c1a8 thru 0x1123e05 data_size 0x1(0x7c5e bytes) 2024-09-21T15:07:27.688 INFO:teuthology.orchestra.run.smithi161.stdout:584 write 0x41d1933 thru 0x41d92fb (0x79c9 bytes) 2024-09-21T15:07:27.694 INFO:teuthology.orchestra.run.smithi161.stdout:856 writesame 0xce94d97 thru 0xcea2fcf data_size 0x1(0xe239 bytes) 2024-09-21T15:07:27.710 INFO:teuthology.orchestra.run.smithi161.stdout:511 writesame 0x49a8fab thru 0x49af48a data_size 0x30(0x64e0 bytes) 2024-09-21T15:07:27.721 INFO:teuthology.orchestra.run.smithi161.stdout:359 writesame 0x59d6c64 thru 0x59e34d5 data_size 0x1(0xc872 bytes) 2024-09-21T15:07:27.722 INFO:teuthology.orchestra.run.smithi161.stdout:585 write 0x6715d2 thru 0x6759e4 (0x4413 bytes) 2024-09-21T15:07:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:857 punch from 0x4cbf122 to 0x4ccf00c, (0xfeea bytes) 2024-09-21T15:07:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:859 write 0x40144a5 thru 0x401de20 (0x997c bytes) 2024-09-21T15:07:27.767 INFO:teuthology.orchestra.run.smithi161.stdout:586 write 0xcd7207d thru 0xcd815ca (0xf54e bytes) 2024-09-21T15:07:27.778 INFO:teuthology.orchestra.run.smithi161.stdout:512 write 0x9199ac1 thru 0x91a270b (0x8c4b bytes) 2024-09-21T15:07:27.779 INFO:teuthology.orchestra.run.smithi161.stdout:861 read 0x875b99c thru 0x8767349 (0xb9ae bytes) 2024-09-21T15:07:27.779 INFO:teuthology.orchestra.run.smithi161.stdout:862 writesame 0x264fc91 thru 0x26573c9 data_size 0x1(0x7739 bytes) 2024-09-21T15:07:27.792 INFO:teuthology.orchestra.run.smithi161.stdout:587 write 0xc1c740b thru 0xc1ca441 (0x3037 bytes) 2024-09-21T15:07:27.807 INFO:teuthology.orchestra.run.smithi161.stdout:360 writesame 0xe99ee8e thru 0xe9a6fd7 data_size 0x43(0x814a bytes) 2024-09-21T15:07:27.808 INFO:teuthology.orchestra.run.smithi161.stdout:863 writesame 0xc47df9b thru 0xc482cbc data_size 0x9(0x4d22 bytes) 2024-09-21T15:07:27.809 INFO:teuthology.orchestra.run.smithi161.stdout:588 read 0x9a343bc thru 0x9a415d9 (0xd21e bytes) 2024-09-21T15:07:27.810 INFO:teuthology.orchestra.run.smithi161.stdout:361 writesame 0x98f1bd8 thru 0x990152f data_size 0x8(0xf958 bytes) 2024-09-21T15:07:27.810 INFO:teuthology.orchestra.run.smithi161.stdout:589 write 0x8ecac20 thru 0x8ecbb6f (0xf50 bytes) 2024-09-21T15:07:27.818 INFO:teuthology.orchestra.run.smithi161.stdout:865 clone 3 order 20 su 524288 sc 8 2024-09-21T15:07:27.822 INFO:teuthology.orchestra.run.smithi161.stdout:590 writesame 0xa460fb thru 0xa4d906 data_size 0x4e(0x780c bytes) 2024-09-21T15:07:27.823 INFO:teuthology.orchestra.run.smithi161.stdout:362 read 0xbbc2540 thru 0xbbcc18e (0x9c4f bytes) 2024-09-21T15:07:27.823 INFO:teuthology.orchestra.run.smithi161.stdout:363 write 0xddc77c9 thru 0xddc7f76 (0x7ae bytes) 2024-09-21T15:07:27.827 INFO:teuthology.orchestra.run.smithi161.stdout:513 write 0xae17219 thru 0xae21211 (0x9ff9 bytes) 2024-09-21T15:07:27.837 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.837 INFO:teuthology.orchestra.run.smithi161.stdout:365 punch from 0xa74bc9 to 0xa80467, (0xb89e bytes) 2024-09-21T15:07:27.837 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.837 INFO:teuthology.orchestra.run.smithi161.stdout:367 writesame 0xaf37b6c thru 0xaf4175e data_size 0x25(0x9bf3 bytes) 2024-09-21T15:07:27.839 INFO:teuthology.orchestra.run.smithi161.stdout:591 read 0x28044cc thru 0x2812802 (0xe337 bytes) 2024-09-21T15:07:27.839 INFO:teuthology.orchestra.run.smithi161.stdout:592 read 0x948c0d1 thru 0x9493336 (0x7266 bytes) 2024-09-21T15:07:27.839 INFO:teuthology.orchestra.run.smithi161.stdout:593 read 0xb451866 thru 0xb453e60 (0x25fb bytes) 2024-09-21T15:07:27.840 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.840 INFO:teuthology.orchestra.run.smithi161.stdout:595 punch from 0xa36bcbb to 0xa37977f, (0xdac4 bytes) 2024-09-21T15:07:27.840 INFO:teuthology.orchestra.run.smithi161.stdout:597 write 0xa786781 thru 0xa78d9d5 (0x7255 bytes) 2024-09-21T15:07:27.842 INFO:teuthology.orchestra.run.smithi161.stdout:514 read 0x40f524b thru 0x4104559 (0xf30f bytes) 2024-09-21T15:07:27.843 INFO:teuthology.orchestra.run.smithi161.stdout:515 punch from 0x483faed to 0x484e611, (0xeb24 bytes) 2024-09-21T15:07:27.851 INFO:teuthology.orchestra.run.smithi161.stdout:368 writesame 0x71c2ae4 thru 0x71c7f22 data_size 0x4f(0x543f bytes) 2024-09-21T15:07:27.859 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.860 INFO:teuthology.orchestra.run.smithi161.stdout:600 read 0x8648d45 thru 0x8658c30 (0xfeec bytes) 2024-09-21T15:07:27.860 INFO:teuthology.orchestra.run.smithi161.stdout:601 punch from 0x816779a to 0x816e06f, (0x68d5 bytes) 2024-09-21T15:07:27.860 INFO:teuthology.orchestra.run.smithi161.stdout:602 clone 4 order 21 su 32768 sc 15 2024-09-21T15:07:27.865 INFO:teuthology.orchestra.run.smithi161.stdout:369 write 0x82a3fa6 thru 0x82ad06e (0x90c9 bytes) 2024-09-21T15:07:27.886 INFO:teuthology.orchestra.run.smithi161.stdout:517 write 0xe164939 thru 0xe16b7a4 (0x6e6c bytes) 2024-09-21T15:07:27.894 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.894 INFO:teuthology.orchestra.run.smithi161.stdout:519 writesame 0x3326c4b thru 0x332f747 data_size 0x17(0x8afd bytes) 2024-09-21T15:07:27.899 INFO:teuthology.orchestra.run.smithi161.stdout:520 write 0x9ac8794 thru 0x9aceb21 (0x638e bytes) 2024-09-21T15:07:27.901 INFO:teuthology.orchestra.run.smithi161.stdout:370 trunc from 0xe9a6fd8 to 0x2c2c38a 2024-09-21T15:07:27.911 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:27.911 INFO:teuthology.orchestra.run.smithi161.stdout:522 write 0xeaab93 thru 0xeb226e (0x76dc bytes) 2024-09-21T15:07:27.919 INFO:teuthology.orchestra.run.smithi161.stdout:523 write 0x67d2729 thru 0x67d2d27 (0x5ff bytes) 2024-09-21T15:07:27.928 INFO:teuthology.orchestra.run.smithi161.stdout:524 writesame 0xde2e80b thru 0xde34e44 data_size 0x5(0x663a bytes) 2024-09-21T15:07:27.929 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #1, image image_cluster1.client.mirror.4-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent2 2024-09-21T15:07:27.939 INFO:teuthology.orchestra.run.smithi161.stdout:526 trunc from 0xe16b7a5 to 0xd9b6963 2024-09-21T15:07:27.961 INFO:teuthology.orchestra.run.smithi161.stdout:527 read 0x8a8e487 thru 0x8a9c77e (0xe2f8 bytes) 2024-09-21T15:07:27.962 INFO:teuthology.orchestra.run.smithi161.stdout:528 read 0xbe6c9 thru 0xcb49f (0xcdd7 bytes) 2024-09-21T15:07:27.962 INFO:teuthology.orchestra.run.smithi161.stdout:530 punch from 0x6d5a158 to 0x6d5ecf8, (0x4ba0 bytes) 2024-09-21T15:07:27.963 INFO:teuthology.orchestra.run.smithi161.stdout:531 write 0xa5cb506 thru 0xa5d4810 (0x930b bytes) 2024-09-21T15:07:27.969 INFO:teuthology.orchestra.run.smithi161.stdout:372 write 0x59f1cb1 thru 0x59fd485 (0xb7d5 bytes) 2024-09-21T15:07:27.976 INFO:teuthology.orchestra.run.smithi161.stdout:532 read 0x56b736c thru 0x56c45af (0xd244 bytes) 2024-09-21T15:07:27.982 INFO:teuthology.orchestra.run.smithi161.stdout:374 writesame 0x1df0b02 thru 0x1df773b data_size 0x7(0x6c3a bytes) 2024-09-21T15:07:27.997 INFO:teuthology.orchestra.run.smithi161.stdout:535 trunc from 0xd9b6963 to 0xce4eaa 2024-09-21T15:07:27.998 INFO:teuthology.orchestra.run.smithi161.stdout:375 punch from 0x17a0d2b to 0x17b07eb, (0xfac0 bytes) 2024-09-21T15:07:27.998 INFO:teuthology.orchestra.run.smithi161.stdout:376 read 0x3152bb2 thru 0x315432a (0x1779 bytes) 2024-09-21T15:07:27.999 INFO:teuthology.orchestra.run.smithi161.stdout:377 trunc from 0x59fd486 to 0x53534b0 2024-09-21T15:07:28.049 INFO:teuthology.orchestra.run.smithi161.stdout:378 write 0x4e21fe0 thru 0x4e2c809 (0xa82a bytes) 2024-09-21T15:07:28.096 INFO:teuthology.orchestra.run.smithi161.stdout:536 write 0x672b26d thru 0x672f1e7 (0x3f7b bytes) 2024-09-21T15:07:28.100 INFO:teuthology.orchestra.run.smithi161.stdout:379 write 0x885fc7f thru 0x886bebb (0xc23d bytes) 2024-09-21T15:07:28.103 INFO:teuthology.orchestra.run.smithi161.stdout:537 write 0x65197b thru 0x65adf6 (0x947c bytes) 2024-09-21T15:07:28.119 INFO:teuthology.orchestra.run.smithi161.stdout:380 trunc from 0x886bebc to 0x2ac8f26 2024-09-21T15:07:28.145 INFO:teuthology.orchestra.run.smithi161.stdout:538 write 0xbd3f823 thru 0xbd45c41 (0x641f bytes) 2024-09-21T15:07:28.166 INFO:teuthology.orchestra.run.smithi161.stdout:539 trunc from 0xbd45c42 to 0x6fd7ff2 2024-09-21T15:07:28.168 INFO:teuthology.orchestra.run.smithi161.stdout:381 punch from 0x1c707d9 to 0x1c7bc30, (0xb457 bytes) 2024-09-21T15:07:28.168 INFO:teuthology.orchestra.run.smithi161.stdout:382 read 0x61dab5 thru 0x62c5c1 (0xeb0d bytes) 2024-09-21T15:07:28.208 INFO:teuthology.orchestra.run.smithi161.stdout:540 write 0x2a4d0a4 thru 0x2a5558d (0x84ea bytes) 2024-09-21T15:07:28.216 INFO:teuthology.orchestra.run.smithi161.stdout:383 write 0xdae3d1b thru 0xdaf0d82 (0xd068 bytes) 2024-09-21T15:07:28.220 INFO:teuthology.orchestra.run.smithi161.stdout:541 punch from 0x126bd3 to 0x13647f, (0xf8ac bytes) 2024-09-21T15:07:28.222 INFO:teuthology.orchestra.run.smithi161.stdout:542 trunc from 0x6fd7ff2 to 0x7b818aa 2024-09-21T15:07:28.238 INFO:teuthology.orchestra.run.smithi161.stdout:385 read 0x2cfb055 thru 0x2d02e28 (0x7dd4 bytes) 2024-09-21T15:07:28.238 INFO:teuthology.orchestra.run.smithi161.stdout:386 write 0x6aa2225 thru 0x6aaf274 (0xd050 bytes) 2024-09-21T15:07:28.252 INFO:teuthology.orchestra.run.smithi161.stdout:388 read 0x767f58d thru 0x768ccfa (0xd76e bytes) 2024-09-21T15:07:28.253 INFO:teuthology.orchestra.run.smithi161.stdout:390 write 0x90d4b80 thru 0x90d958e (0x4a0f bytes) 2024-09-21T15:07:28.257 INFO:teuthology.orchestra.run.smithi161.stdout:543 read 0x2af9775 thru 0x2b01f28 (0x87b4 bytes) 2024-09-21T15:07:28.258 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.264 INFO:teuthology.orchestra.run.smithi161.stdout:391 read 0x84c76f0 thru 0x84d0983 (0x9294 bytes) 2024-09-21T15:07:28.264 INFO:teuthology.orchestra.run.smithi161.stdout:392 write 0x7ad2155 thru 0x7addf71 (0xbe1d bytes) 2024-09-21T15:07:28.279 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.280 INFO:teuthology.orchestra.run.smithi161.stdout:395 punch from 0x8cba46b to 0x8cc8536, (0xe0cb bytes) 2024-09-21T15:07:28.280 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.280 INFO:teuthology.orchestra.run.smithi161.stdout:397 write 0xa64d999 thru 0xa6529d8 (0x5040 bytes) 2024-09-21T15:07:28.290 INFO:teuthology.orchestra.run.smithi161.stdout:398 punch from 0x8e50b4d to 0x8e54cfe, (0x41b1 bytes) 2024-09-21T15:07:28.290 INFO:teuthology.orchestra.run.smithi161.stdout:399 write 0x673beff thru 0x6744ac3 (0x8bc5 bytes) 2024-09-21T15:07:28.299 INFO:teuthology.orchestra.run.smithi161.stdout:545 write 0xdd3f73d thru 0xdd3f745 (0x9 bytes) 2024-09-21T15:07:28.306 INFO:teuthology.orchestra.run.smithi161.stdout:400 writesame 0xa30af3d thru 0xa30d96d data_size 0x1(0x2a31 bytes) 2024-09-21T15:07:28.309 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.309 INFO:teuthology.orchestra.run.smithi161.stdout:547 write 0xa3cdb61 thru 0xa3da7b8 (0xcc58 bytes) 2024-09-21T15:07:28.321 INFO:teuthology.orchestra.run.smithi161.stdout:549 write 0x2e9fda1 thru 0x2ea12dc (0x153c bytes) 2024-09-21T15:07:28.344 INFO:teuthology.orchestra.run.smithi161.stdout:401 trunc from 0xdaf0d83 to 0x5d54185 2024-09-21T15:07:28.356 INFO:teuthology.orchestra.run.smithi161.stdout:550 trunc from 0xdd3f746 to 0x307ec3 2024-09-21T15:07:28.385 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.396 INFO:teuthology.orchestra.run.smithi161.stdout:551 write 0x1d5972 thru 0x1d84a2 (0x2b31 bytes) 2024-09-21T15:07:28.398 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.398 INFO:teuthology.orchestra.run.smithi161.stdout:474 punch from 0x60f9fd4 to 0x6104b07, (0xab33 bytes) 2024-09-21T15:07:28.405 INFO:teuthology.orchestra.run.smithi161.stdout:552 punch from 0x131101 to 0x140bb5, (0xfab4 bytes) 2024-09-21T15:07:28.405 INFO:teuthology.orchestra.run.smithi161.stdout:554 read 0x8ff14 thru 0x99578 (0x9665 bytes) 2024-09-21T15:07:28.406 INFO:teuthology.orchestra.run.smithi161.stdout:555 read 0x16ad70 thru 0x170756 (0x59e7 bytes) 2024-09-21T15:07:28.407 INFO:teuthology.orchestra.run.smithi161.stdout:556 read 0x72b81 thru 0x80f6f (0xe3ef bytes) 2024-09-21T15:07:28.410 INFO:teuthology.orchestra.run.smithi161.stdout:404 write 0x7383219 thru 0x73918bf (0xe6a7 bytes) 2024-09-21T15:07:28.410 INFO:teuthology.orchestra.run.smithi161.stdout:557 punch from 0x17363e to 0x177547, (0x3f09 bytes) 2024-09-21T15:07:28.422 INFO:teuthology.orchestra.run.smithi161.stdout:475 read 0x95981 thru 0x9c77f (0x6dff bytes) 2024-09-21T15:07:28.423 INFO:teuthology.orchestra.run.smithi161.stdout:476 writesame 0x4dd56fc thru 0x4ddbd5c data_size 0x1(0x6661 bytes) 2024-09-21T15:07:28.426 INFO:teuthology.orchestra.run.smithi161.stdout:405 punch from 0x139ed79 to 0x13a132c, (0x25b3 bytes) 2024-09-21T15:07:28.426 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.426 INFO:teuthology.orchestra.run.smithi161.stdout:407 flatten 2024-09-21T15:07:28.453 INFO:teuthology.orchestra.run.smithi161.stdout:558 write 0x4232299 thru 0x4232853 (0x5bb bytes) 2024-09-21T15:07:28.464 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.465 INFO:teuthology.orchestra.run.smithi161.stdout:560 read 0x1871bab thru 0x1877aea (0x5f40 bytes) 2024-09-21T15:07:28.468 INFO:teuthology.orchestra.run.smithi161.stdout:561 trunc from 0x4232854 to 0x3e86538 2024-09-21T15:07:28.478 INFO:teuthology.orchestra.run.smithi161.stdout:477 trunc from 0xeb00b88 to 0x7267636 2024-09-21T15:07:28.498 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.499 INFO:teuthology.orchestra.run.smithi161.stdout:410 writesame 0x5bf6d3f thru 0x5bfe00b data_size 0x1(0x72cd bytes) 2024-09-21T15:07:28.535 INFO:teuthology.orchestra.run.smithi161.stdout:411 read 0x6fe25d9 thru 0x6fe6828 (0x4250 bytes) 2024-09-21T15:07:28.535 INFO:teuthology.orchestra.run.smithi161.stdout:413 writesame 0x4056f46 thru 0x406118c data_size 0x1(0xa247 bytes) 2024-09-21T15:07:28.549 INFO:teuthology.orchestra.run.smithi161.stdout:479 read 0x25f2e11 thru 0x25f9005 (0x61f5 bytes) 2024-09-21T15:07:28.550 INFO:teuthology.orchestra.run.smithi161.stdout:480 punch from 0x3ef8ff1 to 0x3efbc61, (0x2c70 bytes) 2024-09-21T15:07:28.550 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.550 INFO:teuthology.orchestra.run.smithi161.stdout:482 read 0x4946f1f thru 0x494c95f (0x5a41 bytes) 2024-09-21T15:07:28.556 INFO:teuthology.orchestra.run.smithi161.stdout:562 write 0xb1cf560 thru 0xb1d0c4b (0x16ec bytes) 2024-09-21T15:07:28.570 INFO:teuthology.orchestra.run.smithi161.stdout:563 punch from 0x632f336 to 0x6339874, (0xa53e bytes) 2024-09-21T15:07:28.571 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.571 INFO:teuthology.orchestra.run.smithi161.stdout:416 read 0x50596a6 thru 0x5068736 (0xf091 bytes) 2024-09-21T15:07:28.571 INFO:teuthology.orchestra.run.smithi161.stdout:483 punch from 0x2cef4b8 to 0x2cf32b1, (0x3df9 bytes) 2024-09-21T15:07:28.571 INFO:teuthology.orchestra.run.smithi161.stdout:485 read 0x61a9544 thru 0x61adfe6 (0x4aa3 bytes) 2024-09-21T15:07:28.571 INFO:teuthology.orchestra.run.smithi161.stdout:417 write 0x57b59e2 thru 0x57b8400 (0x2a1f bytes) 2024-09-21T15:07:28.572 INFO:teuthology.orchestra.run.smithi161.stdout:564 writesame 0x847f6b6 thru 0x848c986 data_size 0x1(0xd2d1 bytes) 2024-09-21T15:07:28.572 INFO:teuthology.orchestra.run.smithi161.stdout:486 read 0x2e1032f thru 0x2e153f7 (0x50c9 bytes) 2024-09-21T15:07:28.574 INFO:teuthology.orchestra.run.smithi161.stdout:487 write 0x3071e9a thru 0x3072365 (0x4cc bytes) 2024-09-21T15:07:28.591 INFO:teuthology.orchestra.run.smithi161.stdout:418 read 0xd4d6bd thru 0xd588a0 (0xb1e4 bytes) 2024-09-21T15:07:28.597 INFO:teuthology.orchestra.run.smithi161.stdout:419 trunc from 0x73918c0 to 0x4502f2b 2024-09-21T15:07:28.607 INFO:teuthology.orchestra.run.smithi161.stdout:488 punch from 0x7094546 to 0x709c09f, (0x7b59 bytes) 2024-09-21T15:07:28.616 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.617 INFO:teuthology.orchestra.run.smithi161.stdout:567 write 0x1e880cb thru 0x1e893cf (0x1305 bytes) 2024-09-21T15:07:28.622 INFO:teuthology.orchestra.run.smithi161.stdout:569 punch from 0x72f1610 to 0x72f1a8e, (0x47e bytes) 2024-09-21T15:07:28.622 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.622 INFO:teuthology.orchestra.run.smithi161.stdout:571 writesame 0x10600ea thru 0x1064875 data_size 0x26(0x478c bytes) 2024-09-21T15:07:28.628 INFO:teuthology.orchestra.run.smithi161.stdout:572 write 0x4962429 thru 0x496451b (0x20f3 bytes) 2024-09-21T15:07:28.637 INFO:teuthology.orchestra.run.smithi161.stdout:489 write 0x8e2f87d thru 0x8e353d5 (0x5b59 bytes) 2024-09-21T15:07:28.639 INFO:teuthology.orchestra.run.smithi161.stdout:573 write 0x679582f thru 0x67a3d89 (0xe55b bytes) 2024-09-21T15:07:28.647 INFO:teuthology.orchestra.run.smithi161.stdout:420 trunc from 0x4502f2b to 0x76a6211 2024-09-21T15:07:28.651 INFO:teuthology.orchestra.run.smithi161.stdout:574 punch from 0x28d6ab to 0x28db33, (0x488 bytes) 2024-09-21T15:07:28.651 INFO:teuthology.orchestra.run.smithi161.stdout:576 punch from 0x308a6e4 to 0x3098ab7, (0xe3d3 bytes) 2024-09-21T15:07:28.665 INFO:teuthology.orchestra.run.smithi161.stdout:422 writesame 0x5974566 thru 0x597e09f data_size 0x25(0x9b3a bytes) 2024-09-21T15:07:28.675 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.675 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.675 INFO:teuthology.orchestra.run.smithi161.stdout:490 writesame 0xa343c2c thru 0xa34e423 data_size 0x32(0xa7f8 bytes) 2024-09-21T15:07:28.678 INFO:teuthology.orchestra.run.smithi161.stdout:491 read 0x7457958 thru 0x7465592 (0xdc3b bytes) 2024-09-21T15:07:28.678 INFO:teuthology.orchestra.run.smithi161.stdout:492 read 0x176807c thru 0x17771d5 (0xf15a bytes) 2024-09-21T15:07:28.679 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.679 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.680 INFO:teuthology.orchestra.run.smithi161.stdout:578 writesame 0xd453370 thru 0xd460ce9 data_size 0x1b(0xd97a bytes) 2024-09-21T15:07:28.682 INFO:teuthology.orchestra.run.smithi161.stdout:495 trunc from 0xa34e424 to 0xb6f2e91 2024-09-21T15:07:28.686 INFO:teuthology.orchestra.run.smithi161.stdout:426 trunc from 0x76a6211 to 0x268f2c2 2024-09-21T15:07:28.688 INFO:teuthology.orchestra.run.smithi161.stdout:579 trunc from 0xd460cea to 0xb13ad19 2024-09-21T15:07:28.703 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone3 from 0xcec953a (overlap 0x208a3d) to 0x138624 2024-09-21T15:07:28.704 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone2 from 0xdd1f20d (overlap 0xa9a38f) to 0x32e444 2024-09-21T15:07:28.730 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.731 INFO:teuthology.orchestra.run.smithi161.stdout:497 read 0x5ba926d thru 0x5bac87d (0x3611 bytes) 2024-09-21T15:07:28.732 INFO:teuthology.orchestra.run.smithi161.stdout:498 read 0x5ba1f64 thru 0x5bb007a (0xe117 bytes) 2024-09-21T15:07:28.735 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.735 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.735 INFO:teuthology.orchestra.run.smithi161.stdout:504 punch from 0x282e466 to 0x283a098, (0xbc32 bytes) 2024-09-21T15:07:28.735 INFO:teuthology.orchestra.run.smithi161.stdout:505 writesame 0x6153494 thru 0x615a985 data_size 0x1(0x74f2 bytes) 2024-09-21T15:07:28.755 INFO:teuthology.orchestra.run.smithi161.stdout:581 punch from 0x2146373 to 0x2153953, (0xd5e0 bytes) 2024-09-21T15:07:28.755 INFO:teuthology.orchestra.run.smithi161.stdout:584 punch from 0xc82726 to 0xc8761f, (0x4ef9 bytes) 2024-09-21T15:07:28.755 INFO:teuthology.orchestra.run.smithi161.stdout:585 punch from 0x12d874 to 0x136476, (0x8c02 bytes) 2024-09-21T15:07:28.755 INFO:teuthology.orchestra.run.smithi161.stdout:586 read 0x6d3be57 thru 0x6d483b0 (0xc55a bytes) 2024-09-21T15:07:28.755 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone4 from 0xe7f0f4f (overlap 0x20839fd) to 0x1041cfe 2024-09-21T15:07:28.756 INFO:teuthology.orchestra.run.smithi161.stdout:587 read 0xa459e53 thru 0xa461c99 (0x7e47 bytes) 2024-09-21T15:07:28.757 INFO:teuthology.orchestra.run.smithi161.stdout:588 write 0x8efe204 thru 0x8f0a538 (0xc335 bytes) 2024-09-21T15:07:28.775 INFO:teuthology.orchestra.run.smithi161.stdout:427 write 0x248a236 thru 0x248b305 (0x10d0 bytes) 2024-09-21T15:07:28.781 INFO:teuthology.orchestra.run.smithi161.stdout:589 punch from 0x67f22e4 to 0x67f3880, (0x159c bytes) 2024-09-21T15:07:28.782 INFO:teuthology.orchestra.run.smithi161.stdout:506 read 0x938635e thru 0x938933b (0x2fde bytes) 2024-09-21T15:07:28.782 INFO:teuthology.orchestra.run.smithi161.stdout:507 write 0x9531a38 thru 0x9537896 (0x5e5f bytes) 2024-09-21T15:07:28.782 INFO:teuthology.orchestra.run.smithi161.stdout:590 write 0x3d2b339 thru 0x3d38615 (0xd2dd bytes) 2024-09-21T15:07:28.789 INFO:teuthology.orchestra.run.smithi161.stdout:428 read 0x695c94 thru 0x69fc28 (0x9f95 bytes) 2024-09-21T15:07:28.791 INFO:teuthology.orchestra.run.smithi161.stdout:430 punch from 0x2685317 to 0x268e307, (0x8ff0 bytes) 2024-09-21T15:07:28.791 INFO:teuthology.orchestra.run.smithi161.stdout:433 punch from 0x15b4479 to 0x15baf0c, (0x6a93 bytes) 2024-09-21T15:07:28.803 INFO:teuthology.orchestra.run.smithi161.stdout:591 punch from 0xddc41 to 0xe466f, (0x6a2e bytes) 2024-09-21T15:07:28.807 INFO:teuthology.orchestra.run.smithi161.stdout:508 read 0x76a2095 thru 0x76a7245 (0x51b1 bytes) 2024-09-21T15:07:28.823 INFO:teuthology.orchestra.run.smithi161.stdout:592 trunc from 0xb13ad19 to 0xf9acff 2024-09-21T15:07:28.865 INFO:teuthology.orchestra.run.smithi161.stdout:509 writesame 0xd64cfe1 thru 0xd6587c0 data_size 0x10(0xb7e0 bytes) 2024-09-21T15:07:28.865 INFO:teuthology.orchestra.run.smithi161.stdout:434 write 0xaaf1def thru 0xaafca77 (0xac89 bytes) 2024-09-21T15:07:28.870 INFO:teuthology.orchestra.run.smithi161.stdout:510 write 0x12269a8 thru 0x1232017 (0xb670 bytes) 2024-09-21T15:07:28.884 INFO:teuthology.orchestra.run.smithi161.stdout:436 read 0x76dca29 thru 0x76e98aa (0xce82 bytes) 2024-09-21T15:07:28.890 INFO:teuthology.orchestra.run.smithi161.stdout:512 write 0x230a787 thru 0x2313230 (0x8aaa bytes) 2024-09-21T15:07:28.903 INFO:teuthology.orchestra.run.smithi161.stdout:513 write 0x8a54321 thru 0x8a5be9b (0x7b7b bytes) 2024-09-21T15:07:28.917 INFO:teuthology.orchestra.run.smithi161.stdout:514 read 0xb0621ca thru 0xb0681c8 (0x5fff bytes) 2024-09-21T15:07:28.917 INFO:teuthology.orchestra.run.smithi161.stdout:515 writesame 0xca68810 thru 0xca6cd05 data_size 0x1a(0x44f6 bytes) 2024-09-21T15:07:28.924 INFO:teuthology.orchestra.run.smithi161.stdout:437 write 0xecde77b thru 0xecebe06 (0xd68c bytes) 2024-09-21T15:07:28.928 INFO:teuthology.orchestra.run.smithi161.stdout:516 read 0x8648690 thru 0x8654f09 (0xc87a bytes) 2024-09-21T15:07:28.928 INFO:teuthology.orchestra.run.smithi161.stdout:517 punch from 0xaf6ddab to 0xaf711ef, (0x3444 bytes) 2024-09-21T15:07:28.928 INFO:teuthology.orchestra.run.smithi161.stdout:520 read 0x73737e0 thru 0x73791b3 (0x59d4 bytes) 2024-09-21T15:07:28.929 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.929 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.929 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.930 INFO:teuthology.orchestra.run.smithi161.stdout:525 read 0xb66251a thru 0xb6653d7 (0x2ebe bytes) 2024-09-21T15:07:28.930 INFO:teuthology.orchestra.run.smithi161.stdout:526 read 0xaefdfe thru 0xafdbb3 (0xddb6 bytes) 2024-09-21T15:07:28.930 INFO:teuthology.orchestra.run.smithi161.stdout:527 write 0xad7afc thru 0xae6b6b (0xf070 bytes) 2024-09-21T15:07:28.935 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.935 INFO:teuthology.orchestra.run.smithi161.stdout:439 read 0x9f12526 thru 0x9f1cbd3 (0xa6ae bytes) 2024-09-21T15:07:28.936 INFO:teuthology.orchestra.run.smithi161.stdout:440 write 0x2804ef5 thru 0x2809a81 (0x4b8d bytes) 2024-09-21T15:07:28.944 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:28.944 INFO:teuthology.orchestra.run.smithi161.stdout:530 read 0xd1f622c thru 0xd1fc002 (0x5dd7 bytes) 2024-09-21T15:07:28.944 INFO:teuthology.orchestra.run.smithi161.stdout:531 write 0x43dbbbe thru 0x43ea98a (0xedcd bytes) 2024-09-21T15:07:28.945 INFO:teuthology.orchestra.run.smithi161.stdout:441 writesame 0xe6bb925 thru 0xe6c1d06 data_size 0x5(0x63e2 bytes) 2024-09-21T15:07:28.947 INFO:teuthology.orchestra.run.smithi161.stdout:593 write 0xe6da387 thru 0xe6e698e (0xc608 bytes) 2024-09-21T15:07:28.962 INFO:teuthology.orchestra.run.smithi161.stdout:533 write 0x97ea77d thru 0x97fa09b (0xf91f bytes) 2024-09-21T15:07:28.962 INFO:teuthology.orchestra.run.smithi161.stdout:595 read 0xc4fffa0 thru 0xc5073b7 (0x7418 bytes) 2024-09-21T15:07:28.962 INFO:teuthology.orchestra.run.smithi161.stdout:444 writesame 0xcf852d3 thru 0xcf91508 data_size 0x1(0xc236 bytes) 2024-09-21T15:07:28.963 INFO:teuthology.orchestra.run.smithi161.stdout:596 punch from 0x1473dff to 0x147b35a, (0x755b bytes) 2024-09-21T15:07:28.963 INFO:teuthology.orchestra.run.smithi161.stdout:597 read 0x9d2b0ef thru 0x9d2ed87 (0x3c99 bytes) 2024-09-21T15:07:28.963 INFO:teuthology.orchestra.run.smithi161.stdout:598 punch from 0xcfb1045 to 0xcfbede7, (0xdda2 bytes) 2024-09-21T15:07:28.963 INFO:teuthology.orchestra.run.smithi161.stdout:599 writesame 0x5b4238f thru 0x5b51cd4 data_size 0x1(0xf946 bytes) 2024-09-21T15:07:28.973 INFO:teuthology.orchestra.run.smithi161.stdout:534 write 0x20b0963 thru 0x20b8fba (0x8658 bytes) 2024-09-21T15:07:29.013 INFO:teuthology.orchestra.run.smithi161.stdout:445 punch from 0x3b6b16e to 0x3b798de, (0xe770 bytes) 2024-09-21T15:07:29.014 INFO:teuthology.orchestra.run.smithi161.stdout:446 write 0x88d94ee thru 0x88e051f (0x7032 bytes) 2024-09-21T15:07:29.024 INFO:teuthology.orchestra.run.smithi161.stdout:447 write 0x2c48e80 thru 0x2c5129d (0x841e bytes) 2024-09-21T15:07:29.028 INFO:teuthology.orchestra.run.smithi161.stdout:535 punch from 0xb3eb2a6 to 0xb3f5c59, (0xa9b3 bytes) 2024-09-21T15:07:29.028 INFO:teuthology.orchestra.run.smithi161.stdout:536 writesame 0xee4700 thru 0xee523a data_size 0x5(0xb3b bytes) 2024-09-21T15:07:29.028 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #2, image image_cluster1.client.mirror.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent3 2024-09-21T15:07:29.034 INFO:teuthology.orchestra.run.smithi161.stdout:449 read 0x166fffa thru 0x1679ae6 (0x9aed bytes) 2024-09-21T15:07:29.035 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #1, image image_cluster1.client.mirror.2-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent2 2024-09-21T15:07:29.039 INFO:teuthology.orchestra.run.smithi161.stdout:452 trunc from 0xecebe07 to 0xc2de744 2024-09-21T15:07:29.045 INFO:teuthology.orchestra.run.smithi161.stdout:600 trunc from 0xe6e698f to 0x51173da 2024-09-21T15:07:29.049 INFO:teuthology.orchestra.run.smithi161.stdout:538 write 0x71047c4 thru 0x7108289 (0x3ac6 bytes) 2024-09-21T15:07:29.056 INFO:teuthology.orchestra.run.smithi161.stdout:539 write 0xa73cf04 thru 0xa74c683 (0xf780 bytes) 2024-09-21T15:07:29.061 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #3, image image_cluster1.client.mirror.5-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent4 2024-09-21T15:07:29.072 INFO:teuthology.orchestra.run.smithi161.stdout:604 write 0xb483d63 thru 0xb484f9d (0x123b bytes) 2024-09-21T15:07:29.081 INFO:teuthology.orchestra.run.smithi161.stdout:541 trunc from 0xd6587c1 to 0x7b70a64 2024-09-21T15:07:29.088 INFO:teuthology.orchestra.run.smithi161.stdout:453 write 0x33afa0e thru 0x33bf6af (0xfca2 bytes) 2024-09-21T15:07:29.089 INFO:teuthology.orchestra.run.smithi161.stdout:866 writesame 0x8950e57 thru 0x8953bfa data_size 0x17(0x2da4 bytes) 2024-09-21T15:07:29.117 INFO:teuthology.orchestra.run.smithi161.stdout:454 trunc from 0xc2de744 to 0x4f8d5df 2024-09-21T15:07:29.120 INFO:teuthology.orchestra.run.smithi161.stdout:605 writesame 0x39afe thru 0x45053 data_size 0x9(0xb556 bytes) 2024-09-21T15:07:29.127 INFO:teuthology.orchestra.run.smithi161.stdout:867 read 0xc131b90 thru 0xc132248 (0x6b9 bytes) 2024-09-21T15:07:29.127 INFO:teuthology.orchestra.run.smithi161.stdout:868 read 0x930c22 thru 0x9332b1 (0x2690 bytes) 2024-09-21T15:07:29.127 INFO:teuthology.orchestra.run.smithi161.stdout:869 punch from 0x3359566 to 0x335e11c, (0x4bb6 bytes) 2024-09-21T15:07:29.128 INFO:teuthology.orchestra.run.smithi161.stdout:870 read 0x6b59f8 thru 0x6c354c (0xdb55 bytes) 2024-09-21T15:07:29.129 INFO:teuthology.orchestra.run.smithi161.stdout:543 write 0x45abc68 thru 0x45afd9c (0x4135 bytes) 2024-09-21T15:07:29.130 INFO:teuthology.orchestra.run.smithi161.stdout:871 writesame 0x50b78c7 thru 0x50c3e7a data_size 0x2(0xc5b4 bytes) 2024-09-21T15:07:29.138 INFO:teuthology.orchestra.run.smithi161.stdout:601 write 0xc3bd7c6 thru 0xc3c9b07 (0xc342 bytes) 2024-09-21T15:07:29.150 INFO:teuthology.orchestra.run.smithi161.stdout:606 read 0xab79a2c thru 0xab8952d (0xfb02 bytes) 2024-09-21T15:07:29.151 INFO:teuthology.orchestra.run.smithi161.stdout:609 read 0xcb34758 thru 0xcb41859 (0xd102 bytes) 2024-09-21T15:07:29.151 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.151 INFO:teuthology.orchestra.run.smithi161.stdout:611 punch from 0x311696 to 0x321523, (0xfe8d bytes) 2024-09-21T15:07:29.151 INFO:teuthology.orchestra.run.smithi161.stdout:612 writesame 0xcdcbfd3 thru 0xcdd6295 data_size 0x39(0xa2c3 bytes) 2024-09-21T15:07:29.154 INFO:teuthology.orchestra.run.smithi161.stdout:544 write 0x2a0f87d thru 0x2a154f3 (0x5c77 bytes) 2024-09-21T15:07:29.155 INFO:teuthology.orchestra.run.smithi161.stdout:873 read 0xa4ba0c4 thru 0xa4bbbc1 (0x1afe bytes) 2024-09-21T15:07:29.156 INFO:teuthology.orchestra.run.smithi161.stdout:874 write 0x328aee9 thru 0x32945e5 (0x96fd bytes) 2024-09-21T15:07:29.158 INFO:teuthology.orchestra.run.smithi161.stdout:602 read 0xa2a0a6e thru 0xa2af7b0 (0xed43 bytes) 2024-09-21T15:07:29.159 INFO:teuthology.orchestra.run.smithi161.stdout:603 read 0xbf93f0e thru 0xbf94ea9 (0xf9c bytes) 2024-09-21T15:07:29.159 INFO:teuthology.orchestra.run.smithi161.stdout:604 read 0x32e88dd thru 0x32f6c22 (0xe346 bytes) 2024-09-21T15:07:29.159 INFO:teuthology.orchestra.run.smithi161.stdout:606 write 0x96805a0 thru 0x9682f64 (0x29c5 bytes) 2024-09-21T15:07:29.166 INFO:teuthology.orchestra.run.smithi161.stdout:875 read 0x464dc2 thru 0x469f62 (0x51a1 bytes) 2024-09-21T15:07:29.166 INFO:teuthology.orchestra.run.smithi161.stdout:616 punch from 0x176a59b to 0x1773ac0, (0x9525 bytes) 2024-09-21T15:07:29.167 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.167 INFO:teuthology.orchestra.run.smithi161.stdout:618 punch from 0xab6ad86 to 0xab754df, (0xa759 bytes) 2024-09-21T15:07:29.167 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.167 INFO:teuthology.orchestra.run.smithi161.stdout:621 write 0x993870c thru 0x9942571 (0x9e66 bytes) 2024-09-21T15:07:29.167 INFO:teuthology.orchestra.run.smithi161.stdout:876 write 0xb953dad thru 0xb95549e (0x16f2 bytes) 2024-09-21T15:07:29.169 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.171 INFO:teuthology.orchestra.run.smithi161.stdout:608 read 0x2af6ed9 thru 0x2afcccd (0x5df5 bytes) 2024-09-21T15:07:29.171 INFO:teuthology.orchestra.run.smithi161.stdout:609 punch from 0x2a7a456 to 0x2a7cd49, (0x28f3 bytes) 2024-09-21T15:07:29.171 INFO:teuthology.orchestra.run.smithi161.stdout:611 write 0x92dbfab thru 0x92dffba (0x4010 bytes) 2024-09-21T15:07:29.171 INFO:teuthology.orchestra.run.smithi161.stdout:545 read 0x68c6b7b thru 0x68d3e0a (0xd290 bytes) 2024-09-21T15:07:29.181 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.181 INFO:teuthology.orchestra.run.smithi161.stdout:878 read 0x8422649 thru 0x8432105 (0xfabd bytes) 2024-09-21T15:07:29.181 INFO:teuthology.orchestra.run.smithi161.stdout:879 write 0x9ff30fb thru 0x9ffac4d (0x7b53 bytes) 2024-09-21T15:07:29.184 INFO:teuthology.orchestra.run.smithi161.stdout:456 trunc from 0x4f8d5df to 0xcd4b989 2024-09-21T15:07:29.189 INFO:teuthology.orchestra.run.smithi161.stdout:612 writesame 0x4e2c77d thru 0x4e2dc25 data_size 0x29(0x14a9 bytes) 2024-09-21T15:07:29.199 INFO:teuthology.orchestra.run.smithi161.stdout:623 read 0xc9d420e thru 0xc9d9d34 (0x5b27 bytes) 2024-09-21T15:07:29.199 INFO:teuthology.orchestra.run.smithi161.stdout:626 read 0x5b54cdf thru 0x5b5a90f (0x5c31 bytes) 2024-09-21T15:07:29.199 INFO:teuthology.orchestra.run.smithi161.stdout:627 punch from 0xbe4ce3 to 0xbf0eff, (0xc21c bytes) 2024-09-21T15:07:29.200 INFO:teuthology.orchestra.run.smithi161.stdout:628 read 0xb8d5016 thru 0xb8d6f41 (0x1f2c bytes) 2024-09-21T15:07:29.200 INFO:teuthology.orchestra.run.smithi161.stdout:629 punch from 0x61e31f1 to 0x61e77a7, (0x45b6 bytes) 2024-09-21T15:07:29.201 INFO:teuthology.orchestra.run.smithi161.stdout:613 write 0xabb4ef thru 0xabd488 (0x1f9a bytes) 2024-09-21T15:07:29.202 INFO:teuthology.orchestra.run.smithi161.stdout:630 trunc from 0xcec953a to 0xba58d81 2024-09-21T15:07:29.212 INFO:teuthology.orchestra.run.smithi161.stdout:546 write 0x9e1ee58 thru 0x9e213b6 (0x255f bytes) 2024-09-21T15:07:29.216 INFO:teuthology.orchestra.run.smithi161.stdout:614 trunc from 0xc3c9b08 to 0xaedeb50 2024-09-21T15:07:29.217 INFO:teuthology.orchestra.run.smithi161.stdout:458 writesame 0x22ea6e4 thru 0x22f31de data_size 0x1(0x8afb bytes) 2024-09-21T15:07:29.224 INFO:teuthology.orchestra.run.smithi161.stdout:547 read 0x5f1c38 thru 0x5fdeee (0xc2b7 bytes) 2024-09-21T15:07:29.225 INFO:teuthology.orchestra.run.smithi161.stdout:548 read 0x5ba7f37 thru 0x5ba806b (0x135 bytes) 2024-09-21T15:07:29.225 INFO:teuthology.orchestra.run.smithi161.stdout:882 trunc from 0xdd1f20d to 0x1a2694b 2024-09-21T15:07:29.255 INFO:teuthology.orchestra.run.smithi161.stdout:459 read 0xaae9f27 thru 0xaaf9241 (0xf31b bytes) 2024-09-21T15:07:29.255 INFO:teuthology.orchestra.run.smithi161.stdout:460 write 0xc2516bd thru 0xc2572d1 (0x5c15 bytes) 2024-09-21T15:07:29.261 INFO:teuthology.orchestra.run.smithi161.stdout:550 writesame 0xeb15d3f thru 0xeb1f638 data_size 0x7a(0x98fa bytes) 2024-09-21T15:07:29.266 INFO:teuthology.orchestra.run.smithi161.stdout:615 read 0x3e4d3dc thru 0x3e4f2f3 (0x1f18 bytes) 2024-09-21T15:07:29.267 INFO:teuthology.orchestra.run.smithi161.stdout:552 read 0x1934293 thru 0x19407e6 (0xc554 bytes) 2024-09-21T15:07:29.267 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.268 INFO:teuthology.orchestra.run.smithi161.stdout:555 write 0xb900a57 thru 0xb9109ba (0xff64 bytes) 2024-09-21T15:07:29.268 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.273 INFO:teuthology.orchestra.run.smithi161.stdout:461 writesame 0x2215f56 thru 0x2219cd6 data_size 0x5(0x3d81 bytes) 2024-09-21T15:07:29.291 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.291 INFO:teuthology.orchestra.run.smithi161.stdout:463 write 0x5852ca3 thru 0x585eee3 (0xc241 bytes) 2024-09-21T15:07:29.300 INFO:teuthology.orchestra.run.smithi161.stdout:617 writesame 0xb89b7ce thru 0xb8a5074 data_size 0x1(0x98a7 bytes) 2024-09-21T15:07:29.301 INFO:teuthology.orchestra.run.smithi161.stdout:631 read 0x175eaff thru 0x1767148 (0x864a bytes) 2024-09-21T15:07:29.301 INFO:teuthology.orchestra.run.smithi161.stdout:632 write 0xd857c6 thru 0xd89ea3 (0x46de bytes) 2024-09-21T15:07:29.302 INFO:teuthology.orchestra.run.smithi161.stdout:465 punch from 0x33752e7 to 0x3378350, (0x3069 bytes) 2024-09-21T15:07:29.302 INFO:teuthology.orchestra.run.smithi161.stdout:466 writesame 0x2e1b438 thru 0x2e256bf data_size 0x8(0xa288 bytes) 2024-09-21T15:07:29.307 INFO:teuthology.orchestra.run.smithi161.stdout:556 trunc from 0xeb1f639 to 0x54b0487 2024-09-21T15:07:29.311 INFO:teuthology.orchestra.run.smithi161.stdout:883 writesame 0xdc0673 thru 0xdce3a2 data_size 0x8(0xdd30 bytes) 2024-09-21T15:07:29.314 INFO:teuthology.orchestra.run.smithi161.stdout:618 punch from 0xa1f54ba to 0xa1f96b4, (0x41fa bytes) 2024-09-21T15:07:29.314 INFO:teuthology.orchestra.run.smithi161.stdout:619 write 0x247c173 thru 0x24800f6 (0x3f84 bytes) 2024-09-21T15:07:29.319 INFO:teuthology.orchestra.run.smithi161.stdout:620 write 0x1bfc855 thru 0x1c04749 (0x7ef5 bytes) 2024-09-21T15:07:29.320 INFO:teuthology.orchestra.run.smithi161.stdout:467 punch from 0xbea27e6 to 0xbead49b, (0xacb5 bytes) 2024-09-21T15:07:29.320 INFO:teuthology.orchestra.run.smithi161.stdout:468 read 0x4828710 thru 0x4830df5 (0x86e6 bytes) 2024-09-21T15:07:29.320 INFO:teuthology.orchestra.run.smithi161.stdout:471 read 0xc03a694 thru 0xc047061 (0xc9ce bytes) 2024-09-21T15:07:29.321 INFO:teuthology.orchestra.run.smithi161.stdout:472 clone 8 order 23 su 65536 sc 6 2024-09-21T15:07:29.336 INFO:teuthology.orchestra.run.smithi161.stdout:622 trunc from 0xb8a5075 to 0xd6095f6 2024-09-21T15:07:29.380 INFO:teuthology.orchestra.run.smithi161.stdout:634 write 0xbb77c0a thru 0xbb7ab8b (0x2f82 bytes) 2024-09-21T15:07:29.384 INFO:teuthology.orchestra.run.smithi161.stdout:623 read 0x9cfc504 thru 0x9d0314c (0x6c49 bytes) 2024-09-21T15:07:29.384 INFO:teuthology.orchestra.run.smithi161.stdout:624 read 0x40a71eb thru 0x40aeccb (0x7ae1 bytes) 2024-09-21T15:07:29.385 INFO:teuthology.orchestra.run.smithi161.stdout:635 punch from 0x2832219 to 0x283f223, (0xd00a bytes) 2024-09-21T15:07:29.385 INFO:teuthology.orchestra.run.smithi161.stdout:637 read 0xb012865 thru 0xb01fe1b (0xd5b7 bytes) 2024-09-21T15:07:29.385 INFO:teuthology.orchestra.run.smithi161.stdout:625 punch from 0xd2f3b76 to 0xd2fc7e9, (0x8c73 bytes) 2024-09-21T15:07:29.385 INFO:teuthology.orchestra.run.smithi161.stdout:626 read 0x895e968 thru 0x896aaf1 (0xc18a bytes) 2024-09-21T15:07:29.385 INFO:teuthology.orchestra.run.smithi161.stdout:627 punch from 0xb6e84f4 to 0xb6eb7aa, (0x32b6 bytes) 2024-09-21T15:07:29.386 INFO:teuthology.orchestra.run.smithi161.stdout:638 write 0x1f5e5b4 thru 0x1f5f839 (0x1286 bytes) 2024-09-21T15:07:29.386 INFO:teuthology.orchestra.run.smithi161.stdout:628 writesame 0x838e036 thru 0x839071e data_size 0x1(0x26e9 bytes) 2024-09-21T15:07:29.386 INFO:teuthology.orchestra.run.smithi161.stdout:886 writesame 0x6f8fba1 thru 0x6f9506c data_size 0x36(0x54cc bytes) 2024-09-21T15:07:29.393 INFO:teuthology.orchestra.run.smithi161.stdout:557 read 0x35451c0 thru 0x354ba5b (0x689c bytes) 2024-09-21T15:07:29.394 INFO:teuthology.orchestra.run.smithi161.stdout:558 punch from 0xda7978 to 0xdaeef2, (0x757a bytes) 2024-09-21T15:07:29.395 INFO:teuthology.orchestra.run.smithi161.stdout:631 write 0x46df2be thru 0x46dffc4 (0xd07 bytes) 2024-09-21T15:07:29.397 INFO:teuthology.orchestra.run.smithi161.stdout:640 write 0xa459dcb thru 0xa4647be (0xa9f4 bytes) 2024-09-21T15:07:29.400 INFO:teuthology.orchestra.run.smithi161.stdout:559 trunc from 0x54b0487 to 0x278a082 2024-09-21T15:07:29.402 INFO:teuthology.orchestra.run.smithi161.stdout:887 trunc from 0x6f9506d to 0xcbfcf1d 2024-09-21T15:07:29.404 INFO:teuthology.orchestra.run.smithi161.stdout:632 write 0xc6cfb8e thru 0xc6d28c7 (0x2d3a bytes) 2024-09-21T15:07:29.416 INFO:teuthology.orchestra.run.smithi161.stdout:633 read 0x18eebf2 thru 0x18f9d7b (0xb18a bytes) 2024-09-21T15:07:29.416 INFO:teuthology.orchestra.run.smithi161.stdout:635 punch from 0x94892cd to 0x948a7e8, (0x151b bytes) 2024-09-21T15:07:29.416 INFO:teuthology.orchestra.run.smithi161.stdout:637 read 0xacdc114 thru 0xace3cdc (0x7bc9 bytes) 2024-09-21T15:07:29.416 INFO:teuthology.orchestra.run.smithi161.stdout:641 write 0x397e21d thru 0x398886f (0xa653 bytes) 2024-09-21T15:07:29.416 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.416 INFO:teuthology.orchestra.run.smithi161.stdout:641 punch from 0x860f9c4 to 0x8619bb8, (0xa1f4 bytes) 2024-09-21T15:07:29.445 INFO:teuthology.orchestra.run.smithi161.stdout:889 read 0x84babd9 thru 0x84c4742 (0x9b6a bytes) 2024-09-21T15:07:29.445 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.446 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.446 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.446 INFO:teuthology.orchestra.run.smithi161.stdout:896 write 0x2a27471 thru 0x2a2d016 (0x5ba6 bytes) 2024-09-21T15:07:29.456 INFO:teuthology.orchestra.run.smithi161.stdout:642 read 0x998de80 thru 0x999cdc3 (0xef44 bytes) 2024-09-21T15:07:29.457 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.457 INFO:teuthology.orchestra.run.smithi161.stdout:645 read 0x27be8c4 thru 0x27c5fc0 (0x76fd bytes) 2024-09-21T15:07:29.458 INFO:teuthology.orchestra.run.smithi161.stdout:646 read 0x6ca3605 thru 0x6ca6bc9 (0x35c5 bytes) 2024-09-21T15:07:29.458 INFO:teuthology.orchestra.run.smithi161.stdout:647 read 0x8313ea6 thru 0x831db71 (0x9ccc bytes) 2024-09-21T15:07:29.458 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.458 INFO:teuthology.orchestra.run.smithi161.stdout:650 writesame 0x56b1ead thru 0x56babba data_size 0x73(0x8d0e bytes) 2024-09-21T15:07:29.458 INFO:teuthology.orchestra.run.smithi161.stdout:897 writesame 0x992b4c0 thru 0x9936139 data_size 0x63(0xac7a bytes) 2024-09-21T15:07:29.461 INFO:teuthology.orchestra.run.smithi161.stdout:642 writesame 0xe0f20a0 thru 0xe100981 data_size 0xd(0xe8e2 bytes) 2024-09-21T15:07:29.467 INFO:teuthology.orchestra.run.smithi161.stdout:643 write 0x560b3ef thru 0x56182b6 (0xcec8 bytes) 2024-09-21T15:07:29.472 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.472 INFO:teuthology.orchestra.run.smithi161.stdout:561 punch from 0x152c493 to 0x153b09c, (0xec09 bytes) 2024-09-21T15:07:29.478 INFO:teuthology.orchestra.run.smithi161.stdout:898 punch from 0x89df26a to 0x89e512b, (0x5ec1 bytes) 2024-09-21T15:07:29.478 INFO:teuthology.orchestra.run.smithi161.stdout:902 punch from 0x2b1b02e to 0x2b27569, (0xc53b bytes) 2024-09-21T15:07:29.478 INFO:teuthology.orchestra.run.smithi161.stdout:903 read 0x1b26c79 thru 0x1b2ad5e (0x40e6 bytes) 2024-09-21T15:07:29.478 INFO:teuthology.orchestra.run.smithi161.stdout:648 write 0x87a267 thru 0x88727a (0xd014 bytes) 2024-09-21T15:07:29.488 INFO:teuthology.orchestra.run.smithi161.stdout:649 writesame 0x99fc0e9 thru 0x99ff8b2 data_size 0x2(0x37ca bytes) 2024-09-21T15:07:29.496 INFO:teuthology.orchestra.run.smithi161.stdout:324 read 0xd5e5542 thru 0xd5efe31 (0xa8f0 bytes) 2024-09-21T15:07:29.506 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.506 INFO:teuthology.orchestra.run.smithi161.stdout:651 read 0x6cd429 thru 0x6dc288 (0xee60 bytes) 2024-09-21T15:07:29.513 INFO:teuthology.orchestra.run.smithi161.stdout:653 write 0xc590079 thru 0xc599d0a (0x9c92 bytes) 2024-09-21T15:07:29.514 INFO:teuthology.orchestra.run.smithi161.stdout:652 trunc from 0xe100982 to 0xa5dcaf7 2024-09-21T15:07:29.516 INFO:teuthology.orchestra.run.smithi161.stdout:905 writesame 0xcde6341 thru 0xcde8912 data_size 0x2(0x25d2 bytes) 2024-09-21T15:07:29.519 INFO:teuthology.orchestra.run.smithi161.stdout:562 write 0xd04388f thru 0xd044bba (0x132c bytes) 2024-09-21T15:07:29.526 INFO:teuthology.orchestra.run.smithi161.stdout:908 trunc from 0xcde8913 to 0x954111e 2024-09-21T15:07:29.527 INFO:teuthology.orchestra.run.smithi161.stdout:563 punch from 0x3824f28 to 0x3834ca8, (0xfd80 bytes) 2024-09-21T15:07:29.527 INFO:teuthology.orchestra.run.smithi161.stdout:564 write 0x5eb4e56 thru 0x5eb6c99 (0x1e44 bytes) 2024-09-21T15:07:29.550 INFO:teuthology.orchestra.run.smithi161.stdout:565 trunc from 0xd044bbb to 0xc32d7a1 2024-09-21T15:07:29.551 INFO:teuthology.orchestra.run.smithi161.stdout:325 trunc from 0xe7f0f4f to 0x468055 2024-09-21T15:07:29.560 INFO:teuthology.orchestra.run.smithi161.stdout:654 write 0xdc73057 thru 0xdc74aba (0x1a64 bytes) 2024-09-21T15:07:29.578 INFO:teuthology.orchestra.run.smithi161.stdout:655 read 0x77d3700 thru 0x77db98a (0x828b bytes) 2024-09-21T15:07:29.579 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.579 INFO:teuthology.orchestra.run.smithi161.stdout:658 writesame 0xdb36c13 thru 0xdb46445 data_size 0x1d(0xf833 bytes) 2024-09-21T15:07:29.579 INFO:teuthology.orchestra.run.smithi161.stdout:653 trunc from 0xa5dcaf7 to 0x14faeca 2024-09-21T15:07:29.598 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.598 INFO:teuthology.orchestra.run.smithi161.stdout:661 writesame 0x15830d5 thru 0x158cdc3 data_size 0x5(0x9cef bytes) 2024-09-21T15:07:29.611 INFO:teuthology.orchestra.run.smithi161.stdout:566 write 0x6f10acb thru 0x6f10f7d (0x4b3 bytes) 2024-09-21T15:07:29.617 INFO:teuthology.orchestra.run.smithi161.stdout:328 trunc from 0x468055 to 0x35338ea 2024-09-21T15:07:29.619 INFO:teuthology.orchestra.run.smithi161.stdout:909 write 0xdc8ecfb thru 0xdc9953f (0xa845 bytes) 2024-09-21T15:07:29.623 INFO:teuthology.orchestra.run.smithi161.stdout:662 write 0x64c043d thru 0x64c2ab6 (0x267a bytes) 2024-09-21T15:07:29.635 INFO:teuthology.orchestra.run.smithi161.stdout:910 write 0xc5739b6 thru 0xc5797ec (0x5e37 bytes) 2024-09-21T15:07:29.636 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.636 INFO:teuthology.orchestra.run.smithi161.stdout:330 read 0x1e163db thru 0x1e22ffd (0xcc23 bytes) 2024-09-21T15:07:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.650 INFO:teuthology.orchestra.run.smithi161.stdout:913 writesame 0x377cc9b thru 0x3782c2e data_size 0x6(0x5f94 bytes) 2024-09-21T15:07:29.661 INFO:teuthology.orchestra.run.smithi161.stdout:567 write 0xddf3892 thru 0xddf76e3 (0x3e52 bytes) 2024-09-21T15:07:29.661 INFO:teuthology.orchestra.run.smithi161.stdout:914 read 0xc91b812 thru 0xc9240d6 (0x88c5 bytes) 2024-09-21T15:07:29.661 INFO:teuthology.orchestra.run.smithi161.stdout:915 write 0x6f19d10 thru 0x6f24996 (0xac87 bytes) 2024-09-21T15:07:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:569 write 0x9900539 thru 0x9900e27 (0x8ef bytes) 2024-09-21T15:07:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:332 trunc from 0x35338ea to 0xe8e6011 2024-09-21T15:07:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:917 read 0xbdb1dd thru 0xbdf018 (0x3e3c bytes) 2024-09-21T15:07:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:918 write 0x3ae2d48 thru 0x3ae300a (0x2c3 bytes) 2024-09-21T15:07:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:654 write 0xdafb9b5 thru 0xdb0092f (0x4f7b bytes) 2024-09-21T15:07:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:663 trunc from 0xdc74abb to 0x1405a1d 2024-09-21T15:07:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:919 punch from 0xb6adae1 to 0xb6bb215, (0xd734 bytes) 2024-09-21T15:07:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:571 read 0xd5bebad thru 0xd5c5979 (0x6dcd bytes) 2024-09-21T15:07:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:923 read 0x472e3ac thru 0x473643e (0x8093 bytes) 2024-09-21T15:07:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:925 read 0x8625b54 thru 0x8628c63 (0x3110 bytes) 2024-09-21T15:07:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:572 writesame 0x6886a13 thru 0x688cea2 data_size 0x8(0x6490 bytes) 2024-09-21T15:07:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:931 read 0x5b75d3a thru 0x5b7a800 (0x4ac7 bytes) 2024-09-21T15:07:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:932 write 0x88085f1 thru 0x88125df (0x9fef bytes) 2024-09-21T15:07:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:655 read 0x8a0b042 thru 0x8a1ad2f (0xfcee bytes) 2024-09-21T15:07:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:657 punch from 0x44806be to 0x448e079, (0xd9bb bytes) 2024-09-21T15:07:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:658 read 0x544b845 thru 0x544c0a3 (0x85f bytes) 2024-09-21T15:07:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:665 writesame 0x1674a07 thru 0x167e400 data_size 0x1(0x99fa bytes) 2024-09-21T15:07:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:573 read 0x9b15523 thru 0x9b225a3 (0xd081 bytes) 2024-09-21T15:07:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:577 punch from 0x436e9b8 to 0x437282e, (0x3e76 bytes) 2024-09-21T15:07:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:579 writesame 0x8f3eaee thru 0x8f487e9 data_size 0x11(0x9cfc bytes) 2024-09-21T15:07:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:334 read 0x41f08e5 thru 0x41f2cbf (0x23db bytes) 2024-09-21T15:07:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:336 read 0x61e450b thru 0x61e47b5 (0x2ab bytes) 2024-09-21T15:07:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:337 writesame 0x4e1798e thru 0x4e1f640 data_size 0x3(0x7cb3 bytes) 2024-09-21T15:07:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:933 write 0xb45d243 thru 0xb46b3f9 (0xe1b7 bytes) 2024-09-21T15:07:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:666 trunc from 0xdb00930 to 0xd59c0bb 2024-09-21T15:07:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:338 write 0x6ae4422 thru 0x6aefed9 (0xbab8 bytes) 2024-09-21T15:07:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:581 read 0x14ae9b1 thru 0x14b59e2 (0x7032 bytes) 2024-09-21T15:07:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:582 read 0x3b02945 thru 0x3b06d3c (0x43f8 bytes) 2024-09-21T15:07:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:584 read 0x2b92899 thru 0x2b98e72 (0x65da bytes) 2024-09-21T15:07:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:585 clone 4 order 22 su 65536 sc 4 2024-09-21T15:07:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:934 write 0x24d5b67 thru 0x24dfd75 (0xa20f bytes) 2024-09-21T15:07:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:339 trunc from 0xe8e6011 to 0x8b58298 2024-09-21T15:07:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:667 read 0x8996240 thru 0x89a5614 (0xf3d5 bytes) 2024-09-21T15:07:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:668 punch from 0x401f5b to 0x405197, (0x323c bytes) 2024-09-21T15:07:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:669 writesame 0x3d033e3 thru 0x3d0db4b data_size 0x1(0xa769 bytes) 2024-09-21T15:07:29.796 INFO:teuthology.orchestra.run.smithi161.stdout:340 read 0x80f1bec thru 0x80f8fcd (0x73e2 bytes) 2024-09-21T15:07:29.796 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.796 INFO:teuthology.orchestra.run.smithi161.stdout:342 writesame 0x625166a thru 0x625375f data_size 0x1(0x20f6 bytes) 2024-09-21T15:07:29.806 INFO:teuthology.orchestra.run.smithi161.stdout:670 writesame 0x2adc2b5 thru 0x2adc577 data_size 0x1(0x2c3 bytes) 2024-09-21T15:07:29.808 INFO:teuthology.orchestra.run.smithi161.stdout:344 punch from 0x7d0b7f6 to 0x7d0da33, (0x223d bytes) 2024-09-21T15:07:29.808 INFO:teuthology.orchestra.run.smithi161.stdout:346 punch from 0x6c85329 to 0x6c90745, (0xb41c bytes) 2024-09-21T15:07:29.809 INFO:teuthology.orchestra.run.smithi161.stdout:347 write 0x8adf40c thru 0x8aee55d (0xf152 bytes) 2024-09-21T15:07:29.815 INFO:teuthology.orchestra.run.smithi161.stdout:936 writesame 0xde21486 thru 0xde30ab5 data_size 0x9c(0xf630 bytes) 2024-09-21T15:07:29.815 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.815 INFO:teuthology.orchestra.run.smithi161.stdout:674 write 0x5eb10c9 thru 0x5ebae3a (0x9d72 bytes) 2024-09-21T15:07:29.816 INFO:teuthology.orchestra.run.smithi161.stdout:664 read 0x95d366 thru 0x964d79 (0x7a14 bytes) 2024-09-21T15:07:29.817 INFO:teuthology.orchestra.run.smithi161.stdout:665 read 0x12c6ff8 thru 0x12d0b52 (0x9b5b bytes) 2024-09-21T15:07:29.818 INFO:teuthology.orchestra.run.smithi161.stdout:937 read 0xa4bf6be thru 0xa4c55ec (0x5f2f bytes) 2024-09-21T15:07:29.818 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.818 INFO:teuthology.orchestra.run.smithi161.stdout:940 clone 4 order 23 su 131072 sc 4 2024-09-21T15:07:29.831 INFO:teuthology.orchestra.run.smithi161.stdout:676 writesame 0x37474ea thru 0x3754c8e data_size 0x5(0xd7a5 bytes) 2024-09-21T15:07:29.843 INFO:teuthology.orchestra.run.smithi161.stdout:666 write 0x18cf872 thru 0x18d9c31 (0xa3c0 bytes) 2024-09-21T15:07:29.846 INFO:teuthology.orchestra.run.smithi161.stdout:678 punch from 0x6555a79 to 0x6562ff3, (0xd57a bytes) 2024-09-21T15:07:29.846 INFO:teuthology.orchestra.run.smithi161.stdout:679 punch from 0xa87ff3b to 0xa886566, (0x662b bytes) 2024-09-21T15:07:29.846 INFO:teuthology.orchestra.run.smithi161.stdout:681 write 0x406830c thru 0x4069d16 (0x1a0b bytes) 2024-09-21T15:07:29.856 INFO:teuthology.orchestra.run.smithi161.stdout:667 read 0x134147e thru 0x134e6ee (0xd271 bytes) 2024-09-21T15:07:29.857 INFO:teuthology.orchestra.run.smithi161.stdout:668 read 0xd9b4bf thru 0xda4d13 (0x9855 bytes) 2024-09-21T15:07:29.861 INFO:teuthology.orchestra.run.smithi161.stdout:682 read 0x1e1f3cc thru 0x1e205e5 (0x121a bytes) 2024-09-21T15:07:29.862 INFO:teuthology.orchestra.run.smithi161.stdout:683 writesame 0x7b5e739 thru 0x7b631cc data_size 0x56(0x4a94 bytes) 2024-09-21T15:07:29.864 INFO:teuthology.orchestra.run.smithi161.stdout:348 writesame 0xca3706e thru 0xca3a305 data_size 0x4(0x3298 bytes) 2024-09-21T15:07:29.869 INFO:teuthology.orchestra.run.smithi161.stdout:350 write 0xa77024d thru 0xa77f17b (0xef2f bytes) 2024-09-21T15:07:29.881 INFO:teuthology.orchestra.run.smithi161.stdout:685 punch from 0xae584e7 to 0xae5b1ab, (0x2cc4 bytes) 2024-09-21T15:07:29.881 INFO:teuthology.orchestra.run.smithi161.stdout:686 read 0x790fac4 thru 0x7916676 (0x6bb3 bytes) 2024-09-21T15:07:29.890 INFO:teuthology.orchestra.run.smithi161.stdout:351 punch from 0x78bc68b to 0x78cb8f9, (0xf26e bytes) 2024-09-21T15:07:29.897 INFO:teuthology.orchestra.run.smithi161.stdout:352 trunc from 0xca3a306 to 0x8cbf28f 2024-09-21T15:07:29.900 INFO:teuthology.orchestra.run.smithi161.stdout:687 trunc from 0xd59c0bb to 0x2553e41 2024-09-21T15:07:29.915 INFO:teuthology.orchestra.run.smithi161.stdout:669 write 0x4e34875 thru 0x4e3663d (0x1dc9 bytes) 2024-09-21T15:07:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.941 INFO:teuthology.orchestra.run.smithi161.stdout:353 write 0x3576ed8 thru 0x3579ddb (0x2f04 bytes) 2024-09-21T15:07:29.962 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:29.962 INFO:teuthology.orchestra.run.smithi161.stdout:355 punch from 0x185335 to 0x18b89f, (0x656a bytes) 2024-09-21T15:07:29.962 INFO:teuthology.orchestra.run.smithi161.stdout:357 read 0x7a9660 thru 0x7b4dfb (0xb79c bytes) 2024-09-21T15:07:29.962 INFO:teuthology.orchestra.run.smithi161.stdout:360 read 0x684aec0 thru 0x684f1bf (0x4300 bytes) 2024-09-21T15:07:29.962 INFO:teuthology.orchestra.run.smithi161.stdout:361 writesame 0x57dd895 thru 0x57e7098 data_size 0x8d(0x9804 bytes) 2024-09-21T15:07:29.966 INFO:teuthology.orchestra.run.smithi161.stdout:672 write 0x533f14c thru 0x534d93f (0xe7f4 bytes) 2024-09-21T15:07:29.975 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #6, image image_cluster1.client.mirror.3-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent7 2024-09-21T15:07:29.978 INFO:teuthology.orchestra.run.smithi161.stdout:362 read 0x687fe33 thru 0x688df97 (0xe165 bytes) 2024-09-21T15:07:29.978 INFO:teuthology.orchestra.run.smithi161.stdout:363 write 0x810a87a thru 0x8114e6c (0xa5f3 bytes) 2024-09-21T15:07:29.994 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.004 INFO:teuthology.orchestra.run.smithi161.stdout:688 write 0x6daa87a thru 0x6daf7da (0x4f61 bytes) 2024-09-21T15:07:30.039 INFO:teuthology.orchestra.run.smithi161.stdout:364 write 0xe41fa8f thru 0xe423d90 (0x4302 bytes) 2024-09-21T15:07:30.053 INFO:teuthology.orchestra.run.smithi161.stdout:674 write 0xeadf6d5 thru 0xeaedee1 (0xe80d bytes) 2024-09-21T15:07:30.057 INFO:teuthology.orchestra.run.smithi161.stdout:365 read 0x25fc661 thru 0x2607990 (0xb330 bytes) 2024-09-21T15:07:30.057 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.057 INFO:teuthology.orchestra.run.smithi161.stdout:367 write 0x14b6bf7 thru 0x14b8216 (0x1620 bytes) 2024-09-21T15:07:30.066 INFO:teuthology.orchestra.run.smithi161.stdout:368 writesame 0x3099f49 thru 0x30a1eae data_size 0x17(0x7f66 bytes) 2024-09-21T15:07:30.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:07:30.063+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cbdb63c0 handle_clone_image: failed to clone image mirror/10b4bac0c30e to image_cluster1.client.mirror.3-clone1 2024-09-21T15:07:30.070 INFO:teuthology.orchestra.run.smithi161.stdout:677 write 0x427b02a thru 0x428814a (0xd121 bytes) 2024-09-21T15:07:30.072 INFO:teuthology.orchestra.run.smithi161.stdout:689 write 0xb5d2c4e thru 0xb5dd8b1 (0xac64 bytes) 2024-09-21T15:07:30.081 INFO:teuthology.orchestra.run.smithi161.stdout:370 punch from 0x32e6e60 to 0x32eb08a, (0x422a bytes) 2024-09-21T15:07:30.081 INFO:teuthology.orchestra.run.smithi161.stdout:371 punch from 0xb854969 to 0xb863128, (0xe7bf bytes) 2024-09-21T15:07:30.081 INFO:teuthology.orchestra.run.smithi161.stdout:372 read 0xd8ae78f thru 0xd8ba596 (0xbe08 bytes) 2024-09-21T15:07:30.081 INFO:teuthology.orchestra.run.smithi161.stdout:373 punch from 0x15b4490 to 0x15bf7fb, (0xb36b bytes) 2024-09-21T15:07:30.081 INFO:teuthology.orchestra.run.smithi161.stdout:374 writesame 0xa5bd9bb thru 0xa5c6c9f data_size 0xf(0x92e5 bytes) 2024-09-21T15:07:30.086 INFO:teuthology.orchestra.run.smithi161.stdout:678 read 0x60b894b thru 0x60c6896 (0xdf4c bytes) 2024-09-21T15:07:30.087 INFO:teuthology.orchestra.run.smithi161.stdout:680 punch from 0xbe74310 to 0xbe75191, (0xe81 bytes) 2024-09-21T15:07:30.087 INFO:teuthology.orchestra.run.smithi161.stdout:681 write 0x171588e thru 0x172264c (0xcdbf bytes) 2024-09-21T15:07:30.096 INFO:teuthology.orchestra.run.smithi161.stdout:376 write 0xb79dc99 thru 0xb7aa555 (0xc8bd bytes) 2024-09-21T15:07:30.099 INFO:teuthology.orchestra.run.smithi161.stdout:690 trunc from 0xb5dd8b2 to 0x6f4e6f6 2024-09-21T15:07:30.106 INFO:teuthology.orchestra.run.smithi161.stdout:684 trunc from 0xeaedee2 to 0xd1fa668 2024-09-21T15:07:30.112 INFO:teuthology.orchestra.run.smithi161.stdout:377 write 0x150eaa2 thru 0x151c1a2 (0xd701 bytes) 2024-09-21T15:07:30.129 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:07:30.127+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cab6e960 handle_clone_image: failed to clone image mirror/10ad6a1a1964 to image_cluster1.client.mirror.2-clone1 2024-09-21T15:07:30.132 INFO:teuthology.orchestra.run.smithi161.stdout:378 write 0x41d4fd thru 0x4264ec (0x8ff0 bytes) 2024-09-21T15:07:30.142 INFO:teuthology.orchestra.run.smithi161.stdout:381 trunc from 0xe423d91 to 0xd987c5a 2024-09-21T15:07:30.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:07:30.147+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb36d0e0 handle_clone_image: failed to clone image mirror/10b63d31e063 to image_cluster1.client.mirror.4-clone3 2024-09-21T15:07:30.150 INFO:teuthology.orchestra.run.smithi161.stdout:692 punch from 0x3fe2e24 to 0x3febd35, (0x8f11 bytes) 2024-09-21T15:07:30.150 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.150 INFO:teuthology.orchestra.run.smithi161.stdout:694 punch from 0x30a7dab to 0x30a970a, (0x195f bytes) 2024-09-21T15:07:30.160 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.160 INFO:teuthology.orchestra.run.smithi161.stdout:686 punch from 0x3ef4fe6 to 0x3efdba4, (0x8bbe bytes) 2024-09-21T15:07:30.160 INFO:teuthology.orchestra.run.smithi161.stdout:687 read 0x905ad71 thru 0x905cec2 (0x2152 bytes) 2024-09-21T15:07:30.160 INFO:teuthology.orchestra.run.smithi161.stdout:689 read 0x574ebf0 thru 0x574f6b6 (0xac7 bytes) 2024-09-21T15:07:30.160 INFO:teuthology.orchestra.run.smithi161.stdout:690 read 0x47a9d0a thru 0x47b866f (0xe966 bytes) 2024-09-21T15:07:30.161 INFO:teuthology.orchestra.run.smithi161.stdout:691 clone 5 order 23 su 65536 sc 7 2024-09-21T15:07:30.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:07:30.163+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb36d2c0 handle_clone_image: failed to clone image mirror/10b592b8d2d4 to image_cluster1.client.mirror.0-clone3 2024-09-21T15:07:30.190 INFO:teuthology.orchestra.run.smithi161.stdout:382 write 0x9a50afd thru 0x9a5cd9b (0xc29f bytes) 2024-09-21T15:07:30.200 INFO:teuthology.orchestra.run.smithi161.stdout:383 punch from 0x5f44e5c to 0x5f492c4, (0x4468 bytes) 2024-09-21T15:07:30.200 INFO:teuthology.orchestra.run.smithi161.stdout:384 writesame 0x83a2ca9 thru 0x83af739 data_size 0x1(0xca91 bytes) 2024-09-21T15:07:30.205 INFO:teuthology.orchestra.run.smithi161.stdout:695 write 0xea72562 thru 0xea7d605 (0xb0a4 bytes) 2024-09-21T15:07:30.231 INFO:teuthology.orchestra.run.smithi161.stdout:696 read 0x9622031 thru 0x962c4cc (0xa49c bytes) 2024-09-21T15:07:30.231 INFO:teuthology.orchestra.run.smithi161.stdout:697 write 0x8dd0f96 thru 0x8ddab5d (0x9bc8 bytes) 2024-09-21T15:07:30.238 INFO:teuthology.orchestra.run.smithi161.stdout:385 read 0x7009c74 thru 0x700fbf7 (0x5f84 bytes) 2024-09-21T15:07:30.241 INFO:teuthology.orchestra.run.smithi161.stdout:698 writesame 0xb59851e thru 0xb5a0dbf data_size 0x1(0x88a2 bytes) 2024-09-21T15:07:30.243 INFO:teuthology.orchestra.run.smithi161.stdout:387 trunc from 0xd987c5a to 0xb2c77f0 2024-09-21T15:07:30.271 INFO:teuthology.orchestra.run.smithi161.stdout:700 read 0x688248e thru 0x68918de (0xf451 bytes) 2024-09-21T15:07:30.271 INFO:teuthology.orchestra.run.smithi161.stdout:701 write 0x3b70129 thru 0x3b796b3 (0x958b bytes) 2024-09-21T15:07:30.277 INFO:teuthology.orchestra.run.smithi161.stdout:702 write 0x29ca768 thru 0x29d7391 (0xcc2a bytes) 2024-09-21T15:07:30.283 INFO:teuthology.orchestra.run.smithi161.stdout:704 write 0x9850ea9 thru 0x985c535 (0xb68d bytes) 2024-09-21T15:07:30.296 INFO:teuthology.orchestra.run.smithi161.stdout:705 writesame 0x490b8c1 thru 0x4915bc8 data_size 0x4a(0xa308 bytes) 2024-09-21T15:07:30.300 INFO:teuthology.orchestra.run.smithi161.stdout:473 read 0xb1e4f8b thru 0xb1e944f (0x44c5 bytes) 2024-09-21T15:07:30.301 INFO:teuthology.orchestra.run.smithi161.stdout:388 write 0xcac34f1 thru 0xcac6d63 (0x3873 bytes) 2024-09-21T15:07:30.307 INFO:teuthology.orchestra.run.smithi161.stdout:706 read 0x508672f thru 0x5092c64 (0xc536 bytes) 2024-09-21T15:07:30.307 INFO:teuthology.orchestra.run.smithi161.stdout:707 read 0x10239fe thru 0x10315fe (0xdc01 bytes) 2024-09-21T15:07:30.317 INFO:teuthology.orchestra.run.smithi161.stdout:389 write 0x479a6fa thru 0x47a0bac (0x64b3 bytes) 2024-09-21T15:07:30.319 INFO:teuthology.orchestra.run.smithi161.stdout:708 trunc from 0xea7d606 to 0x79e82dc 2024-09-21T15:07:30.325 INFO:teuthology.orchestra.run.smithi161.stdout:474 write 0x15a7f24 thru 0x15b6953 (0xea30 bytes) 2024-09-21T15:07:30.332 INFO:teuthology.orchestra.run.smithi161.stdout:391 clone 6 order 22 su 2097152 sc 14 2024-09-21T15:07:30.354 INFO:teuthology.orchestra.run.smithi161.stdout:475 punch from 0xbf222e6 to 0xbf2c8c0, (0xa5da bytes) 2024-09-21T15:07:30.365 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.376 INFO:teuthology.orchestra.run.smithi161.stdout:710 trunc from 0x79e82dc to 0xc46f65c 2024-09-21T15:07:30.376 INFO:teuthology.orchestra.run.smithi161.stdout:477 write 0xcdea4dd thru 0xcdeb187 (0xcab bytes) 2024-09-21T15:07:30.411 INFO:teuthology.orchestra.run.smithi161.stdout:711 trunc from 0xc46f65c to 0x6379049 2024-09-21T15:07:30.412 INFO:teuthology.orchestra.run.smithi161.stdout:478 write 0xd0dbdfb thru 0xd0dfe32 (0x4038 bytes) 2024-09-21T15:07:30.425 INFO:teuthology.orchestra.run.smithi161.stdout:479 write 0xbf362ee thru 0xbf37d80 (0x1a93 bytes) 2024-09-21T15:07:30.437 INFO:teuthology.orchestra.run.smithi161.stdout:480 writesame 0xa5e259a thru 0xa5ea910 data_size 0x35(0x8377 bytes) 2024-09-21T15:07:30.448 INFO:teuthology.orchestra.run.smithi161.stdout:481 read 0x9ffb061 thru 0x9fff952 (0x48f2 bytes) 2024-09-21T15:07:30.448 INFO:teuthology.orchestra.run.smithi161.stdout:484 read 0x87a05cb thru 0x87a767b (0x70b1 bytes) 2024-09-21T15:07:30.448 INFO:teuthology.orchestra.run.smithi161.stdout:485 punch from 0x4790ea0 to 0x479a6bc, (0x981c bytes) 2024-09-21T15:07:30.448 INFO:teuthology.orchestra.run.smithi161.stdout:486 read 0x7dc84ae thru 0x7dcae4e (0x29a1 bytes) 2024-09-21T15:07:30.449 INFO:teuthology.orchestra.run.smithi161.stdout:488 write 0x5495443 thru 0x549eb17 (0x96d5 bytes) 2024-09-21T15:07:30.450 INFO:teuthology.orchestra.run.smithi161.stdout:712 trunc from 0x6379049 to 0xb3a8dd9 2024-09-21T15:07:30.464 INFO:teuthology.orchestra.run.smithi161.stdout:489 read 0x65d058d thru 0x65d3478 (0x2eec bytes) 2024-09-21T15:07:30.464 INFO:teuthology.orchestra.run.smithi161.stdout:491 read 0x7c0d495 thru 0x7c17e37 (0xa9a3 bytes) 2024-09-21T15:07:30.464 INFO:teuthology.orchestra.run.smithi161.stdout:493 write 0x6a07c02 thru 0x6a15158 (0xd557 bytes) 2024-09-21T15:07:30.473 INFO:teuthology.orchestra.run.smithi161.stdout:713 writesame 0x76e3f59 thru 0x76f0a3c data_size 0x8c(0xcae4 bytes) 2024-09-21T15:07:30.487 INFO:teuthology.orchestra.run.smithi161.stdout:715 writesame 0x77d8b8b thru 0x77e783c data_size 0x3(0xecb2 bytes) 2024-09-21T15:07:30.490 INFO:teuthology.orchestra.run.smithi161.stdout:495 read 0xc394f29 thru 0xc3a117e (0xc256 bytes) 2024-09-21T15:07:30.490 INFO:teuthology.orchestra.run.smithi161.stdout:496 read 0x2e7c5b9 thru 0x2e84797 (0x81df bytes) 2024-09-21T15:07:30.491 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.491 INFO:teuthology.orchestra.run.smithi161.stdout:499 punch from 0x4dba623 to 0x4dc4d07, (0xa6e4 bytes) 2024-09-21T15:07:30.491 INFO:teuthology.orchestra.run.smithi161.stdout:500 write 0xaf62703 thru 0xaf6517d (0x2a7b bytes) 2024-09-21T15:07:30.513 INFO:teuthology.orchestra.run.smithi161.stdout:716 punch from 0x89547cc to 0x8961972, (0xd1a6 bytes) 2024-09-21T15:07:30.513 INFO:teuthology.orchestra.run.smithi161.stdout:717 read 0xaff5a0a thru 0xaffd80c (0x7e03 bytes) 2024-09-21T15:07:30.514 INFO:teuthology.orchestra.run.smithi161.stdout:718 trunc from 0xb3a8dd9 to 0xb880b7e 2024-09-21T15:07:30.520 INFO:teuthology.orchestra.run.smithi161.stdout:501 trunc from 0xd0dfe33 to 0x4eae5c6 2024-09-21T15:07:30.544 INFO:teuthology.orchestra.run.smithi161.stdout:719 write 0x8fb66e8 thru 0x8fbf6db (0x8ff4 bytes) 2024-09-21T15:07:30.564 INFO:teuthology.orchestra.run.smithi161.stdout:720 read 0x4c1c0b5 thru 0x4c23ee9 (0x7e35 bytes) 2024-09-21T15:07:30.574 INFO:teuthology.orchestra.run.smithi161.stdout:721 trunc from 0xb880b7e to 0x7838e81 2024-09-21T15:07:30.631 INFO:teuthology.orchestra.run.smithi161.stdout:503 write 0x4fa524f thru 0x4fad4be (0x8270 bytes) 2024-09-21T15:07:30.643 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.643 INFO:teuthology.orchestra.run.smithi161.stdout:508 read 0x3b7ecd thru 0x3bdcdf (0x5e13 bytes) 2024-09-21T15:07:30.643 INFO:teuthology.orchestra.run.smithi161.stdout:509 read 0x45768fb thru 0x4584d96 (0xe49c bytes) 2024-09-21T15:07:30.652 INFO:teuthology.orchestra.run.smithi161.stdout:722 writesame 0x857d816 thru 0x858ca1c data_size 0x13(0xf207 bytes) 2024-09-21T15:07:30.661 INFO:teuthology.orchestra.run.smithi161.stdout:723 read 0x50fcb0a thru 0x510c893 (0xfd8a bytes) 2024-09-21T15:07:30.662 INFO:teuthology.orchestra.run.smithi161.stdout:724 read 0x557d928 thru 0x558c238 (0xe911 bytes) 2024-09-21T15:07:30.663 INFO:teuthology.orchestra.run.smithi161.stdout:725 write 0x53fde6c thru 0x5401dda (0x3f6f bytes) 2024-09-21T15:07:30.676 INFO:teuthology.orchestra.run.smithi161.stdout:726 punch from 0x3379724 to 0x3385efd, (0xc7d9 bytes) 2024-09-21T15:07:30.677 INFO:teuthology.orchestra.run.smithi161.stdout:728 punch from 0x41218aa to 0x412bc94, (0xa3ea bytes) 2024-09-21T15:07:30.677 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.677 INFO:teuthology.orchestra.run.smithi161.stdout:730 write 0x48f4f7d thru 0x4902763 (0xd7e7 bytes) 2024-09-21T15:07:30.687 INFO:teuthology.orchestra.run.smithi161.stdout:731 punch from 0x190300d to 0x190d9e0, (0xa9d3 bytes) 2024-09-21T15:07:30.688 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.688 INFO:teuthology.orchestra.run.smithi161.stdout:510 writesame 0x8b15625 thru 0x8b170ac data_size 0xc(0x1a88 bytes) 2024-09-21T15:07:30.692 INFO:teuthology.orchestra.run.smithi161.stdout:512 writesame 0x32bdc4c thru 0x32c3e04 data_size 0x1f(0x61b9 bytes) 2024-09-21T15:07:30.705 INFO:teuthology.orchestra.run.smithi161.stdout:513 trunc from 0x8b170ad to 0x521be8b 2024-09-21T15:07:30.726 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone3 from 0xddf76e4 (overlap 0x278a082) to 0x3f4340 2024-09-21T15:07:30.732 INFO:teuthology.orchestra.run.smithi161.stdout:733 write 0xe45c598 thru 0xe46a729 (0xe192 bytes) 2024-09-21T15:07:30.734 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone4 from 0xd1fa668 (overlap 0x1405a1d) to 0x0 2024-09-21T15:07:30.739 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:07:30.738+0000 7f7fd044c700 -1 reset not still connected to 0x56369ee915f0 2024-09-21T15:07:30.739 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:07:30.738+0000 7f7fd044c700 -1 reset not still connected to 0x56369f5ddee0 2024-09-21T15:07:30.740 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:07:30.738+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95a410 2024-09-21T15:07:30.740 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:07:30.738+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bad0 2024-09-21T15:07:30.740 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:07:30.738+0000 7f7fd044c700 -1 reset not still connected to 0x5636a1dfe5b0 2024-09-21T15:07:30.740 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:07:30.738+0000 7f7fd044c700 -1 reset not still connected to 0x5636a1dfeea0 2024-09-21T15:07:30.749 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.749 INFO:teuthology.orchestra.run.smithi161.stdout:515 read 0x119d4a3 thru 0x119db54 (0x6b2 bytes) 2024-09-21T15:07:30.749 INFO:teuthology.orchestra.run.smithi161.stdout:516 read 0x77c191 thru 0x785152 (0x8fc2 bytes) 2024-09-21T15:07:30.751 INFO:teuthology.orchestra.run.smithi161.stdout:517 punch from 0x50cc000 to 0x50d41cf, (0x81cf bytes) 2024-09-21T15:07:30.751 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.751 INFO:teuthology.orchestra.run.smithi161.stdout:520 read 0x3052c0d thru 0x3060d53 (0xe147 bytes) 2024-09-21T15:07:30.752 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone3 from 0xde30ab6 (overlap 0x1a2694b) to 0x0 2024-09-21T15:07:30.754 INFO:teuthology.orchestra.run.smithi161.stdout:521 read 0x1a3d5dc thru 0x1a40c76 (0x369b bytes) 2024-09-21T15:07:30.758 INFO:teuthology.orchestra.run.smithi161.stdout:734 read 0x1402233 thru 0x140fb75 (0xd943 bytes) 2024-09-21T15:07:30.759 INFO:teuthology.orchestra.run.smithi161.stdout:735 read 0xa3d8930 thru 0xa3e153c (0x8c0d bytes) 2024-09-21T15:07:30.759 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.759 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.759 INFO:teuthology.orchestra.run.smithi161.stdout:738 read 0x17d5a5c thru 0x17d7dfa (0x239f bytes) 2024-09-21T15:07:30.759 INFO:teuthology.orchestra.run.smithi161.stdout:739 read 0x511a616 thru 0x5127c35 (0xd620 bytes) 2024-09-21T15:07:30.760 INFO:teuthology.orchestra.run.smithi161.stdout:741 write 0xa1fa6a3 thru 0xa20a20b (0xfb69 bytes) 2024-09-21T15:07:30.765 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone5 from 0xcac6d64 (overlap 0x468055) to 0x70cd5 2024-09-21T15:07:30.797 INFO:teuthology.orchestra.run.smithi161.stdout:742 punch from 0xa9b2038 to 0xa9b73ab, (0x5373 bytes) 2024-09-21T15:07:30.807 INFO:teuthology.orchestra.run.smithi161.stdout:743 trunc from 0xe46a72a to 0x8f56c40 2024-09-21T15:07:30.822 INFO:teuthology.orchestra.run.smithi161.stdout:522 write 0x8f97a2f thru 0x8fa7443 (0xfa15 bytes) 2024-09-21T15:07:30.846 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.846 INFO:teuthology.orchestra.run.smithi161.stdout:524 trunc from 0x8fa7444 to 0x91ffeb3 2024-09-21T15:07:30.876 INFO:teuthology.orchestra.run.smithi161.stdout:745 read 0x39409ad thru 0x3942624 (0x1c78 bytes) 2024-09-21T15:07:30.883 INFO:teuthology.orchestra.run.smithi161.stdout:525 punch from 0x788e584 to 0x7895498, (0x6f14 bytes) 2024-09-21T15:07:30.883 INFO:teuthology.orchestra.run.smithi161.stdout:526 read 0x3c37f14 thru 0x3c41be4 (0x9cd1 bytes) 2024-09-21T15:07:30.883 INFO:teuthology.orchestra.run.smithi161.stdout:528 punch from 0x5d4280b to 0x5d451d4, (0x29c9 bytes) 2024-09-21T15:07:30.901 INFO:teuthology.orchestra.run.smithi161.stdout:746 write 0xb29aafe thru 0xb29d519 (0x2a1c bytes) 2024-09-21T15:07:30.915 INFO:teuthology.orchestra.run.smithi161.stdout:747 read 0x5aae60 thru 0x5ac252 (0x13f3 bytes) 2024-09-21T15:07:30.915 INFO:teuthology.orchestra.run.smithi161.stdout:748 read 0x2ddea1c thru 0x2ddecba (0x29f bytes) 2024-09-21T15:07:30.915 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:30.916 INFO:teuthology.orchestra.run.smithi161.stdout:750 write 0x1019164 thru 0x101b153 (0x1ff0 bytes) 2024-09-21T15:07:30.916 INFO:teuthology.orchestra.run.smithi161.stdout:529 write 0xdc9cb05 thru 0xdca98b6 (0xcdb2 bytes) 2024-09-21T15:07:30.928 INFO:teuthology.orchestra.run.smithi161.stdout:752 punch from 0x3671b18 to 0x367946b, (0x7953 bytes) 2024-09-21T15:07:30.928 INFO:teuthology.orchestra.run.smithi161.stdout:753 writesame 0x91e88c0 thru 0x91f660e data_size 0x1(0xdd4f bytes) 2024-09-21T15:07:30.929 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:07:30.923+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb36c3c0 handle_clone_image: failed to clone image mirror/10b4a856d47d to image_cluster1.client.mirror.3-clone8 2024-09-21T15:07:30.934 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #2, image image_cluster1.client.mirror.4-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent3 2024-09-21T15:07:30.934 INFO:teuthology.orchestra.run.smithi161.stdout:532 read 0x607e7c4 thru 0x608246a (0x3ca7 bytes) 2024-09-21T15:07:30.934 INFO:teuthology.orchestra.run.smithi161.stdout:534 read 0x62ff952 thru 0x63058e3 (0x5f92 bytes) 2024-09-21T15:07:30.935 INFO:teuthology.orchestra.run.smithi161.stdout:535 read 0x9970090 thru 0x997206e (0x1fdf bytes) 2024-09-21T15:07:30.952 INFO:teuthology.orchestra.run.smithi161.stdout:536 trunc from 0xdca98b7 to 0x4371092 2024-09-21T15:07:30.963 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #3, image image_cluster1.client.mirror.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent4 2024-09-21T15:07:30.969 INFO:teuthology.orchestra.run.smithi161.stdout:754 read 0x5466ad5 thru 0x54745e3 (0xdb0f bytes) 2024-09-21T15:07:30.969 INFO:teuthology.orchestra.run.smithi161.stdout:755 read 0x355529c thru 0x355af84 (0x5ce9 bytes) 2024-09-21T15:07:30.970 INFO:teuthology.orchestra.run.smithi161.stdout:756 writesame 0xa3bcd9 thru 0xa3e8d6 data_size 0x3(0x2bfe bytes) 2024-09-21T15:07:30.981 INFO:teuthology.orchestra.run.smithi161.stdout:758 punch from 0xa70196a to 0xa702302, (0x998 bytes) 2024-09-21T15:07:30.981 INFO:teuthology.orchestra.run.smithi161.stdout:761 writesame 0x633df0c thru 0x6347985 data_size 0xa9(0x9a7a bytes) 2024-09-21T15:07:30.999 INFO:teuthology.orchestra.run.smithi161.stdout:692 trunc from 0xd1fa668 to 0xd1388bb 2024-09-21T15:07:31.010 INFO:teuthology.orchestra.run.smithi161.stdout:762 trunc from 0xb29d51a to 0xc442ef 2024-09-21T15:07:31.010 INFO:teuthology.orchestra.run.smithi161.stdout:537 trunc from 0x4371092 to 0xa9ac586 2024-09-21T15:07:31.023 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #2, image image_cluster1.client.mirror.2-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent3 2024-09-21T15:07:31.036 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #4, image image_cluster1.client.mirror.5-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent5 2024-09-21T15:07:31.044 INFO:teuthology.orchestra.run.smithi161.stdout:538 trunc from 0xa9ac586 to 0x727d105 2024-09-21T15:07:31.057 INFO:teuthology.orchestra.run.smithi161.stdout:693 trunc from 0xd1388bb to 0xca8e076 2024-09-21T15:07:31.070 INFO:teuthology.orchestra.run.smithi161.stdout:539 write 0x306bfdb thru 0x30792fb (0xd321 bytes) 2024-09-21T15:07:31.071 INFO:teuthology.orchestra.run.smithi161.stdout:763 trunc from 0xc442ef to 0x9976f98 2024-09-21T15:07:31.083 INFO:teuthology.orchestra.run.smithi161.stdout:540 read 0x5f5d47 thru 0x5fb3d2 (0x568c bytes) 2024-09-21T15:07:31.086 INFO:teuthology.orchestra.run.smithi161.stdout:941 read 0x6fa2fb9 thru 0x6fb034a (0xd392 bytes) 2024-09-21T15:07:31.095 INFO:teuthology.orchestra.run.smithi161.stdout:541 trunc from 0x727d105 to 0x623b137 2024-09-21T15:07:31.099 INFO:teuthology.orchestra.run.smithi161.stdout:694 read 0x1a50cdf thru 0x1a536d4 (0x29f6 bytes) 2024-09-21T15:07:31.100 INFO:teuthology.orchestra.run.smithi161.stdout:695 write 0x147f22b thru 0x148a72d (0xb503 bytes) 2024-09-21T15:07:31.102 INFO:teuthology.orchestra.run.smithi161.stdout:764 trunc from 0x9976f98 to 0x89bda0f 2024-09-21T15:07:31.125 INFO:teuthology.orchestra.run.smithi161.stdout:942 trunc from 0xde30ab6 to 0x92d87aa 2024-09-21T15:07:31.129 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.133 INFO:teuthology.orchestra.run.smithi161.stdout:765 write 0x31e6459 thru 0x31f0bf2 (0xa79a bytes) 2024-09-21T15:07:31.136 INFO:teuthology.orchestra.run.smithi161.stdout:542 read 0x21346ee thru 0x2134e9c (0x7af bytes) 2024-09-21T15:07:31.140 INFO:teuthology.orchestra.run.smithi161.stdout:766 writesame 0x54dce27 thru 0x54e4a0d data_size 0x3(0x7be7 bytes) 2024-09-21T15:07:31.148 INFO:teuthology.orchestra.run.smithi161.stdout:393 read 0x103e94e thru 0x104d319 (0xe9cc bytes) 2024-09-21T15:07:31.153 INFO:teuthology.orchestra.run.smithi161.stdout:770 punch from 0x1488569 to 0x1491dae, (0x9845 bytes) 2024-09-21T15:07:31.153 INFO:teuthology.orchestra.run.smithi161.stdout:771 writesame 0x418cd57 thru 0x418f79f data_size 0x5(0x2a49 bytes) 2024-09-21T15:07:31.158 INFO:teuthology.orchestra.run.smithi161.stdout:697 writesame 0xe8d3f45 thru 0xe8d7423 data_size 0x1(0x34df bytes) 2024-09-21T15:07:31.163 INFO:teuthology.orchestra.run.smithi161.stdout:543 write 0x9929f21 thru 0x992ecca (0x4daa bytes) 2024-09-21T15:07:31.163 INFO:teuthology.orchestra.run.smithi161.stdout:698 read 0x6d1c7f4 thru 0x6d2c1a7 (0xf9b4 bytes) 2024-09-21T15:07:31.163 INFO:teuthology.orchestra.run.smithi161.stdout:699 write 0x96229e6 thru 0x9631102 (0xe71d bytes) 2024-09-21T15:07:31.167 INFO:teuthology.orchestra.run.smithi161.stdout:772 trunc from 0x89bda0f to 0x901aa82 2024-09-21T15:07:31.172 INFO:teuthology.orchestra.run.smithi161.stdout:394 write 0x4aed215 thru 0x4af6a6a (0x9856 bytes) 2024-09-21T15:07:31.180 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.180 INFO:teuthology.orchestra.run.smithi161.stdout:547 write 0x5e1b8bd thru 0x5e21804 (0x5f48 bytes) 2024-09-21T15:07:31.190 INFO:teuthology.orchestra.run.smithi161.stdout:702 punch from 0x7104349 to 0x7104a97, (0x74e bytes) 2024-09-21T15:07:31.190 INFO:teuthology.orchestra.run.smithi161.stdout:703 write 0x9728e08 thru 0x973754f (0xe748 bytes) 2024-09-21T15:07:31.191 INFO:teuthology.orchestra.run.smithi161.stdout:549 read 0x7a60c4e thru 0x7a6c0a8 (0xb45b bytes) 2024-09-21T15:07:31.191 INFO:teuthology.orchestra.run.smithi161.stdout:395 read 0x6678066 thru 0x6685c75 (0xdc10 bytes) 2024-09-21T15:07:31.192 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.192 INFO:teuthology.orchestra.run.smithi161.stdout:552 punch from 0xa55999 to 0xa6586d, (0xfed4 bytes) 2024-09-21T15:07:31.192 INFO:teuthology.orchestra.run.smithi161.stdout:553 punch from 0x442ae2d to 0x4434d4b, (0x9f1e bytes) 2024-09-21T15:07:31.192 INFO:teuthology.orchestra.run.smithi161.stdout:554 writesame 0x983db97 thru 0x9848700 data_size 0x25(0xab6a bytes) 2024-09-21T15:07:31.193 INFO:teuthology.orchestra.run.smithi161.stdout:943 write 0xab9d63e thru 0xaba6517 (0x8eda bytes) 2024-09-21T15:07:31.194 INFO:teuthology.orchestra.run.smithi161.stdout:396 trunc from 0xcac6d64 to 0xb1886ce 2024-09-21T15:07:31.200 INFO:teuthology.orchestra.run.smithi161.stdout:773 read 0x333fd68 thru 0x334bd72 (0xc00b bytes) 2024-09-21T15:07:31.214 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.214 INFO:teuthology.orchestra.run.smithi161.stdout:557 write 0x1cd7c02 thru 0x1ce2620 (0xaa1f bytes) 2024-09-21T15:07:31.214 INFO:teuthology.orchestra.run.smithi161.stdout:944 write 0x9133c31 thru 0x913ffce (0xc39e bytes) 2024-09-21T15:07:31.218 INFO:teuthology.orchestra.run.smithi161.stdout:704 write 0x9b6d715 thru 0x9b71320 (0x3c0c bytes) 2024-09-21T15:07:31.229 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.229 INFO:teuthology.orchestra.run.smithi161.stdout:707 read 0x80c78e1 thru 0x80d0539 (0x8c59 bytes) 2024-09-21T15:07:31.229 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.229 INFO:teuthology.orchestra.run.smithi161.stdout:712 read 0x714d8b thru 0x71aff9 (0x626f bytes) 2024-09-21T15:07:31.230 INFO:teuthology.orchestra.run.smithi161.stdout:713 read 0x6c50dc5 thru 0x6c54cd0 (0x3f0c bytes) 2024-09-21T15:07:31.230 INFO:teuthology.orchestra.run.smithi161.stdout:715 read 0x94814f9 thru 0x948a6cf (0x91d7 bytes) 2024-09-21T15:07:31.231 INFO:teuthology.orchestra.run.smithi161.stdout:716 read 0x7ecae3b thru 0x7ed1071 (0x6237 bytes) 2024-09-21T15:07:31.232 INFO:teuthology.orchestra.run.smithi161.stdout:718 writesame 0x725f526 thru 0x7265a90 data_size 0x1(0x656b bytes) 2024-09-21T15:07:31.235 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.235 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.235 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.235 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.235 INFO:teuthology.orchestra.run.smithi161.stdout:566 punch from 0x862b7a8 to 0x8633160, (0x79b8 bytes) 2024-09-21T15:07:31.235 INFO:teuthology.orchestra.run.smithi161.stdout:567 write 0x7027fad thru 0x7033097 (0xb0eb bytes) 2024-09-21T15:07:31.240 INFO:teuthology.orchestra.run.smithi161.stdout:775 writesame 0xe09c4e6 thru 0xe0aa120 data_size 0x1(0xdc3b bytes) 2024-09-21T15:07:31.241 INFO:teuthology.orchestra.run.smithi161.stdout:397 read 0x959613a thru 0x9599b04 (0x39cb bytes) 2024-09-21T15:07:31.241 INFO:teuthology.orchestra.run.smithi161.stdout:400 read 0x63c64dd thru 0x63cd850 (0x7374 bytes) 2024-09-21T15:07:31.241 INFO:teuthology.orchestra.run.smithi161.stdout:401 writesame 0xad62c6a thru 0xad71bc6 data_size 0x1(0xef5d bytes) 2024-09-21T15:07:31.243 INFO:teuthology.orchestra.run.smithi161.stdout:776 write 0x53831ce thru 0x538d00d (0x9e40 bytes) 2024-09-21T15:07:31.256 INFO:teuthology.orchestra.run.smithi161.stdout:568 punch from 0x8cb7734 to 0x8cc2ad7, (0xb3a3 bytes) 2024-09-21T15:07:31.256 INFO:teuthology.orchestra.run.smithi161.stdout:569 write 0x18a88f5 thru 0x18b03c4 (0x7ad0 bytes) 2024-09-21T15:07:31.257 INFO:teuthology.orchestra.run.smithi161.stdout:777 writesame 0xa97681c thru 0xa98333f data_size 0x2(0xcb24 bytes) 2024-09-21T15:07:31.279 INFO:teuthology.orchestra.run.smithi161.stdout:719 trunc from 0xe8d7424 to 0x3213e92 2024-09-21T15:07:31.287 INFO:teuthology.orchestra.run.smithi161.stdout:779 read 0xad63fbc thru 0xad6c113 (0x8158 bytes) 2024-09-21T15:07:31.287 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.288 INFO:teuthology.orchestra.run.smithi161.stdout:781 punch from 0x9ec45ca to 0x9ecd1f3, (0x8c29 bytes) 2024-09-21T15:07:31.288 INFO:teuthology.orchestra.run.smithi161.stdout:782 write 0x743c6cf thru 0x744118f (0x4ac1 bytes) 2024-09-21T15:07:31.294 INFO:teuthology.orchestra.run.smithi161.stdout:402 punch from 0x152e145 to 0x1533f8a, (0x5e45 bytes) 2024-09-21T15:07:31.294 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.300 INFO:teuthology.orchestra.run.smithi161.stdout:572 punch from 0x95d51c9 to 0x95e1935, (0xc76c bytes) 2024-09-21T15:07:31.300 INFO:teuthology.orchestra.run.smithi161.stdout:574 punch from 0x58a483c to 0x58a6210, (0x19d4 bytes) 2024-09-21T15:07:31.300 INFO:teuthology.orchestra.run.smithi161.stdout:783 write 0x42306a2 thru 0x423903e (0x899d bytes) 2024-09-21T15:07:31.301 INFO:teuthology.orchestra.run.smithi161.stdout:575 writesame 0x3e36231 thru 0x3e427f3 data_size 0x1(0xc5c3 bytes) 2024-09-21T15:07:31.305 INFO:teuthology.orchestra.run.smithi161.stdout:946 write 0xdcbf144 thru 0xdcc8ba3 (0x9a60 bytes) 2024-09-21T15:07:31.308 INFO:teuthology.orchestra.run.smithi161.stdout:405 trunc from 0xb1886ce to 0x3773fd2 2024-09-21T15:07:31.317 INFO:teuthology.orchestra.run.smithi161.stdout:784 read 0x2671ffa thru 0x267d310 (0xb317 bytes) 2024-09-21T15:07:31.334 INFO:teuthology.orchestra.run.smithi161.stdout:578 read 0x1ce9c60 thru 0x1cefc77 (0x6018 bytes) 2024-09-21T15:07:31.335 INFO:teuthology.orchestra.run.smithi161.stdout:579 punch from 0x24d93be to 0x24e4dee, (0xba30 bytes) 2024-09-21T15:07:31.336 INFO:teuthology.orchestra.run.smithi161.stdout:583 punch from 0x30fb071 to 0x310aada, (0xfa69 bytes) 2024-09-21T15:07:31.336 INFO:teuthology.orchestra.run.smithi161.stdout:589 read 0x3294d24 thru 0x32a330f (0xe5ec bytes) 2024-09-21T15:07:31.339 INFO:teuthology.orchestra.run.smithi161.stdout:590 write 0x155583a thru 0x1556333 (0xafa bytes) 2024-09-21T15:07:31.355 INFO:teuthology.orchestra.run.smithi161.stdout:947 read 0x4a1a1c thru 0x4a5a6d (0x4052 bytes) 2024-09-21T15:07:31.355 INFO:teuthology.orchestra.run.smithi161.stdout:948 read 0x84da080 thru 0x84e7da8 (0xdd29 bytes) 2024-09-21T15:07:31.356 INFO:teuthology.orchestra.run.smithi161.stdout:949 read 0x453694f thru 0x453a32f (0x39e1 bytes) 2024-09-21T15:07:31.356 INFO:teuthology.orchestra.run.smithi161.stdout:951 read 0x5dafb67 thru 0x5dbedd8 (0xf272 bytes) 2024-09-21T15:07:31.357 INFO:teuthology.orchestra.run.smithi161.stdout:952 read 0x766bfda thru 0x7678f15 (0xcf3c bytes) 2024-09-21T15:07:31.357 INFO:teuthology.orchestra.run.smithi161.stdout:953 write 0xab092e9 thru 0xab122ec (0x9004 bytes) 2024-09-21T15:07:31.360 INFO:teuthology.orchestra.run.smithi161.stdout:592 read 0x9a1b16 thru 0x9a663a (0x4b25 bytes) 2024-09-21T15:07:31.360 INFO:teuthology.orchestra.run.smithi161.stdout:593 write 0x376117b thru 0x3768313 (0x7199 bytes) 2024-09-21T15:07:31.364 INFO:teuthology.orchestra.run.smithi161.stdout:785 write 0xedc722f thru 0xedd6138 (0xef0a bytes) 2024-09-21T15:07:31.373 INFO:teuthology.orchestra.run.smithi161.stdout:597 punch from 0x30f597 to 0x31a06c, (0xaad5 bytes) 2024-09-21T15:07:31.374 INFO:teuthology.orchestra.run.smithi161.stdout:954 writesame 0x5f6628 thru 0x5f8918 data_size 0x1(0x22f1 bytes) 2024-09-21T15:07:31.374 INFO:teuthology.orchestra.run.smithi161.stdout:598 writesame 0x686ea3b thru 0x6870918 data_size 0x12(0x1ede bytes) 2024-09-21T15:07:31.385 INFO:teuthology.orchestra.run.smithi161.stdout:786 write 0xaeee258 thru 0xaef46cc (0x6475 bytes) 2024-09-21T15:07:31.386 INFO:teuthology.orchestra.run.smithi161.stdout:599 read 0x4775698 thru 0x4782c07 (0xd570 bytes) 2024-09-21T15:07:31.394 INFO:teuthology.orchestra.run.smithi161.stdout:407 punch from 0x266595c to 0x266a6fd, (0x4da1 bytes) 2024-09-21T15:07:31.394 INFO:teuthology.orchestra.run.smithi161.stdout:410 read 0x1734aed thru 0x173aae7 (0x5ffb bytes) 2024-09-21T15:07:31.394 INFO:teuthology.orchestra.run.smithi161.stdout:787 write 0xa6507b thru 0xa70f5a (0xbee0 bytes) 2024-09-21T15:07:31.394 INFO:teuthology.orchestra.run.smithi161.stdout:411 read 0xca6383 thru 0xcab2b6 (0x4f34 bytes) 2024-09-21T15:07:31.402 INFO:teuthology.orchestra.run.smithi161.stdout:788 write 0x2048c86 thru 0x20510e9 (0x8464 bytes) 2024-09-21T15:07:31.409 INFO:teuthology.orchestra.run.smithi161.stdout:789 read 0x7d34616 thru 0x7d3594e (0x1339 bytes) 2024-09-21T15:07:31.409 INFO:teuthology.orchestra.run.smithi161.stdout:790 write 0x442c9ea thru 0x4430da4 (0x43bb bytes) 2024-09-21T15:07:31.412 INFO:teuthology.orchestra.run.smithi161.stdout:955 trunc from 0xdcc8ba4 to 0xb4a18aa 2024-09-21T15:07:31.413 INFO:teuthology.orchestra.run.smithi161.stdout:791 read 0xac13478 thru 0xac1b87f (0x8408 bytes) 2024-09-21T15:07:31.413 INFO:teuthology.orchestra.run.smithi161.stdout:792 write 0x6429daf thru 0x64367e8 (0xca3a bytes) 2024-09-21T15:07:31.419 INFO:teuthology.orchestra.run.smithi161.stdout:600 write 0xee39257 thru 0xee47409 (0xe1b3 bytes) 2024-09-21T15:07:31.429 INFO:teuthology.orchestra.run.smithi161.stdout:793 write 0xb42a2e1 thru 0xb432d80 (0x8aa0 bytes) 2024-09-21T15:07:31.445 INFO:teuthology.orchestra.run.smithi161.stdout:601 writesame 0x797616f thru 0x7983f7c data_size 0x2b(0xde0e bytes) 2024-09-21T15:07:31.448 INFO:teuthology.orchestra.run.smithi161.stdout:795 write 0x385de53 thru 0x3865d62 (0x7f10 bytes) 2024-09-21T15:07:31.453 INFO:teuthology.orchestra.run.smithi161.stdout:412 write 0xbe509f4 thru 0xbe603fa (0xfa07 bytes) 2024-09-21T15:07:31.460 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.460 INFO:teuthology.orchestra.run.smithi161.stdout:797 write 0x6194109 thru 0x6198311 (0x4209 bytes) 2024-09-21T15:07:31.460 INFO:teuthology.orchestra.run.smithi161.stdout:603 writesame 0x24d5ae0 thru 0x24d96ef data_size 0x10(0x3c10 bytes) 2024-09-21T15:07:31.464 INFO:teuthology.orchestra.run.smithi161.stdout:720 writesame 0xd45768b thru 0xd45cb16 data_size 0xe(0x548c bytes) 2024-09-21T15:07:31.467 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.467 INFO:teuthology.orchestra.run.smithi161.stdout:415 punch from 0x6bb0c60 to 0x6bbace6, (0xa086 bytes) 2024-09-21T15:07:31.467 INFO:teuthology.orchestra.run.smithi161.stdout:416 read 0xa6ec2c3 thru 0xa6f668d (0xa3cb bytes) 2024-09-21T15:07:31.467 INFO:teuthology.orchestra.run.smithi161.stdout:723 write 0xb197e78 thru 0xb19a3a6 (0x252f bytes) 2024-09-21T15:07:31.468 INFO:teuthology.orchestra.run.smithi161.stdout:417 punch from 0x5456ec4 to 0x54585b3, (0x16ef bytes) 2024-09-21T15:07:31.468 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xee36974 2024-09-21T15:07:31.470 INFO:teuthology.orchestra.run.smithi161.stdout:799 read 0x133e44d thru 0x1347df2 (0x99a6 bytes) 2024-09-21T15:07:31.472 INFO:teuthology.orchestra.run.smithi161.stdout:800 write 0x5c3a13a thru 0x5c3e84a (0x4711 bytes) 2024-09-21T15:07:31.472 INFO:teuthology.orchestra.run.smithi161.stdout:418 trunc from 0xbe603fb to 0xee36974 2024-09-21T15:07:31.476 INFO:teuthology.orchestra.run.smithi161.stdout:956 write 0xa8ec0e7 thru 0xa8f36c3 (0x75dd bytes) 2024-09-21T15:07:31.480 INFO:teuthology.orchestra.run.smithi161.stdout:801 read 0xcba4365 thru 0xcbaa8ec (0x6588 bytes) 2024-09-21T15:07:31.481 INFO:teuthology.orchestra.run.smithi161.stdout:606 clone 9 order 24 su 65536 sc 13 2024-09-21T15:07:31.482 INFO:teuthology.orchestra.run.smithi161.stdout:587 write 0x8ed0f40 thru 0x8ed30db (0x219c bytes) 2024-09-21T15:07:31.486 INFO:teuthology.orchestra.run.smithi161.stdout:957 read 0x2749cd7 thru 0x2750b16 (0x6e40 bytes) 2024-09-21T15:07:31.486 INFO:teuthology.orchestra.run.smithi161.stdout:958 punch from 0x8117672 to 0x811de44, (0x67d2 bytes) 2024-09-21T15:07:31.497 INFO:teuthology.orchestra.run.smithi161.stdout:419 read 0xbbe9de3 thru 0xbbf5992 (0xbbb0 bytes) 2024-09-21T15:07:31.500 INFO:teuthology.orchestra.run.smithi161.stdout:802 trunc from 0xedd6139 to 0x945ee5f 2024-09-21T15:07:31.505 INFO:teuthology.orchestra.run.smithi161.stdout:421 trunc from 0xee36974 to 0xaadcfed 2024-09-21T15:07:31.507 INFO:teuthology.orchestra.run.smithi161.stdout:588 write 0x98e511a thru 0x98f2baa (0xda91 bytes) 2024-09-21T15:07:31.510 INFO:teuthology.orchestra.run.smithi161.stdout:959 write 0xb663e5f thru 0xb66c932 (0x8ad4 bytes) 2024-09-21T15:07:31.510 INFO:teuthology.orchestra.run.smithi161.stdout:724 trunc from 0xd45cb17 to 0x264014a 2024-09-21T15:07:31.526 INFO:teuthology.orchestra.run.smithi161.stdout:589 write 0x620aa9a thru 0x6210d4a (0x62b1 bytes) 2024-09-21T15:07:31.545 INFO:teuthology.orchestra.run.smithi161.stdout:803 writesame 0x3a1e9b4 thru 0x3a2c5a6 data_size 0x3(0xdbf3 bytes) 2024-09-21T15:07:31.546 INFO:teuthology.orchestra.run.smithi161.stdout:590 punch from 0x85cf598 to 0x85dcb24, (0xd58c bytes) 2024-09-21T15:07:31.546 INFO:teuthology.orchestra.run.smithi161.stdout:593 write 0x1706e54 thru 0x1708697 (0x1844 bytes) 2024-09-21T15:07:31.569 INFO:teuthology.orchestra.run.smithi161.stdout:423 read 0x8cf0c thru 0x8f0d9 (0x21ce bytes) 2024-09-21T15:07:31.570 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.570 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.573 INFO:teuthology.orchestra.run.smithi161.stdout:805 trunc from 0x945ee5f to 0xc555adb 2024-09-21T15:07:31.584 INFO:teuthology.orchestra.run.smithi161.stdout:725 read 0x85dc86 thru 0x86c241 (0xe5bc bytes) 2024-09-21T15:07:31.585 INFO:teuthology.orchestra.run.smithi161.stdout:727 punch from 0xc9716c to 0xc9be76, (0x4d0a bytes) 2024-09-21T15:07:31.590 INFO:teuthology.orchestra.run.smithi161.stdout:960 write 0xedfab38 thru 0xee01b13 (0x6fdc bytes) 2024-09-21T15:07:31.592 INFO:teuthology.orchestra.run.smithi161.stdout:594 trunc from 0xddf76e4 to 0x6166c66 2024-09-21T15:07:31.598 INFO:teuthology.orchestra.run.smithi161.stdout:426 write 0xb0be5e6 thru 0xb0c3324 (0x4d3f bytes) 2024-09-21T15:07:31.604 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.608 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.608 INFO:teuthology.orchestra.run.smithi161.stdout:962 punch from 0xbc33201 to 0xbc37831, (0x4630 bytes) 2024-09-21T15:07:31.616 INFO:teuthology.orchestra.run.smithi161.stdout:427 writesame 0x584fa26 thru 0x585eea0 data_size 0x1(0xf47b bytes) 2024-09-21T15:07:31.621 INFO:teuthology.orchestra.run.smithi161.stdout:964 trunc from 0xee01b14 to 0x8fbdaa9 2024-09-21T15:07:31.623 INFO:teuthology.orchestra.run.smithi161.stdout:728 writesame 0x4a03fef thru 0x4a0e67b data_size 0x1(0xa68d bytes) 2024-09-21T15:07:31.649 INFO:teuthology.orchestra.run.smithi161.stdout:807 write 0xe7a728b thru 0xe7b1412 (0xa188 bytes) 2024-09-21T15:07:31.658 INFO:teuthology.orchestra.run.smithi161.stdout:808 read 0x6d66322 thru 0x6d7482a (0xe509 bytes) 2024-09-21T15:07:31.658 INFO:teuthology.orchestra.run.smithi161.stdout:809 write 0x9028f47 thru 0x903201a (0x90d4 bytes) 2024-09-21T15:07:31.660 INFO:teuthology.orchestra.run.smithi161.stdout:595 read 0x5e58c0e thru 0x5e63de8 (0xb1db bytes) 2024-09-21T15:07:31.660 INFO:teuthology.orchestra.run.smithi161.stdout:596 read 0x5e7f360 thru 0x5e80a21 (0x16c2 bytes) 2024-09-21T15:07:31.671 INFO:teuthology.orchestra.run.smithi161.stdout:429 trunc from 0xb0c3325 to 0x82c5f8c 2024-09-21T15:07:31.672 INFO:teuthology.orchestra.run.smithi161.stdout:810 read 0x537c037 thru 0x537dca6 (0x1c70 bytes) 2024-09-21T15:07:31.672 INFO:teuthology.orchestra.run.smithi161.stdout:811 writesame 0x80028eb thru 0x800b00a data_size 0x5e(0x8720 bytes) 2024-09-21T15:07:31.673 INFO:teuthology.orchestra.run.smithi161.stdout:729 write 0xbcab8b8 thru 0xbcb5f01 (0xa64a bytes) 2024-09-21T15:07:31.693 INFO:teuthology.orchestra.run.smithi161.stdout:730 read 0x41292c5 thru 0x4132a87 (0x97c3 bytes) 2024-09-21T15:07:31.694 INFO:teuthology.orchestra.run.smithi161.stdout:731 read 0x9c6de64 thru 0x9c7892e (0xaacb bytes) 2024-09-21T15:07:31.694 INFO:teuthology.orchestra.run.smithi161.stdout:732 read 0xa6dbc3b thru 0xa6e33af (0x7775 bytes) 2024-09-21T15:07:31.694 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.745 INFO:teuthology.orchestra.run.smithi161.stdout:734 read 0x4f8c0af thru 0x4f8fcc7 (0x3c19 bytes) 2024-09-21T15:07:31.745 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.745 INFO:teuthology.orchestra.run.smithi161.stdout:737 writesame 0xb03530e thru 0xb040cc0 data_size 0x1(0xb9b3 bytes) 2024-09-21T15:07:31.746 INFO:teuthology.orchestra.run.smithi161.stdout:598 write 0x7e95d19 thru 0x7ea1fc6 (0xc2ae bytes) 2024-09-21T15:07:31.746 INFO:teuthology.orchestra.run.smithi161.stdout:814 trunc from 0xe7b1413 to 0x35eac9b 2024-09-21T15:07:31.746 INFO:teuthology.orchestra.run.smithi161.stdout:601 clone 5 order 24 su 4194304 sc 11 2024-09-21T15:07:31.747 INFO:teuthology.orchestra.run.smithi161.stdout:965 read 0x24ab7c9 thru 0x24b2f70 (0x77a8 bytes) 2024-09-21T15:07:31.747 INFO:teuthology.orchestra.run.smithi161.stdout:430 punch from 0x5364d9c to 0x536d369, (0x85cd bytes) 2024-09-21T15:07:31.747 INFO:teuthology.orchestra.run.smithi161.stdout:431 read 0x60af1d7 thru 0x60ba7b8 (0xb5e2 bytes) 2024-09-21T15:07:31.747 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.769 INFO:teuthology.orchestra.run.smithi161.stdout:815 read 0x1ac29da thru 0x1ac80b8 (0x56df bytes) 2024-09-21T15:07:31.770 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone8 from 0xee4740a (overlap 0x4371092) to 0x143b82b 2024-09-21T15:07:31.770 INFO:teuthology.orchestra.run.smithi161.stdout:738 write 0xea103f3 thru 0xea1ec24 (0xe832 bytes) 2024-09-21T15:07:31.770 INFO:teuthology.orchestra.run.smithi161.stdout:816 punch from 0x127b000 to 0x1285bb3, (0xabb3 bytes) 2024-09-21T15:07:31.771 INFO:teuthology.orchestra.run.smithi161.stdout:433 write 0xcf7ff5f thru 0xcf8b751 (0xb7f3 bytes) 2024-09-21T15:07:31.775 INFO:teuthology.orchestra.run.smithi161.stdout:970 write 0xb5d4830 thru 0xb5e32cb (0xea9c bytes) 2024-09-21T15:07:31.782 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.782 INFO:teuthology.orchestra.run.smithi161.stdout:435 writesame 0xc5d35b5 thru 0xc5df65c data_size 0x5a(0xc0a8 bytes) 2024-09-21T15:07:31.784 INFO:teuthology.orchestra.run.smithi161.stdout:740 write 0xe8cd518 thru 0xe8da86a (0xd353 bytes) 2024-09-21T15:07:31.792 INFO:teuthology.orchestra.run.smithi161.stdout:971 punch from 0x7470b29 to 0x74809e7, (0xfebe bytes) 2024-09-21T15:07:31.792 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.792 INFO:teuthology.orchestra.run.smithi161.stdout:974 read 0x2953bdf thru 0x295c2c8 (0x86ea bytes) 2024-09-21T15:07:31.793 INFO:teuthology.orchestra.run.smithi161.stdout:975 write 0x9dd9ee3 thru 0x9de3166 (0x9284 bytes) 2024-09-21T15:07:31.798 INFO:teuthology.orchestra.run.smithi161.stdout:437 punch from 0x70888e3 to 0x708e9c7, (0x60e4 bytes) 2024-09-21T15:07:31.798 INFO:teuthology.orchestra.run.smithi161.stdout:438 read 0x3e70458 thru 0x3e7d1aa (0xcd53 bytes) 2024-09-21T15:07:31.801 INFO:teuthology.orchestra.run.smithi161.stdout:817 write 0x3ac6479 thru 0x3ac8545 (0x20cd bytes) 2024-09-21T15:07:31.806 INFO:teuthology.orchestra.run.smithi161.stdout:741 punch from 0x29c8c4c to 0x29d4f37, (0xc2eb bytes) 2024-09-21T15:07:31.806 INFO:teuthology.orchestra.run.smithi161.stdout:743 write 0x1502848 thru 0x150f4c1 (0xcc7a bytes) 2024-09-21T15:07:31.811 INFO:teuthology.orchestra.run.smithi161.stdout:976 read 0x7f2a59c thru 0x7f30bee (0x6653 bytes) 2024-09-21T15:07:31.812 INFO:teuthology.orchestra.run.smithi161.stdout:977 write 0x65276fa thru 0x652cf9d (0x58a4 bytes) 2024-09-21T15:07:31.815 INFO:teuthology.orchestra.run.smithi161.stdout:744 write 0x2170e77 thru 0x217ada0 (0x9f2a bytes) 2024-09-21T15:07:31.820 INFO:teuthology.orchestra.run.smithi161.stdout:818 trunc from 0x3ac8546 to 0x16a6ec2 2024-09-21T15:07:31.830 INFO:teuthology.orchestra.run.smithi161.stdout:745 read 0xd821f20 thru 0xd828fc6 (0x70a7 bytes) 2024-09-21T15:07:31.831 INFO:teuthology.orchestra.run.smithi161.stdout:746 read 0x6a3c353 thru 0x6a4afd3 (0xec81 bytes) 2024-09-21T15:07:31.831 INFO:teuthology.orchestra.run.smithi161.stdout:747 punch from 0xe130293 to 0xe13a0d1, (0x9e3e bytes) 2024-09-21T15:07:31.831 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.831 INFO:teuthology.orchestra.run.smithi161.stdout:751 read 0xb4c5cb1 thru 0xb4d3d57 (0xe0a7 bytes) 2024-09-21T15:07:31.831 INFO:teuthology.orchestra.run.smithi161.stdout:752 read 0x5563179 thru 0x55696a0 (0x6528 bytes) 2024-09-21T15:07:31.832 INFO:teuthology.orchestra.run.smithi161.stdout:753 writesame 0x57f35f0 thru 0x5801899 data_size 0x39(0xe2aa bytes) 2024-09-21T15:07:31.853 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.853 INFO:teuthology.orchestra.run.smithi161.stdout:755 read 0xc43155a thru 0xc441470 (0xff17 bytes) 2024-09-21T15:07:31.853 INFO:teuthology.orchestra.run.smithi161.stdout:756 read 0xe0ed6ca thru 0xe0f7857 (0xa18e bytes) 2024-09-21T15:07:31.854 INFO:teuthology.orchestra.run.smithi161.stdout:757 read 0x855b94d thru 0x855dbb7 (0x226b bytes) 2024-09-21T15:07:31.854 INFO:teuthology.orchestra.run.smithi161.stdout:758 writesame 0x3d71b92 thru 0x3d7fda3 data_size 0x13(0xe212 bytes) 2024-09-21T15:07:31.861 INFO:teuthology.orchestra.run.smithi161.stdout:439 writesame 0xe44689e thru 0xe447fee data_size 0x1(0x1751 bytes) 2024-09-21T15:07:31.870 INFO:teuthology.orchestra.run.smithi161.stdout:440 read 0x68cf326 thru 0x68cf5c6 (0x2a1 bytes) 2024-09-21T15:07:31.870 INFO:teuthology.orchestra.run.smithi161.stdout:441 read 0xbd28b44 thru 0xbd28ec9 (0x386 bytes) 2024-09-21T15:07:31.870 INFO:teuthology.orchestra.run.smithi161.stdout:442 read 0x5826770 thru 0x58271fc (0xa8d bytes) 2024-09-21T15:07:31.871 INFO:teuthology.orchestra.run.smithi161.stdout:759 read 0x23950a6 thru 0x239ab17 (0x5a72 bytes) 2024-09-21T15:07:31.872 INFO:teuthology.orchestra.run.smithi161.stdout:760 writesame 0x174f5c7 thru 0x175384b data_size 0x1(0x4285 bytes) 2024-09-21T15:07:31.887 INFO:teuthology.orchestra.run.smithi161.stdout:979 write 0xd193c4d thru 0xd19fce4 (0xc098 bytes) 2024-09-21T15:07:31.891 INFO:teuthology.orchestra.run.smithi161.stdout:762 read 0x3334cda thru 0x333defb (0x9222 bytes) 2024-09-21T15:07:31.891 INFO:teuthology.orchestra.run.smithi161.stdout:763 read 0xc2f5da3 thru 0xc302cd8 (0xcf36 bytes) 2024-09-21T15:07:31.915 INFO:teuthology.orchestra.run.smithi161.stdout:819 write 0x1f027f2 thru 0x1f0bcc9 (0x94d8 bytes) 2024-09-21T15:07:31.919 INFO:teuthology.orchestra.run.smithi161.stdout:980 trunc from 0xd19fce5 to 0x1c2734c 2024-09-21T15:07:31.924 INFO:teuthology.orchestra.run.smithi161.stdout:764 trunc from 0xea1ec25 to 0x298a4f1 2024-09-21T15:07:31.927 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.927 INFO:teuthology.orchestra.run.smithi161.stdout:821 punch from 0x1db27a5 to 0x1dbf978, (0xd1d3 bytes) 2024-09-21T15:07:31.927 INFO:teuthology.orchestra.run.smithi161.stdout:822 write 0xd9931e thru 0xda154d (0x8230 bytes) 2024-09-21T15:07:31.928 INFO:teuthology.orchestra.run.smithi161.stdout:443 trunc from 0xe447fef to 0x1bfc60f 2024-09-21T15:07:31.944 INFO:teuthology.orchestra.run.smithi161.stdout:823 read 0xa91905 thru 0xa9f210 (0xd90c bytes) 2024-09-21T15:07:31.947 INFO:teuthology.orchestra.run.smithi161.stdout:824 read 0xdaf8e6 thru 0xdb12d5 (0x19f0 bytes) 2024-09-21T15:07:31.949 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:31.949 INFO:teuthology.orchestra.run.smithi161.stdout:827 read 0x12a6152 thru 0x12b3ab0 (0xd95f bytes) 2024-09-21T15:07:32.011 INFO:teuthology.orchestra.run.smithi161.stdout:828 write 0x79f2d9c thru 0x79f7fca (0x522f bytes) 2024-09-21T15:07:32.011 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.013 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #7, image image_cluster1.client.mirror.3-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent8 2024-09-21T15:07:32.019 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.023 INFO:teuthology.orchestra.run.smithi161.stdout:981 read 0x15e846a thru 0x15f7292 (0xee29 bytes) 2024-09-21T15:07:32.025 INFO:teuthology.orchestra.run.smithi161.stdout:982 punch from 0x1056224 to 0x10603f7, (0xa1d3 bytes) 2024-09-21T15:07:32.025 INFO:teuthology.orchestra.run.smithi161.stdout:983 write 0x15d099d thru 0x15e00de (0xf742 bytes) 2024-09-21T15:07:32.032 INFO:teuthology.orchestra.run.smithi161.stdout:984 punch from 0x2a3825 to 0x2a510c, (0x18e7 bytes) 2024-09-21T15:07:32.041 INFO:teuthology.orchestra.run.smithi161.stdout:766 writesame 0x7d814fa thru 0x7d8937e data_size 0x7(0x7e85 bytes) 2024-09-21T15:07:32.048 INFO:teuthology.orchestra.run.smithi161.stdout:767 read 0x5036b8f thru 0x503f265 (0x86d7 bytes) 2024-09-21T15:07:32.048 INFO:teuthology.orchestra.run.smithi161.stdout:768 punch from 0x4aa953e to 0x4ab099b, (0x745d bytes) 2024-09-21T15:07:32.048 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.048 INFO:teuthology.orchestra.run.smithi161.stdout:771 punch from 0x46c7eb8 to 0x46cc4b1, (0x45f9 bytes) 2024-09-21T15:07:32.048 INFO:teuthology.orchestra.run.smithi161.stdout:772 read 0x52e49f8 thru 0x52f3987 (0xef90 bytes) 2024-09-21T15:07:32.048 INFO:teuthology.orchestra.run.smithi161.stdout:774 read 0x7a07c12 thru 0x7a10d78 (0x9167 bytes) 2024-09-21T15:07:32.048 INFO:teuthology.orchestra.run.smithi161.stdout:775 read 0x6072f29 thru 0x607e1c5 (0xb29d bytes) 2024-09-21T15:07:32.048 INFO:teuthology.orchestra.run.smithi161.stdout:776 writesame 0x70d913d thru 0x70da360 data_size 0x2b(0x1224 bytes) 2024-09-21T15:07:32.060 INFO:teuthology.orchestra.run.smithi161.stdout:834 writesame 0xcd66243 thru 0xcd73504 data_size 0x35(0xd2c2 bytes) 2024-09-21T15:07:32.061 INFO:teuthology.orchestra.run.smithi161.stdout:777 trunc from 0x7d8937f to 0x68ab9f0 2024-09-21T15:07:32.064 INFO:teuthology.orchestra.run.smithi161.stdout:835 writesame 0xb9cbf4b thru 0xb9d753b data_size 0x1(0xb5f1 bytes) 2024-09-21T15:07:32.081 INFO:teuthology.orchestra.run.smithi161.stdout:985 write 0x70292a7 thru 0x702aa77 (0x17d1 bytes) 2024-09-21T15:07:32.121 INFO:teuthology.orchestra.run.smithi161.stdout:779 trunc from 0x68ab9f0 to 0x8c979b7 2024-09-21T15:07:32.124 INFO:teuthology.orchestra.run.smithi161.stdout:989 write 0x7afd18d thru 0x7b0c18c (0xf000 bytes) 2024-09-21T15:07:32.135 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.135 INFO:teuthology.orchestra.run.smithi161.stdout:991 read 0xbb6c31 thru 0xbc224b (0xb61b bytes) 2024-09-21T15:07:32.137 INFO:teuthology.orchestra.run.smithi161.stdout:992 punch from 0x5271a98 to 0x527a436, (0x899e bytes) 2024-09-21T15:07:32.138 INFO:teuthology.orchestra.run.smithi161.stdout:993 write 0x1419b80 thru 0x14200a2 (0x6523 bytes) 2024-09-21T15:07:32.139 INFO:teuthology.orchestra.run.smithi161.stdout:836 writesame 0xcf1a4b4 thru 0xcf1d1e3 data_size 0x18(0x2d30 bytes) 2024-09-21T15:07:32.142 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.142 INFO:teuthology.orchestra.run.smithi161.stdout:838 punch from 0x4520a68 to 0x4520e35, (0x3cd bytes) 2024-09-21T15:07:32.142 INFO:teuthology.orchestra.run.smithi161.stdout:839 read 0x8e9c034 thru 0x8eaa5f7 (0xe5c4 bytes) 2024-09-21T15:07:32.142 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.148 INFO:teuthology.orchestra.run.smithi161.stdout:994 trunc from 0x7b0c18d to 0x97a125a 2024-09-21T15:07:32.163 INFO:teuthology.orchestra.run.smithi161.stdout:846 write 0xcf31012 thru 0xcf3bd85 (0xad74 bytes) 2024-09-21T15:07:32.169 INFO:teuthology.orchestra.run.smithi161.stdout:781 writesame 0xa27cbfe thru 0xa28c7bc data_size 0x11(0xfbbf bytes) 2024-09-21T15:07:32.172 INFO:teuthology.orchestra.run.smithi161.stdout:847 write 0x28b1512 thru 0x28bf1d2 (0xdcc1 bytes) 2024-09-21T15:07:32.172 INFO:teuthology.orchestra.run.smithi161.stdout:782 read 0x1da7ec4 thru 0x1daa9d9 (0x2b16 bytes) 2024-09-21T15:07:32.173 INFO:teuthology.orchestra.run.smithi161.stdout:783 write 0x844c448 thru 0x8455587 (0x9140 bytes) 2024-09-21T15:07:32.180 INFO:teuthology.orchestra.run.smithi161.stdout:848 read 0x45f0a8e thru 0x45f4f9e (0x4511 bytes) 2024-09-21T15:07:32.183 INFO:teuthology.orchestra.run.smithi161.stdout:849 trunc from 0xcf3bd86 to 0xe578d66 2024-09-21T15:07:32.190 INFO:teuthology.orchestra.run.smithi161.stdout:784 trunc from 0xa28c7bd to 0xc75e5ac 2024-09-21T15:07:32.196 INFO:teuthology.orchestra.run.smithi161.stdout:995 write 0xd3f786e thru 0xd3fab7f (0x3312 bytes) 2024-09-21T15:07:32.213 INFO:teuthology.orchestra.run.smithi161.stdout:997 writesame 0x80e1bb9 thru 0x80f16c5 data_size 0x9(0xfb0d bytes) 2024-09-21T15:07:32.213 INFO:teuthology.orchestra.run.smithi161.stdout:850 write 0x12d0dfc thru 0x12d2810 (0x1a15 bytes) 2024-09-21T15:07:32.226 INFO:teuthology.orchestra.run.smithi161.stdout:785 write 0x472ddb3 thru 0x473cd51 (0xef9f bytes) 2024-09-21T15:07:32.229 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.229 INFO:teuthology.orchestra.run.smithi161.stdout:445 read 0xb912b3 thru 0xb9b656 (0xa3a4 bytes) 2024-09-21T15:07:32.235 INFO:teuthology.orchestra.run.smithi161.stdout:999 trunc from 0xd3fab80 to 0xa80b019 2024-09-21T15:07:32.236 INFO:teuthology.orchestra.run.smithi161.stdout:786 punch from 0xb909c4d to 0xb90ccd2, (0x3085 bytes) 2024-09-21T15:07:32.236 INFO:teuthology.orchestra.run.smithi161.stdout:789 punch from 0x4ea5542 to 0x4eabdfd, (0x68bb bytes) 2024-09-21T15:07:32.236 INFO:teuthology.orchestra.run.smithi161.stdout:790 write 0x6e238b9 thru 0x6e2f1d8 (0xb920 bytes) 2024-09-21T15:07:32.239 INFO:teuthology.orchestra.run.smithi161.stdout:851 trunc from 0xe578d66 to 0x5dd17c8 2024-09-21T15:07:32.251 INFO:teuthology.orchestra.run.smithi161.stdout:791 trunc from 0xc75e5ac to 0xad8ae11 2024-09-21T15:07:32.276 INFO:teuthology.orchestra.run.smithi161.stdout:447 writesame 0xb3f7e88 thru 0xb3f8d0a data_size 0x1(0xe83 bytes) 2024-09-21T15:07:32.278 INFO:teuthology.orchestra.run.smithi161.stdout:448 read 0x4410226 thru 0x4418296 (0x8071 bytes) 2024-09-21T15:07:32.278 INFO:teuthology.orchestra.run.smithi161.stdout:449 writesame 0x55081e6 thru 0x55129e9 data_size 0x2(0xa804 bytes) 2024-09-21T15:07:32.283 INFO:teuthology.orchestra.run.smithi161.stdout:792 punch from 0x928ceb5 to 0x928d9ff, (0xb4a bytes) 2024-09-21T15:07:32.283 INFO:teuthology.orchestra.run.smithi161.stdout:793 writesame 0x40b6966 thru 0x40bdbf1 data_size 0x2(0x728c bytes) 2024-09-21T15:07:32.286 INFO:teuthology.orchestra.run.smithi161.stdout:852 punch from 0x12837a7 to 0x1293253, (0xfaac bytes) 2024-09-21T15:07:32.286 INFO:teuthology.orchestra.run.smithi161.stdout:853 read 0x1814aa1 thru 0x182075b (0xbcbb bytes) 2024-09-21T15:07:32.299 INFO:teuthology.orchestra.run.smithi161.stdout:450 read 0x8b509ad thru 0x8b5c37a (0xb9ce bytes) 2024-09-21T15:07:32.314 INFO:teuthology.orchestra.run.smithi161.stdout:1000 writesame 0xe8156d0 thru 0xe81f59e data_size 0x2f(0x9ecf bytes) 2024-09-21T15:07:32.316 INFO:teuthology.orchestra.run.smithi161.stdout:1002 read 0x456e782 thru 0x45733d1 (0x4c50 bytes) 2024-09-21T15:07:32.316 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.316 INFO:teuthology.orchestra.run.smithi161.stdout:1004 write 0xe29f833 thru 0xe2a2ad4 (0x32a2 bytes) 2024-09-21T15:07:32.317 INFO:teuthology.orchestra.run.smithi161.stdout:854 writesame 0xbbf6fbc thru 0xbbff059 data_size 0x65(0x809e bytes) 2024-09-21T15:07:32.324 INFO:teuthology.orchestra.run.smithi161.stdout:1005 write 0x33ec17 thru 0x346a90 (0x7e7a bytes) 2024-09-21T15:07:32.325 INFO:teuthology.orchestra.run.smithi161.stdout:794 writesame 0xbd9b85d thru 0xbdaa87f data_size 0x5(0xf023 bytes) 2024-09-21T15:07:32.326 INFO:teuthology.orchestra.run.smithi161.stdout:451 write 0xdb212cd thru 0xdb2fced (0xea21 bytes) 2024-09-21T15:07:32.327 INFO:teuthology.orchestra.run.smithi161.stdout:855 trunc from 0xbbff05a to 0x70abf7d 2024-09-21T15:07:32.329 INFO:teuthology.orchestra.run.smithi161.stdout:795 read 0x236b7c8 thru 0x2376140 (0xa979 bytes) 2024-09-21T15:07:32.330 INFO:teuthology.orchestra.run.smithi161.stdout:797 read 0x9e79800 thru 0x9e82857 (0x9058 bytes) 2024-09-21T15:07:32.331 INFO:teuthology.orchestra.run.smithi161.stdout:798 write 0x83b785 thru 0x8415ce (0x5e4a bytes) 2024-09-21T15:07:32.333 INFO:teuthology.orchestra.run.smithi161.stdout:1007 clone 5 order 25 su 262144 sc 5 2024-09-21T15:07:32.341 INFO:teuthology.orchestra.run.smithi161.stdout:454 read 0x3cdf886 thru 0x3cec4d6 (0xcc51 bytes) 2024-09-21T15:07:32.341 INFO:teuthology.orchestra.run.smithi161.stdout:456 trunc from 0xdb2fcee to 0xdb2be65 2024-09-21T15:07:32.348 INFO:teuthology.orchestra.run.smithi161.stdout:799 trunc from 0xbdaa880 to 0x8ec914d 2024-09-21T15:07:32.367 INFO:teuthology.orchestra.run.smithi161.stdout:857 trunc from 0x70abf7d to 0xc00e689 2024-09-21T15:07:32.383 INFO:teuthology.orchestra.run.smithi161.stdout:457 read 0x67bd11c thru 0x67c1f24 (0x4e09 bytes) 2024-09-21T15:07:32.383 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.383 INFO:teuthology.orchestra.run.smithi161.stdout:462 punch from 0x4bc1091 to 0x4bcde10, (0xcd7f bytes) 2024-09-21T15:07:32.383 INFO:teuthology.orchestra.run.smithi161.stdout:463 writesame 0x72d3991 thru 0x72dea1f data_size 0xb(0xb08f bytes) 2024-09-21T15:07:32.393 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.393 INFO:teuthology.orchestra.run.smithi161.stdout:465 read 0x70297cf thru 0x702b85c (0x208e bytes) 2024-09-21T15:07:32.393 INFO:teuthology.orchestra.run.smithi161.stdout:466 write 0xcce68e5 thru 0xccea8f0 (0x400c bytes) 2024-09-21T15:07:32.405 INFO:teuthology.orchestra.run.smithi161.stdout:467 read 0x49a6ea6 thru 0x49a9da8 (0x2f03 bytes) 2024-09-21T15:07:32.405 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.405 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.405 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.405 INFO:teuthology.orchestra.run.smithi161.stdout:472 read 0xa65fe57 thru 0xa66d223 (0xd3cd bytes) 2024-09-21T15:07:32.405 INFO:teuthology.orchestra.run.smithi161.stdout:474 read 0xa5f4e37 thru 0xa5fa699 (0x5863 bytes) 2024-09-21T15:07:32.405 INFO:teuthology.orchestra.run.smithi161.stdout:475 read 0x3820c33 thru 0x382419c (0x356a bytes) 2024-09-21T15:07:32.406 INFO:teuthology.orchestra.run.smithi161.stdout:476 writesame 0x9381412 thru 0x938231d data_size 0x12(0xf0c bytes) 2024-09-21T15:07:32.414 INFO:teuthology.orchestra.run.smithi161.stdout:477 punch from 0x7dd4afa to 0x7dd778d, (0x2c93 bytes) 2024-09-21T15:07:32.415 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.415 INFO:teuthology.orchestra.run.smithi161.stdout:479 write 0xa45f96b thru 0xa46142c (0x1ac2 bytes) 2024-09-21T15:07:32.420 INFO:teuthology.orchestra.run.smithi161.stdout:858 write 0xc308939 thru 0xc30a83f (0x1f07 bytes) 2024-09-21T15:07:32.423 INFO:teuthology.orchestra.run.smithi161.stdout:800 write 0xe8b107a thru 0xe8b2c71 (0x1bf8 bytes) 2024-09-21T15:07:32.429 INFO:teuthology.orchestra.run.smithi161.stdout:859 read 0x131ae2f thru 0x1329448 (0xe61a bytes) 2024-09-21T15:07:32.430 INFO:teuthology.orchestra.run.smithi161.stdout:860 punch from 0x8ad4435 to 0x8adb941, (0x750c bytes) 2024-09-21T15:07:32.430 INFO:teuthology.orchestra.run.smithi161.stdout:861 write 0x8bb5e28 thru 0x8bc4dbd (0xef96 bytes) 2024-09-21T15:07:32.431 INFO:teuthology.orchestra.run.smithi161.stdout:480 trunc from 0xdb2be65 to 0x9649a1f 2024-09-21T15:07:32.433 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.433 INFO:teuthology.orchestra.run.smithi161.stdout:802 writesame 0x26a3b96 thru 0x26af3e9 data_size 0x2f(0xb854 bytes) 2024-09-21T15:07:32.440 INFO:teuthology.orchestra.run.smithi161.stdout:608 read 0x12752e3 thru 0x127a535 (0x5253 bytes) 2024-09-21T15:07:32.440 INFO:teuthology.orchestra.run.smithi161.stdout:804 read 0x57b28cc thru 0x57c049e (0xdbd3 bytes) 2024-09-21T15:07:32.440 INFO:teuthology.orchestra.run.smithi161.stdout:805 punch from 0xb9ea799 to 0xb9ec47e, (0x1ce5 bytes) 2024-09-21T15:07:32.441 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.441 INFO:teuthology.orchestra.run.smithi161.stdout:807 writesame 0x5778f5e thru 0x577b8c9 data_size 0x16(0x296c bytes) 2024-09-21T15:07:32.441 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.441 INFO:teuthology.orchestra.run.smithi161.stdout:865 read 0xbdf3321 thru 0xbdfe8ed (0xb5cd bytes) 2024-09-21T15:07:32.441 INFO:teuthology.orchestra.run.smithi161.stdout:866 punch from 0xb6a36a to 0xb6ed12, (0x49a8 bytes) 2024-09-21T15:07:32.441 INFO:teuthology.orchestra.run.smithi161.stdout:867 read 0x28e51e8 thru 0x28ed6bc (0x84d5 bytes) 2024-09-21T15:07:32.442 INFO:teuthology.orchestra.run.smithi161.stdout:869 read 0x3b51858 thru 0x3b5a2d5 (0x8a7e bytes) 2024-09-21T15:07:32.442 INFO:teuthology.orchestra.run.smithi161.stdout:872 read 0xb147227 thru 0xb151abc (0xa896 bytes) 2024-09-21T15:07:32.442 INFO:teuthology.orchestra.run.smithi161.stdout:873 read 0x15e77ef thru 0x15efb36 (0x8348 bytes) 2024-09-21T15:07:32.448 INFO:teuthology.orchestra.run.smithi161.stdout:874 trunc from 0xc30a840 to 0x8c2ff49 2024-09-21T15:07:32.455 INFO:teuthology.orchestra.run.smithi161.stdout:609 write 0x57c3a5d thru 0x57c8753 (0x4cf7 bytes) 2024-09-21T15:07:32.467 INFO:teuthology.orchestra.run.smithi161.stdout:808 trunc from 0xe8b2c72 to 0x3636953 2024-09-21T15:07:32.475 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.475 INFO:teuthology.orchestra.run.smithi161.stdout:483 read 0x525fb5d thru 0x5269a4f (0x9ef3 bytes) 2024-09-21T15:07:32.485 INFO:teuthology.orchestra.run.smithi161.stdout:610 writesame 0xe2b6a75 thru 0xe2c29a4 data_size 0x10(0xbf30 bytes) 2024-09-21T15:07:32.489 INFO:teuthology.orchestra.run.smithi161.stdout:484 trunc from 0x9649a1f to 0xd262f7 2024-09-21T15:07:32.507 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.508 INFO:teuthology.orchestra.run.smithi161.stdout:875 trunc from 0x8c2ff49 to 0xd4f5b93 2024-09-21T15:07:32.523 INFO:teuthology.orchestra.run.smithi161.stdout:613 trunc from 0xee4740a to 0x7054e85 2024-09-21T15:07:32.541 INFO:teuthology.orchestra.run.smithi161.stdout:809 read 0x7eb63f thru 0x7f1737 (0x60f9 bytes) 2024-09-21T15:07:32.542 INFO:teuthology.orchestra.run.smithi161.stdout:810 read 0xefef13 thru 0xf0ea2c (0xfb1a bytes) 2024-09-21T15:07:32.553 INFO:teuthology.orchestra.run.smithi161.stdout:812 trunc from 0x3636953 to 0x84bb68b 2024-09-21T15:07:32.562 INFO:teuthology.orchestra.run.smithi161.stdout:876 trunc from 0xd4f5b93 to 0x4d8cbb6 2024-09-21T15:07:32.649 INFO:teuthology.orchestra.run.smithi161.stdout:488 read 0x70d20b thru 0x716cfd (0x9af3 bytes) 2024-09-21T15:07:32.727 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.778 INFO:teuthology.orchestra.run.smithi161.stdout:815 writesame 0x9ff1cd0 thru 0xa0011e8 data_size 0x8d(0xf519 bytes) 2024-09-21T15:07:32.783 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.783 INFO:teuthology.orchestra.run.smithi161.stdout:817 write 0x228a983 thru 0x228b1f6 (0x874 bytes) 2024-09-21T15:07:32.786 INFO:teuthology.orchestra.run.smithi161.stdout:877 write 0x3102e68 thru 0x3104e15 (0x1fae bytes) 2024-09-21T15:07:32.791 INFO:teuthology.orchestra.run.smithi161.stdout:490 write 0x57477a7 thru 0x574f20e (0x7a68 bytes) 2024-09-21T15:07:32.805 INFO:teuthology.orchestra.run.smithi161.stdout:878 read 0x52e8d thru 0x56714 (0x3888 bytes) 2024-09-21T15:07:32.806 INFO:teuthology.orchestra.run.smithi161.stdout:879 write 0x3a5cfea thru 0x3a5dd33 (0xd4a bytes) 2024-09-21T15:07:32.824 INFO:teuthology.orchestra.run.smithi161.stdout:880 write 0x1c558d6 thru 0x1c5f256 (0x9981 bytes) 2024-09-21T15:07:32.850 INFO:teuthology.orchestra.run.smithi161.stdout:818 write 0xd2aaad7 thru 0xd2b73e5 (0xc90f bytes) 2024-09-21T15:07:32.866 INFO:teuthology.orchestra.run.smithi161.stdout:819 write 0x7062fcc thru 0x70646a6 (0x16db bytes) 2024-09-21T15:07:32.873 INFO:teuthology.orchestra.run.smithi161.stdout:491 write 0xdeaca4d thru 0xdeb5ace (0x9082 bytes) 2024-09-21T15:07:32.879 INFO:teuthology.orchestra.run.smithi161.stdout:820 read 0x87e68f8 thru 0x87ee0c4 (0x77cd bytes) 2024-09-21T15:07:32.879 INFO:teuthology.orchestra.run.smithi161.stdout:821 write 0xc4d2fe7 thru 0xc4e2e53 (0xfe6d bytes) 2024-09-21T15:07:32.887 INFO:teuthology.orchestra.run.smithi161.stdout:492 read 0x20dbbc7 thru 0x20e8964 (0xcd9e bytes) 2024-09-21T15:07:32.889 INFO:teuthology.orchestra.run.smithi161.stdout:881 write 0x9f6897d thru 0x9f6f208 (0x688c bytes) 2024-09-21T15:07:32.889 INFO:teuthology.orchestra.run.smithi161.stdout:615 write 0xc7e8a69 thru 0xc7ef97c (0x6f14 bytes) 2024-09-21T15:07:32.893 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.893 INFO:teuthology.orchestra.run.smithi161.stdout:823 write 0x9f51d5 thru 0x9fdd68 (0x8b94 bytes) 2024-09-21T15:07:32.898 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:32.898 INFO:teuthology.orchestra.run.smithi161.stdout:619 write 0x73a55fe thru 0x73aa97d (0x5380 bytes) 2024-09-21T15:07:32.901 INFO:teuthology.orchestra.run.smithi161.stdout:824 write 0xbdb8ce7 thru 0xbdbd13d (0x4457 bytes) 2024-09-21T15:07:32.904 INFO:teuthology.orchestra.run.smithi161.stdout:620 punch from 0xa9da87a to 0xa9deb56, (0x42dc bytes) 2024-09-21T15:07:32.907 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone4 from 0x7ea1fc7 (overlap 0x6166c66) to 0x0 2024-09-21T15:07:32.910 INFO:teuthology.orchestra.run.smithi161.stdout:494 trunc from 0xdeb5acf to 0x160c7ee 2024-09-21T15:07:32.924 INFO:teuthology.orchestra.run.smithi161.stdout:621 trunc from 0xc7ef97d to 0x1e286d5 2024-09-21T15:07:33.008 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.2-clone4 2024-09-21T15:07:33.008 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.029 INFO:teuthology.orchestra.run.smithi161.stdout:882 write 0xcc980c0 thru 0xcc9bc8e (0x3bcf bytes) 2024-09-21T15:07:33.054 INFO:teuthology.orchestra.run.smithi161.stdout:883 trunc from 0xcc9bc8f to 0x460810e 2024-09-21T15:07:33.056 INFO:teuthology.orchestra.run.smithi161.stdout:623 write 0x540c84b thru 0x541364e (0x6e04 bytes) 2024-09-21T15:07:33.067 INFO:teuthology.orchestra.run.smithi161.stdout:495 writesame 0x3ecb98c thru 0x3ed1b91 data_size 0x1(0x6206 bytes) 2024-09-21T15:07:33.070 INFO:teuthology.orchestra.run.smithi161.stdout:825 writesame 0xdcecf45 thru 0xdcefe69 data_size 0x9(0x2f25 bytes) 2024-09-21T15:07:33.074 INFO:teuthology.orchestra.run.smithi161.stdout:496 read 0x31ebb84 thru 0x31f094a (0x4dc7 bytes) 2024-09-21T15:07:33.082 INFO:teuthology.orchestra.run.smithi161.stdout:826 write 0x1047931 thru 0x104b3cc (0x3a9c bytes) 2024-09-21T15:07:33.092 INFO:teuthology.orchestra.run.smithi161.stdout:827 writesame 0xb98674f thru 0xb98f4cc data_size 0x3(0x8d7e bytes) 2024-09-21T15:07:33.102 INFO:teuthology.orchestra.run.smithi161.stdout:624 write 0x770544b thru 0x770c198 (0x6d4e bytes) 2024-09-21T15:07:33.109 INFO:teuthology.orchestra.run.smithi161.stdout:828 write 0xc5dfb7f thru 0xc5e1175 (0x15f7 bytes) 2024-09-21T15:07:33.112 INFO:teuthology.orchestra.run.smithi161.stdout:625 write 0x54c9e90 thru 0x54d22c5 (0x8436 bytes) 2024-09-21T15:07:33.120 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.120 INFO:teuthology.orchestra.run.smithi161.stdout:830 read 0x6ee79 thru 0x70fd7 (0x215f bytes) 2024-09-21T15:07:33.121 INFO:teuthology.orchestra.run.smithi161.stdout:626 write 0x9031f5 thru 0x90650a (0x3316 bytes) 2024-09-21T15:07:33.122 INFO:teuthology.orchestra.run.smithi161.stdout:497 write 0x7eea794 thru 0x7ef8897 (0xe104 bytes) 2024-09-21T15:07:33.123 INFO:teuthology.orchestra.run.smithi161.stdout:831 writesame 0x3891c2c thru 0x38953e6 data_size 0x1(0x37bb bytes) 2024-09-21T15:07:33.132 INFO:teuthology.orchestra.run.smithi161.stdout:627 read 0x634ca93 thru 0x6354dfd (0x836b bytes) 2024-09-21T15:07:33.139 INFO:teuthology.orchestra.run.smithi161.stdout:498 write 0x362e722 thru 0x3632a37 (0x4316 bytes) 2024-09-21T15:07:33.145 INFO:teuthology.orchestra.run.smithi161.stdout:832 write 0xaad24fe thru 0xaadb4c3 (0x8fc6 bytes) 2024-09-21T15:07:33.147 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.148 INFO:teuthology.orchestra.run.smithi161.stdout:500 read 0x6b93e52 thru 0x6ba0565 (0xc714 bytes) 2024-09-21T15:07:33.148 INFO:teuthology.orchestra.run.smithi161.stdout:503 writesame 0x7a46b8b thru 0x7a533e6 data_size 0x2(0xc85c bytes) 2024-09-21T15:07:33.151 INFO:teuthology.orchestra.run.smithi161.stdout:884 write 0x89ab059 thru 0x89ad506 (0x24ae bytes) 2024-09-21T15:07:33.153 INFO:teuthology.orchestra.run.smithi161.stdout:833 write 0x8d90a3c thru 0x8d9507e (0x4643 bytes) 2024-09-21T15:07:33.161 INFO:teuthology.orchestra.run.smithi161.stdout:885 write 0x5fdf9f8 thru 0x5fece83 (0xd48c bytes) 2024-09-21T15:07:33.174 INFO:teuthology.orchestra.run.smithi161.stdout:834 writesame 0x7295e18 thru 0x72a35b1 data_size 0x3(0xd79a bytes) 2024-09-21T15:07:33.175 INFO:teuthology.orchestra.run.smithi161.stdout:886 punch from 0x46c22eb to 0x46cb5eb, (0x9300 bytes) 2024-09-21T15:07:33.175 INFO:teuthology.orchestra.run.smithi161.stdout:887 trunc from 0x89ad507 to 0x8aa618a 2024-09-21T15:07:33.180 INFO:teuthology.orchestra.run.smithi161.stdout:628 writesame 0xaa289a6 thru 0xaa37c03 data_size 0x51(0xf25e bytes) 2024-09-21T15:07:33.192 INFO:teuthology.orchestra.run.smithi161.stdout:629 read 0x9abe4ed thru 0x9ac9f57 (0xba6b bytes) 2024-09-21T15:07:33.194 INFO:teuthology.orchestra.run.smithi161.stdout:835 writesame 0x88c42f9 thru 0x88d0a66 data_size 0x43(0xc76e bytes) 2024-09-21T15:07:33.197 INFO:teuthology.orchestra.run.smithi161.stdout:630 trunc from 0xaa37c04 to 0x892157a 2024-09-21T15:07:33.208 INFO:teuthology.orchestra.run.smithi161.stdout:836 writesame 0x1420964 thru 0x1426e9b data_size 0x29(0x6538 bytes) 2024-09-21T15:07:33.218 INFO:teuthology.orchestra.run.smithi161.stdout:504 write 0x9696ff1 thru 0x96a4e9f (0xdeaf bytes) 2024-09-21T15:07:33.220 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.220 INFO:teuthology.orchestra.run.smithi161.stdout:839 punch from 0x32c14ef to 0x32cefb3, (0xdac4 bytes) 2024-09-21T15:07:33.246 INFO:teuthology.orchestra.run.smithi161.stdout:632 read 0x2a50e43 thru 0x2a52b00 (0x1cbe bytes) 2024-09-21T15:07:33.247 INFO:teuthology.orchestra.run.smithi161.stdout:506 trunc from 0x96a4ea0 to 0xd6a2492 2024-09-21T15:07:33.247 INFO:teuthology.orchestra.run.smithi161.stdout:634 punch from 0x2bf3acd to 0x2bff2b3, (0xb7e6 bytes) 2024-09-21T15:07:33.247 INFO:teuthology.orchestra.run.smithi161.stdout:635 write 0x5ca5bcf thru 0x5cb3a4b (0xde7d bytes) 2024-09-21T15:07:33.251 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #3, image image_cluster1.client.mirror.4-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent4 2024-09-21T15:07:33.257 INFO:teuthology.orchestra.run.smithi161.stdout:888 write 0xc1aea72 thru 0xc1bbc01 (0xd190 bytes) 2024-09-21T15:07:33.264 INFO:teuthology.orchestra.run.smithi161.stdout:840 write 0xe0d85ce thru 0xe0e5376 (0xcda9 bytes) 2024-09-21T15:07:33.271 INFO:teuthology.orchestra.run.smithi161.stdout:889 write 0x80c5134 thru 0x80c75ba (0x2487 bytes) 2024-09-21T15:07:33.281 INFO:teuthology.orchestra.run.smithi161.stdout:845 read 0xb620007 thru 0xb62faf9 (0xfaf3 bytes) 2024-09-21T15:07:33.281 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #3, image image_cluster1.client.mirror.2-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent4 2024-09-21T15:07:33.284 INFO:teuthology.orchestra.run.smithi161.stdout:507 writesame 0x7d4c195 thru 0x7d56439 data_size 0x1(0xa2a5 bytes) 2024-09-21T15:07:33.284 INFO:teuthology.orchestra.run.smithi161.stdout:846 trunc from 0xe0e5377 to 0xd3765ec 2024-09-21T15:07:33.288 INFO:teuthology.orchestra.run.smithi161.stdout:636 writesame 0x9995322 thru 0x999fd97 data_size 0x15(0xaa76 bytes) 2024-09-21T15:07:33.295 INFO:teuthology.orchestra.run.smithi161.stdout:890 trunc from 0xc1bbc02 to 0x56ad6bb 2024-09-21T15:07:33.298 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.298 INFO:teuthology.orchestra.run.smithi161.stdout:639 read 0x1e65211 thru 0x1e66ea8 (0x1c98 bytes) 2024-09-21T15:07:33.298 INFO:teuthology.orchestra.run.smithi161.stdout:641 read 0x16c91fc thru 0x16cb31d (0x2122 bytes) 2024-09-21T15:07:33.299 INFO:teuthology.orchestra.run.smithi161.stdout:643 punch from 0x59de17a to 0x59deaf1, (0x977 bytes) 2024-09-21T15:07:33.299 INFO:teuthology.orchestra.run.smithi161.stdout:644 clone 10 order 22 su 32768 sc 7 2024-09-21T15:07:33.308 INFO:teuthology.orchestra.run.smithi161.stdout:603 write 0x5672881 thru 0x5674e48 (0x25c8 bytes) 2024-09-21T15:07:33.320 INFO:teuthology.orchestra.run.smithi161.stdout:509 punch from 0x13ee233 to 0x13f1aff, (0x38cc bytes) 2024-09-21T15:07:33.320 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.321 INFO:teuthology.orchestra.run.smithi161.stdout:512 writesame 0x12dd90c thru 0x12e1237 data_size 0x2(0x392c bytes) 2024-09-21T15:07:33.335 INFO:teuthology.orchestra.run.smithi161.stdout:1008 write 0x4e299ed thru 0x4e3987f (0xfe93 bytes) 2024-09-21T15:07:33.340 INFO:teuthology.orchestra.run.smithi161.stdout:514 punch from 0x38b156c to 0x38bb21a, (0x9cae bytes) 2024-09-21T15:07:33.341 INFO:teuthology.orchestra.run.smithi161.stdout:515 read 0x4d42727 thru 0x4d4c750 (0xa02a bytes) 2024-09-21T15:07:33.341 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.341 INFO:teuthology.orchestra.run.smithi161.stdout:518 write 0xabcde0d thru 0xabd5085 (0x7279 bytes) 2024-09-21T15:07:33.343 INFO:teuthology.orchestra.run.smithi161.stdout:847 punch from 0x568b135 to 0x568dec5, (0x2d90 bytes) 2024-09-21T15:07:33.343 INFO:teuthology.orchestra.run.smithi161.stdout:848 punch from 0x76625d0 to 0x7668e46, (0x6876 bytes) 2024-09-21T15:07:33.353 INFO:teuthology.orchestra.run.smithi161.stdout:604 read 0x75397e6 thru 0x75430fa (0x9915 bytes) 2024-09-21T15:07:33.354 INFO:teuthology.orchestra.run.smithi161.stdout:519 write 0x812c7dc thru 0x812dc5d (0x1482 bytes) 2024-09-21T15:07:33.357 INFO:teuthology.orchestra.run.smithi161.stdout:850 trunc from 0xd3765ec to 0x7460a7b 2024-09-21T15:07:33.357 INFO:teuthology.orchestra.run.smithi161.stdout:891 punch from 0x17c06b3 to 0x17c7d78, (0x76c5 bytes) 2024-09-21T15:07:33.357 INFO:teuthology.orchestra.run.smithi161.stdout:892 write 0x52c13b7 thru 0x52c79bc (0x6606 bytes) 2024-09-21T15:07:33.360 INFO:teuthology.orchestra.run.smithi161.stdout:605 trunc from 0x7ea1fc7 to 0x591bfe5 2024-09-21T15:07:33.377 INFO:teuthology.orchestra.run.smithi161.stdout:520 punch from 0x1672b9a to 0x1677c69, (0x50cf bytes) 2024-09-21T15:07:33.377 INFO:teuthology.orchestra.run.smithi161.stdout:521 write 0x8a7ae37 thru 0x8a83864 (0x8a2e bytes) 2024-09-21T15:07:33.400 INFO:teuthology.orchestra.run.smithi161.stdout:893 punch from 0x382363a to 0x382a5fa, (0x6fc0 bytes) 2024-09-21T15:07:33.400 INFO:teuthology.orchestra.run.smithi161.stdout:894 punch from 0x4be1bc2 to 0x4be7a51, (0x5e8f bytes) 2024-09-21T15:07:33.400 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.401 INFO:teuthology.orchestra.run.smithi161.stdout:896 trunc from 0x56ad6bb to 0x634c656 2024-09-21T15:07:33.423 INFO:teuthology.orchestra.run.smithi161.stdout:523 trunc from 0xd6a2492 to 0xd15ed3e 2024-09-21T15:07:33.425 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.425 INFO:teuthology.orchestra.run.smithi161.stdout:1011 punch from 0x152b1bf to 0x152bbbf, (0xa00 bytes) 2024-09-21T15:07:33.425 INFO:teuthology.orchestra.run.smithi161.stdout:1012 punch from 0x38e6550 to 0x38e6ff8, (0xaa8 bytes) 2024-09-21T15:07:33.425 INFO:teuthology.orchestra.run.smithi161.stdout:1013 punch from 0x1d1a60d to 0x1d214d0, (0x6ec3 bytes) 2024-09-21T15:07:33.426 INFO:teuthology.orchestra.run.smithi161.stdout:1014 punch from 0x800854a to 0x800877a, (0x230 bytes) 2024-09-21T15:07:33.426 INFO:teuthology.orchestra.run.smithi161.stdout:1016 write 0x734edf9 thru 0x73576ae (0x88b6 bytes) 2024-09-21T15:07:33.447 INFO:teuthology.orchestra.run.smithi161.stdout:851 read 0xb160d6 thru 0xb1a3c5 (0x42f0 bytes) 2024-09-21T15:07:33.468 INFO:teuthology.orchestra.run.smithi161.stdout:524 read 0x4572b67 thru 0x4578bd9 (0x6073 bytes) 2024-09-21T15:07:33.468 INFO:teuthology.orchestra.run.smithi161.stdout:525 write 0xadfc2b4 thru 0xae035d9 (0x7326 bytes) 2024-09-21T15:07:33.475 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.482 INFO:teuthology.orchestra.run.smithi161.stdout:1018 trunc from 0xe81f59f to 0xac7c170 2024-09-21T15:07:33.496 INFO:teuthology.orchestra.run.smithi161.stdout:897 write 0xd994596 thru 0xd9a39f7 (0xf462 bytes) 2024-09-21T15:07:33.507 INFO:teuthology.orchestra.run.smithi161.stdout:853 write 0xb722fc1 thru 0xb72e247 (0xb287 bytes) 2024-09-21T15:07:33.514 INFO:teuthology.orchestra.run.smithi161.stdout:526 trunc from 0xd15ed3e to 0x5d413aa 2024-09-21T15:07:33.521 INFO:teuthology.orchestra.run.smithi161.stdout:898 read 0x4f5b78e thru 0x4f623b2 (0x6c25 bytes) 2024-09-21T15:07:33.521 INFO:teuthology.orchestra.run.smithi161.stdout:899 write 0xb0a25cc thru 0xb0aa79e (0x81d3 bytes) 2024-09-21T15:07:33.525 INFO:teuthology.orchestra.run.smithi161.stdout:854 trunc from 0xb72e248 to 0xb01d070 2024-09-21T15:07:33.538 INFO:teuthology.orchestra.run.smithi161.stdout:900 read 0xb05442 thru 0xb13db8 (0xe977 bytes) 2024-09-21T15:07:33.539 INFO:teuthology.orchestra.run.smithi161.stdout:901 write 0x33deba7 thru 0x33e1167 (0x25c1 bytes) 2024-09-21T15:07:33.540 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.541 INFO:teuthology.orchestra.run.smithi161.stdout:608 write 0x5593241 thru 0x5596749 (0x3509 bytes) 2024-09-21T15:07:33.552 INFO:teuthology.orchestra.run.smithi161.stdout:1019 punch from 0x237fc19 to 0x23887d1, (0x8bb8 bytes) 2024-09-21T15:07:33.552 INFO:teuthology.orchestra.run.smithi161.stdout:1020 read 0x3c9bdd5 thru 0x3cab691 (0xf8bd bytes) 2024-09-21T15:07:33.567 INFO:teuthology.orchestra.run.smithi161.stdout:609 trunc from 0x591bfe5 to 0xd920198 2024-09-21T15:07:33.568 INFO:teuthology.orchestra.run.smithi161.stdout:855 punch from 0x67c86e0 to 0x67cb50d, (0x2e2d bytes) 2024-09-21T15:07:33.568 INFO:teuthology.orchestra.run.smithi161.stdout:857 read 0x96d7ff7 thru 0x96da889 (0x2893 bytes) 2024-09-21T15:07:33.568 INFO:teuthology.orchestra.run.smithi161.stdout:858 write 0x1f17cf9 thru 0x1f1dd2b (0x6033 bytes) 2024-09-21T15:07:33.582 INFO:teuthology.orchestra.run.smithi161.stdout:527 trunc from 0x5d413aa to 0x2071436 2024-09-21T15:07:33.586 INFO:teuthology.orchestra.run.smithi161.stdout:859 read 0x31314bf thru 0x31314c7 (0x9 bytes) 2024-09-21T15:07:33.587 INFO:teuthology.orchestra.run.smithi161.stdout:863 writesame 0x585e414 thru 0x586c9eb data_size 0x14(0xe5d8 bytes) 2024-09-21T15:07:33.594 INFO:teuthology.orchestra.run.smithi161.stdout:902 write 0xeb95de3 thru 0xeb98ee4 (0x3102 bytes) 2024-09-21T15:07:33.605 INFO:teuthology.orchestra.run.smithi161.stdout:1021 write 0xb650bcd thru 0xb65a8e0 (0x9d14 bytes) 2024-09-21T15:07:33.612 INFO:teuthology.orchestra.run.smithi161.stdout:864 write 0x8b394a5 thru 0x8b471a2 (0xdcfe bytes) 2024-09-21T15:07:33.616 INFO:teuthology.orchestra.run.smithi161.stdout:612 read 0x38da699 thru 0x38e36c9 (0x9031 bytes) 2024-09-21T15:07:33.617 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.618 INFO:teuthology.orchestra.run.smithi161.stdout:1024 read 0x893bf36 thru 0x894b497 (0xf562 bytes) 2024-09-21T15:07:33.618 INFO:teuthology.orchestra.run.smithi161.stdout:1025 write 0x7145dfc thru 0x714d9d1 (0x7bd6 bytes) 2024-09-21T15:07:33.627 INFO:teuthology.orchestra.run.smithi161.stdout:865 punch from 0x62ae626 to 0x62b950a, (0xaee4 bytes) 2024-09-21T15:07:33.633 INFO:teuthology.orchestra.run.smithi161.stdout:866 trunc from 0xb01d070 to 0xc27f880 2024-09-21T15:07:33.638 INFO:teuthology.orchestra.run.smithi161.stdout:615 trunc from 0xd920198 to 0x6e6f478 2024-09-21T15:07:33.642 INFO:teuthology.orchestra.run.smithi161.stdout:903 trunc from 0xeb98ee5 to 0x8aeafb 2024-09-21T15:07:33.660 INFO:teuthology.orchestra.run.smithi161.stdout:1027 read 0x890c5de thru 0x89149c0 (0x83e3 bytes) 2024-09-21T15:07:33.661 INFO:teuthology.orchestra.run.smithi161.stdout:1028 write 0xb02ea44 thru 0xb03a885 (0xbe42 bytes) 2024-09-21T15:07:33.668 INFO:teuthology.orchestra.run.smithi161.stdout:528 writesame 0xc99ddef thru 0xc99f0f0 data_size 0x3(0x1302 bytes) 2024-09-21T15:07:33.670 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.670 INFO:teuthology.orchestra.run.smithi161.stdout:869 clone 6 order 23 su 65536 sc 6 2024-09-21T15:07:33.673 INFO:teuthology.orchestra.run.smithi161.stdout:1030 punch from 0x4f774a1 to 0x4f7bbd6, (0x4735 bytes) 2024-09-21T15:07:33.673 INFO:teuthology.orchestra.run.smithi161.stdout:1031 writesame 0x64afc77 thru 0x64b0c5a data_size 0xc(0xfe4 bytes) 2024-09-21T15:07:33.674 INFO:teuthology.orchestra.run.smithi161.stdout:529 read 0xba1a862 thru 0xba1fac3 (0x5262 bytes) 2024-09-21T15:07:33.674 INFO:teuthology.orchestra.run.smithi161.stdout:531 write 0x305913a thru 0x305b189 (0x2050 bytes) 2024-09-21T15:07:33.678 INFO:teuthology.orchestra.run.smithi161.stdout:616 trunc from 0x6e6f478 to 0x5491f6 2024-09-21T15:07:33.687 INFO:teuthology.orchestra.run.smithi161.stdout:532 punch from 0x7b8ac60 to 0x7b8ff25, (0x52c5 bytes) 2024-09-21T15:07:33.687 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.692 INFO:teuthology.orchestra.run.smithi161.stdout:1034 trunc from 0xb65a8e1 to 0x4875e70 2024-09-21T15:07:33.705 INFO:teuthology.orchestra.run.smithi161.stdout:534 trunc from 0xc99f0f1 to 0x1be3617 2024-09-21T15:07:33.710 INFO:teuthology.orchestra.run.smithi161.stdout:905 read 0x5013be thru 0x5086d4 (0x7317 bytes) 2024-09-21T15:07:33.749 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.757 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.770 INFO:teuthology.orchestra.run.smithi161.stdout:906 writesame 0x724e2a1 thru 0x725b9dd data_size 0x1(0xd73d bytes) 2024-09-21T15:07:33.774 INFO:teuthology.orchestra.run.smithi161.stdout:907 punch from 0x31f1725 to 0x31f29bc, (0x1297 bytes) 2024-09-21T15:07:33.775 INFO:teuthology.orchestra.run.smithi161.stdout:910 read 0xfbac9a thru 0xfc50e4 (0xa44b bytes) 2024-09-21T15:07:33.794 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone9 from 0x999fd98 (overlap 0x1e286d5) to 0x1218419 2024-09-21T15:07:33.804 INFO:teuthology.orchestra.run.smithi161.stdout:618 write 0xd1feae1 thru 0xd205213 (0x6733 bytes) 2024-09-21T15:07:33.805 INFO:teuthology.orchestra.run.smithi161.stdout:536 writesame 0xbd64e1e thru 0xbd725ed data_size 0x18(0xd7d0 bytes) 2024-09-21T15:07:33.807 INFO:teuthology.orchestra.run.smithi161.stdout:1035 read 0x3521be0 thru 0x35246c7 (0x2ae8 bytes) 2024-09-21T15:07:33.810 INFO:teuthology.orchestra.run.smithi161.stdout:537 read 0x35e88d9 thru 0x35f1c6a (0x9392 bytes) 2024-09-21T15:07:33.810 INFO:teuthology.orchestra.run.smithi161.stdout:538 write 0x980a929 thru 0x980ffa0 (0x5678 bytes) 2024-09-21T15:07:33.818 INFO:teuthology.orchestra.run.smithi161.stdout:912 write 0x93ca29c thru 0x93d0458 (0x61bd bytes) 2024-09-21T15:07:33.818 INFO:teuthology.orchestra.run.smithi161.stdout:619 punch from 0xb2c616e to 0xb2c9d7b, (0x3c0d bytes) 2024-09-21T15:07:33.819 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.819 INFO:teuthology.orchestra.run.smithi161.stdout:621 read 0x12f484d thru 0x12fed00 (0xa4b4 bytes) 2024-09-21T15:07:33.820 INFO:teuthology.orchestra.run.smithi161.stdout:622 trunc from 0xd205214 to 0xc95a3ee 2024-09-21T15:07:33.824 INFO:teuthology.orchestra.run.smithi161.stdout:539 write 0x53ce617 thru 0x53db121 (0xcb0b bytes) 2024-09-21T15:07:33.832 INFO:teuthology.orchestra.run.smithi161.stdout:914 writesame 0x36cfdff thru 0x36d918a data_size 0x85(0x938c bytes) 2024-09-21T15:07:33.839 INFO:teuthology.orchestra.run.smithi161.stdout:540 writesame 0x7e86b3 thru 0x7f287c data_size 0x3b(0xa1ca bytes) 2024-09-21T15:07:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:541 trunc from 0xbd725ee to 0x80df2d9 2024-09-21T15:07:33.874 INFO:teuthology.orchestra.run.smithi161.stdout:623 clone 6 order 21 su 16384 sc 7 2024-09-21T15:07:33.885 INFO:teuthology.orchestra.run.smithi161.stdout:1036 write 0xe744178 thru 0xe74efe0 (0xae69 bytes) 2024-09-21T15:07:33.886 INFO:teuthology.orchestra.run.smithi161.stdout:915 writesame 0xc62927e thru 0xc62b7cd data_size 0xc(0x2550 bytes) 2024-09-21T15:07:33.897 INFO:teuthology.orchestra.run.smithi161.stdout:916 punch from 0x1d44e20 to 0x1d4b0b1, (0x6291 bytes) 2024-09-21T15:07:33.897 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:33.897 INFO:teuthology.orchestra.run.smithi161.stdout:919 writesame 0xb097d1f thru 0xb09e6c5 data_size 0x25(0x69a7 bytes) 2024-09-21T15:07:33.907 INFO:teuthology.orchestra.run.smithi161.stdout:1037 write 0x9093a51 thru 0x9094e22 (0x13d2 bytes) 2024-09-21T15:07:33.910 INFO:teuthology.orchestra.run.smithi161.stdout:920 writesame 0x80ad6c4 thru 0x80bc852 data_size 0x3(0xf18f bytes) 2024-09-21T15:07:33.913 INFO:teuthology.orchestra.run.smithi161.stdout:542 writesame 0x60f9c57 thru 0x6106ebd data_size 0x1(0xd267 bytes) 2024-09-21T15:07:33.916 INFO:teuthology.orchestra.run.smithi161.stdout:1038 trunc from 0xe74efe1 to 0xb85a6d3 2024-09-21T15:07:33.931 INFO:teuthology.orchestra.run.smithi161.stdout:921 write 0xa76b5fe thru 0xa770bde (0x55e1 bytes) 2024-09-21T15:07:33.949 INFO:teuthology.orchestra.run.smithi161.stdout:922 read 0x2927b48 thru 0x29314cd (0x9986 bytes) 2024-09-21T15:07:33.963 INFO:teuthology.orchestra.run.smithi161.stdout:543 trunc from 0x80df2d9 to 0x3eb913d 2024-09-21T15:07:33.967 INFO:teuthology.orchestra.run.smithi161.stdout:1040 punch from 0x92c5d89 to 0x92d2913, (0xcb8a bytes) 2024-09-21T15:07:33.967 INFO:teuthology.orchestra.run.smithi161.stdout:1041 write 0x7f4db43 thru 0x7f56841 (0x8cff bytes) 2024-09-21T15:07:33.971 INFO:teuthology.orchestra.run.smithi161.stdout:923 trunc from 0xc62b7ce to 0x142a32e 2024-09-21T15:07:33.979 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.008 INFO:teuthology.orchestra.run.smithi161.stdout:1045 write 0xc24d4de thru 0xc25a392 (0xceb5 bytes) 2024-09-21T15:07:34.017 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #8, image image_cluster1.client.mirror.3-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent9 2024-09-21T15:07:34.021 INFO:teuthology.orchestra.run.smithi161.stdout:1046 write 0x9be1c3a thru 0x9be4dbf (0x3186 bytes) 2024-09-21T15:07:34.026 INFO:teuthology.orchestra.run.smithi161.stdout:1047 read 0xb75507b thru 0xb759dc6 (0x4d4c bytes) 2024-09-21T15:07:34.026 INFO:teuthology.orchestra.run.smithi161.stdout:1049 punch from 0x9a8001a to 0x9a86c15, (0x6bfb bytes) 2024-09-21T15:07:34.058 INFO:teuthology.orchestra.run.smithi161.stdout:925 writesame 0x743d8b3 thru 0x744a060 data_size 0x3d(0xc7ae bytes) 2024-09-21T15:07:34.065 INFO:teuthology.orchestra.run.smithi161.stdout:544 write 0xe6e8bc7 thru 0xe6ec18e (0x35c8 bytes) 2024-09-21T15:07:34.070 INFO:teuthology.orchestra.run.smithi161.stdout:1050 writesame 0xe6be4b7 thru 0xe6bf800 data_size 0x3(0x134a bytes) 2024-09-21T15:07:34.074 INFO:teuthology.orchestra.run.smithi161.stdout:545 punch from 0x6be940b to 0x6bf8082, (0xec77 bytes) 2024-09-21T15:07:34.074 INFO:teuthology.orchestra.run.smithi161.stdout:547 write 0xdc5102c thru 0xdc51a09 (0x9de bytes) 2024-09-21T15:07:34.076 INFO:teuthology.orchestra.run.smithi161.stdout:1053 read 0xa85d819 thru 0xa86adb0 (0xd598 bytes) 2024-09-21T15:07:34.076 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.084 INFO:teuthology.orchestra.run.smithi161.stdout:548 write 0x52c4852 thru 0x52ceb65 (0xa314 bytes) 2024-09-21T15:07:34.097 INFO:teuthology.orchestra.run.smithi161.stdout:1056 trunc from 0xe6bf801 to 0x2199646 2024-09-21T15:07:34.104 INFO:teuthology.orchestra.run.smithi161.stdout:549 read 0x191fab1 thru 0x19225ff (0x2b4f bytes) 2024-09-21T15:07:34.104 INFO:teuthology.orchestra.run.smithi161.stdout:551 punch from 0x46c2f1a to 0x46ce4a8, (0xb58e bytes) 2024-09-21T15:07:34.104 INFO:teuthology.orchestra.run.smithi161.stdout:552 read 0xd4e0ef thru 0xd54664 (0x6576 bytes) 2024-09-21T15:07:34.105 INFO:teuthology.orchestra.run.smithi161.stdout:926 write 0xd7e4d9e thru 0xd7e5d5c (0xfbf bytes) 2024-09-21T15:07:34.114 INFO:teuthology.orchestra.run.smithi161.stdout:928 write 0x71bb213 thru 0x71c7093 (0xbe81 bytes) 2024-09-21T15:07:34.124 INFO:teuthology.orchestra.run.smithi161.stdout:645 write 0x61d5e4 thru 0x627bd4 (0xa5f1 bytes) 2024-09-21T15:07:34.127 INFO:teuthology.orchestra.run.smithi161.stdout:929 read 0x63e7c06 thru 0x63ed181 (0x557c bytes) 2024-09-21T15:07:34.132 INFO:teuthology.orchestra.run.smithi161.stdout:553 writesame 0xeceb9ba thru 0xecf0587 data_size 0x1f(0x4bce bytes) 2024-09-21T15:07:34.135 INFO:teuthology.orchestra.run.smithi161.stdout:555 write 0x1ce3234 thru 0x1ceba9f (0x886c bytes) 2024-09-21T15:07:34.139 INFO:teuthology.orchestra.run.smithi161.stdout:930 trunc from 0xd7e5d5d to 0x64f6578 2024-09-21T15:07:34.141 INFO:teuthology.orchestra.run.smithi161.stdout:1059 punch from 0x50bfb9 to 0x513cbc, (0x7d03 bytes) 2024-09-21T15:07:34.141 INFO:teuthology.orchestra.run.smithi161.stdout:1060 punch from 0xf4e5ea to 0xf5276a, (0x4180 bytes) 2024-09-21T15:07:34.143 INFO:teuthology.orchestra.run.smithi161.stdout:557 read 0x867e1d2 thru 0x8680666 (0x2495 bytes) 2024-09-21T15:07:34.143 INFO:teuthology.orchestra.run.smithi161.stdout:558 write 0xe26ba6f thru 0xe275b02 (0xa094 bytes) 2024-09-21T15:07:34.183 INFO:teuthology.orchestra.run.smithi161.stdout:559 trunc from 0xecf0588 to 0x7ed1c77 2024-09-21T15:07:34.203 INFO:teuthology.orchestra.run.smithi161.stdout:1061 writesame 0xafb521d thru 0xafbc92a data_size 0x31(0x770e bytes) 2024-09-21T15:07:34.203 INFO:teuthology.orchestra.run.smithi161.stdout:932 read 0x4cb713b thru 0x4cbb856 (0x471c bytes) 2024-09-21T15:07:34.203 INFO:teuthology.orchestra.run.smithi161.stdout:933 writesame 0x13da6cf thru 0x13de4be data_size 0x4(0x3df0 bytes) 2024-09-21T15:07:34.207 INFO:teuthology.orchestra.run.smithi161.stdout:1063 write 0x376f882 thru 0x377d4c3 (0xdc42 bytes) 2024-09-21T15:07:34.213 INFO:teuthology.orchestra.run.smithi161.stdout:935 read 0x2746973 thru 0x274efcf (0x865d bytes) 2024-09-21T15:07:34.215 INFO:teuthology.orchestra.run.smithi161.stdout:936 writesame 0x61da70a thru 0x61e802e data_size 0x1(0xd925 bytes) 2024-09-21T15:07:34.216 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.216 INFO:teuthology.orchestra.run.smithi161.stdout:1066 writesame 0x69366fb thru 0x6936936 data_size 0x1(0x23c bytes) 2024-09-21T15:07:34.228 INFO:teuthology.orchestra.run.smithi161.stdout:1067 punch from 0x4a0e3d7 to 0x4a1e1c8, (0xfdf1 bytes) 2024-09-21T15:07:34.228 INFO:teuthology.orchestra.run.smithi161.stdout:1068 read 0x141e572 thru 0x1421acb (0x355a bytes) 2024-09-21T15:07:34.229 INFO:teuthology.orchestra.run.smithi161.stdout:1069 trunc from 0xafbc92b to 0xae30356 2024-09-21T15:07:34.233 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.233 INFO:teuthology.orchestra.run.smithi161.stdout:561 read 0x6b6f235 thru 0x6b75fe5 (0x6db1 bytes) 2024-09-21T15:07:34.233 INFO:teuthology.orchestra.run.smithi161.stdout:563 punch from 0x120e44b to 0x1219821, (0xb3d6 bytes) 2024-09-21T15:07:34.233 INFO:teuthology.orchestra.run.smithi161.stdout:646 writesame 0xcba00aa thru 0xcba28dc data_size 0x1(0x2833 bytes) 2024-09-21T15:07:34.236 INFO:teuthology.orchestra.run.smithi161.stdout:648 writesame 0x3f5382d thru 0x3f5c558 data_size 0x82(0x8d2c bytes) 2024-09-21T15:07:34.254 INFO:teuthology.orchestra.run.smithi161.stdout:565 trunc from 0x7ed1c77 to 0x1873f4 2024-09-21T15:07:34.257 INFO:teuthology.orchestra.run.smithi161.stdout:937 read 0x148d06c thru 0x148ea7c (0x1a11 bytes) 2024-09-21T15:07:34.267 INFO:teuthology.orchestra.run.smithi161.stdout:649 write 0x851d2c9 thru 0x8523229 (0x5f61 bytes) 2024-09-21T15:07:34.270 INFO:teuthology.orchestra.run.smithi161.stdout:938 trunc from 0x64f6578 to 0x3f4e3d 2024-09-21T15:07:34.285 INFO:teuthology.orchestra.run.smithi161.stdout:1070 punch from 0x82a68e7 to 0x82a835a, (0x1a73 bytes) 2024-09-21T15:07:34.285 INFO:teuthology.orchestra.run.smithi161.stdout:1072 punch from 0xa524dee to 0xa52eaf2, (0x9d04 bytes) 2024-09-21T15:07:34.286 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.286 INFO:teuthology.orchestra.run.smithi161.stdout:1074 trunc from 0xae30356 to 0xaca10bd 2024-09-21T15:07:34.302 INFO:teuthology.orchestra.run.smithi161.stdout:650 writesame 0xa681481 thru 0xa684bcf data_size 0x1(0x374f bytes) 2024-09-21T15:07:34.328 INFO:teuthology.orchestra.run.smithi161.stdout:651 read 0x6cba7ad thru 0x6cbc9bb (0x220f bytes) 2024-09-21T15:07:34.330 INFO:teuthology.orchestra.run.smithi161.stdout:1075 write 0x994a241 thru 0x994b8de (0x169e bytes) 2024-09-21T15:07:34.334 INFO:teuthology.orchestra.run.smithi161.stdout:939 read 0x226104 thru 0x23224f (0xc14c bytes) 2024-09-21T15:07:34.335 INFO:teuthology.orchestra.run.smithi161.stdout:940 punch from 0x39a4a2 to 0x3a3c17, (0x9775 bytes) 2024-09-21T15:07:34.335 INFO:teuthology.orchestra.run.smithi161.stdout:941 punch from 0x11d9f5 to 0x1282e4, (0xa8ef bytes) 2024-09-21T15:07:34.335 INFO:teuthology.orchestra.run.smithi161.stdout:1076 read 0x97858b6 thru 0x9792635 (0xcd80 bytes) 2024-09-21T15:07:34.343 INFO:teuthology.orchestra.run.smithi161.stdout:653 trunc from 0xcba28dd to 0x6c9ba0d 2024-09-21T15:07:34.388 INFO:teuthology.orchestra.run.smithi161.stdout:568 write 0x86a5e9e thru 0x86adff5 (0x8158 bytes) 2024-09-21T15:07:34.411 INFO:teuthology.orchestra.run.smithi161.stdout:1077 writesame 0xb221b66 thru 0xb22c29f data_size 0xf(0xa73a bytes) 2024-09-21T15:07:34.415 INFO:teuthology.orchestra.run.smithi161.stdout:944 write 0xb6e50cf thru 0xb6f2e58 (0xdd8a bytes) 2024-09-21T15:07:34.417 INFO:teuthology.orchestra.run.smithi161.stdout:1079 write 0x16c4e10 thru 0x16c7356 (0x2547 bytes) 2024-09-21T15:07:34.424 INFO:teuthology.orchestra.run.smithi161.stdout:569 write 0x214d670 thru 0x21568ab (0x923c bytes) 2024-09-21T15:07:34.432 INFO:teuthology.orchestra.run.smithi161.stdout:1081 writesame 0x52abead thru 0x52babe3 data_size 0x1(0xed37 bytes) 2024-09-21T15:07:34.454 INFO:teuthology.orchestra.run.smithi161.stdout:945 trunc from 0xb6f2e59 to 0x35419cd 2024-09-21T15:07:34.474 INFO:teuthology.orchestra.run.smithi161.stdout:654 read 0x3d2cf4e thru 0x3d37e50 (0xaf03 bytes) 2024-09-21T15:07:34.475 INFO:teuthology.orchestra.run.smithi161.stdout:570 read 0x6563923 thru 0x65698f8 (0x5fd6 bytes) 2024-09-21T15:07:34.475 INFO:teuthology.orchestra.run.smithi161.stdout:571 write 0x6c1e9c1 thru 0x6c2aff2 (0xc632 bytes) 2024-09-21T15:07:34.479 INFO:teuthology.orchestra.run.smithi161.stdout:1082 trunc from 0xb22c2a0 to 0x9a21507 2024-09-21T15:07:34.489 INFO:teuthology.orchestra.run.smithi161.stdout:572 read 0x23b2072 thru 0x23bcd35 (0xacc4 bytes) 2024-09-21T15:07:34.489 INFO:teuthology.orchestra.run.smithi161.stdout:574 read 0x372aeea thru 0x3733396 (0x84ad bytes) 2024-09-21T15:07:34.512 INFO:teuthology.orchestra.run.smithi161.stdout:655 writesame 0xce27b03 thru 0xce3327a data_size 0x98(0xb778 bytes) 2024-09-21T15:07:34.516 INFO:teuthology.orchestra.run.smithi161.stdout:946 trunc from 0x35419cd to 0x4c13633 2024-09-21T15:07:34.520 INFO:teuthology.orchestra.run.smithi161.stdout:575 write 0x8adea90 thru 0x8aee64c (0xfbbd bytes) 2024-09-21T15:07:34.521 INFO:teuthology.orchestra.run.smithi161.stdout:1083 trunc from 0x9a21507 to 0xdcaa7c5 2024-09-21T15:07:34.526 INFO:teuthology.orchestra.run.smithi161.stdout:661 trunc from 0xce3327b to 0x7b07be3 2024-09-21T15:07:34.533 INFO:teuthology.orchestra.run.smithi161.stdout:577 punch from 0x4355e90 to 0x43650a8, (0xf218 bytes) 2024-09-21T15:07:34.533 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.541 INFO:teuthology.orchestra.run.smithi161.stdout:947 trunc from 0x4c13633 to 0x76f4c57 2024-09-21T15:07:34.544 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.545 INFO:teuthology.orchestra.run.smithi161.stdout:1085 read 0xab8f565 thru 0xab9cb7f (0xd61b bytes) 2024-09-21T15:07:34.545 INFO:teuthology.orchestra.run.smithi161.stdout:1086 write 0x49b0d17 thru 0x49bea53 (0xdd3d bytes) 2024-09-21T15:07:34.553 INFO:teuthology.orchestra.run.smithi161.stdout:662 punch from 0x156f93 to 0x162aa4, (0xbb11 bytes) 2024-09-21T15:07:34.553 INFO:teuthology.orchestra.run.smithi161.stdout:663 write 0x2488622 thru 0x24974b7 (0xee96 bytes) 2024-09-21T15:07:34.556 INFO:teuthology.orchestra.run.smithi161.stdout:1087 read 0x7a459de thru 0x7a4e30a (0x892d bytes) 2024-09-21T15:07:34.558 INFO:teuthology.orchestra.run.smithi161.stdout:1088 punch from 0xdb6b170 to 0xdb7ac3a, (0xfaca bytes) 2024-09-21T15:07:34.558 INFO:teuthology.orchestra.run.smithi161.stdout:1089 punch from 0x46762c3 to 0x467afed, (0x4d2a bytes) 2024-09-21T15:07:34.558 INFO:teuthology.orchestra.run.smithi161.stdout:1090 punch from 0x3b665e9 to 0x3b723b0, (0xbdc7 bytes) 2024-09-21T15:07:34.558 INFO:teuthology.orchestra.run.smithi161.stdout:1091 writesame 0x4945f36 thru 0x494707b data_size 0x1(0x1146 bytes) 2024-09-21T15:07:34.590 INFO:teuthology.orchestra.run.smithi161.stdout:1092 read 0x73cac45 thru 0x73cc391 (0x174d bytes) 2024-09-21T15:07:34.591 INFO:teuthology.orchestra.run.smithi161.stdout:1093 writesame 0xc194dc9 thru 0xc19e13b data_size 0x1(0x9373 bytes) 2024-09-21T15:07:34.591 INFO:teuthology.orchestra.run.smithi161.stdout:948 trunc from 0x76f4c57 to 0x3daf2bf 2024-09-21T15:07:34.595 INFO:teuthology.orchestra.run.smithi161.stdout:579 write 0xd73ad12 thru 0xd741842 (0x6b31 bytes) 2024-09-21T15:07:34.603 INFO:teuthology.orchestra.run.smithi161.stdout:664 read 0x2cab35a thru 0x2cb4133 (0x8dda bytes) 2024-09-21T15:07:34.604 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.612 INFO:teuthology.orchestra.run.smithi161.stdout:581 write 0x6e68a40 thru 0x6e6ef9e (0x655f bytes) 2024-09-21T15:07:34.631 INFO:teuthology.orchestra.run.smithi161.stdout:583 write 0x7a9e5fe thru 0x7aa5c21 (0x7624 bytes) 2024-09-21T15:07:34.636 INFO:teuthology.orchestra.run.smithi161.stdout:1094 punch from 0x99230f2 to 0x9924d62, (0x1c70 bytes) 2024-09-21T15:07:34.643 INFO:teuthology.orchestra.run.smithi161.stdout:584 punch from 0x4354c83 to 0x4361e96, (0xd213 bytes) 2024-09-21T15:07:34.643 INFO:teuthology.orchestra.run.smithi161.stdout:585 clone 7 order 20 su 8192 sc 10 2024-09-21T15:07:34.649 INFO:teuthology.orchestra.run.smithi161.stdout:667 write 0xe4e13fa thru 0xe4eca9b (0xb6a2 bytes) 2024-09-21T15:07:34.657 INFO:teuthology.orchestra.run.smithi161.stdout:1095 trunc from 0xdcaa7c5 to 0x7bfac9c 2024-09-21T15:07:34.660 INFO:teuthology.orchestra.run.smithi161.stdout:668 punch from 0xa255c4b to 0xa2594cd, (0x3882 bytes) 2024-09-21T15:07:34.660 INFO:teuthology.orchestra.run.smithi161.stdout:669 write 0x7b5152d thru 0x7b5cf62 (0xba36 bytes) 2024-09-21T15:07:34.674 INFO:teuthology.orchestra.run.smithi161.stdout:671 writesame 0x7c2d4ac thru 0x7c3d300 data_size 0xb(0xfe55 bytes) 2024-09-21T15:07:34.686 INFO:teuthology.orchestra.run.smithi161.stdout:672 punch from 0x6036890 to 0x603c473, (0x5be3 bytes) 2024-09-21T15:07:34.686 INFO:teuthology.orchestra.run.smithi161.stdout:673 read 0xe1af1b7 thru 0xe1b33c2 (0x420c bytes) 2024-09-21T15:07:34.686 INFO:teuthology.orchestra.run.smithi161.stdout:678 read 0xcf8bda1 thru 0xcf8f334 (0x3594 bytes) 2024-09-21T15:07:34.687 INFO:teuthology.orchestra.run.smithi161.stdout:680 punch from 0xd786953 to 0xd791e32, (0xb4df bytes) 2024-09-21T15:07:34.687 INFO:teuthology.orchestra.run.smithi161.stdout:681 clone 11 order 18 su 2048 sc 10 2024-09-21T15:07:34.687 INFO:teuthology.orchestra.run.smithi161.stdout:951 writesame 0xbbec5e8 thru 0xbbee566 data_size 0x1(0x1f7f bytes) 2024-09-21T15:07:34.707 INFO:teuthology.orchestra.run.smithi161.stdout:952 trunc from 0xbbee567 to 0x3eef101 2024-09-21T15:07:34.756 INFO:teuthology.orchestra.run.smithi161.stdout:1096 write 0xd1c5db5 thru 0xd1c6f55 (0x11a1 bytes) 2024-09-21T15:07:34.772 INFO:teuthology.orchestra.run.smithi161.stdout:1097 write 0x2a0d8cb thru 0x2a0fc23 (0x2359 bytes) 2024-09-21T15:07:34.778 INFO:teuthology.orchestra.run.smithi161.stdout:1098 write 0x6ca5abf thru 0x6cb2ffb (0xd53d bytes) 2024-09-21T15:07:34.785 INFO:teuthology.orchestra.run.smithi161.stdout:953 writesame 0x6e69537 thru 0x6e7576f data_size 0x1(0xc239 bytes) 2024-09-21T15:07:34.788 INFO:teuthology.orchestra.run.smithi161.stdout:954 write 0x13cbf7c thru 0x13cdfb3 (0x2038 bytes) 2024-09-21T15:07:34.789 INFO:teuthology.orchestra.run.smithi161.stdout:1100 trunc from 0xd1c6f56 to 0xe1eae9f 2024-09-21T15:07:34.794 INFO:teuthology.orchestra.run.smithi161.stdout:955 read 0x24d94ef thru 0x24df679 (0x618b bytes) 2024-09-21T15:07:34.795 INFO:teuthology.orchestra.run.smithi161.stdout:956 write 0x309c15d thru 0x30a99cd (0xd871 bytes) 2024-09-21T15:07:34.803 INFO:teuthology.orchestra.run.smithi161.stdout:957 punch from 0x2cc32e0 to 0x2cd08fc, (0xd61c bytes) 2024-09-21T15:07:34.803 INFO:teuthology.orchestra.run.smithi161.stdout:958 write 0xde6a45 thru 0xdf06c2 (0x9c7e bytes) 2024-09-21T15:07:34.805 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.0-clone5 2024-09-21T15:07:34.806 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone5 from 0xc95a3ee (overlap 0x5491f6) to 0x32bdfa 2024-09-21T15:07:34.810 INFO:teuthology.orchestra.run.smithi161.stdout:960 punch from 0x689d2f8 to 0x68a1087, (0x3d8f bytes) 2024-09-21T15:07:34.810 INFO:teuthology.orchestra.run.smithi161.stdout:961 read 0x2f8c4b8 thru 0x2f8ca5b (0x5a4 bytes) 2024-09-21T15:07:34.811 INFO:teuthology.orchestra.run.smithi161.stdout:962 read 0x5ce82af thru 0x5cee913 (0x6665 bytes) 2024-09-21T15:07:34.811 INFO:teuthology.orchestra.run.smithi161.stdout:963 write 0x542197b thru 0x5428d28 (0x73ae bytes) 2024-09-21T15:07:34.818 INFO:teuthology.orchestra.run.smithi161.stdout:1101 write 0x467e37e thru 0x4686356 (0x7fd9 bytes) 2024-09-21T15:07:34.823 INFO:teuthology.orchestra.run.smithi161.stdout:964 read 0x5d61695 thru 0x5d61924 (0x290 bytes) 2024-09-21T15:07:34.823 INFO:teuthology.orchestra.run.smithi161.stdout:967 write 0x32d76a0 thru 0x32dd86a (0x61cb bytes) 2024-09-21T15:07:34.828 INFO:teuthology.orchestra.run.smithi161.stdout:1102 punch from 0x9ba87e2 to 0x9bb6a2c, (0xe24a bytes) 2024-09-21T15:07:34.828 INFO:teuthology.orchestra.run.smithi161.stdout:1104 write 0x5639685 thru 0x563a430 (0xdac bytes) 2024-09-21T15:07:34.837 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.837 INFO:teuthology.orchestra.run.smithi161.stdout:969 write 0xb05de2 thru 0xb0a672 (0x4891 bytes) 2024-09-21T15:07:34.839 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.839 INFO:teuthology.orchestra.run.smithi161.stdout:1106 read 0xc8b2397 thru 0xc8b7bb5 (0x581f bytes) 2024-09-21T15:07:34.839 INFO:teuthology.orchestra.run.smithi161.stdout:1109 read 0x7154299 thru 0x715be6e (0x7bd6 bytes) 2024-09-21T15:07:34.840 INFO:teuthology.orchestra.run.smithi161.stdout:1111 punch from 0x41316ed to 0x413856d, (0x6e80 bytes) 2024-09-21T15:07:34.840 INFO:teuthology.orchestra.run.smithi161.stdout:1112 read 0x32d206a thru 0x32d70d0 (0x5067 bytes) 2024-09-21T15:07:34.842 INFO:teuthology.orchestra.run.smithi161.stdout:1114 read 0x820545c thru 0x820726b (0x1e10 bytes) 2024-09-21T15:07:34.842 INFO:teuthology.orchestra.run.smithi161.stdout:1116 read 0x85979fc thru 0x85a33d0 (0xb9d5 bytes) 2024-09-21T15:07:34.843 INFO:teuthology.orchestra.run.smithi161.stdout:970 punch from 0x297112d to 0x297ffc7, (0xee9a bytes) 2024-09-21T15:07:34.843 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.843 INFO:teuthology.orchestra.run.smithi161.stdout:973 punch from 0x41f6824 to 0x4203e5a, (0xd636 bytes) 2024-09-21T15:07:34.843 INFO:teuthology.orchestra.run.smithi161.stdout:974 read 0x227e143 thru 0x2285689 (0x7547 bytes) 2024-09-21T15:07:34.843 INFO:teuthology.orchestra.run.smithi161.stdout:1117 writesame 0x5c3faf3 thru 0x5c42d12 data_size 0x10(0x3220 bytes) 2024-09-21T15:07:34.849 INFO:teuthology.orchestra.run.smithi161.stdout:1118 write 0x5d011ac thru 0x5d047eb (0x3640 bytes) 2024-09-21T15:07:34.854 INFO:teuthology.orchestra.run.smithi161.stdout:975 trunc from 0x6e75770 to 0xbfbbab0 2024-09-21T15:07:34.855 INFO:teuthology.orchestra.run.smithi161.stdout:1120 read 0x2186819 thru 0x218c72a (0x5f12 bytes) 2024-09-21T15:07:34.856 INFO:teuthology.orchestra.run.smithi161.stdout:1122 punch from 0x528f05f to 0x5294719, (0x56ba bytes) 2024-09-21T15:07:34.856 INFO:teuthology.orchestra.run.smithi161.stdout:1124 read 0xdffc348 thru 0xe003160 (0x6e19 bytes) 2024-09-21T15:07:34.856 INFO:teuthology.orchestra.run.smithi161.stdout:1125 read 0xa33e737 thru 0xa341aa5 (0x336f bytes) 2024-09-21T15:07:34.856 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.893 INFO:teuthology.orchestra.run.smithi161.stdout:976 read 0x7201b71 thru 0x72059e7 (0x3e77 bytes) 2024-09-21T15:07:34.893 INFO:teuthology.orchestra.run.smithi161.stdout:979 clone 5 order 24 su 4194304 sc 15 2024-09-21T15:07:34.915 INFO:teuthology.orchestra.run.smithi161.stdout:1128 writesame 0xe8b77be thru 0xe8b9928 data_size 0x5(0x216b bytes) 2024-09-21T15:07:34.917 INFO:teuthology.orchestra.run.smithi161.stdout:1129 read 0x726ac7d thru 0x727a2f9 (0xf67d bytes) 2024-09-21T15:07:34.918 INFO:teuthology.orchestra.run.smithi161.stdout:1130 read 0x1c97b1e thru 0x1ca0cca (0x91ad bytes) 2024-09-21T15:07:34.921 INFO:teuthology.orchestra.run.smithi161.stdout:1131 write 0x3463ee3 thru 0x346da16 (0x9b34 bytes) 2024-09-21T15:07:34.925 INFO:teuthology.orchestra.run.smithi161.stdout:1132 punch from 0x934201b to 0x934ad37, (0x8d1c bytes) 2024-09-21T15:07:34.927 INFO:teuthology.orchestra.run.smithi161.stdout:1133 write 0xa24908 thru 0xa32aa8 (0xe1a1 bytes) 2024-09-21T15:07:34.934 INFO:teuthology.orchestra.run.smithi161.stdout:1134 write 0xd83cd36 thru 0xd83e420 (0x16eb bytes) 2024-09-21T15:07:34.947 INFO:teuthology.orchestra.run.smithi161.stdout:1135 trunc from 0xe8b9929 to 0xc36dcb2 2024-09-21T15:07:34.980 INFO:teuthology.orchestra.run.smithi161.stdout:1136 read 0x407f20d thru 0x4080922 (0x1716 bytes) 2024-09-21T15:07:34.980 INFO:teuthology.orchestra.run.smithi161.stdout:1137 write 0x5234c1 thru 0x52a35a (0x6e9a bytes) 2024-09-21T15:07:34.989 INFO:teuthology.orchestra.run.smithi161.stdout:1138 punch from 0x2d9dab6 to 0x2da5f1f, (0x8469 bytes) 2024-09-21T15:07:34.989 INFO:teuthology.orchestra.run.smithi161.stdout:1139 read 0x52fb619 thru 0x53095a2 (0xdf8a bytes) 2024-09-21T15:07:34.990 INFO:teuthology.orchestra.run.smithi161.stdout:1141 read 0x1f71147 thru 0x1f749ea (0x38a4 bytes) 2024-09-21T15:07:34.990 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.990 INFO:teuthology.orchestra.run.smithi161.stdout:1144 read 0xaad0f3c thru 0xaaddcf5 (0xcdba bytes) 2024-09-21T15:07:34.990 INFO:teuthology.orchestra.run.smithi161.stdout:1145 writesame 0xaa8b132 thru 0xaa8bb2d data_size 0xc(0x9fc bytes) 2024-09-21T15:07:34.999 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:34.999 INFO:teuthology.orchestra.run.smithi161.stdout:1148 read 0xbd0a7c2 thru 0xbd12228 (0x7a67 bytes) 2024-09-21T15:07:34.999 INFO:teuthology.orchestra.run.smithi161.stdout:1149 read 0x64fef0f thru 0x650dc99 (0xed8b bytes) 2024-09-21T15:07:35.000 INFO:teuthology.orchestra.run.smithi161.stdout:1150 read 0xa50700a thru 0xa50c8d6 (0x58cd bytes) 2024-09-21T15:07:35.000 INFO:teuthology.orchestra.run.smithi161.stdout:1151 write 0x1f520a1 thru 0x1f53e1a (0x1d7a bytes) 2024-09-21T15:07:35.001 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #4, image image_cluster1.client.mirror.4-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent5 2024-09-21T15:07:35.008 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.009 INFO:teuthology.orchestra.run.smithi161.stdout:1155 read 0x80bc5d thru 0x81467b (0x8a1f bytes) 2024-09-21T15:07:35.009 INFO:teuthology.orchestra.run.smithi161.stdout:1156 write 0xac1d3c7 thru 0xac284e1 (0xb11b bytes) 2024-09-21T15:07:35.024 INFO:teuthology.orchestra.run.smithi161.stdout:1157 writesame 0x46d1263 thru 0x46d43f1 data_size 0x1(0x318f bytes) 2024-09-21T15:07:35.038 INFO:teuthology.orchestra.run.smithi161.stdout:1158 punch from 0x866e94b to 0x8679521, (0xabd6 bytes) 2024-09-21T15:07:35.038 INFO:teuthology.orchestra.run.smithi161.stdout:1159 write 0x81582dd thru 0x815fb90 (0x78b4 bytes) 2024-09-21T15:07:35.044 INFO:teuthology.orchestra.run.smithi161.stdout:1160 read 0x75be6d0 thru 0x75c3640 (0x4f71 bytes) 2024-09-21T15:07:35.045 INFO:teuthology.orchestra.run.smithi161.stdout:1161 read 0x558b55a thru 0x5598a3f (0xd4e6 bytes) 2024-09-21T15:07:35.046 INFO:teuthology.orchestra.run.smithi161.stdout:1162 writesame 0x79eb873 thru 0x79f2d86 data_size 0x4(0x7514 bytes) 2024-09-21T15:07:35.055 INFO:teuthology.orchestra.run.smithi161.stdout:1163 read 0xbc2cc2c thru 0xbc3b13e (0xe513 bytes) 2024-09-21T15:07:35.056 INFO:teuthology.orchestra.run.smithi161.stdout:1164 write 0x9d7ca94 thru 0x9d7e3bd (0x192a bytes) 2024-09-21T15:07:35.061 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.061 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.061 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.062 INFO:teuthology.orchestra.run.smithi161.stdout:1170 trunc from 0xc36dcb2 to 0xbf6b4ca 2024-09-21T15:07:35.070 INFO:teuthology.orchestra.run.smithi161.stdout:624 trunc from 0xc95a3ee to 0x148d2f8 2024-09-21T15:07:35.077 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #4, image image_cluster1.client.mirror.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent5 2024-09-21T15:07:35.102 INFO:teuthology.orchestra.run.smithi161.stdout:1172 read 0xbc91733 thru 0xbc97569 (0x5e37 bytes) 2024-09-21T15:07:35.109 INFO:teuthology.orchestra.run.smithi161.stdout:1174 writesame 0x5e1ad81 thru 0x5e23c50 data_size 0x14(0x8ed0 bytes) 2024-09-21T15:07:35.109 INFO:teuthology.orchestra.run.smithi161.stdout:1175 write 0x842b769 thru 0x84357ad (0xa045 bytes) 2024-09-21T15:07:35.121 INFO:teuthology.orchestra.run.smithi161.stdout:1176 writesame 0x69b519a thru 0x69b7229 data_size 0x8(0x2090 bytes) 2024-09-21T15:07:35.132 INFO:teuthology.orchestra.run.smithi161.stdout:1177 writesame 0x89f6aee thru 0x8a04bce data_size 0x1(0xe0e1 bytes) 2024-09-21T15:07:35.132 INFO:teuthology.orchestra.run.smithi161.stdout:870 writesame 0x653f076 thru 0x6548499 data_size 0x26(0x9424 bytes) 2024-09-21T15:07:35.169 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.170 INFO:teuthology.orchestra.run.smithi161.stdout:1178 read 0x1e38630 thru 0x1e39e2e (0x17ff bytes) 2024-09-21T15:07:35.175 INFO:teuthology.orchestra.run.smithi161.stdout:1179 trunc from 0xbf6b4ca to 0xdbded5a 2024-09-21T15:07:35.182 INFO:teuthology.orchestra.run.smithi161.stdout:871 read 0x6a42aea thru 0x6a4481b (0x1d32 bytes) 2024-09-21T15:07:35.182 INFO:teuthology.orchestra.run.smithi161.stdout:872 write 0x52a15d1 thru 0x52aee5d (0xd88d bytes) 2024-09-21T15:07:35.191 INFO:teuthology.orchestra.run.smithi161.stdout:626 trunc from 0x148d2f8 to 0xeb60e80 2024-09-21T15:07:35.197 INFO:teuthology.orchestra.run.smithi161.stdout:877 read 0x340a417 thru 0x340c6ea (0x22d4 bytes) 2024-09-21T15:07:35.198 INFO:teuthology.orchestra.run.smithi161.stdout:878 write 0x183134d thru 0x18378c2 (0x6576 bytes) 2024-09-21T15:07:35.203 INFO:teuthology.orchestra.run.smithi161.stdout:1180 punch from 0xd4e8495 to 0xd4eb365, (0x2ed0 bytes) 2024-09-21T15:07:35.203 INFO:teuthology.orchestra.run.smithi161.stdout:1181 punch from 0x6924628 to 0x692a85d, (0x6235 bytes) 2024-09-21T15:07:35.203 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xebc8269 2024-09-21T15:07:35.205 INFO:teuthology.orchestra.run.smithi161.stdout:1182 trunc from 0xdbded5a to 0xebc8269 2024-09-21T15:07:35.216 INFO:teuthology.orchestra.run.smithi161.stdout:879 read 0x4448610 thru 0x4458524 (0xff15 bytes) 2024-09-21T15:07:35.217 INFO:teuthology.orchestra.run.smithi161.stdout:629 punch from 0x975ff4a to 0x976135f, (0x1415 bytes) 2024-09-21T15:07:35.217 INFO:teuthology.orchestra.run.smithi161.stdout:630 write 0x123710d thru 0x12422dd (0xb1d1 bytes) 2024-09-21T15:07:35.217 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.221 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.221 INFO:teuthology.orchestra.run.smithi161.stdout:1185 write 0x885a5b2 thru 0x88637b0 (0x91ff bytes) 2024-09-21T15:07:35.228 INFO:teuthology.orchestra.run.smithi161.stdout:631 writesame 0x6cfc92f thru 0x6d01869 data_size 0x1(0x4f3b bytes) 2024-09-21T15:07:35.237 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.237 INFO:teuthology.orchestra.run.smithi161.stdout:1187 read 0xde9acb9 thru 0xdea5171 (0xa4b9 bytes) 2024-09-21T15:07:35.237 INFO:teuthology.orchestra.run.smithi161.stdout:1188 read 0x69abba thru 0x6aa9b3 (0xfdfa bytes) 2024-09-21T15:07:35.240 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.240 INFO:teuthology.orchestra.run.smithi161.stdout:1190 write 0x8b4dd8c thru 0x8b556a3 (0x7918 bytes) 2024-09-21T15:07:35.252 INFO:teuthology.orchestra.run.smithi161.stdout:632 read 0x27172b1 thru 0x271e92a (0x767a bytes) 2024-09-21T15:07:35.253 INFO:teuthology.orchestra.run.smithi161.stdout:1192 writesame 0x86e14b thru 0x87800d data_size 0x1(0x9ec3 bytes) 2024-09-21T15:07:35.263 INFO:teuthology.orchestra.run.smithi161.stdout:883 write 0xe3c3892 thru 0xe3ce510 (0xac7f bytes) 2024-09-21T15:07:35.269 INFO:teuthology.orchestra.run.smithi161.stdout:633 trunc from 0xeb60e80 to 0x6a94b38 2024-09-21T15:07:35.285 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.285 INFO:teuthology.orchestra.run.smithi161.stdout:1194 writesame 0xb4d35fd thru 0xb4ded5e data_size 0x1(0xb762 bytes) 2024-09-21T15:07:35.292 INFO:teuthology.orchestra.run.smithi161.stdout:885 read 0x7867fce thru 0x786c135 (0x4168 bytes) 2024-09-21T15:07:35.293 INFO:teuthology.orchestra.run.smithi161.stdout:886 write 0x402e4df thru 0x403b566 (0xd088 bytes) 2024-09-21T15:07:35.314 INFO:teuthology.orchestra.run.smithi161.stdout:634 clone 7 order 20 su 131072 sc 2 2024-09-21T15:07:35.325 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.325 INFO:teuthology.orchestra.run.smithi161.stdout:1198 punch from 0xac94223 to 0xac98e89, (0x4c66 bytes) 2024-09-21T15:07:35.325 INFO:teuthology.orchestra.run.smithi161.stdout:1199 punch from 0x6673bd to 0x673c18, (0xc85b bytes) 2024-09-21T15:07:35.341 INFO:teuthology.orchestra.run.smithi161.stdout:887 write 0x85980b5 thru 0x85a698f (0xe8db bytes) 2024-09-21T15:07:35.353 INFO:teuthology.orchestra.run.smithi161.stdout:1201 write 0xed774ef thru 0xed845d0 (0xd0e2 bytes) 2024-09-21T15:07:35.366 INFO:teuthology.orchestra.run.smithi161.stdout:1202 trunc from 0xed845d1 to 0xe405ff9 2024-09-21T15:07:35.366 INFO:teuthology.orchestra.run.smithi161.stdout:888 write 0xc8bd714 thru 0xc8be900 (0x11ed bytes) 2024-09-21T15:07:35.374 INFO:teuthology.orchestra.run.smithi161.stdout:889 writesame 0x26f916b thru 0x2702e34 data_size 0xe(0x9cca bytes) 2024-09-21T15:07:35.407 INFO:teuthology.orchestra.run.smithi161.stdout:890 writesame 0xdc1347d thru 0xdc17ef7 data_size 0x1(0x4a7b bytes) 2024-09-21T15:07:35.413 INFO:teuthology.orchestra.run.smithi161.stdout:1203 trunc from 0xe405ff9 to 0x5674cd9 2024-09-21T15:07:35.430 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.430 INFO:teuthology.orchestra.run.smithi161.stdout:893 read 0x974bcb5 thru 0x9755b99 (0x9ee5 bytes) 2024-09-21T15:07:35.431 INFO:teuthology.orchestra.run.smithi161.stdout:894 punch from 0xcf4b660 to 0xcf4befc, (0x89c bytes) 2024-09-21T15:07:35.431 INFO:teuthology.orchestra.run.smithi161.stdout:895 read 0xc23fac6 thru 0xc24566a (0x5ba5 bytes) 2024-09-21T15:07:35.453 INFO:teuthology.orchestra.run.smithi161.stdout:1205 read 0x4256bff thru 0x425f175 (0x8577 bytes) 2024-09-21T15:07:35.454 INFO:teuthology.orchestra.run.smithi161.stdout:896 trunc from 0xe3ce511 to 0x308220e 2024-09-21T15:07:35.454 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.502 INFO:teuthology.orchestra.run.smithi161.stdout:1207 write 0xec5a926 thru 0xec63a01 (0x90dc bytes) 2024-09-21T15:07:35.516 INFO:teuthology.orchestra.run.smithi161.stdout:1210 punch from 0x53c4c52 to 0x53c4e15, (0x1c3 bytes) 2024-09-21T15:07:35.517 INFO:teuthology.orchestra.run.smithi161.stdout:1211 trunc from 0xec63a02 to 0xe3935a0 2024-09-21T15:07:35.521 INFO:teuthology.orchestra.run.smithi161.stdout:898 read 0x2b50cb8 thru 0x2b5ae1a (0xa163 bytes) 2024-09-21T15:07:35.522 INFO:teuthology.orchestra.run.smithi161.stdout:900 punch from 0x4127bc to 0x41e678, (0xbebc bytes) 2024-09-21T15:07:35.522 INFO:teuthology.orchestra.run.smithi161.stdout:901 read 0xc7392d thru 0xc7b77c (0x7e50 bytes) 2024-09-21T15:07:35.546 INFO:teuthology.orchestra.run.smithi161.stdout:1212 write 0x3d62435 thru 0x3d6a339 (0x7f05 bytes) 2024-09-21T15:07:35.553 INFO:teuthology.orchestra.run.smithi161.stdout:1213 writesame 0x1c5d5e5 thru 0x1c6c9e7 data_size 0x1(0xf403 bytes) 2024-09-21T15:07:35.554 INFO:teuthology.orchestra.run.smithi161.stdout:903 write 0x615e677 thru 0x6167c75 (0x95ff bytes) 2024-09-21T15:07:35.578 INFO:teuthology.orchestra.run.smithi161.stdout:905 trunc from 0x6167c76 to 0x9fcb67e 2024-09-21T15:07:35.614 INFO:teuthology.orchestra.run.smithi161.stdout:1214 punch from 0x5591c49 to 0x559ada8, (0x915f bytes) 2024-09-21T15:07:35.614 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.614 INFO:teuthology.orchestra.run.smithi161.stdout:1217 punch from 0x2907eb3 to 0x290d04a, (0x5197 bytes) 2024-09-21T15:07:35.614 INFO:teuthology.orchestra.run.smithi161.stdout:1218 read 0xae5d936 thru 0xae68e45 (0xb510 bytes) 2024-09-21T15:07:35.615 INFO:teuthology.orchestra.run.smithi161.stdout:1221 write 0x5cc024e thru 0x5ccd6e0 (0xd493 bytes) 2024-09-21T15:07:35.634 INFO:teuthology.orchestra.run.smithi161.stdout:1222 writesame 0x27394ca thru 0x273fc45 data_size 0x25(0x677c bytes) 2024-09-21T15:07:35.643 INFO:teuthology.orchestra.run.smithi161.stdout:1223 write 0xd03f8ea thru 0xd048c71 (0x9388 bytes) 2024-09-21T15:07:35.655 INFO:teuthology.orchestra.run.smithi161.stdout:906 punch from 0x1f24f1d to 0x1f2bc81, (0x6d64 bytes) 2024-09-21T15:07:35.656 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.656 INFO:teuthology.orchestra.run.smithi161.stdout:909 read 0x4156fd thru 0x41bc3c (0x6540 bytes) 2024-09-21T15:07:35.656 INFO:teuthology.orchestra.run.smithi161.stdout:911 read 0x9d75c74 thru 0x9d84291 (0xe61e bytes) 2024-09-21T15:07:35.657 INFO:teuthology.orchestra.run.smithi161.stdout:912 writesame 0x2fa27d1 thru 0x2fad2e1 data_size 0x1(0xab11 bytes) 2024-09-21T15:07:35.693 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.701 INFO:teuthology.orchestra.run.smithi161.stdout:914 trunc from 0x9fcb67e to 0xbd87825 2024-09-21T15:07:35.706 INFO:teuthology.orchestra.run.smithi161.stdout:1224 trunc from 0xe3935a0 to 0x5513b67 2024-09-21T15:07:35.738 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.738 INFO:teuthology.orchestra.run.smithi161.stdout:916 read 0x48182a0 thru 0x481f1da (0x6f3b bytes) 2024-09-21T15:07:35.761 INFO:teuthology.orchestra.run.smithi161.stdout:917 trunc from 0xbd87825 to 0x5e2efd 2024-09-21T15:07:35.811 INFO:teuthology.orchestra.run.smithi161.stdout:1225 writesame 0xb24b178 thru 0xb251447 data_size 0x5d(0x62d0 bytes) 2024-09-21T15:07:35.816 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.816 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:35.816 INFO:teuthology.orchestra.run.smithi161.stdout:1229 writesame 0x1bb48d2 thru 0x1bc0c3f data_size 0x5(0xc36e bytes) 2024-09-21T15:07:35.838 INFO:teuthology.orchestra.run.smithi161.stdout:1230 trunc from 0xb251448 to 0xc70e893 2024-09-21T15:07:35.838 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.1-clone4 2024-09-21T15:07:35.844 INFO:teuthology.orchestra.run.smithi161.stdout:919 read 0x1434e1 thru 0x15292c (0xf44c bytes) 2024-09-21T15:07:35.845 INFO:teuthology.orchestra.run.smithi161.stdout:921 read 0x492ee5 thru 0x4a28ee (0xfa0a bytes) 2024-09-21T15:07:35.846 INFO:teuthology.orchestra.run.smithi161.stdout:923 read 0x20519d thru 0x209587 (0x43eb bytes) 2024-09-21T15:07:35.872 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.5-clone6 2024-09-21T15:07:35.881 INFO:teuthology.orchestra.run.smithi161.stdout:924 trunc from 0x5e2efd to 0xe57c561 2024-09-21T15:07:35.887 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone6 from 0x6a94b38 (overlap 0x148d2f8) to 0x0 2024-09-21T15:07:35.897 INFO:teuthology.orchestra.run.smithi161.stdout:1232 trunc from 0xc70e893 to 0xfb5a 2024-09-21T15:07:35.915 INFO:teuthology.orchestra.run.smithi161.stdout:925 write 0xbffcc9c thru 0xc009dab (0xd110 bytes) 2024-09-21T15:07:35.941 INFO:teuthology.orchestra.run.smithi161.stdout:926 read 0x5e70fc6 thru 0x5e76b58 (0x5b93 bytes) 2024-09-21T15:07:35.941 INFO:teuthology.orchestra.run.smithi161.stdout:927 write 0xa0f746b thru 0xa100ecb (0x9a61 bytes) 2024-09-21T15:07:35.979 INFO:teuthology.orchestra.run.smithi161.stdout:1233 trunc from 0xfb5a to 0xdc986af 2024-09-21T15:07:35.987 INFO:teuthology.orchestra.run.smithi161.stdout:928 trunc from 0xe57c561 to 0x28c3346 2024-09-21T15:07:36.002 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone10 from 0xe4eca9c (overlap 0x6c9ba0d) to 0x56e2e70 2024-09-21T15:07:36.009 INFO:teuthology.orchestra.run.smithi161.stdout:1235 read 0x4a38b52 thru 0x4a467d7 (0xdc86 bytes) 2024-09-21T15:07:36.009 INFO:teuthology.orchestra.run.smithi161.stdout:1236 read 0x104582b thru 0x10504fb (0xacd1 bytes) 2024-09-21T15:07:36.038 INFO:teuthology.orchestra.run.smithi161.stdout:1237 write 0xe0235f1 thru 0xe02bdaa (0x87ba bytes) 2024-09-21T15:07:36.042 INFO:teuthology.orchestra.run.smithi161.stdout:930 read 0x181b3a thru 0x18d1f6 (0xb6bd bytes) 2024-09-21T15:07:36.043 INFO:teuthology.orchestra.run.smithi161.stdout:931 punch from 0x9d4c3f to 0x9d713f, (0x2500 bytes) 2024-09-21T15:07:36.047 INFO:teuthology.orchestra.run.smithi161.stdout:1238 write 0xb599441 thru 0xb59c636 (0x31f6 bytes) 2024-09-21T15:07:36.052 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.052 INFO:teuthology.orchestra.run.smithi161.stdout:1243 read 0xaab2076 thru 0xaabb78d (0x9718 bytes) 2024-09-21T15:07:36.061 INFO:teuthology.orchestra.run.smithi161.stdout:932 writesame 0x42d00f0 thru 0x42d4b28 data_size 0x1(0x4a39 bytes) 2024-09-21T15:07:36.063 INFO:teuthology.orchestra.run.smithi161.stdout:933 read 0x3feba22 thru 0x3fef457 (0x3a36 bytes) 2024-09-21T15:07:36.064 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.064 INFO:teuthology.orchestra.run.smithi161.stdout:935 read 0x34c92e8 thru 0x34ce0f2 (0x4e0b bytes) 2024-09-21T15:07:36.072 INFO:teuthology.orchestra.run.smithi161.stdout:1244 trunc from 0xe02bdab to 0x363b5f9 2024-09-21T15:07:36.072 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #3, image image_cluster1.client.mirror.1-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent4 2024-09-21T15:07:36.106 INFO:teuthology.orchestra.run.smithi161.stdout:936 writesame 0xd733374 thru 0xd736695 data_size 0x23(0x3322 bytes) 2024-09-21T15:07:36.109 INFO:teuthology.orchestra.run.smithi161.stdout:1245 writesame 0x96cebb thru 0x971929 data_size 0x25(0x4a6f bytes) 2024-09-21T15:07:36.111 INFO:teuthology.orchestra.run.smithi161.stdout:937 write 0xbd7429a thru 0xbd82c25 (0xe98c bytes) 2024-09-21T15:07:36.122 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.122 INFO:teuthology.orchestra.run.smithi161.stdout:1248 read 0x28ac554 thru 0x28b3935 (0x73e2 bytes) 2024-09-21T15:07:36.122 INFO:teuthology.orchestra.run.smithi161.stdout:1249 write 0x2773488 thru 0x27747f4 (0x136d bytes) 2024-09-21T15:07:36.130 INFO:teuthology.orchestra.run.smithi161.stdout:938 punch from 0x1ec6175 to 0x1ed5a22, (0xf8ad bytes) 2024-09-21T15:07:36.130 INFO:teuthology.orchestra.run.smithi161.stdout:941 write 0xc85b9a thru 0xc903a4 (0xa80b bytes) 2024-09-21T15:07:36.155 INFO:teuthology.orchestra.run.smithi161.stdout:942 trunc from 0xd736696 to 0x9fe4a2e 2024-09-21T15:07:36.174 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #5, image image_cluster1.client.mirror.4-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent6 2024-09-21T15:07:36.189 INFO:teuthology.orchestra.run.smithi161.stdout:943 read 0x8bda334 thru 0x8bdd5e6 (0x32b3 bytes) 2024-09-21T15:07:36.189 INFO:teuthology.orchestra.run.smithi161.stdout:944 write 0x70064b2 thru 0x7014853 (0xe3a2 bytes) 2024-09-21T15:07:36.190 INFO:teuthology.orchestra.run.smithi161.stdout:1250 write 0xd79eb04 thru 0xd79f938 (0xe35 bytes) 2024-09-21T15:07:36.199 INFO:teuthology.orchestra.run.smithi161.stdout:1253 write 0x50fd56b thru 0x510cbfe (0xf694 bytes) 2024-09-21T15:07:36.204 INFO:teuthology.orchestra.run.smithi161.stdout:945 punch from 0x67ebf97 to 0x67f3c7b, (0x7ce4 bytes) 2024-09-21T15:07:36.204 INFO:teuthology.orchestra.run.smithi161.stdout:946 write 0x35e8430 thru 0x35ea68b (0x225c bytes) 2024-09-21T15:07:36.205 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #5, image image_cluster1.client.mirror.5-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent6 2024-09-21T15:07:36.212 INFO:teuthology.orchestra.run.smithi161.stdout:1258 punch from 0x9ceec2f to 0x9cf6f6f, (0x8340 bytes) 2024-09-21T15:07:36.212 INFO:teuthology.orchestra.run.smithi161.stdout:1259 write 0xb72b8b4 thru 0xb7338d1 (0x801e bytes) 2024-09-21T15:07:36.216 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.216 INFO:teuthology.orchestra.run.smithi161.stdout:640 read 0x5763b1c thru 0x5770943 (0xce28 bytes) 2024-09-21T15:07:36.233 INFO:teuthology.orchestra.run.smithi161.stdout:643 read 0x1c4b37d thru 0x1c4bb0a (0x78e bytes) 2024-09-21T15:07:36.233 INFO:teuthology.orchestra.run.smithi161.stdout:644 write 0x30a6cfa thru 0x30abfd6 (0x52dd bytes) 2024-09-21T15:07:36.236 INFO:teuthology.orchestra.run.smithi161.stdout:1260 trunc from 0xd79f939 to 0x2ce6b7e 2024-09-21T15:07:36.247 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.247 INFO:teuthology.orchestra.run.smithi161.stdout:587 punch from 0x6fb136b to 0x6fb98d3, (0x8568 bytes) 2024-09-21T15:07:36.257 INFO:teuthology.orchestra.run.smithi161.stdout:947 write 0xe5db2dc thru 0xe5e5f81 (0xaca6 bytes) 2024-09-21T15:07:36.264 INFO:teuthology.orchestra.run.smithi161.stdout:646 trunc from 0x6a94b38 to 0xabe42e 2024-09-21T15:07:36.265 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #9, image image_cluster1.client.mirror.3-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent10 2024-09-21T15:07:36.268 INFO:teuthology.orchestra.run.smithi161.stdout:588 write 0x2e401e2 thru 0x2e4650b (0x632a bytes) 2024-09-21T15:07:36.300 INFO:teuthology.orchestra.run.smithi161.stdout:948 trunc from 0xe5e5f82 to 0x20b38d9 2024-09-21T15:07:36.304 INFO:teuthology.orchestra.run.smithi161.stdout:589 writesame 0x24753ed thru 0x247d485 data_size 0x1(0x8099 bytes) 2024-09-21T15:07:36.341 INFO:teuthology.orchestra.run.smithi161.stdout:1261 writesame 0xa64a9a2 thru 0xa654ab5 data_size 0x3d(0xa114 bytes) 2024-09-21T15:07:36.341 INFO:teuthology.orchestra.run.smithi161.stdout:682 punch from 0xb54a417 to 0xb553697, (0x9280 bytes) 2024-09-21T15:07:36.355 INFO:teuthology.orchestra.run.smithi161.stdout:590 write 0x41f319a thru 0x41fa307 (0x716e bytes) 2024-09-21T15:07:36.363 INFO:teuthology.orchestra.run.smithi161.stdout:949 trunc from 0x20b38d9 to 0x3dc508 2024-09-21T15:07:36.365 INFO:teuthology.orchestra.run.smithi161.stdout:683 read 0xbf37e04 thru 0xbf47267 (0xf464 bytes) 2024-09-21T15:07:36.366 INFO:teuthology.orchestra.run.smithi161.stdout:684 read 0x9da786a thru 0x9dad221 (0x59b8 bytes) 2024-09-21T15:07:36.366 INFO:teuthology.orchestra.run.smithi161.stdout:685 write 0xc48fdbc thru 0xc49b0d2 (0xb317 bytes) 2024-09-21T15:07:36.379 INFO:teuthology.orchestra.run.smithi161.stdout:591 write 0x9c49db9 thru 0x9c52e26 (0x906e bytes) 2024-09-21T15:07:36.382 INFO:teuthology.orchestra.run.smithi161.stdout:1263 write 0xc2a05e7 thru 0xc2a6460 (0x5e7a bytes) 2024-09-21T15:07:36.390 INFO:teuthology.orchestra.run.smithi161.stdout:648 writesame 0x31670d7 thru 0x317082e data_size 0x3a(0x9758 bytes) 2024-09-21T15:07:36.403 INFO:teuthology.orchestra.run.smithi161.stdout:1264 read 0x42146ac thru 0x421a300 (0x5c55 bytes) 2024-09-21T15:07:36.404 INFO:teuthology.orchestra.run.smithi161.stdout:1265 read 0x730bfa3 thru 0x7318001 (0xc05f bytes) 2024-09-21T15:07:36.405 INFO:teuthology.orchestra.run.smithi161.stdout:1266 writesame 0x6448285 thru 0x644ae1c data_size 0x1(0x2b98 bytes) 2024-09-21T15:07:36.409 INFO:teuthology.orchestra.run.smithi161.stdout:686 read 0x509aba8 thru 0x50a688e (0xbce7 bytes) 2024-09-21T15:07:36.413 INFO:teuthology.orchestra.run.smithi161.stdout:649 trunc from 0x317082f to 0xc3aa0cc 2024-09-21T15:07:36.420 INFO:teuthology.orchestra.run.smithi161.stdout:688 write 0x4eedbb8 thru 0x4ef1c63 (0x40ac bytes) 2024-09-21T15:07:36.438 INFO:teuthology.orchestra.run.smithi161.stdout:592 read 0x1531e thru 0x17bd0 (0x28b3 bytes) 2024-09-21T15:07:36.439 INFO:teuthology.orchestra.run.smithi161.stdout:593 read 0xa238867 thru 0xa23a6be (0x1e58 bytes) 2024-09-21T15:07:36.443 INFO:teuthology.orchestra.run.smithi161.stdout:594 write 0x793e4a2 thru 0x794c31b (0xde7a bytes) 2024-09-21T15:07:36.456 INFO:teuthology.orchestra.run.smithi161.stdout:652 trunc from 0xc3aa0cc to 0xec16ba6 2024-09-21T15:07:36.501 INFO:teuthology.orchestra.run.smithi161.stdout:653 read 0x834efb0 thru 0x835861a (0x966b bytes) 2024-09-21T15:07:36.501 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.501 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.501 INFO:teuthology.orchestra.run.smithi161.stdout:657 write 0xa39efd1 thru 0xa3ac8b2 (0xd8e2 bytes) 2024-09-21T15:07:36.510 INFO:teuthology.orchestra.run.smithi161.stdout:658 read 0x6dfde7 thru 0x6e1f30 (0x214a bytes) 2024-09-21T15:07:36.512 INFO:teuthology.orchestra.run.smithi161.stdout:660 punch from 0x8b11a99 to 0x8b11df3, (0x35a bytes) 2024-09-21T15:07:36.512 INFO:teuthology.orchestra.run.smithi161.stdout:661 punch from 0xac0c045 to 0xac0d70d, (0x16c8 bytes) 2024-09-21T15:07:36.512 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.512 INFO:teuthology.orchestra.run.smithi161.stdout:663 writesame 0x5fed289 thru 0x5ff6bf6 data_size 0x29(0x996e bytes) 2024-09-21T15:07:36.520 INFO:teuthology.orchestra.run.smithi161.stdout:664 read 0x20c3955 thru 0x20d29b4 (0xf060 bytes) 2024-09-21T15:07:36.520 INFO:teuthology.orchestra.run.smithi161.stdout:665 write 0xc3135fa thru 0xc316dfa (0x3801 bytes) 2024-09-21T15:07:36.529 INFO:teuthology.orchestra.run.smithi161.stdout:666 punch from 0xad32e3d to 0xad34390, (0x1553 bytes) 2024-09-21T15:07:36.530 INFO:teuthology.orchestra.run.smithi161.stdout:667 writesame 0x54c67d1 thru 0x54d10e3 data_size 0x1(0xa913 bytes) 2024-09-21T15:07:36.551 INFO:teuthology.orchestra.run.smithi161.stdout:689 write 0xcac5e98 thru 0xcad0e6c (0xafd5 bytes) 2024-09-21T15:07:36.562 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.562 INFO:teuthology.orchestra.run.smithi161.stdout:669 writesame 0x2277f27 thru 0x227d048 data_size 0x1f(0x5122 bytes) 2024-09-21T15:07:36.571 INFO:teuthology.orchestra.run.smithi161.stdout:1267 write 0xca2b1df thru 0xca354f6 (0xa318 bytes) 2024-09-21T15:07:36.575 INFO:teuthology.orchestra.run.smithi161.stdout:950 write 0xb8f0831 thru 0xb8ff8a4 (0xf074 bytes) 2024-09-21T15:07:36.588 INFO:teuthology.orchestra.run.smithi161.stdout:670 writesame 0x2d31b91 thru 0x2d3ddb4 data_size 0x1c(0xc224 bytes) 2024-09-21T15:07:36.588 INFO:teuthology.orchestra.run.smithi161.stdout:1268 write 0x6cca8ba thru 0x6cd0faa (0x66f1 bytes) 2024-09-21T15:07:36.602 INFO:teuthology.orchestra.run.smithi161.stdout:596 writesame 0xbabd65d thru 0xbacd2fa data_size 0x3a(0xfc9e bytes) 2024-09-21T15:07:36.609 INFO:teuthology.orchestra.run.smithi161.stdout:690 write 0x65bd40b thru 0x65cb2ae (0xdea4 bytes) 2024-09-21T15:07:36.610 INFO:teuthology.orchestra.run.smithi161.stdout:1269 read 0xa548d1c thru 0xa55869f (0xf984 bytes) 2024-09-21T15:07:36.610 INFO:teuthology.orchestra.run.smithi161.stdout:1270 write 0x48ea6cd thru 0x48ec531 (0x1e65 bytes) 2024-09-21T15:07:36.628 INFO:teuthology.orchestra.run.smithi161.stdout:671 trunc from 0xec16ba6 to 0x75afea0 2024-09-21T15:07:36.643 INFO:teuthology.orchestra.run.smithi161.stdout:1271 trunc from 0xca354f7 to 0xa7f9347 2024-09-21T15:07:36.713 INFO:teuthology.orchestra.run.smithi161.stdout:597 read 0x1ffcc49 thru 0x2006faa (0xa362 bytes) 2024-09-21T15:07:36.715 INFO:teuthology.orchestra.run.smithi161.stdout:598 punch from 0x158e515 to 0x159a5f1, (0xc0dc bytes) 2024-09-21T15:07:36.715 INFO:teuthology.orchestra.run.smithi161.stdout:599 punch from 0x34173be to 0x341f733, (0x8375 bytes) 2024-09-21T15:07:36.715 INFO:teuthology.orchestra.run.smithi161.stdout:600 read 0xa8feb4b thru 0xa902d92 (0x4248 bytes) 2024-09-21T15:07:36.715 INFO:teuthology.orchestra.run.smithi161.stdout:602 write 0x8af3bf8 thru 0x8affe5e (0xc267 bytes) 2024-09-21T15:07:36.719 INFO:teuthology.orchestra.run.smithi161.stdout:951 write 0xe084a74 thru 0xe08a306 (0x5893 bytes) 2024-09-21T15:07:36.732 INFO:teuthology.orchestra.run.smithi161.stdout:672 write 0x1d5d1f6 thru 0x1d60654 (0x345f bytes) 2024-09-21T15:07:36.744 INFO:teuthology.orchestra.run.smithi161.stdout:953 read 0x11f0877 thru 0x11feb32 (0xe2bc bytes) 2024-09-21T15:07:36.745 INFO:teuthology.orchestra.run.smithi161.stdout:954 read 0x31ba591 thru 0x31c734c (0xcdbc bytes) 2024-09-21T15:07:36.746 INFO:teuthology.orchestra.run.smithi161.stdout:955 punch from 0x4d91a32 to 0x4da0e02, (0xf3d0 bytes) 2024-09-21T15:07:36.746 INFO:teuthology.orchestra.run.smithi161.stdout:956 read 0x1eae742 thru 0x1eb4761 (0x6020 bytes) 2024-09-21T15:07:36.747 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.747 INFO:teuthology.orchestra.run.smithi161.stdout:959 write 0x619a1a thru 0x622baf (0x9196 bytes) 2024-09-21T15:07:36.747 INFO:teuthology.orchestra.run.smithi161.stdout:691 write 0x90c6ac2 thru 0x90cd1b3 (0x66f2 bytes) 2024-09-21T15:07:36.757 INFO:teuthology.orchestra.run.smithi161.stdout:675 read 0x72fe0f4 thru 0x72ff5aa (0x14b7 bytes) 2024-09-21T15:07:36.757 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.757 INFO:teuthology.orchestra.run.smithi161.stdout:678 punch from 0x19edeed to 0x19f78ff, (0x9a12 bytes) 2024-09-21T15:07:36.757 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.757 INFO:teuthology.orchestra.run.smithi161.stdout:681 write 0x3ad0e90 thru 0x3ad324c (0x23bd bytes) 2024-09-21T15:07:36.760 INFO:teuthology.orchestra.run.smithi161.stdout:961 read 0xf4ed26 thru 0xf522f2 (0x35cd bytes) 2024-09-21T15:07:36.760 INFO:teuthology.orchestra.run.smithi161.stdout:962 write 0x95e6f32 thru 0x95e7d04 (0xdd3 bytes) 2024-09-21T15:07:36.770 INFO:teuthology.orchestra.run.smithi161.stdout:963 punch from 0x2dace1d to 0x2db94aa, (0xc68d bytes) 2024-09-21T15:07:36.770 INFO:teuthology.orchestra.run.smithi161.stdout:964 writesame 0x2a889b3 thru 0x2a97963 data_size 0x1(0xefb1 bytes) 2024-09-21T15:07:36.794 INFO:teuthology.orchestra.run.smithi161.stdout:682 trunc from 0x75afea0 to 0xad4f012 2024-09-21T15:07:36.795 INFO:teuthology.orchestra.run.smithi161.stdout:692 write 0x65267fd thru 0x653320c (0xca10 bytes) 2024-09-21T15:07:36.805 INFO:teuthology.orchestra.run.smithi161.stdout:603 punch from 0x6a16790 to 0x6a2041c, (0x9c8c bytes) 2024-09-21T15:07:36.805 INFO:teuthology.orchestra.run.smithi161.stdout:605 write 0x4e77cb0 thru 0x4e7c882 (0x4bd3 bytes) 2024-09-21T15:07:36.816 INFO:teuthology.orchestra.run.smithi161.stdout:695 read 0x8aed24d thru 0x8af10fd (0x3eb1 bytes) 2024-09-21T15:07:36.816 INFO:teuthology.orchestra.run.smithi161.stdout:965 trunc from 0xe08a307 to 0xbbf66bf 2024-09-21T15:07:36.818 INFO:teuthology.orchestra.run.smithi161.stdout:696 trunc from 0xe4eca9c to 0xd65d90f 2024-09-21T15:07:36.825 INFO:teuthology.orchestra.run.smithi161.stdout:1272 writesame 0xe2ef93f thru 0xe2f4f40 data_size 0x65(0x5602 bytes) 2024-09-21T15:07:36.830 INFO:teuthology.orchestra.run.smithi161.stdout:606 write 0x81110d7 thru 0x81139cf (0x28f9 bytes) 2024-09-21T15:07:36.838 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.838 INFO:teuthology.orchestra.run.smithi161.stdout:609 read 0x2768493 thru 0x277641d (0xdf8b bytes) 2024-09-21T15:07:36.839 INFO:teuthology.orchestra.run.smithi161.stdout:611 writesame 0x94990a6 thru 0x949965d data_size 0xc(0x5b8 bytes) 2024-09-21T15:07:36.842 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.842 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.848 INFO:teuthology.orchestra.run.smithi161.stdout:685 trunc from 0xad4f012 to 0x84f0787 2024-09-21T15:07:36.853 INFO:teuthology.orchestra.run.smithi161.stdout:1274 trunc from 0xe2f4f41 to 0x205b3d6 2024-09-21T15:07:36.854 INFO:teuthology.orchestra.run.smithi161.stdout:612 punch from 0xc64dc8d to 0xc65a33b, (0xc6ae bytes) 2024-09-21T15:07:36.854 INFO:teuthology.orchestra.run.smithi161.stdout:613 read 0x1366c4d thru 0x1374db6 (0xe16a bytes) 2024-09-21T15:07:36.854 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.859 INFO:teuthology.orchestra.run.smithi161.stdout:617 trunc from 0xd741843 to 0xa27143b 2024-09-21T15:07:36.876 INFO:teuthology.orchestra.run.smithi161.stdout:966 write 0x941ff74 thru 0x942de00 (0xde8d bytes) 2024-09-21T15:07:36.878 INFO:teuthology.orchestra.run.smithi161.stdout:686 read 0x7c0c289 thru 0x7c0fba2 (0x391a bytes) 2024-09-21T15:07:36.879 INFO:teuthology.orchestra.run.smithi161.stdout:688 writesame 0xead89e thru 0xeb7e9e data_size 0xd(0xa601 bytes) 2024-09-21T15:07:36.906 INFO:teuthology.orchestra.run.smithi161.stdout:967 write 0xaae5265 thru 0xaaeba09 (0x67a5 bytes) 2024-09-21T15:07:36.918 INFO:teuthology.orchestra.run.smithi161.stdout:969 read 0xace3547 thru 0xaceb5ee (0x80a8 bytes) 2024-09-21T15:07:36.922 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.922 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:36.923 INFO:teuthology.orchestra.run.smithi161.stdout:698 writesame 0xb5184c0 thru 0xb527e41 data_size 0x6d(0xf982 bytes) 2024-09-21T15:07:36.942 INFO:teuthology.orchestra.run.smithi161.stdout:980 write 0xb97be11 thru 0xb97f095 (0x3285 bytes) 2024-09-21T15:07:36.943 INFO:teuthology.orchestra.run.smithi161.stdout:689 write 0xc5b0c46 thru 0xc5b296c (0x1d27 bytes) 2024-09-21T15:07:36.961 INFO:teuthology.orchestra.run.smithi161.stdout:970 write 0xeb05b03 thru 0xeb078da (0x1dd8 bytes) 2024-09-21T15:07:36.968 INFO:teuthology.orchestra.run.smithi161.stdout:1277 trunc from 0x205b3d6 to 0x999cc4f 2024-09-21T15:07:36.972 INFO:teuthology.orchestra.run.smithi161.stdout:690 write 0xb263e99 thru 0xb26fff0 (0xc158 bytes) 2024-09-21T15:07:36.991 INFO:teuthology.orchestra.run.smithi161.stdout:701 punch from 0x435085f to 0x43513aa, (0xb4b bytes) 2024-09-21T15:07:36.991 INFO:teuthology.orchestra.run.smithi161.stdout:702 read 0x751f395 thru 0x752605a (0x6cc6 bytes) 2024-09-21T15:07:36.991 INFO:teuthology.orchestra.run.smithi161.stdout:971 read 0xae2f178 thru 0xae3034e (0x11d7 bytes) 2024-09-21T15:07:36.991 INFO:teuthology.orchestra.run.smithi161.stdout:972 write 0x1e22105 thru 0x1e247b1 (0x26ad bytes) 2024-09-21T15:07:36.991 INFO:teuthology.orchestra.run.smithi161.stdout:703 punch from 0xc4de64f to 0xc4e8ce2, (0xa693 bytes) 2024-09-21T15:07:36.992 INFO:teuthology.orchestra.run.smithi161.stdout:706 writesame 0x6e2ffb7 thru 0x6e36d97 data_size 0x1(0x6de1 bytes) 2024-09-21T15:07:37.003 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.003 INFO:teuthology.orchestra.run.smithi161.stdout:975 writesame 0xe7bcfa5 thru 0xe7c9861 data_size 0x3b(0xc8bd bytes) 2024-09-21T15:07:37.034 INFO:teuthology.orchestra.run.smithi161.stdout:691 punch from 0xaf931d8 to 0xaf95b29, (0x2951 bytes) 2024-09-21T15:07:37.034 INFO:teuthology.orchestra.run.smithi161.stdout:692 write 0x15986f1 thru 0x15a00b8 (0x79c8 bytes) 2024-09-21T15:07:37.048 INFO:teuthology.orchestra.run.smithi161.stdout:976 punch from 0xeabb512 to 0xeabbdf0, (0x8de bytes) 2024-09-21T15:07:37.048 INFO:teuthology.orchestra.run.smithi161.stdout:977 writesame 0xa13bd4c thru 0xa146d21 data_size 0x47(0xafd6 bytes) 2024-09-21T15:07:37.064 INFO:teuthology.orchestra.run.smithi161.stdout:693 read 0xa8b90de thru 0xa8ba4e6 (0x1409 bytes) 2024-09-21T15:07:37.064 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.064 INFO:teuthology.orchestra.run.smithi161.stdout:695 punch from 0x9e595db to 0x9e608c5, (0x72ea bytes) 2024-09-21T15:07:37.064 INFO:teuthology.orchestra.run.smithi161.stdout:978 writesame 0xd06cc9b thru 0xd077d96 data_size 0x2f(0xb0fc bytes) 2024-09-21T15:07:37.066 INFO:teuthology.orchestra.run.smithi161.stdout:1278 read 0x2196128 thru 0x219b21c (0x50f5 bytes) 2024-09-21T15:07:37.067 INFO:teuthology.orchestra.run.smithi161.stdout:1279 read 0xf9d3e0 thru 0xfa61bd (0x8dde bytes) 2024-09-21T15:07:37.070 INFO:teuthology.orchestra.run.smithi161.stdout:696 trunc from 0xc5b296d to 0xe7a1e28 2024-09-21T15:07:37.074 INFO:teuthology.orchestra.run.smithi161.stdout:979 write 0x5fde784 thru 0x5fe2211 (0x3a8e bytes) 2024-09-21T15:07:37.078 INFO:teuthology.orchestra.run.smithi161.stdout:618 write 0x60302b thru 0x6057c4 (0x279a bytes) 2024-09-21T15:07:37.078 INFO:teuthology.orchestra.run.smithi161.stdout:1280 write 0x8f3bf1c thru 0x8f48426 (0xc50b bytes) 2024-09-21T15:07:37.093 INFO:teuthology.orchestra.run.smithi161.stdout:981 trunc from 0xbfbbab0 to 0x1f748ae 2024-09-21T15:07:37.109 INFO:teuthology.orchestra.run.smithi161.stdout:981 clone 7 order 19 su 8192 sc 13 2024-09-21T15:07:37.113 INFO:teuthology.orchestra.run.smithi161.stdout:698 write 0xca756dd thru 0xca7bdcb (0x66ef bytes) 2024-09-21T15:07:37.124 INFO:teuthology.orchestra.run.smithi161.stdout:1281 read 0x1e55a85 thru 0x1e5b7a9 (0x5d25 bytes) 2024-09-21T15:07:37.125 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.125 INFO:teuthology.orchestra.run.smithi161.stdout:1284 punch from 0x5ef289b to 0x5ef9807, (0x6f6c bytes) 2024-09-21T15:07:37.125 INFO:teuthology.orchestra.run.smithi161.stdout:1285 read 0x202fcde thru 0x2034bef (0x4f12 bytes) 2024-09-21T15:07:37.125 INFO:teuthology.orchestra.run.smithi161.stdout:1287 read 0x305371c thru 0x3054d2c (0x1611 bytes) 2024-09-21T15:07:37.138 INFO:teuthology.orchestra.run.smithi161.stdout:700 read 0x980c567 thru 0x981aa13 (0xe4ad bytes) 2024-09-21T15:07:37.138 INFO:teuthology.orchestra.run.smithi161.stdout:701 read 0x4f21ab0 thru 0x4f2eeb2 (0xd403 bytes) 2024-09-21T15:07:37.139 INFO:teuthology.orchestra.run.smithi161.stdout:702 read 0xb83b104 thru 0xb8455eb (0xa4e8 bytes) 2024-09-21T15:07:37.139 INFO:teuthology.orchestra.run.smithi161.stdout:703 read 0x4090157 thru 0x40995f0 (0x949a bytes) 2024-09-21T15:07:37.139 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.139 INFO:teuthology.orchestra.run.smithi161.stdout:708 write 0xc4203b9 thru 0xc427787 (0x73cf bytes) 2024-09-21T15:07:37.141 INFO:teuthology.orchestra.run.smithi161.stdout:707 punch from 0x3a5144d to 0x3a5b861, (0xa414 bytes) 2024-09-21T15:07:37.141 INFO:teuthology.orchestra.run.smithi161.stdout:708 read 0x87df63b thru 0x87eae0f (0xb7d5 bytes) 2024-09-21T15:07:37.142 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.142 INFO:teuthology.orchestra.run.smithi161.stdout:713 writesame 0x3e3bba thru 0x3eb917 data_size 0x9(0x7d5e bytes) 2024-09-21T15:07:37.144 INFO:teuthology.orchestra.run.smithi161.stdout:619 trunc from 0xa27143b to 0x3f881db 2024-09-21T15:07:37.151 INFO:teuthology.orchestra.run.smithi161.stdout:709 clone 8 order 18 su 131072 sc 15 2024-09-21T15:07:37.222 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.222 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.242 INFO:teuthology.orchestra.run.smithi161.stdout:1288 write 0xe226d14 thru 0xe22b08d (0x437a bytes) 2024-09-21T15:07:37.250 INFO:teuthology.orchestra.run.smithi161.stdout:714 trunc from 0xd65d90f to 0xdab8561 2024-09-21T15:07:37.259 INFO:teuthology.orchestra.run.smithi161.stdout:985 writesame 0x7bac380 thru 0x7bafb01 data_size 0x46(0x3782 bytes) 2024-09-21T15:07:37.265 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.265 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.265 INFO:teuthology.orchestra.run.smithi161.stdout:620 punch from 0xe05f0e to 0xe1579b, (0xf88d bytes) 2024-09-21T15:07:37.274 INFO:teuthology.orchestra.run.smithi161.stdout:718 write 0xccf8864 thru 0xcd02984 (0xa121 bytes) 2024-09-21T15:07:37.281 INFO:teuthology.orchestra.run.smithi161.stdout:1292 trunc from 0xe22b08e to 0xc5849e 2024-09-21T15:07:37.289 INFO:teuthology.orchestra.run.smithi161.stdout:621 trunc from 0x3f881db to 0xa38163e 2024-09-21T15:07:37.307 INFO:teuthology.orchestra.run.smithi161.stdout:722 write 0xc96e57e thru 0xc97870c (0xa18f bytes) 2024-09-21T15:07:37.322 INFO:teuthology.orchestra.run.smithi161.stdout:622 punch from 0x432ae76 to 0x4337b1d, (0xcca7 bytes) 2024-09-21T15:07:37.322 INFO:teuthology.orchestra.run.smithi161.stdout:623 read 0x5ac27ba thru 0x5acf64d (0xce94 bytes) 2024-09-21T15:07:37.325 INFO:teuthology.orchestra.run.smithi161.stdout:988 write 0xddcab43 thru 0xddcf156 (0x4614 bytes) 2024-09-21T15:07:37.342 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.343 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.343 INFO:teuthology.orchestra.run.smithi161.stdout:725 read 0x196 thru 0x7815 (0x7680 bytes) 2024-09-21T15:07:37.347 INFO:teuthology.orchestra.run.smithi161.stdout:726 write 0x2557918 thru 0x2561658 (0x9d41 bytes) 2024-09-21T15:07:37.354 INFO:teuthology.orchestra.run.smithi161.stdout:624 write 0xc57ba28 thru 0xc5859ce (0x9fa7 bytes) 2024-09-21T15:07:37.358 INFO:teuthology.orchestra.run.smithi161.stdout:989 trunc from 0xddcf157 to 0x41599d3 2024-09-21T15:07:37.364 INFO:teuthology.orchestra.run.smithi161.stdout:1293 trunc from 0xc5849e to 0xc4ec4a2 2024-09-21T15:07:37.424 INFO:teuthology.orchestra.run.smithi161.stdout:626 trunc from 0xc5859cf to 0x56b629f 2024-09-21T15:07:37.455 INFO:teuthology.orchestra.run.smithi161.stdout:990 write 0x295f6d thru 0x29a7a3 (0x4837 bytes) 2024-09-21T15:07:37.474 INFO:teuthology.orchestra.run.smithi161.stdout:1294 write 0x74f706a thru 0x74f8117 (0x10ae bytes) 2024-09-21T15:07:37.481 INFO:teuthology.orchestra.run.smithi161.stdout:727 write 0x30500cc thru 0x3055250 (0x5185 bytes) 2024-09-21T15:07:37.486 INFO:teuthology.orchestra.run.smithi161.stdout:1295 read 0xa95f794 thru 0xa96ae2e (0xb69b bytes) 2024-09-21T15:07:37.503 INFO:teuthology.orchestra.run.smithi161.stdout:628 write 0x17a9543 thru 0x17acb25 (0x35e3 bytes) 2024-09-21T15:07:37.509 INFO:teuthology.orchestra.run.smithi161.stdout:1297 trunc from 0xc4ec4a2 to 0x216b16f 2024-09-21T15:07:37.552 INFO:teuthology.orchestra.run.smithi161.stdout:992 writesame 0x7b18b44 thru 0x7b21545 data_size 0x5(0x8a02 bytes) 2024-09-21T15:07:37.572 INFO:teuthology.orchestra.run.smithi161.stdout:993 trunc from 0x7b21546 to 0x1ce1018 2024-09-21T15:07:37.577 INFO:teuthology.orchestra.run.smithi161.stdout:629 write 0x5629b6a thru 0x56321ef (0x8686 bytes) 2024-09-21T15:07:37.599 INFO:teuthology.orchestra.run.smithi161.stdout:630 read 0x4fda91b thru 0x4fe70bb (0xc7a1 bytes) 2024-09-21T15:07:37.599 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.599 INFO:teuthology.orchestra.run.smithi161.stdout:632 write 0x514d9f2 thru 0x515c97c (0xef8b bytes) 2024-09-21T15:07:37.605 INFO:teuthology.orchestra.run.smithi161.stdout:728 punch from 0x4f80ec5 to 0x4f8747a, (0x65b5 bytes) 2024-09-21T15:07:37.615 INFO:teuthology.orchestra.run.smithi161.stdout:729 trunc from 0xdab8561 to 0xa283e6a 2024-09-21T15:07:37.622 INFO:teuthology.orchestra.run.smithi161.stdout:634 writesame 0x4dc912e thru 0x4dd8099 data_size 0x4d(0xef6c bytes) 2024-09-21T15:07:37.633 INFO:teuthology.orchestra.run.smithi161.stdout:994 read 0x709537 thru 0x70db8e (0x4658 bytes) 2024-09-21T15:07:37.656 INFO:teuthology.orchestra.run.smithi161.stdout:636 trunc from 0x56b629f to 0x3eeda7a 2024-09-21T15:07:37.669 INFO:teuthology.orchestra.run.smithi161.stdout:1298 writesame 0xb67dfb1 thru 0xb67f90b data_size 0x1(0x195b bytes) 2024-09-21T15:07:37.676 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.676 INFO:teuthology.orchestra.run.smithi161.stdout:1300 read 0x8568a3c thru 0x856f933 (0x6ef8 bytes) 2024-09-21T15:07:37.678 INFO:teuthology.orchestra.run.smithi161.stdout:1301 read 0x7ed2108 thru 0x7ed339c (0x1295 bytes) 2024-09-21T15:07:37.688 INFO:teuthology.orchestra.run.smithi161.stdout:995 write 0x85e0072 thru 0x85e258e (0x251d bytes) 2024-09-21T15:07:37.702 INFO:teuthology.orchestra.run.smithi161.stdout:997 trunc from 0x85e258f to 0x5168a14 2024-09-21T15:07:37.723 INFO:teuthology.orchestra.run.smithi161.stdout:1302 writesame 0xdb5f8db thru 0xdb62c5d data_size 0x1(0x3383 bytes) 2024-09-21T15:07:37.726 INFO:teuthology.orchestra.run.smithi161.stdout:1304 write 0x2293e6b thru 0x22a1b9d (0xdd33 bytes) 2024-09-21T15:07:37.733 INFO:teuthology.orchestra.run.smithi161.stdout:1306 write 0x817ef76 thru 0x81878d4 (0x895f bytes) 2024-09-21T15:07:37.741 INFO:teuthology.orchestra.run.smithi161.stdout:730 punch from 0x52b2e23 to 0x52b6b8b, (0x3d68 bytes) 2024-09-21T15:07:37.741 INFO:teuthology.orchestra.run.smithi161.stdout:731 punch from 0x539f241 to 0x53abf8b, (0xcd4a bytes) 2024-09-21T15:07:37.743 INFO:teuthology.orchestra.run.smithi161.stdout:1308 clone 6 order 22 su 524288 sc 5 2024-09-21T15:07:37.746 INFO:teuthology.orchestra.run.smithi161.stdout:637 trunc from 0x3eeda7a to 0xbd95131 2024-09-21T15:07:37.748 INFO:teuthology.orchestra.run.smithi161.stdout:732 trunc from 0xa283e6a to 0x7489158 2024-09-21T15:07:37.753 INFO:teuthology.orchestra.run.smithi161.stdout:998 trunc from 0x5168a14 to 0x76b3795 2024-09-21T15:07:37.773 INFO:teuthology.orchestra.run.smithi161.stdout:638 write 0x56b8632 thru 0x56b9861 (0x1230 bytes) 2024-09-21T15:07:37.787 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:37.787 INFO:teuthology.orchestra.run.smithi161.stdout:640 write 0x5ac1162 thru 0x5ac3057 (0x1ef6 bytes) 2024-09-21T15:07:37.793 INFO:teuthology.orchestra.run.smithi161.stdout:999 punch from 0x19155c0 to 0x1915b82, (0x5c2 bytes) 2024-09-21T15:07:37.842 INFO:teuthology.orchestra.run.smithi161.stdout:1001 write 0x7abe937 thru 0x7ac46f3 (0x5dbd bytes) 2024-09-21T15:07:37.847 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone6 from 0xeb078db (overlap 0x3dc508) to 0x0 2024-09-21T15:07:37.851 INFO:teuthology.orchestra.run.smithi161.stdout:1002 read 0x13234f thru 0x13eaa9 (0xc75b bytes) 2024-09-21T15:07:37.857 INFO:teuthology.orchestra.run.smithi161.stdout:1003 trunc from 0x7ac46f4 to 0x63e6e53 2024-09-21T15:07:37.873 INFO:teuthology.orchestra.run.smithi161.stdout:641 write 0xe0aa339 thru 0xe0ae7d3 (0x449b bytes) 2024-09-21T15:07:37.876 INFO:teuthology.orchestra.run.smithi161.stdout:733 trunc from 0x7489158 to 0x3c45102 2024-09-21T15:07:37.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:07:37.874+0000 7f68eae7f700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581cac12540 finish: resending after timeout 2024-09-21T15:07:37.888 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone7 from 0xe7a1e28 (overlap 0xabe42e) to 0x898358 2024-09-21T15:07:37.897 INFO:teuthology.orchestra.run.smithi161.stdout:642 write 0xa5b8549 thru 0xa5c8144 (0xfbfc bytes) 2024-09-21T15:07:37.921 INFO:teuthology.orchestra.run.smithi161.stdout:1005 read 0x2c0d721 thru 0x2c1b9bc (0xe29c bytes) 2024-09-21T15:07:37.922 INFO:teuthology.orchestra.run.smithi161.stdout:1007 punch from 0x63a78da to 0x63aa27b, (0x29a1 bytes) 2024-09-21T15:07:37.922 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xec75981 2024-09-21T15:07:37.944 INFO:teuthology.orchestra.run.smithi161.stdout:643 trunc from 0xe0ae7d4 to 0xaf49806 2024-09-21T15:07:37.959 INFO:teuthology.orchestra.run.smithi161.stdout:1008 trunc from 0x63e6e53 to 0xec75981 2024-09-21T15:07:38.003 INFO:teuthology.orchestra.run.smithi161.stdout:1009 write 0x9b9577 thru 0x9bf87f (0x6309 bytes) 2024-09-21T15:07:38.049 INFO:teuthology.orchestra.run.smithi161.stdout:1011 write 0x55968bb thru 0x559e8f5 (0x803b bytes) 2024-09-21T15:07:38.081 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #5, image image_cluster1.client.mirror.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent6 2024-09-21T15:07:38.083 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:38.083 INFO:teuthology.orchestra.run.smithi161.stdout:1013 read 0xc47f259 thru 0xc485a0e (0x67b6 bytes) 2024-09-21T15:07:38.099 INFO:teuthology.orchestra.run.smithi161.stdout:644 writesame 0xde3220a thru 0xde3b98a data_size 0x1(0x9781 bytes) 2024-09-21T15:07:38.100 INFO:teuthology.orchestra.run.smithi161.stdout:1014 trunc from 0xec75981 to 0xadb211f 2024-09-21T15:07:38.105 INFO:teuthology.orchestra.run.smithi161.stdout:645 write 0x5236b60 thru 0x523bc11 (0x50b2 bytes) 2024-09-21T15:07:38.128 INFO:teuthology.orchestra.run.smithi161.stdout:646 read 0x8a00619 thru 0x8a04d1d (0x4705 bytes) 2024-09-21T15:07:38.128 INFO:teuthology.orchestra.run.smithi161.stdout:647 punch from 0x3d2f714 to 0x3d33517, (0x3e03 bytes) 2024-09-21T15:07:38.128 INFO:teuthology.orchestra.run.smithi161.stdout:648 punch from 0x88abecf to 0x88bafbc, (0xf0ed bytes) 2024-09-21T15:07:38.128 INFO:teuthology.orchestra.run.smithi161.stdout:649 write 0x499577b thru 0x49a35cf (0xde55 bytes) 2024-09-21T15:07:38.146 INFO:teuthology.orchestra.run.smithi161.stdout:1015 write 0x66530b1 thru 0x665c99f (0x98ef bytes) 2024-09-21T15:07:38.156 INFO:teuthology.orchestra.run.smithi161.stdout:650 write 0x3df9fe3 thru 0x3e0877e (0xe79c bytes) 2024-09-21T15:07:38.160 INFO:teuthology.orchestra.run.smithi161.stdout:1016 write 0x2bf4d80 thru 0x2c0024a (0xb4cb bytes) 2024-09-21T15:07:38.169 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:38.169 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:38.169 INFO:teuthology.orchestra.run.smithi161.stdout:655 read 0x30f0fbe thru 0x30fa08e (0x90d1 bytes) 2024-09-21T15:07:38.169 INFO:teuthology.orchestra.run.smithi161.stdout:656 punch from 0x7d14dda to 0x7d1c6f6, (0x791c bytes) 2024-09-21T15:07:38.170 INFO:teuthology.orchestra.run.smithi161.stdout:657 writesame 0xaa80225 thru 0xaa86434 data_size 0x18(0x6210 bytes) 2024-09-21T15:07:38.171 INFO:teuthology.orchestra.run.smithi161.stdout:1017 write 0xb82691 thru 0xb8e2d0 (0xbc40 bytes) 2024-09-21T15:07:38.175 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #6, image image_cluster1.client.mirror.4-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent7 2024-09-21T15:07:38.184 INFO:teuthology.orchestra.run.smithi161.stdout:1018 clone 6 order 21 su 8192 sc 5 2024-09-21T15:07:38.184 INFO:teuthology.orchestra.run.smithi161.stdout:658 writesame 0xcb6e20b thru 0xcb741cb data_size 0x1(0x5fc1 bytes) 2024-09-21T15:07:38.198 INFO:teuthology.orchestra.run.smithi161.stdout:734 write 0xd9516de thru 0xd956b0d (0x5430 bytes) 2024-09-21T15:07:38.216 INFO:teuthology.orchestra.run.smithi161.stdout:659 write 0x2ea9689 thru 0x2eb61ce (0xcb46 bytes) 2024-09-21T15:07:38.232 INFO:teuthology.orchestra.run.smithi161.stdout:736 read 0x8355451 thru 0x8363feb (0xeb9b bytes) 2024-09-21T15:07:38.233 INFO:teuthology.orchestra.run.smithi161.stdout:737 trunc from 0xd956b0e to 0xdd06e19 2024-09-21T15:07:38.249 INFO:teuthology.orchestra.run.smithi161.stdout:712 trunc from 0xe7a1e28 to 0x74c69ab 2024-09-21T15:07:38.254 INFO:teuthology.orchestra.run.smithi161.stdout:661 punch from 0x197a977 to 0x1981c00, (0x7289 bytes) 2024-09-21T15:07:38.254 INFO:teuthology.orchestra.run.smithi161.stdout:662 writesame 0xbb9665a thru 0xbb9def3 data_size 0x2(0x789a bytes) 2024-09-21T15:07:38.271 INFO:teuthology.orchestra.run.smithi161.stdout:738 write 0xa3257c5 thru 0xa331219 (0xba55 bytes) 2024-09-21T15:07:38.276 INFO:teuthology.orchestra.run.smithi161.stdout:663 trunc from 0xde3b98b to 0xb8a7a13 2024-09-21T15:07:38.301 INFO:teuthology.orchestra.run.smithi161.stdout:739 write 0x72493d0 thru 0x72503c9 (0x6ffa bytes) 2024-09-21T15:07:38.323 INFO:teuthology.orchestra.run.smithi161.stdout:713 trunc from 0x74c69ab to 0x5a0f671 2024-09-21T15:07:38.326 INFO:teuthology.orchestra.run.smithi161.stdout:741 write 0x482bc23 thru 0x4837ff8 (0xc3d6 bytes) 2024-09-21T15:07:38.344 INFO:teuthology.orchestra.run.smithi161.stdout:664 write 0x4fea75e thru 0x4fee2e3 (0x3b86 bytes) 2024-09-21T15:07:38.355 INFO:teuthology.orchestra.run.smithi161.stdout:742 punch from 0x9bc390d to 0x9bcd4c0, (0x9bb3 bytes) 2024-09-21T15:07:38.355 INFO:teuthology.orchestra.run.smithi161.stdout:665 punch from 0x9611d93 to 0x961c358, (0xa5c5 bytes) 2024-09-21T15:07:38.356 INFO:teuthology.orchestra.run.smithi161.stdout:743 write 0x148931d thru 0x1495085 (0xbd69 bytes) 2024-09-21T15:07:38.356 INFO:teuthology.orchestra.run.smithi161.stdout:666 read 0x7c59534 thru 0x7c5bb10 (0x25dd bytes) 2024-09-21T15:07:38.370 INFO:teuthology.orchestra.run.smithi161.stdout:667 trunc from 0xb8a7a13 to 0x54a63be 2024-09-21T15:07:38.450 INFO:teuthology.orchestra.run.smithi161.stdout:714 read 0x52fa29 thru 0x531ab3 (0x208b bytes) 2024-09-21T15:07:38.463 INFO:teuthology.orchestra.run.smithi161.stdout:715 trunc from 0x5a0f671 to 0xd4fe527 2024-09-21T15:07:38.480 INFO:teuthology.orchestra.run.smithi161.stdout:744 write 0xb0f762d thru 0xb104739 (0xd10d bytes) 2024-09-21T15:07:38.486 INFO:teuthology.orchestra.run.smithi161.stdout:670 punch from 0x1e24cd2 to 0x1e3342d, (0xe75b bytes) 2024-09-21T15:07:38.488 INFO:teuthology.orchestra.run.smithi161.stdout:716 writesame 0x18d6801 thru 0x18e433b data_size 0x1(0xdb3b bytes) 2024-09-21T15:07:38.502 INFO:teuthology.orchestra.run.smithi161.stdout:745 write 0xd7c7481 thru 0xd7cc9fd (0x557d bytes) 2024-09-21T15:07:38.507 INFO:teuthology.orchestra.run.smithi161.stdout:982 write 0x6bb96d0 thru 0x6bbf416 (0x5d47 bytes) 2024-09-21T15:07:38.539 INFO:teuthology.orchestra.run.smithi161.stdout:746 trunc from 0xdd06e19 to 0x93cbdd2 2024-09-21T15:07:38.540 INFO:teuthology.orchestra.run.smithi161.stdout:671 writesame 0x7b663f6 thru 0x7b7376e data_size 0x1(0xd379 bytes) 2024-09-21T15:07:38.546 INFO:teuthology.orchestra.run.smithi161.stdout:672 read 0xb3844c thru 0xb40e42 (0x89f7 bytes) 2024-09-21T15:07:38.547 INFO:teuthology.orchestra.run.smithi161.stdout:673 read 0x7a177d9 thru 0x7a1bd78 (0x45a0 bytes) 2024-09-21T15:07:38.547 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:38.547 INFO:teuthology.orchestra.run.smithi161.stdout:675 writesame 0x778c6bb thru 0x7792b67 data_size 0x47(0x64ad bytes) 2024-09-21T15:07:38.550 INFO:teuthology.orchestra.run.smithi161.stdout:720 trunc from 0xd4fe527 to 0xd6724b 2024-09-21T15:07:38.562 INFO:teuthology.orchestra.run.smithi161.stdout:983 read 0x52e301 thru 0x53c313 (0xe013 bytes) 2024-09-21T15:07:38.567 INFO:teuthology.orchestra.run.smithi161.stdout:984 trunc from 0xeb078db to 0xd198994 2024-09-21T15:07:38.569 INFO:teuthology.orchestra.run.smithi161.stdout:676 write 0x663d392 thru 0x66481e4 (0xae53 bytes) 2024-09-21T15:07:38.671 INFO:teuthology.orchestra.run.smithi161.stdout:677 trunc from 0x7b7376f to 0xc158b51 2024-09-21T15:07:38.697 INFO:teuthology.orchestra.run.smithi161.stdout:747 writesame 0x942634f thru 0x9435228 data_size 0x9e(0xeeda bytes) 2024-09-21T15:07:38.713 INFO:teuthology.orchestra.run.smithi161.stdout:679 write 0x58c9593 thru 0x58d3e54 (0xa8c2 bytes) 2024-09-21T15:07:38.716 INFO:teuthology.orchestra.run.smithi161.stdout:985 trunc from 0xd198994 to 0xa9ee513 2024-09-21T15:07:38.734 INFO:teuthology.orchestra.run.smithi161.stdout:681 write 0x3527289 thru 0x3529bd2 (0x294a bytes) 2024-09-21T15:07:38.745 INFO:teuthology.orchestra.run.smithi161.stdout:721 writesame 0x934938e thru 0x934b3e8 data_size 0xb(0x205b bytes) 2024-09-21T15:07:38.757 INFO:teuthology.orchestra.run.smithi161.stdout:682 write 0xdf10d5 thru 0xe0050b (0xf437 bytes) 2024-09-21T15:07:38.764 INFO:teuthology.orchestra.run.smithi161.stdout:748 writesame 0xddc9c66 thru 0xddcaaf1 data_size 0x26(0xe8c bytes) 2024-09-21T15:07:38.770 INFO:teuthology.orchestra.run.smithi161.stdout:750 writesame 0x57346e5 thru 0x573ccfb data_size 0x1(0x8617 bytes) 2024-09-21T15:07:38.812 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:38.812 INFO:teuthology.orchestra.run.smithi161.stdout:684 writesame 0xaba7df7 thru 0xabb742a data_size 0xe(0xf634 bytes) 2024-09-21T15:07:38.835 INFO:teuthology.orchestra.run.smithi161.stdout:751 write 0x1835984 thru 0x183c763 (0x6de0 bytes) 2024-09-21T15:07:38.840 INFO:teuthology.orchestra.run.smithi161.stdout:686 write 0xb1fe681 thru 0xb20a084 (0xba04 bytes) 2024-09-21T15:07:38.857 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:38.857 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:38.857 INFO:teuthology.orchestra.run.smithi161.stdout:690 clone 8 order 19 su 4096 sc 7 2024-09-21T15:07:38.863 INFO:teuthology.orchestra.run.smithi161.stdout:987 read 0x2b24743 thru 0x2b2d2e3 (0x8ba1 bytes) 2024-09-21T15:07:38.864 INFO:teuthology.orchestra.run.smithi161.stdout:988 read 0x793dc50 thru 0x7943721 (0x5ad2 bytes) 2024-09-21T15:07:38.864 INFO:teuthology.orchestra.run.smithi161.stdout:989 writesame 0x10f530d thru 0x1101166 data_size 0x37(0xbe5a bytes) 2024-09-21T15:07:38.970 INFO:teuthology.orchestra.run.smithi161.stdout:723 write 0xc0a8757 thru 0xc0a9e58 (0x1702 bytes) 2024-09-21T15:07:38.970 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.1-clone5 intact 2024-09-21T15:07:38.976 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone5 from 0xdb62c5e (overlap 0xfb5a) to 0x0 2024-09-21T15:07:38.982 INFO:teuthology.orchestra.run.smithi161.stdout:752 writesame 0x30b8c5e thru 0x30c2550 data_size 0x29(0x98f3 bytes) 2024-09-21T15:07:38.982 INFO:teuthology.orchestra.run.smithi161.stdout:990 punch from 0x1528ff3 to 0x1535ae3, (0xcaf0 bytes) 2024-09-21T15:07:38.982 INFO:teuthology.orchestra.run.smithi161.stdout:991 punch from 0x80f3a05 to 0x8100d29, (0xd324 bytes) 2024-09-21T15:07:38.982 INFO:teuthology.orchestra.run.smithi161.stdout:993 write 0x22513fd thru 0x225be19 (0xaa1d bytes) 2024-09-21T15:07:38.988 INFO:teuthology.orchestra.run.smithi161.stdout:724 write 0x88b7aa2 thru 0x88bebcf (0x712e bytes) 2024-09-21T15:07:39.001 INFO:teuthology.orchestra.run.smithi161.stdout:753 read 0x4175bb3 thru 0x417cab2 (0x6f00 bytes) 2024-09-21T15:07:39.002 INFO:teuthology.orchestra.run.smithi161.stdout:754 read 0x5d5b382 thru 0x5d6afc4 (0xfc43 bytes) 2024-09-21T15:07:39.002 INFO:teuthology.orchestra.run.smithi161.stdout:755 read 0xbf0a31e thru 0xbf159d6 (0xb6b9 bytes) 2024-09-21T15:07:39.003 INFO:teuthology.orchestra.run.smithi161.stdout:756 read 0x7b435cc thru 0x7b4ebf6 (0xb62b bytes) 2024-09-21T15:07:39.003 INFO:teuthology.orchestra.run.smithi161.stdout:757 writesame 0x424e217 thru 0x42557c2 data_size 0x22(0x75ac bytes) 2024-09-21T15:07:39.028 INFO:teuthology.orchestra.run.smithi161.stdout:725 read 0x6d4c40e thru 0x6d524a2 (0x6095 bytes) 2024-09-21T15:07:39.028 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.028 INFO:teuthology.orchestra.run.smithi161.stdout:729 write 0x86a4827 thru 0x86b2008 (0xd7e2 bytes) 2024-09-21T15:07:39.039 INFO:teuthology.orchestra.run.smithi161.stdout:758 write 0x3548376 thru 0x3556534 (0xe1bf bytes) 2024-09-21T15:07:39.048 INFO:teuthology.orchestra.run.smithi161.stdout:733 read 0x5ff56e0 thru 0x5ff8b22 (0x3443 bytes) 2024-09-21T15:07:39.048 INFO:teuthology.orchestra.run.smithi161.stdout:734 punch from 0x575addf to 0x5762c96, (0x7eb7 bytes) 2024-09-21T15:07:39.049 INFO:teuthology.orchestra.run.smithi161.stdout:735 punch from 0xba65fa0 to 0xba69887, (0x38e7 bytes) 2024-09-21T15:07:39.049 INFO:teuthology.orchestra.run.smithi161.stdout:737 write 0x2c61dff thru 0x2c6e153 (0xc355 bytes) 2024-09-21T15:07:39.065 INFO:teuthology.orchestra.run.smithi161.stdout:738 writesame 0xbe432e2 thru 0xbe48df8 data_size 0x3(0x5b17 bytes) 2024-09-21T15:07:39.128 INFO:teuthology.orchestra.run.smithi161.stdout:741 punch from 0x74dc427 to 0x74e8823, (0xc3fc bytes) 2024-09-21T15:07:39.128 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.129 INFO:teuthology.orchestra.run.smithi161.stdout:743 write 0x5f83263 thru 0x5f89bcf (0x696d bytes) 2024-09-21T15:07:39.134 INFO:teuthology.orchestra.run.smithi161.stdout:760 read 0x3e57763 thru 0x3e57d3b (0x5d9 bytes) 2024-09-21T15:07:39.135 INFO:teuthology.orchestra.run.smithi161.stdout:761 writesame 0xa4d07bd thru 0xa4e0555 data_size 0x1(0xfd99 bytes) 2024-09-21T15:07:39.142 INFO:teuthology.orchestra.run.smithi161.stdout:746 write 0x8a6906e thru 0x8a7730c (0xe29f bytes) 2024-09-21T15:07:39.150 INFO:teuthology.orchestra.run.smithi161.stdout:994 write 0xcbda547 thru 0xcbe8943 (0xe3fd bytes) 2024-09-21T15:07:39.171 INFO:teuthology.orchestra.run.smithi161.stdout:747 write 0x8235540 thru 0x823d3a7 (0x7e68 bytes) 2024-09-21T15:07:39.179 INFO:teuthology.orchestra.run.smithi161.stdout:762 read 0xb6d09a6 thru 0xb6d4ceb (0x4346 bytes) 2024-09-21T15:07:39.180 INFO:teuthology.orchestra.run.smithi161.stdout:763 clone 12 order 19 su 4096 sc 2 2024-09-21T15:07:39.191 INFO:teuthology.orchestra.run.smithi161.stdout:748 read 0x2f0ffdd thru 0x2f199f2 (0x9a16 bytes) 2024-09-21T15:07:39.197 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #4, image image_cluster1.client.mirror.1-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent5 2024-09-21T15:07:39.203 INFO:teuthology.orchestra.run.smithi161.stdout:750 trunc from 0xc0a9e59 to 0x75e9088 2024-09-21T15:07:39.207 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #4, image image_cluster1.client.mirror.2-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent5 2024-09-21T15:07:39.217 INFO:teuthology.orchestra.run.smithi161.stdout:995 write 0xd560f3f thru 0xd56f630 (0xe6f2 bytes) 2024-09-21T15:07:39.246 INFO:teuthology.orchestra.run.smithi161.stdout:996 read 0x424d861 thru 0x4252d8f (0x552f bytes) 2024-09-21T15:07:39.247 INFO:teuthology.orchestra.run.smithi161.stdout:997 read 0xc2b84be thru 0xc2c4803 (0xc346 bytes) 2024-09-21T15:07:39.255 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.255 INFO:teuthology.orchestra.run.smithi161.stdout:752 read 0x74afb79 thru 0x74b6f3d (0x73c5 bytes) 2024-09-21T15:07:39.255 INFO:teuthology.orchestra.run.smithi161.stdout:753 read 0x5eed21f thru 0x5eee642 (0x1424 bytes) 2024-09-21T15:07:39.255 INFO:teuthology.orchestra.run.smithi161.stdout:754 read 0x1604528 thru 0x1610579 (0xc052 bytes) 2024-09-21T15:07:39.256 INFO:teuthology.orchestra.run.smithi161.stdout:755 punch from 0x13e174d to 0x13e6576, (0x4e29 bytes) 2024-09-21T15:07:39.256 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.256 INFO:teuthology.orchestra.run.smithi161.stdout:759 write 0x287da8a thru 0x28853b1 (0x7928 bytes) 2024-09-21T15:07:39.266 INFO:teuthology.orchestra.run.smithi161.stdout:998 trunc from 0xd56f631 to 0x3c0c35c 2024-09-21T15:07:39.276 INFO:teuthology.orchestra.run.smithi161.stdout:760 punch from 0xc54a93 to 0xc60a93, (0xc000 bytes) 2024-09-21T15:07:39.276 INFO:teuthology.orchestra.run.smithi161.stdout:761 read 0x133c35b thru 0x1340c3b (0x48e1 bytes) 2024-09-21T15:07:39.292 INFO:teuthology.orchestra.run.smithi161.stdout:763 trunc from 0x75e9088 to 0xe691dd3 2024-09-21T15:07:39.352 INFO:teuthology.orchestra.run.smithi161.stdout:764 read 0x2e43b67 thru 0x2e4d3f1 (0x988b bytes) 2024-09-21T15:07:39.357 INFO:teuthology.orchestra.run.smithi161.stdout:765 trunc from 0xe691dd3 to 0xbbea526 2024-09-21T15:07:39.364 INFO:teuthology.orchestra.run.smithi161.stdout:999 punch from 0x2d8837d to 0x2d9448f, (0xc112 bytes) 2024-09-21T15:07:39.365 INFO:teuthology.orchestra.run.smithi161.stdout:1001 read 0x520bb9 thru 0x52c72b (0xbb73 bytes) 2024-09-21T15:07:39.368 INFO:teuthology.orchestra.run.smithi161.stdout:1002 read 0x165e979 thru 0x1662602 (0x3c8a bytes) 2024-09-21T15:07:39.379 INFO:teuthology.orchestra.run.smithi161.stdout:766 read 0x9e3cdc4 thru 0x9e42a66 (0x5ca3 bytes) 2024-09-21T15:07:39.379 INFO:teuthology.orchestra.run.smithi161.stdout:768 write 0x355b18d thru 0x355fa83 (0x48f7 bytes) 2024-09-21T15:07:39.385 INFO:teuthology.orchestra.run.smithi161.stdout:1003 trunc from 0x3c0c35c to 0xbe333bc 2024-09-21T15:07:39.388 INFO:teuthology.orchestra.run.smithi161.stdout:769 writesame 0x264089f thru 0x264323e data_size 0x4a(0x29a0 bytes) 2024-09-21T15:07:39.401 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.401 INFO:teuthology.orchestra.run.smithi161.stdout:772 write 0xbb2281 thru 0xbbc695 (0xa415 bytes) 2024-09-21T15:07:39.408 INFO:teuthology.orchestra.run.smithi161.stdout:1004 write 0x1fbe6a3 thru 0x1fc7949 (0x92a7 bytes) 2024-09-21T15:07:39.410 INFO:teuthology.orchestra.run.smithi161.stdout:773 read 0x959c13b thru 0x95a79a1 (0xb867 bytes) 2024-09-21T15:07:39.411 INFO:teuthology.orchestra.run.smithi161.stdout:774 write 0x726d0e8 thru 0x72739fb (0x6914 bytes) 2024-09-21T15:07:39.433 INFO:teuthology.orchestra.run.smithi161.stdout:777 writesame 0x2a2b430 thru 0x2a2f826 data_size 0x1(0x43f7 bytes) 2024-09-21T15:07:39.447 INFO:teuthology.orchestra.run.smithi161.stdout:1005 read 0x19d074d thru 0x19dc21f (0xbad3 bytes) 2024-09-21T15:07:39.449 INFO:teuthology.orchestra.run.smithi161.stdout:1006 write 0x5cd70d4 thru 0x5ce5ba2 (0xeacf bytes) 2024-09-21T15:07:39.450 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.450 INFO:teuthology.orchestra.run.smithi161.stdout:780 writesame 0x1412112 thru 0x14126b5 data_size 0x4(0x5a4 bytes) 2024-09-21T15:07:39.459 INFO:teuthology.orchestra.run.smithi161.stdout:781 write 0x653208d thru 0x653c078 (0x9fec bytes) 2024-09-21T15:07:39.475 INFO:teuthology.orchestra.run.smithi161.stdout:1007 trunc from 0xbe333bc to 0xc06efdf 2024-09-21T15:07:39.478 INFO:teuthology.orchestra.run.smithi161.stdout:783 flatten 2024-09-21T15:07:39.501 INFO:teuthology.orchestra.run.smithi161.stdout:1008 read 0x5e73dcd thru 0x5e75f21 (0x2155 bytes) 2024-09-21T15:07:39.501 INFO:teuthology.orchestra.run.smithi161.stdout:1009 punch from 0x6f3195e to 0x6f41012, (0xf6b4 bytes) 2024-09-21T15:07:39.501 INFO:teuthology.orchestra.run.smithi161.stdout:1011 read 0x472fa8f thru 0x473045b (0x9cd bytes) 2024-09-21T15:07:39.501 INFO:teuthology.orchestra.run.smithi161.stdout:1012 write 0x8226ab7 thru 0x8234379 (0xd8c3 bytes) 2024-09-21T15:07:39.548 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.548 INFO:teuthology.orchestra.run.smithi161.stdout:1015 writesame 0xb09b5d7 thru 0xb0ab4fe data_size 0xb8(0xff28 bytes) 2024-09-21T15:07:39.567 INFO:teuthology.orchestra.run.smithi161.stdout:1016 punch from 0xbb2e23 to 0xbb6071, (0x324e bytes) 2024-09-21T15:07:39.573 INFO:teuthology.orchestra.run.smithi161.stdout:1017 trunc from 0xc06efdf to 0x8d273a9 2024-09-21T15:07:39.584 INFO:teuthology.orchestra.run.smithi161.stdout:785 write 0x601e6ce thru 0x6021fdc (0x390f bytes) 2024-09-21T15:07:39.601 INFO:teuthology.orchestra.run.smithi161.stdout:786 read 0x7ce53e7 thru 0x7ce6ead (0x1ac7 bytes) 2024-09-21T15:07:39.601 INFO:teuthology.orchestra.run.smithi161.stdout:787 read 0x7fa9206 thru 0x7faf7a2 (0x659d bytes) 2024-09-21T15:07:39.604 INFO:teuthology.orchestra.run.smithi161.stdout:788 trunc from 0xbbea526 to 0xcc56436 2024-09-21T15:07:39.619 INFO:teuthology.orchestra.run.smithi161.stdout:1018 punch from 0x661e2e to 0x669acc, (0x7c9e bytes) 2024-09-21T15:07:39.619 INFO:teuthology.orchestra.run.smithi161.stdout:1019 write 0x18c166e thru 0x18cabd2 (0x9565 bytes) 2024-09-21T15:07:39.625 INFO:teuthology.orchestra.run.smithi161.stdout:1020 write 0x40bfda0 thru 0x40cc3a3 (0xc604 bytes) 2024-09-21T15:07:39.658 INFO:teuthology.orchestra.run.smithi161.stdout:789 writesame 0x4e093ad thru 0x4e1232e data_size 0x27(0x8f82 bytes) 2024-09-21T15:07:39.668 INFO:teuthology.orchestra.run.smithi161.stdout:1020 trunc from 0x8d273a9 to 0x3b5d433 2024-09-21T15:07:39.675 INFO:teuthology.orchestra.run.smithi161.stdout:790 read 0x82c2148 thru 0x82cb35d (0x9216 bytes) 2024-09-21T15:07:39.681 INFO:teuthology.orchestra.run.smithi161.stdout:791 read 0xc3f499e thru 0xc3f513f (0x7a2 bytes) 2024-09-21T15:07:39.681 INFO:teuthology.orchestra.run.smithi161.stdout:792 write 0x309bbc2 thru 0x309fe7f (0x42be bytes) 2024-09-21T15:07:39.696 INFO:teuthology.orchestra.run.smithi161.stdout:793 read 0x34736a5 thru 0x347611c (0x2a78 bytes) 2024-09-21T15:07:39.696 INFO:teuthology.orchestra.run.smithi161.stdout:794 read 0x2582288 thru 0x2585d48 (0x3ac1 bytes) 2024-09-21T15:07:39.730 INFO:teuthology.orchestra.run.smithi161.stdout:1309 writesame 0xc9bb6bc thru 0xc9c438d data_size 0x46(0x8cd2 bytes) 2024-09-21T15:07:39.745 INFO:teuthology.orchestra.run.smithi161.stdout:795 writesame 0xebf40a6 thru 0xebf6c26 data_size 0x25(0x2b81 bytes) 2024-09-21T15:07:39.748 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.748 INFO:teuthology.orchestra.run.smithi161.stdout:799 write 0x15d4f6d thru 0x15ded66 (0x9dfa bytes) 2024-09-21T15:07:39.755 INFO:teuthology.orchestra.run.smithi161.stdout:1021 read 0xd258e2 thru 0xd25f24 (0x643 bytes) 2024-09-21T15:07:39.756 INFO:teuthology.orchestra.run.smithi161.stdout:1310 read 0x84e2c56 thru 0x84f2ab1 (0xfe5c bytes) 2024-09-21T15:07:39.759 INFO:teuthology.orchestra.run.smithi161.stdout:1311 trunc from 0xdb62c5e to 0xe770207 2024-09-21T15:07:39.762 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.762 INFO:teuthology.orchestra.run.smithi161.stdout:801 write 0xd06fa79 thru 0xd077f86 (0x850e bytes) 2024-09-21T15:07:39.777 INFO:teuthology.orchestra.run.smithi161.stdout:802 punch from 0x1f0d4ff to 0x1f0dbf4, (0x6f5 bytes) 2024-09-21T15:07:39.777 INFO:teuthology.orchestra.run.smithi161.stdout:803 writesame 0x506774c thru 0x506aa3c data_size 0x1b(0x32f1 bytes) 2024-09-21T15:07:39.788 INFO:teuthology.orchestra.run.smithi161.stdout:804 write 0xe63aeaf thru 0xe63d354 (0x24a6 bytes) 2024-09-21T15:07:39.792 INFO:teuthology.orchestra.run.smithi161.stdout:1312 punch from 0x9b072f3 to 0x9b16ced, (0xf9fa bytes) 2024-09-21T15:07:39.792 INFO:teuthology.orchestra.run.smithi161.stdout:1313 write 0x35ac354 thru 0x35aed5f (0x2a0c bytes) 2024-09-21T15:07:39.794 INFO:teuthology.orchestra.run.smithi161.stdout:1022 writesame 0x9d9b1b4 thru 0x9d9d52e data_size 0x1(0x237b bytes) 2024-09-21T15:07:39.799 INFO:teuthology.orchestra.run.smithi161.stdout:1023 punch from 0x52c972e to 0x52ca32f, (0xc01 bytes) 2024-09-21T15:07:39.799 INFO:teuthology.orchestra.run.smithi161.stdout:1024 punch from 0x893e306 to 0x893ea69, (0x763 bytes) 2024-09-21T15:07:39.799 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.799 INFO:teuthology.orchestra.run.smithi161.stdout:1030 punch from 0x6e3c813 to 0x6e4874d, (0xbf3a bytes) 2024-09-21T15:07:39.800 INFO:teuthology.orchestra.run.smithi161.stdout:1032 writesame 0x45b7cd7 thru 0x45ba728 data_size 0x1(0x2a52 bytes) 2024-09-21T15:07:39.804 INFO:teuthology.orchestra.run.smithi161.stdout:805 write 0x872a958 thru 0x872cc16 (0x22bf bytes) 2024-09-21T15:07:39.814 INFO:teuthology.orchestra.run.smithi161.stdout:1315 writesame 0x6386583 thru 0x638890a data_size 0xc(0x2388 bytes) 2024-09-21T15:07:39.820 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.820 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.820 INFO:teuthology.orchestra.run.smithi161.stdout:1035 write 0x2c78178 thru 0x2c85ea4 (0xdd2d bytes) 2024-09-21T15:07:39.822 INFO:teuthology.orchestra.run.smithi161.stdout:806 read 0xb599e67 thru 0xb5a4dd7 (0xaf71 bytes) 2024-09-21T15:07:39.822 INFO:teuthology.orchestra.run.smithi161.stdout:808 read 0x46d8d32 thru 0x46e2a16 (0x9ce5 bytes) 2024-09-21T15:07:39.823 INFO:teuthology.orchestra.run.smithi161.stdout:810 write 0x1ecf8cb thru 0x1ed2b07 (0x323d bytes) 2024-09-21T15:07:39.850 INFO:teuthology.orchestra.run.smithi161.stdout:811 write 0xe81bed2 thru 0xe81c455 (0x584 bytes) 2024-09-21T15:07:39.852 INFO:teuthology.orchestra.run.smithi161.stdout:1316 write 0x22780ab thru 0x22831af (0xb105 bytes) 2024-09-21T15:07:39.854 INFO:teuthology.orchestra.run.smithi161.stdout:1021 write 0xd004f82 thru 0xd00a357 (0x53d6 bytes) 2024-09-21T15:07:39.870 INFO:teuthology.orchestra.run.smithi161.stdout:1036 read 0x14e92bf thru 0x14f8f30 (0xfc72 bytes) 2024-09-21T15:07:39.872 INFO:teuthology.orchestra.run.smithi161.stdout:1038 write 0x2f3c15 thru 0x2ffb84 (0xbf70 bytes) 2024-09-21T15:07:39.873 INFO:teuthology.orchestra.run.smithi161.stdout:813 trunc from 0xebf6c27 to 0x85bf5df 2024-09-21T15:07:39.883 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.883 INFO:teuthology.orchestra.run.smithi161.stdout:1025 write 0x782eb79 thru 0x7833f1d (0x53a5 bytes) 2024-09-21T15:07:39.883 INFO:teuthology.orchestra.run.smithi161.stdout:1317 read 0x2bc5ffd thru 0x2bcd2f9 (0x72fd bytes) 2024-09-21T15:07:39.885 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.885 INFO:teuthology.orchestra.run.smithi161.stdout:1321 punch from 0x4f4cdc8 to 0x4f4e19a, (0x13d2 bytes) 2024-09-21T15:07:39.894 INFO:teuthology.orchestra.run.smithi161.stdout:1322 trunc from 0xe770207 to 0xb2dc819 2024-09-21T15:07:39.904 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.5-clone7 2024-09-21T15:07:39.962 INFO:teuthology.orchestra.run.smithi161.stdout:1039 read 0x8d4c92b thru 0x8d4f9e7 (0x30bd bytes) 2024-09-21T15:07:39.962 INFO:teuthology.orchestra.run.smithi161.stdout:1040 read 0x8d66441 thru 0x8d669b3 (0x573 bytes) 2024-09-21T15:07:39.962 INFO:teuthology.orchestra.run.smithi161.stdout:1041 read 0x3713bcb thru 0x3721e5c (0xe292 bytes) 2024-09-21T15:07:39.962 INFO:teuthology.orchestra.run.smithi161.stdout:1042 read 0x95e89a9 thru 0x95f88a3 (0xfefb bytes) 2024-09-21T15:07:39.963 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:39.963 INFO:teuthology.orchestra.run.smithi161.stdout:1044 read 0x7257711 thru 0x7257d34 (0x624 bytes) 2024-09-21T15:07:39.963 INFO:teuthology.orchestra.run.smithi161.stdout:1045 write 0x2ce07ae thru 0x2cec17f (0xb9d2 bytes) 2024-09-21T15:07:40.019 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.3-clone11 intact 2024-09-21T15:07:40.021 INFO:teuthology.orchestra.run.smithi161.stdout:1026 trunc from 0xd00a358 to 0xd480161 2024-09-21T15:07:40.027 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.028 INFO:teuthology.orchestra.run.smithi161.stdout:815 punch from 0x25158a3 to 0x251aa6a, (0x51c7 bytes) 2024-09-21T15:07:40.028 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.028 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.028 INFO:teuthology.orchestra.run.smithi161.stdout:818 write 0x11dbd30 thru 0x11e7f67 (0xc238 bytes) 2024-09-21T15:07:40.038 INFO:teuthology.orchestra.run.smithi161.stdout:1046 write 0xad4a987 thru 0xad52379 (0x79f3 bytes) 2024-09-21T15:07:40.043 INFO:teuthology.orchestra.run.smithi161.stdout:820 punch from 0x5312719 to 0x531417e, (0x1a65 bytes) 2024-09-21T15:07:40.044 INFO:teuthology.orchestra.run.smithi161.stdout:821 punch from 0x912dd0 to 0x91e7e1, (0xba11 bytes) 2024-09-21T15:07:40.044 INFO:teuthology.orchestra.run.smithi161.stdout:822 read 0x94e6ca thru 0x951d1d (0x3654 bytes) 2024-09-21T15:07:40.057 INFO:teuthology.orchestra.run.smithi161.stdout:1028 read 0xa68903f thru 0xa689ca7 (0xc69 bytes) 2024-09-21T15:07:40.057 INFO:teuthology.orchestra.run.smithi161.stdout:1030 write 0x4645da1 thru 0x464f923 (0x9b83 bytes) 2024-09-21T15:07:40.061 INFO:teuthology.orchestra.run.smithi161.stdout:1047 writesame 0x111474c thru 0x1118acf data_size 0x3a(0x4384 bytes) 2024-09-21T15:07:40.074 INFO:teuthology.orchestra.run.smithi161.stdout:1048 punch from 0x7f890d to 0x801bbd, (0x92b0 bytes) 2024-09-21T15:07:40.074 INFO:teuthology.orchestra.run.smithi161.stdout:1049 read 0x4639361 thru 0x463c775 (0x3415 bytes) 2024-09-21T15:07:40.075 INFO:teuthology.orchestra.run.smithi161.stdout:1050 punch from 0x76848f2 to 0x768ab93, (0x62a1 bytes) 2024-09-21T15:07:40.075 INFO:teuthology.orchestra.run.smithi161.stdout:1051 read 0x6bef30f thru 0x6bfa4a5 (0xb197 bytes) 2024-09-21T15:07:40.075 INFO:teuthology.orchestra.run.smithi161.stdout:1052 read 0x63d89f2 thru 0x63e0ded (0x83fc bytes) 2024-09-21T15:07:40.085 INFO:teuthology.orchestra.run.smithi161.stdout:1323 writesame 0xdbac91e thru 0xdbb0740 data_size 0x1(0x3e23 bytes) 2024-09-21T15:07:40.089 INFO:teuthology.orchestra.run.smithi161.stdout:1055 trunc from 0xad5237a to 0x40a8a25 2024-09-21T15:07:40.091 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.091 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.092 INFO:teuthology.orchestra.run.smithi161.stdout:1326 trunc from 0xdbb0741 to 0xe3bfa9f 2024-09-21T15:07:40.094 INFO:teuthology.orchestra.run.smithi161.stdout:824 write 0xbe531ea thru 0xbe5c610 (0x9427 bytes) 2024-09-21T15:07:40.124 INFO:teuthology.orchestra.run.smithi161.stdout:1327 read 0x4c8f81 thru 0x4cd24f (0x42cf bytes) 2024-09-21T15:07:40.128 INFO:teuthology.orchestra.run.smithi161.stdout:825 read 0x54bde0 thru 0x55aba5 (0xedc6 bytes) 2024-09-21T15:07:40.128 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.128 INFO:teuthology.orchestra.run.smithi161.stdout:827 punch from 0x30885c2 to 0x308940e, (0xe4c bytes) 2024-09-21T15:07:40.128 INFO:teuthology.orchestra.run.smithi161.stdout:828 write 0x80d0c7a thru 0x80d6655 (0x59dc bytes) 2024-09-21T15:07:40.138 INFO:teuthology.orchestra.run.smithi161.stdout:1329 trunc from 0xe3bfa9f to 0x7ab3672 2024-09-21T15:07:40.161 INFO:teuthology.orchestra.run.smithi161.stdout:829 read 0xa9f0c25 thru 0xa9fd688 (0xca64 bytes) 2024-09-21T15:07:40.161 INFO:teuthology.orchestra.run.smithi161.stdout:830 punch from 0x7c0a706 to 0x7c17c1b, (0xd515 bytes) 2024-09-21T15:07:40.161 INFO:teuthology.orchestra.run.smithi161.stdout:831 read 0xacc1b94 thru 0xacc5c1a (0x4087 bytes) 2024-09-21T15:07:40.161 INFO:teuthology.orchestra.run.smithi161.stdout:832 write 0x6f6c6e5 thru 0x6f6f9f3 (0x330f bytes) 2024-09-21T15:07:40.173 INFO:teuthology.orchestra.run.smithi161.stdout:1056 read 0x3ca0984 thru 0x3cab579 (0xabf6 bytes) 2024-09-21T15:07:40.174 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.174 INFO:teuthology.orchestra.run.smithi161.stdout:1059 writesame 0x2b2836b thru 0x2b33b0a data_size 0x71(0xb7a0 bytes) 2024-09-21T15:07:40.198 INFO:teuthology.orchestra.run.smithi161.stdout:1031 punch from 0xb629284 to 0xb639054, (0xfdd0 bytes) 2024-09-21T15:07:40.198 INFO:teuthology.orchestra.run.smithi161.stdout:1032 write 0x5117b74 thru 0x51226fe (0xab8b bytes) 2024-09-21T15:07:40.209 INFO:teuthology.orchestra.run.smithi161.stdout:834 trunc from 0xbe5c611 to 0x2576507 2024-09-21T15:07:40.209 INFO:teuthology.orchestra.run.smithi161.stdout:1060 trunc from 0x40a8a25 to 0xc44db0f 2024-09-21T15:07:40.231 INFO:teuthology.orchestra.run.smithi161.stdout:1330 read 0x73f270b thru 0x73fa109 (0x79ff bytes) 2024-09-21T15:07:40.231 INFO:teuthology.orchestra.run.smithi161.stdout:1331 read 0x422d64f thru 0x4238027 (0xa9d9 bytes) 2024-09-21T15:07:40.310 INFO:teuthology.orchestra.run.smithi161.stdout:1332 writesame 0xec3afb3 thru 0xec47346 data_size 0x2(0xc394 bytes) 2024-09-21T15:07:40.313 INFO:teuthology.orchestra.run.smithi161.stdout:1333 read 0xcb0474f thru 0xcb048ec (0x19e bytes) 2024-09-21T15:07:40.313 INFO:teuthology.orchestra.run.smithi161.stdout:1334 writesame 0x499f8b5 thru 0x49a05c2 data_size 0x3(0xd0e bytes) 2024-09-21T15:07:40.322 INFO:teuthology.orchestra.run.smithi161.stdout:1335 read 0x5fe04c7 thru 0x5fe1b86 (0x16c0 bytes) 2024-09-21T15:07:40.323 INFO:teuthology.orchestra.run.smithi161.stdout:1337 punch from 0x42c2634 to 0x42c9d25, (0x76f1 bytes) 2024-09-21T15:07:40.323 INFO:teuthology.orchestra.run.smithi161.stdout:1338 write 0x14d35f7 thru 0x14e2edd (0xf8e7 bytes) 2024-09-21T15:07:40.339 INFO:teuthology.orchestra.run.smithi161.stdout:1339 write 0x338659a thru 0x3394f1d (0xe984 bytes) 2024-09-21T15:07:40.356 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #6, image image_cluster1.client.mirror.5-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent7 2024-09-21T15:07:40.361 INFO:teuthology.orchestra.run.smithi161.stdout:1340 punch from 0x978884a to 0x9792c1b, (0xa3d1 bytes) 2024-09-21T15:07:40.365 INFO:teuthology.orchestra.run.smithi161.stdout:1033 read 0x6acfc45 thru 0x6ad7d14 (0x80d0 bytes) 2024-09-21T15:07:40.374 INFO:teuthology.orchestra.run.smithi161.stdout:836 punch from 0x9af003 to 0x9b266d, (0x366a bytes) 2024-09-21T15:07:40.374 INFO:teuthology.orchestra.run.smithi161.stdout:837 read 0xadf34b thru 0xae7e10 (0x8ac6 bytes) 2024-09-21T15:07:40.379 INFO:teuthology.orchestra.run.smithi161.stdout:1061 write 0xe7e88fe thru 0xe7edd6d (0x5470 bytes) 2024-09-21T15:07:40.385 INFO:teuthology.orchestra.run.smithi161.stdout:1034 trunc from 0xd480161 to 0x8ed236a 2024-09-21T15:07:40.393 INFO:teuthology.orchestra.run.smithi161.stdout:1063 punch from 0x30bbe62 to 0x30bd5e5, (0x1783 bytes) 2024-09-21T15:07:40.393 INFO:teuthology.orchestra.run.smithi161.stdout:1064 write 0x175b4b3 thru 0x175c83e (0x138c bytes) 2024-09-21T15:07:40.393 INFO:teuthology.orchestra.run.smithi161.stdout:1342 trunc from 0xec47347 to 0x3990df5 2024-09-21T15:07:40.403 INFO:teuthology.orchestra.run.smithi161.stdout:1065 read 0x357289d thru 0x357c4b6 (0x9c1a bytes) 2024-09-21T15:07:40.406 INFO:teuthology.orchestra.run.smithi161.stdout:1066 write 0xbc5afca thru 0xbc5e317 (0x334e bytes) 2024-09-21T15:07:40.423 INFO:teuthology.orchestra.run.smithi161.stdout:838 write 0x91f234c thru 0x91fdaf0 (0xb7a5 bytes) 2024-09-21T15:07:40.440 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.440 INFO:teuthology.orchestra.run.smithi161.stdout:1070 write 0xd9ea90c thru 0xd9f482f (0x9f24 bytes) 2024-09-21T15:07:40.486 INFO:teuthology.orchestra.run.smithi161.stdout:839 read 0x74388f3 thru 0x74398ba (0xfc8 bytes) 2024-09-21T15:07:40.486 INFO:teuthology.orchestra.run.smithi161.stdout:841 write 0x8ce21de thru 0x8ce597f (0x37a2 bytes) 2024-09-21T15:07:40.488 INFO:teuthology.orchestra.run.smithi161.stdout:1071 read 0xc50c15b thru 0xc512161 (0x6007 bytes) 2024-09-21T15:07:40.500 INFO:teuthology.orchestra.run.smithi161.stdout:1344 read 0x1f39b04 thru 0x1f4225f (0x875c bytes) 2024-09-21T15:07:40.501 INFO:teuthology.orchestra.run.smithi161.stdout:1347 read 0x18142e4 thru 0x1822da8 (0xeac5 bytes) 2024-09-21T15:07:40.502 INFO:teuthology.orchestra.run.smithi161.stdout:1348 punch from 0x11849ac to 0x1185455, (0xaa9 bytes) 2024-09-21T15:07:40.502 INFO:teuthology.orchestra.run.smithi161.stdout:1349 read 0x36b5b00 thru 0x36bfa84 (0x9f85 bytes) 2024-09-21T15:07:40.510 INFO:teuthology.orchestra.run.smithi161.stdout:1072 trunc from 0xe7edd6e to 0x3d4a948 2024-09-21T15:07:40.550 INFO:teuthology.orchestra.run.smithi161.stdout:1350 write 0xa71cb59 thru 0xa72bdeb (0xf293 bytes) 2024-09-21T15:07:40.558 INFO:teuthology.orchestra.run.smithi161.stdout:1074 read 0x2506e05 thru 0x2515905 (0xeb01 bytes) 2024-09-21T15:07:40.559 INFO:teuthology.orchestra.run.smithi161.stdout:842 read 0x8935a64 thru 0x893a1aa (0x4747 bytes) 2024-09-21T15:07:40.559 INFO:teuthology.orchestra.run.smithi161.stdout:843 writesame 0x7394e31 thru 0x739b7a8 data_size 0x7d(0x6978 bytes) 2024-09-21T15:07:40.560 INFO:teuthology.orchestra.run.smithi161.stdout:1076 read 0x14ead34 thru 0x14f7058 (0xc325 bytes) 2024-09-21T15:07:40.562 INFO:teuthology.orchestra.run.smithi161.stdout:1078 punch from 0x9c92ad to 0x9d2491, (0x91e4 bytes) 2024-09-21T15:07:40.564 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.564 INFO:teuthology.orchestra.run.smithi161.stdout:1355 read 0x3a4025 thru 0x3b07ed (0xc7c9 bytes) 2024-09-21T15:07:40.581 INFO:teuthology.orchestra.run.smithi161.stdout:844 trunc from 0x91fdaf1 to 0x4ff4447 2024-09-21T15:07:40.596 INFO:teuthology.orchestra.run.smithi161.stdout:1356 writesame 0xc00ac10 thru 0xc01aab0 data_size 0x1(0xfea1 bytes) 2024-09-21T15:07:40.607 INFO:teuthology.orchestra.run.smithi161.stdout:1079 writesame 0xe8be756 thru 0xe8cb6e1 data_size 0x4a(0xcf8c bytes) 2024-09-21T15:07:40.616 INFO:teuthology.orchestra.run.smithi161.stdout:1081 writesame 0xcb255bf thru 0xcb28618 data_size 0x3(0x305a bytes) 2024-09-21T15:07:40.626 INFO:teuthology.orchestra.run.smithi161.stdout:1359 write 0xde86c50 thru 0xde932a8 (0xc659 bytes) 2024-09-21T15:07:40.627 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #10, image image_cluster1.client.mirror.3-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent11 2024-09-21T15:07:40.634 INFO:teuthology.orchestra.run.smithi161.stdout:1083 punch from 0x32d4b9e to 0x32e4b72, (0xffd4 bytes) 2024-09-21T15:07:40.634 INFO:teuthology.orchestra.run.smithi161.stdout:1084 writesame 0x7b54e45 thru 0x7b5d6a5 data_size 0x1(0x8861 bytes) 2024-09-21T15:07:40.640 INFO:teuthology.orchestra.run.smithi161.stdout:845 trunc from 0x4ff4447 to 0xd2963e0 2024-09-21T15:07:40.655 INFO:teuthology.orchestra.run.smithi161.stdout:1360 trunc from 0xde932a9 to 0x4a9168d 2024-09-21T15:07:40.656 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.656 INFO:teuthology.orchestra.run.smithi161.stdout:1086 write 0xda0fb1 thru 0xda3042 (0x2092 bytes) 2024-09-21T15:07:40.660 INFO:teuthology.orchestra.run.smithi161.stdout:1087 punch from 0xb38cde7 to 0xb3918f9, (0x4b12 bytes) 2024-09-21T15:07:40.666 INFO:teuthology.orchestra.run.smithi161.stdout:846 write 0x696d84a thru 0x697d5dc (0xfd93 bytes) 2024-09-21T15:07:40.670 INFO:teuthology.orchestra.run.smithi161.stdout:1088 trunc from 0xe8cb6e2 to 0x815b4dd 2024-09-21T15:07:40.678 INFO:teuthology.orchestra.run.smithi161.stdout:847 writesame 0x2a83d75 thru 0x2a87ec2 data_size 0xd(0x414e bytes) 2024-09-21T15:07:40.687 INFO:teuthology.orchestra.run.smithi161.stdout:849 write 0xbd7e40c thru 0xbd8b276 (0xce6b bytes) 2024-09-21T15:07:40.704 INFO:teuthology.orchestra.run.smithi161.stdout:850 trunc from 0xd2963e0 to 0xb94ecc7 2024-09-21T15:07:40.722 INFO:teuthology.orchestra.run.smithi161.stdout:1090 trunc from 0x815b4dd to 0x5f2c4e8 2024-09-21T15:07:40.785 INFO:teuthology.orchestra.run.smithi161.stdout:1361 writesame 0x91936f1 thru 0x9199835 data_size 0x1(0x6145 bytes) 2024-09-21T15:07:40.789 INFO:teuthology.orchestra.run.smithi161.stdout:1362 write 0x85cf125 thru 0x85d8553 (0x942f bytes) 2024-09-21T15:07:40.801 INFO:teuthology.orchestra.run.smithi161.stdout:1364 write 0x4f27c02 thru 0x4f306f0 (0x8aef bytes) 2024-09-21T15:07:40.812 INFO:teuthology.orchestra.run.smithi161.stdout:851 read 0x4c655c9 thru 0x4c72383 (0xcdbb bytes) 2024-09-21T15:07:40.812 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.812 INFO:teuthology.orchestra.run.smithi161.stdout:853 writesame 0x7c392e1 thru 0x7c39723 data_size 0x1(0x443 bytes) 2024-09-21T15:07:40.817 INFO:teuthology.orchestra.run.smithi161.stdout:1365 write 0x1bff585 thru 0x1c029ea (0x3466 bytes) 2024-09-21T15:07:40.829 INFO:teuthology.orchestra.run.smithi161.stdout:1036 punch from 0x65afbed to 0x65baa52, (0xae65 bytes) 2024-09-21T15:07:40.829 INFO:teuthology.orchestra.run.smithi161.stdout:1037 writesame 0x45d3426 thru 0x45d70a3 data_size 0x3a(0x3c7e bytes) 2024-09-21T15:07:40.831 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.843 INFO:teuthology.orchestra.run.smithi161.stdout:1368 trunc from 0x9199836 to 0x2b8ffef 2024-09-21T15:07:40.852 INFO:teuthology.orchestra.run.smithi161.stdout:854 write 0x952af13 thru 0x9536c1d (0xbd0b bytes) 2024-09-21T15:07:40.852 INFO:teuthology.orchestra.run.smithi161.stdout:1038 trunc from 0x8ed236a to 0xb855608 2024-09-21T15:07:40.859 INFO:teuthology.orchestra.run.smithi161.stdout:1094 punch from 0x2631fcc to 0x263464f, (0x2683 bytes) 2024-09-21T15:07:40.862 INFO:teuthology.orchestra.run.smithi161.stdout:855 punch from 0x45af895 to 0x45b4a58, (0x51c3 bytes) 2024-09-21T15:07:40.877 INFO:teuthology.orchestra.run.smithi161.stdout:1039 writesame 0xb302aa3 thru 0xb311218 data_size 0x56(0xe776 bytes) 2024-09-21T15:07:40.880 INFO:teuthology.orchestra.run.smithi161.stdout:856 trunc from 0xb94ecc7 to 0x1197125 2024-09-21T15:07:40.886 INFO:teuthology.orchestra.run.smithi161.stdout:1095 writesame 0x96d5f9d thru 0x96dbccf data_size 0x21(0x5d33 bytes) 2024-09-21T15:07:40.887 INFO:teuthology.orchestra.run.smithi161.stdout:691 punch from 0xb80b0e3 to 0xb81a052, (0xef6f bytes) 2024-09-21T15:07:40.890 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.890 INFO:teuthology.orchestra.run.smithi161.stdout:1099 punch from 0x7e6e2d to 0x7ea575, (0x3748 bytes) 2024-09-21T15:07:40.890 INFO:teuthology.orchestra.run.smithi161.stdout:1101 writesame 0x3cf4a7e thru 0x3d023c9 data_size 0x2(0xd94c bytes) 2024-09-21T15:07:40.901 INFO:teuthology.orchestra.run.smithi161.stdout:1040 trunc from 0xb855608 to 0x7a40468 2024-09-21T15:07:40.909 INFO:teuthology.orchestra.run.smithi161.stdout:1102 writesame 0x8a20b98 thru 0x8a24238 data_size 0x1(0x36a1 bytes) 2024-09-21T15:07:40.918 INFO:teuthology.orchestra.run.smithi161.stdout:694 write 0x5851d14 thru 0x585ef9b (0xd288 bytes) 2024-09-21T15:07:40.942 INFO:teuthology.orchestra.run.smithi161.stdout:1103 trunc from 0x96dbcd0 to 0xc19959d 2024-09-21T15:07:40.950 INFO:teuthology.orchestra.run.smithi161.stdout:1370 writesame 0x95ba715 thru 0x95c1b5c data_size 0x3d(0x7448 bytes) 2024-09-21T15:07:40.963 INFO:teuthology.orchestra.run.smithi161.stdout:1371 write 0x31e53c2 thru 0x31f12a6 (0xbee5 bytes) 2024-09-21T15:07:40.986 INFO:teuthology.orchestra.run.smithi161.stdout:1372 write 0x910ac7f thru 0x9112304 (0x7686 bytes) 2024-09-21T15:07:40.991 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:40.995 INFO:teuthology.orchestra.run.smithi161.stdout:699 read 0x3a1b61e thru 0x3a23fa3 (0x8986 bytes) 2024-09-21T15:07:40.996 INFO:teuthology.orchestra.run.smithi161.stdout:700 read 0x34e316c thru 0x34ecfb1 (0x9e46 bytes) 2024-09-21T15:07:40.997 INFO:teuthology.orchestra.run.smithi161.stdout:701 write 0x764c226 thru 0x7650466 (0x4241 bytes) 2024-09-21T15:07:41.011 INFO:teuthology.orchestra.run.smithi161.stdout:1374 trunc from 0x95c1b5d to 0x233aba0 2024-09-21T15:07:41.013 INFO:teuthology.orchestra.run.smithi161.stdout:1104 write 0x9e3b7f1 thru 0x9e43d34 (0x8544 bytes) 2024-09-21T15:07:41.023 INFO:teuthology.orchestra.run.smithi161.stdout:765 write 0x1953ba3 thru 0x195b705 (0x7b63 bytes) 2024-09-21T15:07:41.036 INFO:teuthology.orchestra.run.smithi161.stdout:860 write 0x6854ecc thru 0x6859d5e (0x4e93 bytes) 2024-09-21T15:07:41.042 INFO:teuthology.orchestra.run.smithi161.stdout:1105 read 0x5421c70 thru 0x542ff74 (0xe305 bytes) 2024-09-21T15:07:41.042 INFO:teuthology.orchestra.run.smithi161.stdout:702 read 0x119edb8 thru 0x11aa984 (0xbbcd bytes) 2024-09-21T15:07:41.042 INFO:teuthology.orchestra.run.smithi161.stdout:1106 read 0x798edba thru 0x79904fe (0x1745 bytes) 2024-09-21T15:07:41.042 INFO:teuthology.orchestra.run.smithi161.stdout:1107 write 0xa4b8f60 thru 0xa4c2d6f (0x9e10 bytes) 2024-09-21T15:07:41.044 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.044 INFO:teuthology.orchestra.run.smithi161.stdout:705 punch from 0xb3489ef to 0xb353faf, (0xb5c0 bytes) 2024-09-21T15:07:41.044 INFO:teuthology.orchestra.run.smithi161.stdout:706 write 0x66f9818 thru 0x670101b (0x7804 bytes) 2024-09-21T15:07:41.054 INFO:teuthology.orchestra.run.smithi161.stdout:861 writesame 0x429f9e4 thru 0x42ad1e1 data_size 0x1(0xd7fe bytes) 2024-09-21T15:07:41.137 INFO:teuthology.orchestra.run.smithi161.stdout:1377 punch from 0x154cf06 to 0x155136f, (0x4469 bytes) 2024-09-21T15:07:41.146 INFO:teuthology.orchestra.run.smithi161.stdout:766 read 0x8ed4ab thru 0x8f6ec2 (0x9a18 bytes) 2024-09-21T15:07:41.147 INFO:teuthology.orchestra.run.smithi161.stdout:1042 read 0x6615b1 thru 0x664c0f (0x365f bytes) 2024-09-21T15:07:41.150 INFO:teuthology.orchestra.run.smithi161.stdout:767 read 0x6cc4f36 thru 0x6cc9796 (0x4861 bytes) 2024-09-21T15:07:41.151 INFO:teuthology.orchestra.run.smithi161.stdout:768 write 0x723fa36 thru 0x7246bc4 (0x718f bytes) 2024-09-21T15:07:41.155 INFO:teuthology.orchestra.run.smithi161.stdout:1044 trunc from 0x7a40468 to 0x583b4fd 2024-09-21T15:07:41.162 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.162 INFO:teuthology.orchestra.run.smithi161.stdout:708 read 0x5941c88 thru 0x594857d (0x68f6 bytes) 2024-09-21T15:07:41.177 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.177 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.177 INFO:teuthology.orchestra.run.smithi161.stdout:866 read 0x53be84c thru 0x53c2e9b (0x4650 bytes) 2024-09-21T15:07:41.177 INFO:teuthology.orchestra.run.smithi161.stdout:867 read 0x497da8c thru 0x4982d9a (0x530f bytes) 2024-09-21T15:07:41.177 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.186 INFO:teuthology.orchestra.run.smithi161.stdout:709 trunc from 0xc158b51 to 0x2cd9e59 2024-09-21T15:07:41.197 INFO:teuthology.orchestra.run.smithi161.stdout:1108 write 0xdbdd1ff thru 0xdbe8c6c (0xba6e bytes) 2024-09-21T15:07:41.202 INFO:teuthology.orchestra.run.smithi161.stdout:1378 write 0xbed22f0 thru 0xbed6bd2 (0x48e3 bytes) 2024-09-21T15:07:41.225 INFO:teuthology.orchestra.run.smithi161.stdout:1045 punch from 0x2080d to 0x2135c, (0xb4f bytes) 2024-09-21T15:07:41.229 INFO:teuthology.orchestra.run.smithi161.stdout:1379 punch from 0x99f0aa4 to 0x99f2141, (0x169d bytes) 2024-09-21T15:07:41.229 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.229 INFO:teuthology.orchestra.run.smithi161.stdout:1381 read 0x3a3da15 thru 0x3a4ccf2 (0xf2de bytes) 2024-09-21T15:07:41.229 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.230 INFO:teuthology.orchestra.run.smithi161.stdout:1383 writesame 0x48a78db thru 0x48af441 data_size 0x1(0x7b67 bytes) 2024-09-21T15:07:41.230 INFO:teuthology.orchestra.run.smithi161.stdout:1109 write 0x23b2320 thru 0x23ba347 (0x8028 bytes) 2024-09-21T15:07:41.237 INFO:teuthology.orchestra.run.smithi161.stdout:769 trunc from 0xddcaaf2 to 0x8edd53c 2024-09-21T15:07:41.279 INFO:teuthology.orchestra.run.smithi161.stdout:869 write 0xd34f8e5 thru 0xd359562 (0x9c7e bytes) 2024-09-21T15:07:41.289 INFO:teuthology.orchestra.run.smithi161.stdout:1385 read 0x4ed07ff thru 0x4ed9ae6 (0x92e8 bytes) 2024-09-21T15:07:41.289 INFO:teuthology.orchestra.run.smithi161.stdout:1386 write 0x8ea0d10 thru 0x8eaed56 (0xe047 bytes) 2024-09-21T15:07:41.296 INFO:teuthology.orchestra.run.smithi161.stdout:1046 write 0x5da55b9 thru 0x5dae6e7 (0x912f bytes) 2024-09-21T15:07:41.302 INFO:teuthology.orchestra.run.smithi161.stdout:871 write 0xae9c670 thru 0xaea1384 (0x4d15 bytes) 2024-09-21T15:07:41.308 INFO:teuthology.orchestra.run.smithi161.stdout:1387 write 0x253af79 thru 0x253afb7 (0x3f bytes) 2024-09-21T15:07:41.308 INFO:teuthology.orchestra.run.smithi161.stdout:1111 write 0xab8aa0a thru 0xab8d265 (0x285c bytes) 2024-09-21T15:07:41.320 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.320 INFO:teuthology.orchestra.run.smithi161.stdout:874 read 0x7500322 thru 0x7503ca7 (0x3986 bytes) 2024-09-21T15:07:41.321 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.321 INFO:teuthology.orchestra.run.smithi161.stdout:875 punch from 0x38f6184 to 0x38f9775, (0x35f1 bytes) 2024-09-21T15:07:41.321 INFO:teuthology.orchestra.run.smithi161.stdout:877 write 0xa1885f2 thru 0xa18870f (0x11e bytes) 2024-09-21T15:07:41.322 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.322 INFO:teuthology.orchestra.run.smithi161.stdout:1049 punch from 0xd8d64f to 0xd95749, (0x80fa bytes) 2024-09-21T15:07:41.322 INFO:teuthology.orchestra.run.smithi161.stdout:770 punch from 0x496c718 to 0x496fc14, (0x34fc bytes) 2024-09-21T15:07:41.323 INFO:teuthology.orchestra.run.smithi161.stdout:1050 read 0x1f9d7d thru 0x204d97 (0xb01b bytes) 2024-09-21T15:07:41.323 INFO:teuthology.orchestra.run.smithi161.stdout:771 read 0x728bb6a thru 0x7292afc (0x6f93 bytes) 2024-09-21T15:07:41.324 INFO:teuthology.orchestra.run.smithi161.stdout:1389 trunc from 0xbed6bd3 to 0xa6a6526 2024-09-21T15:07:41.327 INFO:teuthology.orchestra.run.smithi161.stdout:1112 read 0x9434c66 thru 0x943ddd4 (0x916f bytes) 2024-09-21T15:07:41.327 INFO:teuthology.orchestra.run.smithi161.stdout:1113 writesame 0x8b94743 thru 0x8b94c93 data_size 0x1(0x551 bytes) 2024-09-21T15:07:41.333 INFO:teuthology.orchestra.run.smithi161.stdout:711 punch from 0x29afeb4 to 0x29b5f08, (0x6054 bytes) 2024-09-21T15:07:41.333 INFO:teuthology.orchestra.run.smithi161.stdout:878 punch from 0x2182830 to 0x21858ae, (0x307e bytes) 2024-09-21T15:07:41.333 INFO:teuthology.orchestra.run.smithi161.stdout:879 write 0x9ce9fa3 thru 0x9cea5f6 (0x654 bytes) 2024-09-21T15:07:41.333 INFO:teuthology.orchestra.run.smithi161.stdout:712 write 0x16c06fb thru 0x16cebdc (0xe4e2 bytes) 2024-09-21T15:07:41.339 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.352 INFO:teuthology.orchestra.run.smithi161.stdout:880 writesame 0xc6440a3 thru 0xc646026 data_size 0x2(0x1f84 bytes) 2024-09-21T15:07:41.374 INFO:teuthology.orchestra.run.smithi161.stdout:881 punch from 0xc4f4511 to 0xc4feea6, (0xa995 bytes) 2024-09-21T15:07:41.374 INFO:teuthology.orchestra.run.smithi161.stdout:882 punch from 0xbaf73dd to 0xbb04022, (0xcc45 bytes) 2024-09-21T15:07:41.374 INFO:teuthology.orchestra.run.smithi161.stdout:883 punch from 0xcded1e7 to 0xcdf8e5d, (0xbc76 bytes) 2024-09-21T15:07:41.374 INFO:teuthology.orchestra.run.smithi161.stdout:885 read 0x18e8d0b thru 0x18eaf9d (0x2293 bytes) 2024-09-21T15:07:41.374 INFO:teuthology.orchestra.run.smithi161.stdout:887 read 0xc506d91 thru 0xc50c916 (0x5b86 bytes) 2024-09-21T15:07:41.374 INFO:teuthology.orchestra.run.smithi161.stdout:888 write 0x890f4c9 thru 0x891d498 (0xdfd0 bytes) 2024-09-21T15:07:41.379 INFO:teuthology.orchestra.run.smithi161.stdout:1115 write 0xe2160de thru 0xe21a538 (0x445b bytes) 2024-09-21T15:07:41.384 INFO:teuthology.orchestra.run.smithi161.stdout:1390 read 0x470c254 thru 0x47155fb (0x93a8 bytes) 2024-09-21T15:07:41.385 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.385 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.385 INFO:teuthology.orchestra.run.smithi161.stdout:1395 write 0x2b1503 thru 0x2c01e3 (0xece1 bytes) 2024-09-21T15:07:41.387 INFO:teuthology.orchestra.run.smithi161.stdout:772 writesame 0xd4e8980 thru 0xd4f697b data_size 0x3d(0xdffc bytes) 2024-09-21T15:07:41.388 INFO:teuthology.orchestra.run.smithi161.stdout:713 read 0x15210b5 thru 0x152be16 (0xad62 bytes) 2024-09-21T15:07:41.391 INFO:teuthology.orchestra.run.smithi161.stdout:1052 write 0x97c8ea6 thru 0x97d3f2a (0xb085 bytes) 2024-09-21T15:07:41.392 INFO:teuthology.orchestra.run.smithi161.stdout:714 read 0x2016593 thru 0x2021810 (0xb27e bytes) 2024-09-21T15:07:41.395 INFO:teuthology.orchestra.run.smithi161.stdout:889 write 0x8fd5514 thru 0x8fe2b14 (0xd601 bytes) 2024-09-21T15:07:41.400 INFO:teuthology.orchestra.run.smithi161.stdout:1116 writesame 0x7a3809a thru 0x7a405ea data_size 0x1(0x8551 bytes) 2024-09-21T15:07:41.405 INFO:teuthology.orchestra.run.smithi161.stdout:716 trunc from 0x2cd9e59 to 0x6de9038 2024-09-21T15:07:41.409 INFO:teuthology.orchestra.run.smithi161.stdout:1396 write 0xc33a38 thru 0xc390a0 (0x5669 bytes) 2024-09-21T15:07:41.414 INFO:teuthology.orchestra.run.smithi161.stdout:1053 read 0x8086f21 thru 0x808cec2 (0x5fa2 bytes) 2024-09-21T15:07:41.415 INFO:teuthology.orchestra.run.smithi161.stdout:890 write 0xacf7c88 thru 0xad0542e (0xd7a7 bytes) 2024-09-21T15:07:41.415 INFO:teuthology.orchestra.run.smithi161.stdout:1059 writesame 0x3653ba5 thru 0x3662962 data_size 0x1(0xedbe bytes) 2024-09-21T15:07:41.418 INFO:teuthology.orchestra.run.smithi161.stdout:773 trunc from 0xd4f697c to 0x160adda 2024-09-21T15:07:41.432 INFO:teuthology.orchestra.run.smithi161.stdout:1117 write 0x158e65c thru 0x1590d50 (0x26f5 bytes) 2024-09-21T15:07:41.434 INFO:teuthology.orchestra.run.smithi161.stdout:1399 write 0xce8ef0 thru 0xcf2f36 (0xa047 bytes) 2024-09-21T15:07:41.445 INFO:teuthology.orchestra.run.smithi161.stdout:891 punch from 0xcae1c34 to 0xcae4451, (0x281d bytes) 2024-09-21T15:07:41.446 INFO:teuthology.orchestra.run.smithi161.stdout:893 punch from 0x779f187 to 0x77a8a3e, (0x98b7 bytes) 2024-09-21T15:07:41.487 INFO:teuthology.orchestra.run.smithi161.stdout:1400 trunc from 0xa6a6526 to 0x1d098e1 2024-09-21T15:07:41.509 INFO:teuthology.orchestra.run.smithi161.stdout:1060 punch from 0x6929a1e to 0x69302ad, (0x688f bytes) 2024-09-21T15:07:41.509 INFO:teuthology.orchestra.run.smithi161.stdout:1119 write 0x20d6b09 thru 0x20dc856 (0x5d4e bytes) 2024-09-21T15:07:41.536 INFO:teuthology.orchestra.run.smithi161.stdout:895 write 0xd956316 thru 0xd95c68b (0x6376 bytes) 2024-09-21T15:07:41.545 INFO:teuthology.orchestra.run.smithi161.stdout:1120 read 0x51291ee thru 0x512d018 (0x3e2b bytes) 2024-09-21T15:07:41.545 INFO:teuthology.orchestra.run.smithi161.stdout:1121 read 0xbb1c0e8 thru 0xbb1edec (0x2d05 bytes) 2024-09-21T15:07:41.545 INFO:teuthology.orchestra.run.smithi161.stdout:1122 punch from 0x978ffa4 to 0x9791326, (0x1382 bytes) 2024-09-21T15:07:41.545 INFO:teuthology.orchestra.run.smithi161.stdout:1123 writesame 0x5f3314d thru 0x5f3990a data_size 0x31(0x67be bytes) 2024-09-21T15:07:41.551 INFO:teuthology.orchestra.run.smithi161.stdout:717 writesame 0xedf9291 thru 0xedff35c data_size 0x46(0x60cc bytes) 2024-09-21T15:07:41.556 INFO:teuthology.orchestra.run.smithi161.stdout:896 write 0x54703c3 thru 0x5479383 (0x8fc1 bytes) 2024-09-21T15:07:41.557 INFO:teuthology.orchestra.run.smithi161.stdout:718 write 0x89eae18 thru 0x89ebeed (0x10d6 bytes) 2024-09-21T15:07:41.562 INFO:teuthology.orchestra.run.smithi161.stdout:1126 write 0xb0228f3 thru 0xb029b4b (0x7259 bytes) 2024-09-21T15:07:41.568 INFO:teuthology.orchestra.run.smithi161.stdout:1061 write 0xd6c5a3a thru 0xd6c976a (0x3d31 bytes) 2024-09-21T15:07:41.570 INFO:teuthology.orchestra.run.smithi161.stdout:719 writesame 0xe03bce6 thru 0xe03f734 data_size 0x17(0x3a4f bytes) 2024-09-21T15:07:41.573 INFO:teuthology.orchestra.run.smithi161.stdout:775 trunc from 0x160adda to 0x34d29b8 2024-09-21T15:07:41.579 INFO:teuthology.orchestra.run.smithi161.stdout:1127 read 0xb44793 thru 0xb44bfb (0x469 bytes) 2024-09-21T15:07:41.580 INFO:teuthology.orchestra.run.smithi161.stdout:1402 read 0x1b85bbd thru 0x1b95206 (0xf64a bytes) 2024-09-21T15:07:41.580 INFO:teuthology.orchestra.run.smithi161.stdout:1132 write 0x8c4b7a0 thru 0x8c598cb (0xe12c bytes) 2024-09-21T15:07:41.581 INFO:teuthology.orchestra.run.smithi161.stdout:1404 read 0x18a9efd thru 0x18b2e7d (0x8f81 bytes) 2024-09-21T15:07:41.589 INFO:teuthology.orchestra.run.smithi161.stdout:1064 read 0x6871199 thru 0x687c54c (0xb3b4 bytes) 2024-09-21T15:07:41.590 INFO:teuthology.orchestra.run.smithi161.stdout:1066 read 0x4e95cd3 thru 0x4e9bddb (0x6109 bytes) 2024-09-21T15:07:41.590 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.590 INFO:teuthology.orchestra.run.smithi161.stdout:721 punch from 0x353fdd to 0x356ced, (0x2d10 bytes) 2024-09-21T15:07:41.590 INFO:teuthology.orchestra.run.smithi161.stdout:722 write 0xd79da71 thru 0xd7a8f79 (0xb509 bytes) 2024-09-21T15:07:41.591 INFO:teuthology.orchestra.run.smithi161.stdout:897 trunc from 0xd95c68c to 0x1f350f0 2024-09-21T15:07:41.597 INFO:teuthology.orchestra.run.smithi161.stdout:1067 trunc from 0xd6c976b to 0x9b5c530 2024-09-21T15:07:41.615 INFO:teuthology.orchestra.run.smithi161.stdout:723 write 0x9a190cf thru 0x9a233a7 (0xa2d9 bytes) 2024-09-21T15:07:41.618 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.5346117995481222) > weight (0.25) 2024-09-21T15:07:41.619 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.5231231614506612) > weight (0.25) 2024-09-21T15:07:41.619 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.2 with skip (0.7524419391789948) > weight (0.25) 2024-09-21T15:07:41.619 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.3 with skip (0.7201092542663097) > weight (0.25) 2024-09-21T15:07:41.619 INFO:tasks.rbd_mirror_thrash:waiting for 65 secs before thrashing 2024-09-21T15:07:41.619 INFO:teuthology.orchestra.run.smithi161.stdout:778 punch from 0x1f71dde to 0x1f7c264, (0xa486 bytes) 2024-09-21T15:07:41.619 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.627 INFO:teuthology.orchestra.run.smithi161.stdout:1133 trunc from 0xe21a539 to 0x7e9acfa 2024-09-21T15:07:41.633 INFO:teuthology.orchestra.run.smithi161.stdout:1405 writesame 0x3b52299 thru 0x3b556f7 data_size 0x29(0x345f bytes) 2024-09-21T15:07:41.635 INFO:teuthology.orchestra.run.smithi161.stdout:724 read 0x59ffeb thru 0x5a5a55 (0x5a6b bytes) 2024-09-21T15:07:41.636 INFO:teuthology.orchestra.run.smithi161.stdout:725 read 0x97d0232 thru 0x97dd301 (0xd0d0 bytes) 2024-09-21T15:07:41.637 INFO:teuthology.orchestra.run.smithi161.stdout:726 write 0xd4900fc thru 0xd49eb6c (0xea71 bytes) 2024-09-21T15:07:41.637 INFO:teuthology.orchestra.run.smithi161.stdout:1406 read 0x32ad74 thru 0x32b0a5 (0x332 bytes) 2024-09-21T15:07:41.652 INFO:teuthology.orchestra.run.smithi161.stdout:1407 trunc from 0x3b556f8 to 0xbb04f1e 2024-09-21T15:07:41.671 INFO:teuthology.orchestra.run.smithi161.stdout:727 punch from 0x7d45b5f to 0x7d54251, (0xe6f2 bytes) 2024-09-21T15:07:41.672 INFO:teuthology.orchestra.run.smithi161.stdout:728 write 0xec0fde3 thru 0xec18420 (0x863e bytes) 2024-09-21T15:07:41.672 INFO:teuthology.orchestra.run.smithi161.stdout:780 write 0x7c0d3c7 thru 0x7c1464b (0x7285 bytes) 2024-09-21T15:07:41.675 INFO:teuthology.orchestra.run.smithi161.stdout:898 read 0x1e08025 thru 0x1e15495 (0xd471 bytes) 2024-09-21T15:07:41.675 INFO:teuthology.orchestra.run.smithi161.stdout:899 read 0x83a43f thru 0x846513 (0xc0d5 bytes) 2024-09-21T15:07:41.679 INFO:teuthology.orchestra.run.smithi161.stdout:1068 trunc from 0x9b5c530 to 0xb57dad0 2024-09-21T15:07:41.695 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.695 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.701 INFO:teuthology.orchestra.run.smithi161.stdout:1408 read 0x1a5572 thru 0x1a90f3 (0x3b82 bytes) 2024-09-21T15:07:41.702 INFO:teuthology.orchestra.run.smithi161.stdout:1410 punch from 0x876c36a to 0x87759ea, (0x9680 bytes) 2024-09-21T15:07:41.702 INFO:teuthology.orchestra.run.smithi161.stdout:730 trunc from 0xedff35d to 0xc15041b 2024-09-21T15:07:41.702 INFO:teuthology.orchestra.run.smithi161.stdout:1411 writesame 0x2f8175d thru 0x2f833fa data_size 0x21(0x1c9e bytes) 2024-09-21T15:07:41.705 INFO:teuthology.orchestra.run.smithi161.stdout:1069 read 0x58c2781 thru 0x58cd1a2 (0xaa22 bytes) 2024-09-21T15:07:41.709 INFO:teuthology.orchestra.run.smithi161.stdout:1071 trunc from 0xb57dad0 to 0x95eb464 2024-09-21T15:07:41.717 INFO:teuthology.orchestra.run.smithi161.stdout:900 writesame 0xb77249a thru 0xb78117e data_size 0x41(0xece5 bytes) 2024-09-21T15:07:41.723 INFO:teuthology.orchestra.run.smithi161.stdout:903 read 0x555df7b thru 0x555e413 (0x499 bytes) 2024-09-21T15:07:41.723 INFO:teuthology.orchestra.run.smithi161.stdout:904 read 0x43aeccf thru 0x43aff0d (0x123f bytes) 2024-09-21T15:07:41.723 INFO:teuthology.orchestra.run.smithi161.stdout:905 read 0x3de0f3c thru 0x3de668a (0x574f bytes) 2024-09-21T15:07:41.723 INFO:teuthology.orchestra.run.smithi161.stdout:908 read 0x75d50be thru 0x75dacde (0x5c21 bytes) 2024-09-21T15:07:41.724 INFO:teuthology.orchestra.run.smithi161.stdout:910 read 0x57d1a77 thru 0x57df52c (0xdab6 bytes) 2024-09-21T15:07:41.725 INFO:teuthology.orchestra.run.smithi161.stdout:1412 write 0x87adbad thru 0x87b845e (0xa8b2 bytes) 2024-09-21T15:07:41.726 INFO:teuthology.orchestra.run.smithi161.stdout:912 trunc from 0xb78117f to 0xa5551ec 2024-09-21T15:07:41.732 INFO:teuthology.orchestra.run.smithi161.stdout:785 writesame 0x9749874 thru 0x9750651 data_size 0x1(0x6dde bytes) 2024-09-21T15:07:41.738 INFO:teuthology.orchestra.run.smithi161.stdout:787 writesame 0x23d6461 thru 0x23e3856 data_size 0xd(0xd3f6 bytes) 2024-09-21T15:07:41.743 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.743 INFO:teuthology.orchestra.run.smithi161.stdout:1415 read 0xb50d810 thru 0xb510ea4 (0x3695 bytes) 2024-09-21T15:07:41.743 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.743 INFO:teuthology.orchestra.run.smithi161.stdout:1417 write 0x53e1ae5 thru 0x53e81c3 (0x66df bytes) 2024-09-21T15:07:41.748 INFO:teuthology.orchestra.run.smithi161.stdout:1134 writesame 0x96a4557 thru 0x96af599 data_size 0x59(0xb043 bytes) 2024-09-21T15:07:41.756 INFO:teuthology.orchestra.run.smithi161.stdout:1135 writesame 0x44d98fc thru 0x44def91 data_size 0x1(0x5696 bytes) 2024-09-21T15:07:41.756 INFO:teuthology.orchestra.run.smithi161.stdout:789 write 0x47cec1a thru 0x47d9809 (0xabf0 bytes) 2024-09-21T15:07:41.759 INFO:teuthology.orchestra.run.smithi161.stdout:1419 write 0x6f490fb thru 0x6f4e3e5 (0x52eb bytes) 2024-09-21T15:07:41.767 INFO:teuthology.orchestra.run.smithi161.stdout:1072 trunc from 0x95eb464 to 0xaf1f4fa 2024-09-21T15:07:41.773 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.773 INFO:teuthology.orchestra.run.smithi161.stdout:1421 writesame 0x6f0d830 thru 0x6f1b467 data_size 0x24(0xdc38 bytes) 2024-09-21T15:07:41.774 INFO:teuthology.orchestra.run.smithi161.stdout:732 punch from 0x4bf30db to 0x4bff412, (0xc337 bytes) 2024-09-21T15:07:41.774 INFO:teuthology.orchestra.run.smithi161.stdout:733 write 0x858eaff thru 0x8591e64 (0x3366 bytes) 2024-09-21T15:07:41.782 INFO:teuthology.orchestra.run.smithi161.stdout:790 write 0x5940153 thru 0x594fb3e (0xf9ec bytes) 2024-09-21T15:07:41.786 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.786 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.786 INFO:teuthology.orchestra.run.smithi161.stdout:1147 read 0x416adb5 thru 0x416e3dd (0x3629 bytes) 2024-09-21T15:07:41.788 INFO:teuthology.orchestra.run.smithi161.stdout:1422 read 0x8a6009b thru 0x8a63f91 (0x3ef7 bytes) 2024-09-21T15:07:41.788 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.789 INFO:teuthology.orchestra.run.smithi161.stdout:1424 write 0x8cf2067 thru 0x8cf53e0 (0x337a bytes) 2024-09-21T15:07:41.791 INFO:teuthology.orchestra.run.smithi161.stdout:915 trunc from 0xa5551ec to 0x10ebfd5 2024-09-21T15:07:41.791 INFO:teuthology.orchestra.run.smithi161.stdout:1148 writesame 0x7f8011c thru 0x7f8ef38 data_size 0x3(0xee1d bytes) 2024-09-21T15:07:41.800 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.800 INFO:teuthology.orchestra.run.smithi161.stdout:793 write 0x21dbb21 thru 0x21ea6fe (0xebde bytes) 2024-09-21T15:07:41.803 INFO:teuthology.orchestra.run.smithi161.stdout:734 trunc from 0xc15041b to 0xafa4e07 2024-09-21T15:07:41.817 INFO:teuthology.orchestra.run.smithi161.stdout:1073 trunc from 0xaf1f4fa to 0x5e59e6b 2024-09-21T15:07:41.820 INFO:teuthology.orchestra.run.smithi161.stdout:1149 read 0x952f435 thru 0x953b196 (0xbd62 bytes) 2024-09-21T15:07:41.820 INFO:teuthology.orchestra.run.smithi161.stdout:794 write 0x3b48091 thru 0x3b4b285 (0x31f5 bytes) 2024-09-21T15:07:41.821 INFO:teuthology.orchestra.run.smithi161.stdout:1150 write 0x78dd4b8 thru 0x78e3316 (0x5e5f bytes) 2024-09-21T15:07:41.836 INFO:teuthology.orchestra.run.smithi161.stdout:916 read 0x8283a thru 0x8d7d2 (0xaf99 bytes) 2024-09-21T15:07:41.836 INFO:teuthology.orchestra.run.smithi161.stdout:917 read 0x1ec1d1 thru 0x1f36ea (0x751a bytes) 2024-09-21T15:07:41.836 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.841 INFO:teuthology.orchestra.run.smithi161.stdout:795 punch from 0x8ef7c03 to 0x8f02029, (0xa426 bytes) 2024-09-21T15:07:41.849 INFO:teuthology.orchestra.run.smithi161.stdout:796 punch from 0x41b67c5 to 0x41bb2f1, (0x4b2c bytes) 2024-09-21T15:07:41.849 INFO:teuthology.orchestra.run.smithi161.stdout:1425 write 0xd563156 thru 0xd56835b (0x5206 bytes) 2024-09-21T15:07:41.851 INFO:teuthology.orchestra.run.smithi161.stdout:1152 trunc from 0x96af59a to 0x4f34fed 2024-09-21T15:07:41.859 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.860 INFO:teuthology.orchestra.run.smithi161.stdout:1075 read 0x25bfc3b thru 0x25c118c (0x1552 bytes) 2024-09-21T15:07:41.871 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.871 INFO:teuthology.orchestra.run.smithi161.stdout:1427 write 0x43bd5ea thru 0x43c66ad (0x90c4 bytes) 2024-09-21T15:07:41.875 INFO:teuthology.orchestra.run.smithi161.stdout:735 write 0xbd89e0d thru 0xbd8b3d2 (0x15c6 bytes) 2024-09-21T15:07:41.886 INFO:teuthology.orchestra.run.smithi161.stdout:919 write 0x3e04413 thru 0x3e0915d (0x4d4b bytes) 2024-09-21T15:07:41.892 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.902 INFO:teuthology.orchestra.run.smithi161.stdout:736 writesame 0x20fc72d thru 0x210578a data_size 0x11(0x905e bytes) 2024-09-21T15:07:41.910 INFO:teuthology.orchestra.run.smithi161.stdout:797 write 0x99cbf39 thru 0x99d981a (0xd8e2 bytes) 2024-09-21T15:07:41.930 INFO:teuthology.orchestra.run.smithi161.stdout:1076 write 0xd23c1b9 thru 0xd23febc (0x3d04 bytes) 2024-09-21T15:07:41.955 INFO:teuthology.orchestra.run.smithi161.stdout:1153 write 0x34590d6 thru 0x3461449 (0x8374 bytes) 2024-09-21T15:07:41.960 INFO:teuthology.orchestra.run.smithi161.stdout:1433 write 0xe4a3227 thru 0xe4b23ca (0xf1a4 bytes) 2024-09-21T15:07:41.968 INFO:teuthology.orchestra.run.smithi161.stdout:1077 writesame 0x7a00f7c thru 0x7a038ba data_size 0x1(0x293f bytes) 2024-09-21T15:07:41.984 INFO:teuthology.orchestra.run.smithi161.stdout:1078 read 0xac81830 thru 0xac8ce33 (0xb604 bytes) 2024-09-21T15:07:41.984 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.984 INFO:teuthology.orchestra.run.smithi161.stdout:1080 read 0x69843cc thru 0x698f789 (0xb3be bytes) 2024-09-21T15:07:41.985 INFO:teuthology.orchestra.run.smithi161.stdout:737 read 0x774f0b6 thru 0x7750e4f (0x1d9a bytes) 2024-09-21T15:07:41.985 INFO:teuthology.orchestra.run.smithi161.stdout:738 read 0x2fb4fd6 thru 0x2fbd6b7 (0x86e2 bytes) 2024-09-21T15:07:41.985 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:41.986 INFO:teuthology.orchestra.run.smithi161.stdout:740 writesame 0x7922029 thru 0x79277ac data_size 0x6(0x5784 bytes) 2024-09-21T15:07:41.991 INFO:teuthology.orchestra.run.smithi161.stdout:920 write 0xb0dfbda thru 0xb0e8329 (0x8750 bytes) 2024-09-21T15:07:41.992 INFO:teuthology.orchestra.run.smithi161.stdout:1434 read 0x51267f7 thru 0x512e459 (0x7c63 bytes) 2024-09-21T15:07:41.994 INFO:teuthology.orchestra.run.smithi161.stdout:1435 write 0x71f9de0 thru 0x71fc95c (0x2b7d bytes) 2024-09-21T15:07:41.996 INFO:teuthology.orchestra.run.smithi161.stdout:1084 trunc from 0xd23febd to 0x65a9bcd 2024-09-21T15:07:42.010 INFO:teuthology.orchestra.run.smithi161.stdout:1436 write 0x58fb066 thru 0x58ffb9a (0x4b35 bytes) 2024-09-21T15:07:42.013 INFO:teuthology.orchestra.run.smithi161.stdout:798 write 0xe922f57 thru 0xe9268d1 (0x397b bytes) 2024-09-21T15:07:42.013 INFO:teuthology.orchestra.run.smithi161.stdout:741 read 0x2e0d759 thru 0x2e162c8 (0x8b70 bytes) 2024-09-21T15:07:42.014 INFO:teuthology.orchestra.run.smithi161.stdout:743 read 0x730f0a9 thru 0x7311963 (0x28bb bytes) 2024-09-21T15:07:42.014 INFO:teuthology.orchestra.run.smithi161.stdout:744 write 0x191a0e2 thru 0x1923a36 (0x9955 bytes) 2024-09-21T15:07:42.024 INFO:teuthology.orchestra.run.smithi161.stdout:1437 writesame 0x11c43e7 thru 0x11cd532 data_size 0x22(0x914c bytes) 2024-09-21T15:07:42.039 INFO:teuthology.orchestra.run.smithi161.stdout:799 read 0x8a9b78c thru 0x8aa8220 (0xca95 bytes) 2024-09-21T15:07:42.039 INFO:teuthology.orchestra.run.smithi161.stdout:800 writesame 0x8ca02f3 thru 0x8ca4adb data_size 0x1(0x47e9 bytes) 2024-09-21T15:07:42.043 INFO:teuthology.orchestra.run.smithi161.stdout:1438 write 0x32378b4 thru 0x3239973 (0x20c0 bytes) 2024-09-21T15:07:42.062 INFO:teuthology.orchestra.run.smithi161.stdout:1440 writesame 0x2f65506 thru 0x2f6f25f data_size 0x2(0x9d5a bytes) 2024-09-21T15:07:42.063 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.064 INFO:teuthology.orchestra.run.smithi161.stdout:802 punch from 0x17cd69a to 0x17d4e89, (0x77ef bytes) 2024-09-21T15:07:42.064 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.064 INFO:teuthology.orchestra.run.smithi161.stdout:804 write 0x13faa02 thru 0x13fea8f (0x408e bytes) 2024-09-21T15:07:42.065 INFO:teuthology.orchestra.run.smithi161.stdout:1154 write 0xadf5ce6 thru 0xadf9b15 (0x3e30 bytes) 2024-09-21T15:07:42.066 INFO:teuthology.orchestra.run.smithi161.stdout:745 writesame 0xa05c53d thru 0xa0684f5 data_size 0x1(0xbfb9 bytes) 2024-09-21T15:07:42.072 INFO:teuthology.orchestra.run.smithi161.stdout:1085 read 0x1d3b29c thru 0x1d47bd7 (0xc93c bytes) 2024-09-21T15:07:42.075 INFO:teuthology.orchestra.run.smithi161.stdout:1086 read 0x6eaaa7 thru 0x6f5f26 (0xb480 bytes) 2024-09-21T15:07:42.076 INFO:teuthology.orchestra.run.smithi161.stdout:1087 write 0x5f43218 thru 0x5f4ab54 (0x793d bytes) 2024-09-21T15:07:42.109 INFO:teuthology.orchestra.run.smithi161.stdout:1155 writesame 0x19308f0 thru 0x1930d2d data_size 0x3(0x43e bytes) 2024-09-21T15:07:42.115 INFO:teuthology.orchestra.run.smithi161.stdout:1156 writesame 0x2b0192d thru 0x2b103fa data_size 0x5(0xeace bytes) 2024-09-21T15:07:42.121 INFO:teuthology.orchestra.run.smithi161.stdout:1441 writesame 0x72d6181 thru 0x72d6cbd data_size 0x7(0xb3d bytes) 2024-09-21T15:07:42.135 INFO:teuthology.orchestra.run.smithi161.stdout:746 writesame 0x5a13679 thru 0x5a1b419 data_size 0x1(0x7da1 bytes) 2024-09-21T15:07:42.153 INFO:teuthology.orchestra.run.smithi161.stdout:805 write 0x575b9ba thru 0x5768aab (0xd0f2 bytes) 2024-09-21T15:07:42.156 INFO:teuthology.orchestra.run.smithi161.stdout:921 write 0xe971edc thru 0xe977291 (0x53b6 bytes) 2024-09-21T15:07:42.158 INFO:teuthology.orchestra.run.smithi161.stdout:1442 write 0x6bdc612 thru 0x6bec24a (0xfc39 bytes) 2024-09-21T15:07:42.168 INFO:teuthology.orchestra.run.smithi161.stdout:747 read 0x8d74c18 thru 0x8d83e96 (0xf27f bytes) 2024-09-21T15:07:42.168 INFO:teuthology.orchestra.run.smithi161.stdout:749 read 0x4c3a7c0 thru 0x4c4634b (0xbb8c bytes) 2024-09-21T15:07:42.168 INFO:teuthology.orchestra.run.smithi161.stdout:751 read 0x208f963 thru 0x209299a (0x3038 bytes) 2024-09-21T15:07:42.170 INFO:teuthology.orchestra.run.smithi161.stdout:752 punch from 0x3a4ed04 to 0x3a5542b, (0x6727 bytes) 2024-09-21T15:07:42.174 INFO:teuthology.orchestra.run.smithi161.stdout:1157 write 0x7a5231d thru 0x7a540a7 (0x1d8b bytes) 2024-09-21T15:07:42.175 INFO:teuthology.orchestra.run.smithi161.stdout:806 write 0x5e21a79 thru 0x5e30332 (0xe8ba bytes) 2024-09-21T15:07:42.179 INFO:teuthology.orchestra.run.smithi161.stdout:1443 read 0x7e81147 thru 0x7e8186a (0x724 bytes) 2024-09-21T15:07:42.180 INFO:teuthology.orchestra.run.smithi161.stdout:922 punch from 0x1a0f343 to 0x1a1601d, (0x6cda bytes) 2024-09-21T15:07:42.180 INFO:teuthology.orchestra.run.smithi161.stdout:1444 punch from 0x2d918c4 to 0x2d9cfa3, (0xb6df bytes) 2024-09-21T15:07:42.180 INFO:teuthology.orchestra.run.smithi161.stdout:1445 read 0x45bb31 thru 0x46398d (0x7e5d bytes) 2024-09-21T15:07:42.181 INFO:teuthology.orchestra.run.smithi161.stdout:923 write 0xa8fa067 thru 0xa909920 (0xf8ba bytes) 2024-09-21T15:07:42.181 INFO:teuthology.orchestra.run.smithi161.stdout:1447 read 0x49e444b thru 0x49edbb8 (0x976e bytes) 2024-09-21T15:07:42.181 INFO:teuthology.orchestra.run.smithi161.stdout:1448 write 0x823eca4 thru 0x8245dab (0x7108 bytes) 2024-09-21T15:07:42.198 INFO:teuthology.orchestra.run.smithi161.stdout:807 read 0x1c36c43 thru 0x1c3dbf7 (0x6fb5 bytes) 2024-09-21T15:07:42.198 INFO:teuthology.orchestra.run.smithi161.stdout:1158 write 0x4078e8a thru 0x407d2ff (0x4476 bytes) 2024-09-21T15:07:42.198 INFO:teuthology.orchestra.run.smithi161.stdout:1449 write 0x3aad5b0 thru 0x3ab290d (0x535e bytes) 2024-09-21T15:07:42.198 INFO:teuthology.orchestra.run.smithi161.stdout:809 write 0x367c09d thru 0x367e7b0 (0x2714 bytes) 2024-09-21T15:07:42.201 INFO:teuthology.orchestra.run.smithi161.stdout:924 punch from 0xc4b291f to 0xc4b4265, (0x1946 bytes) 2024-09-21T15:07:42.201 INFO:teuthology.orchestra.run.smithi161.stdout:925 write 0x6eba36c thru 0x6ebcda0 (0x2a35 bytes) 2024-09-21T15:07:42.203 INFO:teuthology.orchestra.run.smithi161.stdout:1091 write 0x790cc41 thru 0x79110c8 (0x4488 bytes) 2024-09-21T15:07:42.211 INFO:teuthology.orchestra.run.smithi161.stdout:1159 read 0x127c7ce thru 0x12862f4 (0x9b27 bytes) 2024-09-21T15:07:42.212 INFO:teuthology.orchestra.run.smithi161.stdout:1450 write 0x3f4fa5a thru 0x3f5685c (0x6e03 bytes) 2024-09-21T15:07:42.220 INFO:teuthology.orchestra.run.smithi161.stdout:753 write 0xda60eb2 thru 0xda6679f (0x58ee bytes) 2024-09-21T15:07:42.220 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.220 INFO:teuthology.orchestra.run.smithi161.stdout:929 read 0xf85e13 thru 0xf86d0c (0xefa bytes) 2024-09-21T15:07:42.221 INFO:teuthology.orchestra.run.smithi161.stdout:810 punch from 0x3854456 to 0x3860e5b, (0xca05 bytes) 2024-09-21T15:07:42.221 INFO:teuthology.orchestra.run.smithi161.stdout:811 read 0x42bce0e thru 0x42c8475 (0xb668 bytes) 2024-09-21T15:07:42.221 INFO:teuthology.orchestra.run.smithi161.stdout:932 write 0x2aa65b0 thru 0x2ab011c (0x9b6d bytes) 2024-09-21T15:07:42.221 INFO:teuthology.orchestra.run.smithi161.stdout:812 writesame 0xa53bce2 thru 0xa5409ab data_size 0x1(0x4cca bytes) 2024-09-21T15:07:42.222 INFO:teuthology.orchestra.run.smithi161.stdout:1160 trunc from 0xadf9b16 to 0x6d785e5 2024-09-21T15:07:42.225 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.225 INFO:teuthology.orchestra.run.smithi161.stdout:1094 write 0x2269d1c thru 0x22722a5 (0x858a bytes) 2024-09-21T15:07:42.230 INFO:teuthology.orchestra.run.smithi161.stdout:1451 trunc from 0xe4b23cb to 0xe92ba96 2024-09-21T15:07:42.242 INFO:teuthology.orchestra.run.smithi161.stdout:933 punch from 0x7f5e408 to 0x7f6bb1d, (0xd715 bytes) 2024-09-21T15:07:42.242 INFO:teuthology.orchestra.run.smithi161.stdout:934 writesame 0xd9bbcaf thru 0xd9be5f7 data_size 0xd(0x2949 bytes) 2024-09-21T15:07:42.244 INFO:teuthology.orchestra.run.smithi161.stdout:814 punch from 0x648ff98 to 0x649fbeb, (0xfc53 bytes) 2024-09-21T15:07:42.244 INFO:teuthology.orchestra.run.smithi161.stdout:815 read 0x410b1b thru 0x419b17 (0x8ffd bytes) 2024-09-21T15:07:42.248 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.249 INFO:teuthology.orchestra.run.smithi161.stdout:754 read 0xb3511e4 thru 0xb359d50 (0x8b6d bytes) 2024-09-21T15:07:42.249 INFO:teuthology.orchestra.run.smithi161.stdout:755 punch from 0x1fe4509 to 0x1fef5f4, (0xb0eb bytes) 2024-09-21T15:07:42.249 INFO:teuthology.orchestra.run.smithi161.stdout:756 write 0x2b46996 thru 0x2b46fcc (0x637 bytes) 2024-09-21T15:07:42.255 INFO:teuthology.orchestra.run.smithi161.stdout:936 write 0x3ad0cc8 thru 0x3ada977 (0x9cb0 bytes) 2024-09-21T15:07:42.257 INFO:teuthology.orchestra.run.smithi161.stdout:757 read 0x28d5685 thru 0x28e3b65 (0xe4e1 bytes) 2024-09-21T15:07:42.265 INFO:teuthology.orchestra.run.smithi161.stdout:817 trunc from 0xe9268d2 to 0x67e726d 2024-09-21T15:07:42.272 INFO:teuthology.orchestra.run.smithi161.stdout:1452 punch from 0xf44128 to 0xf44234, (0x10c bytes) 2024-09-21T15:07:42.272 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.272 INFO:teuthology.orchestra.run.smithi161.stdout:1458 write 0x29a6037 thru 0x29a9aa6 (0x3a70 bytes) 2024-09-21T15:07:42.282 INFO:teuthology.orchestra.run.smithi161.stdout:1459 read 0x77a8c25 thru 0x77b0c31 (0x800d bytes) 2024-09-21T15:07:42.282 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.293 INFO:teuthology.orchestra.run.smithi161.stdout:758 writesame 0x5ee8cbb thru 0x5eef17b data_size 0x1(0x64c1 bytes) 2024-09-21T15:07:42.300 INFO:teuthology.orchestra.run.smithi161.stdout:1095 write 0x2ff375 thru 0x30bb5c (0xc7e8 bytes) 2024-09-21T15:07:42.309 INFO:teuthology.orchestra.run.smithi161.stdout:1461 trunc from 0xe92ba96 to 0x63e7526 2024-09-21T15:07:42.318 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.323 INFO:teuthology.orchestra.run.smithi161.stdout:759 read 0x14b78a6 thru 0x14c77d0 (0xff2b bytes) 2024-09-21T15:07:42.326 INFO:teuthology.orchestra.run.smithi161.stdout:760 writesame 0x741dae5 thru 0x74209d2 data_size 0x1(0x2eee bytes) 2024-09-21T15:07:42.341 INFO:teuthology.orchestra.run.smithi161.stdout:938 trunc from 0xe977292 to 0x2836469 2024-09-21T15:07:42.358 INFO:teuthology.orchestra.run.smithi161.stdout:818 read 0x3af63e6 thru 0x3b012e1 (0xaefc bytes) 2024-09-21T15:07:42.359 INFO:teuthology.orchestra.run.smithi161.stdout:1161 writesame 0xd773fa3 thru 0xd77fb9f data_size 0x37(0xbbfd bytes) 2024-09-21T15:07:42.376 INFO:teuthology.orchestra.run.smithi161.stdout:761 read 0xafa18a2 thru 0xafa4607 (0x2d66 bytes) 2024-09-21T15:07:42.376 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.376 INFO:teuthology.orchestra.run.smithi161.stdout:764 write 0xadc6cb6 thru 0xadcfec2 (0x920d bytes) 2024-09-21T15:07:42.381 INFO:teuthology.orchestra.run.smithi161.stdout:819 read 0x319ef00 thru 0x319ffd2 (0x10d3 bytes) 2024-09-21T15:07:42.382 INFO:teuthology.orchestra.run.smithi161.stdout:1162 write 0x6dd2325 thru 0x6dd8ee8 (0x6bc4 bytes) 2024-09-21T15:07:42.404 INFO:teuthology.orchestra.run.smithi161.stdout:1163 punch from 0xd5cce57 to 0xd5db530, (0xe6d9 bytes) 2024-09-21T15:07:42.404 INFO:teuthology.orchestra.run.smithi161.stdout:1165 write 0x3329b1b thru 0x3339a9c (0xff82 bytes) 2024-09-21T15:07:42.407 INFO:teuthology.orchestra.run.smithi161.stdout:1462 trunc from 0x63e7526 to 0x6e2b5ba 2024-09-21T15:07:42.442 INFO:teuthology.orchestra.run.smithi161.stdout:820 write 0xbf29d26 thru 0xbf3610f (0xc3ea bytes) 2024-09-21T15:07:42.451 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.451 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.452 INFO:teuthology.orchestra.run.smithi161.stdout:766 writesame 0x1880330 thru 0x1886769 data_size 0x1(0x643a bytes) 2024-09-21T15:07:42.461 INFO:teuthology.orchestra.run.smithi161.stdout:1465 trunc from 0x6e2b5ba to 0xa953b58 2024-09-21T15:07:42.479 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.479 INFO:teuthology.orchestra.run.smithi161.stdout:941 read 0x25c175e thru 0x25c17ac (0x4f bytes) 2024-09-21T15:07:42.479 INFO:teuthology.orchestra.run.smithi161.stdout:942 write 0x7c8892 thru 0x7c8ff6 (0x765 bytes) 2024-09-21T15:07:42.488 INFO:teuthology.orchestra.run.smithi161.stdout:823 trunc from 0xbf36110 to 0x80515c8 2024-09-21T15:07:42.493 INFO:teuthology.orchestra.run.smithi161.stdout:767 read 0x4c6c24e thru 0x4c722ff (0x60b2 bytes) 2024-09-21T15:07:42.493 INFO:teuthology.orchestra.run.smithi161.stdout:768 write 0x9d71999 thru 0x9d7c7e5 (0xae4d bytes) 2024-09-21T15:07:42.501 INFO:teuthology.orchestra.run.smithi161.stdout:944 read 0x1a9d834 thru 0x1aa1af8 (0x42c5 bytes) 2024-09-21T15:07:42.503 INFO:teuthology.orchestra.run.smithi161.stdout:769 punch from 0x1dc96dc to 0x1dcbb87, (0x24ab bytes) 2024-09-21T15:07:42.503 INFO:teuthology.orchestra.run.smithi161.stdout:771 read 0x841eac4 thru 0x8429c1e (0xb15b bytes) 2024-09-21T15:07:42.503 INFO:teuthology.orchestra.run.smithi161.stdout:773 write 0x699c9d2 thru 0x699cfd3 (0x602 bytes) 2024-09-21T15:07:42.505 INFO:teuthology.orchestra.run.smithi161.stdout:1466 punch from 0x84fa13d to 0x8508f1c, (0xeddf bytes) 2024-09-21T15:07:42.505 INFO:teuthology.orchestra.run.smithi161.stdout:1468 trunc from 0xa953b58 to 0xa60f286 2024-09-21T15:07:42.507 INFO:teuthology.orchestra.run.smithi161.stdout:1166 trunc from 0xd77fba0 to 0x4ac3fc7 2024-09-21T15:07:42.512 INFO:teuthology.orchestra.run.smithi161.stdout:774 read 0xf3be85 thru 0xf40c30 (0x4dac bytes) 2024-09-21T15:07:42.514 INFO:teuthology.orchestra.run.smithi161.stdout:775 write 0x83a01ae thru 0x83adff7 (0xde4a bytes) 2024-09-21T15:07:42.532 INFO:teuthology.orchestra.run.smithi161.stdout:1469 read 0x40f8221 thru 0x410244b (0xa22b bytes) 2024-09-21T15:07:42.533 INFO:teuthology.orchestra.run.smithi161.stdout:1470 punch from 0x51b5c36 to 0x51b8eac, (0x3276 bytes) 2024-09-21T15:07:42.534 INFO:teuthology.orchestra.run.smithi161.stdout:824 write 0x5579420 thru 0x557bf1f (0x2b00 bytes) 2024-09-21T15:07:42.540 INFO:teuthology.orchestra.run.smithi161.stdout:776 writesame 0x14c1cbc thru 0x14c771e data_size 0x9(0x5a63 bytes) 2024-09-21T15:07:42.545 INFO:teuthology.orchestra.run.smithi161.stdout:945 writesame 0x412997c thru 0x4139786 data_size 0x1(0xfe0b bytes) 2024-09-21T15:07:42.547 INFO:teuthology.orchestra.run.smithi161.stdout:1096 writesame 0xa282c17 thru 0xa282e33 data_size 0x1(0x21d bytes) 2024-09-21T15:07:42.553 INFO:teuthology.orchestra.run.smithi161.stdout:1097 read 0x2e1984e thru 0x2e2528c (0xba3f bytes) 2024-09-21T15:07:42.555 INFO:teuthology.orchestra.run.smithi161.stdout:946 punch from 0x3cc52a2 to 0x3ccade1, (0x5b3f bytes) 2024-09-21T15:07:42.555 INFO:teuthology.orchestra.run.smithi161.stdout:950 clone 9 order 19 su 4096 sc 14 2024-09-21T15:07:42.556 INFO:teuthology.orchestra.run.smithi161.stdout:1098 write 0x57b4aec thru 0x57b6494 (0x19a9 bytes) 2024-09-21T15:07:42.579 INFO:teuthology.orchestra.run.smithi161.stdout:825 trunc from 0x80515c8 to 0x14e672f 2024-09-21T15:07:42.581 INFO:teuthology.orchestra.run.smithi161.stdout:1167 write 0x11b6c0e thru 0x11c5f37 (0xf32a bytes) 2024-09-21T15:07:42.591 INFO:teuthology.orchestra.run.smithi161.stdout:1473 write 0xc566fca thru 0xc568880 (0x18b7 bytes) 2024-09-21T15:07:42.595 INFO:teuthology.orchestra.run.smithi161.stdout:1099 clone 7 order 23 su 262144 sc 11 2024-09-21T15:07:42.602 INFO:teuthology.orchestra.run.smithi161.stdout:779 write 0x7cf2bf7 thru 0x7cfcef2 (0xa2fc bytes) 2024-09-21T15:07:42.610 INFO:teuthology.orchestra.run.smithi161.stdout:1474 write 0x37198c8 thru 0x371a22b (0x964 bytes) 2024-09-21T15:07:42.637 INFO:teuthology.orchestra.run.smithi161.stdout:780 writesame 0x215fc62 thru 0x216f45b data_size 0x1(0xf7fa bytes) 2024-09-21T15:07:42.639 INFO:teuthology.orchestra.run.smithi161.stdout:1168 write 0x2b444d8 thru 0x2b4f68a (0xb1b3 bytes) 2024-09-21T15:07:42.676 INFO:teuthology.orchestra.run.smithi161.stdout:1169 read 0x4a10a88 thru 0x4a1dec4 (0xd43d bytes) 2024-09-21T15:07:42.678 INFO:teuthology.orchestra.run.smithi161.stdout:782 trunc from 0xda667a0 to 0xc17d654 2024-09-21T15:07:42.700 INFO:teuthology.orchestra.run.smithi161.stdout:1475 write 0xe91d495 thru 0xe92704c (0x9bb8 bytes) 2024-09-21T15:07:42.714 INFO:teuthology.orchestra.run.smithi161.stdout:1476 read 0xc0ad601 thru 0xc0b949b (0xbe9b bytes) 2024-09-21T15:07:42.714 INFO:teuthology.orchestra.run.smithi161.stdout:1477 write 0x4e91a7b thru 0x4e9fd9c (0xe322 bytes) 2024-09-21T15:07:42.730 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.730 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.730 INFO:teuthology.orchestra.run.smithi161.stdout:1482 read 0x108443 thru 0x10c187 (0x3d45 bytes) 2024-09-21T15:07:42.731 INFO:teuthology.orchestra.run.smithi161.stdout:1484 punch from 0x68b0cb2 to 0x68bc05d, (0xb3ab bytes) 2024-09-21T15:07:42.731 INFO:teuthology.orchestra.run.smithi161.stdout:1486 read 0x80a0b thru 0x8b565 (0xab5b bytes) 2024-09-21T15:07:42.732 INFO:teuthology.orchestra.run.smithi161.stdout:1488 write 0x8ba78 thru 0x99d06 (0xe28f bytes) 2024-09-21T15:07:42.733 INFO:teuthology.orchestra.run.smithi161.stdout:784 trunc from 0xc17d654 to 0xa4e59f9 2024-09-21T15:07:42.737 INFO:teuthology.orchestra.run.smithi161.stdout:1170 writesame 0xe7aeeaf thru 0xe7b585a data_size 0x2(0x69ac bytes) 2024-09-21T15:07:42.744 INFO:teuthology.orchestra.run.smithi161.stdout:1171 punch from 0x486b459 to 0x487b04b, (0xfbf2 bytes) 2024-09-21T15:07:42.744 INFO:teuthology.orchestra.run.smithi161.stdout:1172 punch from 0xe3c7787 to 0xe3d0abc, (0x9335 bytes) 2024-09-21T15:07:42.744 INFO:teuthology.orchestra.run.smithi161.stdout:1173 write 0x8b9300c thru 0x8b9bdaf (0x8da4 bytes) 2024-09-21T15:07:42.755 INFO:teuthology.orchestra.run.smithi161.stdout:1489 read 0xe7e028a thru 0xe7e2bd8 (0x294f bytes) 2024-09-21T15:07:42.755 INFO:teuthology.orchestra.run.smithi161.stdout:1493 writesame 0x287eb49 thru 0x2880991 data_size 0x1(0x1e49 bytes) 2024-09-21T15:07:42.757 INFO:teuthology.orchestra.run.smithi161.stdout:827 writesame 0x2c005d0 thru 0x2c06cfa data_size 0x31(0x672b bytes) 2024-09-21T15:07:42.763 INFO:teuthology.orchestra.run.smithi161.stdout:828 read 0x257a98 thru 0x25d34e (0x58b7 bytes) 2024-09-21T15:07:42.764 INFO:teuthology.orchestra.run.smithi161.stdout:1174 read 0xc18aaf3 thru 0xc196cd3 (0xc1e1 bytes) 2024-09-21T15:07:42.769 INFO:teuthology.orchestra.run.smithi161.stdout:1494 read 0xdfb1dd5 thru 0xdfb3534 (0x1760 bytes) 2024-09-21T15:07:42.769 INFO:teuthology.orchestra.run.smithi161.stdout:1495 write 0x10b324f thru 0x10b5457 (0x2209 bytes) 2024-09-21T15:07:42.780 INFO:teuthology.orchestra.run.smithi161.stdout:1496 punch from 0x80c4fb6 to 0x80cc421, (0x746b bytes) 2024-09-21T15:07:42.781 INFO:teuthology.orchestra.run.smithi161.stdout:1498 write 0xbacc28 thru 0xbba66a (0xda43 bytes) 2024-09-21T15:07:42.785 INFO:teuthology.orchestra.run.smithi161.stdout:1175 trunc from 0xe7b585b to 0x4b4802f 2024-09-21T15:07:42.788 INFO:teuthology.orchestra.run.smithi161.stdout:1501 read 0x2a0b68a thru 0x2a1892a (0xd2a1 bytes) 2024-09-21T15:07:42.801 INFO:teuthology.orchestra.run.smithi161.stdout:1502 trunc from 0xe92704d to 0x6724d5c 2024-09-21T15:07:42.805 INFO:teuthology.orchestra.run.smithi161.stdout:786 write 0xd96cf87 thru 0xd971d33 (0x4dad bytes) 2024-09-21T15:07:42.814 INFO:teuthology.orchestra.run.smithi161.stdout:830 write 0xb771337 thru 0xb776029 (0x4cf3 bytes) 2024-09-21T15:07:42.830 INFO:teuthology.orchestra.run.smithi161.stdout:787 write 0xd784cfa thru 0xd78de3d (0x9144 bytes) 2024-09-21T15:07:42.835 INFO:teuthology.orchestra.run.smithi161.stdout:832 read 0x9fcdde3 thru 0x9fd8c40 (0xae5e bytes) 2024-09-21T15:07:42.835 INFO:teuthology.orchestra.run.smithi161.stdout:834 write 0x21d26e7 thru 0x21d5682 (0x2f9c bytes) 2024-09-21T15:07:42.838 INFO:teuthology.orchestra.run.smithi161.stdout:1177 write 0x9a3bdf thru 0x9aa5fa (0x6a1c bytes) 2024-09-21T15:07:42.856 INFO:teuthology.orchestra.run.smithi161.stdout:789 read 0x67dc925 thru 0x67dd134 (0x810 bytes) 2024-09-21T15:07:42.856 INFO:teuthology.orchestra.run.smithi161.stdout:835 writesame 0x93ee13e thru 0x93f5f69 data_size 0x14(0x7e2c bytes) 2024-09-21T15:07:42.857 INFO:teuthology.orchestra.run.smithi161.stdout:790 trunc from 0xd971d34 to 0xde210f3 2024-09-21T15:07:42.863 INFO:teuthology.orchestra.run.smithi161.stdout:1504 clone 7 order 25 su 524288 sc 15 2024-09-21T15:07:42.875 INFO:teuthology.orchestra.run.smithi161.stdout:837 write 0x3a061e0 thru 0x3a0b2ab (0x50cc bytes) 2024-09-21T15:07:42.895 INFO:teuthology.orchestra.run.smithi161.stdout:838 write 0x978755e thru 0x9787a1d (0x4c0 bytes) 2024-09-21T15:07:42.898 INFO:teuthology.orchestra.run.smithi161.stdout:791 read 0x30ed760 thru 0x30f8c47 (0xb4e8 bytes) 2024-09-21T15:07:42.899 INFO:teuthology.orchestra.run.smithi161.stdout:792 read 0x2ccb685 thru 0x2cd3467 (0x7de3 bytes) 2024-09-21T15:07:42.900 INFO:teuthology.orchestra.run.smithi161.stdout:794 write 0xcff4c2e thru 0xcffea73 (0x9e46 bytes) 2024-09-21T15:07:42.902 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.902 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.911 INFO:teuthology.orchestra.run.smithi161.stdout:841 trunc from 0xb77602a to 0x778f784 2024-09-21T15:07:42.920 INFO:teuthology.orchestra.run.smithi161.stdout:795 punch from 0xd975975 to 0xd9778f1, (0x1f7c bytes) 2024-09-21T15:07:42.920 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.920 INFO:teuthology.orchestra.run.smithi161.stdout:797 read 0x9c2c56c thru 0x9c34caf (0x8744 bytes) 2024-09-21T15:07:42.933 INFO:teuthology.orchestra.run.smithi161.stdout:1178 write 0xd49bec7 thru 0xd4a6bb4 (0xacee bytes) 2024-09-21T15:07:42.933 INFO:teuthology.orchestra.run.smithi161.stdout:798 trunc from 0xde210f3 to 0x6e425fa 2024-09-21T15:07:42.948 INFO:teuthology.orchestra.run.smithi161.stdout:842 write 0x765ef60 thru 0x765f941 (0x9e2 bytes) 2024-09-21T15:07:42.965 INFO:teuthology.orchestra.run.smithi161.stdout:1181 punch from 0xbb156ab to 0xbb1bacc, (0x6421 bytes) 2024-09-21T15:07:42.965 INFO:teuthology.orchestra.run.smithi161.stdout:1182 writesame 0xd437d9c thru 0xd43c826 data_size 0x1(0x4a8b bytes) 2024-09-21T15:07:42.968 INFO:teuthology.orchestra.run.smithi161.stdout:843 write 0x3d72dbf thru 0x3d74e5e (0x20a0 bytes) 2024-09-21T15:07:42.984 INFO:teuthology.orchestra.run.smithi161.stdout:1183 writesame 0xbd6ac10 thru 0xbd7236b data_size 0x2(0x775c bytes) 2024-09-21T15:07:42.990 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:42.990 INFO:teuthology.orchestra.run.smithi161.stdout:845 read 0x5b98363 thru 0x5ba66d6 (0xe374 bytes) 2024-09-21T15:07:42.997 INFO:teuthology.orchestra.run.smithi161.stdout:850 trunc from 0x778f784 to 0x4ac0b10 2024-09-21T15:07:43.021 INFO:teuthology.orchestra.run.smithi161.stdout:799 trunc from 0x6e425fa to 0x90c0208 2024-09-21T15:07:43.029 INFO:teuthology.orchestra.run.smithi161.stdout:1184 trunc from 0xd4a6bb5 to 0x153f751 2024-09-21T15:07:43.043 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.049 INFO:teuthology.orchestra.run.smithi161.stdout:800 read 0x3d30f4b thru 0x3d33ad0 (0x2b86 bytes) 2024-09-21T15:07:43.094 INFO:teuthology.orchestra.run.smithi161.stdout:802 writesame 0xe386e4b thru 0xe393ad1 data_size 0x1f(0xcc87 bytes) 2024-09-21T15:07:43.099 INFO:teuthology.orchestra.run.smithi161.stdout:804 write 0x386736d thru 0x387164d (0xa2e1 bytes) 2024-09-21T15:07:43.099 INFO:teuthology.orchestra.run.smithi161.stdout:852 write 0xd19e879 thru 0xd1a4891 (0x6019 bytes) 2024-09-21T15:07:43.115 INFO:teuthology.orchestra.run.smithi161.stdout:854 write 0xbca14f6 thru 0xbcaca06 (0xb511 bytes) 2024-09-21T15:07:43.129 INFO:teuthology.orchestra.run.smithi161.stdout:805 read 0x4bfd4b8 thru 0x4bff0da (0x1c23 bytes) 2024-09-21T15:07:43.129 INFO:teuthology.orchestra.run.smithi161.stdout:806 write 0x2db0a9 thru 0x2def40 (0x3e98 bytes) 2024-09-21T15:07:43.135 INFO:teuthology.orchestra.run.smithi161.stdout:855 writesame 0xaa9267d thru 0xaa9f70b data_size 0x27(0xd08f bytes) 2024-09-21T15:07:43.156 INFO:teuthology.orchestra.run.smithi161.stdout:856 write 0xa8796b2 thru 0xa879788 (0xd7 bytes) 2024-09-21T15:07:43.164 INFO:teuthology.orchestra.run.smithi161.stdout:807 punch from 0x221eb18 to 0x22212ca, (0x27b2 bytes) 2024-09-21T15:07:43.164 INFO:teuthology.orchestra.run.smithi161.stdout:808 write 0x54a66d7 thru 0x54b5ac8 (0xf3f2 bytes) 2024-09-21T15:07:43.172 INFO:teuthology.orchestra.run.smithi161.stdout:1186 punch from 0x11c3f72 to 0x11d2c9a, (0xed28 bytes) 2024-09-21T15:07:43.172 INFO:teuthology.orchestra.run.smithi161.stdout:1187 punch from 0x10effca to 0x10f862d, (0x8663 bytes) 2024-09-21T15:07:43.173 INFO:teuthology.orchestra.run.smithi161.stdout:857 read 0x6332a8c thru 0x633a548 (0x7abd bytes) 2024-09-21T15:07:43.194 INFO:teuthology.orchestra.run.smithi161.stdout:809 write 0x27766d thru 0x27fb04 (0x8498 bytes) 2024-09-21T15:07:43.214 INFO:teuthology.orchestra.run.smithi161.stdout:858 writesame 0xde5531d thru 0xde5ae6f data_size 0x1(0x5b53 bytes) 2024-09-21T15:07:43.216 INFO:teuthology.orchestra.run.smithi161.stdout:859 write 0x77c49a3 thru 0x77d256c (0xdbca bytes) 2024-09-21T15:07:43.217 INFO:teuthology.orchestra.run.smithi161.stdout:1188 writesame 0x4b8f4fc thru 0x4b912f9 data_size 0x2(0x1dfe bytes) 2024-09-21T15:07:43.219 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.220 INFO:teuthology.orchestra.run.smithi161.stdout:1189 read 0x4460114 thru 0x446a4cf (0xa3bc bytes) 2024-09-21T15:07:43.220 INFO:teuthology.orchestra.run.smithi161.stdout:1190 read 0x45340df thru 0x453a7dc (0x66fe bytes) 2024-09-21T15:07:43.227 INFO:teuthology.orchestra.run.smithi161.stdout:862 read 0x3f9e40b thru 0x3fa0b4f (0x2745 bytes) 2024-09-21T15:07:43.227 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.235 INFO:teuthology.orchestra.run.smithi161.stdout:1191 trunc from 0x4b912fa to 0xbd388ec 2024-09-21T15:07:43.242 INFO:teuthology.orchestra.run.smithi161.stdout:864 trunc from 0xde5ae70 to 0x69e9146 2024-09-21T15:07:43.242 INFO:teuthology.orchestra.run.smithi161.stdout:811 trunc from 0xe393ad2 to 0x28590e4 2024-09-21T15:07:43.281 INFO:teuthology.orchestra.run.smithi161.stdout:1192 trunc from 0xbd388ec to 0x615cb4f 2024-09-21T15:07:43.308 INFO:teuthology.orchestra.run.smithi161.stdout:865 trunc from 0x69e9146 to 0x5c39add 2024-09-21T15:07:43.362 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.362 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.409 INFO:teuthology.orchestra.run.smithi161.stdout:1193 write 0xcf1536e thru 0xcf24e4c (0xfadf bytes) 2024-09-21T15:07:43.413 INFO:teuthology.orchestra.run.smithi161.stdout:813 writesame 0x4ad2dcc thru 0x4ad8036 data_size 0x1(0x526b bytes) 2024-09-21T15:07:43.413 INFO:teuthology.orchestra.run.smithi161.stdout:868 write 0xcdb9cb4 thru 0xcdc3fd4 (0xa321 bytes) 2024-09-21T15:07:43.434 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.434 INFO:teuthology.orchestra.run.smithi161.stdout:1195 read 0x7bbdda5 thru 0x7bc8fb2 (0xb20e bytes) 2024-09-21T15:07:43.434 INFO:teuthology.orchestra.run.smithi161.stdout:1197 writesame 0x6d136cf thru 0x6d187ae data_size 0x10(0x50e0 bytes) 2024-09-21T15:07:43.444 INFO:teuthology.orchestra.run.smithi161.stdout:871 trunc from 0xcdc3fd5 to 0x8910d18 2024-09-21T15:07:43.449 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.449 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.449 INFO:teuthology.orchestra.run.smithi161.stdout:1202 write 0x40cabaf thru 0x40d7f05 (0xd357 bytes) 2024-09-21T15:07:43.461 INFO:teuthology.orchestra.run.smithi161.stdout:814 writesame 0x4f7687e thru 0x4f78241 data_size 0x11(0x19c4 bytes) 2024-09-21T15:07:43.494 INFO:teuthology.orchestra.run.smithi161.stdout:873 read 0x2d36a94 thru 0x2d3ccde (0x624b bytes) 2024-09-21T15:07:43.496 INFO:teuthology.orchestra.run.smithi161.stdout:1204 trunc from 0xcf24e4d to 0x5d6a651 2024-09-21T15:07:43.526 INFO:teuthology.orchestra.run.smithi161.stdout:816 write 0xd78e51b thru 0xd79102e (0x2b14 bytes) 2024-09-21T15:07:43.541 INFO:teuthology.orchestra.run.smithi161.stdout:875 write 0xe4815d0 thru 0xe48f420 (0xde51 bytes) 2024-09-21T15:07:43.544 INFO:teuthology.orchestra.run.smithi161.stdout:817 punch from 0xaa9cc17 to 0xaaa7f9a, (0xb383 bytes) 2024-09-21T15:07:43.557 INFO:teuthology.orchestra.run.smithi161.stdout:818 trunc from 0xd79102f to 0x6db24cc 2024-09-21T15:07:43.563 INFO:teuthology.orchestra.run.smithi161.stdout:876 read 0x90753f thru 0x90b3bf (0x3e81 bytes) 2024-09-21T15:07:43.566 INFO:teuthology.orchestra.run.smithi161.stdout:878 read 0x5ef68c5 thru 0x5f028c1 (0xbffd bytes) 2024-09-21T15:07:43.566 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.566 INFO:teuthology.orchestra.run.smithi161.stdout:880 write 0xc7350ff thru 0xc74147d (0xc37f bytes) 2024-09-21T15:07:43.573 INFO:teuthology.orchestra.run.smithi161.stdout:1206 trunc from 0x5d6a651 to 0x79c3b00 2024-09-21T15:07:43.580 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.580 INFO:teuthology.orchestra.run.smithi161.stdout:883 writesame 0xaa09e08 thru 0xaa0d363 data_size 0xa(0x355c bytes) 2024-09-21T15:07:43.594 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.594 INFO:teuthology.orchestra.run.smithi161.stdout:884 write 0x6f0dbe9 thru 0x6f18100 (0xa518 bytes) 2024-09-21T15:07:43.604 INFO:teuthology.orchestra.run.smithi161.stdout:1207 trunc from 0x79c3b00 to 0x3137939 2024-09-21T15:07:43.613 INFO:teuthology.orchestra.run.smithi161.stdout:885 trunc from 0xe48f421 to 0xe2813eb 2024-09-21T15:07:43.634 INFO:teuthology.orchestra.run.smithi161.stdout:820 writesame 0xb52318d thru 0xb525776 data_size 0x17(0x25ea bytes) 2024-09-21T15:07:43.639 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone6 from 0x6724d5c (overlap 0x1d098e1) to 0xe84c70 2024-09-21T15:07:43.639 INFO:teuthology.orchestra.run.smithi161.stdout:821 write 0x6b5ec8c thru 0x6b6e2d0 (0xf645 bytes) 2024-09-21T15:07:43.659 INFO:teuthology.orchestra.run.smithi161.stdout:822 punch from 0x6ba53e5 to 0x6bb5109, (0xfd24 bytes) 2024-09-21T15:07:43.665 INFO:teuthology.orchestra.run.smithi161.stdout:1208 trunc from 0x3137939 to 0x1bdd8ee 2024-09-21T15:07:43.666 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone6 from 0xa282e34 (overlap 0x583b4fd) to 0x8d2bb2 2024-09-21T15:07:43.672 INFO:teuthology.orchestra.run.smithi161.stdout:886 writesame 0x8d8c03a thru 0x8d978b4 data_size 0x1(0xb87b bytes) 2024-09-21T15:07:43.713 INFO:teuthology.orchestra.run.smithi161.stdout:823 write 0xe3ee7b3 thru 0xe3f4e8b (0x66d9 bytes) 2024-09-21T15:07:43.739 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.739 INFO:teuthology.orchestra.run.smithi161.stdout:890 write 0x8fe9114 thru 0x8ff6756 (0xd643 bytes) 2024-09-21T15:07:43.743 INFO:teuthology.orchestra.run.smithi161.stdout:825 writesame 0x5db87d2 thru 0x5dbae0a data_size 0x13(0x2639 bytes) 2024-09-21T15:07:43.765 INFO:teuthology.orchestra.run.smithi161.stdout:891 write 0x7bfbf60 thru 0x7c00655 (0x46f6 bytes) 2024-09-21T15:07:43.774 INFO:teuthology.orchestra.run.smithi161.stdout:1209 trunc from 0x1bdd8ee to 0x99131e8 2024-09-21T15:07:43.780 INFO:teuthology.orchestra.run.smithi161.stdout:826 read 0x8d53b7a thru 0x8d5d677 (0x9afe bytes) 2024-09-21T15:07:43.780 INFO:teuthology.orchestra.run.smithi161.stdout:828 write 0x475778c thru 0x47595b6 (0x1e2b bytes) 2024-09-21T15:07:43.796 INFO:teuthology.orchestra.run.smithi161.stdout:830 punch from 0x61cd837 to 0x61d0514, (0x2cdd bytes) 2024-09-21T15:07:43.796 INFO:teuthology.orchestra.run.smithi161.stdout:832 punch from 0x149e320 to 0x14a71f0, (0x8ed0 bytes) 2024-09-21T15:07:43.797 INFO:teuthology.orchestra.run.smithi161.stdout:835 punch from 0x7688221 to 0x7697dbe, (0xfb9d bytes) 2024-09-21T15:07:43.797 INFO:teuthology.orchestra.run.smithi161.stdout:836 read 0xb595440 thru 0xb59bfec (0x6bad bytes) 2024-09-21T15:07:43.797 INFO:teuthology.orchestra.run.smithi161.stdout:837 writesame 0x8c4cfc3 thru 0x8c4fafb data_size 0x1(0x2b39 bytes) 2024-09-21T15:07:43.824 INFO:teuthology.orchestra.run.smithi161.stdout:892 punch from 0xa52d2ab to 0xa538b6c, (0xb8c1 bytes) 2024-09-21T15:07:43.824 INFO:teuthology.orchestra.run.smithi161.stdout:895 read 0x65afcaa thru 0x65b0687 (0x9de bytes) 2024-09-21T15:07:43.824 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.824 INFO:teuthology.orchestra.run.smithi161.stdout:897 punch from 0x91eb5e5 to 0x91ef4a6, (0x3ec1 bytes) 2024-09-21T15:07:43.824 INFO:teuthology.orchestra.run.smithi161.stdout:898 write 0xb18e0cd thru 0xb19678c (0x86c0 bytes) 2024-09-21T15:07:43.831 INFO:teuthology.orchestra.run.smithi161.stdout:838 read 0x6cc232f thru 0x6cc7247 (0x4f19 bytes) 2024-09-21T15:07:43.832 INFO:teuthology.orchestra.run.smithi161.stdout:839 write 0x46d263a thru 0x46d6498 (0x3e5f bytes) 2024-09-21T15:07:43.847 INFO:teuthology.orchestra.run.smithi161.stdout:899 write 0xc821b5c thru 0xc824c52 (0x30f7 bytes) 2024-09-21T15:07:43.853 INFO:teuthology.orchestra.run.smithi161.stdout:840 writesame 0x275b5ff thru 0x27636d1 data_size 0x1(0x80d3 bytes) 2024-09-21T15:07:43.867 INFO:teuthology.orchestra.run.smithi161.stdout:900 read 0xb57d2b0 thru 0xb5865bc (0x930d bytes) 2024-09-21T15:07:43.867 INFO:teuthology.orchestra.run.smithi161.stdout:901 read 0x221a6a3 thru 0x2226e71 (0xc7cf bytes) 2024-09-21T15:07:43.868 INFO:teuthology.orchestra.run.smithi161.stdout:902 write 0xa9cf253 thru 0xa9cf662 (0x410 bytes) 2024-09-21T15:07:43.876 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #5, image image_cluster1.client.mirror.2-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent6 2024-09-21T15:07:43.876 INFO:teuthology.orchestra.run.smithi161.stdout:903 write 0x4c61771 thru 0x4c628fd (0x118d bytes) 2024-09-21T15:07:43.885 INFO:teuthology.orchestra.run.smithi161.stdout:904 punch from 0x9ad3ad4 to 0x9ae2b33, (0xf05f bytes) 2024-09-21T15:07:43.885 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.885 INFO:teuthology.orchestra.run.smithi161.stdout:907 writesame 0x9b31cc2 thru 0x9b3c202 data_size 0x1(0xa541 bytes) 2024-09-21T15:07:43.896 INFO:teuthology.orchestra.run.smithi161.stdout:841 trunc from 0xe3f4e8c to 0x6e7b8ef 2024-09-21T15:07:43.911 INFO:teuthology.orchestra.run.smithi161.stdout:1210 read 0x5752ba thru 0x58255a (0xd2a1 bytes) 2024-09-21T15:07:43.914 INFO:teuthology.orchestra.run.smithi161.stdout:1211 trunc from 0x99131e8 to 0x9bdacf7 2024-09-21T15:07:43.925 INFO:teuthology.orchestra.run.smithi161.stdout:1505 write 0x3ea1ace thru 0x3eadccb (0xc1fe bytes) 2024-09-21T15:07:43.939 INFO:teuthology.orchestra.run.smithi161.stdout:1213 writesame 0x650273d thru 0x650d759 data_size 0x47(0xb01d bytes) 2024-09-21T15:07:43.947 INFO:teuthology.orchestra.run.smithi161.stdout:908 punch from 0x9c8f56e to 0x9c9a039, (0xaacb bytes) 2024-09-21T15:07:43.947 INFO:teuthology.orchestra.run.smithi161.stdout:909 writesame 0xd911456 thru 0xd914c45 data_size 0x28(0x37f0 bytes) 2024-09-21T15:07:43.959 INFO:teuthology.orchestra.run.smithi161.stdout:910 write 0x8f742e9 thru 0x8f78f40 (0x4c58 bytes) 2024-09-21T15:07:43.962 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:43.992 INFO:teuthology.orchestra.run.smithi161.stdout:911 write 0x21d3cfe thru 0x21d81e6 (0x44e9 bytes) 2024-09-21T15:07:44.008 INFO:teuthology.orchestra.run.smithi161.stdout:912 punch from 0x1ecdf20 to 0x1ecfafe, (0x1bde bytes) 2024-09-21T15:07:44.008 INFO:teuthology.orchestra.run.smithi161.stdout:913 write 0x8155da4 thru 0x8156d34 (0xf91 bytes) 2024-09-21T15:07:44.025 INFO:teuthology.orchestra.run.smithi161.stdout:1508 write 0xba10023 thru 0xba193bc (0x939a bytes) 2024-09-21T15:07:44.028 INFO:teuthology.orchestra.run.smithi161.stdout:915 read 0xbc18c4f thru 0xbc24976 (0xbd28 bytes) 2024-09-21T15:07:44.028 INFO:teuthology.orchestra.run.smithi161.stdout:916 read 0x50a8dae thru 0x50b3b6a (0xadbd bytes) 2024-09-21T15:07:44.028 INFO:teuthology.orchestra.run.smithi161.stdout:917 read 0xb068bc8 thru 0xb073dfd (0xb236 bytes) 2024-09-21T15:07:44.028 INFO:teuthology.orchestra.run.smithi161.stdout:918 read 0x2d0df47 thru 0x2d0f3b6 (0x1470 bytes) 2024-09-21T15:07:44.035 INFO:teuthology.orchestra.run.smithi161.stdout:1214 trunc from 0x9bdacf7 to 0x78635c2 2024-09-21T15:07:44.035 INFO:teuthology.orchestra.run.smithi161.stdout:921 trunc from 0xe2813eb to 0xba846fd 2024-09-21T15:07:44.038 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #7, image image_cluster1.client.mirror.4-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent8 2024-09-21T15:07:44.048 INFO:teuthology.orchestra.run.smithi161.stdout:1509 read 0xc230b8 thru 0xc314a5 (0xe3ee bytes) 2024-09-21T15:07:44.049 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:44.049 INFO:teuthology.orchestra.run.smithi161.stdout:1511 read 0x5e3ad46 thru 0x5e3c4ec (0x17a7 bytes) 2024-09-21T15:07:44.049 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:44.049 INFO:teuthology.orchestra.run.smithi161.stdout:1513 writesame 0x3bc2b57 thru 0x3bcd871 data_size 0x1(0xad1b bytes) 2024-09-21T15:07:44.073 INFO:teuthology.orchestra.run.smithi161.stdout:1216 trunc from 0x78635c2 to 0x4196be0 2024-09-21T15:07:44.092 INFO:teuthology.orchestra.run.smithi161.stdout:922 trunc from 0xba846fd to 0x1f01bca 2024-09-21T15:07:44.097 INFO:teuthology.orchestra.run.smithi161.stdout:1514 read 0x1cdd004 thru 0x1cea2f0 (0xd2ed bytes) 2024-09-21T15:07:44.098 INFO:teuthology.orchestra.run.smithi161.stdout:1516 writesame 0x5a7a2a9 thru 0x5a7ee86 data_size 0x9(0x4bde bytes) 2024-09-21T15:07:44.142 INFO:teuthology.orchestra.run.smithi161.stdout:1517 trunc from 0xba193bd to 0x44bbd82 2024-09-21T15:07:44.187 INFO:teuthology.orchestra.run.smithi161.stdout:842 read 0x42804 thru 0x4fdf0 (0xd5ed bytes) 2024-09-21T15:07:44.188 INFO:teuthology.orchestra.run.smithi161.stdout:1217 punch from 0x3a64d60 to 0x3a69476, (0x4716 bytes) 2024-09-21T15:07:44.188 INFO:teuthology.orchestra.run.smithi161.stdout:1218 write 0x2f89e66 thru 0x2f966c6 (0xc861 bytes) 2024-09-21T15:07:44.196 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:44.196 INFO:teuthology.orchestra.run.smithi161.stdout:953 read 0x35eb4b8 thru 0x35edfde (0x2b27 bytes) 2024-09-21T15:07:44.196 INFO:teuthology.orchestra.run.smithi161.stdout:1518 write 0x3699f1d thru 0x36a1d5d (0x7e41 bytes) 2024-09-21T15:07:44.200 INFO:teuthology.orchestra.run.smithi161.stdout:924 punch from 0x1e35670 to 0x1e3fd30, (0xa6c0 bytes) 2024-09-21T15:07:44.201 INFO:teuthology.orchestra.run.smithi161.stdout:926 trunc from 0x1f01bca to 0x23dcd0e 2024-09-21T15:07:44.207 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:44.211 INFO:teuthology.orchestra.run.smithi161.stdout:1220 read 0x23aa321 thru 0x23b14e6 (0x71c6 bytes) 2024-09-21T15:07:44.213 INFO:teuthology.orchestra.run.smithi161.stdout:1520 trunc from 0x44bbd82 to 0x1f9839a 2024-09-21T15:07:44.218 INFO:teuthology.orchestra.run.smithi161.stdout:1222 trunc from 0x4196be0 to 0x150eea9 2024-09-21T15:07:44.239 INFO:teuthology.orchestra.run.smithi161.stdout:927 punch from 0x3a61ad to 0x3b1ce2, (0xbb35 bytes) 2024-09-21T15:07:44.256 INFO:teuthology.orchestra.run.smithi161.stdout:843 trunc from 0x6e7b8ef to 0x1c4fb18 2024-09-21T15:07:44.275 INFO:teuthology.orchestra.run.smithi161.stdout:1522 punch from 0x42a2a7 to 0x432c5b, (0x89b4 bytes) 2024-09-21T15:07:44.275 INFO:teuthology.orchestra.run.smithi161.stdout:1523 read 0xe5e185 thru 0xe6bad4 (0xd950 bytes) 2024-09-21T15:07:44.284 INFO:teuthology.orchestra.run.smithi161.stdout:954 write 0xb9fa8cc thru 0xba04f03 (0xa638 bytes) 2024-09-21T15:07:44.291 INFO:teuthology.orchestra.run.smithi161.stdout:928 writesame 0x2add67b thru 0x2ae64bc data_size 0x2(0x8e42 bytes) 2024-09-21T15:07:44.304 INFO:teuthology.orchestra.run.smithi161.stdout:1223 read 0xde6548 thru 0xdeb932 (0x53eb bytes) 2024-09-21T15:07:44.318 INFO:teuthology.orchestra.run.smithi161.stdout:929 read 0x27c7e4a thru 0x27c9962 (0x1b19 bytes) 2024-09-21T15:07:44.318 INFO:teuthology.orchestra.run.smithi161.stdout:930 read 0xe286bb thru 0xe3194a (0x9290 bytes) 2024-09-21T15:07:44.342 INFO:teuthology.orchestra.run.smithi161.stdout:1524 write 0xc91b301 thru 0xc920f0f (0x5c0f bytes) 2024-09-21T15:07:44.355 INFO:teuthology.orchestra.run.smithi161.stdout:1525 read 0x217da83 thru 0x217f408 (0x1986 bytes) 2024-09-21T15:07:44.355 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:44.362 INFO:teuthology.orchestra.run.smithi161.stdout:1224 write 0x9dabf97 thru 0x9db5a92 (0x9afc bytes) 2024-09-21T15:07:44.364 INFO:teuthology.orchestra.run.smithi161.stdout:1529 trunc from 0xc920f10 to 0x874aac4 2024-09-21T15:07:44.385 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:44.389 INFO:teuthology.orchestra.run.smithi161.stdout:955 write 0xc8430f7 thru 0xc8480ec (0x4ff6 bytes) 2024-09-21T15:07:44.389 INFO:teuthology.orchestra.run.smithi161.stdout:1226 read 0x7456723 thru 0x745b3e8 (0x4cc6 bytes) 2024-09-21T15:07:44.389 INFO:teuthology.orchestra.run.smithi161.stdout:1227 punch from 0x620cb54 to 0x62147f4, (0x7ca0 bytes) 2024-09-21T15:07:44.395 INFO:teuthology.orchestra.run.smithi161.stdout:931 writesame 0xd30dbbc thru 0xd30f664 data_size 0x41(0x1aa9 bytes) 2024-09-21T15:07:44.398 INFO:teuthology.orchestra.run.smithi161.stdout:1229 trunc from 0x9db5a93 to 0xe3ad37d 2024-09-21T15:07:44.401 INFO:teuthology.orchestra.run.smithi161.stdout:934 writesame 0x47276c3 thru 0x47359b1 data_size 0xf(0xe2ef bytes) 2024-09-21T15:07:44.411 INFO:teuthology.orchestra.run.smithi161.stdout:1530 write 0x77b65c2 thru 0x77c2dc8 (0xc807 bytes) 2024-09-21T15:07:44.416 INFO:teuthology.orchestra.run.smithi161.stdout:935 write 0xce21ec1 thru 0xce2fc42 (0xdd82 bytes) 2024-09-21T15:07:44.416 INFO:teuthology.orchestra.run.smithi161.stdout:956 trunc from 0xc8480ed to 0x94191db 2024-09-21T15:07:44.419 INFO:teuthology.orchestra.run.smithi161.stdout:1531 read 0x2191228 thru 0x219969c (0x8475 bytes) 2024-09-21T15:07:44.421 INFO:teuthology.orchestra.run.smithi161.stdout:846 write 0x3e53f74 thru 0x3e63092 (0xf11f bytes) 2024-09-21T15:07:44.425 INFO:teuthology.orchestra.run.smithi161.stdout:1532 trunc from 0x874aac4 to 0xaf4b386 2024-09-21T15:07:44.434 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:44.434 INFO:teuthology.orchestra.run.smithi161.stdout:1233 writesame 0x5767e2 thru 0x578374 data_size 0xd(0x1b93 bytes) 2024-09-21T15:07:44.437 INFO:teuthology.orchestra.run.smithi161.stdout:936 writesame 0x85199c5 thru 0x85210c6 data_size 0x1(0x7702 bytes) 2024-09-21T15:07:44.465 INFO:teuthology.orchestra.run.smithi161.stdout:1235 read 0xa03b18a thru 0xa047800 (0xc677 bytes) 2024-09-21T15:07:44.466 INFO:teuthology.orchestra.run.smithi161.stdout:1237 writesame 0xae127f9 thru 0xae16775 data_size 0x1(0x3f7d bytes) 2024-09-21T15:07:44.474 INFO:teuthology.orchestra.run.smithi161.stdout:938 trunc from 0xd30f665 to 0xd26924d 2024-09-21T15:07:44.482 INFO:teuthology.orchestra.run.smithi161.stdout:1238 write 0x831da76 thru 0x8320dcd (0x3358 bytes) 2024-09-21T15:07:44.482 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:44.482 INFO:teuthology.orchestra.run.smithi161.stdout:959 clone 10 order 21 su 32768 sc 5 2024-09-21T15:07:44.482 INFO:teuthology.orchestra.run.smithi161.stdout:1533 read 0x880ff4d thru 0x8817bee (0x7ca2 bytes) 2024-09-21T15:07:44.500 INFO:teuthology.orchestra.run.smithi161.stdout:1239 read 0x9c9003c thru 0x9c9e324 (0xe2e9 bytes) 2024-09-21T15:07:44.502 INFO:teuthology.orchestra.run.smithi161.stdout:1535 trunc from 0xaf4b386 to 0x2281dbb 2024-09-21T15:07:44.503 INFO:teuthology.orchestra.run.smithi161.stdout:1240 trunc from 0xe3ad37d to 0xd4e683b 2024-09-21T15:07:44.504 INFO:teuthology.orchestra.run.smithi161.stdout:848 write 0x7f832d6 thru 0x7f87916 (0x4641 bytes) 2024-09-21T15:07:44.505 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #5, image image_cluster1.client.mirror.1-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent6 2024-09-21T15:07:44.513 INFO:teuthology.orchestra.run.smithi161.stdout:941 punch from 0x641aa8a to 0x6425aef, (0xb065 bytes) 2024-09-21T15:07:44.513 INFO:teuthology.orchestra.run.smithi161.stdout:942 write 0xc416652 thru 0xc41f638 (0x8fe7 bytes) 2024-09-21T15:07:44.523 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:44.523 INFO:teuthology.orchestra.run.smithi161.stdout:850 write 0x4cd4219 thru 0x4cdc1e9 (0x7fd1 bytes) 2024-09-21T15:07:44.528 INFO:teuthology.orchestra.run.smithi161.stdout:943 read 0x40da16f thru 0x40db685 (0x1517 bytes) 2024-09-21T15:07:44.528 INFO:teuthology.orchestra.run.smithi161.stdout:944 write 0xb4cb313 thru 0xb4d832c (0xd01a bytes) 2024-09-21T15:07:44.543 INFO:teuthology.orchestra.run.smithi161.stdout:945 writesame 0x6374274 thru 0x6383295 data_size 0x7(0xf022 bytes) 2024-09-21T15:07:44.543 INFO:teuthology.orchestra.run.smithi161.stdout:1243 write 0xa2ef0fd thru 0xa2faa9c (0xb9a0 bytes) 2024-09-21T15:07:44.545 INFO:teuthology.orchestra.run.smithi161.stdout:851 trunc from 0x7f87917 to 0x7a007c5 2024-09-21T15:07:44.556 INFO:teuthology.orchestra.run.smithi161.stdout:1536 trunc from 0x2281dbb to 0x89e42d5 2024-09-21T15:07:44.560 INFO:teuthology.orchestra.run.smithi161.stdout:947 read 0x5eefb51 thru 0x5efba82 (0xbf32 bytes) 2024-09-21T15:07:44.561 INFO:teuthology.orchestra.run.smithi161.stdout:949 write 0x44b6039 thru 0x44c17ac (0xb774 bytes) 2024-09-21T15:07:44.566 INFO:teuthology.orchestra.run.smithi161.stdout:1245 clone 8 order 19 su 16384 sc 13 2024-09-21T15:07:44.576 INFO:teuthology.orchestra.run.smithi161.stdout:950 write 0x3b37ad4 thru 0x3b37d0c (0x239 bytes) 2024-09-21T15:07:44.591 INFO:teuthology.orchestra.run.smithi161.stdout:951 punch from 0x1ac7cff to 0x1aca0b2, (0x23b3 bytes) 2024-09-21T15:07:44.591 INFO:teuthology.orchestra.run.smithi161.stdout:954 read 0x1f28e4f thru 0x1f2e9c4 (0x5b76 bytes) 2024-09-21T15:07:44.591 INFO:teuthology.orchestra.run.smithi161.stdout:956 read 0x893265a thru 0x8934c7d (0x2624 bytes) 2024-09-21T15:07:44.591 INFO:teuthology.orchestra.run.smithi161.stdout:855 read 0x58a2f20 thru 0x58b18cd (0xe9ae bytes) 2024-09-21T15:07:44.592 INFO:teuthology.orchestra.run.smithi161.stdout:1537 trunc from 0x89e42d5 to 0x5b9cf3d 2024-09-21T15:07:44.592 INFO:teuthology.orchestra.run.smithi161.stdout:957 writesame 0x2fcc595 thru 0x2fd8b0b data_size 0x1(0xc577 bytes) 2024-09-21T15:07:44.592 INFO:teuthology.orchestra.run.smithi161.stdout:857 read 0x1c8d80d thru 0x1c9104f (0x3843 bytes) 2024-09-21T15:07:44.593 INFO:teuthology.orchestra.run.smithi161.stdout:858 write 0x5913d21 thru 0x59205e5 (0xc8c5 bytes) 2024-09-21T15:07:44.636 INFO:teuthology.orchestra.run.smithi161.stdout:959 read 0x8cc3c3b thru 0x8cc9efd (0x62c3 bytes) 2024-09-21T15:07:44.637 INFO:teuthology.orchestra.run.smithi161.stdout:960 punch from 0xc4cc92b to 0xc4d2fc1, (0x6696 bytes) 2024-09-21T15:07:44.637 INFO:teuthology.orchestra.run.smithi161.stdout:962 write 0x9508c75 thru 0x951882e (0xfbba bytes) 2024-09-21T15:07:44.642 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:44.642 INFO:teuthology.orchestra.run.smithi161.stdout:861 write 0x35abc22 thru 0x35b452b (0x890a bytes) 2024-09-21T15:07:44.650 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:44.651 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:44.662 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:44.662 INFO:teuthology.orchestra.run.smithi161.stdout:864 read 0x646d9cb thru 0x6478e04 (0xb43a bytes) 2024-09-21T15:07:44.663 INFO:teuthology.orchestra.run.smithi161.stdout:865 punch from 0x4b055c6 to 0x4b12c2f, (0xd669 bytes) 2024-09-21T15:07:44.663 INFO:teuthology.orchestra.run.smithi161.stdout:866 write 0x6d65a8e thru 0x6d7099a (0xaf0d bytes) 2024-09-21T15:07:44.664 INFO:teuthology.orchestra.run.smithi161.stdout:968 trunc from 0xd26924d to 0x72fcfea 2024-09-21T15:07:44.684 INFO:teuthology.orchestra.run.smithi161.stdout:867 read 0x6c9d3c9 thru 0x6ca5a05 (0x863d bytes) 2024-09-21T15:07:44.693 INFO:teuthology.orchestra.run.smithi161.stdout:1539 write 0xa820ac6 thru 0xa82a1ec (0x9727 bytes) 2024-09-21T15:07:44.693 INFO:teuthology.orchestra.run.smithi161.stdout:869 trunc from 0x7a007c5 to 0xbc8f9fe 2024-09-21T15:07:44.699 INFO:teuthology.orchestra.run.smithi161.stdout:1540 write 0x700831e thru 0x700e4f1 (0x61d4 bytes) 2024-09-21T15:07:44.706 INFO:teuthology.orchestra.run.smithi161.stdout:969 trunc from 0x72fcfea to 0x479c0c3 2024-09-21T15:07:44.719 INFO:teuthology.orchestra.run.smithi161.stdout:870 write 0x20e72d thru 0x20f719 (0xfed bytes) 2024-09-21T15:07:44.737 INFO:teuthology.orchestra.run.smithi161.stdout:872 trunc from 0xbc8f9fe to 0xe122d6d 2024-09-21T15:07:44.758 INFO:teuthology.orchestra.run.smithi161.stdout:1542 write 0xe7afe3e thru 0xe7b1aa0 (0x1c63 bytes) 2024-09-21T15:07:44.767 INFO:teuthology.orchestra.run.smithi161.stdout:1543 write 0xf88723 thru 0xf96745 (0xe023 bytes) 2024-09-21T15:07:44.775 INFO:teuthology.orchestra.run.smithi161.stdout:1544 writesame 0x749d9cc thru 0x74a8e9d data_size 0xf(0xb4d2 bytes) 2024-09-21T15:07:44.775 INFO:teuthology.orchestra.run.smithi161.stdout:873 write 0x6d8e846 thru 0x6d985c1 (0x9d7c bytes) 2024-09-21T15:07:44.784 INFO:teuthology.orchestra.run.smithi161.stdout:1545 writesame 0x3254d37 thru 0x3259b22 data_size 0x2(0x4dec bytes) 2024-09-21T15:07:44.792 INFO:teuthology.orchestra.run.smithi161.stdout:874 write 0xac96fa1 thru 0xaca20c7 (0xb127 bytes) 2024-09-21T15:07:44.801 INFO:teuthology.orchestra.run.smithi161.stdout:971 write 0xb2cb9b0 thru 0xb2d5779 (0x9dca bytes) 2024-09-21T15:07:44.802 INFO:teuthology.orchestra.run.smithi161.stdout:1546 write 0x74d2864 thru 0x74dd179 (0xa916 bytes) 2024-09-21T15:07:44.819 INFO:teuthology.orchestra.run.smithi161.stdout:973 punch from 0x194cb50 to 0x195052d, (0x39dd bytes) 2024-09-21T15:07:44.819 INFO:teuthology.orchestra.run.smithi161.stdout:974 write 0x24121d3 thru 0x2412385 (0x1b3 bytes) 2024-09-21T15:07:44.819 INFO:teuthology.orchestra.run.smithi161.stdout:875 write 0x464b3d0 thru 0x4659ac4 (0xe6f5 bytes) 2024-09-21T15:07:44.837 INFO:teuthology.orchestra.run.smithi161.stdout:1547 trunc from 0xe7b1aa1 to 0x205940e 2024-09-21T15:07:44.838 INFO:teuthology.orchestra.run.smithi161.stdout:877 write 0x5dee0eb thru 0x5df695b (0x8871 bytes) 2024-09-21T15:07:44.862 INFO:teuthology.orchestra.run.smithi161.stdout:879 write 0x5eb02a2 thru 0x5eb9751 (0x94b0 bytes) 2024-09-21T15:07:44.862 INFO:teuthology.orchestra.run.smithi161.stdout:975 write 0xbb03ae6 thru 0xbb0899d (0x4eb8 bytes) 2024-09-21T15:07:44.885 INFO:teuthology.orchestra.run.smithi161.stdout:979 read 0x29e4a68 thru 0x29f3ec7 (0xf460 bytes) 2024-09-21T15:07:44.885 INFO:teuthology.orchestra.run.smithi161.stdout:981 write 0x1c5c345 thru 0x1c6b75f (0xf41b bytes) 2024-09-21T15:07:44.889 INFO:teuthology.orchestra.run.smithi161.stdout:1102 write 0xf7ad64 thru 0xf805d8 (0x5875 bytes) 2024-09-21T15:07:44.890 INFO:teuthology.orchestra.run.smithi161.stdout:882 read 0xd1c0764 thru 0xd1c882a (0x80c7 bytes) 2024-09-21T15:07:44.891 INFO:teuthology.orchestra.run.smithi161.stdout:883 writesame 0xbc42b62 thru 0xbc478d3 data_size 0x17(0x4d72 bytes) 2024-09-21T15:07:44.916 INFO:teuthology.orchestra.run.smithi161.stdout:884 writesame 0x5472017 thru 0x547245a data_size 0x2(0x444 bytes) 2024-09-21T15:07:44.928 INFO:teuthology.orchestra.run.smithi161.stdout:982 trunc from 0xbb0899e to 0xf67dde 2024-09-21T15:07:44.935 INFO:teuthology.orchestra.run.smithi161.stdout:885 writesame 0x4bd90f5 thru 0x4be7d6a data_size 0xab(0xec76 bytes) 2024-09-21T15:07:44.949 INFO:teuthology.orchestra.run.smithi161.stdout:1548 write 0x98d783c thru 0x98e1a6e (0xa233 bytes) 2024-09-21T15:07:44.968 INFO:teuthology.orchestra.run.smithi161.stdout:1549 read 0x2fc2fea thru 0x2fcebb8 (0xbbcf bytes) 2024-09-21T15:07:44.969 INFO:teuthology.orchestra.run.smithi161.stdout:1550 read 0x1196d47 thru 0x11982e1 (0x159b bytes) 2024-09-21T15:07:44.970 INFO:teuthology.orchestra.run.smithi161.stdout:1551 read 0x5c76b2b thru 0x5c84645 (0xdb1b bytes) 2024-09-21T15:07:44.971 INFO:teuthology.orchestra.run.smithi161.stdout:886 trunc from 0xe122d6d to 0x9d52165 2024-09-21T15:07:44.981 INFO:teuthology.orchestra.run.smithi161.stdout:1552 trunc from 0x98e1a6f to 0x4b60c9c 2024-09-21T15:07:45.037 INFO:teuthology.orchestra.run.smithi161.stdout:887 read 0x51b2f52 thru 0x51b7c5d (0x4d0c bytes) 2024-09-21T15:07:45.037 INFO:teuthology.orchestra.run.smithi161.stdout:888 write 0x25c1fc0 thru 0x25c225c (0x29d bytes) 2024-09-21T15:07:45.042 INFO:teuthology.orchestra.run.smithi161.stdout:1553 writesame 0x3be5828 thru 0x3bec9cb data_size 0x7(0x71a4 bytes) 2024-09-21T15:07:45.044 INFO:teuthology.orchestra.run.smithi161.stdout:1103 read 0x425995b thru 0x4265853 (0xbef9 bytes) 2024-09-21T15:07:45.053 INFO:teuthology.orchestra.run.smithi161.stdout:1554 write 0x2c9b58a thru 0x2c9c3dc (0xe53 bytes) 2024-09-21T15:07:45.054 INFO:teuthology.orchestra.run.smithi161.stdout:889 write 0x10389a8 thru 0x103e5ec (0x5c45 bytes) 2024-09-21T15:07:45.058 INFO:teuthology.orchestra.run.smithi161.stdout:1104 trunc from 0xa282e34 to 0x41e5566 2024-09-21T15:07:45.067 INFO:teuthology.orchestra.run.smithi161.stdout:1555 read 0x3b8a76d thru 0x3b8c746 (0x1fda bytes) 2024-09-21T15:07:45.069 INFO:teuthology.orchestra.run.smithi161.stdout:1556 trunc from 0x4b60c9c to 0x48ef772 2024-09-21T15:07:45.165 INFO:teuthology.orchestra.run.smithi161.stdout:1557 trunc from 0x48ef772 to 0x7838b02 2024-09-21T15:07:45.177 INFO:teuthology.orchestra.run.smithi161.stdout:890 punch from 0x10e08c8 to 0x10ed617, (0xcd4f bytes) 2024-09-21T15:07:45.177 INFO:teuthology.orchestra.run.smithi161.stdout:894 read 0x79120c5 thru 0x791fb0e (0xda4a bytes) 2024-09-21T15:07:45.177 INFO:teuthology.orchestra.run.smithi161.stdout:895 write 0x92f539f thru 0x93001fb (0xae5d bytes) 2024-09-21T15:07:45.188 INFO:teuthology.orchestra.run.smithi161.stdout:984 trunc from 0xf67dde to 0x182b990 2024-09-21T15:07:45.230 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:45.230 INFO:teuthology.orchestra.run.smithi161.stdout:898 writesame 0x746be00 thru 0x7470d43 data_size 0x59(0x4f44 bytes) 2024-09-21T15:07:45.249 INFO:teuthology.orchestra.run.smithi161.stdout:899 read 0x8bc63a4 thru 0x8bd457a (0xe1d7 bytes) 2024-09-21T15:07:45.249 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:45.250 INFO:teuthology.orchestra.run.smithi161.stdout:903 punch from 0x20c04a7 to 0x20c45b2, (0x410b bytes) 2024-09-21T15:07:45.250 INFO:teuthology.orchestra.run.smithi161.stdout:906 writesame 0x580c335 thru 0x58129a2 data_size 0x7(0x666e bytes) 2024-09-21T15:07:45.265 INFO:teuthology.orchestra.run.smithi161.stdout:907 punch from 0x6ce085c to 0x6cee5d0, (0xdd74 bytes) 2024-09-21T15:07:45.266 INFO:teuthology.orchestra.run.smithi161.stdout:1558 write 0xb1ea81b thru 0xb1f2559 (0x7d3f bytes) 2024-09-21T15:07:45.276 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:45.276 INFO:teuthology.orchestra.run.smithi161.stdout:1560 read 0x8ac5380 thru 0x8ad0529 (0xb1aa bytes) 2024-09-21T15:07:45.279 INFO:teuthology.orchestra.run.smithi161.stdout:1561 trunc from 0xb1f255a to 0x9c75963 2024-09-21T15:07:45.312 INFO:teuthology.orchestra.run.smithi161.stdout:908 write 0xd6569a3 thru 0xd660e5d (0xa4bb bytes) 2024-09-21T15:07:45.338 INFO:teuthology.orchestra.run.smithi161.stdout:909 read 0x694fda0 thru 0x695cd06 (0xcf67 bytes) 2024-09-21T15:07:45.339 INFO:teuthology.orchestra.run.smithi161.stdout:910 writesame 0x90fb674 thru 0x90fdc11 data_size 0x2d(0x259e bytes) 2024-09-21T15:07:45.362 INFO:teuthology.orchestra.run.smithi161.stdout:1562 read 0x7140cfd thru 0x7146d96 (0x609a bytes) 2024-09-21T15:07:45.362 INFO:teuthology.orchestra.run.smithi161.stdout:1563 read 0x925c7af thru 0x92670d5 (0xa927 bytes) 2024-09-21T15:07:45.363 INFO:teuthology.orchestra.run.smithi161.stdout:1564 write 0x183d7c1 thru 0x1846b5e (0x939e bytes) 2024-09-21T15:07:45.369 INFO:teuthology.orchestra.run.smithi161.stdout:911 read 0x22306b1 thru 0x2237484 (0x6dd4 bytes) 2024-09-21T15:07:45.370 INFO:teuthology.orchestra.run.smithi161.stdout:912 read 0x4bea37d thru 0x4bf8c83 (0xe907 bytes) 2024-09-21T15:07:45.371 INFO:teuthology.orchestra.run.smithi161.stdout:913 punch from 0xb84ed51 to 0xb857fe5, (0x9294 bytes) 2024-09-21T15:07:45.371 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:45.371 INFO:teuthology.orchestra.run.smithi161.stdout:915 write 0x2ded7a thru 0x2e997b (0xac02 bytes) 2024-09-21T15:07:45.382 INFO:teuthology.orchestra.run.smithi161.stdout:916 write 0x387fe33 thru 0x3880194 (0x362 bytes) 2024-09-21T15:07:45.421 INFO:teuthology.orchestra.run.smithi161.stdout:1105 clone 8 order 19 su 2048 sc 15 2024-09-21T15:07:45.424 INFO:teuthology.orchestra.run.smithi161.stdout:985 write 0xc7bedc3 thru 0xc7c5225 (0x6463 bytes) 2024-09-21T15:07:45.425 INFO:teuthology.orchestra.run.smithi161.stdout:1565 write 0xeae1115 thru 0xeae27fb (0x16e7 bytes) 2024-09-21T15:07:45.439 INFO:teuthology.orchestra.run.smithi161.stdout:1567 write 0x5f22156 thru 0x5f2a049 (0x7ef4 bytes) 2024-09-21T15:07:45.443 INFO:teuthology.orchestra.run.smithi161.stdout:986 punch from 0x4e3d837 to 0x4e470be, (0x9887 bytes) 2024-09-21T15:07:45.443 INFO:teuthology.orchestra.run.smithi161.stdout:917 write 0xd9a8d02 thru 0xd9b5d96 (0xd095 bytes) 2024-09-21T15:07:45.443 INFO:teuthology.orchestra.run.smithi161.stdout:987 write 0x70b5b18 thru 0x70c1300 (0xb7e9 bytes) 2024-09-21T15:07:45.451 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:45.452 INFO:teuthology.orchestra.run.smithi161.stdout:1569 read 0x96cd19d thru 0x96db794 (0xe5f8 bytes) 2024-09-21T15:07:45.454 INFO:teuthology.orchestra.run.smithi161.stdout:1570 read 0x6a13015 thru 0x6a1e5f0 (0xb5dc bytes) 2024-09-21T15:07:45.455 INFO:teuthology.orchestra.run.smithi161.stdout:1571 punch from 0x895b920 to 0x89634df, (0x7bbf bytes) 2024-09-21T15:07:45.455 INFO:teuthology.orchestra.run.smithi161.stdout:1573 write 0x4778a01 thru 0x4782f96 (0xa596 bytes) 2024-09-21T15:07:45.483 INFO:teuthology.orchestra.run.smithi161.stdout:988 read 0xf8afce thru 0xf9965f (0xe692 bytes) 2024-09-21T15:07:45.484 INFO:teuthology.orchestra.run.smithi161.stdout:990 write 0x619aa5e thru 0x619ebb6 (0x4159 bytes) 2024-09-21T15:07:45.491 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:45.505 INFO:teuthology.orchestra.run.smithi161.stdout:1574 trunc from 0xeae27fc to 0x80a2667 2024-09-21T15:07:45.512 INFO:teuthology.orchestra.run.smithi161.stdout:922 trunc from 0xd9b5d97 to 0x57f4cf9 2024-09-21T15:07:45.516 INFO:teuthology.orchestra.run.smithi161.stdout:992 trunc from 0xc7c5226 to 0x7a7acc6 2024-09-21T15:07:45.553 INFO:teuthology.orchestra.run.smithi161.stdout:1577 write 0x7131a56 thru 0x713ac5f (0x920a bytes) 2024-09-21T15:07:45.566 INFO:teuthology.orchestra.run.smithi161.stdout:1578 read 0x38b3073 thru 0x38b80e9 (0x5077 bytes) 2024-09-21T15:07:45.579 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:45.579 INFO:teuthology.orchestra.run.smithi161.stdout:994 writesame 0x323b3 thru 0x37c65 data_size 0x1d(0x58b3 bytes) 2024-09-21T15:07:45.600 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:45.600 INFO:teuthology.orchestra.run.smithi161.stdout:926 write 0x1e95f51 thru 0x1e9d4bf (0x756f bytes) 2024-09-21T15:07:45.605 INFO:teuthology.orchestra.run.smithi161.stdout:1579 write 0x8d5d6f3 thru 0x8d6ae4a (0xd758 bytes) 2024-09-21T15:07:45.632 INFO:teuthology.orchestra.run.smithi161.stdout:928 trunc from 0x57f4cf9 to 0x3ef839d 2024-09-21T15:07:45.643 INFO:teuthology.orchestra.run.smithi161.stdout:1581 writesame 0x17c1ed4 thru 0x17cb949 data_size 0x11(0x9a76 bytes) 2024-09-21T15:07:45.652 INFO:teuthology.orchestra.run.smithi161.stdout:995 trunc from 0x7a7acc6 to 0xc5a8b35 2024-09-21T15:07:45.659 INFO:teuthology.orchestra.run.smithi161.stdout:1582 write 0x4f56c6f thru 0x4f5b46c (0x47fe bytes) 2024-09-21T15:07:45.671 INFO:teuthology.orchestra.run.smithi161.stdout:1587 write 0x416966d thru 0x416c31e (0x2cb2 bytes) 2024-09-21T15:07:45.683 INFO:teuthology.orchestra.run.smithi161.stdout:1588 read 0x6457f0d thru 0x645a6da (0x27ce bytes) 2024-09-21T15:07:45.697 INFO:teuthology.orchestra.run.smithi161.stdout:996 writesame 0x55ec879 thru 0x55efa6a data_size 0x3(0x31f2 bytes) 2024-09-21T15:07:45.702 INFO:teuthology.orchestra.run.smithi161.stdout:929 write 0xe36a0a thru 0xe3ebfc (0x81f3 bytes) 2024-09-21T15:07:45.715 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone9 from 0x94191db (overlap 0x4139787) to 0x0 2024-09-21T15:07:45.718 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:45.718 INFO:teuthology.orchestra.run.smithi161.stdout:998 write 0x855654c thru 0x8557215 (0xcca bytes) 2024-09-21T15:07:45.723 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.0-clone7 intact 2024-09-21T15:07:45.732 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:45.732 INFO:teuthology.orchestra.run.smithi161.stdout:1000 write 0x430ae4e thru 0x43166f0 (0xb8a3 bytes) 2024-09-21T15:07:45.742 INFO:teuthology.orchestra.run.smithi161.stdout:1589 write 0xafe6e48 thru 0xafed7aa (0x6963 bytes) 2024-09-21T15:07:45.747 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.1-clone7 2024-09-21T15:07:45.751 INFO:teuthology.orchestra.run.smithi161.stdout:1001 punch from 0x8395eb5 to 0x839fc50, (0x9d9b bytes) 2024-09-21T15:07:45.751 INFO:teuthology.orchestra.run.smithi161.stdout:1003 read 0x38ac2b0 thru 0x38b55ed (0x933e bytes) 2024-09-21T15:07:45.751 INFO:teuthology.orchestra.run.smithi161.stdout:1004 writesame 0x9a54188 thru 0x9a60472 data_size 0x1(0xc2eb bytes) 2024-09-21T15:07:45.754 INFO:teuthology.orchestra.run.smithi161.stdout:1591 trunc from 0xafed7ab to 0xd24a15e 2024-09-21T15:07:45.785 INFO:teuthology.orchestra.run.smithi161.stdout:930 write 0xaa8a4eb thru 0xaa95b1b (0xb631 bytes) 2024-09-21T15:07:45.815 INFO:teuthology.orchestra.run.smithi161.stdout:1592 read 0x2cb42e8 thru 0x2cb922a (0x4f43 bytes) 2024-09-21T15:07:45.815 INFO:teuthology.orchestra.run.smithi161.stdout:1593 clone 8 order 23 su 65536 sc 2 2024-09-21T15:07:45.823 INFO:teuthology.orchestra.run.smithi161.stdout:931 read 0x80afdab thru 0x80bf1d1 (0xf427 bytes) 2024-09-21T15:07:45.823 INFO:teuthology.orchestra.run.smithi161.stdout:932 writesame 0x18ad0b0 thru 0x18b721b data_size 0x2(0xa16c bytes) 2024-09-21T15:07:45.832 INFO:teuthology.orchestra.run.smithi161.stdout:1005 read 0x8a8fa3 thru 0x8b720b (0xe269 bytes) 2024-09-21T15:07:45.848 INFO:teuthology.orchestra.run.smithi161.stdout:933 writesame 0x84b59c4 thru 0x84c2fe4 data_size 0x29(0xd621 bytes) 2024-09-21T15:07:45.851 INFO:teuthology.orchestra.run.smithi161.stdout:1006 read 0xa302f00 thru 0xa30d69d (0xa79e bytes) 2024-09-21T15:07:45.851 INFO:teuthology.orchestra.run.smithi161.stdout:1007 read 0x8b02cea thru 0x8b103fe (0xd715 bytes) 2024-09-21T15:07:45.852 INFO:teuthology.orchestra.run.smithi161.stdout:1008 read 0x6c93a96 thru 0x6c9ea0b (0xaf76 bytes) 2024-09-21T15:07:45.857 INFO:teuthology.orchestra.run.smithi161.stdout:1009 trunc from 0xc5a8b35 to 0x9d96ffa 2024-09-21T15:07:45.878 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:45.878 INFO:teuthology.orchestra.run.smithi161.stdout:936 punch from 0x68590f0 to 0x6867607, (0xe517 bytes) 2024-09-21T15:07:45.878 INFO:teuthology.orchestra.run.smithi161.stdout:938 punch from 0x55f1941 to 0x55f9150, (0x780f bytes) 2024-09-21T15:07:45.878 INFO:teuthology.orchestra.run.smithi161.stdout:941 read 0x5b9fa5a thru 0x5ba3872 (0x3e19 bytes) 2024-09-21T15:07:45.898 INFO:teuthology.orchestra.run.smithi161.stdout:1010 punch from 0x4449530 to 0x4451a2b, (0x84fb bytes) 2024-09-21T15:07:45.905 INFO:teuthology.orchestra.run.smithi161.stdout:942 writesame 0xbd16c5f thru 0xbd17981 data_size 0x13(0xd23 bytes) 2024-09-21T15:07:45.908 INFO:teuthology.orchestra.run.smithi161.stdout:943 punch from 0xaabfd75 to 0xaac307e, (0x3309 bytes) 2024-09-21T15:07:45.908 INFO:teuthology.orchestra.run.smithi161.stdout:944 punch from 0xb1976db to 0xb1a3e3c, (0xc761 bytes) 2024-09-21T15:07:45.908 INFO:teuthology.orchestra.run.smithi161.stdout:945 writesame 0x56ad438 thru 0x56b7364 data_size 0x3(0x9f2d bytes) 2024-09-21T15:07:45.912 INFO:teuthology.orchestra.run.smithi161.stdout:1014 trunc from 0x9d96ffa to 0x10394e9 2024-09-21T15:07:45.931 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:45.931 INFO:teuthology.orchestra.run.smithi161.stdout:948 write 0x5e08959 thru 0x5e10be8 (0x8290 bytes) 2024-09-21T15:07:45.961 INFO:teuthology.orchestra.run.smithi161.stdout:949 write 0x30a346b thru 0x30b27f6 (0xf38c bytes) 2024-09-21T15:07:45.962 INFO:teuthology.orchestra.run.smithi161.stdout:1015 clone 13 order 21 su 65536 sc 9 2024-09-21T15:07:45.964 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #6, image image_cluster1.client.mirror.1-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent7 2024-09-21T15:07:45.972 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #6, image image_cluster1.client.mirror.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent7 2024-09-21T15:07:46.003 INFO:teuthology.orchestra.run.smithi161.stdout:951 trunc from 0xbd17982 to 0x73de6c4 2024-09-21T15:07:46.031 INFO:teuthology.orchestra.run.smithi161.stdout:1246 write 0xa107b91 thru 0xa10f924 (0x7d94 bytes) 2024-09-21T15:07:46.055 INFO:teuthology.orchestra.run.smithi161.stdout:1107 trunc from 0x41e5566 to 0x9e0c1a0 2024-09-21T15:07:46.098 INFO:teuthology.orchestra.run.smithi161.stdout:952 writesame 0xe09e7a5 thru 0xe0aa905 data_size 0x1(0xc161 bytes) 2024-09-21T15:07:46.103 INFO:teuthology.orchestra.run.smithi161.stdout:953 read 0x4182572 thru 0x418e595 (0xc024 bytes) 2024-09-21T15:07:46.104 INFO:teuthology.orchestra.run.smithi161.stdout:955 write 0x8766325 thru 0x876bf86 (0x5c62 bytes) 2024-09-21T15:07:46.121 INFO:teuthology.orchestra.run.smithi161.stdout:1247 write 0xd6675d4 thru 0xd66de0b (0x6838 bytes) 2024-09-21T15:07:46.123 INFO:teuthology.orchestra.run.smithi161.stdout:1108 punch from 0x41af55b to 0x41af7e3, (0x288 bytes) 2024-09-21T15:07:46.123 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:46.123 INFO:teuthology.orchestra.run.smithi161.stdout:1110 clone 9 order 21 su 65536 sc 12 2024-09-21T15:07:46.131 INFO:teuthology.orchestra.run.smithi161.stdout:956 read 0xdf3c3f1 thru 0xdf432d2 (0x6ee2 bytes) 2024-09-21T15:07:46.131 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:46.131 INFO:teuthology.orchestra.run.smithi161.stdout:958 writesame 0x454f749 thru 0x4559f10 data_size 0x76(0xa7c8 bytes) 2024-09-21T15:07:46.143 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:46.143 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:46.143 INFO:teuthology.orchestra.run.smithi161.stdout:1251 read 0x34807b1 thru 0x3484bcd (0x441d bytes) 2024-09-21T15:07:46.144 INFO:teuthology.orchestra.run.smithi161.stdout:1253 read 0x2066249 thru 0x2069e99 (0x3c51 bytes) 2024-09-21T15:07:46.144 INFO:teuthology.orchestra.run.smithi161.stdout:1254 punch from 0x2558534 to 0x25653a4, (0xce70 bytes) 2024-09-21T15:07:46.144 INFO:teuthology.orchestra.run.smithi161.stdout:1257 write 0xd093526 thru 0xd09637e (0x2e59 bytes) 2024-09-21T15:07:46.155 INFO:teuthology.orchestra.run.smithi161.stdout:960 writesame 0x9d2fb40 thru 0x9d33a15 data_size 0x1(0x3ed6 bytes) 2024-09-21T15:07:46.162 INFO:teuthology.orchestra.run.smithi161.stdout:1260 read 0x2f6d55c thru 0x2f7bda3 (0xe848 bytes) 2024-09-21T15:07:46.163 INFO:teuthology.orchestra.run.smithi161.stdout:1261 write 0xc42d91b thru 0xc4380c0 (0xa7a6 bytes) 2024-09-21T15:07:46.181 INFO:teuthology.orchestra.run.smithi161.stdout:962 write 0x34370c4 thru 0x34448a1 (0xd7de bytes) 2024-09-21T15:07:46.187 INFO:teuthology.orchestra.run.smithi161.stdout:1264 read 0xb23312b thru 0xb2337d7 (0x6ad bytes) 2024-09-21T15:07:46.187 INFO:teuthology.orchestra.run.smithi161.stdout:1265 writesame 0x4a374f5 thru 0x4a3d53f data_size 0x21(0x604b bytes) 2024-09-21T15:07:46.213 INFO:teuthology.orchestra.run.smithi161.stdout:963 read 0xd34fa6c thru 0xd351567 (0x1afc bytes) 2024-09-21T15:07:46.213 INFO:teuthology.orchestra.run.smithi161.stdout:964 punch from 0xb75a6e8 to 0xb75eb2e, (0x4446 bytes) 2024-09-21T15:07:46.214 INFO:teuthology.orchestra.run.smithi161.stdout:1266 write 0x481771c thru 0x4826eae (0xf793 bytes) 2024-09-21T15:07:46.214 INFO:teuthology.orchestra.run.smithi161.stdout:966 read 0xdabb352 thru 0xdabc7dc (0x148b bytes) 2024-09-21T15:07:46.214 INFO:teuthology.orchestra.run.smithi161.stdout:969 read 0x44a4239 thru 0x44b37d1 (0xf599 bytes) 2024-09-21T15:07:46.220 INFO:teuthology.orchestra.run.smithi161.stdout:972 writesame 0xc8af755 thru 0xc8bc973 data_size 0x1(0xd21f bytes) 2024-09-21T15:07:46.250 INFO:teuthology.orchestra.run.smithi161.stdout:1268 read 0x9ad505b thru 0x9add63c (0x85e2 bytes) 2024-09-21T15:07:46.250 INFO:teuthology.orchestra.run.smithi161.stdout:1269 write 0x4d13103 thru 0x4d13904 (0x802 bytes) 2024-09-21T15:07:46.267 INFO:teuthology.orchestra.run.smithi161.stdout:1270 trunc from 0xd66de0c to 0x8fc535c 2024-09-21T15:07:46.275 INFO:teuthology.orchestra.run.smithi161.stdout:973 trunc from 0xe0aa906 to 0x51acccf 2024-09-21T15:07:46.370 INFO:teuthology.orchestra.run.smithi161.stdout:1271 trunc from 0x8fc535c to 0x2071750 2024-09-21T15:07:46.377 INFO:teuthology.orchestra.run.smithi161.stdout:974 write 0x603443c thru 0x603dcdb (0x98a0 bytes) 2024-09-21T15:07:46.404 INFO:teuthology.orchestra.run.smithi161.stdout:975 punch from 0x32d830 to 0x330218, (0x29e8 bytes) 2024-09-21T15:07:46.404 INFO:teuthology.orchestra.run.smithi161.stdout:976 writesame 0x5810c33 thru 0x581432f data_size 0x1(0x36fd bytes) 2024-09-21T15:07:46.425 INFO:teuthology.orchestra.run.smithi161.stdout:977 write 0x50d8afa thru 0x50e3c58 (0xb15f bytes) 2024-09-21T15:07:46.433 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #8, image image_cluster1.client.mirror.4-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent9 2024-09-21T15:07:46.456 INFO:teuthology.orchestra.run.smithi161.stdout:1272 read 0x1eacbfa thru 0x1eb36eb (0x6af2 bytes) 2024-09-21T15:07:46.457 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:46.457 INFO:teuthology.orchestra.run.smithi161.stdout:1274 read 0xac33b4 thru 0xad1651 (0xe29e bytes) 2024-09-21T15:07:46.478 INFO:teuthology.orchestra.run.smithi161.stdout:978 trunc from 0x603dcdc to 0xe4cbe50 2024-09-21T15:07:46.507 INFO:teuthology.orchestra.run.smithi161.stdout:1275 write 0x2af749a thru 0x2b04379 (0xcee0 bytes) 2024-09-21T15:07:46.523 INFO:teuthology.orchestra.run.smithi161.stdout:980 read 0x4ab88fd thru 0x4ac8791 (0xfe95 bytes) 2024-09-21T15:07:46.524 INFO:teuthology.orchestra.run.smithi161.stdout:981 write 0xb0fb557 thru 0xb105fe1 (0xaa8b bytes) 2024-09-21T15:07:46.549 INFO:teuthology.orchestra.run.smithi161.stdout:982 trunc from 0xe4cbe50 to 0xd2674c1 2024-09-21T15:07:46.572 INFO:teuthology.orchestra.run.smithi161.stdout:983 write 0x32dc3f5 thru 0x32e7f13 (0xbb1f bytes) 2024-09-21T15:07:46.581 INFO:teuthology.orchestra.run.smithi161.stdout:985 punch from 0x7b2a2dd to 0x7b39f8c, (0xfcaf bytes) 2024-09-21T15:07:46.581 INFO:teuthology.orchestra.run.smithi161.stdout:986 punch from 0x26f5eed to 0x26fb2b2, (0x53c5 bytes) 2024-09-21T15:07:46.583 INFO:teuthology.orchestra.run.smithi161.stdout:1277 write 0xddd9bea thru 0xdde1c13 (0x802a bytes) 2024-09-21T15:07:46.586 INFO:teuthology.orchestra.run.smithi161.stdout:987 trunc from 0xd2674c1 to 0xad24a4a 2024-09-21T15:07:46.614 INFO:teuthology.orchestra.run.smithi161.stdout:1278 trunc from 0xdde1c14 to 0xb5476bc 2024-09-21T15:07:46.623 INFO:teuthology.orchestra.run.smithi161.stdout:963 punch from 0x936b743 to 0x936ccd8, (0x1595 bytes) 2024-09-21T15:07:46.642 INFO:teuthology.orchestra.run.smithi161.stdout:964 write 0x865bd4e thru 0x865fcc2 (0x3f75 bytes) 2024-09-21T15:07:46.651 INFO:teuthology.orchestra.run.smithi161.stdout:989 trunc from 0xad24a4a to 0x86a8dea 2024-09-21T15:07:46.672 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:46.676 INFO:teuthology.orchestra.run.smithi161.stdout:991 write 0x2c92869 thru 0x2ca21bd (0xf955 bytes) 2024-09-21T15:07:46.683 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone7 from 0xd24a15e (overlap 0x1f9839a) to 0xca34a4 2024-09-21T15:07:46.687 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone8 from 0x9e0c1a0 (overlap 0x41e5566) to 0x0 2024-09-21T15:07:46.689 INFO:teuthology.orchestra.run.smithi161.stdout:966 trunc from 0x94191db to 0x18f4244 2024-09-21T15:07:46.691 INFO:teuthology.orchestra.run.smithi161.stdout:1280 write 0xc3c8d43 thru 0xc3cf0d8 (0x6396 bytes) 2024-09-21T15:07:46.767 INFO:teuthology.orchestra.run.smithi161.stdout:994 read 0x161abe2 thru 0x1626066 (0xb485 bytes) 2024-09-21T15:07:46.783 INFO:teuthology.orchestra.run.smithi161.stdout:1281 write 0x64a333c thru 0x64aa0f7 (0x6dbc bytes) 2024-09-21T15:07:46.813 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone12 from 0x10394e9 (overlap 0xf67dde) to 0x6298bf 2024-09-21T15:07:46.819 INFO:teuthology.orchestra.run.smithi161.stdout:1283 trunc from 0xc3cf0d9 to 0xc617136 2024-09-21T15:07:46.835 INFO:teuthology.orchestra.run.smithi161.stdout:995 writesame 0xa22a874 thru 0xa236c7f data_size 0x2(0xc40c bytes) 2024-09-21T15:07:46.845 INFO:teuthology.orchestra.run.smithi161.stdout:996 read 0x3d3eb14 thru 0x3d40fad (0x249a bytes) 2024-09-21T15:07:46.856 INFO:teuthology.orchestra.run.smithi161.stdout:997 write 0x9ebb793 thru 0x9ec969d (0xdf0b bytes) 2024-09-21T15:07:46.963 INFO:teuthology.orchestra.run.smithi161.stdout:1284 punch from 0xb83b69b to 0xb83e468, (0x2dcd bytes) 2024-09-21T15:07:46.964 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:46.964 INFO:teuthology.orchestra.run.smithi161.stdout:1286 writesame 0x6b92e17 thru 0x6b9a38c data_size 0x61(0x7576 bytes) 2024-09-21T15:07:46.965 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:46.965 INFO:teuthology.orchestra.run.smithi161.stdout:999 read 0x9c82ccd thru 0x9c8f3af (0xc6e3 bytes) 2024-09-21T15:07:46.966 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:46.966 INFO:teuthology.orchestra.run.smithi161.stdout:1002 writesame 0x88f4946 thru 0x8902df0 data_size 0x27(0xe4ab bytes) 2024-09-21T15:07:46.991 INFO:teuthology.orchestra.run.smithi161.stdout:1287 writesame 0xb5fb8b8 thru 0xb605e23 data_size 0x6(0xa56c bytes) 2024-09-21T15:07:47.015 INFO:teuthology.orchestra.run.smithi161.stdout:1288 read 0xa365f4a thru 0xa370e5d (0xaf14 bytes) 2024-09-21T15:07:47.027 INFO:teuthology.orchestra.run.smithi161.stdout:1289 trunc from 0xc617136 to 0x622a304 2024-09-21T15:07:47.033 INFO:teuthology.orchestra.run.smithi161.stdout:1004 writesame 0xaa5a806 thru 0xaa66e92 data_size 0x1(0xc68d bytes) 2024-09-21T15:07:47.036 INFO:teuthology.orchestra.run.smithi161.stdout:1005 write 0x2e16487 thru 0x2e1f3f6 (0x8f70 bytes) 2024-09-21T15:07:47.062 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.062 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.062 INFO:teuthology.orchestra.run.smithi161.stdout:1009 punch from 0x98ee300 to 0x98f2ee8, (0x4be8 bytes) 2024-09-21T15:07:47.062 INFO:teuthology.orchestra.run.smithi161.stdout:1010 read 0x9f2d524 thru 0x9f31da9 (0x4886 bytes) 2024-09-21T15:07:47.067 INFO:teuthology.orchestra.run.smithi161.stdout:1011 punch from 0x5219001 to 0x521d1bc, (0x41bb bytes) 2024-09-21T15:07:47.072 INFO:teuthology.orchestra.run.smithi161.stdout:1012 trunc from 0xaa66e93 to 0xcff16ab 2024-09-21T15:07:47.115 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.115 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.115 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.115 INFO:teuthology.orchestra.run.smithi161.stdout:1018 read 0x7867fa1 thru 0x7870f5d (0x8fbd bytes) 2024-09-21T15:07:47.116 INFO:teuthology.orchestra.run.smithi161.stdout:1019 read 0xb6058c9 thru 0xb610390 (0xaac8 bytes) 2024-09-21T15:07:47.116 INFO:teuthology.orchestra.run.smithi161.stdout:1020 write 0x8d7570e thru 0x8d813e1 (0xbcd4 bytes) 2024-09-21T15:07:47.153 INFO:teuthology.orchestra.run.smithi161.stdout:1290 read 0x54630ed thru 0x5468961 (0x5875 bytes) 2024-09-21T15:07:47.174 INFO:teuthology.orchestra.run.smithi161.stdout:1021 write 0x5cd8dd3 thru 0x5ce3b5c (0xad8a bytes) 2024-09-21T15:07:47.200 INFO:teuthology.orchestra.run.smithi161.stdout:1291 write 0xbe18a87 thru 0xbe23c09 (0xb183 bytes) 2024-09-21T15:07:47.208 INFO:teuthology.orchestra.run.smithi161.stdout:1023 punch from 0x4804279 to 0x481013b, (0xbec2 bytes) 2024-09-21T15:07:47.208 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.209 INFO:teuthology.orchestra.run.smithi161.stdout:1027 read 0x4404eaf thru 0x44079ad (0x2aff bytes) 2024-09-21T15:07:47.213 INFO:teuthology.orchestra.run.smithi161.stdout:1028 write 0x9f24617 thru 0x9f2c126 (0x7b10 bytes) 2024-09-21T15:07:47.275 INFO:teuthology.orchestra.run.smithi161.stdout:1029 trunc from 0xcff16ab to 0xd9616fe 2024-09-21T15:07:47.341 INFO:teuthology.orchestra.run.smithi161.stdout:1031 read 0xd91f9e6 thru 0xd922855 (0x2e70 bytes) 2024-09-21T15:07:47.341 INFO:teuthology.orchestra.run.smithi161.stdout:1032 write 0x600570c thru 0x600fbc7 (0xa4bc bytes) 2024-09-21T15:07:47.348 INFO:teuthology.orchestra.run.smithi161.stdout:1292 writesame 0xe31265f thru 0xe3215e6 data_size 0x2a(0xef88 bytes) 2024-09-21T15:07:47.356 INFO:teuthology.orchestra.run.smithi161.stdout:1293 write 0x134cf58 thru 0x134dc0b (0xcb4 bytes) 2024-09-21T15:07:47.380 INFO:teuthology.orchestra.run.smithi161.stdout:1294 writesame 0x25ac9a9 thru 0x25b2fd2 data_size 0x9(0x662a bytes) 2024-09-21T15:07:47.392 INFO:teuthology.orchestra.run.smithi161.stdout:1295 write 0x5e70e10 thru 0x5e73fe3 (0x31d4 bytes) 2024-09-21T15:07:47.415 INFO:teuthology.orchestra.run.smithi161.stdout:1296 read 0x78cb726 thru 0x78cc9e6 (0x12c1 bytes) 2024-09-21T15:07:47.415 INFO:teuthology.orchestra.run.smithi161.stdout:1297 writesame 0xafd096f thru 0xafdfe15 data_size 0x3(0xf4a7 bytes) 2024-09-21T15:07:47.416 INFO:teuthology.orchestra.run.smithi161.stdout:1034 read 0x6db99d4 thru 0x6dbbc36 (0x2263 bytes) 2024-09-21T15:07:47.417 INFO:teuthology.orchestra.run.smithi161.stdout:1035 writesame 0x1546a49 thru 0x1550c32 data_size 0x19(0xa1ea bytes) 2024-09-21T15:07:47.452 INFO:teuthology.orchestra.run.smithi161.stdout:1298 write 0x140bb94 thru 0x1412c1b (0x7088 bytes) 2024-09-21T15:07:47.452 INFO:teuthology.orchestra.run.smithi161.stdout:967 write 0xc9497bf thru 0xc94a5ed (0xe2f bytes) 2024-09-21T15:07:47.471 INFO:teuthology.orchestra.run.smithi161.stdout:1036 read 0xd77208a thru 0xd780428 (0xe39f bytes) 2024-09-21T15:07:47.472 INFO:teuthology.orchestra.run.smithi161.stdout:1037 write 0xa199f88 thru 0xa1a8391 (0xe40a bytes) 2024-09-21T15:07:47.497 INFO:teuthology.orchestra.run.smithi161.stdout:969 write 0x63ad114 thru 0x63bca9c (0xf989 bytes) 2024-09-21T15:07:47.520 INFO:teuthology.orchestra.run.smithi161.stdout:1040 punch from 0x1aa09d0 to 0x1aa3199, (0x27c9 bytes) 2024-09-21T15:07:47.520 INFO:teuthology.orchestra.run.smithi161.stdout:1042 write 0x1844a95 thru 0x184f3e3 (0xa94f bytes) 2024-09-21T15:07:47.533 INFO:teuthology.orchestra.run.smithi161.stdout:1299 read 0xe2ba984 thru 0xe2c635d (0xb9da bytes) 2024-09-21T15:07:47.534 INFO:teuthology.orchestra.run.smithi161.stdout:1300 writesame 0xa364e6b thru 0xa370d29 data_size 0x3(0xbebf bytes) 2024-09-21T15:07:47.539 INFO:teuthology.orchestra.run.smithi161.stdout:971 write 0x96ffefb thru 0x9700f72 (0x1078 bytes) 2024-09-21T15:07:47.568 INFO:teuthology.orchestra.run.smithi161.stdout:972 read 0x92d9e63 thru 0x92dd29d (0x343b bytes) 2024-09-21T15:07:47.568 INFO:teuthology.orchestra.run.smithi161.stdout:973 write 0xc1661b9 thru 0xc175440 (0xf288 bytes) 2024-09-21T15:07:47.569 INFO:teuthology.orchestra.run.smithi161.stdout:1301 write 0x2d7576d thru 0x2d821f7 (0xca8b bytes) 2024-09-21T15:07:47.580 INFO:teuthology.orchestra.run.smithi161.stdout:1043 write 0xc1e2efe thru 0xc1e7af8 (0x4bfb bytes) 2024-09-21T15:07:47.597 INFO:teuthology.orchestra.run.smithi161.stdout:1302 read 0xde20c93 thru 0xde2d52f (0xc89d bytes) 2024-09-21T15:07:47.597 INFO:teuthology.orchestra.run.smithi161.stdout:1304 write 0x9d8afb3 thru 0x9d9886f (0xd8bd bytes) 2024-09-21T15:07:47.608 INFO:teuthology.orchestra.run.smithi161.stdout:1044 write 0x7c2d89c thru 0x7c316c6 (0x3e2b bytes) 2024-09-21T15:07:47.609 INFO:teuthology.orchestra.run.smithi161.stdout:976 writesame 0xaf731c1 thru 0xaf78559 data_size 0x1(0x5399 bytes) 2024-09-21T15:07:47.640 INFO:teuthology.orchestra.run.smithi161.stdout:1305 trunc from 0xe3215e7 to 0x3f13425 2024-09-21T15:07:47.645 INFO:teuthology.orchestra.run.smithi161.stdout:1045 write 0x2ea1c5 thru 0x2f283a (0x8676 bytes) 2024-09-21T15:07:47.662 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #6, image image_cluster1.client.mirror.2-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent7 2024-09-21T15:07:47.663 INFO:teuthology.orchestra.run.smithi161.stdout:1046 writesame 0x7c16b0 thru 0x7c93b5 data_size 0xd(0x7d06 bytes) 2024-09-21T15:07:47.681 INFO:teuthology.orchestra.run.smithi161.stdout:981 writesame 0xd0902bf thru 0xd0922e0 data_size 0x9(0x2022 bytes) 2024-09-21T15:07:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:984 read 0xaeb6c12 thru 0xaec0128 (0x9517 bytes) 2024-09-21T15:07:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:986 read 0x1fc2138 thru 0x1fc864f (0x6518 bytes) 2024-09-21T15:07:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:987 punch from 0x39fc2c3 to 0x3a01c91, (0x59ce bytes) 2024-09-21T15:07:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:1047 read 0x92107da thru 0x921108c (0x8b3 bytes) 2024-09-21T15:07:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:1049 write 0x9f276c5 thru 0x9f2eac6 (0x7402 bytes) 2024-09-21T15:07:47.707 INFO:teuthology.orchestra.run.smithi161.stdout:1306 punch from 0x19d9d51 to 0x19dcaab, (0x2d5a bytes) 2024-09-21T15:07:47.709 INFO:teuthology.orchestra.run.smithi161.stdout:988 trunc from 0xd0922e1 to 0x6abdfe1 2024-09-21T15:07:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:1051 writesame 0x8a6da5d thru 0x8a74611 data_size 0x27(0x6bb5 bytes) 2024-09-21T15:07:47.737 INFO:teuthology.orchestra.run.smithi161.stdout:1052 write 0x8976f2f thru 0x89817ca (0xa89c bytes) 2024-09-21T15:07:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:1055 punch from 0xd72619b to 0xd734dac, (0xec11 bytes) 2024-09-21T15:07:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:1056 writesame 0x82cf0f4 thru 0x82d3158 data_size 0x23(0x4065 bytes) 2024-09-21T15:07:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:1307 write 0xa348f29 thru 0xa34fd9a (0x6e72 bytes) 2024-09-21T15:07:47.766 INFO:teuthology.orchestra.run.smithi161.stdout:1594 punch from 0x2966512 to 0x29745b9, (0xe0a7 bytes) 2024-09-21T15:07:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:990 read 0x17fedaa thru 0x17ffe62 (0x10b9 bytes) 2024-09-21T15:07:47.776 INFO:teuthology.orchestra.run.smithi161.stdout:1057 write 0x3a7e746 thru 0x3a7f02f (0x8ea bytes) 2024-09-21T15:07:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:1308 read 0xec4251 thru 0xecf956 (0xb706 bytes) 2024-09-21T15:07:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:1596 read 0x71ee829 thru 0x71f70aa (0x8882 bytes) 2024-09-21T15:07:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:1600 read 0x26dc601 thru 0x26e58db (0x92db bytes) 2024-09-21T15:07:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #11, image image_cluster1.client.mirror.3-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent12 2024-09-21T15:07:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:1058 trunc from 0xd9616fe to 0xb38a25d 2024-09-21T15:07:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:1601 read 0x3c05d0a thru 0x3c137a9 (0xdaa0 bytes) 2024-09-21T15:07:47.792 INFO:teuthology.orchestra.run.smithi161.stdout:1602 read 0xbcd0d77 thru 0xbcd6c75 (0x5eff bytes) 2024-09-21T15:07:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:1603 write 0xb0ef79d thru 0xb0efb8a (0x3ee bytes) 2024-09-21T15:07:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:1613 write 0x1271a32 thru 0x127c739 (0xad08 bytes) 2024-09-21T15:07:47.828 INFO:teuthology.orchestra.run.smithi161.stdout:1312 write 0xd0a014b thru 0xd0ab872 (0xb728 bytes) 2024-09-21T15:07:47.833 INFO:teuthology.orchestra.run.smithi161.stdout:991 writesame 0xc3241bb thru 0xc332bdb data_size 0x1(0xea21 bytes) 2024-09-21T15:07:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:993 read 0x75859c7 thru 0x759110c (0xb746 bytes) 2024-09-21T15:07:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:995 write 0x3411544 thru 0x3411709 (0x1c6 bytes) 2024-09-21T15:07:47.854 INFO:teuthology.orchestra.run.smithi161.stdout:1313 writesame 0x8d253ee thru 0x8d2cb83 data_size 0x1(0x7796 bytes) 2024-09-21T15:07:47.857 INFO:teuthology.orchestra.run.smithi161.stdout:1614 writesame 0x9d8655c thru 0x9d95e90 data_size 0x1(0xf935 bytes) 2024-09-21T15:07:47.860 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.860 INFO:teuthology.orchestra.run.smithi161.stdout:998 punch from 0x1d4559c to 0x1d488f1, (0x3355 bytes) 2024-09-21T15:07:47.860 INFO:teuthology.orchestra.run.smithi161.stdout:1000 read 0x938483c thru 0x9384958 (0x11d bytes) 2024-09-21T15:07:47.860 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.860 INFO:teuthology.orchestra.run.smithi161.stdout:1006 punch from 0x172cffb to 0x173ac2a, (0xdc2f bytes) 2024-09-21T15:07:47.860 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.860 INFO:teuthology.orchestra.run.smithi161.stdout:1008 write 0xaa7bdb1 thru 0xaa7ca79 (0xcc9 bytes) 2024-09-21T15:07:47.879 INFO:teuthology.orchestra.run.smithi161.stdout:1059 trunc from 0xb38a25d to 0x226af7e 2024-09-21T15:07:47.923 INFO:teuthology.orchestra.run.smithi161.stdout:1315 punch from 0x840be2c to 0x84136ae, (0x7882 bytes) 2024-09-21T15:07:47.924 INFO:teuthology.orchestra.run.smithi161.stdout:1316 read 0x8a02ae2 thru 0x8a0f04f (0xc56e bytes) 2024-09-21T15:07:47.924 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.924 INFO:teuthology.orchestra.run.smithi161.stdout:1319 write 0xc9a8b7d thru 0xc9ac1f7 (0x367b bytes) 2024-09-21T15:07:47.926 INFO:teuthology.orchestra.run.smithi161.stdout:1009 trunc from 0xc332bdc to 0x3ea9d6 2024-09-21T15:07:47.959 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:47.966 INFO:teuthology.orchestra.run.smithi161.stdout:1616 trunc from 0xd24a15e to 0x9ceb1bc 2024-09-21T15:07:47.980 INFO:teuthology.orchestra.run.smithi161.stdout:1322 read 0x256ef76 thru 0x257aefb (0xbf86 bytes) 2024-09-21T15:07:48.023 INFO:teuthology.orchestra.run.smithi161.stdout:1324 write 0x58489c5 thru 0x5849d44 (0x1380 bytes) 2024-09-21T15:07:48.100 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:48.100 INFO:teuthology.orchestra.run.smithi161.stdout:1326 write 0x556463 thru 0x5602d0 (0x9e6e bytes) 2024-09-21T15:07:48.144 INFO:teuthology.orchestra.run.smithi161.stdout:1061 clone 9 order 18 su 65536 sc 11 2024-09-21T15:07:48.347 INFO:teuthology.orchestra.run.smithi161.stdout:1617 write 0x1c52b thru 0x286c5 (0xc19b bytes) 2024-09-21T15:07:48.435 INFO:teuthology.orchestra.run.smithi161.stdout:1327 read 0x4610441 thru 0x461d7e4 (0xd3a4 bytes) 2024-09-21T15:07:48.435 INFO:teuthology.orchestra.run.smithi161.stdout:1328 writesame 0xc5d9576 thru 0xc5df12a data_size 0x1(0x5bb5 bytes) 2024-09-21T15:07:48.467 INFO:teuthology.orchestra.run.smithi161.stdout:1618 write 0x5ba1db7 thru 0x5ba2a73 (0xcbd bytes) 2024-09-21T15:07:48.518 INFO:teuthology.orchestra.run.smithi161.stdout:1620 punch from 0x747f700 to 0x748cab8, (0xd3b8 bytes) 2024-09-21T15:07:48.518 INFO:teuthology.orchestra.run.smithi161.stdout:1621 write 0x533bc6 thru 0x535d73 (0x21ae bytes) 2024-09-21T15:07:48.524 INFO:teuthology.orchestra.run.smithi161.stdout:1010 read 0x22415b thru 0x22505b (0xf01 bytes) 2024-09-21T15:07:48.525 INFO:teuthology.orchestra.run.smithi161.stdout:1011 read 0x1b70b9 thru 0x1bb9e9 (0x4931 bytes) 2024-09-21T15:07:48.525 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:48.560 INFO:teuthology.orchestra.run.smithi161.stdout:1623 write 0x9cdcb39 thru 0x9ce1ab8 (0x4f80 bytes) 2024-09-21T15:07:48.575 INFO:teuthology.orchestra.run.smithi161.stdout:1624 trunc from 0x9ceb1bc to 0x64792c8 2024-09-21T15:07:48.620 INFO:teuthology.orchestra.run.smithi161.stdout:1329 write 0x7b485e5 thru 0x7b51ad9 (0x94f5 bytes) 2024-09-21T15:07:48.691 INFO:teuthology.orchestra.run.smithi161.stdout:1331 read 0x21fac32 thru 0x220345d (0x882c bytes) 2024-09-21T15:07:48.691 INFO:teuthology.orchestra.run.smithi161.stdout:1332 writesame 0x83ff271 thru 0x8407885 data_size 0x5(0x8615 bytes) 2024-09-21T15:07:48.734 INFO:teuthology.orchestra.run.smithi161.stdout:1333 writesame 0x440d194 thru 0x440e1b4 data_size 0x1(0x1021 bytes) 2024-09-21T15:07:48.746 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:48.746 INFO:teuthology.orchestra.run.smithi161.stdout:1336 punch from 0x7618e6a to 0x761f15a, (0x62f0 bytes) 2024-09-21T15:07:48.746 INFO:teuthology.orchestra.run.smithi161.stdout:1339 read 0xa77e9a9 thru 0xa77f6d1 (0xd29 bytes) 2024-09-21T15:07:48.746 INFO:teuthology.orchestra.run.smithi161.stdout:1340 write 0xad36acb thru 0xad3f8f2 (0x8e28 bytes) 2024-09-21T15:07:48.800 INFO:teuthology.orchestra.run.smithi161.stdout:1341 writesame 0x5e01a11 thru 0x5e0ad28 data_size 0x12(0x9318 bytes) 2024-09-21T15:07:48.819 INFO:teuthology.orchestra.run.smithi161.stdout:1013 write 0x98de297 thru 0x98e3c85 (0x59ef bytes) 2024-09-21T15:07:48.832 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone8 from 0x226af7e (overlap 0x1c4fb18) to 0x0 2024-09-21T15:07:48.849 INFO:teuthology.orchestra.run.smithi161.stdout:1014 write 0x5123f00 thru 0x5131205 (0xd306 bytes) 2024-09-21T15:07:48.864 INFO:teuthology.orchestra.run.smithi161.stdout:1342 trunc from 0xd0ab873 to 0x5527c4b 2024-09-21T15:07:48.949 INFO:teuthology.orchestra.run.smithi161.stdout:1015 trunc from 0x98e3c86 to 0x1f92b5d 2024-09-21T15:07:49.118 INFO:teuthology.orchestra.run.smithi161.stdout:1343 punch from 0x365e9c0 to 0x3663cec, (0x532c bytes) 2024-09-21T15:07:49.124 INFO:teuthology.orchestra.run.smithi161.stdout:1625 write 0x4ffde7c thru 0x5008b94 (0xad19 bytes) 2024-09-21T15:07:49.151 INFO:teuthology.orchestra.run.smithi161.stdout:1345 write 0xaf59229 thru 0xaf5c98e (0x3766 bytes) 2024-09-21T15:07:49.183 INFO:teuthology.orchestra.run.smithi161.stdout:1346 trunc from 0xaf5c98f to 0x2abc3e3 2024-09-21T15:07:49.238 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #7, image image_cluster1.client.mirror.5-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent8 2024-09-21T15:07:49.309 INFO:teuthology.orchestra.run.smithi161.stdout:1347 write 0xa8bcf92 thru 0xa8c8204 (0xb273 bytes) 2024-09-21T15:07:49.349 INFO:teuthology.orchestra.run.smithi161.stdout:1348 writesame 0x5621c77 thru 0x562c430 data_size 0x1(0xa7ba bytes) 2024-09-21T15:07:49.393 INFO:teuthology.orchestra.run.smithi161.stdout:1350 punch from 0x2a8a24d to 0x2a9813f, (0xdef2 bytes) 2024-09-21T15:07:49.393 INFO:teuthology.orchestra.run.smithi161.stdout:1351 write 0x69d162e thru 0x69d67f5 (0x51c8 bytes) 2024-09-21T15:07:49.402 INFO:teuthology.orchestra.run.smithi161.stdout:1352 read 0x2514d82 thru 0x251a0ac (0x532b bytes) 2024-09-21T15:07:49.403 INFO:teuthology.orchestra.run.smithi161.stdout:1353 punch from 0x4b646b8 to 0x4b713d3, (0xcd1b bytes) 2024-09-21T15:07:49.403 INFO:teuthology.orchestra.run.smithi161.stdout:1016 write 0x4d54a21 thru 0x4d5c6e8 (0x7cc8 bytes) 2024-09-21T15:07:49.413 INFO:teuthology.orchestra.run.smithi161.stdout:1354 trunc from 0xa8c8205 to 0x5a095a9 2024-09-21T15:07:49.511 INFO:teuthology.orchestra.run.smithi161.stdout:1355 read 0x546b51d thru 0x546d34f (0x1e33 bytes) 2024-09-21T15:07:49.511 INFO:teuthology.orchestra.run.smithi161.stdout:1356 read 0x365bc0a thru 0x365d4a9 (0x18a0 bytes) 2024-09-21T15:07:49.511 INFO:teuthology.orchestra.run.smithi161.stdout:1357 read 0xdc039a thru 0xdc2340 (0x1fa7 bytes) 2024-09-21T15:07:49.515 INFO:teuthology.orchestra.run.smithi161.stdout:1627 write 0x7f25ed9 thru 0x7f2e04a (0x8172 bytes) 2024-09-21T15:07:49.517 INFO:teuthology.orchestra.run.smithi161.stdout:1358 trunc from 0x5a095a9 to 0x8552334 2024-09-21T15:07:49.537 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:49.547 INFO:teuthology.orchestra.run.smithi161.stdout:1628 read 0x3539db2 thru 0x3543c02 (0x9e51 bytes) 2024-09-21T15:07:49.548 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:49.548 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:49.548 INFO:teuthology.orchestra.run.smithi161.stdout:1632 write 0x5cf6ccf thru 0x5cfa5c8 (0x38fa bytes) 2024-09-21T15:07:49.551 INFO:teuthology.orchestra.run.smithi161.stdout:1360 trunc from 0x8552334 to 0x1787a7 2024-09-21T15:07:49.635 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:49.635 INFO:teuthology.orchestra.run.smithi161.stdout:1634 write 0x708432a thru 0x708e08b (0x9d62 bytes) 2024-09-21T15:07:49.690 INFO:teuthology.orchestra.run.smithi161.stdout:1636 read 0x538f68f thru 0x53951f1 (0x5b63 bytes) 2024-09-21T15:07:49.697 INFO:teuthology.orchestra.run.smithi161.stdout:1638 trunc from 0x7f2e04b to 0x478a676 2024-09-21T15:07:49.710 INFO:teuthology.orchestra.run.smithi161.stdout:1017 write 0x5fd7686 thru 0x5fe49cf (0xd34a bytes) 2024-09-21T15:07:49.809 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:49.809 INFO:teuthology.orchestra.run.smithi161.stdout:1063 write 0x15f167d thru 0x16012fa (0xfc7e bytes) 2024-09-21T15:07:49.850 INFO:teuthology.orchestra.run.smithi161.stdout:1362 write 0x26acdf1 thru 0x26b16e4 (0x48f4 bytes) 2024-09-21T15:07:49.879 INFO:teuthology.orchestra.run.smithi161.stdout:1064 punch from 0xd31257 to 0xd35f6b, (0x4d14 bytes) 2024-09-21T15:07:49.885 INFO:teuthology.orchestra.run.smithi161.stdout:1066 trunc from 0x226af7e to 0x53ed6b5 2024-09-21T15:07:49.928 INFO:teuthology.orchestra.run.smithi161.stdout:1067 punch from 0x450c80c to 0x451a5a4, (0xdd98 bytes) 2024-09-21T15:07:49.937 INFO:teuthology.orchestra.run.smithi161.stdout:1069 trunc from 0x53ed6b5 to 0x8d72251 2024-09-21T15:07:49.952 INFO:teuthology.orchestra.run.smithi161.stdout:1363 write 0xafa26ec thru 0xafa8767 (0x607c bytes) 2024-09-21T15:07:49.956 INFO:teuthology.orchestra.run.smithi161.stdout:1070 trunc from 0x8d72251 to 0x930173a 2024-09-21T15:07:49.972 INFO:teuthology.orchestra.run.smithi161.stdout:1364 read 0x32166bd thru 0x322220a (0xbb4e bytes) 2024-09-21T15:07:49.973 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:49.990 INFO:teuthology.orchestra.run.smithi161.stdout:1071 write 0x79b1f94 thru 0x79b65db (0x4648 bytes) 2024-09-21T15:07:49.997 INFO:teuthology.orchestra.run.smithi161.stdout:1020 write 0x771b0dc thru 0x77267d7 (0xb6fc bytes) 2024-09-21T15:07:50.035 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.035 INFO:teuthology.orchestra.run.smithi161.stdout:1074 clone 10 order 23 su 32768 sc 3 2024-09-21T15:07:50.050 INFO:teuthology.orchestra.run.smithi161.stdout:1367 write 0xe82c990 thru 0xe834fc1 (0x8632 bytes) 2024-09-21T15:07:50.066 INFO:teuthology.orchestra.run.smithi161.stdout:1369 read 0x8aa1a44 thru 0x8aae950 (0xcf0d bytes) 2024-09-21T15:07:50.066 INFO:teuthology.orchestra.run.smithi161.stdout:1370 write 0x57de3f8 thru 0x57e9fa0 (0xbba9 bytes) 2024-09-21T15:07:50.088 INFO:teuthology.orchestra.run.smithi161.stdout:1639 read 0x942b4d thru 0x948f5a (0x640e bytes) 2024-09-21T15:07:50.105 INFO:teuthology.orchestra.run.smithi161.stdout:1640 trunc from 0x478a676 to 0xb62dcc8 2024-09-21T15:07:50.132 INFO:teuthology.orchestra.run.smithi161.stdout:1371 write 0xb9ce218 thru 0xb9d719a (0x8f83 bytes) 2024-09-21T15:07:50.173 INFO:teuthology.orchestra.run.smithi161.stdout:1372 write 0x8d08351 thru 0x8d0d254 (0x4f04 bytes) 2024-09-21T15:07:50.185 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.186 INFO:teuthology.orchestra.run.smithi161.stdout:1374 read 0xdb02d6f thru 0xdb0f4eb (0xc77d bytes) 2024-09-21T15:07:50.186 INFO:teuthology.orchestra.run.smithi161.stdout:1375 write 0x8d820c2 thru 0x8d82cc0 (0xbff bytes) 2024-09-21T15:07:50.197 INFO:teuthology.orchestra.run.smithi161.stdout:1022 write 0xde877c6 thru 0xde8fedf (0x871a bytes) 2024-09-21T15:07:50.198 INFO:teuthology.orchestra.run.smithi161.stdout:1641 read 0x56d7871 thru 0x56e1a43 (0xa1d3 bytes) 2024-09-21T15:07:50.198 INFO:teuthology.orchestra.run.smithi161.stdout:1642 trunc from 0xb62dcc8 to 0xb273edc 2024-09-21T15:07:50.204 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.204 INFO:teuthology.orchestra.run.smithi161.stdout:1377 write 0x5a5c571 thru 0x5a678fd (0xb38d bytes) 2024-09-21T15:07:50.230 INFO:teuthology.orchestra.run.smithi161.stdout:1023 trunc from 0xde8fee0 to 0xdf98ad4 2024-09-21T15:07:50.252 INFO:teuthology.orchestra.run.smithi161.stdout:1643 read 0x8d3ebc9 thru 0x8d4950e (0xa946 bytes) 2024-09-21T15:07:50.252 INFO:teuthology.orchestra.run.smithi161.stdout:1644 punch from 0x8c92dea to 0x8ca019a, (0xd3b0 bytes) 2024-09-21T15:07:50.253 INFO:teuthology.orchestra.run.smithi161.stdout:1649 punch from 0x5dd4a7a to 0x5dda1ff, (0x5785 bytes) 2024-09-21T15:07:50.253 INFO:teuthology.orchestra.run.smithi161.stdout:1650 write 0x8fb4feb thru 0x8fb829e (0x32b4 bytes) 2024-09-21T15:07:50.258 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.258 INFO:teuthology.orchestra.run.smithi161.stdout:1381 read 0xbd0c8d8 thru 0xbd0e243 (0x196c bytes) 2024-09-21T15:07:50.259 INFO:teuthology.orchestra.run.smithi161.stdout:1382 read 0x4b10cbf thru 0x4b1b812 (0xab54 bytes) 2024-09-21T15:07:50.259 INFO:teuthology.orchestra.run.smithi161.stdout:1384 write 0x4bda199 thru 0x4be5a96 (0xb8fe bytes) 2024-09-21T15:07:50.269 INFO:teuthology.orchestra.run.smithi161.stdout:1651 write 0x8244681 thru 0x8254117 (0xfa97 bytes) 2024-09-21T15:07:50.279 INFO:teuthology.orchestra.run.smithi161.stdout:1024 punch from 0x8961579 to 0x896a784, (0x920b bytes) 2024-09-21T15:07:50.279 INFO:teuthology.orchestra.run.smithi161.stdout:1025 read 0x6a305e2 thru 0x6a3d104 (0xcb23 bytes) 2024-09-21T15:07:50.279 INFO:teuthology.orchestra.run.smithi161.stdout:1026 read 0x7e0f2e4 thru 0x7e12c38 (0x3955 bytes) 2024-09-21T15:07:50.280 INFO:teuthology.orchestra.run.smithi161.stdout:1028 read 0x7692a62 thru 0x76945ba (0x1b59 bytes) 2024-09-21T15:07:50.280 INFO:teuthology.orchestra.run.smithi161.stdout:1029 read 0xafb42df thru 0xafc427a (0xff9c bytes) 2024-09-21T15:07:50.280 INFO:teuthology.orchestra.run.smithi161.stdout:1030 punch from 0x4dea64b to 0x4df6f79, (0xc92e bytes) 2024-09-21T15:07:50.280 INFO:teuthology.orchestra.run.smithi161.stdout:1031 read 0x76a43b9 thru 0x76ab594 (0x71dc bytes) 2024-09-21T15:07:50.283 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.283 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.283 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.283 INFO:teuthology.orchestra.run.smithi161.stdout:1390 write 0x65d57af thru 0x65d663e (0xe90 bytes) 2024-09-21T15:07:50.292 INFO:teuthology.orchestra.run.smithi161.stdout:1032 write 0x4c12818 thru 0x4c1f9c1 (0xd1aa bytes) 2024-09-21T15:07:50.305 INFO:teuthology.orchestra.run.smithi161.stdout:1652 punch from 0x3eb9f36 to 0x3ebd153, (0x321d bytes) 2024-09-21T15:07:50.305 INFO:teuthology.orchestra.run.smithi161.stdout:1653 write 0x5dbe3f8 thru 0x5dcca44 (0xe64d bytes) 2024-09-21T15:07:50.306 INFO:teuthology.orchestra.run.smithi161.stdout:1392 punch from 0x75670b6 to 0x7574341, (0xd28b bytes) 2024-09-21T15:07:50.324 INFO:teuthology.orchestra.run.smithi161.stdout:1033 writesame 0xc8a9cd0 thru 0xc8b7b4f data_size 0x59(0xde80 bytes) 2024-09-21T15:07:50.331 INFO:teuthology.orchestra.run.smithi161.stdout:1394 trunc from 0xe834fc2 to 0x13e8240 2024-09-21T15:07:50.346 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.346 INFO:teuthology.orchestra.run.smithi161.stdout:1655 write 0x9d05aa5 thru 0x9d07620 (0x1b7c bytes) 2024-09-21T15:07:50.351 INFO:teuthology.orchestra.run.smithi161.stdout:1035 write 0x3f96ead thru 0x3fa1da0 (0xaef4 bytes) 2024-09-21T15:07:50.363 INFO:teuthology.orchestra.run.smithi161.stdout:1656 punch from 0xaedea0f to 0xaeedc03, (0xf1f4 bytes) 2024-09-21T15:07:50.363 INFO:teuthology.orchestra.run.smithi161.stdout:1657 read 0x7d6430f thru 0x7d65c69 (0x195b bytes) 2024-09-21T15:07:50.363 INFO:teuthology.orchestra.run.smithi161.stdout:1658 punch from 0x50f7f0 to 0x518cb1, (0x94c1 bytes) 2024-09-21T15:07:50.369 INFO:teuthology.orchestra.run.smithi161.stdout:1659 trunc from 0xb273edc to 0xde93e6d 2024-09-21T15:07:50.418 INFO:teuthology.orchestra.run.smithi161.stdout:1660 read 0x6e6a1ec thru 0x6e6fa1e (0x5833 bytes) 2024-09-21T15:07:50.419 INFO:teuthology.orchestra.run.smithi161.stdout:1661 read 0x12a5f08 thru 0x12a7563 (0x165c bytes) 2024-09-21T15:07:50.420 INFO:teuthology.orchestra.run.smithi161.stdout:1663 read 0xa4a3a96 thru 0xa4b05fa (0xcb65 bytes) 2024-09-21T15:07:50.429 INFO:teuthology.orchestra.run.smithi161.stdout:1396 read 0x12a5ee thru 0x13263a (0x804d bytes) 2024-09-21T15:07:50.430 INFO:teuthology.orchestra.run.smithi161.stdout:1036 write 0x82b77b1 thru 0x82bdaa4 (0x62f4 bytes) 2024-09-21T15:07:50.431 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.432 INFO:teuthology.orchestra.run.smithi161.stdout:1665 trunc from 0xde93e6d to 0x75a196f 2024-09-21T15:07:50.447 INFO:teuthology.orchestra.run.smithi161.stdout:1037 punch from 0x2c0d4f6 to 0x2c19423, (0xbf2d bytes) 2024-09-21T15:07:50.448 INFO:teuthology.orchestra.run.smithi161.stdout:1039 punch from 0x4c24de0 to 0x4c31d74, (0xcf94 bytes) 2024-09-21T15:07:50.448 INFO:teuthology.orchestra.run.smithi161.stdout:1041 read 0x86fc94f thru 0x87034f6 (0x6ba8 bytes) 2024-09-21T15:07:50.448 INFO:teuthology.orchestra.run.smithi161.stdout:1043 punch from 0xbc399ef to 0xbc3e7e8, (0x4df9 bytes) 2024-09-21T15:07:50.448 INFO:teuthology.orchestra.run.smithi161.stdout:1044 write 0x4d7602 thru 0x4e4c6e (0xd66d bytes) 2024-09-21T15:07:50.470 INFO:teuthology.orchestra.run.smithi161.stdout:1398 write 0x880fb62 thru 0x8819da2 (0xa241 bytes) 2024-09-21T15:07:50.472 INFO:teuthology.orchestra.run.smithi161.stdout:1045 trunc from 0xdf98ad4 to 0xb37f1d0 2024-09-21T15:07:50.485 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.486 INFO:teuthology.orchestra.run.smithi161.stdout:1671 read 0x547af0d thru 0x5481571 (0x6665 bytes) 2024-09-21T15:07:50.487 INFO:teuthology.orchestra.run.smithi161.stdout:1672 punch from 0x102de09 to 0x102f34d, (0x1544 bytes) 2024-09-21T15:07:50.487 INFO:teuthology.orchestra.run.smithi161.stdout:1673 read 0x5cd3601 thru 0x5ce1da7 (0xe7a7 bytes) 2024-09-21T15:07:50.488 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.525 INFO:teuthology.orchestra.run.smithi161.stdout:1399 write 0x6d5a61c thru 0x6d5bdff (0x17e4 bytes) 2024-09-21T15:07:50.541 INFO:teuthology.orchestra.run.smithi161.stdout:1400 read 0x4dc4d4c thru 0x4dce9ce (0x9c83 bytes) 2024-09-21T15:07:50.542 INFO:teuthology.orchestra.run.smithi161.stdout:1401 read 0x651291b thru 0x6512ce2 (0x3c8 bytes) 2024-09-21T15:07:50.545 INFO:teuthology.orchestra.run.smithi161.stdout:1047 read 0xada7eb5 thru 0xadac96b (0x4ab7 bytes) 2024-09-21T15:07:50.546 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.546 INFO:teuthology.orchestra.run.smithi161.stdout:1049 writesame 0x6fa5981 thru 0x6fa69d5 data_size 0x1(0x1055 bytes) 2024-09-21T15:07:50.549 INFO:teuthology.orchestra.run.smithi161.stdout:1676 write 0xbd58249 thru 0xbd65edb (0xdc93 bytes) 2024-09-21T15:07:50.551 INFO:teuthology.orchestra.run.smithi161.stdout:1402 trunc from 0x8819da3 to 0x386d1b4 2024-09-21T15:07:50.553 INFO:teuthology.orchestra.run.smithi161.stdout:1050 writesame 0x3f6126c thru 0x3f65c8d data_size 0x3(0x4a22 bytes) 2024-09-21T15:07:50.588 INFO:teuthology.orchestra.run.smithi161.stdout:1677 read 0x1815db5 thru 0x18221d2 (0xc41e bytes) 2024-09-21T15:07:50.589 INFO:teuthology.orchestra.run.smithi161.stdout:1678 read 0x19fe3b2 thru 0x1a00cae (0x28fd bytes) 2024-09-21T15:07:50.590 INFO:teuthology.orchestra.run.smithi161.stdout:1679 punch from 0x61dfa31 to 0x61ed780, (0xdd4f bytes) 2024-09-21T15:07:50.590 INFO:teuthology.orchestra.run.smithi161.stdout:1680 trunc from 0xbd65edc to 0xbe36a53 2024-09-21T15:07:50.592 INFO:teuthology.orchestra.run.smithi161.stdout:1051 read 0xa6167a thru 0xa709d5 (0xf35c bytes) 2024-09-21T15:07:50.593 INFO:teuthology.orchestra.run.smithi161.stdout:1052 writesame 0x4ec7169 thru 0x4ecc6cb data_size 0x1(0x5563 bytes) 2024-09-21T15:07:50.625 INFO:teuthology.orchestra.run.smithi161.stdout:1054 trunc from 0xb37f1d0 to 0xd5b15f3 2024-09-21T15:07:50.641 INFO:teuthology.orchestra.run.smithi161.stdout:1404 read 0x1670401 thru 0x1677d3c (0x793c bytes) 2024-09-21T15:07:50.641 INFO:teuthology.orchestra.run.smithi161.stdout:1405 read 0x1f1a7f4 thru 0x1f1d52c (0x2d39 bytes) 2024-09-21T15:07:50.659 INFO:teuthology.orchestra.run.smithi161.stdout:1681 write 0xb1a4f96 thru 0xb1b1905 (0xc970 bytes) 2024-09-21T15:07:50.692 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.692 INFO:teuthology.orchestra.run.smithi161.stdout:1062 writesame 0xaca6748 thru 0xacb04cd data_size 0x8d(0x9d86 bytes) 2024-09-21T15:07:50.694 INFO:teuthology.orchestra.run.smithi161.stdout:1406 writesame 0x8cb2193 thru 0x8cb572d data_size 0x1(0x359b bytes) 2024-09-21T15:07:50.698 INFO:teuthology.orchestra.run.smithi161.stdout:1682 trunc from 0xbe36a53 to 0x232a032 2024-09-21T15:07:50.701 INFO:teuthology.orchestra.run.smithi161.stdout:1407 trunc from 0x8cb572e to 0xa6d8f05 2024-09-21T15:07:50.715 INFO:teuthology.orchestra.run.smithi161.stdout:1063 read 0x21edf48 thru 0x21fae58 (0xcf11 bytes) 2024-09-21T15:07:50.721 INFO:teuthology.orchestra.run.smithi161.stdout:1064 trunc from 0xd5b15f3 to 0xaa80fa0 2024-09-21T15:07:50.733 INFO:teuthology.orchestra.run.smithi161.stdout:1408 read 0x7d08ba7 thru 0x7d1584a (0xcca4 bytes) 2024-09-21T15:07:50.734 INFO:teuthology.orchestra.run.smithi161.stdout:1409 write 0x2d3c502 thru 0x2d3e3b4 (0x1eb3 bytes) 2024-09-21T15:07:50.753 INFO:teuthology.orchestra.run.smithi161.stdout:1410 punch from 0x4bdd0a9 to 0x4be1977, (0x48ce bytes) 2024-09-21T15:07:50.753 INFO:teuthology.orchestra.run.smithi161.stdout:1411 write 0x80321a6 thru 0x803861d (0x6478 bytes) 2024-09-21T15:07:50.774 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone9 from 0x930173a (overlap 0x226af7e) to 0x37118c 2024-09-21T15:07:50.781 INFO:teuthology.orchestra.run.smithi161.stdout:1412 writesame 0x6aea7a4 thru 0x6af4199 data_size 0x3(0x99f6 bytes) 2024-09-21T15:07:50.831 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.832 INFO:teuthology.orchestra.run.smithi161.stdout:1415 write 0x94f025 thru 0x951fe9 (0x2fc5 bytes) 2024-09-21T15:07:50.835 INFO:teuthology.orchestra.run.smithi161.stdout:1065 read 0x301a573 thru 0x30236f3 (0x9181 bytes) 2024-09-21T15:07:50.835 INFO:teuthology.orchestra.run.smithi161.stdout:1066 write 0x92fdd78 thru 0x930c062 (0xe2eb bytes) 2024-09-21T15:07:50.862 INFO:teuthology.orchestra.run.smithi161.stdout:1417 writesame 0x72d9b2b thru 0x72e773c data_size 0x11(0xdc12 bytes) 2024-09-21T15:07:50.883 INFO:teuthology.orchestra.run.smithi161.stdout:1068 writesame 0x4a66c09 thru 0x4a686e1 data_size 0x1(0x1ad9 bytes) 2024-09-21T15:07:50.891 INFO:teuthology.orchestra.run.smithi161.stdout:1683 read 0x18b0c1f thru 0x18bfcde (0xf0c0 bytes) 2024-09-21T15:07:50.892 INFO:teuthology.orchestra.run.smithi161.stdout:1684 read 0x92e0a6 thru 0x92e92c (0x887 bytes) 2024-09-21T15:07:50.900 INFO:teuthology.orchestra.run.smithi161.stdout:1069 writesame 0x125bd8f thru 0x1269c85 data_size 0x1(0xdef7 bytes) 2024-09-21T15:07:50.908 INFO:teuthology.orchestra.run.smithi161.stdout:1418 read 0x7f90bb5 thru 0x7f9d12c (0xc578 bytes) 2024-09-21T15:07:50.909 INFO:teuthology.orchestra.run.smithi161.stdout:1419 read 0x8914e11 thru 0x89203b6 (0xb5a6 bytes) 2024-09-21T15:07:50.914 INFO:teuthology.orchestra.run.smithi161.stdout:1420 trunc from 0xa6d8f05 to 0x7aec514 2024-09-21T15:07:50.939 INFO:teuthology.orchestra.run.smithi161.stdout:1070 read 0x6981f46 thru 0x698cf77 (0xb032 bytes) 2024-09-21T15:07:50.940 INFO:teuthology.orchestra.run.smithi161.stdout:1074 punch from 0xa149854 to 0xa151e9a, (0x8646 bytes) 2024-09-21T15:07:50.940 INFO:teuthology.orchestra.run.smithi161.stdout:1077 punch from 0x73fbc2 to 0x746421, (0x685f bytes) 2024-09-21T15:07:50.940 INFO:teuthology.orchestra.run.smithi161.stdout:1078 punch from 0x370407b to 0x3709ee3, (0x5e68 bytes) 2024-09-21T15:07:50.941 INFO:teuthology.orchestra.run.smithi161.stdout:1079 punch from 0x26b2b08 to 0x26bb6bb, (0x8bb3 bytes) 2024-09-21T15:07:50.941 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:50.941 INFO:teuthology.orchestra.run.smithi161.stdout:1082 write 0x10bee6a thru 0x10c8ecd (0xa064 bytes) 2024-09-21T15:07:50.978 INFO:teuthology.orchestra.run.smithi161.stdout:1085 write 0x5fc1af0 thru 0x5fc8cf3 (0x7204 bytes) 2024-09-21T15:07:51.022 INFO:teuthology.orchestra.run.smithi161.stdout:1421 read 0x51418cf thru 0x514308d (0x17bf bytes) 2024-09-21T15:07:51.022 INFO:teuthology.orchestra.run.smithi161.stdout:1422 write 0x3c160a9 thru 0x3c1c61f (0x6577 bytes) 2024-09-21T15:07:51.054 INFO:teuthology.orchestra.run.smithi161.stdout:1087 read 0x9008e91 thru 0x9011015 (0x8185 bytes) 2024-09-21T15:07:51.055 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:51.055 INFO:teuthology.orchestra.run.smithi161.stdout:1089 read 0x11cc3e8 thru 0x11d3e49 (0x7a62 bytes) 2024-09-21T15:07:51.064 INFO:teuthology.orchestra.run.smithi161.stdout:1091 write 0x7b49b7b thru 0x7b4a6f4 (0xb7a bytes) 2024-09-21T15:07:51.078 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:51.079 INFO:teuthology.orchestra.run.smithi161.stdout:1426 read 0x2515c60 thru 0x251def9 (0x829a bytes) 2024-09-21T15:07:51.086 INFO:teuthology.orchestra.run.smithi161.stdout:1685 write 0xdf4514d thru 0xdf485fc (0x34b0 bytes) 2024-09-21T15:07:51.092 INFO:teuthology.orchestra.run.smithi161.stdout:1427 trunc from 0x7aec514 to 0x198927f 2024-09-21T15:07:51.104 INFO:teuthology.orchestra.run.smithi161.stdout:1093 read 0x67e4d7c thru 0x67ea4c4 (0x5749 bytes) 2024-09-21T15:07:51.104 INFO:teuthology.orchestra.run.smithi161.stdout:1094 write 0x3b6b99c thru 0x3b705b3 (0x4c18 bytes) 2024-09-21T15:07:51.145 INFO:teuthology.orchestra.run.smithi161.stdout:1686 read 0xba6e849 thru 0xba7d73b (0xeef3 bytes) 2024-09-21T15:07:51.145 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:51.145 INFO:teuthology.orchestra.run.smithi161.stdout:1688 read 0x1da6396 thru 0x1db1df5 (0xba60 bytes) 2024-09-21T15:07:51.146 INFO:teuthology.orchestra.run.smithi161.stdout:1689 read 0x43e55a8 thru 0x43e9b4f (0x45a8 bytes) 2024-09-21T15:07:51.146 INFO:teuthology.orchestra.run.smithi161.stdout:1690 write 0x6064e8e thru 0x6070b59 (0xbccc bytes) 2024-09-21T15:07:51.191 INFO:teuthology.orchestra.run.smithi161.stdout:1097 writesame 0x781afff thru 0x782acd9 data_size 0x1(0xfcdb bytes) 2024-09-21T15:07:51.264 INFO:teuthology.orchestra.run.smithi161.stdout:1691 punch from 0xcfdc45 to 0xcfea61, (0xe1c bytes) 2024-09-21T15:07:51.264 INFO:teuthology.orchestra.run.smithi161.stdout:1694 punch from 0x6e324ea to 0x6e3fc9e, (0xd7b4 bytes) 2024-09-21T15:07:51.264 INFO:teuthology.orchestra.run.smithi161.stdout:1695 write 0x77f4c1b thru 0x77f5a59 (0xe3f bytes) 2024-09-21T15:07:51.328 INFO:teuthology.orchestra.run.smithi161.stdout:1428 punch from 0x16576c to 0x175536, (0xfdca bytes) 2024-09-21T15:07:51.328 INFO:teuthology.orchestra.run.smithi161.stdout:1429 read 0x9c9d88 thru 0x9cda00 (0x3c79 bytes) 2024-09-21T15:07:51.328 INFO:teuthology.orchestra.run.smithi161.stdout:1430 punch from 0x1642d6c to 0x164984e, (0x6ae2 bytes) 2024-09-21T15:07:51.442 INFO:teuthology.orchestra.run.smithi161.stdout:1431 write 0xe1545c1 thru 0xe155eda (0x191a bytes) 2024-09-21T15:07:51.442 INFO:teuthology.orchestra.run.smithi161.stdout:1099 write 0xec42699 thru 0xec474ac (0x4e14 bytes) 2024-09-21T15:07:51.464 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:51.464 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:51.464 INFO:teuthology.orchestra.run.smithi161.stdout:1434 read 0x6f0b672 thru 0x6f1a606 (0xef95 bytes) 2024-09-21T15:07:51.467 INFO:teuthology.orchestra.run.smithi161.stdout:1436 write 0xb362801 thru 0xb36512b (0x292b bytes) 2024-09-21T15:07:51.481 INFO:teuthology.orchestra.run.smithi161.stdout:1100 write 0x5a58e98 thru 0x5a60bd6 (0x7d3f bytes) 2024-09-21T15:07:51.493 INFO:teuthology.orchestra.run.smithi161.stdout:1437 writesame 0x63c3cd8 thru 0x63c6ddd data_size 0x19(0x3106 bytes) 2024-09-21T15:07:51.508 INFO:teuthology.orchestra.run.smithi161.stdout:1439 write 0x205e351 thru 0x206227e (0x3f2e bytes) 2024-09-21T15:07:51.514 INFO:teuthology.orchestra.run.smithi161.stdout:1102 trunc from 0xec474ad to 0x7fe7512 2024-09-21T15:07:51.546 INFO:teuthology.orchestra.run.smithi161.stdout:1442 trunc from 0xe155edb to 0xc5867eb 2024-09-21T15:07:51.584 INFO:teuthology.orchestra.run.smithi161.stdout:1696 write 0xebfbca5 thru 0xec01d97 (0x60f3 bytes) 2024-09-21T15:07:51.632 INFO:teuthology.orchestra.run.smithi161.stdout:1697 trunc from 0xec01d98 to 0x84227c 2024-09-21T15:07:51.661 INFO:teuthology.orchestra.run.smithi161.stdout:1443 punch from 0x3530c3 to 0x3588c0, (0x57fd bytes) 2024-09-21T15:07:51.662 INFO:teuthology.orchestra.run.smithi161.stdout:1446 punch from 0x54930c4 to 0x549c9c1, (0x98fd bytes) 2024-09-21T15:07:51.662 INFO:teuthology.orchestra.run.smithi161.stdout:1447 write 0xa1c4e6 thru 0xa26e41 (0xa95c bytes) 2024-09-21T15:07:51.709 INFO:teuthology.orchestra.run.smithi161.stdout:1448 writesame 0xc2ca23b thru 0xc2d4ec3 data_size 0x1(0xac89 bytes) 2024-09-21T15:07:51.754 INFO:teuthology.orchestra.run.smithi161.stdout:1450 read 0xc3bec9a thru 0xc3c2576 (0x38dd bytes) 2024-09-21T15:07:51.754 INFO:teuthology.orchestra.run.smithi161.stdout:1451 read 0x8a6fd16 thru 0x8a77252 (0x753d bytes) 2024-09-21T15:07:51.754 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:51.754 INFO:teuthology.orchestra.run.smithi161.stdout:1455 punch from 0x19153a7 to 0x191a9dd, (0x5636 bytes) 2024-09-21T15:07:51.756 INFO:teuthology.orchestra.run.smithi161.stdout:1103 writesame 0x504e185 thru 0x5051feb data_size 0x2d(0x3e67 bytes) 2024-09-21T15:07:51.812 INFO:teuthology.orchestra.run.smithi161.stdout:1104 read 0x7ce3b4 thru 0x7d744a (0x9097 bytes) 2024-09-21T15:07:51.813 INFO:teuthology.orchestra.run.smithi161.stdout:1105 write 0x18c24a2 thru 0x18cbe2c (0x998b bytes) 2024-09-21T15:07:51.838 INFO:teuthology.orchestra.run.smithi161.stdout:1106 trunc from 0x7fe7512 to 0x5dc8ce3 2024-09-21T15:07:51.858 INFO:teuthology.orchestra.run.smithi161.stdout:1016 trunc from 0x10394e9 to 0x5f8b7cf 2024-09-21T15:07:51.903 INFO:teuthology.orchestra.run.smithi161.stdout:1456 writesame 0xe7690c1 thru 0xe77070f data_size 0x1(0x764f bytes) 2024-09-21T15:07:51.905 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:51.921 INFO:teuthology.orchestra.run.smithi161.stdout:1458 trunc from 0xe770710 to 0x7140934 2024-09-21T15:07:51.929 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #8, image image_cluster1.client.mirror.5-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent9 2024-09-21T15:07:52.026 INFO:teuthology.orchestra.run.smithi161.stdout:1077 writesame 0x8119419 thru 0x8126be9 data_size 0x1(0xd7d1 bytes) 2024-09-21T15:07:52.067 INFO:teuthology.orchestra.run.smithi161.stdout:1107 read 0xb3a86f thru 0xb48747 (0xded9 bytes) 2024-09-21T15:07:52.079 INFO:teuthology.orchestra.run.smithi161.stdout:1460 trunc from 0x7140934 to 0x439ff1 2024-09-21T15:07:52.116 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:52.116 INFO:teuthology.orchestra.run.smithi161.stdout:1022 punch from 0x29aa90f to 0x29b7fb9, (0xd6aa bytes) 2024-09-21T15:07:52.116 INFO:teuthology.orchestra.run.smithi161.stdout:1023 punch from 0x479503f to 0x479af92, (0x5f53 bytes) 2024-09-21T15:07:52.145 INFO:teuthology.orchestra.run.smithi161.stdout:1078 read 0x1351bcc thru 0x13613a2 (0xf7d7 bytes) 2024-09-21T15:07:52.153 INFO:teuthology.orchestra.run.smithi161.stdout:1079 clone 11 order 23 su 32768 sc 13 2024-09-21T15:07:52.178 INFO:teuthology.orchestra.run.smithi161.stdout:1698 write 0xe1bc110 thru 0xe1c9e48 (0xdd39 bytes) 2024-09-21T15:07:52.180 INFO:teuthology.orchestra.run.smithi161.stdout:1461 punch from 0x1e960b to 0x1f6d98, (0xd78d bytes) 2024-09-21T15:07:52.180 INFO:teuthology.orchestra.run.smithi161.stdout:1462 punch from 0x11bf61 to 0x12994e, (0xd9ed bytes) 2024-09-21T15:07:52.180 INFO:teuthology.orchestra.run.smithi161.stdout:1463 read 0x18e218 thru 0x19b999 (0xd782 bytes) 2024-09-21T15:07:52.181 INFO:teuthology.orchestra.run.smithi161.stdout:1464 read 0xeb28b thru 0xeefd1 (0x3d47 bytes) 2024-09-21T15:07:52.183 INFO:teuthology.orchestra.run.smithi161.stdout:1465 punch from 0xb70c0 to 0xb9659, (0x2599 bytes) 2024-09-21T15:07:52.183 INFO:teuthology.orchestra.run.smithi161.stdout:1467 trunc from 0x439ff1 to 0x1e026f 2024-09-21T15:07:52.184 INFO:teuthology.orchestra.run.smithi161.stdout:1108 writesame 0x971757c thru 0x9726b02 data_size 0xd(0xf587 bytes) 2024-09-21T15:07:52.188 INFO:teuthology.orchestra.run.smithi161.stdout:1109 clone 11 order 21 su 524288 sc 10 2024-09-21T15:07:52.201 INFO:teuthology.orchestra.run.smithi161.stdout:1699 punch from 0x3545242 to 0x354716f, (0x1f2d bytes) 2024-09-21T15:07:52.201 INFO:teuthology.orchestra.run.smithi161.stdout:1702 writesame 0xdc2ae79 thru 0xdc2d372 data_size 0x1(0x24fa bytes) 2024-09-21T15:07:52.203 INFO:teuthology.orchestra.run.smithi161.stdout:1025 write 0xe458574 thru 0xe45f346 (0x6dd3 bytes) 2024-09-21T15:07:52.214 INFO:teuthology.orchestra.run.smithi161.stdout:1703 read 0x2b86b17 thru 0x2b932be (0xc7a8 bytes) 2024-09-21T15:07:52.214 INFO:teuthology.orchestra.run.smithi161.stdout:1029 write 0x8d6966d thru 0x8d730ed (0x9a81 bytes) 2024-09-21T15:07:52.214 INFO:teuthology.orchestra.run.smithi161.stdout:1705 write 0x83144ef thru 0x8320474 (0xbf86 bytes) 2024-09-21T15:07:52.225 INFO:teuthology.orchestra.run.smithi161.stdout:1030 writesame 0x3d0d49d thru 0x3d0e819 data_size 0x1(0x137d bytes) 2024-09-21T15:07:52.226 INFO:teuthology.orchestra.run.smithi161.stdout:1706 trunc from 0xe1c9e49 to 0xdcde289 2024-09-21T15:07:52.234 INFO:teuthology.orchestra.run.smithi161.stdout:1031 write 0xa9c6811 thru 0xa9d4cbe (0xe4ae bytes) 2024-09-21T15:07:52.238 INFO:teuthology.orchestra.run.smithi161.stdout:1468 write 0x150ebaf thru 0x15117f8 (0x2c4a bytes) 2024-09-21T15:07:52.258 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:52.258 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:52.272 INFO:teuthology.orchestra.run.smithi161.stdout:1032 trunc from 0xe45f347 to 0x37fe5ff 2024-09-21T15:07:52.276 INFO:teuthology.orchestra.run.smithi161.stdout:1707 read 0x588a6 thru 0x660f1 (0xd84c bytes) 2024-09-21T15:07:52.277 INFO:teuthology.orchestra.run.smithi161.stdout:1708 read 0x16d6ed0 thru 0x16ddbf2 (0x6d23 bytes) 2024-09-21T15:07:52.277 INFO:teuthology.orchestra.run.smithi161.stdout:1709 punch from 0x46b6ab2 to 0x46bb6b3, (0x4c01 bytes) 2024-09-21T15:07:52.277 INFO:teuthology.orchestra.run.smithi161.stdout:1710 write 0x3048559 thru 0x304d386 (0x4e2e bytes) 2024-09-21T15:07:52.296 INFO:teuthology.orchestra.run.smithi161.stdout:1711 read 0xd9bcbab thru 0xd9c28ff (0x5d55 bytes) 2024-09-21T15:07:52.297 INFO:teuthology.orchestra.run.smithi161.stdout:1712 writesame 0x206115a thru 0x206cfd9 data_size 0x8(0xbe80 bytes) 2024-09-21T15:07:52.299 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #7, image image_cluster1.client.mirror.1-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent8 2024-09-21T15:07:52.303 INFO:teuthology.orchestra.run.smithi161.stdout:1471 writesame 0x2ab0a9d thru 0x2ab1404 data_size 0x8(0x968 bytes) 2024-09-21T15:07:52.315 INFO:teuthology.orchestra.run.smithi161.stdout:1713 punch from 0x339ab42 to 0x33a132a, (0x67e8 bytes) 2024-09-21T15:07:52.315 INFO:teuthology.orchestra.run.smithi161.stdout:1715 read 0x1844d9b thru 0x18460ed (0x1353 bytes) 2024-09-21T15:07:52.315 INFO:teuthology.orchestra.run.smithi161.stdout:1716 trunc from 0xdcde289 to 0xdc87296 2024-09-21T15:07:52.330 INFO:teuthology.orchestra.run.smithi161.stdout:1033 punch from 0x1bc0a82 to 0x1bc9143, (0x86c1 bytes) 2024-09-21T15:07:52.343 INFO:teuthology.orchestra.run.smithi161.stdout:1473 write 0x4f6f3a8 thru 0x4f7bcaa (0xc903 bytes) 2024-09-21T15:07:52.347 INFO:teuthology.orchestra.run.smithi161.stdout:1717 read 0x1ebbd38 thru 0x1ebfee3 (0x41ac bytes) 2024-09-21T15:07:52.358 INFO:teuthology.orchestra.run.smithi161.stdout:1476 read 0x19d39c5 thru 0x19da2f2 (0x692e bytes) 2024-09-21T15:07:52.358 INFO:teuthology.orchestra.run.smithi161.stdout:1477 write 0x1d3a4e3 thru 0x1d3c6ff (0x221d bytes) 2024-09-21T15:07:52.359 INFO:teuthology.orchestra.run.smithi161.stdout:1718 trunc from 0xdc87296 to 0x75e83c2 2024-09-21T15:07:52.369 INFO:teuthology.orchestra.run.smithi161.stdout:1478 read 0x26ef859 thru 0x26feca4 (0xf44c bytes) 2024-09-21T15:07:52.369 INFO:teuthology.orchestra.run.smithi161.stdout:1036 write 0x95516ed thru 0x9556676 (0x4f8a bytes) 2024-09-21T15:07:52.370 INFO:teuthology.orchestra.run.smithi161.stdout:1480 write 0x10ec6a thru 0x11b201 (0xc598 bytes) 2024-09-21T15:07:52.392 INFO:teuthology.orchestra.run.smithi161.stdout:1719 punch from 0x714aa0a to 0x71545dd, (0x9bd3 bytes) 2024-09-21T15:07:52.393 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:52.393 INFO:teuthology.orchestra.run.smithi161.stdout:1723 punch from 0x1cd0013 to 0x1cd4369, (0x4356 bytes) 2024-09-21T15:07:52.418 INFO:teuthology.orchestra.run.smithi161.stdout:1037 write 0xd6ec7bf thru 0xd6f4294 (0x7ad6 bytes) 2024-09-21T15:07:52.418 INFO:teuthology.orchestra.run.smithi161.stdout:1481 write 0x7978a19 thru 0x797a32e (0x1916 bytes) 2024-09-21T15:07:52.422 INFO:teuthology.orchestra.run.smithi161.stdout:1726 write 0xbd0d385 thru 0xbd1a0cc (0xcd48 bytes) 2024-09-21T15:07:52.435 INFO:teuthology.orchestra.run.smithi161.stdout:1483 read 0xbf6638 thru 0xc00d49 (0xa712 bytes) 2024-09-21T15:07:52.435 INFO:teuthology.orchestra.run.smithi161.stdout:1487 read 0xd74f37 thru 0xd7e8b7 (0x9981 bytes) 2024-09-21T15:07:52.438 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:52.441 INFO:teuthology.orchestra.run.smithi161.stdout:1727 writesame 0x10c8228 thru 0x10caeae data_size 0x1(0x2c87 bytes) 2024-09-21T15:07:52.446 INFO:teuthology.orchestra.run.smithi161.stdout:1041 trunc from 0xd6f4295 to 0x98179e1 2024-09-21T15:07:52.481 INFO:teuthology.orchestra.run.smithi161.stdout:1728 trunc from 0xbd1a0cd to 0x1648a01 2024-09-21T15:07:52.487 INFO:teuthology.orchestra.run.smithi161.stdout:1488 write 0xdbd8288 thru 0xdbe4f13 (0xcc8c bytes) 2024-09-21T15:07:52.505 INFO:teuthology.orchestra.run.smithi161.stdout:1042 write 0x950427f thru 0x950c195 (0x7f17 bytes) 2024-09-21T15:07:52.510 INFO:teuthology.orchestra.run.smithi161.stdout:1489 read 0x993d3f0 thru 0x994438a (0x6f9b bytes) 2024-09-21T15:07:52.510 INFO:teuthology.orchestra.run.smithi161.stdout:1491 read 0x2fa27e3 thru 0x2faee8b (0xc6a9 bytes) 2024-09-21T15:07:52.510 INFO:teuthology.orchestra.run.smithi161.stdout:1492 read 0x7b0379 thru 0x7b44d1 (0x4159 bytes) 2024-09-21T15:07:52.510 INFO:teuthology.orchestra.run.smithi161.stdout:1493 read 0xb4fd04e thru 0xb50938f (0xc342 bytes) 2024-09-21T15:07:52.511 INFO:teuthology.orchestra.run.smithi161.stdout:1494 write 0xa79fc58 thru 0xa7acd3e (0xd0e7 bytes) 2024-09-21T15:07:52.516 INFO:teuthology.orchestra.run.smithi161.stdout:1044 read 0x3b16cc1 thru 0x3b26bbe (0xfefe bytes) 2024-09-21T15:07:52.516 INFO:teuthology.orchestra.run.smithi161.stdout:1045 writesame 0x8cdd52d thru 0x8ced003 data_size 0xf(0xfad7 bytes) 2024-09-21T15:07:52.533 INFO:teuthology.orchestra.run.smithi161.stdout:1495 writesame 0x656401e thru 0x656e2be data_size 0x1f(0xa2a1 bytes) 2024-09-21T15:07:52.533 INFO:teuthology.orchestra.run.smithi161.stdout:1111 read 0x25d1d04 thru 0x25d3ea0 (0x219d bytes) 2024-09-21T15:07:52.534 INFO:teuthology.orchestra.run.smithi161.stdout:1047 read 0x59dee8b thru 0x59e6161 (0x72d7 bytes) 2024-09-21T15:07:52.540 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:52.540 INFO:teuthology.orchestra.run.smithi161.stdout:1730 punch from 0x1843bd to 0x18b7b0, (0x73f3 bytes) 2024-09-21T15:07:52.540 INFO:teuthology.orchestra.run.smithi161.stdout:1731 read 0x5e4ef8 thru 0x5f3ece (0xefd7 bytes) 2024-09-21T15:07:52.541 INFO:teuthology.orchestra.run.smithi161.stdout:1732 read 0x86eee1 thru 0x8769fd (0x7b1d bytes) 2024-09-21T15:07:52.543 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:52.543 INFO:teuthology.orchestra.run.smithi161.stdout:1735 punch from 0x11ce74 to 0x12955e, (0xc6ea bytes) 2024-09-21T15:07:52.543 INFO:teuthology.orchestra.run.smithi161.stdout:1736 punch from 0x14927c to 0x149e33, (0xbb7 bytes) 2024-09-21T15:07:52.543 INFO:teuthology.orchestra.run.smithi161.stdout:1738 punch from 0x981d74 to 0x983f44, (0x21d0 bytes) 2024-09-21T15:07:52.555 INFO:teuthology.orchestra.run.smithi161.stdout:1739 trunc from 0x1648a01 to 0x6d1229c 2024-09-21T15:07:52.559 INFO:teuthology.orchestra.run.smithi161.stdout:1497 read 0x3e1c65b thru 0x3e2b064 (0xea0a bytes) 2024-09-21T15:07:52.570 INFO:teuthology.orchestra.run.smithi161.stdout:1112 read 0x51152f thru 0x5119c0 (0x492 bytes) 2024-09-21T15:07:52.571 INFO:teuthology.orchestra.run.smithi161.stdout:1115 write 0x7f3a929 thru 0x7f45527 (0xabff bytes) 2024-09-21T15:07:52.579 INFO:teuthology.orchestra.run.smithi161.stdout:1498 trunc from 0xdbe4f14 to 0x1865955 2024-09-21T15:07:52.583 INFO:teuthology.orchestra.run.smithi161.stdout:1048 write 0x990bdc4 thru 0x99183f9 (0xc636 bytes) 2024-09-21T15:07:52.610 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:52.610 INFO:teuthology.orchestra.run.smithi161.stdout:1053 read 0x514a4ec thru 0x51587f8 (0xe30d bytes) 2024-09-21T15:07:52.619 INFO:teuthology.orchestra.run.smithi161.stdout:1117 trunc from 0x9e0c1a0 to 0xea718f3 2024-09-21T15:07:52.632 INFO:teuthology.orchestra.run.smithi161.stdout:1740 write 0xda659b6 thru 0xda71a95 (0xc0e0 bytes) 2024-09-21T15:07:52.650 INFO:teuthology.orchestra.run.smithi161.stdout:1741 punch from 0x87a1e7c to 0x87a5be3, (0x3d67 bytes) 2024-09-21T15:07:52.650 INFO:teuthology.orchestra.run.smithi161.stdout:1742 read 0x308bd69 thru 0x308d146 (0x13de bytes) 2024-09-21T15:07:52.650 INFO:teuthology.orchestra.run.smithi161.stdout:1744 write 0x1eaa3d8 thru 0x1eb688e (0xc4b7 bytes) 2024-09-21T15:07:52.657 INFO:teuthology.orchestra.run.smithi161.stdout:1118 writesame 0xb4dc09c thru 0xb4ea7a6 data_size 0xd1(0xe70b bytes) 2024-09-21T15:07:52.659 INFO:teuthology.orchestra.run.smithi161.stdout:1500 read 0x8b62f1 thru 0x8b894b (0x265b bytes) 2024-09-21T15:07:52.660 INFO:teuthology.orchestra.run.smithi161.stdout:1054 writesame 0xe55d2f1 thru 0xe55dcea data_size 0x1(0x9fa bytes) 2024-09-21T15:07:52.663 INFO:teuthology.orchestra.run.smithi161.stdout:1055 writesame 0x3cad73a thru 0x3cb9ad5 data_size 0x4(0xc39c bytes) 2024-09-21T15:07:52.666 INFO:teuthology.orchestra.run.smithi161.stdout:1745 trunc from 0xda71a96 to 0xb70184d 2024-09-21T15:07:52.668 INFO:teuthology.orchestra.run.smithi161.stdout:1119 read 0x94264b3 thru 0x942904c (0x2b9a bytes) 2024-09-21T15:07:52.677 INFO:teuthology.orchestra.run.smithi161.stdout:1120 trunc from 0xea718f3 to 0xb15d80a 2024-09-21T15:07:52.683 INFO:teuthology.orchestra.run.smithi161.stdout:1056 read 0xb2b9e3e thru 0xb2c2c42 (0x8e05 bytes) 2024-09-21T15:07:52.683 INFO:teuthology.orchestra.run.smithi161.stdout:1057 writesame 0x71aab1b thru 0x71ad064 data_size 0x4a(0x254a bytes) 2024-09-21T15:07:52.694 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:52.694 INFO:teuthology.orchestra.run.smithi161.stdout:1059 write 0x9b46e50 thru 0x9b50349 (0x94fa bytes) 2024-09-21T15:07:52.699 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone10 from 0x9726b03 (overlap 0x3ea9d6) to 0x1910bc 2024-09-21T15:07:52.704 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:52.704 INFO:teuthology.orchestra.run.smithi161.stdout:1748 writesame 0x54c366a thru 0x54c9f77 data_size 0x71(0x690e bytes) 2024-09-21T15:07:52.707 INFO:teuthology.orchestra.run.smithi161.stdout:1502 write 0xd092657 thru 0xd09b1db (0x8b85 bytes) 2024-09-21T15:07:52.715 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone10 from 0x930173a (overlap 0x930173a) to 0x0 2024-09-21T15:07:52.717 INFO:teuthology.orchestra.run.smithi161.stdout:1060 read 0x722c36a thru 0x7236c15 (0xa8ac bytes) 2024-09-21T15:07:52.718 INFO:teuthology.orchestra.run.smithi161.stdout:1062 write 0x19acaa4 thru 0x19b24ee (0x5a4b bytes) 2024-09-21T15:07:52.731 INFO:teuthology.orchestra.run.smithi161.stdout:1121 punch from 0x980aff8 to 0x9814262, (0x926a bytes) 2024-09-21T15:07:52.731 INFO:teuthology.orchestra.run.smithi161.stdout:1749 read 0x898c3e2 thru 0x898dcb7 (0x18d6 bytes) 2024-09-21T15:07:52.731 INFO:teuthology.orchestra.run.smithi161.stdout:1122 write 0xac8bde1 thru 0xac952d2 (0x94f2 bytes) 2024-09-21T15:07:52.732 INFO:teuthology.orchestra.run.smithi161.stdout:1750 write 0x24fc524 thru 0x250bdde (0xf8bb bytes) 2024-09-21T15:07:52.739 INFO:teuthology.orchestra.run.smithi161.stdout:1505 writesame 0x71ff41a thru 0x72093f3 data_size 0x4f(0x9fda bytes) 2024-09-21T15:07:52.742 INFO:teuthology.orchestra.run.smithi161.stdout:1063 read 0x5b435d1 thru 0x5b470a5 (0x3ad5 bytes) 2024-09-21T15:07:52.743 INFO:teuthology.orchestra.run.smithi161.stdout:1066 read 0xd878e1 thru 0xd8d50a (0x5c2a bytes) 2024-09-21T15:07:52.747 INFO:teuthology.orchestra.run.smithi161.stdout:1067 read 0x1518f3b thru 0x151ffa3 (0x7069 bytes) 2024-09-21T15:07:52.747 INFO:teuthology.orchestra.run.smithi161.stdout:1069 punch from 0x37e2aff to 0x37ebfe9, (0x94ea bytes) 2024-09-21T15:07:52.747 INFO:teuthology.orchestra.run.smithi161.stdout:1071 write 0x64e9c16 thru 0x64f2e07 (0x91f2 bytes) 2024-09-21T15:07:52.788 INFO:teuthology.orchestra.run.smithi161.stdout:1752 read 0x3d1e066 thru 0x3d1f133 (0x10ce bytes) 2024-09-21T15:07:52.807 INFO:teuthology.orchestra.run.smithi161.stdout:1754 trunc from 0xb70184d to 0x1d1b227 2024-09-21T15:07:52.861 INFO:teuthology.orchestra.run.smithi161.stdout:1123 read 0x513be8d thru 0x51458e1 (0x9a55 bytes) 2024-09-21T15:07:52.862 INFO:teuthology.orchestra.run.smithi161.stdout:1127 write 0x3a61212 thru 0x3a6fbaf (0xe99e bytes) 2024-09-21T15:07:52.911 INFO:teuthology.orchestra.run.smithi161.stdout:1508 write 0x74bd232 thru 0x74c8a37 (0xb806 bytes) 2024-09-21T15:07:52.966 INFO:teuthology.orchestra.run.smithi161.stdout:1072 trunc from 0xe55dceb to 0x4371592 2024-09-21T15:07:52.984 INFO:teuthology.orchestra.run.smithi161.stdout:1755 read 0xdc2c98 thru 0xdce0bc (0xb425 bytes) 2024-09-21T15:07:53.025 INFO:teuthology.orchestra.run.smithi161.stdout:1757 write 0x4fd9a6c thru 0x4fe9127 (0xf6bc bytes) 2024-09-21T15:07:53.047 INFO:teuthology.orchestra.run.smithi161.stdout:1511 read 0xbed84ab thru 0xbedb47f (0x2fd5 bytes) 2024-09-21T15:07:53.047 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.049 INFO:teuthology.orchestra.run.smithi161.stdout:1513 trunc from 0xd09b1dc to 0xddf29cf 2024-09-21T15:07:53.099 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #9, image image_cluster1.client.mirror.4-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent10 2024-09-21T15:07:53.113 INFO:teuthology.orchestra.run.smithi161.stdout:1759 punch from 0x44fe71b to 0x4506a49, (0x832e bytes) 2024-09-21T15:07:53.113 INFO:teuthology.orchestra.run.smithi161.stdout:1760 write 0x26a05a0 thru 0x26a7d1b (0x777c bytes) 2024-09-21T15:07:53.122 INFO:teuthology.orchestra.run.smithi161.stdout:1128 read 0x953fa04 thru 0x954ddf9 (0xe3f6 bytes) 2024-09-21T15:07:53.122 INFO:teuthology.orchestra.run.smithi161.stdout:1129 punch from 0xcd82b1 to 0xcd891d, (0x66c bytes) 2024-09-21T15:07:53.122 INFO:teuthology.orchestra.run.smithi161.stdout:1130 read 0x1167c32 thru 0x117572a (0xdaf9 bytes) 2024-09-21T15:07:53.123 INFO:teuthology.orchestra.run.smithi161.stdout:1515 read 0xc253004 thru 0xc261d09 (0xed06 bytes) 2024-09-21T15:07:53.124 INFO:teuthology.orchestra.run.smithi161.stdout:1516 read 0xa6f787c thru 0xa6f8818 (0xf9d bytes) 2024-09-21T15:07:53.124 INFO:teuthology.orchestra.run.smithi161.stdout:1517 read 0x152c76a thru 0x153219c (0x5a33 bytes) 2024-09-21T15:07:53.124 INFO:teuthology.orchestra.run.smithi161.stdout:1518 read 0x5e685ff thru 0x5e68620 (0x22 bytes) 2024-09-21T15:07:53.146 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.146 INFO:teuthology.orchestra.run.smithi161.stdout:1131 read 0x1308faa thru 0x1312f7a (0x9fd1 bytes) 2024-09-21T15:07:53.152 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.152 INFO:teuthology.orchestra.run.smithi161.stdout:1134 write 0x234f6ab thru 0x23530a4 (0x39fa bytes) 2024-09-21T15:07:53.162 INFO:teuthology.orchestra.run.smithi161.stdout:1761 read 0x2d7cd92 thru 0x2d832a4 (0x6513 bytes) 2024-09-21T15:07:53.163 INFO:teuthology.orchestra.run.smithi161.stdout:1519 writesame 0xe99c722 thru 0xe9aa102 data_size 0x11(0xd9e1 bytes) 2024-09-21T15:07:53.168 INFO:teuthology.orchestra.run.smithi161.stdout:1520 read 0x60b8b74 thru 0x60c6fef (0xe47c bytes) 2024-09-21T15:07:53.172 INFO:teuthology.orchestra.run.smithi161.stdout:1762 trunc from 0x4fe9128 to 0x97fc031 2024-09-21T15:07:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:1521 trunc from 0xe9aa103 to 0xad73ad 2024-09-21T15:07:53.270 INFO:teuthology.orchestra.run.smithi161.stdout:1112 writesame 0xa3c244b thru 0xa3cb101 data_size 0x11(0x8cb7 bytes) 2024-09-21T15:07:53.306 INFO:teuthology.orchestra.run.smithi161.stdout:1763 writesame 0xcb5d4a8 thru 0xcb65069 data_size 0x49(0x7bc2 bytes) 2024-09-21T15:07:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.312 INFO:teuthology.orchestra.run.smithi161.stdout:1767 write 0x2d8e4c thru 0x2def0c (0x60c1 bytes) 2024-09-21T15:07:53.320 INFO:teuthology.orchestra.run.smithi161.stdout:1768 read 0x22a10b8 thru 0x22b039f (0xf2e8 bytes) 2024-09-21T15:07:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:1769 punch from 0x59f240 to 0x5a4611, (0x53d1 bytes) 2024-09-21T15:07:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:1770 punch from 0xdc77b5 to 0xdcd594, (0x5ddf bytes) 2024-09-21T15:07:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:1771 punch from 0x17a150e to 0x17adad1, (0xc5c3 bytes) 2024-09-21T15:07:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:1135 punch from 0x1be7dc9 to 0x1beb2d8, (0x350f bytes) 2024-09-21T15:07:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.322 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xec7e63c 2024-09-21T15:07:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:1772 read 0x8c1fd85 thru 0x8c2a9cc (0xac48 bytes) 2024-09-21T15:07:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:1773 punch from 0x5405a84 to 0x5410715, (0xac91 bytes) 2024-09-21T15:07:53.324 INFO:teuthology.orchestra.run.smithi161.stdout:1114 writesame 0xc17fd06 thru 0xc18166a data_size 0xb(0x1965 bytes) 2024-09-21T15:07:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:1139 trunc from 0xb15d80a to 0xec7e63c 2024-09-21T15:07:53.343 INFO:teuthology.orchestra.run.smithi161.stdout:1115 trunc from 0xc18166b to 0x68759ce 2024-09-21T15:07:53.364 INFO:teuthology.orchestra.run.smithi161.stdout:1774 write 0xd586057 thru 0xd58955a (0x3504 bytes) 2024-09-21T15:07:53.371 INFO:teuthology.orchestra.run.smithi161.stdout:1075 write 0xeda178f thru 0xedaa76b (0x8fdd bytes) 2024-09-21T15:07:53.381 INFO:teuthology.orchestra.run.smithi161.stdout:1141 writesame 0xb54b634 thru 0xb54c928 data_size 0x1(0x12f5 bytes) 2024-09-21T15:07:53.383 INFO:teuthology.orchestra.run.smithi161.stdout:1775 writesame 0xace37a7 thru 0xacf15bb data_size 0x3(0xde15 bytes) 2024-09-21T15:07:53.389 INFO:teuthology.orchestra.run.smithi161.stdout:1078 read 0x2b3b1bc thru 0x2b4420c (0x9051 bytes) 2024-09-21T15:07:53.389 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.389 INFO:teuthology.orchestra.run.smithi161.stdout:1084 read 0x229be05 thru 0x22a0bbe (0x4dba bytes) 2024-09-21T15:07:53.389 INFO:teuthology.orchestra.run.smithi161.stdout:1085 punch from 0x65b5b3d to 0x65b7ec3, (0x2386 bytes) 2024-09-21T15:07:53.389 INFO:teuthology.orchestra.run.smithi161.stdout:1086 write 0x56c0d10 thru 0x56cd746 (0xca37 bytes) 2024-09-21T15:07:53.407 INFO:teuthology.orchestra.run.smithi161.stdout:1522 write 0xccb798c thru 0xccc07dc (0x8e51 bytes) 2024-09-21T15:07:53.407 INFO:teuthology.orchestra.run.smithi161.stdout:1143 read 0xcd3ebec thru 0xcd48d08 (0xa11d bytes) 2024-09-21T15:07:53.407 INFO:teuthology.orchestra.run.smithi161.stdout:1144 clone 10 order 24 su 8388608 sc 4 2024-09-21T15:07:53.415 INFO:teuthology.orchestra.run.smithi161.stdout:1116 read 0x5215690 thru 0x5220fe0 (0xb951 bytes) 2024-09-21T15:07:53.416 INFO:teuthology.orchestra.run.smithi161.stdout:1118 write 0xbe9904 thru 0xbeb654 (0x1d51 bytes) 2024-09-21T15:07:53.417 INFO:teuthology.orchestra.run.smithi161.stdout:1087 writesame 0x930b894 thru 0x930cb8e data_size 0x1(0x12fb bytes) 2024-09-21T15:07:53.424 INFO:teuthology.orchestra.run.smithi161.stdout:1778 trunc from 0xd58955b to 0x774ad11 2024-09-21T15:07:53.434 INFO:teuthology.orchestra.run.smithi161.stdout:1120 read 0x3ce5c99 thru 0x3cf5741 (0xfaa9 bytes) 2024-09-21T15:07:53.435 INFO:teuthology.orchestra.run.smithi161.stdout:1089 read 0xe31adbf thru 0xe31cb7a (0x1dbc bytes) 2024-09-21T15:07:53.436 INFO:teuthology.orchestra.run.smithi161.stdout:1122 read 0x1054677 thru 0x1060936 (0xc2c0 bytes) 2024-09-21T15:07:53.436 INFO:teuthology.orchestra.run.smithi161.stdout:1090 read 0xa9c6dad thru 0xa9ca8dc (0x3b30 bytes) 2024-09-21T15:07:53.436 INFO:teuthology.orchestra.run.smithi161.stdout:1092 write 0x9943d5a thru 0x9952f0d (0xf1b4 bytes) 2024-09-21T15:07:53.437 INFO:teuthology.orchestra.run.smithi161.stdout:1124 read 0x1d0af04 thru 0x1d0e346 (0x3443 bytes) 2024-09-21T15:07:53.448 INFO:teuthology.orchestra.run.smithi161.stdout:1094 punch from 0x356647e to 0x3568b99, (0x271b bytes) 2024-09-21T15:07:53.448 INFO:teuthology.orchestra.run.smithi161.stdout:1095 write 0x63e80ad thru 0x63f2a1e (0xa972 bytes) 2024-09-21T15:07:53.454 INFO:teuthology.orchestra.run.smithi161.stdout:1523 trunc from 0xccc07dd to 0x7313bf 2024-09-21T15:07:53.460 INFO:teuthology.orchestra.run.smithi161.stdout:1096 read 0x40c3539 thru 0x40d1b40 (0xe608 bytes) 2024-09-21T15:07:53.460 INFO:teuthology.orchestra.run.smithi161.stdout:1097 read 0x9d52ebf thru 0x9d5b30e (0x8450 bytes) 2024-09-21T15:07:53.469 INFO:teuthology.orchestra.run.smithi161.stdout:1125 write 0x921ceca thru 0x9220bef (0x3d26 bytes) 2024-09-21T15:07:53.479 INFO:teuthology.orchestra.run.smithi161.stdout:1098 trunc from 0xedaa76c to 0x4c20803 2024-09-21T15:07:53.489 INFO:teuthology.orchestra.run.smithi161.stdout:1126 trunc from 0x9220bf0 to 0x4741cb7 2024-09-21T15:07:53.502 INFO:teuthology.orchestra.run.smithi161.stdout:1524 read 0x13a728 thru 0x13f4b8 (0x4d91 bytes) 2024-09-21T15:07:53.504 INFO:teuthology.orchestra.run.smithi161.stdout:1529 write 0x5a9f31 thru 0x5b527a (0xb34a bytes) 2024-09-21T15:07:53.509 INFO:teuthology.orchestra.run.smithi161.stdout:1779 write 0xac34f96 thru 0xac3d124 (0x818f bytes) 2024-09-21T15:07:53.521 INFO:teuthology.orchestra.run.smithi161.stdout:1533 trunc from 0x7313bf to 0x1a9e98f 2024-09-21T15:07:53.537 INFO:teuthology.orchestra.run.smithi161.stdout:1780 punch from 0x54efba3 to 0x54fc4b4, (0xc911 bytes) 2024-09-21T15:07:53.537 INFO:teuthology.orchestra.run.smithi161.stdout:1781 read 0x42b364a thru 0x42c34f9 (0xfeb0 bytes) 2024-09-21T15:07:53.539 INFO:teuthology.orchestra.run.smithi161.stdout:1784 write 0xe6c397 thru 0xe7983b (0xd4a5 bytes) 2024-09-21T15:07:53.548 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #9, image image_cluster1.client.mirror.5-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent10 2024-09-21T15:07:53.596 INFO:teuthology.orchestra.run.smithi161.stdout:1127 write 0x47c2c16 thru 0x47c4bf9 (0x1fe4 bytes) 2024-09-21T15:07:53.600 INFO:teuthology.orchestra.run.smithi161.stdout:1785 write 0xe7ee542 thru 0xe7fb8ba (0xd379 bytes) 2024-09-21T15:07:53.600 INFO:teuthology.orchestra.run.smithi161.stdout:1099 write 0xaba2b65 thru 0xabaddcd (0xb269 bytes) 2024-09-21T15:07:53.605 INFO:teuthology.orchestra.run.smithi161.stdout:1534 writesame 0xce88c15 thru 0xce8bc65 data_size 0x39(0x3051 bytes) 2024-09-21T15:07:53.609 INFO:teuthology.orchestra.run.smithi161.stdout:1128 trunc from 0x47c4bfa to 0x78deb60 2024-09-21T15:07:53.609 INFO:teuthology.orchestra.run.smithi161.stdout:1535 punch from 0x44b0089 to 0x44ba026, (0x9f9d bytes) 2024-09-21T15:07:53.609 INFO:teuthology.orchestra.run.smithi161.stdout:1536 write 0x52887db thru 0x529231d (0x9b43 bytes) 2024-09-21T15:07:53.616 INFO:teuthology.orchestra.run.smithi161.stdout:1100 punch from 0xa96fb84 to 0xa975a01, (0x5e7d bytes) 2024-09-21T15:07:53.616 INFO:teuthology.orchestra.run.smithi161.stdout:1101 punch from 0x42415eb to 0x424ea5b, (0xd470 bytes) 2024-09-21T15:07:53.617 INFO:teuthology.orchestra.run.smithi161.stdout:1102 write 0x8a957d4 thru 0x8a98a85 (0x32b2 bytes) 2024-09-21T15:07:53.624 INFO:teuthology.orchestra.run.smithi161.stdout:1787 writesame 0x79d9404 thru 0x79d97bd data_size 0x3(0x3ba bytes) 2024-09-21T15:07:53.634 INFO:teuthology.orchestra.run.smithi161.stdout:1537 read 0x90b74dd thru 0x90c5f04 (0xea28 bytes) 2024-09-21T15:07:53.636 INFO:teuthology.orchestra.run.smithi161.stdout:1539 trunc from 0xce8bc66 to 0xdc17079 2024-09-21T15:07:53.639 INFO:teuthology.orchestra.run.smithi161.stdout:1103 punch from 0x492a5ff to 0x492ed82, (0x4783 bytes) 2024-09-21T15:07:53.646 INFO:teuthology.orchestra.run.smithi161.stdout:1788 write 0x86885ec thru 0x8694784 (0xc199 bytes) 2024-09-21T15:07:53.658 INFO:teuthology.orchestra.run.smithi161.stdout:1130 punch from 0x1bc557f to 0x1bc99de, (0x445f bytes) 2024-09-21T15:07:53.658 INFO:teuthology.orchestra.run.smithi161.stdout:1104 trunc from 0xabaddce to 0x2725fc1 2024-09-21T15:07:53.658 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.658 INFO:teuthology.orchestra.run.smithi161.stdout:1133 read 0x3e2a677 thru 0x3e300f5 (0x5a7f bytes) 2024-09-21T15:07:53.665 INFO:teuthology.orchestra.run.smithi161.stdout:1789 read 0xc750da9 thru 0xc751421 (0x679 bytes) 2024-09-21T15:07:53.665 INFO:teuthology.orchestra.run.smithi161.stdout:1791 read 0x481b60c thru 0x481e022 (0x2a17 bytes) 2024-09-21T15:07:53.666 INFO:teuthology.orchestra.run.smithi161.stdout:1793 punch from 0x737951a to 0x7384f68, (0xba4e bytes) 2024-09-21T15:07:53.667 INFO:teuthology.orchestra.run.smithi161.stdout:1795 read 0x7445ed4 thru 0x7447de7 (0x1f14 bytes) 2024-09-21T15:07:53.667 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.667 INFO:teuthology.orchestra.run.smithi161.stdout:1798 write 0x391114b thru 0x392113c (0xfff2 bytes) 2024-09-21T15:07:53.682 INFO:teuthology.orchestra.run.smithi161.stdout:1540 read 0xc7ff11d thru 0xc7ff8f0 (0x7d4 bytes) 2024-09-21T15:07:53.684 INFO:teuthology.orchestra.run.smithi161.stdout:1541 trunc from 0xdc17079 to 0xeda6617 2024-09-21T15:07:53.684 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.685 INFO:teuthology.orchestra.run.smithi161.stdout:1800 write 0xabdb9eb thru 0xabe846c (0xca82 bytes) 2024-09-21T15:07:53.696 INFO:teuthology.orchestra.run.smithi161.stdout:1135 write 0xb0d334f thru 0xb0d7029 (0x3cdb bytes) 2024-09-21T15:07:53.697 INFO:teuthology.orchestra.run.smithi161.stdout:1803 read 0xd36b0d6 thru 0xd375de9 (0xad14 bytes) 2024-09-21T15:07:53.697 INFO:teuthology.orchestra.run.smithi161.stdout:1805 read 0xb23f498 thru 0xb2439f9 (0x4562 bytes) 2024-09-21T15:07:53.697 INFO:teuthology.orchestra.run.smithi161.stdout:1807 read 0x99fca05 thru 0x9a070b1 (0xa6ad bytes) 2024-09-21T15:07:53.697 INFO:teuthology.orchestra.run.smithi161.stdout:1809 read 0x9ded664 thru 0x9df0346 (0x2ce3 bytes) 2024-09-21T15:07:53.697 INFO:teuthology.orchestra.run.smithi161.stdout:1810 write 0xa384b88 thru 0xa38b9f9 (0x6e72 bytes) 2024-09-21T15:07:53.703 INFO:teuthology.orchestra.run.smithi161.stdout:1812 writesame 0x64f4dcc thru 0x6500e9c data_size 0x1(0xc0d1 bytes) 2024-09-21T15:07:53.705 INFO:teuthology.orchestra.run.smithi161.stdout:1136 write 0x2a53faa thru 0x2a5f05b (0xb0b2 bytes) 2024-09-21T15:07:53.706 INFO:teuthology.orchestra.run.smithi161.stdout:1542 writesame 0xecfdaeb thru 0xed00b37 data_size 0x1(0x304d bytes) 2024-09-21T15:07:53.719 INFO:teuthology.orchestra.run.smithi161.stdout:1138 read 0xb80308 thru 0xb8f493 (0xf18c bytes) 2024-09-21T15:07:53.720 INFO:teuthology.orchestra.run.smithi161.stdout:1140 read 0xad0bab0 thru 0xad16af1 (0xb042 bytes) 2024-09-21T15:07:53.721 INFO:teuthology.orchestra.run.smithi161.stdout:1105 trunc from 0x2725fc1 to 0x9d28436 2024-09-21T15:07:53.721 INFO:teuthology.orchestra.run.smithi161.stdout:1143 punch from 0x73d1833 to 0x73d6285, (0x4a52 bytes) 2024-09-21T15:07:53.721 INFO:teuthology.orchestra.run.smithi161.stdout:1544 read 0x8e50791 thru 0x8e525a9 (0x1e19 bytes) 2024-09-21T15:07:53.721 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.722 INFO:teuthology.orchestra.run.smithi161.stdout:1548 read 0x7c39aa2 thru 0x7c3a7f0 (0xd4f bytes) 2024-09-21T15:07:53.722 INFO:teuthology.orchestra.run.smithi161.stdout:1549 read 0x40c024 thru 0x4160a3 (0xa080 bytes) 2024-09-21T15:07:53.736 INFO:teuthology.orchestra.run.smithi161.stdout:1550 read 0x4bb263e thru 0x4bbf2d9 (0xcc9c bytes) 2024-09-21T15:07:53.736 INFO:teuthology.orchestra.run.smithi161.stdout:1813 write 0x2ce333e thru 0x2ceac5c (0x791f bytes) 2024-09-21T15:07:53.745 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.745 INFO:teuthology.orchestra.run.smithi161.stdout:1816 read 0xc1fb897 thru 0xc205d1c (0xa486 bytes) 2024-09-21T15:07:53.745 INFO:teuthology.orchestra.run.smithi161.stdout:1817 write 0xd6c3e33 thru 0xd6d2e14 (0xefe2 bytes) 2024-09-21T15:07:53.758 INFO:teuthology.orchestra.run.smithi161.stdout:1551 trunc from 0xeda6617 to 0x43f14c2 2024-09-21T15:07:53.761 INFO:teuthology.orchestra.run.smithi161.stdout:1818 read 0x691bcaa thru 0x6927041 (0xb398 bytes) 2024-09-21T15:07:53.762 INFO:teuthology.orchestra.run.smithi161.stdout:1820 punch from 0x904a97a to 0x904c385, (0x1a0b bytes) 2024-09-21T15:07:53.762 INFO:teuthology.orchestra.run.smithi161.stdout:1821 read 0x8438067 thru 0x843c0db (0x4075 bytes) 2024-09-21T15:07:53.763 INFO:teuthology.orchestra.run.smithi161.stdout:1823 punch from 0x25be77b to 0x25c13da, (0x2c5f bytes) 2024-09-21T15:07:53.763 INFO:teuthology.orchestra.run.smithi161.stdout:1824 read 0x348ac23 thru 0x348c2fb (0x16d9 bytes) 2024-09-21T15:07:53.765 INFO:teuthology.orchestra.run.smithi161.stdout:1145 writesame 0xbf9b39b thru 0xbf9be6d data_size 0x1(0xad3 bytes) 2024-09-21T15:07:53.766 INFO:teuthology.orchestra.run.smithi161.stdout:1825 trunc from 0xe7fb8bb to 0xd83888f 2024-09-21T15:07:53.772 INFO:teuthology.orchestra.run.smithi161.stdout:1146 writesame 0x3d3574e thru 0x3d35edf data_size 0x13(0x792 bytes) 2024-09-21T15:07:53.791 INFO:teuthology.orchestra.run.smithi161.stdout:1147 trunc from 0xbf9be6e to 0x87d8056 2024-09-21T15:07:53.793 INFO:teuthology.orchestra.run.smithi161.stdout:1108 write 0xe173cc6 thru 0xe17b66f (0x79aa bytes) 2024-09-21T15:07:53.811 INFO:teuthology.orchestra.run.smithi161.stdout:1109 writesame 0x6de2761 thru 0x6de5e08 data_size 0x42(0x36a8 bytes) 2024-09-21T15:07:53.821 INFO:teuthology.orchestra.run.smithi161.stdout:1081 trunc from 0x930173a to 0x8bd8ec2 2024-09-21T15:07:53.822 INFO:teuthology.orchestra.run.smithi161.stdout:1554 read 0x47b921 thru 0x483cae (0x838e bytes) 2024-09-21T15:07:53.824 INFO:teuthology.orchestra.run.smithi161.stdout:1827 trunc from 0xd83888f to 0xbde0df7 2024-09-21T15:07:53.825 INFO:teuthology.orchestra.run.smithi161.stdout:1555 read 0xe86503 thru 0xe91ba5 (0xb6a3 bytes) 2024-09-21T15:07:53.826 INFO:teuthology.orchestra.run.smithi161.stdout:1556 write 0x24eb5a5 thru 0x24ef65a (0x40b6 bytes) 2024-09-21T15:07:53.830 INFO:teuthology.orchestra.run.smithi161.stdout:1148 write 0x5754ac1 thru 0x57557cb (0xd0b bytes) 2024-09-21T15:07:53.831 INFO:teuthology.orchestra.run.smithi161.stdout:1110 trunc from 0xe17b670 to 0x8fedf35 2024-09-21T15:07:53.837 INFO:teuthology.orchestra.run.smithi161.stdout:1557 read 0x4bcbfc thru 0x4bf118 (0x251d bytes) 2024-09-21T15:07:53.841 INFO:teuthology.orchestra.run.smithi161.stdout:1149 trunc from 0x87d8056 to 0x8445c5a 2024-09-21T15:07:53.848 INFO:teuthology.orchestra.run.smithi161.stdout:1558 trunc from 0x43f14c2 to 0x9e0f7c7 2024-09-21T15:07:53.876 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.876 INFO:teuthology.orchestra.run.smithi161.stdout:1829 write 0x785e242 thru 0x78613d7 (0x3196 bytes) 2024-09-21T15:07:53.900 INFO:teuthology.orchestra.run.smithi161.stdout:1150 punch from 0x16e3ab1 to 0x16f19ce, (0xdf1d bytes) 2024-09-21T15:07:53.900 INFO:teuthology.orchestra.run.smithi161.stdout:1151 read 0x779a9ea thru 0x77a1143 (0x675a bytes) 2024-09-21T15:07:53.900 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.901 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.901 INFO:teuthology.orchestra.run.smithi161.stdout:1562 punch from 0x3abd637 to 0x3ac6b5b, (0x9524 bytes) 2024-09-21T15:07:53.901 INFO:teuthology.orchestra.run.smithi161.stdout:1565 read 0x441e13f thru 0x44297d5 (0xb697 bytes) 2024-09-21T15:07:53.901 INFO:teuthology.orchestra.run.smithi161.stdout:1566 read 0x3c33a93 thru 0x3c3dd67 (0xa2d5 bytes) 2024-09-21T15:07:53.906 INFO:teuthology.orchestra.run.smithi161.stdout:1152 trunc from 0x8445c5a to 0x556c1d4 2024-09-21T15:07:53.915 INFO:teuthology.orchestra.run.smithi161.stdout:1112 read 0x692aad0 thru 0x69319d6 (0x6f07 bytes) 2024-09-21T15:07:53.915 INFO:teuthology.orchestra.run.smithi161.stdout:1114 write 0x2b07212 thru 0x2b0db62 (0x6951 bytes) 2024-09-21T15:07:53.918 INFO:teuthology.orchestra.run.smithi161.stdout:1830 punch from 0xdc84db to 0xdcf0fc, (0x6c21 bytes) 2024-09-21T15:07:53.918 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:53.918 INFO:teuthology.orchestra.run.smithi161.stdout:1834 read 0xa80527c thru 0xa80bdca (0x6b4f bytes) 2024-09-21T15:07:53.918 INFO:teuthology.orchestra.run.smithi161.stdout:1835 punch from 0x82a903d to 0x82aba89, (0x2a4c bytes) 2024-09-21T15:07:53.918 INFO:teuthology.orchestra.run.smithi161.stdout:1838 read 0x7677496 thru 0x767bd01 (0x486c bytes) 2024-09-21T15:07:53.928 INFO:teuthology.orchestra.run.smithi161.stdout:1116 write 0xbfce9d thru 0xbfe493 (0x15f7 bytes) 2024-09-21T15:07:53.930 INFO:teuthology.orchestra.run.smithi161.stdout:1840 trunc from 0xbde0df7 to 0x5c19148 2024-09-21T15:07:53.941 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone9 from 0xec7e63c (overlap 0x9e0c1a0) to 0x2f6a07c 2024-09-21T15:07:53.945 INFO:teuthology.orchestra.run.smithi161.stdout:1568 writesame 0xed1c3f6 thru 0xed25f86 data_size 0xf(0x9b91 bytes) 2024-09-21T15:07:53.948 INFO:teuthology.orchestra.run.smithi161.stdout:1569 read 0x6d25669 thru 0x6d27801 (0x2199 bytes) 2024-09-21T15:07:53.950 INFO:teuthology.orchestra.run.smithi161.stdout:1570 write 0xeb178fc thru 0xeb1b760 (0x3e65 bytes) 2024-09-21T15:07:53.965 INFO:teuthology.orchestra.run.smithi161.stdout:1153 trunc from 0x556c1d4 to 0x655a34d 2024-09-21T15:07:54.045 INFO:teuthology.orchestra.run.smithi161.stdout:1082 write 0xb2f105 thru 0xb312c0 (0x21bc bytes) 2024-09-21T15:07:54.047 INFO:teuthology.orchestra.run.smithi161.stdout:1571 punch from 0xcbcf9bf to 0xcbdad91, (0xb3d2 bytes) 2024-09-21T15:07:54.047 INFO:teuthology.orchestra.run.smithi161.stdout:1572 read 0xe029e7f thru 0xe0312df (0x7461 bytes) 2024-09-21T15:07:54.048 INFO:teuthology.orchestra.run.smithi161.stdout:1573 punch from 0x28e68ba to 0x28f59d4, (0xf11a bytes) 2024-09-21T15:07:54.048 INFO:teuthology.orchestra.run.smithi161.stdout:1574 write 0x1e8bee3 thru 0x1e97c87 (0xbda5 bytes) 2024-09-21T15:07:54.065 INFO:teuthology.orchestra.run.smithi161.stdout:1117 read 0x6c3e81a thru 0x6c40fb9 (0x27a0 bytes) 2024-09-21T15:07:54.149 INFO:teuthology.orchestra.run.smithi161.stdout:1154 write 0x87bc2c9 thru 0x87cad3a (0xea72 bytes) 2024-09-21T15:07:54.189 INFO:teuthology.orchestra.run.smithi161.stdout:1575 punch from 0x180cc90 to 0x1818427, (0xb797 bytes) 2024-09-21T15:07:54.190 INFO:teuthology.orchestra.run.smithi161.stdout:1576 punch from 0x33a3985 to 0x33a5678, (0x1cf3 bytes) 2024-09-21T15:07:54.190 INFO:teuthology.orchestra.run.smithi161.stdout:1577 read 0xb7ddb02 thru 0xb7ebf8a (0xe489 bytes) 2024-09-21T15:07:54.190 INFO:teuthology.orchestra.run.smithi161.stdout:1578 punch from 0x399ff6e to 0x39a679f, (0x6831 bytes) 2024-09-21T15:07:54.190 INFO:teuthology.orchestra.run.smithi161.stdout:1580 write 0x1e783e0 thru 0x1e852b3 (0xced4 bytes) 2024-09-21T15:07:54.193 INFO:teuthology.orchestra.run.smithi161.stdout:1155 write 0x32ef5c6 thru 0x32f7848 (0x8283 bytes) 2024-09-21T15:07:54.204 INFO:teuthology.orchestra.run.smithi161.stdout:1083 read 0x235a285 thru 0x235f691 (0x540d bytes) 2024-09-21T15:07:54.204 INFO:teuthology.orchestra.run.smithi161.stdout:1084 read 0x1a18b1 thru 0x1ac81e (0xaf6e bytes) 2024-09-21T15:07:54.215 INFO:teuthology.orchestra.run.smithi161.stdout:1842 writesame 0x6db0801 thru 0x6dbb562 data_size 0x1(0xad62 bytes) 2024-09-21T15:07:54.221 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:54.221 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:54.222 INFO:teuthology.orchestra.run.smithi161.stdout:1846 read 0x32ab291 thru 0x32b496d (0x96dd bytes) 2024-09-21T15:07:54.266 INFO:teuthology.orchestra.run.smithi161.stdout:1085 punch from 0x18c7634 to 0x18cef2f, (0x78fb bytes) 2024-09-21T15:07:54.266 INFO:teuthology.orchestra.run.smithi161.stdout:1086 read 0x36b75f6 thru 0x36c5133 (0xdb3e bytes) 2024-09-21T15:07:54.266 INFO:teuthology.orchestra.run.smithi161.stdout:1156 write 0x7158cc5 thru 0x715e148 (0x5484 bytes) 2024-09-21T15:07:54.269 INFO:teuthology.orchestra.run.smithi161.stdout:1087 trunc from 0x8bd8ec2 to 0x9bfe604 2024-09-21T15:07:54.281 INFO:teuthology.orchestra.run.smithi161.stdout:1582 write 0xab20cae thru 0xab2f43f (0xe792 bytes) 2024-09-21T15:07:54.288 INFO:teuthology.orchestra.run.smithi161.stdout:1157 write 0x4aa6146 thru 0x4aa9818 (0x36d3 bytes) 2024-09-21T15:07:54.294 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:54.294 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:54.294 INFO:teuthology.orchestra.run.smithi161.stdout:1161 write 0xf67880 thru 0xf6e2a8 (0x6a29 bytes) 2024-09-21T15:07:54.310 INFO:teuthology.orchestra.run.smithi161.stdout:1583 write 0xe1d9c1b thru 0xe1db6c0 (0x1aa6 bytes) 2024-09-21T15:07:54.323 INFO:teuthology.orchestra.run.smithi161.stdout:1586 write 0x7977016 thru 0x7978e3e (0x1e29 bytes) 2024-09-21T15:07:54.341 INFO:teuthology.orchestra.run.smithi161.stdout:1587 write 0x1b69ede thru 0x1b79248 (0xf36b bytes) 2024-09-21T15:07:54.359 INFO:teuthology.orchestra.run.smithi161.stdout:1162 read 0x800739f thru 0x8014a50 (0xd6b2 bytes) 2024-09-21T15:07:54.359 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:54.359 INFO:teuthology.orchestra.run.smithi161.stdout:1164 punch from 0x325d371 to 0x3261f7f, (0x4c0e bytes) 2024-09-21T15:07:54.359 INFO:teuthology.orchestra.run.smithi161.stdout:1165 write 0x14cf061 thru 0x14d229a (0x323a bytes) 2024-09-21T15:07:54.362 INFO:teuthology.orchestra.run.smithi161.stdout:1588 write 0xb2178e9 thru 0xb2196c6 (0x1dde bytes) 2024-09-21T15:07:54.375 INFO:teuthology.orchestra.run.smithi161.stdout:1167 writesame 0x53839dc thru 0x53862c4 data_size 0x1(0x28e9 bytes) 2024-09-21T15:07:54.378 INFO:teuthology.orchestra.run.smithi161.stdout:1589 write 0xb8fcd23 thru 0xb904acd (0x7dab bytes) 2024-09-21T15:07:54.396 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:54.396 INFO:teuthology.orchestra.run.smithi161.stdout:1169 write 0x61c8cdd thru 0x61d2d1a (0xa03e bytes) 2024-09-21T15:07:54.411 INFO:teuthology.orchestra.run.smithi161.stdout:1590 read 0xafb32a4 thru 0xafc27c0 (0xf51d bytes) 2024-09-21T15:07:54.411 INFO:teuthology.orchestra.run.smithi161.stdout:1592 writesame 0x4d3c2ec thru 0x4d3fb40 data_size 0x39(0x3855 bytes) 2024-09-21T15:07:54.424 INFO:teuthology.orchestra.run.smithi161.stdout:1088 writesame 0xae3b7c4 thru 0xae4102e data_size 0x9(0x586b bytes) 2024-09-21T15:07:54.426 INFO:teuthology.orchestra.run.smithi161.stdout:1594 read 0xca0de60 thru 0xca13754 (0x58f5 bytes) 2024-09-21T15:07:54.427 INFO:teuthology.orchestra.run.smithi161.stdout:1595 writesame 0x6c84dd9 thru 0x6c8ff61 data_size 0x1(0xb189 bytes) 2024-09-21T15:07:54.427 INFO:teuthology.orchestra.run.smithi161.stdout:1170 writesame 0x52a816e thru 0x52b4d69 data_size 0x46(0xcbfc bytes) 2024-09-21T15:07:54.437 INFO:teuthology.orchestra.run.smithi161.stdout:1847 writesame 0x79f64b7 thru 0x79f7eb4 data_size 0x3(0x19fe bytes) 2024-09-21T15:07:54.438 INFO:teuthology.orchestra.run.smithi161.stdout:1118 write 0xab9b828 thru 0xabaaa85 (0xf25e bytes) 2024-09-21T15:07:54.444 INFO:teuthology.orchestra.run.smithi161.stdout:1850 read 0x1298a1 thru 0x138eec (0xf64c bytes) 2024-09-21T15:07:54.446 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:54.446 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:54.446 INFO:teuthology.orchestra.run.smithi161.stdout:1853 write 0x90187c thru 0x910372 (0xeaf7 bytes) 2024-09-21T15:07:54.447 INFO:teuthology.orchestra.run.smithi161.stdout:1171 read 0x1fb8894 thru 0x1fbfa62 (0x71cf bytes) 2024-09-21T15:07:54.451 INFO:teuthology.orchestra.run.smithi161.stdout:1172 trunc from 0x87cad3b to 0xa6ffb72 2024-09-21T15:07:54.456 INFO:teuthology.orchestra.run.smithi161.stdout:1596 write 0x4869837 thru 0x48762cb (0xca95 bytes) 2024-09-21T15:07:54.467 INFO:teuthology.orchestra.run.smithi161.stdout:1119 read 0x9d91c66 thru 0x9d9f1a0 (0xd53b bytes) 2024-09-21T15:07:54.468 INFO:teuthology.orchestra.run.smithi161.stdout:1121 flatten 2024-09-21T15:07:54.484 INFO:teuthology.orchestra.run.smithi161.stdout:1597 read 0x84241a2 thru 0x8426013 (0x1e72 bytes) 2024-09-21T15:07:54.484 INFO:teuthology.orchestra.run.smithi161.stdout:1598 read 0x9a4bbc7 thru 0x9a4f6a8 (0x3ae2 bytes) 2024-09-21T15:07:54.484 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:54.484 INFO:teuthology.orchestra.run.smithi161.stdout:1600 write 0x2a60e2d thru 0x2a6bd6c (0xaf40 bytes) 2024-09-21T15:07:54.509 INFO:teuthology.orchestra.run.smithi161.stdout:1173 punch from 0x4aebc66 to 0x4af588f, (0x9c29 bytes) 2024-09-21T15:07:54.509 INFO:teuthology.orchestra.run.smithi161.stdout:1174 read 0x9b105d thru 0x9b7a80 (0x6a24 bytes) 2024-09-21T15:07:54.510 INFO:teuthology.orchestra.run.smithi161.stdout:1176 write 0x34e3639 thru 0x34e7919 (0x42e1 bytes) 2024-09-21T15:07:54.551 INFO:teuthology.orchestra.run.smithi161.stdout:1854 write 0xb8e6879 thru 0xb8f2ef1 (0xc679 bytes) 2024-09-21T15:07:54.594 INFO:teuthology.orchestra.run.smithi161.stdout:1177 writesame 0xd97b1ff thru 0xd9851b6 data_size 0x4c(0x9fb8 bytes) 2024-09-21T15:07:54.597 INFO:teuthology.orchestra.run.smithi161.stdout:1178 write 0xa03bfd0 thru 0xa03c25b (0x28c bytes) 2024-09-21T15:07:54.605 INFO:teuthology.orchestra.run.smithi161.stdout:1855 read 0x3611f6b thru 0x3616063 (0x40f9 bytes) 2024-09-21T15:07:54.607 INFO:teuthology.orchestra.run.smithi161.stdout:1856 punch from 0x47e400f to 0x47f2d4b, (0xed3c bytes) 2024-09-21T15:07:54.607 INFO:teuthology.orchestra.run.smithi161.stdout:1858 write 0x4a7cf1e thru 0x4a7fd82 (0x2e65 bytes) 2024-09-21T15:07:54.615 INFO:teuthology.orchestra.run.smithi161.stdout:1859 write 0xb5f1075 thru 0xb5f93d0 (0x835c bytes) 2024-09-21T15:07:54.618 INFO:teuthology.orchestra.run.smithi161.stdout:1090 write 0xba92028 thru 0xba95b3b (0x3b14 bytes) 2024-09-21T15:07:54.620 INFO:teuthology.orchestra.run.smithi161.stdout:1180 read 0x9c335fb thru 0x9c3e20f (0xac15 bytes) 2024-09-21T15:07:54.620 INFO:teuthology.orchestra.run.smithi161.stdout:1182 writesame 0xa2684b8 thru 0xa2743f3 data_size 0x2(0xbf3c bytes) 2024-09-21T15:07:54.625 INFO:teuthology.orchestra.run.smithi161.stdout:1860 writesame 0x2f75c15 thru 0x2f7f1cf data_size 0x3(0x95bb bytes) 2024-09-21T15:07:54.626 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:54.626 INFO:teuthology.orchestra.run.smithi161.stdout:1092 writesame 0x675989d thru 0x67661df data_size 0x1(0xc943 bytes) 2024-09-21T15:07:54.629 INFO:teuthology.orchestra.run.smithi161.stdout:1601 trunc from 0xed25f87 to 0x37b617a 2024-09-21T15:07:54.648 INFO:teuthology.orchestra.run.smithi161.stdout:1183 read 0xc0926c0 thru 0xc09929b (0x6bdc bytes) 2024-09-21T15:07:54.670 INFO:teuthology.orchestra.run.smithi161.stdout:1184 trunc from 0xd9851b7 to 0x2b0c2fd 2024-09-21T15:07:54.735 INFO:teuthology.orchestra.run.smithi161.stdout:1093 write 0xb644b2d thru 0xb653cce (0xf1a2 bytes) 2024-09-21T15:07:54.899 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:54.899 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:54.925 INFO:teuthology.orchestra.run.smithi161.stdout:1861 write 0xdb4429b thru 0xdb520b2 (0xde18 bytes) 2024-09-21T15:07:54.961 INFO:teuthology.orchestra.run.smithi161.stdout:1191 write 0xcf09574 thru 0xcf11c85 (0x8712 bytes) 2024-09-21T15:07:54.971 INFO:teuthology.orchestra.run.smithi161.stdout:1862 writesame 0xb5813b3 thru 0xb590fcb data_size 0x1(0xfc19 bytes) 2024-09-21T15:07:55.013 INFO:teuthology.orchestra.run.smithi161.stdout:1192 read 0xbef2487 thru 0xbefbd04 (0x987e bytes) 2024-09-21T15:07:55.013 INFO:teuthology.orchestra.run.smithi161.stdout:1194 write 0xccb21e7 thru 0xccc0b9f (0xe9b9 bytes) 2024-09-21T15:07:55.034 INFO:teuthology.orchestra.run.smithi161.stdout:1094 trunc from 0xba95b3c to 0xd80bcc3 2024-09-21T15:07:55.038 INFO:teuthology.orchestra.run.smithi161.stdout:1863 trunc from 0xdb520b3 to 0x8e8f54f 2024-09-21T15:07:55.040 INFO:teuthology.orchestra.run.smithi161.stdout:1195 writesame 0x584c5f7 thru 0x5853084 data_size 0x17(0x6a8e bytes) 2024-09-21T15:07:55.050 INFO:teuthology.orchestra.run.smithi161.stdout:1196 read 0xad5fb60 thru 0xad6d7cc (0xdc6d bytes) 2024-09-21T15:07:55.050 INFO:teuthology.orchestra.run.smithi161.stdout:1197 write 0xa34cb35 thru 0xa35292e (0x5dfa bytes) 2024-09-21T15:07:55.110 INFO:teuthology.orchestra.run.smithi161.stdout:1199 trunc from 0xcf11c86 to 0xddda44c 2024-09-21T15:07:55.159 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.159 INFO:teuthology.orchestra.run.smithi161.stdout:1201 write 0xaddb91e thru 0xaddceeb (0x15ce bytes) 2024-09-21T15:07:55.178 INFO:teuthology.orchestra.run.smithi161.stdout:1203 read 0x3293115 thru 0x3299f14 (0x6e00 bytes) 2024-09-21T15:07:55.178 INFO:teuthology.orchestra.run.smithi161.stdout:1204 write 0x1f2649d thru 0x1f2ea7a (0x85de bytes) 2024-09-21T15:07:55.190 INFO:teuthology.orchestra.run.smithi161.stdout:1206 write 0x53d4deb thru 0x53d6156 (0x136c bytes) 2024-09-21T15:07:55.214 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.214 INFO:teuthology.orchestra.run.smithi161.stdout:1208 write 0xafa90b3 thru 0xafb8da9 (0xfcf7 bytes) 2024-09-21T15:07:55.278 INFO:teuthology.orchestra.run.smithi161.stdout:1209 write 0xb1f2ffb thru 0xb200a67 (0xda6d bytes) 2024-09-21T15:07:55.310 INFO:teuthology.orchestra.run.smithi161.stdout:1602 write 0x111c464 thru 0x112bf07 (0xfaa4 bytes) 2024-09-21T15:07:55.326 INFO:teuthology.orchestra.run.smithi161.stdout:1210 punch from 0x75ec650 to 0x75fa8ea, (0xe29a bytes) 2024-09-21T15:07:55.326 INFO:teuthology.orchestra.run.smithi161.stdout:1212 read 0x3f9be9f thru 0x3fab292 (0xf3f4 bytes) 2024-09-21T15:07:55.326 INFO:teuthology.orchestra.run.smithi161.stdout:1213 writesame 0xb901e0e thru 0xb906d3b data_size 0x5(0x4f2e bytes) 2024-09-21T15:07:55.338 INFO:teuthology.orchestra.run.smithi161.stdout:1095 punch from 0x6abb738 to 0x6ac4d88, (0x9650 bytes) 2024-09-21T15:07:55.344 INFO:teuthology.orchestra.run.smithi161.stdout:1096 trunc from 0xd80bcc3 to 0xa4ef25b 2024-09-21T15:07:55.368 INFO:teuthology.orchestra.run.smithi161.stdout:1214 read 0x6008f85 thru 0x600ad82 (0x1dfe bytes) 2024-09-21T15:07:55.368 INFO:teuthology.orchestra.run.smithi161.stdout:1215 read 0x759e52a thru 0x75aa7a8 (0xc27f bytes) 2024-09-21T15:07:55.368 INFO:teuthology.orchestra.run.smithi161.stdout:1216 write 0x155ba64 thru 0x15637a2 (0x7d3f bytes) 2024-09-21T15:07:55.371 INFO:teuthology.orchestra.run.smithi161.stdout:1603 read 0xcf6af thru 0xd06f5 (0x1047 bytes) 2024-09-21T15:07:55.376 INFO:teuthology.orchestra.run.smithi161.stdout:1217 read 0x99536af thru 0x9960900 (0xd252 bytes) 2024-09-21T15:07:55.387 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.392 INFO:teuthology.orchestra.run.smithi161.stdout:1608 trunc from 0x37b617a to 0xa78b08 2024-09-21T15:07:55.393 INFO:teuthology.orchestra.run.smithi161.stdout:1218 trunc from 0xddda44c to 0x5fa2feb 2024-09-21T15:07:55.394 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.397 INFO:teuthology.orchestra.run.smithi161.stdout:1864 read 0x574dedb thru 0x5754abd (0x6be3 bytes) 2024-09-21T15:07:55.397 INFO:teuthology.orchestra.run.smithi161.stdout:1867 read 0x6273fbe thru 0x62771f9 (0x323c bytes) 2024-09-21T15:07:55.397 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.397 INFO:teuthology.orchestra.run.smithi161.stdout:1870 writesame 0xe9852c thru 0xea24ee data_size 0x1(0x9fc3 bytes) 2024-09-21T15:07:55.428 INFO:teuthology.orchestra.run.smithi161.stdout:1098 write 0xaf53a23 thru 0xaf58355 (0x4933 bytes) 2024-09-21T15:07:55.438 INFO:teuthology.orchestra.run.smithi161.stdout:1099 read 0x2bc90d9 thru 0x2bce245 (0x516d bytes) 2024-09-21T15:07:55.439 INFO:teuthology.orchestra.run.smithi161.stdout:1100 write 0xab38fe7 thru 0xab48719 (0xf733 bytes) 2024-09-21T15:07:55.442 INFO:teuthology.orchestra.run.smithi161.stdout:1122 writesame 0x7b60e29 thru 0x7b6bdd2 data_size 0xf(0xafaa bytes) 2024-09-21T15:07:55.456 INFO:teuthology.orchestra.run.smithi161.stdout:1871 write 0x136b607 thru 0x1378f7e (0xd978 bytes) 2024-09-21T15:07:55.459 INFO:teuthology.orchestra.run.smithi161.stdout:1102 read 0x6cc20f0 thru 0x6cca634 (0x8545 bytes) 2024-09-21T15:07:55.460 INFO:teuthology.orchestra.run.smithi161.stdout:1107 read 0x1b0b33f thru 0x1b0d53d (0x21ff bytes) 2024-09-21T15:07:55.461 INFO:teuthology.orchestra.run.smithi161.stdout:1123 writesame 0x402b308 thru 0x4033975 data_size 0x1(0x866e bytes) 2024-09-21T15:07:55.461 INFO:teuthology.orchestra.run.smithi161.stdout:1108 read 0x7cb1933 thru 0x7cb3500 (0x1bce bytes) 2024-09-21T15:07:55.462 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.462 INFO:teuthology.orchestra.run.smithi161.stdout:1110 read 0x7cac403 thru 0x7cbb020 (0xec1e bytes) 2024-09-21T15:07:55.464 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.464 INFO:teuthology.orchestra.run.smithi161.stdout:1112 writesame 0x4cd41e6 thru 0x4ce3be6 data_size 0x29(0xfa01 bytes) 2024-09-21T15:07:55.469 INFO:teuthology.orchestra.run.smithi161.stdout:1874 write 0x69ab71f thru 0x69b5821 (0xa103 bytes) 2024-09-21T15:07:55.496 INFO:teuthology.orchestra.run.smithi161.stdout:1124 read 0x92581d1 thru 0x925b7ed (0x361d bytes) 2024-09-21T15:07:55.497 INFO:teuthology.orchestra.run.smithi161.stdout:1127 clone 14 order 18 su 8192 sc 7 2024-09-21T15:07:55.509 INFO:teuthology.orchestra.run.smithi161.stdout:1609 read 0x5aa504 thru 0x5b4cd6 (0xa7d3 bytes) 2024-09-21T15:07:55.522 INFO:teuthology.orchestra.run.smithi161.stdout:1219 trunc from 0x5fa2feb to 0x5c34e05 2024-09-21T15:07:55.525 INFO:teuthology.orchestra.run.smithi161.stdout:1610 trunc from 0xa78b08 to 0x8800021 2024-09-21T15:07:55.547 INFO:teuthology.orchestra.run.smithi161.stdout:1875 write 0xba3b746 thru 0xba3cc07 (0x14c2 bytes) 2024-09-21T15:07:55.563 INFO:teuthology.orchestra.run.smithi161.stdout:1115 writesame 0xaa523e0 thru 0xaa5d286 data_size 0x1(0xaea7 bytes) 2024-09-21T15:07:55.569 INFO:teuthology.orchestra.run.smithi161.stdout:1876 write 0x3a90b9 thru 0x3b5d77 (0xccbf bytes) 2024-09-21T15:07:55.570 INFO:teuthology.orchestra.run.smithi161.stdout:1220 read 0x3882c7b thru 0x3889354 (0x66da bytes) 2024-09-21T15:07:55.570 INFO:teuthology.orchestra.run.smithi161.stdout:1222 writesame 0x5b66841 thru 0x5b67f0d data_size 0x1(0x16cd bytes) 2024-09-21T15:07:55.571 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.579 INFO:teuthology.orchestra.run.smithi161.stdout:1612 trunc from 0x8800021 to 0xc09fb3a 2024-09-21T15:07:55.593 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.594 INFO:teuthology.orchestra.run.smithi161.stdout:1117 read 0x752c483 thru 0x7534253 (0x7dd1 bytes) 2024-09-21T15:07:55.594 INFO:teuthology.orchestra.run.smithi161.stdout:1878 write 0x2cca16a thru 0x2cd5aaa (0xb941 bytes) 2024-09-21T15:07:55.595 INFO:teuthology.orchestra.run.smithi161.stdout:1118 punch from 0x6f5b25 to 0x6fa860, (0x4d3b bytes) 2024-09-21T15:07:55.602 INFO:teuthology.orchestra.run.smithi161.stdout:1224 write 0x432d417 thru 0x433baef (0xe6d9 bytes) 2024-09-21T15:07:55.605 INFO:teuthology.orchestra.run.smithi161.stdout:1879 read 0xb3e98a thru 0xb4c41e (0xda95 bytes) 2024-09-21T15:07:55.606 INFO:teuthology.orchestra.run.smithi161.stdout:1880 write 0x5a53945 thru 0x5a5c58d (0x8c49 bytes) 2024-09-21T15:07:55.615 INFO:teuthology.orchestra.run.smithi161.stdout:1881 writesame 0x4eca1da thru 0x4eca7db data_size 0x1(0x602 bytes) 2024-09-21T15:07:55.621 INFO:teuthology.orchestra.run.smithi161.stdout:1883 write 0x68e4431 thru 0x68e6a11 (0x25e1 bytes) 2024-09-21T15:07:55.623 INFO:teuthology.orchestra.run.smithi161.stdout:1613 trunc from 0xc09fb3a to 0x8442687 2024-09-21T15:07:55.626 INFO:teuthology.orchestra.run.smithi161.stdout:1884 clone 9 order 20 su 4096 sc 10 2024-09-21T15:07:55.629 INFO:teuthology.orchestra.run.smithi161.stdout:1119 write 0xdef8296 thru 0xdf0615e (0xdec9 bytes) 2024-09-21T15:07:55.641 INFO:teuthology.orchestra.run.smithi161.stdout:1226 write 0x656972b thru 0x65698ef (0x1c5 bytes) 2024-09-21T15:07:55.649 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.649 INFO:teuthology.orchestra.run.smithi161.stdout:1123 write 0x27bedb0 thru 0x27c3839 (0x4a8a bytes) 2024-09-21T15:07:55.652 INFO:teuthology.orchestra.run.smithi161.stdout:1228 write 0x3f65e15 thru 0x3f6ce31 (0x701d bytes) 2024-09-21T15:07:55.670 INFO:teuthology.orchestra.run.smithi161.stdout:1229 punch from 0x4eacdd1 to 0x4eb40f8, (0x7327 bytes) 2024-09-21T15:07:55.670 INFO:teuthology.orchestra.run.smithi161.stdout:1231 punch from 0x354d2a1 to 0x3556b48, (0x98a7 bytes) 2024-09-21T15:07:55.670 INFO:teuthology.orchestra.run.smithi161.stdout:1232 write 0x43d9454 thru 0x43e6fbf (0xdb6c bytes) 2024-09-21T15:07:55.675 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #8, image image_cluster1.client.mirror.1-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent9 2024-09-21T15:07:55.682 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.682 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.682 INFO:teuthology.orchestra.run.smithi161.stdout:1236 punch from 0x4cc5f68 to 0x4cc91a3, (0x323b bytes) 2024-09-21T15:07:55.682 INFO:teuthology.orchestra.run.smithi161.stdout:1237 read 0x1a40963 thru 0x1a4e0f0 (0xd78e bytes) 2024-09-21T15:07:55.685 INFO:teuthology.orchestra.run.smithi161.stdout:1615 write 0xc9262d1 thru 0xc92db1e (0x784e bytes) 2024-09-21T15:07:55.705 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.705 INFO:teuthology.orchestra.run.smithi161.stdout:1618 punch from 0x5a2221e to 0x5a2c011, (0x9df3 bytes) 2024-09-21T15:07:55.706 INFO:teuthology.orchestra.run.smithi161.stdout:1621 flatten 2024-09-21T15:07:55.720 INFO:teuthology.orchestra.run.smithi161.stdout:1124 write 0xbe9769d thru 0xbe9d167 (0x5acb bytes) 2024-09-21T15:07:55.727 INFO:teuthology.orchestra.run.smithi161.stdout:1240 write 0xb2b2929 thru 0xb2c1345 (0xea1d bytes) 2024-09-21T15:07:55.729 INFO:teuthology.orchestra.run.smithi161.stdout:1126 punch from 0x1884fe0 to 0x1887e7c, (0x2e9c bytes) 2024-09-21T15:07:55.729 INFO:teuthology.orchestra.run.smithi161.stdout:1127 writesame 0x35895b thru 0x3590ab data_size 0x1(0x751 bytes) 2024-09-21T15:07:55.737 INFO:teuthology.orchestra.run.smithi161.stdout:1623 read 0xc2fc26a thru 0xc302035 (0x5dcc bytes) 2024-09-21T15:07:55.737 INFO:teuthology.orchestra.run.smithi161.stdout:1624 writesame 0x7759ff8 thru 0x7760676 data_size 0x1(0x667f bytes) 2024-09-21T15:07:55.741 INFO:teuthology.orchestra.run.smithi161.stdout:1147 trunc from 0xec7e63c to 0x4b0d0bf 2024-09-21T15:07:55.746 INFO:teuthology.orchestra.run.smithi161.stdout:1243 write 0x67c0987 thru 0x67cbcc0 (0xb33a bytes) 2024-09-21T15:07:55.752 INFO:teuthology.orchestra.run.smithi161.stdout:1128 trunc from 0xdf0615f to 0x83d8588 2024-09-21T15:07:55.766 INFO:teuthology.orchestra.run.smithi161.stdout:1244 trunc from 0xb2c1346 to 0xc8c52a1 2024-09-21T15:07:55.767 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.767 INFO:teuthology.orchestra.run.smithi161.stdout:1626 writesame 0x980e70f thru 0x9814c08 data_size 0x5e(0x64fa bytes) 2024-09-21T15:07:55.800 INFO:teuthology.orchestra.run.smithi161.stdout:1245 read 0x9359a65 thru 0x9360122 (0x66be bytes) 2024-09-21T15:07:55.800 INFO:teuthology.orchestra.run.smithi161.stdout:1246 read 0x5702c8f thru 0x570624d (0x35bf bytes) 2024-09-21T15:07:55.800 INFO:teuthology.orchestra.run.smithi161.stdout:1249 read 0x85cfd4f thru 0x85d5f0f (0x61c1 bytes) 2024-09-21T15:07:55.800 INFO:teuthology.orchestra.run.smithi161.stdout:1251 read 0x34fa1bf thru 0x350632e (0xc170 bytes) 2024-09-21T15:07:55.802 INFO:teuthology.orchestra.run.smithi161.stdout:1252 read 0x6d3f118 thru 0x6d49c40 (0xab29 bytes) 2024-09-21T15:07:55.802 INFO:teuthology.orchestra.run.smithi161.stdout:1253 punch from 0xc7f1105 to 0xc7f7f22, (0x6e1d bytes) 2024-09-21T15:07:55.802 INFO:teuthology.orchestra.run.smithi161.stdout:1254 write 0x674b0fc thru 0x674dd35 (0x2c3a bytes) 2024-09-21T15:07:55.805 INFO:teuthology.orchestra.run.smithi161.stdout:1627 write 0x6d453a5 thru 0x6d4af8e (0x5bea bytes) 2024-09-21T15:07:55.815 INFO:teuthology.orchestra.run.smithi161.stdout:1255 write 0x709491c thru 0x709dc10 (0x92f5 bytes) 2024-09-21T15:07:55.827 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.827 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.827 INFO:teuthology.orchestra.run.smithi161.stdout:1259 writesame 0xc5cefe9 thru 0xc5d3d10 data_size 0xc(0x4d28 bytes) 2024-09-21T15:07:55.838 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.838 INFO:teuthology.orchestra.run.smithi161.stdout:1262 read 0x3eb65c thru 0x3f2ef4 (0x7899 bytes) 2024-09-21T15:07:55.839 INFO:teuthology.orchestra.run.smithi161.stdout:1129 trunc from 0x83d8588 to 0xb47d6ff 2024-09-21T15:07:55.843 INFO:teuthology.orchestra.run.smithi161.stdout:1628 trunc from 0xc92db1f to 0x54cb72 2024-09-21T15:07:55.856 INFO:teuthology.orchestra.run.smithi161.stdout:1264 trunc from 0xc8c52a1 to 0x1a76537 2024-09-21T15:07:55.866 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.908 INFO:teuthology.orchestra.run.smithi161.stdout:1131 write 0xca8a389 thru 0xca96bb5 (0xc82d bytes) 2024-09-21T15:07:55.914 INFO:teuthology.orchestra.run.smithi161.stdout:1630 read 0x347a72 thru 0x349da4 (0x2333 bytes) 2024-09-21T15:07:55.915 INFO:teuthology.orchestra.run.smithi161.stdout:1631 read 0xfd3c5 thru 0x108121 (0xad5d bytes) 2024-09-21T15:07:55.917 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.919 INFO:teuthology.orchestra.run.smithi161.stdout:1133 write 0x20c2848 thru 0x20c2c80 (0x439 bytes) 2024-09-21T15:07:55.935 INFO:teuthology.orchestra.run.smithi161.stdout:1633 trunc from 0x54cb72 to 0x855624c 2024-09-21T15:07:55.939 INFO:teuthology.orchestra.run.smithi161.stdout:1265 read 0x8c1c0d thru 0x8c9e3c (0x8230 bytes) 2024-09-21T15:07:55.944 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.944 INFO:teuthology.orchestra.run.smithi161.stdout:1135 read 0xa133a32 thru 0xa13d62d (0x9bfc bytes) 2024-09-21T15:07:55.945 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.945 INFO:teuthology.orchestra.run.smithi161.stdout:1137 writesame 0x35d231f thru 0x35dfa02 data_size 0x22(0xd6e4 bytes) 2024-09-21T15:07:55.948 INFO:teuthology.orchestra.run.smithi161.stdout:1148 writesame 0x71e3773 thru 0x71ea9c5 data_size 0x25(0x7253 bytes) 2024-09-21T15:07:55.957 INFO:teuthology.orchestra.run.smithi161.stdout:1634 writesame 0x4f49f79 thru 0x4f4eb26 data_size 0x3(0x4bae bytes) 2024-09-21T15:07:55.958 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.958 INFO:teuthology.orchestra.run.smithi161.stdout:1139 read 0x9cd86a2 thru 0x9ce1e89 (0x97e8 bytes) 2024-09-21T15:07:55.974 INFO:teuthology.orchestra.run.smithi161.stdout:1635 read 0x6d77c93 thru 0x6d7bdeb (0x4159 bytes) 2024-09-21T15:07:55.974 INFO:teuthology.orchestra.run.smithi161.stdout:1636 punch from 0x5707908 to 0x5713f22, (0xc61a bytes) 2024-09-21T15:07:55.974 INFO:teuthology.orchestra.run.smithi161.stdout:1637 read 0x5372561 thru 0x5375b6f (0x360f bytes) 2024-09-21T15:07:55.974 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:55.974 INFO:teuthology.orchestra.run.smithi161.stdout:1639 read 0x5c46ca2 thru 0x5c4f7fa (0x8b59 bytes) 2024-09-21T15:07:55.979 INFO:teuthology.orchestra.run.smithi161.stdout:1266 write 0x33b2ef1 thru 0x33bff24 (0xd034 bytes) 2024-09-21T15:07:55.982 INFO:teuthology.orchestra.run.smithi161.stdout:1140 trunc from 0xca96bb6 to 0x7e5194 2024-09-21T15:07:55.995 INFO:teuthology.orchestra.run.smithi161.stdout:1267 read 0x23c49af thru 0x23cd187 (0x87d9 bytes) 2024-09-21T15:07:55.996 INFO:teuthology.orchestra.run.smithi161.stdout:1268 read 0xe98626 thru 0xe9efaa (0x6985 bytes) 2024-09-21T15:07:55.996 INFO:teuthology.orchestra.run.smithi161.stdout:1149 write 0x9a61b24 thru 0x9a6c2bf (0xa79c bytes) 2024-09-21T15:07:55.997 INFO:teuthology.orchestra.run.smithi161.stdout:1269 read 0x16bdd78 thru 0x16c10bf (0x3348 bytes) 2024-09-21T15:07:56.012 INFO:teuthology.orchestra.run.smithi161.stdout:1150 read 0x10d06ae thru 0x10dd96f (0xd2c2 bytes) 2024-09-21T15:07:56.019 INFO:teuthology.orchestra.run.smithi161.stdout:1152 read 0x1faafe4 thru 0x1fb0b0b (0x5b28 bytes) 2024-09-21T15:07:56.052 INFO:teuthology.orchestra.run.smithi161.stdout:1640 write 0xb56d8d7 thru 0xb57b182 (0xd8ac bytes) 2024-09-21T15:07:56.060 INFO:teuthology.orchestra.run.smithi161.stdout:1270 write 0x98c185c thru 0x98c53ee (0x3b93 bytes) 2024-09-21T15:07:56.074 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:56.075 INFO:teuthology.orchestra.run.smithi161.stdout:1273 read 0x4a0c991 thru 0x4a1b1e7 (0xe857 bytes) 2024-09-21T15:07:56.075 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:56.075 INFO:teuthology.orchestra.run.smithi161.stdout:1276 clone 12 order 18 su 4096 sc 3 2024-09-21T15:07:56.076 INFO:teuthology.orchestra.run.smithi161.stdout:1153 write 0xa0675e7 thru 0xa071004 (0x9a1e bytes) 2024-09-21T15:07:56.086 INFO:teuthology.orchestra.run.smithi161.stdout:1155 read 0x87783fe thru 0x8787e1d (0xfa20 bytes) 2024-09-21T15:07:56.087 INFO:teuthology.orchestra.run.smithi161.stdout:1156 read 0x887d4de thru 0x8881095 (0x3bb8 bytes) 2024-09-21T15:07:56.087 INFO:teuthology.orchestra.run.smithi161.stdout:1157 write 0x44b9b52 thru 0x44c7a96 (0xdf45 bytes) 2024-09-21T15:07:56.091 INFO:teuthology.orchestra.run.smithi161.stdout:1141 read 0x266be9 thru 0x26e4a7 (0x78bf bytes) 2024-09-21T15:07:56.098 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:56.099 INFO:teuthology.orchestra.run.smithi161.stdout:1162 writesame 0x1d2179e thru 0x1d218ff data_size 0x3(0x162 bytes) 2024-09-21T15:07:56.164 INFO:teuthology.orchestra.run.smithi161.stdout:1641 write 0xcc9d7c2 thru 0xcc9f9f4 (0x2233 bytes) 2024-09-21T15:07:56.251 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:56.271 INFO:teuthology.orchestra.run.smithi161.stdout:1142 write 0x7568cc7 thru 0x756fa28 (0x6d62 bytes) 2024-09-21T15:07:56.276 INFO:teuthology.orchestra.run.smithi161.stdout:1643 writesame 0xd6d9298 thru 0xd6dfd4c data_size 0x1(0x6ab5 bytes) 2024-09-21T15:07:56.282 INFO:teuthology.orchestra.run.smithi161.stdout:1645 punch from 0xc07323d to 0xc080bfb, (0xd9be bytes) 2024-09-21T15:07:56.282 INFO:teuthology.orchestra.run.smithi161.stdout:1646 punch from 0x90183b4 to 0x9024f68, (0xcbb4 bytes) 2024-09-21T15:07:56.282 INFO:teuthology.orchestra.run.smithi161.stdout:1648 punch from 0x83f0d15 to 0x83f6350, (0x563b bytes) 2024-09-21T15:07:56.283 INFO:teuthology.orchestra.run.smithi161.stdout:1143 punch from 0x3f3ae7e to 0x3f3e680, (0x3802 bytes) 2024-09-21T15:07:56.283 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:56.283 INFO:teuthology.orchestra.run.smithi161.stdout:1147 read 0xfedc18 thru 0xfefa6c (0x1e55 bytes) 2024-09-21T15:07:56.283 INFO:teuthology.orchestra.run.smithi161.stdout:1148 writesame 0xbb120a thru 0xbbd02a data_size 0x1(0xbe21 bytes) 2024-09-21T15:07:56.311 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:56.322 INFO:teuthology.orchestra.run.smithi161.stdout:1649 writesame 0xed5dcea thru 0xed6b822 data_size 0xd(0xdb39 bytes) 2024-09-21T15:07:56.326 INFO:teuthology.orchestra.run.smithi161.stdout:1650 write 0xa3d36a3 thru 0xa3dab16 (0x7474 bytes) 2024-09-21T15:07:56.361 INFO:teuthology.orchestra.run.smithi161.stdout:1150 write 0xbb91043 thru 0xbb9c964 (0xb922 bytes) 2024-09-21T15:07:56.361 INFO:teuthology.orchestra.run.smithi161.stdout:1165 punch from 0x606c144 to 0x606c145, (0x1 bytes) 2024-09-21T15:07:56.362 INFO:teuthology.orchestra.run.smithi161.stdout:1166 write 0x3cd0b93 thru 0x3cdcb82 (0xbff0 bytes) 2024-09-21T15:07:56.369 INFO:teuthology.orchestra.run.smithi161.stdout:1653 trunc from 0xed6b823 to 0x76b43a5 2024-09-21T15:07:56.376 INFO:teuthology.orchestra.run.smithi161.stdout:1151 punch from 0x7d02c34 to 0x7d0390f, (0xcdb bytes) 2024-09-21T15:07:56.376 INFO:teuthology.orchestra.run.smithi161.stdout:1153 write 0xa383279 thru 0xa385391 (0x2119 bytes) 2024-09-21T15:07:56.391 INFO:teuthology.orchestra.run.smithi161.stdout:1154 read 0x3a97c4f thru 0x3aa6db4 (0xf166 bytes) 2024-09-21T15:07:56.391 INFO:teuthology.orchestra.run.smithi161.stdout:1155 punch from 0x7b0cb54 to 0x7b0e9a4, (0x1e50 bytes) 2024-09-21T15:07:56.392 INFO:teuthology.orchestra.run.smithi161.stdout:1156 write 0x112f12a thru 0x113eb91 (0xfa68 bytes) 2024-09-21T15:07:56.415 INFO:teuthology.orchestra.run.smithi161.stdout:1167 write 0xa767628 thru 0xa76d433 (0x5e0c bytes) 2024-09-21T15:07:56.417 INFO:teuthology.orchestra.run.smithi161.stdout:1654 punch from 0xcf5239 to 0xcfd7c2, (0x8589 bytes) 2024-09-21T15:07:56.417 INFO:teuthology.orchestra.run.smithi161.stdout:1655 clone 9 order 18 su 1024 sc 14 2024-09-21T15:07:56.426 INFO:teuthology.orchestra.run.smithi161.stdout:1168 write 0x5d1e537 thru 0x5d2a9fe (0xc4c8 bytes) 2024-09-21T15:07:56.431 INFO:teuthology.orchestra.run.smithi161.stdout:1157 write 0xbf76d3b thru 0xbf7f349 (0x860f bytes) 2024-09-21T15:07:56.437 INFO:teuthology.orchestra.run.smithi161.stdout:1169 write 0x357203d thru 0x357312d (0x10f1 bytes) 2024-09-21T15:07:56.594 INFO:teuthology.orchestra.run.smithi161.stdout:1158 writesame 0x7c85959 thru 0x7c92578 data_size 0x2e(0xcc20 bytes) 2024-09-21T15:07:56.685 INFO:teuthology.orchestra.run.smithi161.stdout:1160 punch from 0x43505a5 to 0x4356c3d, (0x6698 bytes) 2024-09-21T15:07:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:1161 flatten 2024-09-21T15:07:56.811 INFO:teuthology.orchestra.run.smithi161.stdout:1162 write 0x3d8c56 thru 0x3e1575 (0x8920 bytes) 2024-09-21T15:07:56.854 INFO:teuthology.orchestra.run.smithi161.stdout:1164 trunc from 0xbf7f34a to 0x14cf761 2024-09-21T15:07:56.994 INFO:teuthology.orchestra.run.smithi161.stdout:1170 read 0x2cdcadc thru 0x2ce09e1 (0x3f06 bytes) 2024-09-21T15:07:56.996 INFO:teuthology.orchestra.run.smithi161.stdout:1172 read 0x543a877 thru 0x5448415 (0xdb9f bytes) 2024-09-21T15:07:56.997 INFO:teuthology.orchestra.run.smithi161.stdout:1173 read 0x8d7cc3b thru 0x8d875cd (0xa993 bytes) 2024-09-21T15:07:56.997 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:56.997 INFO:teuthology.orchestra.run.smithi161.stdout:1175 read 0x8348ff1 thru 0x83548aa (0xb8ba bytes) 2024-09-21T15:07:56.998 INFO:teuthology.orchestra.run.smithi161.stdout:1177 read 0x6a4678c thru 0x6a47c61 (0x14d6 bytes) 2024-09-21T15:07:56.999 INFO:teuthology.orchestra.run.smithi161.stdout:1165 write 0x7f99d37 thru 0x7f9f7c0 (0x5a8a bytes) 2024-09-21T15:07:57.001 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:57.004 INFO:teuthology.orchestra.run.smithi161.stdout:1184 trunc from 0xa76d434 to 0xded2352 2024-09-21T15:07:57.012 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone11 from 0x98c53ef (overlap 0x1a76537) to 0xa95baf 2024-09-21T15:07:57.018 INFO:teuthology.orchestra.run.smithi161.stdout:1166 punch from 0x58f750c to 0x59026b4, (0xb1a8 bytes) 2024-09-21T15:07:57.054 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:57.054 INFO:teuthology.orchestra.run.smithi161.stdout:1186 write 0xe0d11c thru 0xe1356b (0x6450 bytes) 2024-09-21T15:07:57.081 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone8 from 0xba3cc08 (overlap 0x84227c) to 0x69b530 2024-09-21T15:07:57.114 INFO:teuthology.orchestra.run.smithi161.stdout:1167 write 0x9caafd1 thru 0x9cadca1 (0x2cd1 bytes) 2024-09-21T15:07:57.184 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #7, image image_cluster1.client.mirror.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent8 2024-09-21T15:07:57.283 INFO:teuthology.orchestra.run.smithi161.stdout:1168 writesame 0x9f4e7e4 thru 0x9f50a5f data_size 0x2(0x227c bytes) 2024-09-21T15:07:57.288 INFO:teuthology.orchestra.run.smithi161.stdout:1170 write 0x20d8476 thru 0x20e64c7 (0xe052 bytes) 2024-09-21T15:07:57.297 INFO:teuthology.orchestra.run.smithi161.stdout:1171 read 0x9beb4d2 thru 0x9bfa86d (0xf39c bytes) 2024-09-21T15:07:57.297 INFO:teuthology.orchestra.run.smithi161.stdout:1172 write 0x2112b2f thru 0x2113dd3 (0x12a5 bytes) 2024-09-21T15:07:57.302 INFO:teuthology.orchestra.run.smithi161.stdout:1173 read 0x99b937c thru 0x99bd499 (0x411e bytes) 2024-09-21T15:07:57.302 INFO:teuthology.orchestra.run.smithi161.stdout:1174 write 0x9dc8088 thru 0x9dd3a2e (0xb9a7 bytes) 2024-09-21T15:07:57.329 INFO:teuthology.orchestra.run.smithi161.stdout:1176 trunc from 0x9f50a60 to 0x9a5990 2024-09-21T15:07:57.403 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #10, image image_cluster1.client.mirror.4-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent11 2024-09-21T15:07:57.405 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #7, image image_cluster1.client.mirror.2-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent8 2024-09-21T15:07:57.406 INFO:teuthology.orchestra.run.smithi161.stdout:1187 read 0x2f44562 thru 0x2f53eaf (0xf94e bytes) 2024-09-21T15:07:57.407 INFO:teuthology.orchestra.run.smithi161.stdout:1189 read 0x89022ba thru 0x89102be (0xe005 bytes) 2024-09-21T15:07:57.408 INFO:teuthology.orchestra.run.smithi161.stdout:1191 write 0x7fc940d thru 0x7fd3299 (0x9e8d bytes) 2024-09-21T15:07:57.412 INFO:teuthology.orchestra.run.smithi161.stdout:1178 punch from 0x8550de to 0x856d85, (0x1ca7 bytes) 2024-09-21T15:07:57.412 INFO:teuthology.orchestra.run.smithi161.stdout:1179 read 0x99df8f thru 0x9a3267 (0x52d9 bytes) 2024-09-21T15:07:57.413 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:57.413 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:57.413 INFO:teuthology.orchestra.run.smithi161.stdout:1182 read 0x123054 thru 0x12ebce (0xbb7b bytes) 2024-09-21T15:07:57.415 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:57.415 INFO:teuthology.orchestra.run.smithi161.stdout:1184 punch from 0x30ac97 to 0x311c5d, (0x6fc6 bytes) 2024-09-21T15:07:57.416 INFO:teuthology.orchestra.run.smithi161.stdout:1192 write 0x5205907 thru 0x52090a5 (0x379f bytes) 2024-09-21T15:07:57.416 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #12, image image_cluster1.client.mirror.3-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent13 2024-09-21T15:07:57.423 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:57.423 INFO:teuthology.orchestra.run.smithi161.stdout:1195 read 0x27253e6 thru 0x2725d10 (0x92b bytes) 2024-09-21T15:07:57.424 INFO:teuthology.orchestra.run.smithi161.stdout:1197 punch from 0x2d91f33 to 0x2d9a75d, (0x882a bytes) 2024-09-21T15:07:57.431 INFO:teuthology.orchestra.run.smithi161.stdout:1198 trunc from 0xded2352 to 0x9f58f0c 2024-09-21T15:07:57.437 INFO:teuthology.orchestra.run.smithi161.stdout:1277 punch from 0x72ef687 to 0x72fafed, (0xb966 bytes) 2024-09-21T15:07:57.441 INFO:teuthology.orchestra.run.smithi161.stdout:1185 write 0x365a82c thru 0x36619e4 (0x71b9 bytes) 2024-09-21T15:07:57.475 INFO:teuthology.orchestra.run.smithi161.stdout:1186 read 0x2cadb12 thru 0x2cb682c (0x8d1b bytes) 2024-09-21T15:07:57.475 INFO:teuthology.orchestra.run.smithi161.stdout:1187 read 0x1767dc5 thru 0x177668c (0xe8c8 bytes) 2024-09-21T15:07:57.481 INFO:teuthology.orchestra.run.smithi161.stdout:1278 trunc from 0x98c53ef to 0xe8f7744 2024-09-21T15:07:57.496 INFO:teuthology.orchestra.run.smithi161.stdout:1885 read 0xa317f59 thru 0xa3252c6 (0xd36e bytes) 2024-09-21T15:07:57.521 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:57.521 INFO:teuthology.orchestra.run.smithi161.stdout:1282 read 0x396cc69 thru 0x396e00a (0x13a2 bytes) 2024-09-21T15:07:57.522 INFO:teuthology.orchestra.run.smithi161.stdout:1283 read 0x640bb18 thru 0x6411a56 (0x5f3f bytes) 2024-09-21T15:07:57.522 INFO:teuthology.orchestra.run.smithi161.stdout:1284 writesame 0xa0909b4 thru 0xa09e7df data_size 0x76(0xde2c bytes) 2024-09-21T15:07:57.599 INFO:teuthology.orchestra.run.smithi161.stdout:1886 read 0x50a9413 thru 0x50ad5ac (0x419a bytes) 2024-09-21T15:07:57.599 INFO:teuthology.orchestra.run.smithi161.stdout:1887 writesame 0xa6517bc thru 0xa65cad4 data_size 0x11(0xb319 bytes) 2024-09-21T15:07:57.600 INFO:teuthology.orchestra.run.smithi161.stdout:1286 trunc from 0xe8f7744 to 0xe76319e 2024-09-21T15:07:57.625 INFO:teuthology.orchestra.run.smithi161.stdout:1199 punch from 0x647767 to 0x64d2d7, (0x5b70 bytes) 2024-09-21T15:07:57.625 INFO:teuthology.orchestra.run.smithi161.stdout:1200 punch from 0x514c8e5 to 0x51595c8, (0xcce3 bytes) 2024-09-21T15:07:57.625 INFO:teuthology.orchestra.run.smithi161.stdout:1201 read 0x5b569fb thru 0x5b63621 (0xcc27 bytes) 2024-09-21T15:07:57.626 INFO:teuthology.orchestra.run.smithi161.stdout:1202 write 0x378922d thru 0x3797840 (0xe614 bytes) 2024-09-21T15:07:57.639 INFO:teuthology.orchestra.run.smithi161.stdout:1203 write 0x35e3c52 thru 0x35f2d26 (0xf0d5 bytes) 2024-09-21T15:07:57.660 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:57.660 INFO:teuthology.orchestra.run.smithi161.stdout:1288 punch from 0x7bd1aba to 0x7be1221, (0xf767 bytes) 2024-09-21T15:07:57.660 INFO:teuthology.orchestra.run.smithi161.stdout:1291 writesame 0x3cd57d0 thru 0x3cdc752 data_size 0x1(0x6f83 bytes) 2024-09-21T15:07:57.665 INFO:teuthology.orchestra.run.smithi161.stdout:1188 write 0x365e780 thru 0x36656e6 (0x6f67 bytes) 2024-09-21T15:07:57.672 INFO:teuthology.orchestra.run.smithi161.stdout:1128 write 0x962c7e6 thru 0x9631e3b (0x5656 bytes) 2024-09-21T15:07:57.685 INFO:teuthology.orchestra.run.smithi161.stdout:1888 write 0xa2b93d thru 0xa31154 (0x5818 bytes) 2024-09-21T15:07:57.694 INFO:teuthology.orchestra.run.smithi161.stdout:1189 punch from 0x13d62f1 to 0x13dbbee, (0x58fd bytes) 2024-09-21T15:07:57.694 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:07:57.694 INFO:teuthology.orchestra.run.smithi161.stdout:1294 read 0x856ce54 thru 0x857a73f (0xd8ec bytes) 2024-09-21T15:07:57.699 INFO:teuthology.orchestra.run.smithi161.stdout:1295 trunc from 0xe76319e to 0xc5cf3ba 2024-09-21T15:07:57.844 INFO:teuthology.orchestra.run.smithi161.stdout:1656 punch from 0x134e83 to 0x135265, (0x3e2 bytes) 2024-09-21T15:07:57.861 INFO:teuthology.orchestra.run.smithi161.stdout:1658 trunc from 0x76b43a5 to 0x95ff1c6 2024-09-21T15:07:58.528 INFO:teuthology.orchestra.run.smithi161.stdout:1204 write 0xd1f6f2f thru 0xd1f8566 (0x1638 bytes) 2024-09-21T15:07:58.541 INFO:teuthology.orchestra.run.smithi161.stdout:1659 writesame 0x2f8ceec thru 0x2f8f383 data_size 0x8(0x2498 bytes) 2024-09-21T15:07:59.785 INFO:teuthology.orchestra.run.smithi161.stdout:1297 write 0x826366 thru 0x8313d6 (0xb071 bytes) 2024-09-21T15:07:59.820 INFO:teuthology.orchestra.run.smithi161.stdout:1190 write 0xe56f743 thru 0xe5791b4 (0x9a72 bytes) 2024-09-21T15:07:59.870 INFO:teuthology.orchestra.run.smithi161.stdout:1205 read 0x3c51ab9 thru 0x3c564bf (0x4a07 bytes) 2024-09-21T15:07:59.871 INFO:teuthology.orchestra.run.smithi161.stdout:1206 read 0x65ee5a5 thru 0x65f927e (0xacda bytes) 2024-09-21T15:07:59.872 INFO:teuthology.orchestra.run.smithi161.stdout:1208 writesame 0x324c2f thru 0x3328e8 data_size 0x13(0xdcba bytes) 2024-09-21T15:07:59.884 INFO:teuthology.orchestra.run.smithi161.stdout:1129 read 0x29c63d4 thru 0x29d5dd0 (0xf9fd bytes) 2024-09-21T15:07:59.884 INFO:teuthology.orchestra.run.smithi161.stdout:1130 writesame 0x208def0 thru 0x2099718 data_size 0x23(0xb829 bytes) 2024-09-21T15:07:59.898 INFO:teuthology.orchestra.run.smithi161.stdout:1660 read 0xcdbd53 thru 0xcdcea5 (0x1153 bytes) 2024-09-21T15:07:59.911 INFO:teuthology.orchestra.run.smithi161.stdout:1661 trunc from 0x95ff1c6 to 0x21922b2 2024-09-21T15:07:59.961 INFO:teuthology.orchestra.run.smithi161.stdout:1300 punch from 0x1d817f2 to 0x1d81cb8, (0x4c6 bytes) 2024-09-21T15:07:59.962 INFO:teuthology.orchestra.run.smithi161.stdout:1301 write 0x82db42f thru 0x82e0e0c (0x59de bytes) 2024-09-21T15:07:59.968 INFO:teuthology.orchestra.run.smithi161.stdout:1192 read 0x87e2fb7 thru 0x87ec01c (0x9066 bytes) 2024-09-21T15:07:59.968 INFO:teuthology.orchestra.run.smithi161.stdout:1195 punch from 0xd11fe1b to 0xd124f36, (0x511b bytes) 2024-09-21T15:07:59.968 INFO:teuthology.orchestra.run.smithi161.stdout:1197 read 0xe5836d thru 0xe63e1c (0xbab0 bytes) 2024-09-21T15:08:00.043 INFO:teuthology.orchestra.run.smithi161.stdout:1889 punch from 0x75a97c9 to 0x75b30ec, (0x9923 bytes) 2024-09-21T15:08:00.043 INFO:teuthology.orchestra.run.smithi161.stdout:1891 writesame 0x231db28 thru 0x232a518 data_size 0x1(0xc9f1 bytes) 2024-09-21T15:08:00.044 INFO:teuthology.orchestra.run.smithi161.stdout:1303 write 0x3dde5aa thru 0x3de61f5 (0x7c4c bytes) 2024-09-21T15:08:00.076 INFO:teuthology.orchestra.run.smithi161.stdout:1304 read 0x532bfa4 thru 0x53382b3 (0xc310 bytes) 2024-09-21T15:08:00.077 INFO:teuthology.orchestra.run.smithi161.stdout:1305 punch from 0xbc677dd to 0xbc6e63c, (0x6e5f bytes) 2024-09-21T15:08:00.077 INFO:teuthology.orchestra.run.smithi161.stdout:1306 write 0x27de695 thru 0x27de7f0 (0x15c bytes) 2024-09-21T15:08:00.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:00.078+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cc7eb2c0 handle_clone_image: failed to clone image mirror/10ae7aede7b6 to image_cluster1.client.mirror.1-clone5 2024-09-21T15:08:00.101 INFO:teuthology.orchestra.run.smithi161.stdout:1131 write 0x457f439 thru 0x45844da (0x50a2 bytes) 2024-09-21T15:08:00.101 INFO:teuthology.orchestra.run.smithi161.stdout:1198 read 0x6b78e9b thru 0x6b7b21b (0x2381 bytes) 2024-09-21T15:08:00.101 INFO:teuthology.orchestra.run.smithi161.stdout:1200 writesame 0xdc13b87 thru 0xdc1fc49 data_size 0x3(0xc0c3 bytes) 2024-09-21T15:08:00.212 INFO:teuthology.orchestra.run.smithi161.stdout:1202 read 0x81dfb thru 0x88530 (0x6736 bytes) 2024-09-21T15:08:00.277 INFO:teuthology.orchestra.run.smithi161.stdout:1203 read 0x72613cb thru 0x7263913 (0x2549 bytes) 2024-09-21T15:08:00.277 INFO:teuthology.orchestra.run.smithi161.stdout:1204 punch from 0x8c3f12 to 0x8cefc5, (0xb0b3 bytes) 2024-09-21T15:08:00.277 INFO:teuthology.orchestra.run.smithi161.stdout:1205 write 0xaf8ff02 thru 0xaf92f7a (0x3079 bytes) 2024-09-21T15:08:00.286 INFO:teuthology.orchestra.run.smithi161.stdout:1308 writesame 0x4b156c2 thru 0x4b2301c data_size 0x1(0xd95b bytes) 2024-09-21T15:08:00.289 INFO:teuthology.orchestra.run.smithi161.stdout:1132 write 0x3818263 thru 0x381d678 (0x5416 bytes) 2024-09-21T15:08:00.304 INFO:teuthology.orchestra.run.smithi161.stdout:1208 trunc from 0xe5791b5 to 0xa87dc1a 2024-09-21T15:08:00.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:00.342+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cd2b5a40 handle_clone_image: failed to clone image mirror/10b51b25f362 to image_cluster1.client.mirror.0-clone6 2024-09-21T15:08:00.350 INFO:teuthology.orchestra.run.smithi161.stdout:1312 read 0x45abede thru 0x45b9f42 (0xe065 bytes) 2024-09-21T15:08:00.401 INFO:teuthology.orchestra.run.smithi161.stdout:1210 read 0x8ff4302 thru 0x8ffe81f (0xa51e bytes) 2024-09-21T15:08:00.404 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:00.404 INFO:teuthology.orchestra.run.smithi161.stdout:1212 write 0x9663e8d thru 0x9667d88 (0x3efc bytes) 2024-09-21T15:08:00.419 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:00.429 INFO:teuthology.orchestra.run.smithi161.stdout:1314 write 0xeb5e87d thru 0xeb6db79 (0xf2fd bytes) 2024-09-21T15:08:00.458 INFO:teuthology.orchestra.run.smithi161.stdout:1315 read 0x52f0dbb thru 0x52f92e2 (0x8528 bytes) 2024-09-21T15:08:00.458 INFO:teuthology.orchestra.run.smithi161.stdout:1316 clone 13 order 25 su 8388608 sc 12 2024-09-21T15:08:00.477 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:00.474+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb356b40 handle_clone_image: failed to clone image mirror/10b6fc5025cb to image_cluster1.client.mirror.4-clone9 2024-09-21T15:08:00.483 INFO:teuthology.orchestra.run.smithi161.stdout:1133 write 0xe3623f8 thru 0xe3624ff (0x108 bytes) 2024-09-21T15:08:00.499 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:00.498+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cc7ea5a0 handle_clone_image: failed to clone image mirror/10b7ea35d911 to image_cluster1.client.mirror.5-clone4 2024-09-21T15:08:00.500 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:00.498+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb356960 handle_clone_image: failed to clone image mirror/10ad2ac9f886 to image_cluster1.client.mirror.2-clone2 2024-09-21T15:08:00.503 INFO:teuthology.orchestra.run.smithi161.stdout:1134 trunc from 0xe362500 to 0xe881224 2024-09-21T15:08:00.506 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:00.506+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb88c780 handle_clone_image: failed to clone image mirror/10b49b3a3009 to image_cluster1.client.mirror.3-clone14 2024-09-21T15:08:00.521 INFO:teuthology.orchestra.run.smithi161.stdout:1214 write 0xc0606d9 thru 0xc0626b0 (0x1fd8 bytes) 2024-09-21T15:08:00.566 INFO:teuthology.orchestra.run.smithi161.stdout:1209 read 0x6848579 thru 0x6853161 (0xabe9 bytes) 2024-09-21T15:08:00.567 INFO:teuthology.orchestra.run.smithi161.stdout:1212 read 0xa252def thru 0xa253b3b (0xd4d bytes) 2024-09-21T15:08:00.568 INFO:teuthology.orchestra.run.smithi161.stdout:1214 write 0x942dff0 thru 0x9431f37 (0x3f48 bytes) 2024-09-21T15:08:00.570 INFO:teuthology.orchestra.run.smithi161.stdout:1135 write 0x8e9f554 thru 0x8ead798 (0xe245 bytes) 2024-09-21T15:08:00.594 INFO:teuthology.orchestra.run.smithi161.stdout:1216 read 0x1049a3c thru 0x104c36f (0x2934 bytes) 2024-09-21T15:08:00.601 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:00.601 INFO:teuthology.orchestra.run.smithi161.stdout:1217 read 0xbb6dd72 thru 0xbb77c01 (0x9e90 bytes) 2024-09-21T15:08:00.601 INFO:teuthology.orchestra.run.smithi161.stdout:1218 read 0xa249717 thru 0xa255038 (0xb922 bytes) 2024-09-21T15:08:00.608 INFO:teuthology.orchestra.run.smithi161.stdout:1137 write 0x1c8cbb1 thru 0x1c90842 (0x3c92 bytes) 2024-09-21T15:08:00.618 INFO:teuthology.orchestra.run.smithi161.stdout:1217 trunc from 0xd1f8567 to 0x57e846d 2024-09-21T15:08:00.620 INFO:teuthology.orchestra.run.smithi161.stdout:1219 trunc from 0xc0626b1 to 0x2a8b732 2024-09-21T15:08:00.621 INFO:teuthology.orchestra.run.smithi161.stdout:1663 writesame 0x75cb282 thru 0x75d3dbc data_size 0x3(0x8b3b bytes) 2024-09-21T15:08:00.623 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:00.623 INFO:teuthology.orchestra.run.smithi161.stdout:1893 write 0x84527a4 thru 0x845672c (0x3f89 bytes) 2024-09-21T15:08:00.628 INFO:teuthology.orchestra.run.smithi161.stdout:1138 write 0x184a231 thru 0x184b33a (0x110a bytes) 2024-09-21T15:08:00.633 INFO:teuthology.orchestra.run.smithi161.stdout:1664 trunc from 0x75d3dbd to 0x983cc85 2024-09-21T15:08:00.644 INFO:teuthology.orchestra.run.smithi161.stdout:1139 write 0xae6c97 thru 0xaf4a79 (0xdde3 bytes) 2024-09-21T15:08:00.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:00.646+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cbb2f0e0 handle_clone_image: failed to clone image mirror/10b53d23b7e6 to image_cluster1.client.mirror.0-clone9 2024-09-21T15:08:00.678 INFO:teuthology.orchestra.run.smithi161.stdout:1894 read 0xad533f2 thru 0xad581cd (0x4ddc bytes) 2024-09-21T15:08:00.678 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:00.688 INFO:teuthology.orchestra.run.smithi161.stdout:1665 punch from 0x5c94413 to 0x5c9b11f, (0x6d0c bytes) 2024-09-21T15:08:00.688 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:00.688 INFO:teuthology.orchestra.run.smithi161.stdout:1668 write 0x65a2571 thru 0x65a2c0c (0x69c bytes) 2024-09-21T15:08:00.689 INFO:teuthology.orchestra.run.smithi161.stdout:1140 punch from 0xc0f7d0d to 0xc1067db, (0xeace bytes) 2024-09-21T15:08:00.689 INFO:teuthology.orchestra.run.smithi161.stdout:1141 read 0x7519763 thru 0x75223e6 (0x8c84 bytes) 2024-09-21T15:08:00.689 INFO:teuthology.orchestra.run.smithi161.stdout:1142 read 0xa0adb54 thru 0xa0b69f2 (0x8e9f bytes) 2024-09-21T15:08:00.690 INFO:teuthology.orchestra.run.smithi161.stdout:1143 write 0x3e6b94 thru 0x3f12d6 (0xa743 bytes) 2024-09-21T15:08:00.695 INFO:teuthology.orchestra.run.smithi161.stdout:1896 trunc from 0xba3cc08 to 0x28c3852 2024-09-21T15:08:00.706 INFO:teuthology.orchestra.run.smithi161.stdout:1221 read 0x11e4a88 thru 0x11f0390 (0xb909 bytes) 2024-09-21T15:08:00.707 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:00.707 INFO:teuthology.orchestra.run.smithi161.stdout:1223 punch from 0x24faed4 to 0x2501b25, (0x6c51 bytes) 2024-09-21T15:08:00.707 INFO:teuthology.orchestra.run.smithi161.stdout:1224 punch from 0x1be2d49 to 0x1be9ae5, (0x6d9c bytes) 2024-09-21T15:08:00.713 INFO:teuthology.orchestra.run.smithi161.stdout:1218 writesame 0x479b16c thru 0x479f226 data_size 0x1(0x40bb bytes) 2024-09-21T15:08:00.716 INFO:teuthology.orchestra.run.smithi161.stdout:1669 trunc from 0x983cc85 to 0x69ead90 2024-09-21T15:08:00.728 INFO:teuthology.orchestra.run.smithi161.stdout:1145 read 0x18888e0 thru 0x188e377 (0x5a98 bytes) 2024-09-21T15:08:00.730 INFO:teuthology.orchestra.run.smithi161.stdout:1146 punch from 0xc4e2419 to 0xc4e6e5d, (0x4a44 bytes) 2024-09-21T15:08:00.730 INFO:teuthology.orchestra.run.smithi161.stdout:1147 read 0xd41cd38 thru 0xd421a58 (0x4d21 bytes) 2024-09-21T15:08:00.730 INFO:teuthology.orchestra.run.smithi161.stdout:1148 read 0xc627506 thru 0xc6337c2 (0xc2bd bytes) 2024-09-21T15:08:00.730 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:00.730 INFO:teuthology.orchestra.run.smithi161.stdout:1150 read 0x592d3fb thru 0x592e972 (0x1578 bytes) 2024-09-21T15:08:00.731 INFO:teuthology.orchestra.run.smithi161.stdout:1151 writesame 0xc732edb thru 0xc73a832 data_size 0x2c(0x7958 bytes) 2024-09-21T15:08:00.777 INFO:teuthology.orchestra.run.smithi161.stdout:1152 write 0xc85cf03 thru 0xc867ae2 (0xabe0 bytes) 2024-09-21T15:08:00.782 INFO:teuthology.orchestra.run.smithi161.stdout:1225 write 0xc6f3e26 thru 0xc6f8132 (0x430d bytes) 2024-09-21T15:08:00.801 INFO:teuthology.orchestra.run.smithi161.stdout:1228 punch from 0x3d987f3 to 0x3d9e17b, (0x5988 bytes) 2024-09-21T15:08:00.802 INFO:teuthology.orchestra.run.smithi161.stdout:1229 punch from 0xb19700c to 0xb19c6f8, (0x56ec bytes) 2024-09-21T15:08:00.811 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone12 from 0xeb6db7a (overlap 0x98c53ef) to 0x4c629f7 2024-09-21T15:08:00.821 INFO:teuthology.orchestra.run.smithi161.stdout:1231 trunc from 0xc6f8133 to 0x40454a2 2024-09-21T15:08:00.876 INFO:teuthology.orchestra.run.smithi161.stdout:1154 writesame 0xd682aac thru 0xd691a92 data_size 0x47(0xefe7 bytes) 2024-09-21T15:08:00.952 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:00.952 INFO:teuthology.orchestra.run.smithi161.stdout:1156 writesame 0x10ca707 thru 0x10d7830 data_size 0x2(0xd12a bytes) 2024-09-21T15:08:01.004 INFO:teuthology.orchestra.run.smithi161.stdout:1232 trunc from 0x40454a2 to 0xe638d49 2024-09-21T15:08:01.013 INFO:teuthology.orchestra.run.smithi161.stdout:1670 read 0x203a0c4 thru 0x20418ef (0x782c bytes) 2024-09-21T15:08:01.016 INFO:teuthology.orchestra.run.smithi161.stdout:1671 punch from 0x1d842e3 to 0x1d893d2, (0x50ef bytes) 2024-09-21T15:08:01.016 INFO:teuthology.orchestra.run.smithi161.stdout:1672 read 0x6919af0 thru 0x69218b3 (0x7dc4 bytes) 2024-09-21T15:08:01.016 INFO:teuthology.orchestra.run.smithi161.stdout:1219 write 0x9316d2b thru 0x9318ff5 (0x22cb bytes) 2024-09-21T15:08:01.034 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.034 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.034 INFO:teuthology.orchestra.run.smithi161.stdout:1227 read 0x3a151b8 thru 0x3a1fea8 (0xacf1 bytes) 2024-09-21T15:08:01.037 INFO:teuthology.orchestra.run.smithi161.stdout:1228 read 0x5d72474 thru 0x5d774ba (0x5047 bytes) 2024-09-21T15:08:01.051 INFO:teuthology.orchestra.run.smithi161.stdout:1230 trunc from 0x9318ff6 to 0x1c79783 2024-09-21T15:08:01.054 INFO:teuthology.orchestra.run.smithi161.stdout:1233 trunc from 0xe638d49 to 0xa9fdf1c 2024-09-21T15:08:01.059 INFO:teuthology.orchestra.run.smithi161.stdout:1673 write 0xba5cdf5 thru 0xba5d083 (0x28f bytes) 2024-09-21T15:08:01.086 INFO:teuthology.orchestra.run.smithi161.stdout:1675 read 0x61442a5 thru 0x6153c14 (0xf970 bytes) 2024-09-21T15:08:01.086 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.089 INFO:teuthology.orchestra.run.smithi161.stdout:1678 trunc from 0xba5d084 to 0xd336988 2024-09-21T15:08:01.108 INFO:teuthology.orchestra.run.smithi161.stdout:1235 trunc from 0xa9fdf1c to 0x56b589b 2024-09-21T15:08:01.108 INFO:teuthology.orchestra.run.smithi161.stdout:1897 write 0xe4be07e thru 0xe4c59f0 (0x7973 bytes) 2024-09-21T15:08:01.135 INFO:teuthology.orchestra.run.smithi161.stdout:1898 writesame 0xce997ef thru 0xcea12ef data_size 0x1(0x7b01 bytes) 2024-09-21T15:08:01.138 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.139 INFO:teuthology.orchestra.run.smithi161.stdout:1231 punch from 0x21abd0 to 0x223de0, (0x9210 bytes) 2024-09-21T15:08:01.139 INFO:teuthology.orchestra.run.smithi161.stdout:1233 read 0x55471b thru 0x554d77 (0x65d bytes) 2024-09-21T15:08:01.141 INFO:teuthology.orchestra.run.smithi161.stdout:1234 punch from 0x29ebb7 to 0x2ad80f, (0xec58 bytes) 2024-09-21T15:08:01.148 INFO:teuthology.orchestra.run.smithi161.stdout:1683 trunc from 0xd336988 to 0x88a0245 2024-09-21T15:08:01.158 INFO:teuthology.orchestra.run.smithi161.stdout:1236 trunc from 0x56b589b to 0x23d2633 2024-09-21T15:08:01.168 INFO:teuthology.orchestra.run.smithi161.stdout:1899 write 0x256b598 thru 0x2570bb2 (0x561b bytes) 2024-09-21T15:08:01.189 INFO:teuthology.orchestra.run.smithi161.stdout:1900 writesame 0x4c316ba thru 0x4c3208b data_size 0x3(0x9d2 bytes) 2024-09-21T15:08:01.204 INFO:teuthology.orchestra.run.smithi161.stdout:1235 writesame 0xd4f05ea thru 0xd4f2910 data_size 0x1(0x2327 bytes) 2024-09-21T15:08:01.215 INFO:teuthology.orchestra.run.smithi161.stdout:1901 read 0x65fe6ac thru 0x660c8ea (0xe23f bytes) 2024-09-21T15:08:01.216 INFO:teuthology.orchestra.run.smithi161.stdout:1902 write 0xd771246 thru 0xd779bc0 (0x897b bytes) 2024-09-21T15:08:01.216 INFO:teuthology.orchestra.run.smithi161.stdout:1237 read 0x1fde913 thru 0x1fed2f6 (0xe9e4 bytes) 2024-09-21T15:08:01.217 INFO:teuthology.orchestra.run.smithi161.stdout:1239 read 0x16e9909 thru 0x16f220c (0x8904 bytes) 2024-09-21T15:08:01.219 INFO:teuthology.orchestra.run.smithi161.stdout:1240 read 0x85b87f thru 0x868ab4 (0xd236 bytes) 2024-09-21T15:08:01.220 INFO:teuthology.orchestra.run.smithi161.stdout:1241 write 0x4231f5 thru 0x42c332 (0x913e bytes) 2024-09-21T15:08:01.220 INFO:teuthology.orchestra.run.smithi161.stdout:1685 read 0x207112b thru 0x207c7d5 (0xb6ab bytes) 2024-09-21T15:08:01.222 INFO:teuthology.orchestra.run.smithi161.stdout:1687 write 0x7fed037 thru 0x7ffba43 (0xea0d bytes) 2024-09-21T15:08:01.234 INFO:teuthology.orchestra.run.smithi161.stdout:1236 trunc from 0xd4f2911 to 0x149ae38 2024-09-21T15:08:01.239 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.239 INFO:teuthology.orchestra.run.smithi161.stdout:1243 read 0x1f74dbf thru 0x1f7d3ee (0x8630 bytes) 2024-09-21T15:08:01.242 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.260 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.260 INFO:teuthology.orchestra.run.smithi161.stdout:1905 punch from 0xc56f004 to 0xc576cac, (0x7ca8 bytes) 2024-09-21T15:08:01.260 INFO:teuthology.orchestra.run.smithi161.stdout:1906 write 0x7656ddf thru 0x7662c6c (0xbe8e bytes) 2024-09-21T15:08:01.279 INFO:teuthology.orchestra.run.smithi161.stdout:1688 trunc from 0x88a0245 to 0x167617a 2024-09-21T15:08:01.290 INFO:teuthology.orchestra.run.smithi161.stdout:1245 writesame 0x2fa59cc thru 0x2fb58c6 data_size 0x23(0xfefb bytes) 2024-09-21T15:08:01.291 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.291 INFO:teuthology.orchestra.run.smithi161.stdout:1910 write 0x5372b6a thru 0x537554a (0x29e1 bytes) 2024-09-21T15:08:01.296 INFO:teuthology.orchestra.run.smithi161.stdout:1237 read 0x127fb4f thru 0x128d6a2 (0xdb54 bytes) 2024-09-21T15:08:01.305 INFO:teuthology.orchestra.run.smithi161.stdout:1246 writesame 0x1d4ffe2 thru 0x1d54686 data_size 0x1(0x46a5 bytes) 2024-09-21T15:08:01.330 INFO:teuthology.orchestra.run.smithi161.stdout:1912 write 0xb0e84b6 thru 0xb0f2257 (0x9da2 bytes) 2024-09-21T15:08:01.363 INFO:teuthology.orchestra.run.smithi161.stdout:1913 punch from 0x3665fef to 0x3668074, (0x2085 bytes) 2024-09-21T15:08:01.363 INFO:teuthology.orchestra.run.smithi161.stdout:1915 read 0x74f6ab1 thru 0x7502536 (0xba86 bytes) 2024-09-21T15:08:01.374 INFO:teuthology.orchestra.run.smithi161.stdout:1238 write 0xc33c9c9 thru 0xc341463 (0x4a9b bytes) 2024-09-21T15:08:01.374 INFO:teuthology.orchestra.run.smithi161.stdout:1916 trunc from 0xe4c59f1 to 0x9192649 2024-09-21T15:08:01.390 INFO:teuthology.orchestra.run.smithi161.stdout:1247 writesame 0xd35a1ad thru 0xd3690c9 data_size 0x1(0xef1d bytes) 2024-09-21T15:08:01.399 INFO:teuthology.orchestra.run.smithi161.stdout:1248 writesame 0x4260336 thru 0x4263ad8 data_size 0x1(0x37a3 bytes) 2024-09-21T15:08:01.412 INFO:teuthology.orchestra.run.smithi161.stdout:1239 read 0x62c24a3 thru 0x62d11f0 (0xed4e bytes) 2024-09-21T15:08:01.412 INFO:teuthology.orchestra.run.smithi161.stdout:1240 read 0xfe33b5 thru 0xfe94cb (0x6117 bytes) 2024-09-21T15:08:01.435 INFO:teuthology.orchestra.run.smithi161.stdout:1250 trunc from 0xd3690ca to 0x719289e 2024-09-21T15:08:01.561 INFO:teuthology.orchestra.run.smithi161.stdout:1918 write 0x34f36c0 thru 0x34f6ec2 (0x3803 bytes) 2024-09-21T15:08:01.566 INFO:teuthology.orchestra.run.smithi161.stdout:1157 read 0xae4ea62 thru 0xae514b2 (0x2a51 bytes) 2024-09-21T15:08:01.566 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.566 INFO:teuthology.orchestra.run.smithi161.stdout:1160 writesame 0x1dbab18 thru 0x1dc8d30 data_size 0x1(0xe219 bytes) 2024-09-21T15:08:01.567 INFO:teuthology.orchestra.run.smithi161.stdout:1241 write 0xd3a7ee9 thru 0xd3adda4 (0x5ebc bytes) 2024-09-21T15:08:01.589 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.589 INFO:teuthology.orchestra.run.smithi161.stdout:1243 read 0x7745470 thru 0x7748d16 (0x38a7 bytes) 2024-09-21T15:08:01.589 INFO:teuthology.orchestra.run.smithi161.stdout:1251 read 0x25b6bb thru 0x26621c (0xab62 bytes) 2024-09-21T15:08:01.590 INFO:teuthology.orchestra.run.smithi161.stdout:1254 read 0x1430662 thru 0x14379de (0x737d bytes) 2024-09-21T15:08:01.591 INFO:teuthology.orchestra.run.smithi161.stdout:1919 trunc from 0x9192649 to 0x6690a17 2024-09-21T15:08:01.592 INFO:teuthology.orchestra.run.smithi161.stdout:1255 read 0x31c89f3 thru 0x31d1b93 (0x91a1 bytes) 2024-09-21T15:08:01.593 INFO:teuthology.orchestra.run.smithi161.stdout:1256 read 0x3bc5a4e thru 0x3bc857c (0x2b2f bytes) 2024-09-21T15:08:01.593 INFO:teuthology.orchestra.run.smithi161.stdout:1257 read 0xcb7ed4 thru 0xcbb315 (0x3442 bytes) 2024-09-21T15:08:01.609 INFO:teuthology.orchestra.run.smithi161.stdout:1244 trunc from 0xd3adda5 to 0x1c691db 2024-09-21T15:08:01.619 INFO:teuthology.orchestra.run.smithi161.stdout:1689 write 0x27c5f63 thru 0x27cd2a9 (0x7347 bytes) 2024-09-21T15:08:01.649 INFO:teuthology.orchestra.run.smithi161.stdout:1920 trunc from 0x6690a17 to 0x204571f 2024-09-21T15:08:01.674 INFO:teuthology.orchestra.run.smithi161.stdout:1690 trunc from 0x27cd2aa to 0xd8451b8 2024-09-21T15:08:01.684 INFO:teuthology.orchestra.run.smithi161.stdout:1245 write 0x223204d thru 0x223d22d (0xb1e1 bytes) 2024-09-21T15:08:01.688 INFO:teuthology.orchestra.run.smithi161.stdout:1921 read 0x1e1ce79 thru 0x1e2543b (0x85c3 bytes) 2024-09-21T15:08:01.696 INFO:teuthology.orchestra.run.smithi161.stdout:1691 writesame 0x6bf33f1 thru 0x6c01055 data_size 0x3(0xdc65 bytes) 2024-09-21T15:08:01.727 INFO:teuthology.orchestra.run.smithi161.stdout:1246 write 0x231bc0e thru 0x231ffe5 (0x43d8 bytes) 2024-09-21T15:08:01.740 INFO:teuthology.orchestra.run.smithi161.stdout:1692 read 0x24610c4 thru 0x2462055 (0xf92 bytes) 2024-09-21T15:08:01.741 INFO:teuthology.orchestra.run.smithi161.stdout:1247 read 0xf2bd86 thru 0xf2f88d (0x3b08 bytes) 2024-09-21T15:08:01.741 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.741 INFO:teuthology.orchestra.run.smithi161.stdout:1248 write 0x3b0b98 thru 0x3b52bf (0x4728 bytes) 2024-09-21T15:08:01.748 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.748 INFO:teuthology.orchestra.run.smithi161.stdout:1251 read 0xc42e86 thru 0xc4c332 (0x94ad bytes) 2024-09-21T15:08:01.749 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.749 INFO:teuthology.orchestra.run.smithi161.stdout:1253 read 0x300068 thru 0x307e3c (0x7dd5 bytes) 2024-09-21T15:08:01.750 INFO:teuthology.orchestra.run.smithi161.stdout:1922 writesame 0xe9293d5 thru 0xe92bec7 data_size 0x1(0x2af3 bytes) 2024-09-21T15:08:01.752 INFO:teuthology.orchestra.run.smithi161.stdout:1923 read 0x46e37b thru 0x47d1a5 (0xee2b bytes) 2024-09-21T15:08:01.753 INFO:teuthology.orchestra.run.smithi161.stdout:1254 trunc from 0x231ffe6 to 0xbe6e52 2024-09-21T15:08:01.757 INFO:teuthology.orchestra.run.smithi161.stdout:1694 trunc from 0xd8451b8 to 0x509ed60 2024-09-21T15:08:01.821 INFO:teuthology.orchestra.run.smithi161.stdout:1255 write 0x23771f5 thru 0x2382ba4 (0xb9b0 bytes) 2024-09-21T15:08:01.826 INFO:teuthology.orchestra.run.smithi161.stdout:1695 trunc from 0x509ed60 to 0xc7cf27b 2024-09-21T15:08:01.850 INFO:teuthology.orchestra.run.smithi161.stdout:1696 writesame 0xb78f6f9 thru 0xb78fb2e data_size 0xe(0x436 bytes) 2024-09-21T15:08:01.863 INFO:teuthology.orchestra.run.smithi161.stdout:1697 punch from 0x2d32b53 to 0x2d387c6, (0x5c73 bytes) 2024-09-21T15:08:01.863 INFO:teuthology.orchestra.run.smithi161.stdout:1698 read 0xa9b21a4 thru 0xa9b5026 (0x2e83 bytes) 2024-09-21T15:08:01.869 INFO:teuthology.orchestra.run.smithi161.stdout:1256 write 0x6add2bc thru 0x6ae5baf (0x88f4 bytes) 2024-09-21T15:08:01.882 INFO:teuthology.orchestra.run.smithi161.stdout:1699 trunc from 0xc7cf27b to 0x317df3a 2024-09-21T15:08:01.888 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #11, image image_cluster1.client.mirror.4-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent12 2024-09-21T15:08:01.891 INFO:teuthology.orchestra.run.smithi161.stdout:1257 trunc from 0x6ae5bb0 to 0x1aae47d 2024-09-21T15:08:01.937 INFO:teuthology.orchestra.run.smithi161.stdout:1700 read 0xa4777c thru 0xa4d2af (0x5b34 bytes) 2024-09-21T15:08:01.938 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:01.944 INFO:teuthology.orchestra.run.smithi161.stdout:1258 read 0x1756a64 thru 0x17591bd (0x275a bytes) 2024-09-21T15:08:01.958 INFO:teuthology.orchestra.run.smithi161.stdout:1703 trunc from 0x317df3a to 0xae5fff6 2024-09-21T15:08:01.962 INFO:teuthology.orchestra.run.smithi161.stdout:1259 trunc from 0x1aae47d to 0x9010e56 2024-09-21T15:08:01.968 INFO:teuthology.orchestra.run.smithi161.stdout:1317 write 0x6a77c26 thru 0x6a81f83 (0xa35e bytes) 2024-09-21T15:08:01.995 INFO:teuthology.orchestra.run.smithi161.stdout:1704 read 0x28d6cb5 thru 0x28e390a (0xcc56 bytes) 2024-09-21T15:08:01.995 INFO:teuthology.orchestra.run.smithi161.stdout:1260 write 0x6ac9328 thru 0x6ad028b (0x6f64 bytes) 2024-09-21T15:08:01.999 INFO:teuthology.orchestra.run.smithi161.stdout:1705 read 0x6fee82b thru 0x6ff0ea8 (0x267e bytes) 2024-09-21T15:08:01.999 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:02.000 INFO:teuthology.orchestra.run.smithi161.stdout:1707 writesame 0x50f36e5 thru 0x5102201 data_size 0x1(0xeb1d bytes) 2024-09-21T15:08:02.027 INFO:teuthology.orchestra.run.smithi161.stdout:1261 write 0x582ce6c thru 0x583bce3 (0xee78 bytes) 2024-09-21T15:08:02.055 INFO:teuthology.orchestra.run.smithi161.stdout:1708 writesame 0x3f0992e thru 0x3f0c884 data_size 0x1(0x2f57 bytes) 2024-09-21T15:08:02.119 INFO:teuthology.orchestra.run.smithi161.stdout:1262 read 0x2dd1e67 thru 0x2ddf04b (0xd1e5 bytes) 2024-09-21T15:08:02.130 INFO:teuthology.orchestra.run.smithi161.stdout:1263 trunc from 0x9010e56 to 0xda98aae 2024-09-21T15:08:02.139 INFO:teuthology.orchestra.run.smithi161.stdout:1709 writesame 0x7996201 thru 0x7999811 data_size 0x1(0x3611 bytes) 2024-09-21T15:08:02.174 INFO:teuthology.orchestra.run.smithi161.stdout:1710 punch from 0x821ec97 to 0x822c4cd, (0xd836 bytes) 2024-09-21T15:08:02.174 INFO:teuthology.orchestra.run.smithi161.stdout:1711 read 0x474f793 thru 0x47550de (0x594c bytes) 2024-09-21T15:08:02.174 INFO:teuthology.orchestra.run.smithi161.stdout:1712 read 0x200e2ac thru 0x201560d (0x7362 bytes) 2024-09-21T15:08:02.175 INFO:teuthology.orchestra.run.smithi161.stdout:1714 punch from 0x712af2e to 0x7138777, (0xd849 bytes) 2024-09-21T15:08:02.175 INFO:teuthology.orchestra.run.smithi161.stdout:1716 read 0x835bd5e thru 0x836a23d (0xe4e0 bytes) 2024-09-21T15:08:02.175 INFO:teuthology.orchestra.run.smithi161.stdout:1717 read 0x9865def thru 0x986863d (0x284f bytes) 2024-09-21T15:08:02.175 INFO:teuthology.orchestra.run.smithi161.stdout:1718 write 0x6766099 thru 0x677007d (0x9fe5 bytes) 2024-09-21T15:08:02.179 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:02.179 INFO:teuthology.orchestra.run.smithi161.stdout:1265 writesame 0xa6f0b15 thru 0xa6f39f4 data_size 0x14(0x2ee0 bytes) 2024-09-21T15:08:02.190 INFO:teuthology.orchestra.run.smithi161.stdout:1266 write 0x54c5c94 thru 0x54cc931 (0x6c9e bytes) 2024-09-21T15:08:02.203 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:02.204 INFO:teuthology.orchestra.run.smithi161.stdout:1269 write 0x1403585 thru 0x1405ccb (0x2747 bytes) 2024-09-21T15:08:02.215 INFO:teuthology.orchestra.run.smithi161.stdout:1270 punch from 0xd4474fe to 0xd44f7f5, (0x82f7 bytes) 2024-09-21T15:08:02.216 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:02.216 INFO:teuthology.orchestra.run.smithi161.stdout:1272 write 0x6855a9 thru 0x69491f (0xf377 bytes) 2024-09-21T15:08:02.250 INFO:teuthology.orchestra.run.smithi161.stdout:1273 write 0xe20306c thru 0xe206029 (0x2fbe bytes) 2024-09-21T15:08:02.262 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:02.262 INFO:teuthology.orchestra.run.smithi161.stdout:1277 writesame 0x65a8105 thru 0x65b7f0f data_size 0x1(0xfe0b bytes) 2024-09-21T15:08:02.321 INFO:teuthology.orchestra.run.smithi161.stdout:1278 read 0xd3eadc4 thru 0xd3ef336 (0x4573 bytes) 2024-09-21T15:08:02.321 INFO:teuthology.orchestra.run.smithi161.stdout:1279 read 0x6a47037 thru 0x6a49c92 (0x2c5c bytes) 2024-09-21T15:08:02.323 INFO:teuthology.orchestra.run.smithi161.stdout:1280 writesame 0x3617b89 thru 0x3626920 data_size 0x4(0xed98 bytes) 2024-09-21T15:08:02.334 INFO:teuthology.orchestra.run.smithi161.stdout:1318 write 0x1bdcbac thru 0x1bdfb6f (0x2fc4 bytes) 2024-09-21T15:08:02.337 INFO:teuthology.orchestra.run.smithi161.stdout:1282 write 0x802f530 thru 0x803120d (0x1cde bytes) 2024-09-21T15:08:02.343 INFO:teuthology.orchestra.run.smithi161.stdout:1283 write 0x11fd323 thru 0x1202aa4 (0x5782 bytes) 2024-09-21T15:08:02.392 INFO:teuthology.orchestra.run.smithi161.stdout:1289 read 0x85fc8b7 thru 0x86015ef (0x4d39 bytes) 2024-09-21T15:08:02.393 INFO:teuthology.orchestra.run.smithi161.stdout:1290 write 0x73af278 thru 0x73b1064 (0x1ded bytes) 2024-09-21T15:08:02.398 INFO:teuthology.orchestra.run.smithi161.stdout:1291 writesame 0x27088df thru 0x2709d76 data_size 0x4(0x1498 bytes) 2024-09-21T15:08:02.437 INFO:teuthology.orchestra.run.smithi161.stdout:1292 read 0xce3a9bb thru 0xce3d0ed (0x2733 bytes) 2024-09-21T15:08:02.461 INFO:teuthology.orchestra.run.smithi161.stdout:1293 writesame 0x3ee020b thru 0x3ee600c data_size 0x2(0x5e02 bytes) 2024-09-21T15:08:02.461 INFO:teuthology.orchestra.run.smithi161.stdout:1294 read 0xc865633 thru 0xc86fb9b (0xa569 bytes) 2024-09-21T15:08:02.461 INFO:teuthology.orchestra.run.smithi161.stdout:1296 punch from 0xdd34952 to 0xdd3a875, (0x5f23 bytes) 2024-09-21T15:08:02.461 INFO:teuthology.orchestra.run.smithi161.stdout:1297 read 0x59201c9 thru 0x592634f (0x6187 bytes) 2024-09-21T15:08:02.462 INFO:teuthology.orchestra.run.smithi161.stdout:1299 writesame 0xac87980 thru 0xac8f7b3 data_size 0x4(0x7e34 bytes) 2024-09-21T15:08:02.470 INFO:teuthology.orchestra.run.smithi161.stdout:1303 read 0xa7d9e74 thru 0xa7e336f (0x94fc bytes) 2024-09-21T15:08:02.472 INFO:teuthology.orchestra.run.smithi161.stdout:1304 read 0x5854dde thru 0x58606cc (0xb8ef bytes) 2024-09-21T15:08:02.472 INFO:teuthology.orchestra.run.smithi161.stdout:1305 write 0x1e463e9 thru 0x1e556e3 (0xf2fb bytes) 2024-09-21T15:08:02.482 INFO:teuthology.orchestra.run.smithi161.stdout:1310 punch from 0xfa7b8b to 0xfb600c, (0xe481 bytes) 2024-09-21T15:08:02.503 INFO:teuthology.orchestra.run.smithi161.stdout:1311 trunc from 0xe20602a to 0x2220e1d 2024-09-21T15:08:02.565 INFO:teuthology.orchestra.run.smithi161.stdout:1924 punch from 0xd73efb0 to 0xd74c5b0, (0xd600 bytes) 2024-09-21T15:08:02.565 INFO:teuthology.orchestra.run.smithi161.stdout:1926 write 0xbcdd18d thru 0xbce01b2 (0x3026 bytes) 2024-09-21T15:08:02.566 INFO:teuthology.orchestra.run.smithi161.stdout:1259 trunc from 0x719289e to 0xbc9d142 2024-09-21T15:08:02.582 INFO:teuthology.orchestra.run.smithi161.stdout:1719 read 0x9c9e32d thru 0x9ca018c (0x1e60 bytes) 2024-09-21T15:08:02.582 INFO:teuthology.orchestra.run.smithi161.stdout:1721 read 0xa6ad636 thru 0xa6b3c65 (0x6630 bytes) 2024-09-21T15:08:02.583 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:02.583 INFO:teuthology.orchestra.run.smithi161.stdout:1723 write 0x2cce916 thru 0x2cd690e (0x7ff9 bytes) 2024-09-21T15:08:02.615 INFO:teuthology.orchestra.run.smithi161.stdout:1161 punch from 0xc6e466b to 0xc6e59c0, (0x1355 bytes) 2024-09-21T15:08:02.615 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:02.615 INFO:teuthology.orchestra.run.smithi161.stdout:1163 punch from 0x5596dca to 0x55a1f50, (0xb186 bytes) 2024-09-21T15:08:02.615 INFO:teuthology.orchestra.run.smithi161.stdout:1164 read 0x1153696 thru 0x115f677 (0xbfe2 bytes) 2024-09-21T15:08:02.615 INFO:teuthology.orchestra.run.smithi161.stdout:1927 writesame 0x98bab0 thru 0x999a1d data_size 0x3(0xdf6e bytes) 2024-09-21T15:08:02.616 INFO:teuthology.orchestra.run.smithi161.stdout:1167 write 0xe620c79 thru 0xe621c0e (0xf96 bytes) 2024-09-21T15:08:02.643 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:02.647 INFO:teuthology.orchestra.run.smithi161.stdout:1168 read 0xc4113cf thru 0xc4203f2 (0xf024 bytes) 2024-09-21T15:08:02.647 INFO:teuthology.orchestra.run.smithi161.stdout:1170 writesame 0xa33427d thru 0xa33814c data_size 0x14(0x3ed0 bytes) 2024-09-21T15:08:02.650 INFO:teuthology.orchestra.run.smithi161.stdout:1261 write 0x1a3e16a thru 0x1a4c42e (0xe2c5 bytes) 2024-09-21T15:08:02.680 INFO:teuthology.orchestra.run.smithi161.stdout:1319 punch from 0x63cc669 to 0x63ce675, (0x200c bytes) 2024-09-21T15:08:02.695 INFO:teuthology.orchestra.run.smithi161.stdout:1315 write 0x4e47409 thru 0x4e51138 (0x9d30 bytes) 2024-09-21T15:08:02.698 INFO:teuthology.orchestra.run.smithi161.stdout:1320 trunc from 0xeb6db7a to 0x556061d 2024-09-21T15:08:02.698 INFO:teuthology.orchestra.run.smithi161.stdout:1262 trunc from 0xbc9d142 to 0x3444b41 2024-09-21T15:08:02.730 INFO:teuthology.orchestra.run.smithi161.stdout:1171 writesame 0x9450e5b thru 0x94513e9 data_size 0x1(0x58f bytes) 2024-09-21T15:08:02.794 INFO:teuthology.orchestra.run.smithi161.stdout:1724 write 0xe444d18 thru 0xe452c38 (0xdf21 bytes) 2024-09-21T15:08:02.832 INFO:teuthology.orchestra.run.smithi161.stdout:1316 write 0xa039c3d thru 0xa041868 (0x7c2c bytes) 2024-09-21T15:08:02.866 INFO:teuthology.orchestra.run.smithi161.stdout:1172 read 0x8c3fe68 thru 0x8c4a3a7 (0xa540 bytes) 2024-09-21T15:08:02.866 INFO:teuthology.orchestra.run.smithi161.stdout:1173 read 0x93a919c thru 0x93acf9a (0x3dff bytes) 2024-09-21T15:08:02.883 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:02.883 INFO:teuthology.orchestra.run.smithi161.stdout:1175 writesame 0x88675d0 thru 0x88704ae data_size 0x5f(0x8edf bytes) 2024-09-21T15:08:02.936 INFO:teuthology.orchestra.run.smithi161.stdout:1726 trunc from 0xe452c39 to 0x2884b26 2024-09-21T15:08:02.956 INFO:teuthology.orchestra.run.smithi161.stdout:1263 trunc from 0x3444b41 to 0x976e854 2024-09-21T15:08:02.982 INFO:teuthology.orchestra.run.smithi161.stdout:1318 read 0x2a76780 thru 0x2a7b6a6 (0x4f27 bytes) 2024-09-21T15:08:03.007 INFO:teuthology.orchestra.run.smithi161.stdout:1179 trunc from 0xe881224 to 0x42bacbd 2024-09-21T15:08:03.008 INFO:teuthology.orchestra.run.smithi161.stdout:1324 trunc from 0xa041869 to 0x524580b 2024-09-21T15:08:03.123 INFO:teuthology.orchestra.run.smithi161.stdout:1265 punch from 0x3ad23e3 to 0x3ade2db, (0xbef8 bytes) 2024-09-21T15:08:03.257 INFO:teuthology.orchestra.run.smithi161.stdout:1928 write 0xddd7edc thru 0xdddd88f (0x59b4 bytes) 2024-09-21T15:08:03.271 INFO:teuthology.orchestra.run.smithi161.stdout:1727 write 0x50bb0a5 thru 0x50c0f87 (0x5ee3 bytes) 2024-09-21T15:08:03.346 INFO:teuthology.orchestra.run.smithi161.stdout:1728 trunc from 0x50c0f88 to 0x41801d7 2024-09-21T15:08:03.363 INFO:teuthology.orchestra.run.smithi161.stdout:1325 writesame 0xed03a1e thru 0xed04611 data_size 0x12(0xbf4 bytes) 2024-09-21T15:08:03.365 INFO:teuthology.orchestra.run.smithi161.stdout:1182 read 0x16c9a05 thru 0x16d9279 (0xf875 bytes) 2024-09-21T15:08:03.367 INFO:teuthology.orchestra.run.smithi161.stdout:1183 read 0x342fd49 thru 0x343d411 (0xd6c9 bytes) 2024-09-21T15:08:03.368 INFO:teuthology.orchestra.run.smithi161.stdout:1184 read 0x67cb65 thru 0x689950 (0xcdec bytes) 2024-09-21T15:08:03.368 INFO:teuthology.orchestra.run.smithi161.stdout:1186 punch from 0x3e9e468 to 0x3ea9316, (0xaeae bytes) 2024-09-21T15:08:03.368 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:03.368 INFO:teuthology.orchestra.run.smithi161.stdout:1188 read 0x256abb6 thru 0x2572924 (0x7d6f bytes) 2024-09-21T15:08:03.369 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:03.369 INFO:teuthology.orchestra.run.smithi161.stdout:1327 write 0x97f33fe thru 0x97fd42a (0xa02d bytes) 2024-09-21T15:08:03.373 INFO:teuthology.orchestra.run.smithi161.stdout:1189 trunc from 0x42bacbd to 0x63ab9f6 2024-09-21T15:08:03.373 INFO:teuthology.orchestra.run.smithi161.stdout:1929 punch from 0x9496095 to 0x94a5eeb, (0xfe56 bytes) 2024-09-21T15:08:03.373 INFO:teuthology.orchestra.run.smithi161.stdout:1930 read 0x483f916 thru 0x4847ac1 (0x81ac bytes) 2024-09-21T15:08:03.378 INFO:teuthology.orchestra.run.smithi161.stdout:1329 write 0xc9fe065 thru 0xca0b8a0 (0xd83c bytes) 2024-09-21T15:08:03.383 INFO:teuthology.orchestra.run.smithi161.stdout:1931 trunc from 0xe92bec8 to 0x8ac1370 2024-09-21T15:08:03.387 INFO:teuthology.orchestra.run.smithi161.stdout:1330 write 0xe40f9b7 thru 0xe41d094 (0xd6de bytes) 2024-09-21T15:08:03.395 INFO:teuthology.orchestra.run.smithi161.stdout:1730 read 0x140ce06 thru 0x140dde2 (0xfdd bytes) 2024-09-21T15:08:03.396 INFO:teuthology.orchestra.run.smithi161.stdout:1731 read 0xbccdbd thru 0xbdbb72 (0xedb6 bytes) 2024-09-21T15:08:03.396 INFO:teuthology.orchestra.run.smithi161.stdout:1733 punch from 0x4aa818 to 0x4b774a, (0xcf32 bytes) 2024-09-21T15:08:03.397 INFO:teuthology.orchestra.run.smithi161.stdout:1734 punch from 0x2da3074 to 0x2dae2a6, (0xb232 bytes) 2024-09-21T15:08:03.401 INFO:teuthology.orchestra.run.smithi161.stdout:1190 trunc from 0x63ab9f6 to 0xadf4d80 2024-09-21T15:08:03.409 INFO:teuthology.orchestra.run.smithi161.stdout:1331 read 0x4769fde thru 0x4773aec (0x9b0f bytes) 2024-09-21T15:08:03.421 INFO:teuthology.orchestra.run.smithi161.stdout:1333 trunc from 0xed04612 to 0x7e6f020 2024-09-21T15:08:03.434 INFO:teuthology.orchestra.run.smithi161.stdout:1191 writesame 0x8d8deb6 thru 0x8d92197 data_size 0x7(0x42e2 bytes) 2024-09-21T15:08:03.438 INFO:teuthology.orchestra.run.smithi161.stdout:1932 read 0x19e9db5 thru 0x19f902a (0xf276 bytes) 2024-09-21T15:08:03.441 INFO:teuthology.orchestra.run.smithi161.stdout:1933 punch from 0x2232dff to 0x2234df4, (0x1ff5 bytes) 2024-09-21T15:08:03.448 INFO:teuthology.orchestra.run.smithi161.stdout:1934 trunc from 0x8ac1370 to 0xbf1f908 2024-09-21T15:08:03.452 INFO:teuthology.orchestra.run.smithi161.stdout:1736 write 0xddb6937 thru 0xddc4afb (0xe1c5 bytes) 2024-09-21T15:08:03.488 INFO:teuthology.orchestra.run.smithi161.stdout:1935 clone 10 order 24 su 524288 sc 3 2024-09-21T15:08:03.490 INFO:teuthology.orchestra.run.smithi161.stdout:1334 trunc from 0x7e6f020 to 0x71dabbf 2024-09-21T15:08:03.492 INFO:teuthology.orchestra.run.smithi161.stdout:1737 read 0x702dac5 thru 0x703c99b (0xeed7 bytes) 2024-09-21T15:08:03.493 INFO:teuthology.orchestra.run.smithi161.stdout:1738 write 0x282ede2 thru 0x283ad3f (0xbf5e bytes) 2024-09-21T15:08:03.504 INFO:teuthology.orchestra.run.smithi161.stdout:1739 writesame 0xbf9e6dd thru 0xbfa1ff0 data_size 0x1a(0x3914 bytes) 2024-09-21T15:08:03.506 INFO:teuthology.orchestra.run.smithi161.stdout:1192 write 0xc692214 thru 0xc69dcbf (0xbaac bytes) 2024-09-21T15:08:03.525 INFO:teuthology.orchestra.run.smithi161.stdout:1193 read 0x91ae7cf thru 0x91b07f0 (0x2022 bytes) 2024-09-21T15:08:03.525 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:03.525 INFO:teuthology.orchestra.run.smithi161.stdout:1198 punch from 0x69327f4 to 0x6938fcf, (0x67db bytes) 2024-09-21T15:08:03.525 INFO:teuthology.orchestra.run.smithi161.stdout:1199 write 0x23235c3 thru 0x23297a6 (0x61e4 bytes) 2024-09-21T15:08:03.548 INFO:teuthology.orchestra.run.smithi161.stdout:1741 trunc from 0xddc4afc to 0x400944f 2024-09-21T15:08:03.570 INFO:teuthology.orchestra.run.smithi161.stdout:1335 write 0xaef0d5d thru 0xaf005e9 (0xf88d bytes) 2024-09-21T15:08:03.581 INFO:teuthology.orchestra.run.smithi161.stdout:1266 writesame 0x8298c6a thru 0x82998d9 data_size 0x8(0xc70 bytes) 2024-09-21T15:08:03.591 INFO:teuthology.orchestra.run.smithi161.stdout:1336 write 0xaeae53b thru 0xaeb905c (0xab22 bytes) 2024-09-21T15:08:03.635 INFO:teuthology.orchestra.run.smithi161.stdout:1338 trunc from 0xaf005ea to 0x3428125 2024-09-21T15:08:03.641 INFO:teuthology.orchestra.run.smithi161.stdout:1200 writesame 0xca7971e thru 0xca8745d data_size 0x30(0xdd40 bytes) 2024-09-21T15:08:03.663 INFO:teuthology.orchestra.run.smithi161.stdout:1742 writesame 0x69e358 thru 0x6a33d3 data_size 0x44(0x507c bytes) 2024-09-21T15:08:03.732 INFO:teuthology.orchestra.run.smithi161.stdout:1268 writesame 0xd8d4ca9 thru 0xd8e4365 data_size 0x5(0xf6bd bytes) 2024-09-21T15:08:03.740 INFO:teuthology.orchestra.run.smithi161.stdout:1269 read 0xcf2eb88 thru 0xcf33128 (0x45a1 bytes) 2024-09-21T15:08:03.741 INFO:teuthology.orchestra.run.smithi161.stdout:1271 write 0x4b25f64 thru 0x4b2a5c2 (0x465f bytes) 2024-09-21T15:08:03.771 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:03.771 INFO:teuthology.orchestra.run.smithi161.stdout:1275 writesame 0xb00a602 thru 0xb00cbb2 data_size 0x1(0x25b1 bytes) 2024-09-21T15:08:03.831 INFO:teuthology.orchestra.run.smithi161.stdout:1277 read 0xafb2cc9 thru 0xafb9325 (0x665d bytes) 2024-09-21T15:08:03.832 INFO:teuthology.orchestra.run.smithi161.stdout:1278 punch from 0x7e8b90b to 0x7e8c812, (0xf07 bytes) 2024-09-21T15:08:03.833 INFO:teuthology.orchestra.run.smithi161.stdout:1279 read 0x1979ea5 thru 0x197b0cb (0x1227 bytes) 2024-09-21T15:08:03.837 INFO:teuthology.orchestra.run.smithi161.stdout:1282 read 0x19a46eb thru 0x19b2b8a (0xe4a0 bytes) 2024-09-21T15:08:03.846 INFO:teuthology.orchestra.run.smithi161.stdout:1283 punch from 0xd2a58ea to 0xd2aec3c, (0x9352 bytes) 2024-09-21T15:08:03.847 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:03.848 INFO:teuthology.orchestra.run.smithi161.stdout:1201 write 0xd62d530 thru 0xd6319ed (0x44be bytes) 2024-09-21T15:08:03.858 INFO:teuthology.orchestra.run.smithi161.stdout:1322 write 0x71c900 thru 0x71c94b (0x4c bytes) 2024-09-21T15:08:03.863 INFO:teuthology.orchestra.run.smithi161.stdout:1286 trunc from 0xd8e4366 to 0x8d28eab 2024-09-21T15:08:03.870 INFO:teuthology.orchestra.run.smithi161.stdout:1339 write 0xccb2b05 thru 0xccb8978 (0x5e74 bytes) 2024-09-21T15:08:03.871 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:03.871 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:03.871 INFO:teuthology.orchestra.run.smithi161.stdout:1326 read 0x3ab5684 thru 0x3ab9c96 (0x4613 bytes) 2024-09-21T15:08:03.881 INFO:teuthology.orchestra.run.smithi161.stdout:1202 trunc from 0xd6319ee to 0x609a487 2024-09-21T15:08:03.896 INFO:teuthology.orchestra.run.smithi161.stdout:1341 write 0xba9b3f4 thru 0xba9d9a5 (0x25b2 bytes) 2024-09-21T15:08:03.897 INFO:teuthology.orchestra.run.smithi161.stdout:1743 read 0x13deb23 thru 0x13e7664 (0x8b42 bytes) 2024-09-21T15:08:03.898 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:03.898 INFO:teuthology.orchestra.run.smithi161.stdout:1746 read 0x1a5b668 thru 0x1a688d8 (0xd271 bytes) 2024-09-21T15:08:03.898 INFO:teuthology.orchestra.run.smithi161.stdout:1747 read 0x4644e8 thru 0x46bd0b (0x7824 bytes) 2024-09-21T15:08:03.901 INFO:teuthology.orchestra.run.smithi161.stdout:1748 write 0x172fdc5 thru 0x17316f9 (0x1935 bytes) 2024-09-21T15:08:03.917 INFO:teuthology.orchestra.run.smithi161.stdout:1343 read 0x92e89a1 thru 0x92ec4bc (0x3b1c bytes) 2024-09-21T15:08:03.918 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:03.918 INFO:teuthology.orchestra.run.smithi161.stdout:1751 punch from 0x14d6b00 to 0x14e06fc, (0x9bfc bytes) 2024-09-21T15:08:03.918 INFO:teuthology.orchestra.run.smithi161.stdout:1752 read 0x34a5391 thru 0x34b0baf (0xb81f bytes) 2024-09-21T15:08:03.919 INFO:teuthology.orchestra.run.smithi161.stdout:1345 punch from 0xddcc31 to 0xdde547, (0x1916 bytes) 2024-09-21T15:08:03.919 INFO:teuthology.orchestra.run.smithi161.stdout:1346 write 0xbca4300 thru 0xbca5da4 (0x1aa5 bytes) 2024-09-21T15:08:03.920 INFO:teuthology.orchestra.run.smithi161.stdout:1753 punch from 0x5b7da6 to 0x5c22f9, (0xa553 bytes) 2024-09-21T15:08:03.920 INFO:teuthology.orchestra.run.smithi161.stdout:1756 punch from 0x32623e5 to 0x326c80f, (0xa42a bytes) 2024-09-21T15:08:03.920 INFO:teuthology.orchestra.run.smithi161.stdout:1757 punch from 0x2c52405 to 0x2c58e84, (0x6a7f bytes) 2024-09-21T15:08:03.920 INFO:teuthology.orchestra.run.smithi161.stdout:1758 punch from 0x15e73c1 to 0x15f463c, (0xd27b bytes) 2024-09-21T15:08:03.920 INFO:teuthology.orchestra.run.smithi161.stdout:1759 punch from 0x26762e2 to 0x267c541, (0x625f bytes) 2024-09-21T15:08:03.920 INFO:teuthology.orchestra.run.smithi161.stdout:1760 punch from 0x39ebd84 to 0x39eeb6e, (0x2dea bytes) 2024-09-21T15:08:03.921 INFO:teuthology.orchestra.run.smithi161.stdout:1287 read 0x40f9aaa thru 0x41080dc (0xe633 bytes) 2024-09-21T15:08:03.921 INFO:teuthology.orchestra.run.smithi161.stdout:1294 punch from 0x3cec0f8 to 0x3cf2413, (0x631b bytes) 2024-09-21T15:08:03.921 INFO:teuthology.orchestra.run.smithi161.stdout:1296 read 0xd0e313 thru 0xd14192 (0x5e80 bytes) 2024-09-21T15:08:03.921 INFO:teuthology.orchestra.run.smithi161.stdout:1297 punch from 0x45d17be to 0x45d7931, (0x6173 bytes) 2024-09-21T15:08:03.922 INFO:teuthology.orchestra.run.smithi161.stdout:1298 read 0x896bd82 thru 0x8972321 (0x65a0 bytes) 2024-09-21T15:08:03.922 INFO:teuthology.orchestra.run.smithi161.stdout:1299 write 0x407743a thru 0x4082261 (0xae28 bytes) 2024-09-21T15:08:03.929 INFO:teuthology.orchestra.run.smithi161.stdout:1347 read 0xa9e1238 thru 0xa9ef045 (0xde0e bytes) 2024-09-21T15:08:03.930 INFO:teuthology.orchestra.run.smithi161.stdout:1327 write 0xa743799 thru 0xa74fcb4 (0xc51c bytes) 2024-09-21T15:08:03.946 INFO:teuthology.orchestra.run.smithi161.stdout:1300 write 0x8166a2a thru 0x817448e (0xda65 bytes) 2024-09-21T15:08:03.965 INFO:teuthology.orchestra.run.smithi161.stdout:1302 write 0xcdbf43 thru 0xce61fb (0xa2b9 bytes) 2024-09-21T15:08:03.970 INFO:teuthology.orchestra.run.smithi161.stdout:1762 write 0x7af338f thru 0x7afab9e (0x7810 bytes) 2024-09-21T15:08:03.972 INFO:teuthology.orchestra.run.smithi161.stdout:1348 write 0xd989d42 thru 0xd9918f4 (0x7bb3 bytes) 2024-09-21T15:08:03.974 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:03.974 INFO:teuthology.orchestra.run.smithi161.stdout:1305 read 0x68bf144 thru 0x68cc747 (0xd604 bytes) 2024-09-21T15:08:03.975 INFO:teuthology.orchestra.run.smithi161.stdout:1306 read 0x1508ffb thru 0x15127ed (0x97f3 bytes) 2024-09-21T15:08:03.975 INFO:teuthology.orchestra.run.smithi161.stdout:1307 read 0x470c8e4 thru 0x471b7dd (0xeefa bytes) 2024-09-21T15:08:03.986 INFO:teuthology.orchestra.run.smithi161.stdout:1203 writesame 0xd373032 thru 0xd37be70 data_size 0x1(0x8e3f bytes) 2024-09-21T15:08:03.987 INFO:teuthology.orchestra.run.smithi161.stdout:1328 writesame 0xbf4b72c thru 0xbf4d707 data_size 0x2(0x1fdc bytes) 2024-09-21T15:08:03.991 INFO:teuthology.orchestra.run.smithi161.stdout:1329 writesame 0x3dfeecc thru 0x3e0d45e data_size 0x1(0xe593 bytes) 2024-09-21T15:08:03.991 INFO:teuthology.orchestra.run.smithi161.stdout:1204 punch from 0x1412986 to 0x1422335, (0xf9af bytes) 2024-09-21T15:08:03.991 INFO:teuthology.orchestra.run.smithi161.stdout:1205 read 0x1145d63 thru 0x11514f4 (0xb792 bytes) 2024-09-21T15:08:03.992 INFO:teuthology.orchestra.run.smithi161.stdout:1206 punch from 0x82fa871 to 0x8301632, (0x6dc1 bytes) 2024-09-21T15:08:03.993 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:03.998 INFO:teuthology.orchestra.run.smithi161.stdout:1209 trunc from 0xd37be71 to 0x9e1aa69 2024-09-21T15:08:04.029 INFO:teuthology.orchestra.run.smithi161.stdout:1350 write 0xe5ed67c thru 0xe5faf21 (0xd8a6 bytes) 2024-09-21T15:08:04.037 INFO:teuthology.orchestra.run.smithi161.stdout:1330 write 0x3a13054 thru 0x3a1e3e8 (0xb395 bytes) 2024-09-21T15:08:04.041 INFO:teuthology.orchestra.run.smithi161.stdout:1764 read 0x292cf7 thru 0x29f02e (0xc338 bytes) 2024-09-21T15:08:04.046 INFO:teuthology.orchestra.run.smithi161.stdout:1210 read 0x76865a3 thru 0x7693b64 (0xd5c2 bytes) 2024-09-21T15:08:04.046 INFO:teuthology.orchestra.run.smithi161.stdout:1212 read 0x80eb28a thru 0x80fa6c5 (0xf43c bytes) 2024-09-21T15:08:04.048 INFO:teuthology.orchestra.run.smithi161.stdout:1765 write 0x11df535 thru 0x11edc04 (0xe6d0 bytes) 2024-09-21T15:08:04.051 INFO:teuthology.orchestra.run.smithi161.stdout:1213 trunc from 0x9e1aa69 to 0xb8c9c65 2024-09-21T15:08:04.054 INFO:teuthology.orchestra.run.smithi161.stdout:1331 read 0x41c914b thru 0x41d43d0 (0xb286 bytes) 2024-09-21T15:08:04.055 INFO:teuthology.orchestra.run.smithi161.stdout:1332 read 0x9075fec thru 0x9076d39 (0xd4e bytes) 2024-09-21T15:08:04.056 INFO:teuthology.orchestra.run.smithi161.stdout:1308 write 0xebdfd07 thru 0xebedef2 (0xe1ec bytes) 2024-09-21T15:08:04.056 INFO:teuthology.orchestra.run.smithi161.stdout:1333 write 0xb40bccf thru 0xb40fcfa (0x402c bytes) 2024-09-21T15:08:04.064 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone9 from 0xbf1f908 (overlap 0x204571f) to 0xce893f 2024-09-21T15:08:04.080 INFO:teuthology.orchestra.run.smithi161.stdout:1310 write 0x16eed06 thru 0x16f7028 (0x8323 bytes) 2024-09-21T15:08:04.094 INFO:teuthology.orchestra.run.smithi161.stdout:1214 punch from 0x80a79ab to 0x80af36e, (0x79c3 bytes) 2024-09-21T15:08:04.101 INFO:teuthology.orchestra.run.smithi161.stdout:1311 write 0xcfe96bf thru 0xcfec355 (0x2c97 bytes) 2024-09-21T15:08:04.112 INFO:teuthology.orchestra.run.smithi161.stdout:1216 trunc from 0xb8c9c65 to 0x2bb273a 2024-09-21T15:08:04.123 INFO:teuthology.orchestra.run.smithi161.stdout:1313 trunc from 0xebedef3 to 0x788858c 2024-09-21T15:08:04.131 INFO:teuthology.orchestra.run.smithi161.stdout:1337 writesame 0xc813bfd thru 0xc81b939 data_size 0x1(0x7d3d bytes) 2024-09-21T15:08:04.137 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.137 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.165 INFO:teuthology.orchestra.run.smithi161.stdout:1351 writesame 0xe86f23f thru 0xe87771c data_size 0x3(0x84de bytes) 2024-09-21T15:08:04.171 INFO:teuthology.orchestra.run.smithi161.stdout:1343 writesame 0xe8370f7 thru 0xe844924 data_size 0x76(0xd82e bytes) 2024-09-21T15:08:04.176 INFO:teuthology.orchestra.run.smithi161.stdout:1344 read 0x4616085 thru 0x461a8fa (0x4876 bytes) 2024-09-21T15:08:04.176 INFO:teuthology.orchestra.run.smithi161.stdout:1352 write 0x5afbcab thru 0x5b093ef (0xd745 bytes) 2024-09-21T15:08:04.176 INFO:teuthology.orchestra.run.smithi161.stdout:1345 write 0x3f59b9d thru 0x3f68567 (0xe9cb bytes) 2024-09-21T15:08:04.191 INFO:teuthology.orchestra.run.smithi161.stdout:1346 write 0x3101fd3 thru 0x310c285 (0xa2b3 bytes) 2024-09-21T15:08:04.206 INFO:teuthology.orchestra.run.smithi161.stdout:1347 read 0x7dd0d77 thru 0x7dde472 (0xd6fc bytes) 2024-09-21T15:08:04.206 INFO:teuthology.orchestra.run.smithi161.stdout:1348 writesame 0x8f82168 thru 0x8f8b115 data_size 0x35(0x8fae bytes) 2024-09-21T15:08:04.206 INFO:teuthology.orchestra.run.smithi161.stdout:1766 writesame 0x217325 thru 0x218fa9 data_size 0x7(0x1c85 bytes) 2024-09-21T15:08:04.219 INFO:teuthology.orchestra.run.smithi161.stdout:1349 write 0x492cd30 thru 0x4933b0d (0x6dde bytes) 2024-09-21T15:08:04.229 INFO:teuthology.orchestra.run.smithi161.stdout:1350 read 0x3ac3504 thru 0x3ac956f (0x606c bytes) 2024-09-21T15:08:04.230 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.230 INFO:teuthology.orchestra.run.smithi161.stdout:1352 writesame 0xa83768e thru 0xa839f95 data_size 0x34(0x2908 bytes) 2024-09-21T15:08:04.241 INFO:teuthology.orchestra.run.smithi161.stdout:1353 read 0xe7c0422 thru 0xe7c9f2b (0x9b0a bytes) 2024-09-21T15:08:04.245 INFO:teuthology.orchestra.run.smithi161.stdout:1353 write 0xd40600c thru 0xd4071c7 (0x11bc bytes) 2024-09-21T15:08:04.257 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.257 INFO:teuthology.orchestra.run.smithi161.stdout:1355 write 0x1e3b9a1 thru 0x1e447ea (0x8e4a bytes) 2024-09-21T15:08:04.261 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.261 INFO:teuthology.orchestra.run.smithi161.stdout:1218 flatten 2024-09-21T15:08:04.299 INFO:teuthology.orchestra.run.smithi161.stdout:1354 read 0x2ce5a4a thru 0x2cf4057 (0xe60e bytes) 2024-09-21T15:08:04.345 INFO:teuthology.orchestra.run.smithi161.stdout:1356 write 0xb4845f1 thru 0xb48f4d8 (0xaee8 bytes) 2024-09-21T15:08:04.347 INFO:teuthology.orchestra.run.smithi161.stdout:1355 read 0x8e6c514 thru 0x8e78a52 (0xc53f bytes) 2024-09-21T15:08:04.353 INFO:teuthology.orchestra.run.smithi161.stdout:1357 punch from 0x179789b to 0x17a4e80, (0xd5e5 bytes) 2024-09-21T15:08:04.353 INFO:teuthology.orchestra.run.smithi161.stdout:1359 read 0x6c827a thru 0x6d45c6 (0xc34d bytes) 2024-09-21T15:08:04.354 INFO:teuthology.orchestra.run.smithi161.stdout:1360 read 0x8ce5658 thru 0x8ce9502 (0x3eab bytes) 2024-09-21T15:08:04.355 INFO:teuthology.orchestra.run.smithi161.stdout:1314 write 0x99bd0aa thru 0x99bdfb9 (0xf10 bytes) 2024-09-21T15:08:04.363 INFO:teuthology.orchestra.run.smithi161.stdout:1361 write 0xad7e30c thru 0xad8b0fb (0xcdf0 bytes) 2024-09-21T15:08:04.364 INFO:teuthology.orchestra.run.smithi161.stdout:1358 punch from 0xcca26e7 to 0xccae14d, (0xba66 bytes) 2024-09-21T15:08:04.364 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.372 INFO:teuthology.orchestra.run.smithi161.stdout:1360 trunc from 0xe87771d to 0xb2c3fef 2024-09-21T15:08:04.395 INFO:teuthology.orchestra.run.smithi161.stdout:1362 read 0x4ca18cf thru 0x4cab16e (0x98a0 bytes) 2024-09-21T15:08:04.405 INFO:teuthology.orchestra.run.smithi161.stdout:1364 trunc from 0xe844925 to 0xac6f3c7 2024-09-21T15:08:04.448 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.448 INFO:teuthology.orchestra.run.smithi161.stdout:1316 write 0x9037752 thru 0x9037b7e (0x42d bytes) 2024-09-21T15:08:04.485 INFO:teuthology.orchestra.run.smithi161.stdout:1366 read 0x72368ce thru 0x724185d (0xaf90 bytes) 2024-09-21T15:08:04.485 INFO:teuthology.orchestra.run.smithi161.stdout:1367 read 0x7148f41 thru 0x7157240 (0xe300 bytes) 2024-09-21T15:08:04.489 INFO:teuthology.orchestra.run.smithi161.stdout:1767 punch from 0x3bff77c to 0x3c02508, (0x2d8c bytes) 2024-09-21T15:08:04.489 INFO:teuthology.orchestra.run.smithi161.stdout:1768 read 0x208d238 thru 0x20951b8 (0x7f81 bytes) 2024-09-21T15:08:04.490 INFO:teuthology.orchestra.run.smithi161.stdout:1769 writesame 0x6ef6375 thru 0x6f006f5 data_size 0x1(0xa381 bytes) 2024-09-21T15:08:04.499 INFO:teuthology.orchestra.run.smithi161.stdout:1361 read 0x6f3a4b thru 0x6fb536 (0x7aec bytes) 2024-09-21T15:08:04.501 INFO:teuthology.orchestra.run.smithi161.stdout:1317 read 0x6375 thru 0x13171 (0xcdfd bytes) 2024-09-21T15:08:04.504 INFO:teuthology.orchestra.run.smithi161.stdout:1318 write 0x27efb2 thru 0x283389 (0x43d8 bytes) 2024-09-21T15:08:04.584 INFO:teuthology.orchestra.run.smithi161.stdout:1369 write 0xe6957ca thru 0xe6968e0 (0x1117 bytes) 2024-09-21T15:08:04.590 INFO:teuthology.orchestra.run.smithi161.stdout:1319 trunc from 0x99bdfba to 0xcd72d3c 2024-09-21T15:08:04.591 INFO:teuthology.orchestra.run.smithi161.stdout:1362 writesame 0xe490ef1 thru 0xe493c12 data_size 0x2(0x2d22 bytes) 2024-09-21T15:08:04.599 INFO:teuthology.orchestra.run.smithi161.stdout:1370 writesame 0x78783e thru 0x78e6bc data_size 0x15(0x6e7f bytes) 2024-09-21T15:08:04.600 INFO:teuthology.orchestra.run.smithi161.stdout:1363 read 0x71f11d1 thru 0x71ff5c6 (0xe3f6 bytes) 2024-09-21T15:08:04.605 INFO:teuthology.orchestra.run.smithi161.stdout:1371 read 0x1ffc83a thru 0x2001391 (0x4b58 bytes) 2024-09-21T15:08:04.606 INFO:teuthology.orchestra.run.smithi161.stdout:1372 read 0x880bfa2 thru 0x8812a28 (0x6a87 bytes) 2024-09-21T15:08:04.615 INFO:teuthology.orchestra.run.smithi161.stdout:1364 trunc from 0xe493c13 to 0x7f31b05 2024-09-21T15:08:04.627 INFO:teuthology.orchestra.run.smithi161.stdout:1373 trunc from 0xe6968e1 to 0x3b59f0f 2024-09-21T15:08:04.632 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.632 INFO:teuthology.orchestra.run.smithi161.stdout:1321 write 0x4846423 thru 0x484751c (0x10fa bytes) 2024-09-21T15:08:04.648 INFO:teuthology.orchestra.run.smithi161.stdout:1322 writesame 0x5f076c7 thru 0x5f11889 data_size 0x1(0xa1c3 bytes) 2024-09-21T15:08:04.688 INFO:teuthology.orchestra.run.smithi161.stdout:1323 punch from 0x4920074 to 0x4926219, (0x61a5 bytes) 2024-09-21T15:08:04.688 INFO:teuthology.orchestra.run.smithi161.stdout:1327 write 0x56f5fef thru 0x56fcb14 (0x6b26 bytes) 2024-09-21T15:08:04.689 INFO:teuthology.orchestra.run.smithi161.stdout:1365 write 0x1d2ff86 thru 0x1d3a3f0 (0xa46b bytes) 2024-09-21T15:08:04.692 INFO:teuthology.orchestra.run.smithi161.stdout:1770 writesame 0xe2661fa thru 0xe26b508 data_size 0x1(0x530f bytes) 2024-09-21T15:08:04.697 INFO:teuthology.orchestra.run.smithi161.stdout:1329 read 0x37041d6 thru 0x370b28c (0x70b7 bytes) 2024-09-21T15:08:04.697 INFO:teuthology.orchestra.run.smithi161.stdout:1330 writesame 0x1d99b0a thru 0x1da2103 data_size 0xb(0x85fa bytes) 2024-09-21T15:08:04.699 INFO:teuthology.orchestra.run.smithi161.stdout:1771 write 0x9e36ab6 thru 0x9e44f0a (0xe455 bytes) 2024-09-21T15:08:04.701 INFO:teuthology.orchestra.run.smithi161.stdout:1366 trunc from 0x7f31b05 to 0x6a0f805 2024-09-21T15:08:04.705 INFO:teuthology.orchestra.run.smithi161.stdout:1374 read 0x25b7041 thru 0x25bce72 (0x5e32 bytes) 2024-09-21T15:08:04.706 INFO:teuthology.orchestra.run.smithi161.stdout:1375 punch from 0x218008c to 0x218a7e1, (0xa755 bytes) 2024-09-21T15:08:04.713 INFO:teuthology.orchestra.run.smithi161.stdout:1331 read 0x99f7d59 thru 0x9a0570b (0xd9b3 bytes) 2024-09-21T15:08:04.714 INFO:teuthology.orchestra.run.smithi161.stdout:1333 write 0x9e9997d thru 0x9ea7e05 (0xe489 bytes) 2024-09-21T15:08:04.734 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.735 INFO:teuthology.orchestra.run.smithi161.stdout:1775 read 0x4800207 thru 0x4805400 (0x51fa bytes) 2024-09-21T15:08:04.735 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.735 INFO:teuthology.orchestra.run.smithi161.stdout:1335 write 0x511f91e thru 0x512dd28 (0xe40b bytes) 2024-09-21T15:08:04.735 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.735 INFO:teuthology.orchestra.run.smithi161.stdout:1778 write 0x97a752c thru 0x97ab95f (0x4434 bytes) 2024-09-21T15:08:04.748 INFO:teuthology.orchestra.run.smithi161.stdout:1336 trunc from 0xcd72d3c to 0xbdfb520 2024-09-21T15:08:04.749 INFO:teuthology.orchestra.run.smithi161.stdout:1221 writesame 0xb055ed7 thru 0xb061b28 data_size 0xf(0xbc52 bytes) 2024-09-21T15:08:04.751 INFO:teuthology.orchestra.run.smithi161.stdout:1367 writesame 0x6151fea thru 0x6152974 data_size 0x1(0x98b bytes) 2024-09-21T15:08:04.753 INFO:teuthology.orchestra.run.smithi161.stdout:1222 read 0x7d5074a thru 0x7d587a9 (0x8060 bytes) 2024-09-21T15:08:04.754 INFO:teuthology.orchestra.run.smithi161.stdout:1223 write 0xa94c092 thru 0xa95888c (0xc7fb bytes) 2024-09-21T15:08:04.761 INFO:teuthology.orchestra.run.smithi161.stdout:1376 write 0xabc2bbc thru 0xabcdd1b (0xb160 bytes) 2024-09-21T15:08:04.769 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.769 INFO:teuthology.orchestra.run.smithi161.stdout:1369 read 0x152166f thru 0x1530964 (0xf2f6 bytes) 2024-09-21T15:08:04.769 INFO:teuthology.orchestra.run.smithi161.stdout:1780 writesame 0x2893619 thru 0x2896551 data_size 0xb(0x2f39 bytes) 2024-09-21T15:08:04.770 INFO:teuthology.orchestra.run.smithi161.stdout:1370 write 0x18ec4bb thru 0x18f874b (0xc291 bytes) 2024-09-21T15:08:04.784 INFO:teuthology.orchestra.run.smithi161.stdout:1377 read 0x8820b65 thru 0x882fd26 (0xf1c2 bytes) 2024-09-21T15:08:04.785 INFO:teuthology.orchestra.run.smithi161.stdout:1378 read 0x13fd9bd thru 0x1402b1a (0x515e bytes) 2024-09-21T15:08:04.786 INFO:teuthology.orchestra.run.smithi161.stdout:1380 read 0x79d4821 thru 0x79dc3f8 (0x7bd8 bytes) 2024-09-21T15:08:04.786 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.787 INFO:teuthology.orchestra.run.smithi161.stdout:1371 write 0x40950c thru 0x40d923 (0x4418 bytes) 2024-09-21T15:08:04.787 INFO:teuthology.orchestra.run.smithi161.stdout:1225 writesame 0xa711dfb thru 0xa717fce data_size 0x6(0x61d4 bytes) 2024-09-21T15:08:04.789 INFO:teuthology.orchestra.run.smithi161.stdout:1381 trunc from 0xabcdd1c to 0x9966012 2024-09-21T15:08:04.796 INFO:teuthology.orchestra.run.smithi161.stdout:1341 writesame 0x77a4770 thru 0x77b09d5 data_size 0x2(0xc266 bytes) 2024-09-21T15:08:04.802 INFO:teuthology.orchestra.run.smithi161.stdout:1226 read 0xad81a26 thru 0xad84cae (0x3289 bytes) 2024-09-21T15:08:04.802 INFO:teuthology.orchestra.run.smithi161.stdout:1227 write 0x208e3ed thru 0x208f067 (0xc7b bytes) 2024-09-21T15:08:04.811 INFO:teuthology.orchestra.run.smithi161.stdout:1784 trunc from 0xe26b509 to 0xaced2c 2024-09-21T15:08:04.811 INFO:teuthology.orchestra.run.smithi161.stdout:1228 read 0x31545e1 thru 0x316073a (0xc15a bytes) 2024-09-21T15:08:04.811 INFO:teuthology.orchestra.run.smithi161.stdout:1229 punch from 0x59eee9b to 0x59f130e, (0x2473 bytes) 2024-09-21T15:08:04.812 INFO:teuthology.orchestra.run.smithi161.stdout:1230 write 0x5f1ecd8 thru 0x5f2b1d9 (0xc502 bytes) 2024-09-21T15:08:04.814 INFO:teuthology.orchestra.run.smithi161.stdout:1343 write 0x942f49 thru 0x94c58f (0x9647 bytes) 2024-09-21T15:08:04.831 INFO:teuthology.orchestra.run.smithi161.stdout:1344 punch from 0x3c1224e to 0x3c1eb5f, (0xc911 bytes) 2024-09-21T15:08:04.831 INFO:teuthology.orchestra.run.smithi161.stdout:1346 writesame 0xac919ec thru 0xac95fff data_size 0x27(0x4614 bytes) 2024-09-21T15:08:04.834 INFO:teuthology.orchestra.run.smithi161.stdout:1382 read 0x1d5d0ac thru 0x1d63385 (0x62da bytes) 2024-09-21T15:08:04.856 INFO:teuthology.orchestra.run.smithi161.stdout:1234 trunc from 0xb061b29 to 0xe514229 2024-09-21T15:08:04.859 INFO:teuthology.orchestra.run.smithi161.stdout:1372 write 0x9d069f5 thru 0x9d082e3 (0x18ef bytes) 2024-09-21T15:08:04.882 INFO:teuthology.orchestra.run.smithi161.stdout:1373 writesame 0x47127f3 thru 0x472092e data_size 0x14(0xe13c bytes) 2024-09-21T15:08:04.897 INFO:teuthology.orchestra.run.smithi161.stdout:1383 write 0xafeec6a thru 0xaffb80e (0xcba5 bytes) 2024-09-21T15:08:04.908 INFO:teuthology.orchestra.run.smithi161.stdout:1374 trunc from 0x9d082e4 to 0x3e4d3a4 2024-09-21T15:08:04.912 INFO:teuthology.orchestra.run.smithi161.stdout:1385 writesame 0xa99899a thru 0xa998b8f data_size 0x1(0x1f6 bytes) 2024-09-21T15:08:04.922 INFO:teuthology.orchestra.run.smithi161.stdout:1386 read 0x80741c thru 0x80bb75 (0x475a bytes) 2024-09-21T15:08:04.922 INFO:teuthology.orchestra.run.smithi161.stdout:1387 read 0x2915fe8 thru 0x291fd6f (0x9d88 bytes) 2024-09-21T15:08:04.924 INFO:teuthology.orchestra.run.smithi161.stdout:1388 read 0x1ac672a thru 0x1ac76ff (0xfd6 bytes) 2024-09-21T15:08:04.924 INFO:teuthology.orchestra.run.smithi161.stdout:1347 write 0xe496ff2 thru 0xe49e99e (0x79ad bytes) 2024-09-21T15:08:04.929 INFO:teuthology.orchestra.run.smithi161.stdout:1391 read 0xfcd2cd thru 0xfdc9ca (0xf6fe bytes) 2024-09-21T15:08:04.931 INFO:teuthology.orchestra.run.smithi161.stdout:1237 read 0x14e08d thru 0x14f6aa (0x161e bytes) 2024-09-21T15:08:04.934 INFO:teuthology.orchestra.run.smithi161.stdout:1238 writesame 0x9b7db5 thru 0x9bc600 data_size 0xe(0x484c bytes) 2024-09-21T15:08:04.937 INFO:teuthology.orchestra.run.smithi161.stdout:1392 trunc from 0xaffb80f to 0xe5f7487 2024-09-21T15:08:04.948 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:04.949 INFO:teuthology.orchestra.run.smithi161.stdout:1241 write 0xb5b5a3c thru 0xb5c29b1 (0xcf76 bytes) 2024-09-21T15:08:04.954 INFO:teuthology.orchestra.run.smithi161.stdout:1348 writesame 0x7c40482 thru 0x7c4c58a data_size 0x1(0xc109 bytes) 2024-09-21T15:08:04.985 INFO:teuthology.orchestra.run.smithi161.stdout:1393 writesame 0x220687b thru 0x2207f5f data_size 0x1(0x16e5 bytes) 2024-09-21T15:08:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #8, image image_cluster1.client.mirror.2-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent9 2024-09-21T15:08:04.992 INFO:teuthology.orchestra.run.smithi161.stdout:1242 punch from 0x4b67446 to 0x4b73bfd, (0xc7b7 bytes) 2024-09-21T15:08:04.992 INFO:teuthology.orchestra.run.smithi161.stdout:1243 write 0x586918f thru 0x586fca2 (0x6b14 bytes) 2024-09-21T15:08:04.998 INFO:teuthology.orchestra.run.smithi161.stdout:1395 read 0x1765a18 thru 0x1770208 (0xa7f1 bytes) 2024-09-21T15:08:04.999 INFO:teuthology.orchestra.run.smithi161.stdout:1396 read 0xa9226cc thru 0xa92d790 (0xb0c5 bytes) 2024-09-21T15:08:05.000 INFO:teuthology.orchestra.run.smithi161.stdout:1350 writesame 0x184dc2f thru 0x1851ae6 data_size 0x24(0x3eb8 bytes) 2024-09-21T15:08:05.000 INFO:teuthology.orchestra.run.smithi161.stdout:1397 read 0x3d60d72 thru 0x3d6a9a2 (0x9c31 bytes) 2024-09-21T15:08:05.002 INFO:teuthology.orchestra.run.smithi161.stdout:1398 read 0x9474b99 thru 0x947ae72 (0x62da bytes) 2024-09-21T15:08:05.002 INFO:teuthology.orchestra.run.smithi161.stdout:1399 write 0x4b3f8 thru 0x5ae64 (0xfa6d bytes) 2024-09-21T15:08:05.015 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.015 INFO:teuthology.orchestra.run.smithi161.stdout:1352 read 0xbe8092a thru 0xbe80ce1 (0x3b8 bytes) 2024-09-21T15:08:05.015 INFO:teuthology.orchestra.run.smithi161.stdout:1353 write 0x40c2e58 thru 0x40d15cb (0xe774 bytes) 2024-09-21T15:08:05.018 INFO:teuthology.orchestra.run.smithi161.stdout:1244 write 0x3101c9 thru 0x316163 (0x5f9b bytes) 2024-09-21T15:08:05.020 INFO:teuthology.orchestra.run.smithi161.stdout:1401 write 0xb1b76d0 thru 0xb1c4445 (0xcd76 bytes) 2024-09-21T15:08:05.032 INFO:teuthology.orchestra.run.smithi161.stdout:1354 punch from 0x7bab70c to 0x7bbb44b, (0xfd3f bytes) 2024-09-21T15:08:05.032 INFO:teuthology.orchestra.run.smithi161.stdout:1355 writesame 0x60ebaf3 thru 0x60f6414 data_size 0x1(0xa922 bytes) 2024-09-21T15:08:05.032 INFO:teuthology.orchestra.run.smithi161.stdout:1375 writesame 0x6e5362c thru 0x6e5d915 data_size 0x3f(0xa2ea bytes) 2024-09-21T15:08:05.036 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.036 INFO:teuthology.orchestra.run.smithi161.stdout:1377 read 0x52b84e3 thru 0x52c669e (0xe1bc bytes) 2024-09-21T15:08:05.036 INFO:teuthology.orchestra.run.smithi161.stdout:1382 punch from 0x5f9d053 to 0x5fa2265, (0x5212 bytes) 2024-09-21T15:08:05.036 INFO:teuthology.orchestra.run.smithi161.stdout:1383 punch from 0x6b834c to 0x6c115c, (0x8e10 bytes) 2024-09-21T15:08:05.036 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.036 INFO:teuthology.orchestra.run.smithi161.stdout:1387 read 0x559814b thru 0x559bcd8 (0x3b8e bytes) 2024-09-21T15:08:05.045 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.045 INFO:teuthology.orchestra.run.smithi161.stdout:1246 write 0xe37409d thru 0xe3755e0 (0x1544 bytes) 2024-09-21T15:08:05.054 INFO:teuthology.orchestra.run.smithi161.stdout:1356 read 0x6a2f2f6 thru 0x6a38e01 (0x9b0c bytes) 2024-09-21T15:08:05.055 INFO:teuthology.orchestra.run.smithi161.stdout:1357 writesame 0xc91f18e thru 0xc925569 data_size 0x53(0x63dc bytes) 2024-09-21T15:08:05.065 INFO:teuthology.orchestra.run.smithi161.stdout:1247 punch from 0xa4b81d6 to 0xa4bb974, (0x379e bytes) 2024-09-21T15:08:05.065 INFO:teuthology.orchestra.run.smithi161.stdout:1249 write 0x318fbb0 thru 0x31940fb (0x454c bytes) 2024-09-21T15:08:05.067 INFO:teuthology.orchestra.run.smithi161.stdout:1359 read 0x32cff0f thru 0x32d8547 (0x8639 bytes) 2024-09-21T15:08:05.067 INFO:teuthology.orchestra.run.smithi161.stdout:1785 trunc from 0xaced2c to 0x6a133b4 2024-09-21T15:08:05.068 INFO:teuthology.orchestra.run.smithi161.stdout:1360 punch from 0x2586e73 to 0x258b170, (0x42fd bytes) 2024-09-21T15:08:05.068 INFO:teuthology.orchestra.run.smithi161.stdout:1361 read 0x21250e3 thru 0x212f592 (0xa4b0 bytes) 2024-09-21T15:08:05.070 INFO:teuthology.orchestra.run.smithi161.stdout:1936 write 0x5d97cde thru 0x5da0c9b (0x8fbe bytes) 2024-09-21T15:08:05.079 INFO:teuthology.orchestra.run.smithi161.stdout:1402 write 0xe7c86ad thru 0xe7ccb68 (0x44bc bytes) 2024-09-21T15:08:05.084 INFO:teuthology.orchestra.run.smithi161.stdout:1388 write 0x9e09967 thru 0x9e0c7c2 (0x2e5c bytes) 2024-09-21T15:08:05.084 INFO:teuthology.orchestra.run.smithi161.stdout:1252 punch from 0x5829245 to 0x5833688, (0xa443 bytes) 2024-09-21T15:08:05.085 INFO:teuthology.orchestra.run.smithi161.stdout:1253 write 0x67dc134 thru 0x67e3471 (0x733e bytes) 2024-09-21T15:08:05.089 INFO:teuthology.orchestra.run.smithi161.stdout:1403 write 0xe65a00f thru 0xe665396 (0xb388 bytes) 2024-09-21T15:08:05.097 INFO:teuthology.orchestra.run.smithi161.stdout:1389 punch from 0x6eabfc9 to 0x6ebb532, (0xf569 bytes) 2024-09-21T15:08:05.099 INFO:teuthology.orchestra.run.smithi161.stdout:1404 write 0x620b086 thru 0x6214878 (0x97f3 bytes) 2024-09-21T15:08:05.102 INFO:teuthology.orchestra.run.smithi161.stdout:1391 trunc from 0x9e0c7c3 to 0x8798a09 2024-09-21T15:08:05.106 INFO:teuthology.orchestra.run.smithi161.stdout:1405 read 0x6cbc7d2 thru 0x6cbe7c7 (0x1ff6 bytes) 2024-09-21T15:08:05.107 INFO:teuthology.orchestra.run.smithi161.stdout:1406 read 0x749d17d thru 0x74ac72e (0xf5b2 bytes) 2024-09-21T15:08:05.108 INFO:teuthology.orchestra.run.smithi161.stdout:1407 punch from 0x70e3ca4 to 0x70f377b, (0xfad7 bytes) 2024-09-21T15:08:05.108 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.108 INFO:teuthology.orchestra.run.smithi161.stdout:1409 read 0x9d34f11 thru 0x9d414da (0xc5ca bytes) 2024-09-21T15:08:05.108 INFO:teuthology.orchestra.run.smithi161.stdout:1410 punch from 0x9ebb778 to 0x9ebd5d1, (0x1e59 bytes) 2024-09-21T15:08:05.108 INFO:teuthology.orchestra.run.smithi161.stdout:1411 read 0x442e9cf thru 0x442fb13 (0x1145 bytes) 2024-09-21T15:08:05.109 INFO:teuthology.orchestra.run.smithi161.stdout:1413 write 0x79e9d7a thru 0x79f607c (0xc303 bytes) 2024-09-21T15:08:05.109 INFO:teuthology.orchestra.run.smithi161.stdout:1254 punch from 0x6c148ff to 0x6c14918, (0x19 bytes) 2024-09-21T15:08:05.109 INFO:teuthology.orchestra.run.smithi161.stdout:1256 write 0x6f8d480 thru 0x6f90db4 (0x3935 bytes) 2024-09-21T15:08:05.115 INFO:teuthology.orchestra.run.smithi161.stdout:1362 write 0xed29274 thru 0xed30707 (0x7494 bytes) 2024-09-21T15:08:05.115 INFO:teuthology.orchestra.run.smithi161.stdout:1937 writesame 0x1e90ea3 thru 0x1e9e393 data_size 0x1b(0xd4f1 bytes) 2024-09-21T15:08:05.117 INFO:teuthology.orchestra.run.smithi161.stdout:1415 read 0x62a223c thru 0x62a23c2 (0x187 bytes) 2024-09-21T15:08:05.120 INFO:teuthology.orchestra.run.smithi161.stdout:1416 write 0x9da019 thru 0x9e7f7b (0xdf63 bytes) 2024-09-21T15:08:05.144 INFO:teuthology.orchestra.run.smithi161.stdout:1417 write 0x35f52a thru 0x3642d5 (0x4dac bytes) 2024-09-21T15:08:05.146 INFO:teuthology.orchestra.run.smithi161.stdout:1257 write 0xe1dd2fc thru 0xe1e260b (0x5310 bytes) 2024-09-21T15:08:05.149 INFO:teuthology.orchestra.run.smithi161.stdout:1363 punch from 0x97a26fd to 0x97b0bb2, (0xe4b5 bytes) 2024-09-21T15:08:05.149 INFO:teuthology.orchestra.run.smithi161.stdout:1364 read 0x1fa68aa thru 0x1fae46e (0x7bc5 bytes) 2024-09-21T15:08:05.161 INFO:teuthology.orchestra.run.smithi161.stdout:1418 clone 14 order 20 su 65536 sc 5 2024-09-21T15:08:05.179 INFO:teuthology.orchestra.run.smithi161.stdout:1258 trunc from 0xe514229 to 0x3e6b245 2024-09-21T15:08:05.183 INFO:teuthology.orchestra.run.smithi161.stdout:1786 write 0xbbfcf9f thru 0xbc09cfe (0xcd60 bytes) 2024-09-21T15:08:05.184 INFO:teuthology.orchestra.run.smithi161.stdout:1392 read 0x3c38799 thru 0x3c3dbfa (0x5462 bytes) 2024-09-21T15:08:05.184 INFO:teuthology.orchestra.run.smithi161.stdout:1394 punch from 0x28847da to 0x288f84b, (0xb071 bytes) 2024-09-21T15:08:05.184 INFO:teuthology.orchestra.run.smithi161.stdout:1395 read 0x25eecde thru 0x25f2d84 (0x40a7 bytes) 2024-09-21T15:08:05.195 INFO:teuthology.orchestra.run.smithi161.stdout:1365 writesame 0xb55058b thru 0xb55ce19 data_size 0x1(0xc88f bytes) 2024-09-21T15:08:05.229 INFO:teuthology.orchestra.run.smithi161.stdout:1366 write 0xe93657e thru 0xe941821 (0xb2a4 bytes) 2024-09-21T15:08:05.237 INFO:teuthology.orchestra.run.smithi161.stdout:1396 writesame 0x20602f7 thru 0x206e2b8 data_size 0x3(0xdfc2 bytes) 2024-09-21T15:08:05.267 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.268 INFO:teuthology.orchestra.run.smithi161.stdout:1789 punch from 0x4da0626 to 0x4da1496, (0xe70 bytes) 2024-09-21T15:08:05.268 INFO:teuthology.orchestra.run.smithi161.stdout:1790 writesame 0x58146db thru 0x581de3c data_size 0x9(0x9762 bytes) 2024-09-21T15:08:05.272 INFO:teuthology.orchestra.run.smithi161.stdout:1367 read 0x4ca946c thru 0x4cb179d (0x8332 bytes) 2024-09-21T15:08:05.273 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.273 INFO:teuthology.orchestra.run.smithi161.stdout:1371 writesame 0xb35e22d thru 0xb36d43b data_size 0x1(0xf20f bytes) 2024-09-21T15:08:05.305 INFO:teuthology.orchestra.run.smithi161.stdout:1261 trunc from 0x3e6b245 to 0x5dffd49 2024-09-21T15:08:05.315 INFO:teuthology.orchestra.run.smithi161.stdout:1372 read 0xa9cdaf2 thru 0xa9d5543 (0x7a52 bytes) 2024-09-21T15:08:05.316 INFO:teuthology.orchestra.run.smithi161.stdout:1373 punch from 0x6a46061 to 0x6a530d0, (0xd06f bytes) 2024-09-21T15:08:05.322 INFO:teuthology.orchestra.run.smithi161.stdout:1791 read 0x3aaa0a0 thru 0x3aafdaa (0x5d0b bytes) 2024-09-21T15:08:05.322 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.322 INFO:teuthology.orchestra.run.smithi161.stdout:1794 trunc from 0xbc09cff to 0xb72f936 2024-09-21T15:08:05.327 INFO:teuthology.orchestra.run.smithi161.stdout:1398 write 0xa675615 thru 0xa676e40 (0x182c bytes) 2024-09-21T15:08:05.337 INFO:teuthology.orchestra.run.smithi161.stdout:1375 trunc from 0xed30708 to 0x2ad6fc7 2024-09-21T15:08:05.380 INFO:teuthology.orchestra.run.smithi161.stdout:1795 punch from 0xa894d87 to 0xa899282, (0x44fb bytes) 2024-09-21T15:08:05.380 INFO:teuthology.orchestra.run.smithi161.stdout:1796 write 0x8ac5c34 thru 0x8aca400 (0x47cd bytes) 2024-09-21T15:08:05.381 INFO:teuthology.orchestra.run.smithi161.stdout:1262 write 0x8793836 thru 0x879aa18 (0x71e3 bytes) 2024-09-21T15:08:05.385 INFO:teuthology.orchestra.run.smithi161.stdout:1938 punch from 0x7ebad12 to 0x7ebed38, (0x4026 bytes) 2024-09-21T15:08:05.385 INFO:teuthology.orchestra.run.smithi161.stdout:1939 write 0x79760a4 thru 0x7982d65 (0xccc2 bytes) 2024-09-21T15:08:05.395 INFO:teuthology.orchestra.run.smithi161.stdout:1400 write 0xee41283 thru 0xee4f3f6 (0xe174 bytes) 2024-09-21T15:08:05.408 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.408 INFO:teuthology.orchestra.run.smithi161.stdout:1266 read 0x83fd3b4 thru 0x84018aa (0x44f7 bytes) 2024-09-21T15:08:05.417 INFO:teuthology.orchestra.run.smithi161.stdout:1401 writesame 0x316e0b6 thru 0x31755fa data_size 0x1(0x7545 bytes) 2024-09-21T15:08:05.420 INFO:teuthology.orchestra.run.smithi161.stdout:1377 punch from 0xcf4c85 to 0xd03187, (0xe502 bytes) 2024-09-21T15:08:05.438 INFO:teuthology.orchestra.run.smithi161.stdout:1267 writesame 0x9d76e06 thru 0x9d7f809 data_size 0x49(0x8a04 bytes) 2024-09-21T15:08:05.440 INFO:teuthology.orchestra.run.smithi161.stdout:1402 write 0x348c857 thru 0x349c3c1 (0xfb6b bytes) 2024-09-21T15:08:05.441 INFO:teuthology.orchestra.run.smithi161.stdout:1271 writesame 0x7aea48a thru 0x7af0778 data_size 0x1f(0x62ef bytes) 2024-09-21T15:08:05.459 INFO:teuthology.orchestra.run.smithi161.stdout:1404 writesame 0x8b122a2 thru 0x8b171c0 data_size 0x1(0x4f1f bytes) 2024-09-21T15:08:05.461 INFO:teuthology.orchestra.run.smithi161.stdout:1272 writesame 0x9b3fe82 thru 0x9b4f699 data_size 0x44(0xf818 bytes) 2024-09-21T15:08:05.463 INFO:teuthology.orchestra.run.smithi161.stdout:1378 write 0x5910edb thru 0x591f3f4 (0xe51a bytes) 2024-09-21T15:08:05.465 INFO:teuthology.orchestra.run.smithi161.stdout:1940 write 0xebe4337 thru 0xebf2d12 (0xe9dc bytes) 2024-09-21T15:08:05.477 INFO:teuthology.orchestra.run.smithi161.stdout:1379 write 0x17e18b4 thru 0x17e7f5f (0x66ac bytes) 2024-09-21T15:08:05.488 INFO:teuthology.orchestra.run.smithi161.stdout:1274 read 0x781ec6b thru 0x782a816 (0xbbac bytes) 2024-09-21T15:08:05.488 INFO:teuthology.orchestra.run.smithi161.stdout:1941 writesame 0x8f7165d thru 0x8f75c1e data_size 0x1(0x45c2 bytes) 2024-09-21T15:08:05.488 INFO:teuthology.orchestra.run.smithi161.stdout:1405 writesame 0x3067909 thru 0x306af18 data_size 0x14(0x3610 bytes) 2024-09-21T15:08:05.489 INFO:teuthology.orchestra.run.smithi161.stdout:1277 read 0x6bbe47e thru 0x6bc7567 (0x90ea bytes) 2024-09-21T15:08:05.489 INFO:teuthology.orchestra.run.smithi161.stdout:1278 punch from 0x2153335 to 0x215d337, (0xa002 bytes) 2024-09-21T15:08:05.490 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.491 INFO:teuthology.orchestra.run.smithi161.stdout:1797 write 0xebb31a4 thru 0xebb5c67 (0x2ac4 bytes) 2024-09-21T15:08:05.491 INFO:teuthology.orchestra.run.smithi161.stdout:1279 trunc from 0x9d7f80a to 0xac0e899 2024-09-21T15:08:05.498 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.499 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.499 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.509 INFO:teuthology.orchestra.run.smithi161.stdout:1411 trunc from 0xee4f3f7 to 0x8dc0830 2024-09-21T15:08:05.523 INFO:teuthology.orchestra.run.smithi161.stdout:1943 writesame 0x41bb81b thru 0x41c83a0 data_size 0x6d(0xcb86 bytes) 2024-09-21T15:08:05.527 INFO:teuthology.orchestra.run.smithi161.stdout:1798 writesame 0x3732f2c thru 0x373ad6e data_size 0x1(0x7e43 bytes) 2024-09-21T15:08:05.544 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.574 INFO:teuthology.orchestra.run.smithi161.stdout:1944 trunc from 0xebf2d13 to 0x5130a87 2024-09-21T15:08:05.586 INFO:teuthology.orchestra.run.smithi161.stdout:1799 write 0x60a77b4 thru 0x60b65db (0xee28 bytes) 2024-09-21T15:08:05.595 INFO:teuthology.orchestra.run.smithi161.stdout:1381 writesame 0x5f529e7 thru 0x5f5e5c4 data_size 0x8b(0xbbde bytes) 2024-09-21T15:08:05.600 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.600 INFO:teuthology.orchestra.run.smithi161.stdout:1413 writesame 0x8d2d61f thru 0x8d30fa8 data_size 0xa(0x398a bytes) 2024-09-21T15:08:05.605 INFO:teuthology.orchestra.run.smithi161.stdout:1281 write 0xadc1bb4 thru 0xadce1b3 (0xc600 bytes) 2024-09-21T15:08:05.612 INFO:teuthology.orchestra.run.smithi161.stdout:1414 read 0x5463b1e thru 0x546bc66 (0x8149 bytes) 2024-09-21T15:08:05.612 INFO:teuthology.orchestra.run.smithi161.stdout:1416 read 0x8461c7a thru 0x8469713 (0x7a9a bytes) 2024-09-21T15:08:05.613 INFO:teuthology.orchestra.run.smithi161.stdout:1417 punch from 0x5ff30f5 to 0x5ff5d13, (0x2c1e bytes) 2024-09-21T15:08:05.614 INFO:teuthology.orchestra.run.smithi161.stdout:1418 writesame 0x8cbeea thru 0x8d585c data_size 0x1(0x9973 bytes) 2024-09-21T15:08:05.631 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.649 INFO:teuthology.orchestra.run.smithi161.stdout:1800 write 0xc667b6 thru 0xc69661 (0x2eac bytes) 2024-09-21T15:08:05.658 INFO:teuthology.orchestra.run.smithi161.stdout:1419 read 0x357665d thru 0x3585039 (0xe9dd bytes) 2024-09-21T15:08:05.659 INFO:teuthology.orchestra.run.smithi161.stdout:1420 punch from 0x64991c7 to 0x649c435, (0x326e bytes) 2024-09-21T15:08:05.659 INFO:teuthology.orchestra.run.smithi161.stdout:1421 write 0x40a36c1 thru 0x40aeea7 (0xb7e7 bytes) 2024-09-21T15:08:05.666 INFO:teuthology.orchestra.run.smithi161.stdout:1801 writesame 0xccaed0 thru 0xccb19a data_size 0x5(0x2cb bytes) 2024-09-21T15:08:05.677 INFO:teuthology.orchestra.run.smithi161.stdout:1802 write 0xa90fef thru 0xa984b3 (0x74c5 bytes) 2024-09-21T15:08:05.679 INFO:teuthology.orchestra.run.smithi161.stdout:1422 write 0x55f2ebe thru 0x55fbbb0 (0x8cf3 bytes) 2024-09-21T15:08:05.687 INFO:teuthology.orchestra.run.smithi161.stdout:1382 writesame 0x652a8e8 thru 0x6532780 data_size 0x27(0x7e99 bytes) 2024-09-21T15:08:05.693 INFO:teuthology.orchestra.run.smithi161.stdout:1285 write 0xc7a5581 thru 0xc7a962e (0x40ae bytes) 2024-09-21T15:08:05.697 INFO:teuthology.orchestra.run.smithi161.stdout:1803 write 0x2f5e87c thru 0x2f6294f (0x40d4 bytes) 2024-09-21T15:08:05.701 INFO:teuthology.orchestra.run.smithi161.stdout:1945 read 0x739db6 thru 0x73e940 (0x4b8b bytes) 2024-09-21T15:08:05.702 INFO:teuthology.orchestra.run.smithi161.stdout:1946 write 0x1739a53 thru 0x17413f2 (0x79a0 bytes) 2024-09-21T15:08:05.703 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.703 INFO:teuthology.orchestra.run.smithi161.stdout:1388 read 0x47ce214 thru 0x47db817 (0xd604 bytes) 2024-09-21T15:08:05.704 INFO:teuthology.orchestra.run.smithi161.stdout:1389 writesame 0x646f386 thru 0x647cbb2 data_size 0x63(0xd82d bytes) 2024-09-21T15:08:05.706 INFO:teuthology.orchestra.run.smithi161.stdout:1423 read 0x62f721c thru 0x62fdb84 (0x6969 bytes) 2024-09-21T15:08:05.707 INFO:teuthology.orchestra.run.smithi161.stdout:1426 write 0xd49fa3 thru 0xd5287a (0x88d8 bytes) 2024-09-21T15:08:05.714 INFO:teuthology.orchestra.run.smithi161.stdout:1390 punch from 0x27d64bf to 0x27d74ce, (0x100f bytes) 2024-09-21T15:08:05.714 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.714 INFO:teuthology.orchestra.run.smithi161.stdout:1951 punch from 0x3bcffa2 to 0x3bd9a3e, (0x9a9c bytes) 2024-09-21T15:08:05.714 INFO:teuthology.orchestra.run.smithi161.stdout:1952 read 0x3cf8c27 thru 0x3d00ed2 (0x82ac bytes) 2024-09-21T15:08:05.714 INFO:teuthology.orchestra.run.smithi161.stdout:1286 writesame 0x43826b2 thru 0x43894da data_size 0x1(0x6e29 bytes) 2024-09-21T15:08:05.715 INFO:teuthology.orchestra.run.smithi161.stdout:1953 write 0x1ca5ce6 thru 0x1cb07d7 (0xaaf2 bytes) 2024-09-21T15:08:05.721 INFO:teuthology.orchestra.run.smithi161.stdout:1427 write 0x5e78444 thru 0x5e870d9 (0xec96 bytes) 2024-09-21T15:08:05.757 INFO:teuthology.orchestra.run.smithi161.stdout:1287 punch from 0x44144c2 to 0x4416846, (0x2384 bytes) 2024-09-21T15:08:05.757 INFO:teuthology.orchestra.run.smithi161.stdout:1288 write 0x198d46 thru 0x1a7b5b (0xee16 bytes) 2024-09-21T15:08:05.779 INFO:teuthology.orchestra.run.smithi161.stdout:1804 read 0xa6121e6 thru 0xa615c00 (0x3a1b bytes) 2024-09-21T15:08:05.779 INFO:teuthology.orchestra.run.smithi161.stdout:1805 writesame 0xb3cc0e1 thru 0xb3ccaff data_size 0x1(0xa1f bytes) 2024-09-21T15:08:05.786 INFO:teuthology.orchestra.run.smithi161.stdout:1393 write 0xacb6db9 thru 0xacc3b24 (0xcd6c bytes) 2024-09-21T15:08:05.802 INFO:teuthology.orchestra.run.smithi161.stdout:1806 trunc from 0xebb5c68 to 0xcc22eea 2024-09-21T15:08:05.803 INFO:teuthology.orchestra.run.smithi161.stdout:1428 write 0xb5c6a0d thru 0xb5ceca5 (0x8299 bytes) 2024-09-21T15:08:05.814 INFO:teuthology.orchestra.run.smithi161.stdout:1429 writesame 0x3838fe8 thru 0x3846919 data_size 0x9(0xd932 bytes) 2024-09-21T15:08:05.825 INFO:teuthology.orchestra.run.smithi161.stdout:1289 write 0xf62788 thru 0xf71e79 (0xf6f2 bytes) 2024-09-21T15:08:05.825 INFO:teuthology.orchestra.run.smithi161.stdout:1430 read 0x9c8863e thru 0x9c898c4 (0x1287 bytes) 2024-09-21T15:08:05.825 INFO:teuthology.orchestra.run.smithi161.stdout:1431 read 0xab88657 thru 0xab8e2fa (0x5ca4 bytes) 2024-09-21T15:08:05.826 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.826 INFO:teuthology.orchestra.run.smithi161.stdout:1433 write 0x740f7ba thru 0x741c03f (0xc886 bytes) 2024-09-21T15:08:05.834 INFO:teuthology.orchestra.run.smithi161.stdout:1435 write 0xb37baf3 thru 0xb385a73 (0x9f81 bytes) 2024-09-21T15:08:05.844 INFO:teuthology.orchestra.run.smithi161.stdout:1436 punch from 0xa80da03 to 0xa81315a, (0x5757 bytes) 2024-09-21T15:08:05.849 INFO:teuthology.orchestra.run.smithi161.stdout:1290 trunc from 0xc7a962f to 0xcf3c944 2024-09-21T15:08:05.852 INFO:teuthology.orchestra.run.smithi161.stdout:1394 read 0x62409c1 thru 0x62432e2 (0x2922 bytes) 2024-09-21T15:08:05.854 INFO:teuthology.orchestra.run.smithi161.stdout:1395 read 0x9386189 thru 0x938fae4 (0x995c bytes) 2024-09-21T15:08:05.856 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.856 INFO:teuthology.orchestra.run.smithi161.stdout:1398 writesame 0x71d43f2 thru 0x71dbeb8 data_size 0x1(0x7ac7 bytes) 2024-09-21T15:08:05.859 INFO:teuthology.orchestra.run.smithi161.stdout:1437 trunc from 0xb5ceca6 to 0x36c8b46 2024-09-21T15:08:05.878 INFO:teuthology.orchestra.run.smithi161.stdout:1399 writesame 0x81d372 thru 0x82b860 data_size 0x1(0xe4ef bytes) 2024-09-21T15:08:05.887 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.887 INFO:teuthology.orchestra.run.smithi161.stdout:1809 write 0xc404148 thru 0xc413226 (0xf0df bytes) 2024-09-21T15:08:05.895 INFO:teuthology.orchestra.run.smithi161.stdout:1291 read 0x1020bf2 thru 0x102185d (0xc6c bytes) 2024-09-21T15:08:05.896 INFO:teuthology.orchestra.run.smithi161.stdout:1292 writesame 0xcc697ae thru 0xcc757c5 data_size 0x4(0xc018 bytes) 2024-09-21T15:08:05.927 INFO:teuthology.orchestra.run.smithi161.stdout:1812 read 0x929a246 thru 0x92a8c50 (0xea0b bytes) 2024-09-21T15:08:05.927 INFO:teuthology.orchestra.run.smithi161.stdout:1293 writesame 0x4d039ea thru 0x4d0488c data_size 0x1(0xea3 bytes) 2024-09-21T15:08:05.927 INFO:teuthology.orchestra.run.smithi161.stdout:1813 read 0x43ff3ce thru 0x4404158 (0x4d8b bytes) 2024-09-21T15:08:05.929 INFO:teuthology.orchestra.run.smithi161.stdout:1814 trunc from 0xcc22eea to 0xd9718a1 2024-09-21T15:08:05.943 INFO:teuthology.orchestra.run.smithi161.stdout:1294 read 0x226f0 thru 0x2280d (0x11e bytes) 2024-09-21T15:08:05.944 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.944 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:05.945 INFO:teuthology.orchestra.run.smithi161.stdout:1297 write 0xf5a868 thru 0xf5e94e (0x40e7 bytes) 2024-09-21T15:08:05.948 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone13 from 0xe7ccb69 (overlap 0x3b59f0f) to 0x5ef64e 2024-09-21T15:08:05.956 INFO:teuthology.orchestra.run.smithi161.stdout:1298 write 0x53bb7a9 thru 0x53c71a2 (0xb9fa bytes) 2024-09-21T15:08:05.962 INFO:teuthology.orchestra.run.smithi161.stdout:1400 write 0xb24ae53 thru 0xb250eea (0x6098 bytes) 2024-09-21T15:08:05.992 INFO:teuthology.orchestra.run.smithi161.stdout:1402 punch from 0x7e24237 to 0x7e33784, (0xf54d bytes) 2024-09-21T15:08:05.992 INFO:teuthology.orchestra.run.smithi161.stdout:1403 read 0x87bbfed thru 0x87c823f (0xc253 bytes) 2024-09-21T15:08:05.993 INFO:teuthology.orchestra.run.smithi161.stdout:1404 write 0xa187fe thru 0xa1cae7 (0x42ea bytes) 2024-09-21T15:08:05.999 INFO:teuthology.orchestra.run.smithi161.stdout:1438 write 0x822ae63 thru 0x823ad93 (0xff31 bytes) 2024-09-21T15:08:06.009 INFO:teuthology.orchestra.run.smithi161.stdout:1405 write 0x8fe7ba6 thru 0x8feed61 (0x71bc bytes) 2024-09-21T15:08:06.016 INFO:teuthology.orchestra.run.smithi161.stdout:1954 write 0x52caff4 thru 0x52cb9bd (0x9ca bytes) 2024-09-21T15:08:06.016 INFO:teuthology.orchestra.run.smithi161.stdout:1816 punch from 0x9da07bc to 0x9da9c7f, (0x94c3 bytes) 2024-09-21T15:08:06.016 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.016 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.016 INFO:teuthology.orchestra.run.smithi161.stdout:1822 write 0xccd3831 thru 0xccd7e8a (0x465a bytes) 2024-09-21T15:08:06.021 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.021 INFO:teuthology.orchestra.run.smithi161.stdout:1443 write 0x68818a5 thru 0x689123a (0xf996 bytes) 2024-09-21T15:08:06.027 INFO:teuthology.orchestra.run.smithi161.stdout:1955 write 0x1e12d15 thru 0x1e13c9b (0xf87 bytes) 2024-09-21T15:08:06.030 INFO:teuthology.orchestra.run.smithi161.stdout:1299 write 0xde25432 thru 0xde35130 (0xfcff bytes) 2024-09-21T15:08:06.042 INFO:teuthology.orchestra.run.smithi161.stdout:1444 punch from 0x293f0b3 to 0x2948a49, (0x9996 bytes) 2024-09-21T15:08:06.042 INFO:teuthology.orchestra.run.smithi161.stdout:1445 write 0x4f727f2 thru 0x4f7a42c (0x7c3b bytes) 2024-09-21T15:08:06.059 INFO:teuthology.orchestra.run.smithi161.stdout:1446 read 0x5b2ce25 thru 0x5b2d5db (0x7b7 bytes) 2024-09-21T15:08:06.059 INFO:teuthology.orchestra.run.smithi161.stdout:1447 writesame 0x6f48f4 thru 0x701447 data_size 0x7(0xcb54 bytes) 2024-09-21T15:08:06.059 INFO:teuthology.orchestra.run.smithi161.stdout:1300 punch from 0x266e4b0 to 0x2676a2d, (0x857d bytes) 2024-09-21T15:08:06.059 INFO:teuthology.orchestra.run.smithi161.stdout:1301 write 0x5a6964 thru 0x5ac9bc (0x6059 bytes) 2024-09-21T15:08:06.059 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.060 INFO:teuthology.orchestra.run.smithi161.stdout:1825 read 0xb5bd68a thru 0xb5c58a7 (0x821e bytes) 2024-09-21T15:08:06.061 INFO:teuthology.orchestra.run.smithi161.stdout:1826 writesame 0x9ae2e32 thru 0x9ae8cb4 data_size 0x5(0x5e83 bytes) 2024-09-21T15:08:06.068 INFO:teuthology.orchestra.run.smithi161.stdout:1302 punch from 0x7847dbe to 0x784c1f2, (0x4434 bytes) 2024-09-21T15:08:06.068 INFO:teuthology.orchestra.run.smithi161.stdout:1303 read 0xd60bba7 thru 0xd6159df (0x9e39 bytes) 2024-09-21T15:08:06.068 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.068 INFO:teuthology.orchestra.run.smithi161.stdout:1305 write 0x2154e33 thru 0x215f1e4 (0xa3b2 bytes) 2024-09-21T15:08:06.069 INFO:teuthology.orchestra.run.smithi161.stdout:1449 write 0x4517205 thru 0x45209bf (0x97bb bytes) 2024-09-21T15:08:06.086 INFO:teuthology.orchestra.run.smithi161.stdout:1450 trunc from 0x823ad94 to 0x634c713 2024-09-21T15:08:06.092 INFO:teuthology.orchestra.run.smithi161.stdout:1956 write 0xa4b16d3 thru 0xa4b5ded (0x471b bytes) 2024-09-21T15:08:06.092 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.092 INFO:teuthology.orchestra.run.smithi161.stdout:1307 write 0xa2c182a thru 0xa2c4bea (0x33c1 bytes) 2024-09-21T15:08:06.106 INFO:teuthology.orchestra.run.smithi161.stdout:1828 read 0x388fedf thru 0x389b65a (0xb77c bytes) 2024-09-21T15:08:06.106 INFO:teuthology.orchestra.run.smithi161.stdout:1829 write 0x10cb2f4 thru 0x10cd706 (0x2413 bytes) 2024-09-21T15:08:06.109 INFO:teuthology.orchestra.run.smithi161.stdout:1406 writesame 0xd251a12 thru 0xd25c663 data_size 0x89(0xac52 bytes) 2024-09-21T15:08:06.111 INFO:teuthology.orchestra.run.smithi161.stdout:1958 writesame 0x9675e63 thru 0x9685492 data_size 0x68(0xf630 bytes) 2024-09-21T15:08:06.111 INFO:teuthology.orchestra.run.smithi161.stdout:1308 punch from 0xc94953f to 0xc956fe0, (0xdaa1 bytes) 2024-09-21T15:08:06.112 INFO:teuthology.orchestra.run.smithi161.stdout:1407 read 0x9726c36 thru 0x9732ad2 (0xbe9d bytes) 2024-09-21T15:08:06.113 INFO:teuthology.orchestra.run.smithi161.stdout:1409 write 0x900fff thru 0x902989 (0x198b bytes) 2024-09-21T15:08:06.122 INFO:teuthology.orchestra.run.smithi161.stdout:1410 read 0x31e2a25 thru 0x31ededc (0xb4b8 bytes) 2024-09-21T15:08:06.132 INFO:teuthology.orchestra.run.smithi161.stdout:1961 trunc from 0xa4b5dee to 0x8681c95 2024-09-21T15:08:06.136 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.137 INFO:teuthology.orchestra.run.smithi161.stdout:1411 trunc from 0xd25c664 to 0x49e955b 2024-09-21T15:08:06.138 INFO:teuthology.orchestra.run.smithi161.stdout:1831 trunc from 0xd9718a1 to 0xebbefd4 2024-09-21T15:08:06.154 INFO:teuthology.orchestra.run.smithi161.stdout:1309 write 0xeae5850 thru 0xeae775a (0x1f0b bytes) 2024-09-21T15:08:06.158 INFO:teuthology.orchestra.run.smithi161.stdout:1451 read 0x1d624f7 thru 0x1d71230 (0xed3a bytes) 2024-09-21T15:08:06.159 INFO:teuthology.orchestra.run.smithi161.stdout:1454 punch from 0x5f9c503 to 0x5fa2b29, (0x6626 bytes) 2024-09-21T15:08:06.159 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.159 INFO:teuthology.orchestra.run.smithi161.stdout:1456 write 0x2e183d3 thru 0x2e24f1d (0xcb4b bytes) 2024-09-21T15:08:06.168 INFO:teuthology.orchestra.run.smithi161.stdout:1459 read 0x17bd5e1 thru 0x17c5e97 (0x88b7 bytes) 2024-09-21T15:08:06.176 INFO:teuthology.orchestra.run.smithi161.stdout:1461 punch from 0x968467 to 0x97036e, (0x7f07 bytes) 2024-09-21T15:08:06.176 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.185 INFO:teuthology.orchestra.run.smithi161.stdout:1833 write 0x260e22b thru 0x26168bf (0x8695 bytes) 2024-09-21T15:08:06.186 INFO:teuthology.orchestra.run.smithi161.stdout:1962 punch from 0x7e9d46 to 0x7f20fb, (0x83b5 bytes) 2024-09-21T15:08:06.186 INFO:teuthology.orchestra.run.smithi161.stdout:1963 write 0x7be1177 thru 0x7be4d04 (0x3b8e bytes) 2024-09-21T15:08:06.187 INFO:teuthology.orchestra.run.smithi161.stdout:1312 trunc from 0xeae775b to 0x91f2297 2024-09-21T15:08:06.199 INFO:teuthology.orchestra.run.smithi161.stdout:1964 read 0x74b1d98 thru 0x74b4fdf (0x3248 bytes) 2024-09-21T15:08:06.199 INFO:teuthology.orchestra.run.smithi161.stdout:1965 writesame 0x5ab3eae thru 0x5ac07e7 data_size 0x2(0xc93a bytes) 2024-09-21T15:08:06.229 INFO:teuthology.orchestra.run.smithi161.stdout:1967 write 0x7d530d8 thru 0x7d545d2 (0x14fb bytes) 2024-09-21T15:08:06.234 INFO:teuthology.orchestra.run.smithi161.stdout:1834 read 0x76bfe09 thru 0x76cd0df (0xd2d7 bytes) 2024-09-21T15:08:06.234 INFO:teuthology.orchestra.run.smithi161.stdout:1837 read 0x7a2719d thru 0x7a3060a (0x946e bytes) 2024-09-21T15:08:06.235 INFO:teuthology.orchestra.run.smithi161.stdout:1838 read 0x1502164 thru 0x1502726 (0x5c3 bytes) 2024-09-21T15:08:06.235 INFO:teuthology.orchestra.run.smithi161.stdout:1839 read 0xaca4834 thru 0xaca964a (0x4e17 bytes) 2024-09-21T15:08:06.235 INFO:teuthology.orchestra.run.smithi161.stdout:1840 writesame 0xd768ef4 thru 0xd77656f data_size 0x6a(0xd67c bytes) 2024-09-21T15:08:06.240 INFO:teuthology.orchestra.run.smithi161.stdout:1464 write 0xe0e0172 thru 0xe0e4f90 (0x4e1f bytes) 2024-09-21T15:08:06.259 INFO:teuthology.orchestra.run.smithi161.stdout:1466 read 0x3a0c7ee thru 0x3a0c87f (0x92 bytes) 2024-09-21T15:08:06.259 INFO:teuthology.orchestra.run.smithi161.stdout:1467 read 0x151d650 thru 0x1520238 (0x2be9 bytes) 2024-09-21T15:08:06.260 INFO:teuthology.orchestra.run.smithi161.stdout:1468 write 0x47b868a thru 0x47c760a (0xef81 bytes) 2024-09-21T15:08:06.265 INFO:teuthology.orchestra.run.smithi161.stdout:1313 read 0x7276a97 thru 0x727c7e4 (0x5d4e bytes) 2024-09-21T15:08:06.265 INFO:teuthology.orchestra.run.smithi161.stdout:1314 punch from 0xe60585 to 0xe6896a, (0x83e5 bytes) 2024-09-21T15:08:06.265 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #12, image image_cluster1.client.mirror.4-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent13 2024-09-21T15:08:06.272 INFO:teuthology.orchestra.run.smithi161.stdout:1844 read 0xdc70769 thru 0xdc7e4c9 (0xdd61 bytes) 2024-09-21T15:08:06.272 INFO:teuthology.orchestra.run.smithi161.stdout:1845 write 0x4eb2d7 thru 0x4f5e09 (0xab33 bytes) 2024-09-21T15:08:06.273 INFO:teuthology.orchestra.run.smithi161.stdout:1968 write 0x883d131 thru 0x884140f (0x42df bytes) 2024-09-21T15:08:06.276 INFO:teuthology.orchestra.run.smithi161.stdout:1412 write 0x589240a thru 0x589961c (0x7213 bytes) 2024-09-21T15:08:06.276 INFO:teuthology.orchestra.run.smithi161.stdout:1469 clone 11 order 18 su 2048 sc 6 2024-09-21T15:08:06.290 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.290 INFO:teuthology.orchestra.run.smithi161.stdout:1414 read 0x83b232 thru 0x84a207 (0xefd6 bytes) 2024-09-21T15:08:06.291 INFO:teuthology.orchestra.run.smithi161.stdout:1846 punch from 0x44a36d6 to 0x44b17bf, (0xe0e9 bytes) 2024-09-21T15:08:06.291 INFO:teuthology.orchestra.run.smithi161.stdout:1847 read 0x83f4e73 thru 0x83f56db (0x869 bytes) 2024-09-21T15:08:06.291 INFO:teuthology.orchestra.run.smithi161.stdout:1848 read 0x750cdce thru 0x7513532 (0x6765 bytes) 2024-09-21T15:08:06.291 INFO:teuthology.orchestra.run.smithi161.stdout:1970 read 0xbd4110 thru 0xbdaeea (0x6ddb bytes) 2024-09-21T15:08:06.292 INFO:teuthology.orchestra.run.smithi161.stdout:1849 read 0x86147e3 thru 0x8619c6c (0x548a bytes) 2024-09-21T15:08:06.292 INFO:teuthology.orchestra.run.smithi161.stdout:1417 read 0x28d38b6 thru 0x28d8f20 (0x566b bytes) 2024-09-21T15:08:06.292 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.292 INFO:teuthology.orchestra.run.smithi161.stdout:1974 write 0x697a476 thru 0x697ca39 (0x25c4 bytes) 2024-09-21T15:08:06.293 INFO:teuthology.orchestra.run.smithi161.stdout:1418 write 0x36cc51 thru 0x377d07 (0xb0b7 bytes) 2024-09-21T15:08:06.299 INFO:teuthology.orchestra.run.smithi161.stdout:1422 read 0x3301939 thru 0x33051fd (0x38c5 bytes) 2024-09-21T15:08:06.299 INFO:teuthology.orchestra.run.smithi161.stdout:1975 read 0x7139ef6 thru 0x7143eec (0x9ff7 bytes) 2024-09-21T15:08:06.300 INFO:teuthology.orchestra.run.smithi161.stdout:1976 read 0x19b4e39 thru 0x19c00eb (0xb2b3 bytes) 2024-09-21T15:08:06.301 INFO:teuthology.orchestra.run.smithi161.stdout:1977 read 0x1663b24 thru 0x166a10b (0x65e8 bytes) 2024-09-21T15:08:06.304 INFO:teuthology.orchestra.run.smithi161.stdout:1978 read 0x4b9aa62 thru 0x4ba2b32 (0x80d1 bytes) 2024-09-21T15:08:06.306 INFO:teuthology.orchestra.run.smithi161.stdout:1979 punch from 0x6f2975b to 0x6f35a7c, (0xc321 bytes) 2024-09-21T15:08:06.306 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.306 INFO:teuthology.orchestra.run.smithi161.stdout:1983 punch from 0x7f9925a to 0x7fa8423, (0xf1c9 bytes) 2024-09-21T15:08:06.306 INFO:teuthology.orchestra.run.smithi161.stdout:1316 write 0x9dc1475 thru 0x9dc6e43 (0x59cf bytes) 2024-09-21T15:08:06.306 INFO:teuthology.orchestra.run.smithi161.stdout:1984 read 0x7dd7d5e thru 0x7dde29f (0x6542 bytes) 2024-09-21T15:08:06.307 INFO:teuthology.orchestra.run.smithi161.stdout:1985 read 0x5d855cf thru 0x5d866e3 (0x1115 bytes) 2024-09-21T15:08:06.307 INFO:teuthology.orchestra.run.smithi161.stdout:1986 read 0x73ccc02 thru 0x73d836a (0xb769 bytes) 2024-09-21T15:08:06.308 INFO:teuthology.orchestra.run.smithi161.stdout:1987 read 0x52d372c thru 0x52e2844 (0xf119 bytes) 2024-09-21T15:08:06.309 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.309 INFO:teuthology.orchestra.run.smithi161.stdout:1989 read 0x83cc211 thru 0x83d7657 (0xb447 bytes) 2024-09-21T15:08:06.312 INFO:teuthology.orchestra.run.smithi161.stdout:1424 trunc from 0x589961d to 0xbbcd552 2024-09-21T15:08:06.320 INFO:teuthology.orchestra.run.smithi161.stdout:1852 trunc from 0xebbefd4 to 0x2ce3b02 2024-09-21T15:08:06.322 INFO:teuthology.orchestra.run.smithi161.stdout:1317 write 0x4c4f0ac thru 0x4c5236f (0x32c4 bytes) 2024-09-21T15:08:06.350 INFO:teuthology.orchestra.run.smithi161.stdout:1993 write 0xd99e2b1 thru 0xd9a370c (0x545c bytes) 2024-09-21T15:08:06.357 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.357 INFO:teuthology.orchestra.run.smithi161.stdout:1426 punch from 0x4631a48 to 0x463ed86, (0xd33e bytes) 2024-09-21T15:08:06.370 INFO:teuthology.orchestra.run.smithi161.stdout:1428 trunc from 0xbbcd552 to 0x56dd7ac 2024-09-21T15:08:06.389 INFO:teuthology.orchestra.run.smithi161.stdout:1995 punch from 0x2519bad to 0x252772f, (0xdb82 bytes) 2024-09-21T15:08:06.389 INFO:teuthology.orchestra.run.smithi161.stdout:1996 read 0xaab9899 thru 0xaac5837 (0xbf9f bytes) 2024-09-21T15:08:06.402 INFO:teuthology.orchestra.run.smithi161.stdout:1997 trunc from 0xd9a370d to 0x52198ac 2024-09-21T15:08:06.517 INFO:teuthology.orchestra.run.smithi161.stdout:1318 write 0xaed074e thru 0xaed163f (0xef2 bytes) 2024-09-21T15:08:06.529 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.529 INFO:teuthology.orchestra.run.smithi161.stdout:1320 punch from 0x19eef4 to 0x1a2c15, (0x3d21 bytes) 2024-09-21T15:08:06.543 INFO:teuthology.orchestra.run.smithi161.stdout:1321 trunc from 0xaed1640 to 0x446d90e 2024-09-21T15:08:06.612 INFO:teuthology.orchestra.run.smithi161.stdout:1429 write 0x21cf428 thru 0x21d62d0 (0x6ea9 bytes) 2024-09-21T15:08:06.688 INFO:teuthology.orchestra.run.smithi161.stdout:1430 read 0x12055ed thru 0x120759c (0x1fb0 bytes) 2024-09-21T15:08:06.701 INFO:teuthology.orchestra.run.smithi161.stdout:1998 read 0x19bc57b thru 0x19c5a85 (0x950b bytes) 2024-09-21T15:08:06.701 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.708 INFO:teuthology.orchestra.run.smithi161.stdout:2001 trunc from 0x52198ac to 0x1b2cdb3 2024-09-21T15:08:06.731 INFO:teuthology.orchestra.run.smithi161.stdout:1431 write 0x8519527 thru 0x851d18f (0x3c69 bytes) 2024-09-21T15:08:06.733 INFO:teuthology.orchestra.run.smithi161.stdout:1853 write 0x6b55f41 thru 0x6b5d9d0 (0x7a90 bytes) 2024-09-21T15:08:06.764 INFO:teuthology.orchestra.run.smithi161.stdout:1322 write 0x4f738ff thru 0x4f7554c (0x1c4e bytes) 2024-09-21T15:08:06.793 INFO:teuthology.orchestra.run.smithi161.stdout:1324 punch from 0x1f3928d to 0x1f3f155, (0x5ec8 bytes) 2024-09-21T15:08:06.795 INFO:teuthology.orchestra.run.smithi161.stdout:1854 read 0x305eb36 thru 0x306929d (0xa768 bytes) 2024-09-21T15:08:06.859 INFO:teuthology.orchestra.run.smithi161.stdout:1432 write 0xc3d422b thru 0xc3dde28 (0x9bfe bytes) 2024-09-21T15:08:06.872 INFO:teuthology.orchestra.run.smithi161.stdout:1855 writesame 0xe601730 thru 0xe602054 data_size 0x1(0x925 bytes) 2024-09-21T15:08:06.873 INFO:teuthology.orchestra.run.smithi161.stdout:1325 write 0xb80b63b thru 0xb80cc28 (0x15ee bytes) 2024-09-21T15:08:06.875 INFO:teuthology.orchestra.run.smithi161.stdout:1856 read 0x576595c thru 0x576c80e (0x6eb3 bytes) 2024-09-21T15:08:06.875 INFO:teuthology.orchestra.run.smithi161.stdout:1858 write 0x640aab8 thru 0x6416bb9 (0xc102 bytes) 2024-09-21T15:08:06.898 INFO:teuthology.orchestra.run.smithi161.stdout:1326 punch from 0x8f61d18 to 0x8f6824c, (0x6534 bytes) 2024-09-21T15:08:06.911 INFO:teuthology.orchestra.run.smithi161.stdout:1327 trunc from 0xb80cc29 to 0x4a7ad06 2024-09-21T15:08:06.930 INFO:teuthology.orchestra.run.smithi161.stdout:1859 read 0xd84163c thru 0xd846c9c (0x5661 bytes) 2024-09-21T15:08:06.930 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:06.930 INFO:teuthology.orchestra.run.smithi161.stdout:1861 writesame 0x4655d1d thru 0x4660adc data_size 0x8b(0xadc0 bytes) 2024-09-21T15:08:06.939 INFO:teuthology.orchestra.run.smithi161.stdout:1433 read 0x8b15e93 thru 0x8b1658c (0x6fa bytes) 2024-09-21T15:08:06.940 INFO:teuthology.orchestra.run.smithi161.stdout:1435 trunc from 0xc3dde29 to 0xcac5c59 2024-09-21T15:08:06.966 INFO:teuthology.orchestra.run.smithi161.stdout:1328 punch from 0x3d91c29 to 0x3d992c0, (0x7697 bytes) 2024-09-21T15:08:06.992 INFO:teuthology.orchestra.run.smithi161.stdout:1329 trunc from 0x4a7ad06 to 0xd0d9e87 2024-09-21T15:08:07.014 INFO:teuthology.orchestra.run.smithi161.stdout:1436 clone 12 order 23 su 131072 sc 11 2024-09-21T15:08:07.025 INFO:teuthology.orchestra.run.smithi161.stdout:1862 write 0x558d324 thru 0x558ef0e (0x1beb bytes) 2024-09-21T15:08:07.039 INFO:teuthology.orchestra.run.smithi161.stdout:1330 write 0x7437f38 thru 0x743ab8c (0x2c55 bytes) 2024-09-21T15:08:07.073 INFO:teuthology.orchestra.run.smithi161.stdout:1332 clone 15 order 18 su 32768 sc 12 2024-09-21T15:08:07.075 INFO:teuthology.orchestra.run.smithi161.stdout:1863 trunc from 0xe602055 to 0x933a755 2024-09-21T15:08:07.119 INFO:teuthology.orchestra.run.smithi161.stdout:2002 read 0x9fc6f9 thru 0x9fe608 (0x1f10 bytes) 2024-09-21T15:08:07.120 INFO:teuthology.orchestra.run.smithi161.stdout:2003 read 0x1293ac9 thru 0x1297ecf (0x4407 bytes) 2024-09-21T15:08:07.167 INFO:teuthology.orchestra.run.smithi161.stdout:1864 write 0x426b85b thru 0x427055d (0x4d03 bytes) 2024-09-21T15:08:07.239 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone10 from 0xe0e4f91 (overlap 0xbe6e52) to 0x4c2c20 2024-09-21T15:08:07.290 INFO:teuthology.orchestra.run.smithi161.stdout:2004 write 0xc42243f thru 0xc429691 (0x7253 bytes) 2024-09-21T15:08:07.300 INFO:teuthology.orchestra.run.smithi161.stdout:1866 write 0x6ded4f9 thru 0x6df324e (0x5d56 bytes) 2024-09-21T15:08:07.304 INFO:teuthology.orchestra.run.smithi161.stdout:2006 read 0x97facb1 thru 0x980ab1f (0xfe6f bytes) 2024-09-21T15:08:07.304 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:07.304 INFO:teuthology.orchestra.run.smithi161.stdout:2009 writesame 0xaefa9ae thru 0xaf01645 data_size 0x32(0x6c98 bytes) 2024-09-21T15:08:07.334 INFO:teuthology.orchestra.run.smithi161.stdout:1867 read 0x785ff4e thru 0x786c214 (0xc2c7 bytes) 2024-09-21T15:08:07.341 INFO:teuthology.orchestra.run.smithi161.stdout:1869 trunc from 0x933a755 to 0x5a52ea7 2024-09-21T15:08:07.349 INFO:teuthology.orchestra.run.smithi161.stdout:2012 trunc from 0xc429692 to 0x1fe1244 2024-09-21T15:08:07.407 INFO:teuthology.orchestra.run.smithi161.stdout:1870 read 0xb5e3f9 thru 0xb6af8e (0xcb96 bytes) 2024-09-21T15:08:07.420 INFO:teuthology.orchestra.run.smithi161.stdout:2014 trunc from 0x1fe1244 to 0x97b0c26 2024-09-21T15:08:07.445 INFO:teuthology.orchestra.run.smithi161.stdout:1872 write 0xa595a93 thru 0xa5a54e7 (0xfa55 bytes) 2024-09-21T15:08:07.475 INFO:teuthology.orchestra.run.smithi161.stdout:1873 clone 10 order 22 su 32768 sc 8 2024-09-21T15:08:07.480 INFO:teuthology.orchestra.run.smithi161.stdout:2015 write 0xd016206 thru 0xd0235c4 (0xd3bf bytes) 2024-09-21T15:08:07.487 INFO:teuthology.orchestra.run.smithi161.stdout:2017 read 0x111918b thru 0x111dc2d (0x4aa3 bytes) 2024-09-21T15:08:07.488 INFO:teuthology.orchestra.run.smithi161.stdout:2018 read 0x5da0353 thru 0x5da5a53 (0x5701 bytes) 2024-09-21T15:08:07.488 INFO:teuthology.orchestra.run.smithi161.stdout:2019 write 0xaf9f450 thru 0xafabe8b (0xca3c bytes) 2024-09-21T15:08:07.498 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #9, image image_cluster1.client.mirror.1-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent10 2024-09-21T15:08:07.500 INFO:teuthology.orchestra.run.smithi161.stdout:2020 write 0x6c31221 thru 0x6c320c9 (0xea9 bytes) 2024-09-21T15:08:07.509 INFO:teuthology.orchestra.run.smithi161.stdout:1419 punch from 0x1bcf21c to 0x1bda826, (0xb60a bytes) 2024-09-21T15:08:07.525 INFO:teuthology.orchestra.run.smithi161.stdout:2021 trunc from 0xd0235c5 to 0x20d525b 2024-09-21T15:08:07.529 INFO:teuthology.orchestra.run.smithi161.stdout:1422 writesame 0x1e88ab1 thru 0x1e9624a data_size 0x3(0xd79a bytes) 2024-09-21T15:08:07.738 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:07.738 INFO:teuthology.orchestra.run.smithi161.stdout:2023 punch from 0x5b28d8 to 0x5c2634, (0xfd5c bytes) 2024-09-21T15:08:07.807 INFO:teuthology.orchestra.run.smithi161.stdout:1423 writesame 0xe873b5e thru 0xe87745d data_size 0x60(0x3900 bytes) 2024-09-21T15:08:07.870 INFO:teuthology.orchestra.run.smithi161.stdout:1424 writesame 0x95af66c thru 0x95b0755 data_size 0x5(0x10ea bytes) 2024-09-21T15:08:07.879 INFO:teuthology.orchestra.run.smithi161.stdout:2025 writesame 0xa773621 thru 0xa782c8b data_size 0x1(0xf66b bytes) 2024-09-21T15:08:07.885 INFO:teuthology.orchestra.run.smithi161.stdout:2029 write 0x96d922b thru 0x96e2f5f (0x9d35 bytes) 2024-09-21T15:08:07.902 INFO:teuthology.orchestra.run.smithi161.stdout:1425 write 0x76d4884 thru 0x76e0869 (0xbfe6 bytes) 2024-09-21T15:08:08.007 INFO:teuthology.orchestra.run.smithi161.stdout:1426 writesame 0x1ee8435 thru 0x1eeda27 data_size 0x1(0x55f3 bytes) 2024-09-21T15:08:08.009 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:08.011 INFO:teuthology.orchestra.run.smithi161.stdout:2031 trunc from 0xa782c8c to 0xbf87070 2024-09-21T15:08:08.020 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone9 from 0xa5a54e8 (overlap 0xaced2c) to 0x8a5756 2024-09-21T15:08:08.044 INFO:teuthology.orchestra.run.smithi161.stdout:1427 read 0x99a2b8b thru 0x99a8a1c (0x5e92 bytes) 2024-09-21T15:08:08.049 INFO:teuthology.orchestra.run.smithi161.stdout:1429 write 0x83302f5 thru 0x833b502 (0xb20e bytes) 2024-09-21T15:08:08.062 INFO:teuthology.orchestra.run.smithi161.stdout:2032 writesame 0x37607 thru 0x3c1c0 data_size 0x1b(0x4bba bytes) 2024-09-21T15:08:08.088 INFO:teuthology.orchestra.run.smithi161.stdout:1430 write 0x27664e0 thru 0x276cb60 (0x6681 bytes) 2024-09-21T15:08:08.096 INFO:teuthology.orchestra.run.smithi161.stdout:2033 read 0xb4d0a9a thru 0xb4dc055 (0xb5bc bytes) 2024-09-21T15:08:08.097 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:08.097 INFO:teuthology.orchestra.run.smithi161.stdout:2035 punch from 0x1250b0d to 0x125f934, (0xee27 bytes) 2024-09-21T15:08:08.127 INFO:teuthology.orchestra.run.smithi161.stdout:1431 write 0x19bf372 thru 0x19c6df4 (0x7a83 bytes) 2024-09-21T15:08:08.139 INFO:teuthology.orchestra.run.smithi161.stdout:2037 write 0xde28bfb thru 0xde32ac6 (0x9ecc bytes) 2024-09-21T15:08:08.151 INFO:teuthology.orchestra.run.smithi161.stdout:2039 read 0x836537 thru 0x83c19d (0x5c67 bytes) 2024-09-21T15:08:08.152 INFO:teuthology.orchestra.run.smithi161.stdout:2040 write 0x91e253e thru 0x91e3081 (0xb44 bytes) 2024-09-21T15:08:08.154 INFO:teuthology.orchestra.run.smithi161.stdout:1432 punch from 0xe65f65f to 0xe660888, (0x1229 bytes) 2024-09-21T15:08:08.156 INFO:teuthology.orchestra.run.smithi161.stdout:1433 write 0xc0ded16 thru 0xc0e5c68 (0x6f53 bytes) 2024-09-21T15:08:08.168 INFO:teuthology.orchestra.run.smithi161.stdout:2041 write 0xcf78d52 thru 0xcf88ce4 (0xff93 bytes) 2024-09-21T15:08:08.177 INFO:teuthology.orchestra.run.smithi161.stdout:1435 punch from 0x9666bc0 to 0x9667041, (0x481 bytes) 2024-09-21T15:08:08.181 INFO:teuthology.orchestra.run.smithi161.stdout:2044 punch from 0x897a06c to 0x897a134, (0xc8 bytes) 2024-09-21T15:08:08.181 INFO:teuthology.orchestra.run.smithi161.stdout:2045 read 0x3aee10a thru 0x3af752c (0x9423 bytes) 2024-09-21T15:08:08.181 INFO:teuthology.orchestra.run.smithi161.stdout:2046 writesame 0xd4d033c thru 0xd4d046a data_size 0x1(0x12f bytes) 2024-09-21T15:08:08.188 INFO:teuthology.orchestra.run.smithi161.stdout:2047 writesame 0x33b6a93 thru 0x33bcb9c data_size 0x1(0x610a bytes) 2024-09-21T15:08:08.190 INFO:teuthology.orchestra.run.smithi161.stdout:1436 trunc from 0xe87745e to 0x897333f 2024-09-21T15:08:08.217 INFO:teuthology.orchestra.run.smithi161.stdout:2048 write 0x3abc815 thru 0x3ac1b52 (0x533e bytes) 2024-09-21T15:08:08.225 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:08.225 INFO:teuthology.orchestra.run.smithi161.stdout:1472 write 0x197e7d8 thru 0x1985a36 (0x725f bytes) 2024-09-21T15:08:08.231 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #13, image image_cluster1.client.mirror.3-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent14 2024-09-21T15:08:08.237 INFO:teuthology.orchestra.run.smithi161.stdout:2049 write 0x917c2b4 thru 0x9188d54 (0xcaa1 bytes) 2024-09-21T15:08:08.259 INFO:teuthology.orchestra.run.smithi161.stdout:2050 writesame 0xa1c66b5 thru 0xa1d160a data_size 0x3(0xaf56 bytes) 2024-09-21T15:08:08.273 INFO:teuthology.orchestra.run.smithi161.stdout:2051 write 0x7409f8f thru 0x74101e6 (0x6258 bytes) 2024-09-21T15:08:08.285 INFO:teuthology.orchestra.run.smithi161.stdout:2052 read 0x9488f3c thru 0x9496052 (0xd117 bytes) 2024-09-21T15:08:08.286 INFO:teuthology.orchestra.run.smithi161.stdout:2053 write 0xd7dbb54 thru 0xd7e8892 (0xcd3f bytes) 2024-09-21T15:08:08.306 INFO:teuthology.orchestra.run.smithi161.stdout:2054 trunc from 0xde32ac7 to 0x80315d9 2024-09-21T15:08:08.315 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #10, image image_cluster1.client.mirror.5-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent11 2024-09-21T15:08:08.322 INFO:teuthology.orchestra.run.smithi161.stdout:1437 write 0xba0a5bf thru 0xba190e6 (0xeb28 bytes) 2024-09-21T15:08:08.341 INFO:teuthology.orchestra.run.smithi161.stdout:1439 read 0x81f456e thru 0x81f763b (0x30ce bytes) 2024-09-21T15:08:08.342 INFO:teuthology.orchestra.run.smithi161.stdout:1440 read 0x9a486cd thru 0x9a5479b (0xc0cf bytes) 2024-09-21T15:08:08.353 INFO:teuthology.orchestra.run.smithi161.stdout:1441 trunc from 0xba190e7 to 0x6cda1c6 2024-09-21T15:08:08.353 INFO:teuthology.orchestra.run.smithi161.stdout:1437 read 0xbd262af thru 0xbd33a38 (0xd78a bytes) 2024-09-21T15:08:08.432 INFO:teuthology.orchestra.run.smithi161.stdout:1438 read 0x53ff31b thru 0x54045dd (0x52c3 bytes) 2024-09-21T15:08:08.433 INFO:teuthology.orchestra.run.smithi161.stdout:1439 write 0x1762ae9 thru 0x17674bd (0x49d5 bytes) 2024-09-21T15:08:08.499 INFO:teuthology.orchestra.run.smithi161.stdout:1442 read 0x4773423 thru 0x477d69b (0xa279 bytes) 2024-09-21T15:08:08.503 INFO:teuthology.orchestra.run.smithi161.stdout:1440 read 0x8b9b849 thru 0x8baac00 (0xf3b8 bytes) 2024-09-21T15:08:08.504 INFO:teuthology.orchestra.run.smithi161.stdout:1441 read 0x3cbf26e thru 0x3cc5f31 (0x6cc4 bytes) 2024-09-21T15:08:08.525 INFO:teuthology.orchestra.run.smithi161.stdout:1443 trunc from 0xcac5c59 to 0x103c798 2024-09-21T15:08:08.564 INFO:teuthology.orchestra.run.smithi161.stdout:1443 write 0xb56732a thru 0xb575941 (0xe618 bytes) 2024-09-21T15:08:08.621 INFO:teuthology.orchestra.run.smithi161.stdout:1444 punch from 0x37bf86a to 0x37c4261, (0x49f7 bytes) 2024-09-21T15:08:08.622 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:08.622 INFO:teuthology.orchestra.run.smithi161.stdout:1448 write 0x4eb2a83 thru 0x4ec09b2 (0xdf30 bytes) 2024-09-21T15:08:08.626 INFO:teuthology.orchestra.run.smithi161.stdout:1333 read 0x714328f thru 0x7151dbe (0xeb30 bytes) 2024-09-21T15:08:08.660 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:08.660 INFO:teuthology.orchestra.run.smithi161.stdout:1336 read 0x2a52bc8 thru 0x2a5d272 (0xa6ab bytes) 2024-09-21T15:08:08.663 INFO:teuthology.orchestra.run.smithi161.stdout:1473 write 0xa9d0160 thru 0xa9d8334 (0x81d5 bytes) 2024-09-21T15:08:08.669 INFO:teuthology.orchestra.run.smithi161.stdout:1337 read 0x3416209 thru 0x3418840 (0x2638 bytes) 2024-09-21T15:08:08.669 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:08.670 INFO:teuthology.orchestra.run.smithi161.stdout:1339 write 0xae59734 thru 0xae606e9 (0x6fb6 bytes) 2024-09-21T15:08:08.682 INFO:teuthology.orchestra.run.smithi161.stdout:1449 write 0x989a435 thru 0x98a8b80 (0xe74c bytes) 2024-09-21T15:08:08.694 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:08.694 INFO:teuthology.orchestra.run.smithi161.stdout:1342 punch from 0x523f8a3 to 0x524d7fd, (0xdf5a bytes) 2024-09-21T15:08:08.694 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:08.694 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:08.694 INFO:teuthology.orchestra.run.smithi161.stdout:1345 writesame 0x554a340 thru 0x5551cc6 data_size 0x1(0x7987 bytes) 2024-09-21T15:08:08.708 INFO:teuthology.orchestra.run.smithi161.stdout:1474 write 0x5ac4f92 thru 0x5ac8c01 (0x3c70 bytes) 2024-09-21T15:08:08.726 INFO:teuthology.orchestra.run.smithi161.stdout:1450 read 0xa1ab1a3 thru 0xa1b0f05 (0x5d63 bytes) 2024-09-21T15:08:08.749 INFO:teuthology.orchestra.run.smithi161.stdout:1346 read 0xaf21dfc thru 0xaf27c65 (0x5e6a bytes) 2024-09-21T15:08:08.755 INFO:teuthology.orchestra.run.smithi161.stdout:1476 write 0xb6805a3 thru 0xb68f26e (0xeccc bytes) 2024-09-21T15:08:08.765 INFO:teuthology.orchestra.run.smithi161.stdout:1350 trunc from 0xd0d9e87 to 0x47dc345 2024-09-21T15:08:08.802 INFO:teuthology.orchestra.run.smithi161.stdout:1451 write 0xeadc1f8 thru 0xeadf1d2 (0x2fdb bytes) 2024-09-21T15:08:08.804 INFO:teuthology.orchestra.run.smithi161.stdout:1477 read 0x2ed1c21 thru 0x2ed3698 (0x1a78 bytes) 2024-09-21T15:08:08.806 INFO:teuthology.orchestra.run.smithi161.stdout:1478 writesame 0xd0ad5e6 thru 0xd0b346d data_size 0x37(0x5e88 bytes) 2024-09-21T15:08:08.836 INFO:teuthology.orchestra.run.smithi161.stdout:1455 trunc from 0xeadf1d3 to 0xde76518 2024-09-21T15:08:08.865 INFO:teuthology.orchestra.run.smithi161.stdout:1351 write 0x4f3b990 thru 0x4f3ed4d (0x33be bytes) 2024-09-21T15:08:08.875 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:08.875 INFO:teuthology.orchestra.run.smithi161.stdout:1355 read 0x26e9d9a thru 0x26f433c (0xa5a3 bytes) 2024-09-21T15:08:08.876 INFO:teuthology.orchestra.run.smithi161.stdout:1357 read 0x38f6087 thru 0x39032cd (0xd247 bytes) 2024-09-21T15:08:08.876 INFO:teuthology.orchestra.run.smithi161.stdout:1358 read 0xd2aada thru 0xd361c2 (0xb6e9 bytes) 2024-09-21T15:08:08.879 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #8, image image_cluster1.client.mirror.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent9 2024-09-21T15:08:08.882 INFO:teuthology.orchestra.run.smithi161.stdout:2055 punch from 0x18cd6d4 to 0x18d5c1a, (0x8546 bytes) 2024-09-21T15:08:08.882 INFO:teuthology.orchestra.run.smithi161.stdout:2056 read 0x44fbd6a thru 0x4505c20 (0x9eb7 bytes) 2024-09-21T15:08:08.885 INFO:teuthology.orchestra.run.smithi161.stdout:2057 trunc from 0x80315d9 to 0x900087b 2024-09-21T15:08:08.917 INFO:teuthology.orchestra.run.smithi161.stdout:1479 trunc from 0xe0e4f91 to 0x142e86f 2024-09-21T15:08:08.921 INFO:teuthology.orchestra.run.smithi161.stdout:2058 read 0x8cf1f9b thru 0x8cfa435 (0x849b bytes) 2024-09-21T15:08:08.921 INFO:teuthology.orchestra.run.smithi161.stdout:2059 punch from 0x6f8275a to 0x6f8778e, (0x5034 bytes) 2024-09-21T15:08:08.923 INFO:teuthology.orchestra.run.smithi161.stdout:1359 write 0x772e99c thru 0x773b724 (0xcd89 bytes) 2024-09-21T15:08:08.929 INFO:teuthology.orchestra.run.smithi161.stdout:1456 punch from 0x26e9a35 to 0x26ea0eb, (0x6b6 bytes) 2024-09-21T15:08:08.937 INFO:teuthology.orchestra.run.smithi161.stdout:2060 trunc from 0x900087b to 0x3afdac 2024-09-21T15:08:08.939 INFO:teuthology.orchestra.run.smithi161.stdout:1360 read 0x13b06ed thru 0x13bf2d7 (0xebeb bytes) 2024-09-21T15:08:08.940 INFO:teuthology.orchestra.run.smithi161.stdout:1361 writesame 0x21f5afa thru 0x220193f data_size 0x5(0xbe46 bytes) 2024-09-21T15:08:08.943 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:08.943 INFO:teuthology.orchestra.run.smithi161.stdout:1445 read 0x9d5430 thru 0x9db276 (0x5e47 bytes) 2024-09-21T15:08:08.973 INFO:teuthology.orchestra.run.smithi161.stdout:1362 read 0x255d309 thru 0x256b24f (0xdf47 bytes) 2024-09-21T15:08:08.974 INFO:teuthology.orchestra.run.smithi161.stdout:1363 read 0xab540e thru 0xabc3a7 (0x6f9a bytes) 2024-09-21T15:08:08.976 INFO:teuthology.orchestra.run.smithi161.stdout:1365 read 0x2611c1a thru 0x261dd6b (0xc152 bytes) 2024-09-21T15:08:08.977 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:08.983 INFO:teuthology.orchestra.run.smithi161.stdout:1458 writesame 0xe948a8f thru 0xe94f327 data_size 0x1(0x6899 bytes) 2024-09-21T15:08:08.985 INFO:teuthology.orchestra.run.smithi161.stdout:1459 write 0x827fc76 thru 0x8288738 (0x8ac3 bytes) 2024-09-21T15:08:08.987 INFO:teuthology.orchestra.run.smithi161.stdout:1367 trunc from 0x773b725 to 0xdf24115 2024-09-21T15:08:08.994 INFO:teuthology.orchestra.run.smithi161.stdout:1446 write 0xba3d625 thru 0xba3d953 (0x32f bytes) 2024-09-21T15:08:09.007 INFO:teuthology.orchestra.run.smithi161.stdout:2061 read 0x35cc90 thru 0x363432 (0x67a3 bytes) 2024-09-21T15:08:09.019 INFO:teuthology.orchestra.run.smithi161.stdout:1368 write 0x44cde3d thru 0x44d34a5 (0x5669 bytes) 2024-09-21T15:08:09.036 INFO:teuthology.orchestra.run.smithi161.stdout:2062 punch from 0x13ff2c to 0x14c993, (0xca67 bytes) 2024-09-21T15:08:09.037 INFO:teuthology.orchestra.run.smithi161.stdout:2064 read 0x1a84c1 thru 0x1ad2fd (0x4e3d bytes) 2024-09-21T15:08:09.037 INFO:teuthology.orchestra.run.smithi161.stdout:1369 read 0x30f8781 thru 0x3104657 (0xbed7 bytes) 2024-09-21T15:08:09.038 INFO:teuthology.orchestra.run.smithi161.stdout:1370 read 0x223e95f thru 0x224437a (0x5a1c bytes) 2024-09-21T15:08:09.045 INFO:teuthology.orchestra.run.smithi161.stdout:1447 punch from 0x69c9284 to 0x69cd37c, (0x40f8 bytes) 2024-09-21T15:08:09.045 INFO:teuthology.orchestra.run.smithi161.stdout:1448 writesame 0x74e4b82 thru 0x74f1ea8 data_size 0x13(0xd327 bytes) 2024-09-21T15:08:09.046 INFO:teuthology.orchestra.run.smithi161.stdout:1460 read 0xe42b2a4 thru 0xe435f6a (0xacc7 bytes) 2024-09-21T15:08:09.046 INFO:teuthology.orchestra.run.smithi161.stdout:1461 read 0x1927b66 thru 0x1933859 (0xbcf4 bytes) 2024-09-21T15:08:09.048 INFO:teuthology.orchestra.run.smithi161.stdout:1462 writesame 0x8834d1e thru 0x8842ae3 data_size 0x1(0xddc6 bytes) 2024-09-21T15:08:09.053 INFO:teuthology.orchestra.run.smithi161.stdout:1371 trunc from 0xdf24115 to 0x628bbd0 2024-09-21T15:08:09.057 INFO:teuthology.orchestra.run.smithi161.stdout:1449 writesame 0x5f74153 thru 0x5f75fda data_size 0x4(0x1e88 bytes) 2024-09-21T15:08:09.090 INFO:teuthology.orchestra.run.smithi161.stdout:1464 write 0x65b4f82 thru 0x65b8745 (0x37c4 bytes) 2024-09-21T15:08:09.091 INFO:teuthology.orchestra.run.smithi161.stdout:1451 writesame 0x1cac8a0 thru 0x1cb502b data_size 0x32(0x878c bytes) 2024-09-21T15:08:09.099 INFO:teuthology.orchestra.run.smithi161.stdout:2065 writesame 0x99b9db thru 0x9a3182 data_size 0x1c(0x77a8 bytes) 2024-09-21T15:08:09.100 INFO:teuthology.orchestra.run.smithi161.stdout:1452 writesame 0xae219ec thru 0xae21e6c data_size 0x1(0x481 bytes) 2024-09-21T15:08:09.103 INFO:teuthology.orchestra.run.smithi161.stdout:1466 punch from 0x5145afb to 0x515455b, (0xea60 bytes) 2024-09-21T15:08:09.103 INFO:teuthology.orchestra.run.smithi161.stdout:1469 writesame 0x4e3d97e thru 0x4e3e284 data_size 0x1(0x907 bytes) 2024-09-21T15:08:09.110 INFO:teuthology.orchestra.run.smithi161.stdout:1372 punch from 0x4dfea91 to 0x4e0053a, (0x1aa9 bytes) 2024-09-21T15:08:09.110 INFO:teuthology.orchestra.run.smithi161.stdout:1373 punch from 0x55ca75a to 0x55d52c9, (0xab6f bytes) 2024-09-21T15:08:09.110 INFO:teuthology.orchestra.run.smithi161.stdout:1374 read 0x3ab7ee3 thru 0x3abca34 (0x4b52 bytes) 2024-09-21T15:08:09.110 INFO:teuthology.orchestra.run.smithi161.stdout:1375 read 0x34230d5 thru 0x3425381 (0x22ad bytes) 2024-09-21T15:08:09.110 INFO:teuthology.orchestra.run.smithi161.stdout:1376 read 0x1a94c64 thru 0x1a9ef40 (0xa2dd bytes) 2024-09-21T15:08:09.114 INFO:teuthology.orchestra.run.smithi161.stdout:1472 writesame 0xdb59f92 thru 0xdb68309 data_size 0x74(0xe378 bytes) 2024-09-21T15:08:09.128 INFO:teuthology.orchestra.run.smithi161.stdout:1377 trunc from 0x628bbd0 to 0x2370a97 2024-09-21T15:08:09.166 INFO:teuthology.orchestra.run.smithi161.stdout:1454 write 0x429f98c thru 0x42a1016 (0x168b bytes) 2024-09-21T15:08:09.170 INFO:teuthology.orchestra.run.smithi161.stdout:2069 write 0x77d3f51 thru 0x77dde3d (0x9eed bytes) 2024-09-21T15:08:09.176 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.176 INFO:teuthology.orchestra.run.smithi161.stdout:1457 write 0x6d5b93e thru 0x6d6a1ec (0xe8af bytes) 2024-09-21T15:08:09.194 INFO:teuthology.orchestra.run.smithi161.stdout:2071 write 0x3d68ace thru 0x3d775f8 (0xeb2b bytes) 2024-09-21T15:08:09.194 INFO:teuthology.orchestra.run.smithi161.stdout:1473 punch from 0x800712e to 0x800c651, (0x5523 bytes) 2024-09-21T15:08:09.194 INFO:teuthology.orchestra.run.smithi161.stdout:1474 write 0x6d4589e thru 0x6d483ea (0x2b4d bytes) 2024-09-21T15:08:09.204 INFO:teuthology.orchestra.run.smithi161.stdout:1458 writesame 0x614710d thru 0x614c83e data_size 0x1(0x5732 bytes) 2024-09-21T15:08:09.210 INFO:teuthology.orchestra.run.smithi161.stdout:1475 writesame 0xcdf7907 thru 0xcdfbe43 data_size 0x5(0x453d bytes) 2024-09-21T15:08:09.214 INFO:teuthology.orchestra.run.smithi161.stdout:2072 writesame 0x6b54f10 thru 0x6b5b3ce data_size 0x1(0x64bf bytes) 2024-09-21T15:08:09.231 INFO:teuthology.orchestra.run.smithi161.stdout:1480 read 0x7ff835 thru 0x8038be (0x408a bytes) 2024-09-21T15:08:09.232 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.232 INFO:teuthology.orchestra.run.smithi161.stdout:1479 writesame 0xd4de0b3 thru 0xd4eba4f data_size 0x1d(0xd99d bytes) 2024-09-21T15:08:09.238 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.238 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.238 INFO:teuthology.orchestra.run.smithi161.stdout:1461 read 0x2dc151a thru 0x2dd0478 (0xef5f bytes) 2024-09-21T15:08:09.239 INFO:teuthology.orchestra.run.smithi161.stdout:1462 write 0x9e2caee thru 0x9e3c7e4 (0xfcf7 bytes) 2024-09-21T15:08:09.245 INFO:teuthology.orchestra.run.smithi161.stdout:2073 read 0x5cb8362 thru 0x5cc337d (0xb01c bytes) 2024-09-21T15:08:09.245 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.245 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.245 INFO:teuthology.orchestra.run.smithi161.stdout:1484 punch from 0x13bcc8d to 0x13c9cdc, (0xd04f bytes) 2024-09-21T15:08:09.245 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.249 INFO:teuthology.orchestra.run.smithi161.stdout:1480 read 0x4811be0 thru 0x4814370 (0x2791 bytes) 2024-09-21T15:08:09.250 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.250 INFO:teuthology.orchestra.run.smithi161.stdout:1482 write 0x74bae27 thru 0x74bda00 (0x2bda bytes) 2024-09-21T15:08:09.251 INFO:teuthology.orchestra.run.smithi161.stdout:2075 trunc from 0x77dde3e to 0x9ff35e8 2024-09-21T15:08:09.253 INFO:teuthology.orchestra.run.smithi161.stdout:1463 writesame 0x21f3ff5 thru 0x2202deb data_size 0x1(0xedf7 bytes) 2024-09-21T15:08:09.267 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.267 INFO:teuthology.orchestra.run.smithi161.stdout:1484 read 0x5af50da thru 0x5afaaf8 (0x5a1f bytes) 2024-09-21T15:08:09.267 INFO:teuthology.orchestra.run.smithi161.stdout:1485 writesame 0x17642d7 thru 0x176dea3 data_size 0x5(0x9bcd bytes) 2024-09-21T15:08:09.292 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:09.290+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cbdb6000 handle_clone_image: failed to clone image mirror/10b71835cc9f to image_cluster1.client.mirror.5-clone12 2024-09-21T15:08:09.297 INFO:teuthology.orchestra.run.smithi161.stdout:1464 write 0x6fa860e thru 0x6fac62e (0x4021 bytes) 2024-09-21T15:08:09.300 INFO:teuthology.orchestra.run.smithi161.stdout:1486 punch from 0xd632185 to 0xd633a0c, (0x1887 bytes) 2024-09-21T15:08:09.300 INFO:teuthology.orchestra.run.smithi161.stdout:1487 read 0x422a9c thru 0x427c1e (0x5183 bytes) 2024-09-21T15:08:09.301 INFO:teuthology.orchestra.run.smithi161.stdout:1378 write 0x36c2ba0 thru 0x36d17c4 (0xec25 bytes) 2024-09-21T15:08:09.301 INFO:teuthology.orchestra.run.smithi161.stdout:1488 write 0xd76772e thru 0xd771254 (0x9b27 bytes) 2024-09-21T15:08:09.303 INFO:teuthology.orchestra.run.smithi161.stdout:1485 write 0xda4d2b0 thru 0xda4d70e (0x45f bytes) 2024-09-21T15:08:09.316 INFO:teuthology.orchestra.run.smithi161.stdout:1465 punch from 0xa4dfde1 to 0xa4e6798, (0x69b7 bytes) 2024-09-21T15:08:09.316 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.317 INFO:teuthology.orchestra.run.smithi161.stdout:1468 read 0x869419e thru 0x8694c7a (0xadd bytes) 2024-09-21T15:08:09.317 INFO:teuthology.orchestra.run.smithi161.stdout:1470 read 0x1ad7103 thru 0x1adeaeb (0x79e9 bytes) 2024-09-21T15:08:09.317 INFO:teuthology.orchestra.run.smithi161.stdout:1472 read 0x99c7c49 thru 0x99c9149 (0x1501 bytes) 2024-09-21T15:08:09.317 INFO:teuthology.orchestra.run.smithi161.stdout:1473 writesame 0x1486b1e thru 0x1486db7 data_size 0x9(0x29a bytes) 2024-09-21T15:08:09.325 INFO:teuthology.orchestra.run.smithi161.stdout:1489 write 0x24254d8 thru 0x2433cb9 (0xe7e2 bytes) 2024-09-21T15:08:09.327 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.327 INFO:teuthology.orchestra.run.smithi161.stdout:2081 writesame 0x939166a thru 0x9394187 data_size 0x1(0x2b1e bytes) 2024-09-21T15:08:09.330 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.330 INFO:teuthology.orchestra.run.smithi161.stdout:1475 write 0xb888773 thru 0xb88ef27 (0x67b5 bytes) 2024-09-21T15:08:09.335 INFO:teuthology.orchestra.run.smithi161.stdout:1486 trunc from 0xda4d70f to 0x85d407f 2024-09-21T15:08:09.342 INFO:teuthology.orchestra.run.smithi161.stdout:1476 read 0x5894ad0 thru 0x5896c21 (0x2152 bytes) 2024-09-21T15:08:09.343 INFO:teuthology.orchestra.run.smithi161.stdout:1477 punch from 0xb8e6be1 to 0xb8f3d0c, (0xd12b bytes) 2024-09-21T15:08:09.343 INFO:teuthology.orchestra.run.smithi161.stdout:1478 write 0xa5ca113 thru 0xa5d206c (0x7f5a bytes) 2024-09-21T15:08:09.344 INFO:teuthology.orchestra.run.smithi161.stdout:2083 read 0x96060d0 thru 0x9610500 (0xa431 bytes) 2024-09-21T15:08:09.344 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.345 INFO:teuthology.orchestra.run.smithi161.stdout:2087 clone 11 order 22 su 32768 sc 13 2024-09-21T15:08:09.354 INFO:teuthology.orchestra.run.smithi161.stdout:1479 writesame 0x16586ef thru 0x166366d data_size 0x1(0xaf7f bytes) 2024-09-21T15:08:09.362 INFO:teuthology.orchestra.run.smithi161.stdout:1874 writesame 0x393796b thru 0x393fa32 data_size 0x34(0x80c8 bytes) 2024-09-21T15:08:09.370 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.371 INFO:teuthology.orchestra.run.smithi161.stdout:1491 write 0xd29423f thru 0xd2a3c6a (0xfa2c bytes) 2024-09-21T15:08:09.385 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.385 INFO:teuthology.orchestra.run.smithi161.stdout:1492 write 0x5d5407b thru 0x5d5b83f (0x77c5 bytes) 2024-09-21T15:08:09.393 INFO:teuthology.orchestra.run.smithi161.stdout:1379 writesame 0xd5d3fb2 thru 0xd5dc938 data_size 0x13(0x8987 bytes) 2024-09-21T15:08:09.395 INFO:teuthology.orchestra.run.smithi161.stdout:1493 write 0x9e67b4e thru 0x9e7255f (0xaa12 bytes) 2024-09-21T15:08:09.397 INFO:teuthology.orchestra.run.smithi161.stdout:1380 writesame 0x22a1b6d thru 0x22b0393 data_size 0x1(0xe827 bytes) 2024-09-21T15:08:09.407 INFO:teuthology.orchestra.run.smithi161.stdout:1487 trunc from 0x85d407f to 0x59ebf27 2024-09-21T15:08:09.420 INFO:teuthology.orchestra.run.smithi161.stdout:1495 write 0x5bc6d40 thru 0x5bc71ad (0x46e bytes) 2024-09-21T15:08:09.428 INFO:teuthology.orchestra.run.smithi161.stdout:1496 writesame 0x9a5ebbb thru 0x9a64a72 data_size 0x1c(0x5eb8 bytes) 2024-09-21T15:08:09.429 INFO:teuthology.orchestra.run.smithi161.stdout:1381 write 0x366b0af thru 0x3674f5f (0x9eb1 bytes) 2024-09-21T15:08:09.437 INFO:teuthology.orchestra.run.smithi161.stdout:1481 writesame 0xbd0a16a thru 0xbd17d0e data_size 0x1(0xdba5 bytes) 2024-09-21T15:08:09.446 INFO:teuthology.orchestra.run.smithi161.stdout:1483 read 0x151fbe5 thru 0x152a68e (0xaaaa bytes) 2024-09-21T15:08:09.449 INFO:teuthology.orchestra.run.smithi161.stdout:1484 read 0x5b2bb34 thru 0x5b2dd31 (0x21fe bytes) 2024-09-21T15:08:09.449 INFO:teuthology.orchestra.run.smithi161.stdout:1485 punch from 0x75be133 to 0x75c9cb4, (0xbb81 bytes) 2024-09-21T15:08:09.449 INFO:teuthology.orchestra.run.smithi161.stdout:1488 writesame 0x1f977c4 thru 0x1f9e765 data_size 0x21(0x6fa2 bytes) 2024-09-21T15:08:09.450 INFO:teuthology.orchestra.run.smithi161.stdout:1498 read 0xc707ed5 thru 0xc7104a8 (0x85d4 bytes) 2024-09-21T15:08:09.451 INFO:teuthology.orchestra.run.smithi161.stdout:1384 write 0x8fe77ed thru 0x8fedac2 (0x62d6 bytes) 2024-09-21T15:08:09.451 INFO:teuthology.orchestra.run.smithi161.stdout:1499 writesame 0x458b06a thru 0x458de22 data_size 0x1(0x2db9 bytes) 2024-09-21T15:08:09.466 INFO:teuthology.orchestra.run.smithi161.stdout:1489 trunc from 0xbd17d0f to 0xd3a7701 2024-09-21T15:08:09.473 INFO:teuthology.orchestra.run.smithi161.stdout:1385 writesame 0x4b52082 thru 0x4b54162 data_size 0x1(0x20e1 bytes) 2024-09-21T15:08:09.475 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.475 INFO:teuthology.orchestra.run.smithi161.stdout:1489 writesame 0x71807f thru 0x71946a data_size 0x6(0x13ec bytes) 2024-09-21T15:08:09.475 INFO:teuthology.orchestra.run.smithi161.stdout:1501 punch from 0x77eb292 to 0x77f5252, (0x9fc0 bytes) 2024-09-21T15:08:09.480 INFO:teuthology.orchestra.run.smithi161.stdout:1876 write 0x9275866 thru 0x927f27c (0x9a17 bytes) 2024-09-21T15:08:09.489 INFO:teuthology.orchestra.run.smithi161.stdout:1503 trunc from 0xe94f328 to 0x713a963 2024-09-21T15:08:09.493 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.493 INFO:teuthology.orchestra.run.smithi161.stdout:1387 write 0x74e93b2 thru 0x74f446c (0xb0bb bytes) 2024-09-21T15:08:09.511 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.511 INFO:teuthology.orchestra.run.smithi161.stdout:1389 punch from 0xadcb95 to 0xae1e6b, (0x52d6 bytes) 2024-09-21T15:08:09.511 INFO:teuthology.orchestra.run.smithi161.stdout:1390 punch from 0x65dc07d to 0x65e3556, (0x74d9 bytes) 2024-09-21T15:08:09.511 INFO:teuthology.orchestra.run.smithi161.stdout:1392 write 0x98a80c6 thru 0x98ad806 (0x5741 bytes) 2024-09-21T15:08:09.519 INFO:teuthology.orchestra.run.smithi161.stdout:1393 read 0x4e9d952 thru 0x4e9e2a5 (0x954 bytes) 2024-09-21T15:08:09.522 INFO:teuthology.orchestra.run.smithi161.stdout:1490 writesame 0x112e9a7 thru 0x1138501 data_size 0x1b(0x9b5b bytes) 2024-09-21T15:08:09.526 INFO:teuthology.orchestra.run.smithi161.stdout:1394 trunc from 0xd5dc939 to 0x92c390b 2024-09-21T15:08:09.528 INFO:teuthology.orchestra.run.smithi161.stdout:1491 write 0x621b8cd thru 0x6228f2f (0xd663 bytes) 2024-09-21T15:08:09.540 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.540 INFO:teuthology.orchestra.run.smithi161.stdout:1493 punch from 0x9426e77 to 0x94353cb, (0xe554 bytes) 2024-09-21T15:08:09.540 INFO:teuthology.orchestra.run.smithi161.stdout:1494 clone 13 order 25 su 524288 sc 4 2024-09-21T15:08:09.541 INFO:teuthology.orchestra.run.smithi161.stdout:1877 read 0x8d3b30a thru 0x8d40c49 (0x5940 bytes) 2024-09-21T15:08:09.541 INFO:teuthology.orchestra.run.smithi161.stdout:1878 read 0x7c77282 thru 0x7c7b2b2 (0x4031 bytes) 2024-09-21T15:08:09.541 INFO:teuthology.orchestra.run.smithi161.stdout:1882 write 0x63171b2 thru 0x6323b9c (0xc9eb bytes) 2024-09-21T15:08:09.632 INFO:teuthology.orchestra.run.smithi161.stdout:1883 trunc from 0xa5a54e8 to 0xb36ddb9 2024-09-21T15:08:09.661 INFO:teuthology.orchestra.run.smithi161.stdout:1395 write 0x35ddff7 thru 0x35e41f0 (0x61fa bytes) 2024-09-21T15:08:09.676 INFO:teuthology.orchestra.run.smithi161.stdout:1884 read 0x71b625d thru 0x71c2601 (0xc3a5 bytes) 2024-09-21T15:08:09.677 INFO:teuthology.orchestra.run.smithi161.stdout:1885 read 0x39ffeb2 thru 0x3a0c3fd (0xc54c bytes) 2024-09-21T15:08:09.678 INFO:teuthology.orchestra.run.smithi161.stdout:1886 read 0x433e51 thru 0x442cdd (0xee8d bytes) 2024-09-21T15:08:09.683 INFO:teuthology.orchestra.run.smithi161.stdout:1504 read 0x570cb32 thru 0x570d69c (0xb6b bytes) 2024-09-21T15:08:09.684 INFO:teuthology.orchestra.run.smithi161.stdout:1887 read 0xeabbcb thru 0xeafc72 (0x40a8 bytes) 2024-09-21T15:08:09.693 INFO:teuthology.orchestra.run.smithi161.stdout:1490 write 0x85cdee8 thru 0x85d95be (0xb6d7 bytes) 2024-09-21T15:08:09.701 INFO:teuthology.orchestra.run.smithi161.stdout:1396 trunc from 0x92c390b to 0x21f876b 2024-09-21T15:08:09.722 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.722 INFO:teuthology.orchestra.run.smithi161.stdout:1492 read 0x3ed49a1 thru 0x3ee2f00 (0xe560 bytes) 2024-09-21T15:08:09.723 INFO:teuthology.orchestra.run.smithi161.stdout:1888 write 0xc6db9b1 thru 0xc6eaeb4 (0xf504 bytes) 2024-09-21T15:08:09.730 INFO:teuthology.orchestra.run.smithi161.stdout:1493 trunc from 0x85d95bf to 0xc2d0487 2024-09-21T15:08:09.738 INFO:teuthology.orchestra.run.smithi161.stdout:1889 read 0x7b9b3af thru 0x7ba8893 (0xd4e5 bytes) 2024-09-21T15:08:09.739 INFO:teuthology.orchestra.run.smithi161.stdout:1505 writesame 0xe277f73 thru 0xe279c9d data_size 0x13(0x1d2b bytes) 2024-09-21T15:08:09.739 INFO:teuthology.orchestra.run.smithi161.stdout:1890 read 0x19421f thru 0x1960cd (0x1eaf bytes) 2024-09-21T15:08:09.742 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.742 INFO:teuthology.orchestra.run.smithi161.stdout:1892 write 0x77ee4ce thru 0x77f0a83 (0x25b6 bytes) 2024-09-21T15:08:09.749 INFO:teuthology.orchestra.run.smithi161.stdout:1506 trunc from 0xe279c9e to 0xc1c84f6 2024-09-21T15:08:09.757 INFO:teuthology.orchestra.run.smithi161.stdout:1398 read 0x84633a thru 0x855c11 (0xf8d8 bytes) 2024-09-21T15:08:09.759 INFO:teuthology.orchestra.run.smithi161.stdout:1400 read 0x20899a6 thru 0x2098ecc (0xf527 bytes) 2024-09-21T15:08:09.761 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.761 INFO:teuthology.orchestra.run.smithi161.stdout:1495 read 0x5bd1aaf thru 0x5bd50ef (0x3641 bytes) 2024-09-21T15:08:09.761 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.761 INFO:teuthology.orchestra.run.smithi161.stdout:1497 read 0xaba3d9e thru 0xabb1450 (0xd6b3 bytes) 2024-09-21T15:08:09.773 INFO:teuthology.orchestra.run.smithi161.stdout:1507 read 0x5cf1598 thru 0x5cf1abc (0x525 bytes) 2024-09-21T15:08:09.773 INFO:teuthology.orchestra.run.smithi161.stdout:1509 writesame 0x6bfa089 thru 0x6bfc79a data_size 0x3(0x2712 bytes) 2024-09-21T15:08:09.782 INFO:teuthology.orchestra.run.smithi161.stdout:1498 trunc from 0xc2d0487 to 0x1b0e78 2024-09-21T15:08:09.783 INFO:teuthology.orchestra.run.smithi161.stdout:1510 write 0xb0012a5 thru 0xb0109ba (0xf716 bytes) 2024-09-21T15:08:09.793 INFO:teuthology.orchestra.run.smithi161.stdout:1401 write 0x5ce8991 thru 0x5cf573a (0xcdaa bytes) 2024-09-21T15:08:09.807 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone12 from 0xd3a7701 (overlap 0x103c798) to 0x0 2024-09-21T15:08:09.807 INFO:teuthology.orchestra.run.smithi161.stdout:1513 punch from 0x1364239 to 0x13733d6, (0xf19d bytes) 2024-09-21T15:08:09.807 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.810 INFO:teuthology.orchestra.run.smithi161.stdout:1520 trunc from 0xc1c84f6 to 0xa1d6ed8 2024-09-21T15:08:09.816 INFO:teuthology.orchestra.run.smithi161.stdout:1893 read 0x499a0a7 thru 0x49a5d55 (0xbcaf bytes) 2024-09-21T15:08:09.816 INFO:teuthology.orchestra.run.smithi161.stdout:1402 write 0x17ae0a3 thru 0x17bddec (0xfd4a bytes) 2024-09-21T15:08:09.817 INFO:teuthology.orchestra.run.smithi161.stdout:1894 punch from 0x625b62c to 0x6267d47, (0xc71b bytes) 2024-09-21T15:08:09.819 INFO:teuthology.orchestra.run.smithi161.stdout:1895 trunc from 0xc6eaeb5 to 0xb0e74d0 2024-09-21T15:08:09.844 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.844 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.844 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:09.844 INFO:teuthology.orchestra.run.smithi161.stdout:1407 read 0x52a543f thru 0x52a8003 (0x2bc5 bytes) 2024-09-21T15:08:09.844 INFO:teuthology.orchestra.run.smithi161.stdout:1408 clone 16 order 22 su 524288 sc 13 2024-09-21T15:08:09.966 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone10 from 0x9ff35e8 (overlap 0x3afdac) to 0x351781 2024-09-21T15:08:10.041 INFO:teuthology.orchestra.run.smithi161.stdout:1896 write 0x6c34e84 thru 0x6c406cb (0xb848 bytes) 2024-09-21T15:08:10.049 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #11, image image_cluster1.client.mirror.5-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent12 2024-09-21T15:08:10.089 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.089 INFO:teuthology.orchestra.run.smithi161.stdout:1522 write 0x67bf68b thru 0x67c816d (0x8ae3 bytes) 2024-09-21T15:08:10.121 INFO:teuthology.orchestra.run.smithi161.stdout:1499 trunc from 0x1b0e78 to 0x3c7d137 2024-09-21T15:08:10.123 INFO:teuthology.orchestra.run.smithi161.stdout:1523 trunc from 0xa1d6ed8 to 0x57d34e6 2024-09-21T15:08:10.135 INFO:teuthology.orchestra.run.smithi161.stdout:1897 punch from 0x5a77850 to 0x5a8579b, (0xdf4b bytes) 2024-09-21T15:08:10.136 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.136 INFO:teuthology.orchestra.run.smithi161.stdout:1903 read 0x5646cbf thru 0x564a2b8 (0x35fa bytes) 2024-09-21T15:08:10.137 INFO:teuthology.orchestra.run.smithi161.stdout:1904 read 0xa8df1e thru 0xa94379 (0x645c bytes) 2024-09-21T15:08:10.141 INFO:teuthology.orchestra.run.smithi161.stdout:1905 punch from 0x558887c to 0x558dcef, (0x5473 bytes) 2024-09-21T15:08:10.142 INFO:teuthology.orchestra.run.smithi161.stdout:1906 punch from 0x1d99ab5 to 0x1d9b49e, (0x19e9 bytes) 2024-09-21T15:08:10.142 INFO:teuthology.orchestra.run.smithi161.stdout:1908 read 0x7530d8a thru 0x753c75b (0xb9d2 bytes) 2024-09-21T15:08:10.143 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.143 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.143 INFO:teuthology.orchestra.run.smithi161.stdout:1911 read 0x3c46cdb thru 0x3c47979 (0xc9f bytes) 2024-09-21T15:08:10.143 INFO:teuthology.orchestra.run.smithi161.stdout:1912 write 0x2a771ed thru 0x2a796e4 (0x24f8 bytes) 2024-09-21T15:08:10.149 INFO:teuthology.orchestra.run.smithi161.stdout:1913 write 0x4a000b2 thru 0x4a0a8ec (0xa83b bytes) 2024-09-21T15:08:10.177 INFO:teuthology.orchestra.run.smithi161.stdout:1502 read 0x2720234 thru 0x272823c (0x8009 bytes) 2024-09-21T15:08:10.177 INFO:teuthology.orchestra.run.smithi161.stdout:1503 punch from 0x20f3490 to 0x20fc6a1, (0x9211 bytes) 2024-09-21T15:08:10.187 INFO:teuthology.orchestra.run.smithi161.stdout:1504 trunc from 0x3c7d137 to 0x8eb5d82 2024-09-21T15:08:10.215 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.223 INFO:teuthology.orchestra.run.smithi161.stdout:1505 punch from 0xb757b3 to 0xb7e9b2, (0x91ff bytes) 2024-09-21T15:08:10.223 INFO:teuthology.orchestra.run.smithi161.stdout:1506 punch from 0x3772d56 to 0x377f05c, (0xc306 bytes) 2024-09-21T15:08:10.223 INFO:teuthology.orchestra.run.smithi161.stdout:1507 write 0x6855aa4 thru 0x6859ca4 (0x4201 bytes) 2024-09-21T15:08:10.234 INFO:teuthology.orchestra.run.smithi161.stdout:1914 write 0x4eb0536 thru 0x4eb2401 (0x1ecc bytes) 2024-09-21T15:08:10.272 INFO:teuthology.orchestra.run.smithi161.stdout:1527 write 0xa870867 thru 0xa8732f1 (0x2a8b bytes) 2024-09-21T15:08:10.294 INFO:teuthology.orchestra.run.smithi161.stdout:1915 trunc from 0xb0e74d0 to 0x3e8e1e8 2024-09-21T15:08:10.296 INFO:teuthology.orchestra.run.smithi161.stdout:1509 writesame 0xd7f748e thru 0xd7fb457 data_size 0x2(0x3fca bytes) 2024-09-21T15:08:10.304 INFO:teuthology.orchestra.run.smithi161.stdout:1510 writesame 0x6ca3cc thru 0x6d6a93 data_size 0x4(0xc6c8 bytes) 2024-09-21T15:08:10.306 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #9, image image_cluster1.client.mirror.2-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent10 2024-09-21T15:08:10.328 INFO:teuthology.orchestra.run.smithi161.stdout:1528 write 0xc3ef10a thru 0xc3ef540 (0x437 bytes) 2024-09-21T15:08:10.333 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.333 INFO:teuthology.orchestra.run.smithi161.stdout:1513 punch from 0xcd5e024 to 0xcd69c7a, (0xbc56 bytes) 2024-09-21T15:08:10.333 INFO:teuthology.orchestra.run.smithi161.stdout:1514 write 0xd1feece thru 0xd20d186 (0xe2b9 bytes) 2024-09-21T15:08:10.347 INFO:teuthology.orchestra.run.smithi161.stdout:1529 punch from 0x10e3da to 0x1138ee, (0x5514 bytes) 2024-09-21T15:08:10.365 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.365 INFO:teuthology.orchestra.run.smithi161.stdout:1516 punch from 0xacb44c to 0xad7e21, (0xc9d5 bytes) 2024-09-21T15:08:10.365 INFO:teuthology.orchestra.run.smithi161.stdout:1517 write 0xa0b228a thru 0xa0bbf09 (0x9c80 bytes) 2024-09-21T15:08:10.370 INFO:teuthology.orchestra.run.smithi161.stdout:1531 trunc from 0xc3ef541 to 0x9ba1cf 2024-09-21T15:08:10.405 INFO:teuthology.orchestra.run.smithi161.stdout:1518 write 0x2807f31 thru 0x2811f63 (0xa033 bytes) 2024-09-21T15:08:10.411 INFO:teuthology.orchestra.run.smithi161.stdout:2088 punch from 0x7e35d2f to 0x7e429ac, (0xcc7d bytes) 2024-09-21T15:08:10.461 INFO:teuthology.orchestra.run.smithi161.stdout:2089 read 0x6938f70 thru 0x6947fef (0xf080 bytes) 2024-09-21T15:08:10.475 INFO:teuthology.orchestra.run.smithi161.stdout:1519 trunc from 0xd7fb458 to 0x537f6b9 2024-09-21T15:08:10.498 INFO:teuthology.orchestra.run.smithi161.stdout:2091 writesame 0xd7b561e thru 0xd7bee01 data_size 0x2(0x97e4 bytes) 2024-09-21T15:08:10.508 INFO:teuthology.orchestra.run.smithi161.stdout:2092 punch from 0x620acf5 to 0x6214852, (0x9b5d bytes) 2024-09-21T15:08:10.509 INFO:teuthology.orchestra.run.smithi161.stdout:2093 write 0xaead7fb thru 0xaebc66e (0xee74 bytes) 2024-09-21T15:08:10.519 INFO:teuthology.orchestra.run.smithi161.stdout:1532 punch from 0x728281 to 0x731228, (0x8fa7 bytes) 2024-09-21T15:08:10.519 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.519 INFO:teuthology.orchestra.run.smithi161.stdout:1535 read 0x66e575 thru 0x678106 (0x9b92 bytes) 2024-09-21T15:08:10.519 INFO:teuthology.orchestra.run.smithi161.stdout:1536 read 0x579a1c thru 0x57f095 (0x567a bytes) 2024-09-21T15:08:10.520 INFO:teuthology.orchestra.run.smithi161.stdout:1538 write 0x225898 thru 0x226f44 (0x16ad bytes) 2024-09-21T15:08:10.531 INFO:teuthology.orchestra.run.smithi161.stdout:2094 punch from 0xbb21073 to 0xbb224fa, (0x1487 bytes) 2024-09-21T15:08:10.531 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.531 INFO:teuthology.orchestra.run.smithi161.stdout:2097 write 0xd06d4f9 thru 0xd07483f (0x7347 bytes) 2024-09-21T15:08:10.533 INFO:teuthology.orchestra.run.smithi161.stdout:1916 read 0x20f8a6a thru 0x21045c9 (0xbb60 bytes) 2024-09-21T15:08:10.534 INFO:teuthology.orchestra.run.smithi161.stdout:1917 read 0x1cc8ac8 thru 0x1cc995e (0xe97 bytes) 2024-09-21T15:08:10.534 INFO:teuthology.orchestra.run.smithi161.stdout:1918 read 0x348d4e9 thru 0x3498bd1 (0xb6e9 bytes) 2024-09-21T15:08:10.540 INFO:teuthology.orchestra.run.smithi161.stdout:1919 trunc from 0x3e8e1e8 to 0x6462c68 2024-09-21T15:08:10.546 INFO:teuthology.orchestra.run.smithi161.stdout:2098 writesame 0x8bed360 thru 0x8bf1014 data_size 0x1(0x3cb5 bytes) 2024-09-21T15:08:10.546 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.550 INFO:teuthology.orchestra.run.smithi161.stdout:1520 punch from 0x3a114d7 to 0x3a16b52, (0x567b bytes) 2024-09-21T15:08:10.551 INFO:teuthology.orchestra.run.smithi161.stdout:1495 trunc from 0xd3a7701 to 0xaffc2f4 2024-09-21T15:08:10.580 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.580 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.580 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.588 INFO:teuthology.orchestra.run.smithi161.stdout:2106 trunc from 0xd7bee02 to 0x99910fd 2024-09-21T15:08:10.629 INFO:teuthology.orchestra.run.smithi161.stdout:1920 write 0xe6ffd4c thru 0xe70383f (0x3af4 bytes) 2024-09-21T15:08:10.638 INFO:teuthology.orchestra.run.smithi161.stdout:1521 write 0x834a7fe thru 0x834be3b (0x163e bytes) 2024-09-21T15:08:10.663 INFO:teuthology.orchestra.run.smithi161.stdout:1540 writesame 0xd83e92a thru 0xd84e238 data_size 0x35(0xf90f bytes) 2024-09-21T15:08:10.667 INFO:teuthology.orchestra.run.smithi161.stdout:1921 trunc from 0xe703840 to 0xa433819 2024-09-21T15:08:10.675 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.675 INFO:teuthology.orchestra.run.smithi161.stdout:1523 read 0x1ddae5b thru 0x1ddc2ff (0x14a5 bytes) 2024-09-21T15:08:10.675 INFO:teuthology.orchestra.run.smithi161.stdout:1524 write 0x3463707 thru 0x34691c0 (0x5aba bytes) 2024-09-21T15:08:10.675 INFO:teuthology.orchestra.run.smithi161.stdout:1542 read 0xb540019 thru 0xb544492 (0x447a bytes) 2024-09-21T15:08:10.693 INFO:teuthology.orchestra.run.smithi161.stdout:1496 read 0x9ee007e thru 0x9eead0a (0xac8d bytes) 2024-09-21T15:08:10.698 INFO:teuthology.orchestra.run.smithi161.stdout:1527 read 0x29c305c thru 0x29c4aa0 (0x1a45 bytes) 2024-09-21T15:08:10.698 INFO:teuthology.orchestra.run.smithi161.stdout:1528 writesame 0x3975b71 thru 0x398414a data_size 0x3f(0xe5da bytes) 2024-09-21T15:08:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:1529 read 0x4ee9120 thru 0x4ef5abe (0xc99f bytes) 2024-09-21T15:08:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:1533 write 0x320f7f7 thru 0x321ee8c (0xf696 bytes) 2024-09-21T15:08:10.740 INFO:teuthology.orchestra.run.smithi161.stdout:1543 write 0xe0a2e90 thru 0xe0aa47d (0x75ee bytes) 2024-09-21T15:08:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:1922 read 0x5f3de46 thru 0x5f4cc2a (0xede5 bytes) 2024-09-21T15:08:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:1923 punch from 0x53f406b to 0x53fa96f, (0x6904 bytes) 2024-09-21T15:08:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:1497 write 0xe7b42d6 thru 0xe7bfce8 (0xba13 bytes) 2024-09-21T15:08:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:1924 read 0x664483b thru 0x6654465 (0xfc2b bytes) 2024-09-21T15:08:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:1926 read 0x22bdcbd thru 0x22c9eb0 (0xc1f4 bytes) 2024-09-21T15:08:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.760 INFO:teuthology.orchestra.run.smithi161.stdout:1535 punch from 0x1774ea9 to 0x1774f28, (0x7f bytes) 2024-09-21T15:08:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:1544 writesame 0x64bb4e9 thru 0x64c16fa data_size 0x1(0x6212 bytes) 2024-09-21T15:08:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:1929 read 0x5716c41 thru 0x571d0da (0x649a bytes) 2024-09-21T15:08:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:1930 read 0x19ead03 thru 0x19f88a0 (0xdb9e bytes) 2024-09-21T15:08:10.768 INFO:teuthology.orchestra.run.smithi161.stdout:1931 punch from 0x322e1de to 0x3230880, (0x26a2 bytes) 2024-09-21T15:08:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:1932 write 0x23db401 thru 0x23dec88 (0x3888 bytes) 2024-09-21T15:08:10.769 INFO:teuthology.orchestra.run.smithi161.stdout:1498 writesame 0xdcf7f0 thru 0xddb73b data_size 0x54(0xbf4c bytes) 2024-09-21T15:08:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:1546 punch from 0xa31052e to 0xa31f3d1, (0xeea3 bytes) 2024-09-21T15:08:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:1547 read 0x4f96199 thru 0x4f9dba9 (0x7a11 bytes) 2024-09-21T15:08:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:1548 read 0x1075e4e thru 0x10808f1 (0xaaa4 bytes) 2024-09-21T15:08:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:1550 read 0xa7a1bab thru 0xa7a399e (0x1df4 bytes) 2024-09-21T15:08:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.806 INFO:teuthology.orchestra.run.smithi161.stdout:1933 trunc from 0xa433819 to 0x2b4f16b 2024-09-21T15:08:10.814 INFO:teuthology.orchestra.run.smithi161.stdout:1552 trunc from 0xe0aa47e to 0x873a4ac 2024-09-21T15:08:10.841 INFO:teuthology.orchestra.run.smithi161.stdout:1536 write 0xc96f6a7 thru 0xc974d1b (0x5675 bytes) 2024-09-21T15:08:10.841 INFO:teuthology.orchestra.run.smithi161.stdout:2108 writesame 0x1c1535f thru 0x1c23ad6 data_size 0x24(0xe778 bytes) 2024-09-21T15:08:10.841 INFO:teuthology.orchestra.run.smithi161.stdout:1499 write 0x4b2b258 thru 0x4b38602 (0xd3ab bytes) 2024-09-21T15:08:10.848 INFO:teuthology.orchestra.run.smithi161.stdout:1934 punch from 0xcc6827 to 0xcd2187, (0xb960 bytes) 2024-09-21T15:08:10.849 INFO:teuthology.orchestra.run.smithi161.stdout:1936 read 0x1ca54b5 thru 0x1cb3cd2 (0xe81e bytes) 2024-09-21T15:08:10.873 INFO:teuthology.orchestra.run.smithi161.stdout:1537 read 0xa66a098 thru 0xa671b0a (0x7a73 bytes) 2024-09-21T15:08:10.873 INFO:teuthology.orchestra.run.smithi161.stdout:1538 punch from 0x9bc0575 to 0x9bc3a71, (0x34fc bytes) 2024-09-21T15:08:10.894 INFO:teuthology.orchestra.run.smithi161.stdout:1555 punch from 0x76f5690 to 0x76f74a6, (0x1e16 bytes) 2024-09-21T15:08:10.894 INFO:teuthology.orchestra.run.smithi161.stdout:1556 write 0x6f473ce thru 0x6f52546 (0xb179 bytes) 2024-09-21T15:08:10.903 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone15 from 0x5cf573b (overlap 0x21f876b) to 0x365a57 2024-09-21T15:08:10.917 INFO:teuthology.orchestra.run.smithi161.stdout:1937 writesame 0x7bd7719 thru 0x7bd7cfc data_size 0xd(0x5e4 bytes) 2024-09-21T15:08:10.940 INFO:teuthology.orchestra.run.smithi161.stdout:1941 read 0x3c1c384 thru 0x3c20e22 (0x4a9f bytes) 2024-09-21T15:08:10.965 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:10.965 INFO:teuthology.orchestra.run.smithi161.stdout:1501 write 0xc06e4d0 thru 0xc078fd3 (0xab04 bytes) 2024-09-21T15:08:10.974 INFO:teuthology.orchestra.run.smithi161.stdout:1539 write 0xda3c357 thru 0xda3ffe3 (0x3c8d bytes) 2024-09-21T15:08:10.988 INFO:teuthology.orchestra.run.smithi161.stdout:1504 read 0xafa1662 thru 0xafa64cb (0x4e6a bytes) 2024-09-21T15:08:10.996 INFO:teuthology.orchestra.run.smithi161.stdout:1505 read 0x503bc37 thru 0x504223d (0x6607 bytes) 2024-09-21T15:08:10.997 INFO:teuthology.orchestra.run.smithi161.stdout:1506 read 0x5a38006 thru 0x5a39b9d (0x1b98 bytes) 2024-09-21T15:08:11.002 INFO:teuthology.orchestra.run.smithi161.stdout:1507 write 0x18833d1 thru 0x1887c59 (0x4889 bytes) 2024-09-21T15:08:11.009 INFO:teuthology.orchestra.run.smithi161.stdout:1559 write 0xa9f5fc5 thru 0xa9fdb10 (0x7b4c bytes) 2024-09-21T15:08:11.020 INFO:teuthology.orchestra.run.smithi161.stdout:1540 punch from 0x52d5c12 to 0x52db712, (0x5b00 bytes) 2024-09-21T15:08:11.020 INFO:teuthology.orchestra.run.smithi161.stdout:1541 read 0x7dd372e thru 0x7de0490 (0xcd63 bytes) 2024-09-21T15:08:11.021 INFO:teuthology.orchestra.run.smithi161.stdout:1542 punch from 0x1d523b8 to 0x1d552d9, (0x2f21 bytes) 2024-09-21T15:08:11.021 INFO:teuthology.orchestra.run.smithi161.stdout:1545 read 0xc561c6 thru 0xc57311 (0x114c bytes) 2024-09-21T15:08:11.025 INFO:teuthology.orchestra.run.smithi161.stdout:2110 write 0xa45f87d thru 0xa46cee3 (0xd667 bytes) 2024-09-21T15:08:11.040 INFO:teuthology.orchestra.run.smithi161.stdout:1560 punch from 0x971f7c5 to 0x972cf89, (0xd7c4 bytes) 2024-09-21T15:08:11.040 INFO:teuthology.orchestra.run.smithi161.stdout:1561 punch from 0x414b0b1 to 0x41596cb, (0xe61a bytes) 2024-09-21T15:08:11.040 INFO:teuthology.orchestra.run.smithi161.stdout:1563 read 0x9c8481a thru 0x9c8d8f8 (0x90df bytes) 2024-09-21T15:08:11.040 INFO:teuthology.orchestra.run.smithi161.stdout:1566 read 0x9f2765e thru 0x9f31fa3 (0xa946 bytes) 2024-09-21T15:08:11.040 INFO:teuthology.orchestra.run.smithi161.stdout:1567 punch from 0x44c955d to 0x44c9c11, (0x6b4 bytes) 2024-09-21T15:08:11.040 INFO:teuthology.orchestra.run.smithi161.stdout:1568 write 0x2f6c97a thru 0x2f79181 (0xc808 bytes) 2024-09-21T15:08:11.053 INFO:teuthology.orchestra.run.smithi161.stdout:1942 write 0xed926cb thru 0xed98d5d (0x6693 bytes) 2024-09-21T15:08:11.066 INFO:teuthology.orchestra.run.smithi161.stdout:2111 read 0x62b82b thru 0x62ff03 (0x46d9 bytes) 2024-09-21T15:08:11.068 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.068 INFO:teuthology.orchestra.run.smithi161.stdout:2114 read 0x497ee7a thru 0x498109a (0x2221 bytes) 2024-09-21T15:08:11.078 INFO:teuthology.orchestra.run.smithi161.stdout:2115 trunc from 0xa46cee4 to 0x789063f 2024-09-21T15:08:11.083 INFO:teuthology.orchestra.run.smithi161.stdout:1943 write 0x9eca4dd thru 0x9ecaede (0xa02 bytes) 2024-09-21T15:08:11.106 INFO:teuthology.orchestra.run.smithi161.stdout:1508 read 0x339f304 thru 0x339fd57 (0xa54 bytes) 2024-09-21T15:08:11.106 INFO:teuthology.orchestra.run.smithi161.stdout:1509 read 0x88d3acf thru 0x88dc408 (0x893a bytes) 2024-09-21T15:08:11.110 INFO:teuthology.orchestra.run.smithi161.stdout:1944 punch from 0xc6980a4 to 0xc6a1a2c, (0x9988 bytes) 2024-09-21T15:08:11.110 INFO:teuthology.orchestra.run.smithi161.stdout:1945 read 0x72cd791 thru 0x72d92fa (0xbb6a bytes) 2024-09-21T15:08:11.111 INFO:teuthology.orchestra.run.smithi161.stdout:1946 write 0x843e7c2 thru 0x8449cbc (0xb4fb bytes) 2024-09-21T15:08:11.130 INFO:teuthology.orchestra.run.smithi161.stdout:1511 trunc from 0xe7bfce9 to 0x169f8cc 2024-09-21T15:08:11.135 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.142 INFO:teuthology.orchestra.run.smithi161.stdout:1547 writesame 0xed0248d thru 0xed0dc9b data_size 0x1(0xb80f bytes) 2024-09-21T15:08:11.143 INFO:teuthology.orchestra.run.smithi161.stdout:1569 write 0xb0c3152 thru 0xb0ce4a5 (0xb354 bytes) 2024-09-21T15:08:11.151 INFO:teuthology.orchestra.run.smithi161.stdout:1548 read 0x9c88d85 thru 0x9c8b6c7 (0x2943 bytes) 2024-09-21T15:08:11.152 INFO:teuthology.orchestra.run.smithi161.stdout:1549 punch from 0xb48454d to 0xb48ed7e, (0xa831 bytes) 2024-09-21T15:08:11.152 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.152 INFO:teuthology.orchestra.run.smithi161.stdout:1551 write 0x7f4be35 thru 0x7f51925 (0x5af1 bytes) 2024-09-21T15:08:11.158 INFO:teuthology.orchestra.run.smithi161.stdout:1948 trunc from 0xed98d5e to 0x27c21cd 2024-09-21T15:08:11.197 INFO:teuthology.orchestra.run.smithi161.stdout:2116 trunc from 0x789063f to 0x99aadc3 2024-09-21T15:08:11.207 INFO:teuthology.orchestra.run.smithi161.stdout:1552 read 0x7defb22 thru 0x7df0857 (0xd36 bytes) 2024-09-21T15:08:11.207 INFO:teuthology.orchestra.run.smithi161.stdout:1553 read 0x8faceb0 thru 0x8fbaa08 (0xdb59 bytes) 2024-09-21T15:08:11.207 INFO:teuthology.orchestra.run.smithi161.stdout:1555 punch from 0x6cfbede to 0x6d078c1, (0xb9e3 bytes) 2024-09-21T15:08:11.208 INFO:teuthology.orchestra.run.smithi161.stdout:1556 writesame 0x9a38882 thru 0x9a3b3e6 data_size 0x17(0x2b65 bytes) 2024-09-21T15:08:11.244 INFO:teuthology.orchestra.run.smithi161.stdout:2117 read 0x2207ccb thru 0x220be8c (0x41c2 bytes) 2024-09-21T15:08:11.245 INFO:teuthology.orchestra.run.smithi161.stdout:2118 writesame 0x98c3d24 thru 0x98cb6ef data_size 0xa(0x79cc bytes) 2024-09-21T15:08:11.255 INFO:teuthology.orchestra.run.smithi161.stdout:1570 write 0xcb17830 thru 0xcb17a0e (0x1df bytes) 2024-09-21T15:08:11.258 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.258 INFO:teuthology.orchestra.run.smithi161.stdout:1560 writesame 0x2b994d9 thru 0x2b9f7fb data_size 0x1(0x6323 bytes) 2024-09-21T15:08:11.265 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.265 INFO:teuthology.orchestra.run.smithi161.stdout:2123 punch from 0x7bf16cc to 0x7bf37b8, (0x20ec bytes) 2024-09-21T15:08:11.285 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.288 INFO:teuthology.orchestra.run.smithi161.stdout:1513 write 0x1431d91 thru 0x143c214 (0xa484 bytes) 2024-09-21T15:08:11.299 INFO:teuthology.orchestra.run.smithi161.stdout:1573 trunc from 0xcb17a0f to 0x5c5a4e7 2024-09-21T15:08:11.312 INFO:teuthology.orchestra.run.smithi161.stdout:1561 trunc from 0xed0dc9c to 0x232d206 2024-09-21T15:08:11.324 INFO:teuthology.orchestra.run.smithi161.stdout:1515 trunc from 0x169f8cc to 0x65178e7 2024-09-21T15:08:11.335 INFO:teuthology.orchestra.run.smithi161.stdout:2124 write 0xa5db9d4 thru 0xa5e8ef0 (0xd51d bytes) 2024-09-21T15:08:11.342 INFO:teuthology.orchestra.run.smithi161.stdout:1952 writesame 0x4a40c2c thru 0x4a47b34 data_size 0x5(0x6f09 bytes) 2024-09-21T15:08:11.355 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.355 INFO:teuthology.orchestra.run.smithi161.stdout:1954 write 0x421e7dc thru 0x422b8e9 (0xd10e bytes) 2024-09-21T15:08:11.376 INFO:teuthology.orchestra.run.smithi161.stdout:2125 read 0x2add136 thru 0x2ae9e7b (0xcd46 bytes) 2024-09-21T15:08:11.377 INFO:teuthology.orchestra.run.smithi161.stdout:2126 write 0x3d7a6a7 thru 0x3d87f9a (0xd8f4 bytes) 2024-09-21T15:08:11.390 INFO:teuthology.orchestra.run.smithi161.stdout:1955 write 0x2fb0c6a thru 0x2fbcab5 (0xbe4c bytes) 2024-09-21T15:08:11.400 INFO:teuthology.orchestra.run.smithi161.stdout:1574 read 0x449d44a thru 0x44ab44b (0xe002 bytes) 2024-09-21T15:08:11.400 INFO:teuthology.orchestra.run.smithi161.stdout:1575 punch from 0x131ab2d to 0x1320c49, (0x611c bytes) 2024-09-21T15:08:11.401 INFO:teuthology.orchestra.run.smithi161.stdout:1576 read 0xd52dfb thru 0xd62a7e (0xfc84 bytes) 2024-09-21T15:08:11.401 INFO:teuthology.orchestra.run.smithi161.stdout:1577 punch from 0x4f82d9e to 0x4f8b4fe, (0x8760 bytes) 2024-09-21T15:08:11.401 INFO:teuthology.orchestra.run.smithi161.stdout:1579 read 0x4cc9d94 thru 0x4cc9ff9 (0x266 bytes) 2024-09-21T15:08:11.401 INFO:teuthology.orchestra.run.smithi161.stdout:1580 punch from 0x7fe862 to 0x7fffb7, (0x1755 bytes) 2024-09-21T15:08:11.404 INFO:teuthology.orchestra.run.smithi161.stdout:1516 trunc from 0x65178e7 to 0xa5cedcd 2024-09-21T15:08:11.408 INFO:teuthology.orchestra.run.smithi161.stdout:1956 punch from 0x1da745c to 0x1da8840, (0x13e4 bytes) 2024-09-21T15:08:11.419 INFO:teuthology.orchestra.run.smithi161.stdout:2129 punch from 0x972d9b3 to 0x973569c, (0x7ce9 bytes) 2024-09-21T15:08:11.419 INFO:teuthology.orchestra.run.smithi161.stdout:2130 writesame 0x570c5f1 thru 0x57197f7 data_size 0x1(0xd207 bytes) 2024-09-21T15:08:11.426 INFO:teuthology.orchestra.run.smithi161.stdout:1562 read 0x1cd61ef thru 0x1cdc44b (0x625d bytes) 2024-09-21T15:08:11.426 INFO:teuthology.orchestra.run.smithi161.stdout:1563 read 0x1f08d49 thru 0x1f189b5 (0xfc6d bytes) 2024-09-21T15:08:11.430 INFO:teuthology.orchestra.run.smithi161.stdout:1518 write 0x150b79 thru 0x15957e (0x8a06 bytes) 2024-09-21T15:08:11.443 INFO:teuthology.orchestra.run.smithi161.stdout:1566 trunc from 0x232d206 to 0xc38223d 2024-09-21T15:08:11.444 INFO:teuthology.orchestra.run.smithi161.stdout:1520 read 0x4ceb54a thru 0x4ceed38 (0x37ef bytes) 2024-09-21T15:08:11.444 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.444 INFO:teuthology.orchestra.run.smithi161.stdout:1522 read 0x8eca635 thru 0x8ed136e (0x6d3a bytes) 2024-09-21T15:08:11.475 INFO:teuthology.orchestra.run.smithi161.stdout:1582 write 0xd2b5d15 thru 0xd2b97fc (0x3ae8 bytes) 2024-09-21T15:08:11.483 INFO:teuthology.orchestra.run.smithi161.stdout:2131 write 0x76bcbc4 thru 0x76ca769 (0xdba6 bytes) 2024-09-21T15:08:11.494 INFO:teuthology.orchestra.run.smithi161.stdout:1584 read 0x3399703 thru 0x3399d37 (0x635 bytes) 2024-09-21T15:08:11.494 INFO:teuthology.orchestra.run.smithi161.stdout:1585 read 0x706f19d thru 0x7073c00 (0x4a64 bytes) 2024-09-21T15:08:11.495 INFO:teuthology.orchestra.run.smithi161.stdout:1587 punch from 0x4ad63cb to 0x4ad987e, (0x34b3 bytes) 2024-09-21T15:08:11.495 INFO:teuthology.orchestra.run.smithi161.stdout:1589 read 0x760a0ac thru 0x761814f (0xe0a4 bytes) 2024-09-21T15:08:11.495 INFO:teuthology.orchestra.run.smithi161.stdout:1590 punch from 0x4c6fe37 to 0x4c77c7d, (0x7e46 bytes) 2024-09-21T15:08:11.497 INFO:teuthology.orchestra.run.smithi161.stdout:1958 writesame 0xc103353 thru 0xc111297 data_size 0x1(0xdf45 bytes) 2024-09-21T15:08:11.497 INFO:teuthology.orchestra.run.smithi161.stdout:2132 writesame 0x795ca54 thru 0x796749f data_size 0x7e(0xaa4c bytes) 2024-09-21T15:08:11.497 INFO:teuthology.orchestra.run.smithi161.stdout:1591 punch from 0x8c3a201 to 0x8c49fc7, (0xfdc6 bytes) 2024-09-21T15:08:11.497 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.497 INFO:teuthology.orchestra.run.smithi161.stdout:1595 punch from 0x5a46af0 to 0x5a55d08, (0xf218 bytes) 2024-09-21T15:08:11.497 INFO:teuthology.orchestra.run.smithi161.stdout:1596 read 0xad7c92 thru 0xae0706 (0x8a75 bytes) 2024-09-21T15:08:11.497 INFO:teuthology.orchestra.run.smithi161.stdout:1597 write 0x4e21df3 thru 0x4e313b6 (0xf5c4 bytes) 2024-09-21T15:08:11.500 INFO:teuthology.orchestra.run.smithi161.stdout:1960 write 0x1687159 thru 0x16949d5 (0xd87d bytes) 2024-09-21T15:08:11.503 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.503 INFO:teuthology.orchestra.run.smithi161.stdout:1568 read 0x729ab0 thru 0x7358b6 (0xbe07 bytes) 2024-09-21T15:08:11.505 INFO:teuthology.orchestra.run.smithi161.stdout:1569 writesame 0x46970be thru 0x469d09f data_size 0x3(0x5fe2 bytes) 2024-09-21T15:08:11.506 INFO:teuthology.orchestra.run.smithi161.stdout:1524 writesame 0xdee11b9 thru 0xdef0944 data_size 0x6(0xf78c bytes) 2024-09-21T15:08:11.507 INFO:teuthology.orchestra.run.smithi161.stdout:2134 punch from 0x376557d to 0x3766e59, (0x18dc bytes) 2024-09-21T15:08:11.529 INFO:teuthology.orchestra.run.smithi161.stdout:1526 trunc from 0xdef0945 to 0x55f1841 2024-09-21T15:08:11.541 INFO:teuthology.orchestra.run.smithi161.stdout:1598 read 0x211b90f thru 0x211e64b (0x2d3d bytes) 2024-09-21T15:08:11.554 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #14, image image_cluster1.client.mirror.3-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent15 2024-09-21T15:08:11.633 INFO:teuthology.orchestra.run.smithi161.stdout:2136 write 0xa6ea1d4 thru 0xa6f568c (0xb4b9 bytes) 2024-09-21T15:08:11.651 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.651 INFO:teuthology.orchestra.run.smithi161.stdout:1572 punch from 0x1d3d5cc to 0x1d4783e, (0xa272 bytes) 2024-09-21T15:08:11.651 INFO:teuthology.orchestra.run.smithi161.stdout:1573 read 0x6b9e921 thru 0x6badc52 (0xf332 bytes) 2024-09-21T15:08:11.653 INFO:teuthology.orchestra.run.smithi161.stdout:1574 trunc from 0xc38223d to 0xd3d4f3d 2024-09-21T15:08:11.660 INFO:teuthology.orchestra.run.smithi161.stdout:1599 write 0xd401e87 thru 0xd40e99a (0xcb14 bytes) 2024-09-21T15:08:11.660 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.660 INFO:teuthology.orchestra.run.smithi161.stdout:2139 read 0xa3678a1 thru 0xa36d8d4 (0x6034 bytes) 2024-09-21T15:08:11.663 INFO:teuthology.orchestra.run.smithi161.stdout:2140 trunc from 0xa6f568d to 0x9248a19 2024-09-21T15:08:11.682 INFO:teuthology.orchestra.run.smithi161.stdout:1601 write 0xb094e71 thru 0xb0a0b8a (0xbd1a bytes) 2024-09-21T15:08:11.691 INFO:teuthology.orchestra.run.smithi161.stdout:1527 writesame 0x69dc34 thru 0x6a9373 data_size 0x20(0xb740 bytes) 2024-09-21T15:08:11.703 INFO:teuthology.orchestra.run.smithi161.stdout:1575 write 0xd8129f thru 0xd88af8 (0x785a bytes) 2024-09-21T15:08:11.714 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.714 INFO:teuthology.orchestra.run.smithi161.stdout:1530 punch from 0x25055da to 0x2506e2f, (0x1855 bytes) 2024-09-21T15:08:11.723 INFO:teuthology.orchestra.run.smithi161.stdout:1602 punch from 0x219186d to 0x2194b1f, (0x32b2 bytes) 2024-09-21T15:08:11.723 INFO:teuthology.orchestra.run.smithi161.stdout:1603 read 0x7c4afcc thru 0x7c5046c (0x54a1 bytes) 2024-09-21T15:08:11.723 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.723 INFO:teuthology.orchestra.run.smithi161.stdout:1605 writesame 0xcee92f0 thru 0xceec371 data_size 0x7(0x3082 bytes) 2024-09-21T15:08:11.731 INFO:teuthology.orchestra.run.smithi161.stdout:1576 punch from 0xceaaeb2 to 0xceb3aa6, (0x8bf4 bytes) 2024-09-21T15:08:11.731 INFO:teuthology.orchestra.run.smithi161.stdout:1577 punch from 0xaf2d631 to 0xaf34cd9, (0x76a8 bytes) 2024-09-21T15:08:11.731 INFO:teuthology.orchestra.run.smithi161.stdout:1578 writesame 0x7a19684 thru 0x7a2673c data_size 0x9(0xd0b9 bytes) 2024-09-21T15:08:11.737 INFO:teuthology.orchestra.run.smithi161.stdout:2142 read 0xd93caa thru 0xd9c835 (0x8b8c bytes) 2024-09-21T15:08:11.737 INFO:teuthology.orchestra.run.smithi161.stdout:1606 write 0x935181d thru 0x93533d0 (0x1bb4 bytes) 2024-09-21T15:08:11.746 INFO:teuthology.orchestra.run.smithi161.stdout:1962 trunc from 0xc111298 to 0x3ccb40f 2024-09-21T15:08:11.752 INFO:teuthology.orchestra.run.smithi161.stdout:1580 writesame 0x55a48dd thru 0x55a6b40 data_size 0x3e(0x2264 bytes) 2024-09-21T15:08:11.755 INFO:teuthology.orchestra.run.smithi161.stdout:1607 write 0x764d3c1 thru 0x765c6b4 (0xf2f4 bytes) 2024-09-21T15:08:11.762 INFO:teuthology.orchestra.run.smithi161.stdout:1531 writesame 0x745c625 thru 0x745f190 data_size 0xe(0x2b6c bytes) 2024-09-21T15:08:11.772 INFO:teuthology.orchestra.run.smithi161.stdout:1581 read 0xb1549f7 thru 0xb16353e (0xeb48 bytes) 2024-09-21T15:08:11.772 INFO:teuthology.orchestra.run.smithi161.stdout:1582 write 0x1f40002 thru 0x1f468ea (0x68e9 bytes) 2024-09-21T15:08:11.777 INFO:teuthology.orchestra.run.smithi161.stdout:1532 trunc from 0x745f191 to 0x8757f3e 2024-09-21T15:08:11.785 INFO:teuthology.orchestra.run.smithi161.stdout:2143 writesame 0xda805c6 thru 0xda8bbd5 data_size 0x18(0xb610 bytes) 2024-09-21T15:08:11.790 INFO:teuthology.orchestra.run.smithi161.stdout:2145 read 0x8b3b44d thru 0x8b42059 (0x6c0d bytes) 2024-09-21T15:08:11.792 INFO:teuthology.orchestra.run.smithi161.stdout:2146 read 0x409c8d7 thru 0x40a8435 (0xbb5f bytes) 2024-09-21T15:08:11.792 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.792 INFO:teuthology.orchestra.run.smithi161.stdout:2148 read 0x2e1810d thru 0x2e1bcb4 (0x3ba8 bytes) 2024-09-21T15:08:11.793 INFO:teuthology.orchestra.run.smithi161.stdout:2149 writesame 0xb5a96d9 thru 0xb5b1875 data_size 0x1(0x819d bytes) 2024-09-21T15:08:11.796 INFO:teuthology.orchestra.run.smithi161.stdout:1583 write 0x37fb4a thru 0x38d318 (0xd7cf bytes) 2024-09-21T15:08:11.829 INFO:teuthology.orchestra.run.smithi161.stdout:1608 writesame 0xdf91f53 thru 0xdf97acb data_size 0x1(0x5b79 bytes) 2024-09-21T15:08:11.830 INFO:teuthology.orchestra.run.smithi161.stdout:2151 read 0x6a24ef0 thru 0x6a28588 (0x3699 bytes) 2024-09-21T15:08:11.830 INFO:teuthology.orchestra.run.smithi161.stdout:1586 read 0x7019662 thru 0x7020697 (0x7036 bytes) 2024-09-21T15:08:11.830 INFO:teuthology.orchestra.run.smithi161.stdout:1587 write 0x6bc8da7 thru 0x6bcd857 (0x4ab1 bytes) 2024-09-21T15:08:11.830 INFO:teuthology.orchestra.run.smithi161.stdout:2152 write 0x39508ee thru 0x395a914 (0xa027 bytes) 2024-09-21T15:08:11.831 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.831 INFO:teuthology.orchestra.run.smithi161.stdout:1534 punch from 0x816a37f to 0x8175e57, (0xbad8 bytes) 2024-09-21T15:08:11.831 INFO:teuthology.orchestra.run.smithi161.stdout:1535 read 0x1e424c0 thru 0x1e4ab0d (0x864e bytes) 2024-09-21T15:08:11.831 INFO:teuthology.orchestra.run.smithi161.stdout:1963 read 0x1c0bb9d thru 0x1c0f53d (0x39a1 bytes) 2024-09-21T15:08:11.832 INFO:teuthology.orchestra.run.smithi161.stdout:1964 punch from 0x1ef5a26 to 0x1ef715f, (0x1739 bytes) 2024-09-21T15:08:11.833 INFO:teuthology.orchestra.run.smithi161.stdout:1609 read 0xa27f174 thru 0xa28154c (0x23d9 bytes) 2024-09-21T15:08:11.833 INFO:teuthology.orchestra.run.smithi161.stdout:1610 write 0xc7b067 thru 0xc7f796 (0x4730 bytes) 2024-09-21T15:08:11.834 INFO:teuthology.orchestra.run.smithi161.stdout:1965 trunc from 0x3ccb40f to 0x2fca003 2024-09-21T15:08:11.835 INFO:teuthology.orchestra.run.smithi161.stdout:1536 trunc from 0x8757f3e to 0x6ddbb9f 2024-09-21T15:08:11.862 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:11.862 INFO:teuthology.orchestra.run.smithi161.stdout:1592 writesame 0xc63fc1 thru 0xc65e6d data_size 0x1(0x1ead bytes) 2024-09-21T15:08:11.870 INFO:teuthology.orchestra.run.smithi161.stdout:2153 write 0x425b85d thru 0x4269c03 (0xe3a7 bytes) 2024-09-21T15:08:11.887 INFO:teuthology.orchestra.run.smithi161.stdout:1593 read 0xc574b8 thru 0xc58eca (0x1a13 bytes) 2024-09-21T15:08:11.889 INFO:teuthology.orchestra.run.smithi161.stdout:1594 punch from 0x68706a9 to 0x687db4a, (0xd4a1 bytes) 2024-09-21T15:08:11.889 INFO:teuthology.orchestra.run.smithi161.stdout:1595 writesame 0xec5256 thru 0xed1bfd data_size 0xc(0xc9a8 bytes) 2024-09-21T15:08:11.898 INFO:teuthology.orchestra.run.smithi161.stdout:1537 writesame 0x63718a6 thru 0x6378926 data_size 0x1(0x7081 bytes) 2024-09-21T15:08:11.900 INFO:teuthology.orchestra.run.smithi161.stdout:1966 writesame 0x4f01f5 thru 0x4fa1e0 data_size 0x2e(0x9fec bytes) 2024-09-21T15:08:11.903 INFO:teuthology.orchestra.run.smithi161.stdout:1597 writesame 0x9cb1447 thru 0x9cc0a7a data_size 0xe(0xf634 bytes) 2024-09-21T15:08:11.903 INFO:teuthology.orchestra.run.smithi161.stdout:2154 read 0xbea7388 thru 0xbeafacd (0x8746 bytes) 2024-09-21T15:08:11.904 INFO:teuthology.orchestra.run.smithi161.stdout:2155 write 0x419984a thru 0x41a0dc0 (0x7577 bytes) 2024-09-21T15:08:11.906 INFO:teuthology.orchestra.run.smithi161.stdout:1611 writesame 0xe46e461 thru 0xe475343 data_size 0x1(0x6ee3 bytes) 2024-09-21T15:08:11.908 INFO:teuthology.orchestra.run.smithi161.stdout:1612 write 0x86dcaae thru 0x86e41ba (0x770d bytes) 2024-09-21T15:08:11.981 INFO:teuthology.orchestra.run.smithi161.stdout:1613 write 0x13e4b48 thru 0x13ec5a6 (0x7a5f bytes) 2024-09-21T15:08:12.000 INFO:teuthology.orchestra.run.smithi161.stdout:1614 punch from 0xddc1cf8 to 0xddc79c0, (0x5cc8 bytes) 2024-09-21T15:08:12.000 INFO:teuthology.orchestra.run.smithi161.stdout:1615 writesame 0x9515e01 thru 0x9516563 data_size 0x1(0x763 bytes) 2024-09-21T15:08:12.003 INFO:teuthology.orchestra.run.smithi161.stdout:2157 writesame 0xd067791 thru 0xd0760ff data_size 0x1(0xe96f bytes) 2024-09-21T15:08:12.051 INFO:teuthology.orchestra.run.smithi161.stdout:1598 writesame 0x77367f4 thru 0x773b29e data_size 0x1(0x4aab bytes) 2024-09-21T15:08:12.057 INFO:teuthology.orchestra.run.smithi161.stdout:2158 punch from 0x301eb5e to 0x301fa4e, (0xef0 bytes) 2024-09-21T15:08:12.057 INFO:teuthology.orchestra.run.smithi161.stdout:2159 write 0x40bef76 thru 0x40c1d2e (0x2db9 bytes) 2024-09-21T15:08:12.059 INFO:teuthology.orchestra.run.smithi161.stdout:1616 punch from 0x103571d to 0x1042b6c, (0xd44f bytes) 2024-09-21T15:08:12.059 INFO:teuthology.orchestra.run.smithi161.stdout:1617 read 0x45b9433 thru 0x45bdd49 (0x4917 bytes) 2024-09-21T15:08:12.059 INFO:teuthology.orchestra.run.smithi161.stdout:1618 punch from 0x3b6f814 to 0x3b71ae5, (0x22d1 bytes) 2024-09-21T15:08:12.059 INFO:teuthology.orchestra.run.smithi161.stdout:1619 punch from 0x7189a5f to 0x718fd82, (0x6323 bytes) 2024-09-21T15:08:12.059 INFO:teuthology.orchestra.run.smithi161.stdout:1620 punch from 0x6d0f108 to 0x6d115f8, (0x24f0 bytes) 2024-09-21T15:08:12.068 INFO:teuthology.orchestra.run.smithi161.stdout:2161 read 0x208d2e8 thru 0x209b84c (0xe565 bytes) 2024-09-21T15:08:12.070 INFO:teuthology.orchestra.run.smithi161.stdout:2162 writesame 0xae7fd36 thru 0xae8234b data_size 0x1e(0x2616 bytes) 2024-09-21T15:08:12.071 INFO:teuthology.orchestra.run.smithi161.stdout:1409 write 0x56c6979 thru 0x56c992b (0x2fb3 bytes) 2024-09-21T15:08:12.080 INFO:teuthology.orchestra.run.smithi161.stdout:1621 trunc from 0xe475344 to 0xf8d2b5 2024-09-21T15:08:12.083 INFO:teuthology.orchestra.run.smithi161.stdout:2163 read 0xd8778a5 thru 0xd87bba0 (0x42fc bytes) 2024-09-21T15:08:12.083 INFO:teuthology.orchestra.run.smithi161.stdout:2165 writesame 0x8f4dd0e thru 0x8f58c89 data_size 0x16(0xaf7c bytes) 2024-09-21T15:08:12.093 INFO:teuthology.orchestra.run.smithi161.stdout:2167 read 0xc17e80b thru 0xc1873c2 (0x8bb8 bytes) 2024-09-21T15:08:12.094 INFO:teuthology.orchestra.run.smithi161.stdout:2169 read 0x471f2cd thru 0x472bbf1 (0xc925 bytes) 2024-09-21T15:08:12.102 INFO:teuthology.orchestra.run.smithi161.stdout:2171 trunc from 0xda8bbd6 to 0xa7eb192 2024-09-21T15:08:12.117 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.117 INFO:teuthology.orchestra.run.smithi161.stdout:1602 read 0x5115597 thru 0x5119f78 (0x49e2 bytes) 2024-09-21T15:08:12.120 INFO:teuthology.orchestra.run.smithi161.stdout:1603 trunc from 0xd3d4f3d to 0xbd499ad 2024-09-21T15:08:12.144 INFO:teuthology.orchestra.run.smithi161.stdout:1538 writesame 0xd7e7527 thru 0xd7e951b data_size 0x1b(0x1ff5 bytes) 2024-09-21T15:08:12.158 INFO:teuthology.orchestra.run.smithi161.stdout:1967 trunc from 0x2fca003 to 0x444c0f5 2024-09-21T15:08:12.158 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.159 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.161 INFO:teuthology.orchestra.run.smithi161.stdout:1623 read 0x529ec3 thru 0x538552 (0xe690 bytes) 2024-09-21T15:08:12.163 INFO:teuthology.orchestra.run.smithi161.stdout:1414 trunc from 0x5cf573b to 0x736d36b 2024-09-21T15:08:12.172 INFO:teuthology.orchestra.run.smithi161.stdout:1539 trunc from 0xd7e951c to 0x292dc1a 2024-09-21T15:08:12.174 INFO:teuthology.orchestra.run.smithi161.stdout:1604 trunc from 0xbd499ad to 0xa490fe8 2024-09-21T15:08:12.178 INFO:teuthology.orchestra.run.smithi161.stdout:1624 trunc from 0xf8d2b5 to 0x82e2dd5 2024-09-21T15:08:12.180 INFO:teuthology.orchestra.run.smithi161.stdout:2172 write 0x3b85eae thru 0x3b87318 (0x146b bytes) 2024-09-21T15:08:12.187 INFO:teuthology.orchestra.run.smithi161.stdout:2173 write 0x96a11db thru 0x96ab8dc (0xa702 bytes) 2024-09-21T15:08:12.187 INFO:teuthology.orchestra.run.smithi161.stdout:1968 writesame 0xdb2a4a thru 0xdbe0be data_size 0x1(0xb675 bytes) 2024-09-21T15:08:12.194 INFO:teuthology.orchestra.run.smithi161.stdout:1415 trunc from 0x736d36b to 0x79d651f 2024-09-21T15:08:12.212 INFO:teuthology.orchestra.run.smithi161.stdout:1969 read 0x34f0ffe thru 0x34f142b (0x42e bytes) 2024-09-21T15:08:12.213 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.213 INFO:teuthology.orchestra.run.smithi161.stdout:2175 punch from 0x522c1fc to 0x522df58, (0x1d5c bytes) 2024-09-21T15:08:12.223 INFO:teuthology.orchestra.run.smithi161.stdout:1542 write 0xbccd06 thru 0xbd88eb (0xbbe6 bytes) 2024-09-21T15:08:12.231 INFO:teuthology.orchestra.run.smithi161.stdout:1625 trunc from 0x82e2dd5 to 0xddd61a9 2024-09-21T15:08:12.231 INFO:teuthology.orchestra.run.smithi161.stdout:1416 read 0x679200 thru 0x67a2cb (0x10cc bytes) 2024-09-21T15:08:12.232 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.236 INFO:teuthology.orchestra.run.smithi161.stdout:1605 trunc from 0xa490fe8 to 0x8d7ced 2024-09-21T15:08:12.253 INFO:teuthology.orchestra.run.smithi161.stdout:1544 trunc from 0x292dc1a to 0xcbbc389 2024-09-21T15:08:12.260 INFO:teuthology.orchestra.run.smithi161.stdout:2176 write 0xde342f6 thru 0xde3b3b7 (0x70c2 bytes) 2024-09-21T15:08:12.273 INFO:teuthology.orchestra.run.smithi161.stdout:1626 read 0x6ceedbf thru 0x6cf74dd (0x871f bytes) 2024-09-21T15:08:12.273 INFO:teuthology.orchestra.run.smithi161.stdout:1627 read 0x86b10d5 thru 0x86bb558 (0xa484 bytes) 2024-09-21T15:08:12.273 INFO:teuthology.orchestra.run.smithi161.stdout:1628 write 0x33d34ad thru 0x33dbb04 (0x8658 bytes) 2024-09-21T15:08:12.286 INFO:teuthology.orchestra.run.smithi161.stdout:1417 writesame 0xe3c4330 thru 0xe3cd0de data_size 0x17(0x8daf bytes) 2024-09-21T15:08:12.291 INFO:teuthology.orchestra.run.smithi161.stdout:2177 read 0x4169ec0 thru 0x41742e6 (0xa427 bytes) 2024-09-21T15:08:12.292 INFO:teuthology.orchestra.run.smithi161.stdout:2179 punch from 0xc81c679 to 0xc8228f7, (0x627e bytes) 2024-09-21T15:08:12.292 INFO:teuthology.orchestra.run.smithi161.stdout:2180 read 0xac2cb34 thru 0xac3403b (0x7508 bytes) 2024-09-21T15:08:12.292 INFO:teuthology.orchestra.run.smithi161.stdout:2183 read 0x1cacc0d thru 0x1cb5984 (0x8d78 bytes) 2024-09-21T15:08:12.293 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.293 INFO:teuthology.orchestra.run.smithi161.stdout:2186 write 0xd72900f thru 0xd72dac6 (0x4ab8 bytes) 2024-09-21T15:08:12.294 INFO:teuthology.orchestra.run.smithi161.stdout:1419 writesame 0x128c7ba thru 0x128ced1 data_size 0x4(0x718 bytes) 2024-09-21T15:08:12.297 INFO:teuthology.orchestra.run.smithi161.stdout:1629 punch from 0xb15cfb3 to 0xb16908f, (0xc0dc bytes) 2024-09-21T15:08:12.297 INFO:teuthology.orchestra.run.smithi161.stdout:1630 punch from 0x4930907 to 0x4933db5, (0x34ae bytes) 2024-09-21T15:08:12.297 INFO:teuthology.orchestra.run.smithi161.stdout:1631 write 0x9bb1700 thru 0x9bb2518 (0xe19 bytes) 2024-09-21T15:08:12.305 INFO:teuthology.orchestra.run.smithi161.stdout:1970 writesame 0xe7d2149 thru 0xe7d90ab data_size 0x5(0x6f63 bytes) 2024-09-21T15:08:12.310 INFO:teuthology.orchestra.run.smithi161.stdout:1545 writesame 0x34459df thru 0x344b2af data_size 0x35(0x58d1 bytes) 2024-09-21T15:08:12.310 INFO:teuthology.orchestra.run.smithi161.stdout:1972 read 0x50e2fd5 thru 0x50eb577 (0x85a3 bytes) 2024-09-21T15:08:12.310 INFO:teuthology.orchestra.run.smithi161.stdout:1974 write 0x1115bc2 thru 0x1115f3c (0x37b bytes) 2024-09-21T15:08:12.315 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.316 INFO:teuthology.orchestra.run.smithi161.stdout:2188 punch from 0x77a87f2 to 0x77ad165, (0x4973 bytes) 2024-09-21T15:08:12.316 INFO:teuthology.orchestra.run.smithi161.stdout:2189 read 0x74f409a thru 0x74f4eb9 (0xe20 bytes) 2024-09-21T15:08:12.317 INFO:teuthology.orchestra.run.smithi161.stdout:2190 read 0x8177810 thru 0x81844f8 (0xcce9 bytes) 2024-09-21T15:08:12.317 INFO:teuthology.orchestra.run.smithi161.stdout:1975 punch from 0x253d1a2 to 0x25467d5, (0x9633 bytes) 2024-09-21T15:08:12.317 INFO:teuthology.orchestra.run.smithi161.stdout:1976 write 0x49ee35 thru 0x4a7abf (0x8c8b bytes) 2024-09-21T15:08:12.318 INFO:teuthology.orchestra.run.smithi161.stdout:1547 punch from 0x46cd50 to 0x47a17e, (0xd42e bytes) 2024-09-21T15:08:12.318 INFO:teuthology.orchestra.run.smithi161.stdout:1548 write 0x23d2287 thru 0x23dfe8c (0xdc06 bytes) 2024-09-21T15:08:12.318 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.318 INFO:teuthology.orchestra.run.smithi161.stdout:2193 punch from 0x738c6bb to 0x7395e89, (0x97ce bytes) 2024-09-21T15:08:12.327 INFO:teuthology.orchestra.run.smithi161.stdout:2195 trunc from 0xde3b3b8 to 0x90efb06 2024-09-21T15:08:12.351 INFO:teuthology.orchestra.run.smithi161.stdout:1420 read 0x1992ab1 thru 0x1998bc3 (0x6113 bytes) 2024-09-21T15:08:12.375 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.375 INFO:teuthology.orchestra.run.smithi161.stdout:1552 writesame 0x74d555 thru 0x7539a9 data_size 0xb(0x6455 bytes) 2024-09-21T15:08:12.395 INFO:teuthology.orchestra.run.smithi161.stdout:1422 write 0xcd79a6 thru 0xcdddd4 (0x642f bytes) 2024-09-21T15:08:12.469 INFO:teuthology.orchestra.run.smithi161.stdout:1553 punch from 0x856458c to 0x856559e, (0x1012 bytes) 2024-09-21T15:08:12.469 INFO:teuthology.orchestra.run.smithi161.stdout:1555 write 0xabd1af8 thru 0xabdc137 (0xa640 bytes) 2024-09-21T15:08:12.470 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.470 INFO:teuthology.orchestra.run.smithi161.stdout:1607 read 0x6b45ce thru 0x6befbc (0xa9ef bytes) 2024-09-21T15:08:12.475 INFO:teuthology.orchestra.run.smithi161.stdout:1633 writesame 0xe25d443 thru 0xe25d595 data_size 0x1(0x153 bytes) 2024-09-21T15:08:12.479 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.479 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.479 INFO:teuthology.orchestra.run.smithi161.stdout:1638 writesame 0x9c43e62 thru 0x9c498f5 data_size 0x44(0x5a94 bytes) 2024-09-21T15:08:12.495 INFO:teuthology.orchestra.run.smithi161.stdout:1640 writesame 0x8ac4d60 thru 0x8acf444 data_size 0x5(0xa6e5 bytes) 2024-09-21T15:08:12.512 INFO:teuthology.orchestra.run.smithi161.stdout:1641 read 0x5971832 thru 0x59736d7 (0x1ea6 bytes) 2024-09-21T15:08:12.512 INFO:teuthology.orchestra.run.smithi161.stdout:1645 read 0x67ca7cb thru 0x67cebb1 (0x43e7 bytes) 2024-09-21T15:08:12.513 INFO:teuthology.orchestra.run.smithi161.stdout:1646 read 0x8867a8b thru 0x886edec (0x7362 bytes) 2024-09-21T15:08:12.513 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.513 INFO:teuthology.orchestra.run.smithi161.stdout:1649 write 0xac77dbf thru 0xac78f0d (0x114f bytes) 2024-09-21T15:08:12.534 INFO:teuthology.orchestra.run.smithi161.stdout:1556 read 0x4b35d57 thru 0x4b435d1 (0xd87b bytes) 2024-09-21T15:08:12.535 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.535 INFO:teuthology.orchestra.run.smithi161.stdout:1560 punch from 0x2ba9f38 to 0x2bb7a6a, (0xdb32 bytes) 2024-09-21T15:08:12.535 INFO:teuthology.orchestra.run.smithi161.stdout:1561 write 0x41d4f90 thru 0x41de905 (0x9976 bytes) 2024-09-21T15:08:12.538 INFO:teuthology.orchestra.run.smithi161.stdout:1650 writesame 0xf9022c thru 0xf9d62b data_size 0x10(0xd400 bytes) 2024-09-21T15:08:12.541 INFO:teuthology.orchestra.run.smithi161.stdout:2196 write 0xd6ea409 thru 0xd6ebc47 (0x183f bytes) 2024-09-21T15:08:12.546 INFO:teuthology.orchestra.run.smithi161.stdout:1424 writesame 0xcb7e4b6 thru 0xcb8bead data_size 0x64(0xd9f8 bytes) 2024-09-21T15:08:12.553 INFO:teuthology.orchestra.run.smithi161.stdout:2197 writesame 0x53c3c46 thru 0x53cd258 data_size 0x1(0x9613 bytes) 2024-09-21T15:08:12.556 INFO:teuthology.orchestra.run.smithi161.stdout:1562 writesame 0x380d223 thru 0x38198d5 data_size 0x1(0xc6b3 bytes) 2024-09-21T15:08:12.558 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.559 INFO:teuthology.orchestra.run.smithi161.stdout:1653 write 0xcc72716 thru 0xcc77a11 (0x52fc bytes) 2024-09-21T15:08:12.581 INFO:teuthology.orchestra.run.smithi161.stdout:2199 read 0x85fdd29 thru 0x860cf49 (0xf221 bytes) 2024-09-21T15:08:12.584 INFO:teuthology.orchestra.run.smithi161.stdout:1654 punch from 0x334a1b2 to 0x33564dd, (0xc32b bytes) 2024-09-21T15:08:12.584 INFO:teuthology.orchestra.run.smithi161.stdout:1655 read 0x41b95ae thru 0x41bc6e6 (0x3139 bytes) 2024-09-21T15:08:12.584 INFO:teuthology.orchestra.run.smithi161.stdout:1425 write 0x3732882 thru 0x3737441 (0x4bc0 bytes) 2024-09-21T15:08:12.596 INFO:teuthology.orchestra.run.smithi161.stdout:1656 trunc from 0xe25d596 to 0x7aebb11 2024-09-21T15:08:12.597 INFO:teuthology.orchestra.run.smithi161.stdout:1608 write 0x49da142 thru 0x49e0dc6 (0x6c85 bytes) 2024-09-21T15:08:12.607 INFO:teuthology.orchestra.run.smithi161.stdout:1564 read 0xac930f9 thru 0xaca177a (0xe682 bytes) 2024-09-21T15:08:12.619 INFO:teuthology.orchestra.run.smithi161.stdout:1426 clone 17 order 22 su 524288 sc 8 2024-09-21T15:08:12.622 INFO:teuthology.orchestra.run.smithi161.stdout:1977 writesame 0x43092e8 thru 0x430bbfe data_size 0x1(0x2917 bytes) 2024-09-21T15:08:12.624 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.633 INFO:teuthology.orchestra.run.smithi161.stdout:2202 write 0xe65c9ad thru 0xe6653bb (0x8a0f bytes) 2024-09-21T15:08:12.639 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.639 INFO:teuthology.orchestra.run.smithi161.stdout:1979 read 0x7985079 thru 0x798e89f (0x9827 bytes) 2024-09-21T15:08:12.640 INFO:teuthology.orchestra.run.smithi161.stdout:1980 read 0x32a9aee thru 0x32b36dd (0x9bf0 bytes) 2024-09-21T15:08:12.640 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.640 INFO:teuthology.orchestra.run.smithi161.stdout:1983 write 0x115af06 thru 0x11608f7 (0x59f2 bytes) 2024-09-21T15:08:12.647 INFO:teuthology.orchestra.run.smithi161.stdout:2203 read 0xad07b81 thru 0xad0f94b (0x7dcb bytes) 2024-09-21T15:08:12.647 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.647 INFO:teuthology.orchestra.run.smithi161.stdout:2206 read 0x9731800 thru 0x97397ef (0x7ff0 bytes) 2024-09-21T15:08:12.652 INFO:teuthology.orchestra.run.smithi161.stdout:1565 writesame 0xdeb591f thru 0xdeb7561 data_size 0x1(0x1c43 bytes) 2024-09-21T15:08:12.655 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.656 INFO:teuthology.orchestra.run.smithi161.stdout:1567 read 0x9b3c627 thru 0x9b43414 (0x6dee bytes) 2024-09-21T15:08:12.656 INFO:teuthology.orchestra.run.smithi161.stdout:1568 write 0xc558d54 thru 0xc562184 (0x9431 bytes) 2024-09-21T15:08:12.656 INFO:teuthology.orchestra.run.smithi161.stdout:1984 writesame 0x94c0b3f thru 0x94cba47 data_size 0x1(0xaf09 bytes) 2024-09-21T15:08:12.664 INFO:teuthology.orchestra.run.smithi161.stdout:2207 trunc from 0xe6653bc to 0x7c42332 2024-09-21T15:08:12.673 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.673 INFO:teuthology.orchestra.run.smithi161.stdout:1570 punch from 0x331c5c9 to 0x3321b69, (0x55a0 bytes) 2024-09-21T15:08:12.673 INFO:teuthology.orchestra.run.smithi161.stdout:1572 write 0x13d8d6d thru 0x13e5dc4 (0xd058 bytes) 2024-09-21T15:08:12.684 INFO:teuthology.orchestra.run.smithi161.stdout:1610 writesame 0xbb152a4 thru 0xbb17550 data_size 0xb(0x22ad bytes) 2024-09-21T15:08:12.706 INFO:teuthology.orchestra.run.smithi161.stdout:1985 write 0xd911001 thru 0xd914c9a (0x3c9a bytes) 2024-09-21T15:08:12.709 INFO:teuthology.orchestra.run.smithi161.stdout:1574 write 0x37bfa0f thru 0x37cabcb (0xb1bd bytes) 2024-09-21T15:08:12.710 INFO:teuthology.orchestra.run.smithi161.stdout:1657 write 0x9330db5 thru 0x9330e2c (0x78 bytes) 2024-09-21T15:08:12.723 INFO:teuthology.orchestra.run.smithi161.stdout:1986 writesame 0xbae0236 thru 0xbae4582 data_size 0x1(0x434d bytes) 2024-09-21T15:08:12.723 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.723 INFO:teuthology.orchestra.run.smithi161.stdout:1581 read 0x14edbd8 thru 0x14f3390 (0x57b9 bytes) 2024-09-21T15:08:12.724 INFO:teuthology.orchestra.run.smithi161.stdout:1582 read 0xa868ecb thru 0xa86a455 (0x158b bytes) 2024-09-21T15:08:12.724 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.724 INFO:teuthology.orchestra.run.smithi161.stdout:1584 writesame 0xa8b687a thru 0xa8b9025 data_size 0x1(0x27ac bytes) 2024-09-21T15:08:12.724 INFO:teuthology.orchestra.run.smithi161.stdout:1658 write 0x8d9fcb thru 0x8e5055 (0xb08b bytes) 2024-09-21T15:08:12.735 INFO:teuthology.orchestra.run.smithi161.stdout:1659 trunc from 0x9330e2d to 0x935de85 2024-09-21T15:08:12.744 INFO:teuthology.orchestra.run.smithi161.stdout:1613 writesame 0xddcd298 thru 0xddd4af0 data_size 0x1(0x7859 bytes) 2024-09-21T15:08:12.745 INFO:teuthology.orchestra.run.smithi161.stdout:2209 read 0x3c472c thru 0x3cc07c (0x7951 bytes) 2024-09-21T15:08:12.746 INFO:teuthology.orchestra.run.smithi161.stdout:2211 write 0x566698 thru 0x568685 (0x1fee bytes) 2024-09-21T15:08:12.747 INFO:teuthology.orchestra.run.smithi161.stdout:1585 punch from 0xabd7325 to 0xabe6963, (0xf63e bytes) 2024-09-21T15:08:12.747 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.747 INFO:teuthology.orchestra.run.smithi161.stdout:1588 write 0x2c03843 thru 0x2c11643 (0xde01 bytes) 2024-09-21T15:08:12.748 INFO:teuthology.orchestra.run.smithi161.stdout:1614 read 0xae4fe8a thru 0xae521f1 (0x2368 bytes) 2024-09-21T15:08:12.748 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.748 INFO:teuthology.orchestra.run.smithi161.stdout:1616 write 0xf733f5 thru 0xf75b41 (0x274d bytes) 2024-09-21T15:08:12.761 INFO:teuthology.orchestra.run.smithi161.stdout:1589 write 0xda42921 thru 0xda509aa (0xe08a bytes) 2024-09-21T15:08:12.767 INFO:teuthology.orchestra.run.smithi161.stdout:1987 trunc from 0xe7d90ac to 0x2fec859 2024-09-21T15:08:12.774 INFO:teuthology.orchestra.run.smithi161.stdout:1617 writesame 0xa29f147 thru 0xa2ad3ae data_size 0x48(0xe268 bytes) 2024-09-21T15:08:12.777 INFO:teuthology.orchestra.run.smithi161.stdout:2212 punch from 0x1b432e1 to 0x1b4d917, (0xa636 bytes) 2024-09-21T15:08:12.777 INFO:teuthology.orchestra.run.smithi161.stdout:2213 punch from 0x1182f9d to 0x1183e8b, (0xeee bytes) 2024-09-21T15:08:12.777 INFO:teuthology.orchestra.run.smithi161.stdout:2214 flatten 2024-09-21T15:08:12.780 INFO:teuthology.orchestra.run.smithi161.stdout:1590 punch from 0xd1099bc to 0xd118461, (0xeaa5 bytes) 2024-09-21T15:08:12.780 INFO:teuthology.orchestra.run.smithi161.stdout:1591 write 0xc456f0f thru 0xc46168e (0xa780 bytes) 2024-09-21T15:08:12.783 INFO:teuthology.orchestra.run.smithi161.stdout:1660 trunc from 0x935de85 to 0xbb6880f 2024-09-21T15:08:12.800 INFO:teuthology.orchestra.run.smithi161.stdout:1618 punch from 0x852d051 to 0x853bc08, (0xebb7 bytes) 2024-09-21T15:08:12.800 INFO:teuthology.orchestra.run.smithi161.stdout:1619 punch from 0xabef936 to 0xabf2dbe, (0x3488 bytes) 2024-09-21T15:08:12.801 INFO:teuthology.orchestra.run.smithi161.stdout:1620 punch from 0x2879d48 to 0x288751c, (0xd7d4 bytes) 2024-09-21T15:08:12.803 INFO:teuthology.orchestra.run.smithi161.stdout:1593 trunc from 0xdeb7562 to 0xa26ef9f 2024-09-21T15:08:12.821 INFO:teuthology.orchestra.run.smithi161.stdout:1621 trunc from 0xddd4af1 to 0x215d2f7 2024-09-21T15:08:12.895 INFO:teuthology.orchestra.run.smithi161.stdout:1661 trunc from 0xbb6880f to 0x5d65312 2024-09-21T15:08:12.911 INFO:teuthology.orchestra.run.smithi161.stdout:1988 writesame 0x178fc87 thru 0x179bfbf data_size 0x1(0xc339 bytes) 2024-09-21T15:08:12.912 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:12.942 INFO:teuthology.orchestra.run.smithi161.stdout:1989 read 0x2f7cf46 thru 0x2f7e6c8 (0x1783 bytes) 2024-09-21T15:08:12.948 INFO:teuthology.orchestra.run.smithi161.stdout:1622 writesame 0x3f7d8f7 thru 0x3f8d205 data_size 0x35(0xf90f bytes) 2024-09-21T15:08:12.953 INFO:teuthology.orchestra.run.smithi161.stdout:1623 punch from 0x250f369 to 0x2515e93, (0x6b2a bytes) 2024-09-21T15:08:12.953 INFO:teuthology.orchestra.run.smithi161.stdout:1624 read 0x24c36fb thru 0x24cb2a5 (0x7bab bytes) 2024-09-21T15:08:12.958 INFO:teuthology.orchestra.run.smithi161.stdout:1599 write 0xd0cdfca thru 0xd0d98ff (0xb936 bytes) 2024-09-21T15:08:12.972 INFO:teuthology.orchestra.run.smithi161.stdout:1600 punch from 0x369df4c to 0x36abff5, (0xe0a9 bytes) 2024-09-21T15:08:12.973 INFO:teuthology.orchestra.run.smithi161.stdout:1604 read 0xcaf8eb9 thru 0xcafa283 (0x13cb bytes) 2024-09-21T15:08:12.973 INFO:teuthology.orchestra.run.smithi161.stdout:1606 read 0xa2375e2 thru 0xa240689 (0x90a8 bytes) 2024-09-21T15:08:12.974 INFO:teuthology.orchestra.run.smithi161.stdout:1607 read 0x3f57505 thru 0x3f5c408 (0x4f04 bytes) 2024-09-21T15:08:12.974 INFO:teuthology.orchestra.run.smithi161.stdout:1608 punch from 0x323d34d to 0x32420e3, (0x4d96 bytes) 2024-09-21T15:08:12.977 INFO:teuthology.orchestra.run.smithi161.stdout:1609 trunc from 0xd0d9900 to 0xe240cd2 2024-09-21T15:08:12.989 INFO:teuthology.orchestra.run.smithi161.stdout:1991 write 0x43bff79 thru 0x43c2324 (0x23ac bytes) 2024-09-21T15:08:13.000 INFO:teuthology.orchestra.run.smithi161.stdout:1627 writesame 0x81ef3d0 thru 0x81f98c9 data_size 0x3(0xa4fa bytes) 2024-09-21T15:08:13.004 INFO:teuthology.orchestra.run.smithi161.stdout:1992 punch from 0x229909c to 0x22a396d, (0xa8d1 bytes) 2024-09-21T15:08:13.005 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.005 INFO:teuthology.orchestra.run.smithi161.stdout:2216 write 0x69d8651 thru 0x69de0ab (0x5a5b bytes) 2024-09-21T15:08:13.007 INFO:teuthology.orchestra.run.smithi161.stdout:1662 writesame 0xe59963b thru 0xe59a9b5 data_size 0x1(0x137b bytes) 2024-09-21T15:08:13.007 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.010 INFO:teuthology.orchestra.run.smithi161.stdout:1663 write 0x68ef89e thru 0x68f4506 (0x4c69 bytes) 2024-09-21T15:08:13.013 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.013 INFO:teuthology.orchestra.run.smithi161.stdout:1611 read 0x458424 thru 0x458fab (0xb88 bytes) 2024-09-21T15:08:13.014 INFO:teuthology.orchestra.run.smithi161.stdout:1612 write 0x4e66189 thru 0x4e712e9 (0xb161 bytes) 2024-09-21T15:08:13.022 INFO:teuthology.orchestra.run.smithi161.stdout:1664 read 0x1b74d20 thru 0x1b7bf57 (0x7238 bytes) 2024-09-21T15:08:13.022 INFO:teuthology.orchestra.run.smithi161.stdout:1666 punch from 0x97a5446 to 0x97b2092, (0xcc4c bytes) 2024-09-21T15:08:13.022 INFO:teuthology.orchestra.run.smithi161.stdout:1667 write 0xaa167a5 thru 0xaa1d0cf (0x692b bytes) 2024-09-21T15:08:13.023 INFO:teuthology.orchestra.run.smithi161.stdout:1613 write 0x972844 thru 0x97b23c (0x89f9 bytes) 2024-09-21T15:08:13.023 INFO:teuthology.orchestra.run.smithi161.stdout:1993 trunc from 0x43c2325 to 0xde21ee0 2024-09-21T15:08:13.031 INFO:teuthology.orchestra.run.smithi161.stdout:1614 write 0x7a4ed7 thru 0x7aef3f (0xa069 bytes) 2024-09-21T15:08:13.034 INFO:teuthology.orchestra.run.smithi161.stdout:1668 punch from 0xa78bf72 to 0xa7989ae, (0xca3c bytes) 2024-09-21T15:08:13.045 INFO:teuthology.orchestra.run.smithi161.stdout:1615 punch from 0xc51fa44 to 0xc522ddb, (0x3397 bytes) 2024-09-21T15:08:13.045 INFO:teuthology.orchestra.run.smithi161.stdout:1616 writesame 0x7d9baf9 thru 0x7d9be89 data_size 0x1(0x391 bytes) 2024-09-21T15:08:13.047 INFO:teuthology.orchestra.run.smithi161.stdout:1669 trunc from 0xe59a9b6 to 0x7660846 2024-09-21T15:08:13.048 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone16 from 0xe3cd0df (overlap 0x5cf573b) to 0x4a5df62 2024-09-21T15:08:13.059 INFO:teuthology.orchestra.run.smithi161.stdout:1617 punch from 0xdf43ccc to 0xdf43cf1, (0x25 bytes) 2024-09-21T15:08:13.060 INFO:teuthology.orchestra.run.smithi161.stdout:1618 punch from 0xd17a4e9 to 0xd1855ba, (0xb0d1 bytes) 2024-09-21T15:08:13.060 INFO:teuthology.orchestra.run.smithi161.stdout:1629 write 0xe8589d3 thru 0xe86865a (0xfc88 bytes) 2024-09-21T15:08:13.067 INFO:teuthology.orchestra.run.smithi161.stdout:1994 write 0x6b5563 thru 0x6c1ce4 (0xc782 bytes) 2024-09-21T15:08:13.067 INFO:teuthology.orchestra.run.smithi161.stdout:2218 write 0xcfa7d4d thru 0xcfa92de (0x1592 bytes) 2024-09-21T15:08:13.080 INFO:teuthology.orchestra.run.smithi161.stdout:1995 writesame 0x48c83bb thru 0x48cfdc4 data_size 0x6(0x7a0a bytes) 2024-09-21T15:08:13.089 INFO:teuthology.orchestra.run.smithi161.stdout:1630 write 0x4911120 thru 0x491fd76 (0xec57 bytes) 2024-09-21T15:08:13.103 INFO:teuthology.orchestra.run.smithi161.stdout:2220 trunc from 0xcfa92df to 0x712426d 2024-09-21T15:08:13.115 INFO:teuthology.orchestra.run.smithi161.stdout:1996 trunc from 0xde21ee0 to 0xdb07e8e 2024-09-21T15:08:13.119 INFO:teuthology.orchestra.run.smithi161.stdout:1619 write 0xea03238 thru 0xea07b3d (0x4906 bytes) 2024-09-21T15:08:13.120 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.120 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.120 INFO:teuthology.orchestra.run.smithi161.stdout:1634 write 0xcb09d11 thru 0xcb0caef (0x2ddf bytes) 2024-09-21T15:08:13.132 INFO:teuthology.orchestra.run.smithi161.stdout:1620 writesame 0xb22664b thru 0xb22c31d data_size 0x3(0x5cd3 bytes) 2024-09-21T15:08:13.135 INFO:teuthology.orchestra.run.smithi161.stdout:1670 read 0x2ffc03e thru 0x2ffccc6 (0xc89 bytes) 2024-09-21T15:08:13.135 INFO:teuthology.orchestra.run.smithi161.stdout:1671 write 0x400ec5a thru 0x4015bc9 (0x6f70 bytes) 2024-09-21T15:08:13.145 INFO:teuthology.orchestra.run.smithi161.stdout:1621 read 0xb3fe6a7 thru 0xb405f76 (0x78d0 bytes) 2024-09-21T15:08:13.145 INFO:teuthology.orchestra.run.smithi161.stdout:1622 write 0xc91e360 thru 0xc923109 (0x4daa bytes) 2024-09-21T15:08:13.146 INFO:teuthology.orchestra.run.smithi161.stdout:1636 writesame 0xb8ea669 thru 0xb8f7594 data_size 0x2(0xcf2c bytes) 2024-09-21T15:08:13.149 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.156 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.176 INFO:teuthology.orchestra.run.smithi161.stdout:1637 read 0x84a60a thru 0x84b216 (0xc0d bytes) 2024-09-21T15:08:13.177 INFO:teuthology.orchestra.run.smithi161.stdout:1639 write 0xd0a1ed7 thru 0xd0a3a3b (0x1b65 bytes) 2024-09-21T15:08:13.179 INFO:teuthology.orchestra.run.smithi161.stdout:1623 trunc from 0xea07b3e to 0x7e31d71 2024-09-21T15:08:13.181 INFO:teuthology.orchestra.run.smithi161.stdout:1998 writesame 0xde7da95 thru 0xde82949 data_size 0x1(0x4eb5 bytes) 2024-09-21T15:08:13.185 INFO:teuthology.orchestra.run.smithi161.stdout:1999 write 0x98c4e5b thru 0x98cac52 (0x5df8 bytes) 2024-09-21T15:08:13.217 INFO:teuthology.orchestra.run.smithi161.stdout:2221 write 0xc65a98f thru 0xc660901 (0x5f73 bytes) 2024-09-21T15:08:13.222 INFO:teuthology.orchestra.run.smithi161.stdout:1674 writesame 0xb08df1d thru 0xb08fc82 data_size 0x35(0x1d66 bytes) 2024-09-21T15:08:13.223 INFO:teuthology.orchestra.run.smithi161.stdout:1640 trunc from 0xe86865b to 0x7e2038e 2024-09-21T15:08:13.225 INFO:teuthology.orchestra.run.smithi161.stdout:2000 trunc from 0xde8294a to 0x50fdaf5 2024-09-21T15:08:13.226 INFO:teuthology.orchestra.run.smithi161.stdout:1675 punch from 0x7ad3767 to 0x7ae09ba, (0xd253 bytes) 2024-09-21T15:08:13.226 INFO:teuthology.orchestra.run.smithi161.stdout:1676 read 0x88e9254 thru 0x88e9ff7 (0xda4 bytes) 2024-09-21T15:08:13.226 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.227 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.240 INFO:teuthology.orchestra.run.smithi161.stdout:1624 read 0x138bb5 thru 0x13a333 (0x177f bytes) 2024-09-21T15:08:13.243 INFO:teuthology.orchestra.run.smithi161.stdout:1625 writesame 0x2684082 thru 0x2691f27 data_size 0x1(0xdea6 bytes) 2024-09-21T15:08:13.250 INFO:teuthology.orchestra.run.smithi161.stdout:2222 trunc from 0xc660902 to 0x1434ffa 2024-09-21T15:08:13.295 INFO:teuthology.orchestra.run.smithi161.stdout:1681 write 0xe98b7a3 thru 0xe98cf86 (0x17e4 bytes) 2024-09-21T15:08:13.296 INFO:teuthology.orchestra.run.smithi161.stdout:1627 writesame 0x114333c thru 0x114fe46 data_size 0x1(0xcb0b bytes) 2024-09-21T15:08:13.312 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.312 INFO:teuthology.orchestra.run.smithi161.stdout:1642 write 0x1b1d87c thru 0x1b281a1 (0xa926 bytes) 2024-09-21T15:08:13.319 INFO:teuthology.orchestra.run.smithi161.stdout:2001 writesame 0x308cc9 thru 0x30f234 data_size 0x2(0x656c bytes) 2024-09-21T15:08:13.336 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.337 INFO:teuthology.orchestra.run.smithi161.stdout:1629 read 0x2172a4d thru 0x217b3ec (0x89a0 bytes) 2024-09-21T15:08:13.337 INFO:teuthology.orchestra.run.smithi161.stdout:1683 write 0xc82c35a thru 0xc834762 (0x8409 bytes) 2024-09-21T15:08:13.349 INFO:teuthology.orchestra.run.smithi161.stdout:1643 read 0x54f5f1b thru 0x54ff46b (0x9551 bytes) 2024-09-21T15:08:13.350 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.354 INFO:teuthology.orchestra.run.smithi161.stdout:2004 read 0x6422c4 thru 0x64a681 (0x83be bytes) 2024-09-21T15:08:13.355 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.355 INFO:teuthology.orchestra.run.smithi161.stdout:2007 read 0x4353505 thru 0x4361377 (0xde73 bytes) 2024-09-21T15:08:13.365 INFO:teuthology.orchestra.run.smithi161.stdout:1648 trunc from 0x7e2038e to 0xe51663c 2024-09-21T15:08:13.366 INFO:teuthology.orchestra.run.smithi161.stdout:1684 read 0xaaf836b thru 0xab02165 (0x9dfb bytes) 2024-09-21T15:08:13.366 INFO:teuthology.orchestra.run.smithi161.stdout:2225 read 0xdd0c2a thru 0xdd7fc0 (0x7397 bytes) 2024-09-21T15:08:13.366 INFO:teuthology.orchestra.run.smithi161.stdout:1685 write 0x2b76e3f thru 0x2b82f82 (0xc144 bytes) 2024-09-21T15:08:13.367 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.369 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #15, image image_cluster1.client.mirror.3-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent16 2024-09-21T15:08:13.385 INFO:teuthology.orchestra.run.smithi161.stdout:1687 punch from 0x1bda1ef to 0x1be11c7, (0x6fd8 bytes) 2024-09-21T15:08:13.385 INFO:teuthology.orchestra.run.smithi161.stdout:1688 read 0x36434dc thru 0x364c8fd (0x9422 bytes) 2024-09-21T15:08:13.385 INFO:teuthology.orchestra.run.smithi161.stdout:1689 read 0x9b5a635 thru 0x9b6463e (0xa00a bytes) 2024-09-21T15:08:13.385 INFO:teuthology.orchestra.run.smithi161.stdout:1690 read 0xe8c5ac8 thru 0xe8ce4fe (0x8a37 bytes) 2024-09-21T15:08:13.386 INFO:teuthology.orchestra.run.smithi161.stdout:1691 write 0xcc7e695 thru 0xcc89662 (0xafce bytes) 2024-09-21T15:08:13.392 INFO:teuthology.orchestra.run.smithi161.stdout:1630 write 0x93887fd thru 0x938c552 (0x3d56 bytes) 2024-09-21T15:08:13.398 INFO:teuthology.orchestra.run.smithi161.stdout:1692 read 0x3d0a21f thru 0x3d15a96 (0xb878 bytes) 2024-09-21T15:08:13.399 INFO:teuthology.orchestra.run.smithi161.stdout:1693 write 0x688b450 thru 0x68900fb (0x4cac bytes) 2024-09-21T15:08:13.402 INFO:teuthology.orchestra.run.smithi161.stdout:1650 read 0x2fe4ca thru 0x3047e0 (0x6317 bytes) 2024-09-21T15:08:13.404 INFO:teuthology.orchestra.run.smithi161.stdout:1651 write 0xa3c6b96 thru 0xa3c9cf2 (0x315d bytes) 2024-09-21T15:08:13.404 INFO:teuthology.orchestra.run.smithi161.stdout:1631 write 0x7d908b3 thru 0x7d926af (0x1dfd bytes) 2024-09-21T15:08:13.415 INFO:teuthology.orchestra.run.smithi161.stdout:2008 writesame 0xbc75184 thru 0xbc7530f data_size 0x6(0x18c bytes) 2024-09-21T15:08:13.417 INFO:teuthology.orchestra.run.smithi161.stdout:1694 trunc from 0xe98cf87 to 0xd005a77 2024-09-21T15:08:13.427 INFO:teuthology.orchestra.run.smithi161.stdout:2009 punch from 0xb282b90 to 0xb28cd79, (0xa1e9 bytes) 2024-09-21T15:08:13.427 INFO:teuthology.orchestra.run.smithi161.stdout:2011 read 0xa783aee thru 0xa78dc56 (0xa169 bytes) 2024-09-21T15:08:13.427 INFO:teuthology.orchestra.run.smithi161.stdout:2012 write 0xb726e42 thru 0xb72a30a (0x34c9 bytes) 2024-09-21T15:08:13.429 INFO:teuthology.orchestra.run.smithi161.stdout:2227 write 0xeae5ec1 thru 0xeaea7ec (0x492c bytes) 2024-09-21T15:08:13.441 INFO:teuthology.orchestra.run.smithi161.stdout:1632 trunc from 0x938c553 to 0x1a78b93 2024-09-21T15:08:13.446 INFO:teuthology.orchestra.run.smithi161.stdout:2013 write 0x697e249 thru 0x69838d6 (0x568e bytes) 2024-09-21T15:08:13.447 INFO:teuthology.orchestra.run.smithi161.stdout:2229 read 0xb30c484 thru 0xb30c866 (0x3e3 bytes) 2024-09-21T15:08:13.447 INFO:teuthology.orchestra.run.smithi161.stdout:2230 write 0x11981ec thru 0x11a207a (0x9e8f bytes) 2024-09-21T15:08:13.450 INFO:teuthology.orchestra.run.smithi161.stdout:1652 writesame 0x6929c25 thru 0x6933a92 data_size 0x7(0x9e6e bytes) 2024-09-21T15:08:13.462 INFO:teuthology.orchestra.run.smithi161.stdout:2231 writesame 0xdf33523 thru 0xdf3a123 data_size 0x1(0x6c01 bytes) 2024-09-21T15:08:13.464 INFO:teuthology.orchestra.run.smithi161.stdout:2014 read 0x27b952e thru 0x27c46ce (0xb1a1 bytes) 2024-09-21T15:08:13.466 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.466 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.476 INFO:teuthology.orchestra.run.smithi161.stdout:1427 writesame 0x8e601ae thru 0x8e6b262 data_size 0x11(0xb0b5 bytes) 2024-09-21T15:08:13.482 INFO:teuthology.orchestra.run.smithi161.stdout:1653 trunc from 0xe51663c to 0xc2cd43d 2024-09-21T15:08:13.488 INFO:teuthology.orchestra.run.smithi161.stdout:2018 trunc from 0xbc75310 to 0x69216a 2024-09-21T15:08:13.492 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.492 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.492 INFO:teuthology.orchestra.run.smithi161.stdout:2235 read 0x2b72eda thru 0x2b816e6 (0xe80d bytes) 2024-09-21T15:08:13.493 INFO:teuthology.orchestra.run.smithi161.stdout:2238 punch from 0x4e971e0 to 0x4e9e2d4, (0x70f4 bytes) 2024-09-21T15:08:13.493 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.493 INFO:teuthology.orchestra.run.smithi161.stdout:2242 write 0x35c170d thru 0x35cb7a4 (0xa098 bytes) 2024-09-21T15:08:13.499 INFO:teuthology.orchestra.run.smithi161.stdout:1695 write 0xc0401d3 thru 0xc0488bf (0x86ed bytes) 2024-09-21T15:08:13.520 INFO:teuthology.orchestra.run.smithi161.stdout:1696 punch from 0x9ffcd01 to 0xa0004fc, (0x37fb bytes) 2024-09-21T15:08:13.521 INFO:teuthology.orchestra.run.smithi161.stdout:1633 punch from 0x123f1fd to 0x124b457, (0xc25a bytes) 2024-09-21T15:08:13.521 INFO:teuthology.orchestra.run.smithi161.stdout:1697 write 0xce226ba thru 0xce23470 (0xdb7 bytes) 2024-09-21T15:08:13.542 INFO:teuthology.orchestra.run.smithi161.stdout:1699 read 0xb9e1b17 thru 0xb9ea1af (0x8699 bytes) 2024-09-21T15:08:13.542 INFO:teuthology.orchestra.run.smithi161.stdout:1700 read 0x68d1b93 thru 0x68d39d7 (0x1e45 bytes) 2024-09-21T15:08:13.542 INFO:teuthology.orchestra.run.smithi161.stdout:1701 punch from 0x1a930d2 to 0x1aa2344, (0xf272 bytes) 2024-09-21T15:08:13.542 INFO:teuthology.orchestra.run.smithi161.stdout:1703 writesame 0x1832ff thru 0x1842a9 data_size 0x3(0xfab bytes) 2024-09-21T15:08:13.545 INFO:teuthology.orchestra.run.smithi161.stdout:2243 trunc from 0xeaea7ed to 0x2a9c175 2024-09-21T15:08:13.556 INFO:teuthology.orchestra.run.smithi161.stdout:1430 read 0x7c7770d thru 0x7c779ee (0x2e2 bytes) 2024-09-21T15:08:13.561 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.561 INFO:teuthology.orchestra.run.smithi161.stdout:1659 punch from 0xabea702 to 0xabf8fa5, (0xe8a3 bytes) 2024-09-21T15:08:13.562 INFO:teuthology.orchestra.run.smithi161.stdout:1660 write 0x2957ea6 thru 0x2962a1a (0xab75 bytes) 2024-09-21T15:08:13.572 INFO:teuthology.orchestra.run.smithi161.stdout:1431 trunc from 0xe3cd0df to 0x469acd8 2024-09-21T15:08:13.597 INFO:teuthology.orchestra.run.smithi161.stdout:1704 trunc from 0xd005a77 to 0x20d3a47 2024-09-21T15:08:13.598 INFO:teuthology.orchestra.run.smithi161.stdout:1634 writesame 0x5527ad2 thru 0x552a0dd data_size 0xa(0x260c bytes) 2024-09-21T15:08:13.607 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.607 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.613 INFO:teuthology.orchestra.run.smithi161.stdout:1662 trunc from 0xc2cd43d to 0x9654e0b 2024-09-21T15:08:13.615 INFO:teuthology.orchestra.run.smithi161.stdout:1640 trunc from 0x552a0de to 0x9d5170e 2024-09-21T15:08:13.664 INFO:teuthology.orchestra.run.smithi161.stdout:2244 write 0x189a896 thru 0x189d756 (0x2ec1 bytes) 2024-09-21T15:08:13.672 INFO:teuthology.orchestra.run.smithi161.stdout:2019 read 0x3b3ef thru 0x40674 (0x5286 bytes) 2024-09-21T15:08:13.674 INFO:teuthology.orchestra.run.smithi161.stdout:1705 read 0x1ab841d thru 0x1abe581 (0x6165 bytes) 2024-09-21T15:08:13.674 INFO:teuthology.orchestra.run.smithi161.stdout:1706 read 0x1efcc05 thru 0x1f059c1 (0x8dbd bytes) 2024-09-21T15:08:13.675 INFO:teuthology.orchestra.run.smithi161.stdout:2020 punch from 0x590171 to 0x5922bb, (0x214a bytes) 2024-09-21T15:08:13.675 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.675 INFO:teuthology.orchestra.run.smithi161.stdout:2022 read 0x3bccef thru 0x3c8af0 (0xbe02 bytes) 2024-09-21T15:08:13.677 INFO:teuthology.orchestra.run.smithi161.stdout:1707 trunc from 0x20d3a47 to 0xcc7791 2024-09-21T15:08:13.688 INFO:teuthology.orchestra.run.smithi161.stdout:1664 read 0x16c5798 thru 0x16cfe6c (0xa6d5 bytes) 2024-09-21T15:08:13.689 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.689 INFO:teuthology.orchestra.run.smithi161.stdout:1666 write 0x6feaf0d thru 0x6ff5549 (0xa63d bytes) 2024-09-21T15:08:13.698 INFO:teuthology.orchestra.run.smithi161.stdout:1433 trunc from 0x469acd8 to 0x623beb5 2024-09-21T15:08:13.698 INFO:teuthology.orchestra.run.smithi161.stdout:2245 trunc from 0x2a9c175 to 0xcffd700 2024-09-21T15:08:13.707 INFO:teuthology.orchestra.run.smithi161.stdout:1641 write 0xd9e271a thru 0xd9ece9d (0xa784 bytes) 2024-09-21T15:08:13.724 INFO:teuthology.orchestra.run.smithi161.stdout:2023 write 0x5bb1067 thru 0x5bb6c8f (0x5c29 bytes) 2024-09-21T15:08:13.737 INFO:teuthology.orchestra.run.smithi161.stdout:1435 punch from 0x59881db to 0x5997bbd, (0xf9e2 bytes) 2024-09-21T15:08:13.737 INFO:teuthology.orchestra.run.smithi161.stdout:1437 write 0x1e53288 thru 0x1e62205 (0xef7e bytes) 2024-09-21T15:08:13.742 INFO:teuthology.orchestra.run.smithi161.stdout:1643 write 0x9c0ceee thru 0x9c11907 (0x4a1a bytes) 2024-09-21T15:08:13.747 INFO:teuthology.orchestra.run.smithi161.stdout:1708 read 0xb6a556 thru 0xb6e895 (0x4340 bytes) 2024-09-21T15:08:13.747 INFO:teuthology.orchestra.run.smithi161.stdout:1709 read 0x8f082f thru 0x8fb40c (0xabde bytes) 2024-09-21T15:08:13.759 INFO:teuthology.orchestra.run.smithi161.stdout:2025 read 0x4b6d75f thru 0x4b74443 (0x6ce5 bytes) 2024-09-21T15:08:13.760 INFO:teuthology.orchestra.run.smithi161.stdout:2246 writesame 0x451141e thru 0x451e09d data_size 0x20(0xcc80 bytes) 2024-09-21T15:08:13.767 INFO:teuthology.orchestra.run.smithi161.stdout:1645 read 0x61959f thru 0x619be8 (0x64a bytes) 2024-09-21T15:08:13.772 INFO:teuthology.orchestra.run.smithi161.stdout:1646 trunc from 0xd9ece9e to 0xc023172 2024-09-21T15:08:13.772 INFO:teuthology.orchestra.run.smithi161.stdout:2247 read 0x5c3d2be thru 0x5c4991e (0xc661 bytes) 2024-09-21T15:08:13.773 INFO:teuthology.orchestra.run.smithi161.stdout:2248 punch from 0x9563ed0 to 0x9565e60, (0x1f90 bytes) 2024-09-21T15:08:13.773 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.774 INFO:teuthology.orchestra.run.smithi161.stdout:2252 read 0x9766d10 thru 0x976cfc3 (0x62b4 bytes) 2024-09-21T15:08:13.774 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.774 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.780 INFO:teuthology.orchestra.run.smithi161.stdout:2255 trunc from 0xcffd700 to 0x9d9856e 2024-09-21T15:08:13.786 INFO:teuthology.orchestra.run.smithi161.stdout:1439 read 0x3eea3dd thru 0x3ef1a18 (0x763c bytes) 2024-09-21T15:08:13.790 INFO:teuthology.orchestra.run.smithi161.stdout:1710 write 0x2e8f965 thru 0x2e9a750 (0xadec bytes) 2024-09-21T15:08:13.791 INFO:teuthology.orchestra.run.smithi161.stdout:1668 writesame 0xd19a012 thru 0xd1a2585 data_size 0x75(0x8574 bytes) 2024-09-21T15:08:13.796 INFO:teuthology.orchestra.run.smithi161.stdout:1669 read 0x9fab53e thru 0x9fb4656 (0x9119 bytes) 2024-09-21T15:08:13.796 INFO:teuthology.orchestra.run.smithi161.stdout:1670 read 0xa8e459d thru 0xa8e64ef (0x1f53 bytes) 2024-09-21T15:08:13.796 INFO:teuthology.orchestra.run.smithi161.stdout:1671 writesame 0x7b84520 thru 0x7b8ef8e data_size 0x17(0xaa6f bytes) 2024-09-21T15:08:13.813 INFO:teuthology.orchestra.run.smithi161.stdout:2026 write 0xe8b85c5 thru 0xe8c0999 (0x83d5 bytes) 2024-09-21T15:08:13.820 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.820 INFO:teuthology.orchestra.run.smithi161.stdout:1673 writesame 0x424f044 thru 0x4250a6f data_size 0x14(0x1a2c bytes) 2024-09-21T15:08:13.821 INFO:teuthology.orchestra.run.smithi161.stdout:2256 punch from 0x58ffe6c to 0x5903762, (0x38f6 bytes) 2024-09-21T15:08:13.825 INFO:teuthology.orchestra.run.smithi161.stdout:1647 write 0xba9a7ff thru 0xbaa89ab (0xe1ad bytes) 2024-09-21T15:08:13.829 INFO:teuthology.orchestra.run.smithi161.stdout:2027 punch from 0xd83ce69 to 0xd84985b, (0xc9f2 bytes) 2024-09-21T15:08:13.829 INFO:teuthology.orchestra.run.smithi161.stdout:2028 read 0xbeb6414 thru 0xbeb7d46 (0x1933 bytes) 2024-09-21T15:08:13.830 INFO:teuthology.orchestra.run.smithi161.stdout:2029 read 0x2a857b9 thru 0x2a90cd1 (0xb519 bytes) 2024-09-21T15:08:13.831 INFO:teuthology.orchestra.run.smithi161.stdout:2031 write 0xe3f3cf5 thru 0xe3f4d9b (0x10a7 bytes) 2024-09-21T15:08:13.836 INFO:teuthology.orchestra.run.smithi161.stdout:1440 write 0x91c861c thru 0x91cdf99 (0x597e bytes) 2024-09-21T15:08:13.847 INFO:teuthology.orchestra.run.smithi161.stdout:1648 punch from 0x18d52a3 to 0x18e192e, (0xc68b bytes) 2024-09-21T15:08:13.848 INFO:teuthology.orchestra.run.smithi161.stdout:2032 write 0x81db53b thru 0x81ded41 (0x3807 bytes) 2024-09-21T15:08:13.856 INFO:teuthology.orchestra.run.smithi161.stdout:1441 write 0x3bc76bb thru 0x3bce655 (0x6f9b bytes) 2024-09-21T15:08:13.858 INFO:teuthology.orchestra.run.smithi161.stdout:1674 trunc from 0xd1a2586 to 0x2046b1b 2024-09-21T15:08:13.866 INFO:teuthology.orchestra.run.smithi161.stdout:2035 trunc from 0xe8c099a to 0xe257e3c 2024-09-21T15:08:13.873 INFO:teuthology.orchestra.run.smithi161.stdout:2258 writesame 0xbb3b057 thru 0xbb480f3 data_size 0xb(0xd09d bytes) 2024-09-21T15:08:13.876 INFO:teuthology.orchestra.run.smithi161.stdout:1442 read 0x1224778 thru 0x12339fb (0xf284 bytes) 2024-09-21T15:08:13.877 INFO:teuthology.orchestra.run.smithi161.stdout:1711 write 0x8b3c387 thru 0x8b3daae (0x1728 bytes) 2024-09-21T15:08:13.879 INFO:teuthology.orchestra.run.smithi161.stdout:1443 write 0x251509a thru 0x2520230 (0xb197 bytes) 2024-09-21T15:08:13.906 INFO:teuthology.orchestra.run.smithi161.stdout:1713 read 0x8656ebf thru 0x865c44e (0x5590 bytes) 2024-09-21T15:08:13.906 INFO:teuthology.orchestra.run.smithi161.stdout:1714 read 0x88a67b7 thru 0x88b538c (0xebd6 bytes) 2024-09-21T15:08:13.907 INFO:teuthology.orchestra.run.smithi161.stdout:1649 write 0xec4e9d2 thru 0xec511e3 (0x2812 bytes) 2024-09-21T15:08:13.913 INFO:teuthology.orchestra.run.smithi161.stdout:1446 clone 18 order 21 su 524288 sc 4 2024-09-21T15:08:13.922 INFO:teuthology.orchestra.run.smithi161.stdout:2259 write 0xd79d6ac thru 0xd79f4a3 (0x1df8 bytes) 2024-09-21T15:08:13.923 INFO:teuthology.orchestra.run.smithi161.stdout:2036 write 0x156acec thru 0x1579cb9 (0xefce bytes) 2024-09-21T15:08:13.927 INFO:teuthology.orchestra.run.smithi161.stdout:1651 trunc from 0xec511e4 to 0xb5d6275 2024-09-21T15:08:13.938 INFO:teuthology.orchestra.run.smithi161.stdout:2038 write 0xc9855e7 thru 0xc987022 (0x1a3c bytes) 2024-09-21T15:08:13.941 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.941 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.951 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.951 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:13.952 INFO:teuthology.orchestra.run.smithi161.stdout:2041 writesame 0xb875c3b thru 0xb87dfae data_size 0x2f(0x8374 bytes) 2024-09-21T15:08:13.960 INFO:teuthology.orchestra.run.smithi161.stdout:1715 writesame 0xbcab40d thru 0xbcad63b data_size 0x1(0x222f bytes) 2024-09-21T15:08:13.964 INFO:teuthology.orchestra.run.smithi161.stdout:2042 clone 11 order 24 su 8388608 sc 9 2024-09-21T15:08:13.967 INFO:teuthology.orchestra.run.smithi161.stdout:1716 writesame 0x6ad1426 thru 0x6add8cb data_size 0x1(0xc4a6 bytes) 2024-09-21T15:08:13.967 INFO:teuthology.orchestra.run.smithi161.stdout:2262 trunc from 0xd79f4a4 to 0x105c91 2024-09-21T15:08:13.970 INFO:teuthology.orchestra.run.smithi161.stdout:1652 read 0x4077042 thru 0x407dc4c (0x6c0b bytes) 2024-09-21T15:08:13.972 INFO:teuthology.orchestra.run.smithi161.stdout:1654 write 0x843f7f2 thru 0x843f900 (0x10f bytes) 2024-09-21T15:08:13.989 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.005 INFO:teuthology.orchestra.run.smithi161.stdout:1675 write 0xca95579 thru 0xca99df1 (0x4879 bytes) 2024-09-21T15:08:14.006 INFO:teuthology.orchestra.run.smithi161.stdout:1717 trunc from 0xbcad63c to 0xaf6458a 2024-09-21T15:08:14.033 INFO:teuthology.orchestra.run.smithi161.stdout:1676 read 0x462a61a thru 0x4634076 (0x9a5d bytes) 2024-09-21T15:08:14.033 INFO:teuthology.orchestra.run.smithi161.stdout:1679 writesame 0x2b852a6 thru 0x2b855d1 data_size 0x7(0x32c bytes) 2024-09-21T15:08:14.037 INFO:teuthology.orchestra.run.smithi161.stdout:1658 write 0xb5f36de thru 0xb5f91d1 (0x5af4 bytes) 2024-09-21T15:08:14.046 INFO:teuthology.orchestra.run.smithi161.stdout:1659 read 0x14363be thru 0x1446101 (0xfd44 bytes) 2024-09-21T15:08:14.047 INFO:teuthology.orchestra.run.smithi161.stdout:1660 writesame 0x3c648 thru 0x439df data_size 0x36(0x7398 bytes) 2024-09-21T15:08:14.048 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.049 INFO:teuthology.orchestra.run.smithi161.stdout:1683 write 0x84757e2 thru 0x847edd3 (0x95f2 bytes) 2024-09-21T15:08:14.051 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.051 INFO:teuthology.orchestra.run.smithi161.stdout:1719 punch from 0x37129e2 to 0x371e6a3, (0xbcc1 bytes) 2024-09-21T15:08:14.051 INFO:teuthology.orchestra.run.smithi161.stdout:1720 writesame 0x8319da9 thru 0x831f0df data_size 0x1b(0x5337 bytes) 2024-09-21T15:08:14.057 INFO:teuthology.orchestra.run.smithi161.stdout:1661 read 0x758116d thru 0x7586176 (0x500a bytes) 2024-09-21T15:08:14.060 INFO:teuthology.orchestra.run.smithi161.stdout:1663 write 0x1d1299d thru 0x1d159ae (0x3012 bytes) 2024-09-21T15:08:14.069 INFO:teuthology.orchestra.run.smithi161.stdout:1721 writesame 0x8c98fbf thru 0x8c9bf70 data_size 0x4a(0x2fb2 bytes) 2024-09-21T15:08:14.071 INFO:teuthology.orchestra.run.smithi161.stdout:1664 punch from 0x19a1aa to 0x19ad0c, (0xb62 bytes) 2024-09-21T15:08:14.071 INFO:teuthology.orchestra.run.smithi161.stdout:1665 read 0x56c1517 thru 0x56c809f (0x6b89 bytes) 2024-09-21T15:08:14.071 INFO:teuthology.orchestra.run.smithi161.stdout:1666 read 0x52f488f thru 0x52fdb59 (0x92cb bytes) 2024-09-21T15:08:14.073 INFO:teuthology.orchestra.run.smithi161.stdout:1667 writesame 0x81f93ed thru 0x81fbcfa data_size 0x5(0x290e bytes) 2024-09-21T15:08:14.075 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.076 INFO:teuthology.orchestra.run.smithi161.stdout:1686 read 0x71641a5 thru 0x7171f6f (0xddcb bytes) 2024-09-21T15:08:14.094 INFO:teuthology.orchestra.run.smithi161.stdout:2263 write 0x6fb290b thru 0x6fb3bb0 (0x12a6 bytes) 2024-09-21T15:08:14.108 INFO:teuthology.orchestra.run.smithi161.stdout:1669 trunc from 0xb5f91d2 to 0x13e3b42 2024-09-21T15:08:14.113 INFO:teuthology.orchestra.run.smithi161.stdout:1687 writesame 0xe40a44c thru 0xe412349 data_size 0x5(0x7efe bytes) 2024-09-21T15:08:14.117 INFO:teuthology.orchestra.run.smithi161.stdout:1722 write 0xb7bd882 thru 0xb7c3292 (0x5a11 bytes) 2024-09-21T15:08:14.118 INFO:teuthology.orchestra.run.smithi161.stdout:1689 writesame 0x82ecdec thru 0x82f191e data_size 0x45(0x4b33 bytes) 2024-09-21T15:08:14.147 INFO:teuthology.orchestra.run.smithi161.stdout:1690 write 0x2ba2500 thru 0x2bb0565 (0xe066 bytes) 2024-09-21T15:08:14.148 INFO:teuthology.orchestra.run.smithi161.stdout:1723 trunc from 0xb7c3293 to 0x86898b8 2024-09-21T15:08:14.161 INFO:teuthology.orchestra.run.smithi161.stdout:2265 writesame 0xa2e6430 thru 0xa2f5470 data_size 0x1(0xf041 bytes) 2024-09-21T15:08:14.167 INFO:teuthology.orchestra.run.smithi161.stdout:2266 write 0x2c8dfd7 thru 0x2c96b16 (0x8b40 bytes) 2024-09-21T15:08:14.179 INFO:teuthology.orchestra.run.smithi161.stdout:1691 read 0xaf9d881 thru 0xafa20ac (0x482c bytes) 2024-09-21T15:08:14.179 INFO:teuthology.orchestra.run.smithi161.stdout:1692 punch from 0x4656fee to 0x465913f, (0x2151 bytes) 2024-09-21T15:08:14.179 INFO:teuthology.orchestra.run.smithi161.stdout:1694 write 0x7cf011f thru 0x7cf04f2 (0x3d4 bytes) 2024-09-21T15:08:14.186 INFO:teuthology.orchestra.run.smithi161.stdout:2268 write 0x40efc0a thru 0x40feb51 (0xef48 bytes) 2024-09-21T15:08:14.197 INFO:teuthology.orchestra.run.smithi161.stdout:1696 writesame 0x7ea7a65 thru 0x7eb68e4 data_size 0x9(0xee80 bytes) 2024-09-21T15:08:14.212 INFO:teuthology.orchestra.run.smithi161.stdout:2269 trunc from 0xa2f5471 to 0xdfcfe3c 2024-09-21T15:08:14.223 INFO:teuthology.orchestra.run.smithi161.stdout:1697 read 0xac254e5 thru 0xac2ec24 (0x9740 bytes) 2024-09-21T15:08:14.225 INFO:teuthology.orchestra.run.smithi161.stdout:1724 read 0xa74fca thru 0xa7a315 (0x534c bytes) 2024-09-21T15:08:14.225 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.229 INFO:teuthology.orchestra.run.smithi161.stdout:1670 write 0xae94b89 thru 0xae98772 (0x3bea bytes) 2024-09-21T15:08:14.240 INFO:teuthology.orchestra.run.smithi161.stdout:1726 trunc from 0x86898b8 to 0x23ad0ce 2024-09-21T15:08:14.243 INFO:teuthology.orchestra.run.smithi161.stdout:1671 write 0x283b70c thru 0x284ada3 (0xf698 bytes) 2024-09-21T15:08:14.244 INFO:teuthology.orchestra.run.smithi161.stdout:2270 write 0x5c4fb06 thru 0x5c54d4c (0x5247 bytes) 2024-09-21T15:08:14.259 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.259 INFO:teuthology.orchestra.run.smithi161.stdout:1674 write 0x5681b3e thru 0x56822e0 (0x7a3 bytes) 2024-09-21T15:08:14.261 INFO:teuthology.orchestra.run.smithi161.stdout:1699 write 0xe8010cf thru 0xe80a686 (0x95b8 bytes) 2024-09-21T15:08:14.267 INFO:teuthology.orchestra.run.smithi161.stdout:1675 write 0x120e39f thru 0x1213eca (0x5b2c bytes) 2024-09-21T15:08:14.278 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.278 INFO:teuthology.orchestra.run.smithi161.stdout:1677 write 0x2dede9e thru 0x2dee472 (0x5d5 bytes) 2024-09-21T15:08:14.286 INFO:teuthology.orchestra.run.smithi161.stdout:1700 writesame 0x35689df thru 0x356d7aa data_size 0x1a(0x4dcc bytes) 2024-09-21T15:08:14.287 INFO:teuthology.orchestra.run.smithi161.stdout:2271 trunc from 0xdfcfe3c to 0x3461ed1 2024-09-21T15:08:14.291 INFO:teuthology.orchestra.run.smithi161.stdout:1728 writesame 0x3393dd thru 0x34128a data_size 0x45(0x7eae bytes) 2024-09-21T15:08:14.305 INFO:teuthology.orchestra.run.smithi161.stdout:1678 trunc from 0xae98773 to 0x16917c9 2024-09-21T15:08:14.307 INFO:teuthology.orchestra.run.smithi161.stdout:1701 write 0x4207898 thru 0x420dfe4 (0x674d bytes) 2024-09-21T15:08:14.335 INFO:teuthology.orchestra.run.smithi161.stdout:1703 read 0x94926b1 thru 0x949323b (0xb8b bytes) 2024-09-21T15:08:14.335 INFO:teuthology.orchestra.run.smithi161.stdout:1704 punch from 0xcf39a86 to 0xcf3f750, (0x5cca bytes) 2024-09-21T15:08:14.335 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.336 INFO:teuthology.orchestra.run.smithi161.stdout:1707 read 0x646b2ee thru 0x6472c7e (0x7991 bytes) 2024-09-21T15:08:14.336 INFO:teuthology.orchestra.run.smithi161.stdout:1709 writesame 0xa15d2b1 thru 0xa16012d data_size 0x1(0x2e7d bytes) 2024-09-21T15:08:14.360 INFO:teuthology.orchestra.run.smithi161.stdout:1710 read 0x3e0e07b thru 0x3e1a616 (0xc59c bytes) 2024-09-21T15:08:14.360 INFO:teuthology.orchestra.run.smithi161.stdout:1712 read 0x703a3db thru 0x703ffd9 (0x5bff bytes) 2024-09-21T15:08:14.361 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.371 INFO:teuthology.orchestra.run.smithi161.stdout:1715 trunc from 0xe80a687 to 0xc52d687 2024-09-21T15:08:14.379 INFO:teuthology.orchestra.run.smithi161.stdout:1729 write 0x2706759 thru 0x270e0cb (0x7973 bytes) 2024-09-21T15:08:14.396 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.405 INFO:teuthology.orchestra.run.smithi161.stdout:1679 write 0x64203e8 thru 0x64212a2 (0xebb bytes) 2024-09-21T15:08:14.410 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.412 INFO:teuthology.orchestra.run.smithi161.stdout:2272 writesame 0xee5fe4c thru 0xee6b27f data_size 0x26(0xb434 bytes) 2024-09-21T15:08:14.414 INFO:teuthology.orchestra.run.smithi161.stdout:2273 write 0x34438dc thru 0x3449d7c (0x64a1 bytes) 2024-09-21T15:08:14.420 INFO:teuthology.orchestra.run.smithi161.stdout:1716 write 0x778b20d thru 0x77981d4 (0xcfc8 bytes) 2024-09-21T15:08:14.425 INFO:teuthology.orchestra.run.smithi161.stdout:1681 trunc from 0x64212a3 to 0xdc7889c 2024-09-21T15:08:14.429 INFO:teuthology.orchestra.run.smithi161.stdout:2275 writesame 0x5f6c5f7 thru 0x5f7b9b8 data_size 0x29(0xf3c2 bytes) 2024-09-21T15:08:14.446 INFO:teuthology.orchestra.run.smithi161.stdout:1717 read 0xb108bfd thru 0xb1099ef (0xdf3 bytes) 2024-09-21T15:08:14.446 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.446 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.447 INFO:teuthology.orchestra.run.smithi161.stdout:2279 writesame 0x3a44d0c thru 0x3a4f77a data_size 0x17(0xaa6f bytes) 2024-09-21T15:08:14.447 INFO:teuthology.orchestra.run.smithi161.stdout:1718 punch from 0x586970 to 0x58fb11, (0x91a1 bytes) 2024-09-21T15:08:14.447 INFO:teuthology.orchestra.run.smithi161.stdout:1719 read 0x7061033 thru 0x7063d4c (0x2d1a bytes) 2024-09-21T15:08:14.447 INFO:teuthology.orchestra.run.smithi161.stdout:1720 punch from 0x1a325b8 to 0x1a32c19, (0x661 bytes) 2024-09-21T15:08:14.447 INFO:teuthology.orchestra.run.smithi161.stdout:1723 read 0xf73e40 thru 0xf7cdf2 (0x8fb3 bytes) 2024-09-21T15:08:14.450 INFO:teuthology.orchestra.run.smithi161.stdout:1726 punch from 0x8ad95ef to 0x8adf764, (0x6175 bytes) 2024-09-21T15:08:14.450 INFO:teuthology.orchestra.run.smithi161.stdout:1728 read 0x6d1c753 thru 0x6d20950 (0x41fe bytes) 2024-09-21T15:08:14.450 INFO:teuthology.orchestra.run.smithi161.stdout:1730 trunc from 0xc52d687 to 0xc721a2b 2024-09-21T15:08:14.460 INFO:teuthology.orchestra.run.smithi161.stdout:2280 punch from 0xbfac9b3 to 0xbfade6b, (0x14b8 bytes) 2024-09-21T15:08:14.460 INFO:teuthology.orchestra.run.smithi161.stdout:2282 write 0x2585b19 thru 0x258688e (0xd76 bytes) 2024-09-21T15:08:14.464 INFO:teuthology.orchestra.run.smithi161.stdout:1682 write 0x78cea4f thru 0x78cf791 (0xd43 bytes) 2024-09-21T15:08:14.466 INFO:teuthology.orchestra.run.smithi161.stdout:2284 read 0x62dc897 thru 0x62dcb96 (0x300 bytes) 2024-09-21T15:08:14.466 INFO:teuthology.orchestra.run.smithi161.stdout:2286 write 0xeb2cbbe thru 0xeb32fcd (0x6410 bytes) 2024-09-21T15:08:14.471 INFO:teuthology.orchestra.run.smithi161.stdout:1683 write 0xb2be6ef thru 0xb2c3b77 (0x5489 bytes) 2024-09-21T15:08:14.479 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.479 INFO:teuthology.orchestra.run.smithi161.stdout:2289 read 0xe003fcc thru 0xe01311e (0xf153 bytes) 2024-09-21T15:08:14.479 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.480 INFO:teuthology.orchestra.run.smithi161.stdout:2292 writesame 0x7df379d thru 0x7dff2d5 data_size 0x1(0xbb39 bytes) 2024-09-21T15:08:14.480 INFO:teuthology.orchestra.run.smithi161.stdout:1731 write 0x8a1435f thru 0x8a22d4c (0xe9ee bytes) 2024-09-21T15:08:14.490 INFO:teuthology.orchestra.run.smithi161.stdout:1684 trunc from 0xdc7889c to 0xec273df 2024-09-21T15:08:14.507 INFO:teuthology.orchestra.run.smithi161.stdout:1732 read 0x9f6bf5 thru 0x9fbd58 (0x5164 bytes) 2024-09-21T15:08:14.525 INFO:teuthology.orchestra.run.smithi161.stdout:2293 read 0xc0b2eb2 thru 0xc0beba7 (0xbcf6 bytes) 2024-09-21T15:08:14.526 INFO:teuthology.orchestra.run.smithi161.stdout:2294 read 0x83dafb7 thru 0x83e14df (0x6529 bytes) 2024-09-21T15:08:14.526 INFO:teuthology.orchestra.run.smithi161.stdout:2296 punch from 0xed1d681 to 0xed287cf, (0xb14e bytes) 2024-09-21T15:08:14.526 INFO:teuthology.orchestra.run.smithi161.stdout:2297 read 0xb17343b thru 0xb17977d (0x6343 bytes) 2024-09-21T15:08:14.526 INFO:teuthology.orchestra.run.smithi161.stdout:2298 writesame 0x9a41dc4 thru 0x9a4b817 data_size 0x7(0x9a54 bytes) 2024-09-21T15:08:14.529 INFO:teuthology.orchestra.run.smithi161.stdout:1685 punch from 0x94bf646 to 0x94caf9e, (0xb958 bytes) 2024-09-21T15:08:14.529 INFO:teuthology.orchestra.run.smithi161.stdout:1686 read 0x65d034c thru 0x65da7e7 (0xa49c bytes) 2024-09-21T15:08:14.530 INFO:teuthology.orchestra.run.smithi161.stdout:1687 punch from 0x5cc8255 to 0x5cd10bf, (0x8e6a bytes) 2024-09-21T15:08:14.530 INFO:teuthology.orchestra.run.smithi161.stdout:1688 read 0x19a00b5 thru 0x19ac828 (0xc774 bytes) 2024-09-21T15:08:14.531 INFO:teuthology.orchestra.run.smithi161.stdout:1689 read 0xe79d393 thru 0xe79ebfa (0x1868 bytes) 2024-09-21T15:08:14.531 INFO:teuthology.orchestra.run.smithi161.stdout:1690 read 0x5cb1622 thru 0x5cb7d7e (0x675d bytes) 2024-09-21T15:08:14.532 INFO:teuthology.orchestra.run.smithi161.stdout:1692 read 0xbdaa1 thru 0xcab99 (0xd0f9 bytes) 2024-09-21T15:08:14.535 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.535 INFO:teuthology.orchestra.run.smithi161.stdout:1694 read 0xae9db20 thru 0xaea2e9a (0x537b bytes) 2024-09-21T15:08:14.536 INFO:teuthology.orchestra.run.smithi161.stdout:1696 read 0x4d562c6 thru 0x4d61628 (0xb363 bytes) 2024-09-21T15:08:14.538 INFO:teuthology.orchestra.run.smithi161.stdout:1698 write 0xa1e027e thru 0xa1e2c85 (0x2a08 bytes) 2024-09-21T15:08:14.541 INFO:teuthology.orchestra.run.smithi161.stdout:2299 writesame 0xc13ddc9 thru 0xc13fd46 data_size 0x2(0x1f7e bytes) 2024-09-21T15:08:14.548 INFO:teuthology.orchestra.run.smithi161.stdout:1699 writesame 0x34a3efc thru 0x34a8910 data_size 0x5(0x4a15 bytes) 2024-09-21T15:08:14.550 INFO:teuthology.orchestra.run.smithi161.stdout:1733 write 0xdb018fa thru 0xdb11252 (0xf959 bytes) 2024-09-21T15:08:14.550 INFO:teuthology.orchestra.run.smithi161.stdout:2300 read 0xe0eacef thru 0xe0eff7c (0x528e bytes) 2024-09-21T15:08:14.550 INFO:teuthology.orchestra.run.smithi161.stdout:2301 read 0x6bc69f0 thru 0x6bcaf3e (0x454f bytes) 2024-09-21T15:08:14.550 INFO:teuthology.orchestra.run.smithi161.stdout:2302 write 0x201a075 thru 0x201f15e (0x50ea bytes) 2024-09-21T15:08:14.560 INFO:teuthology.orchestra.run.smithi161.stdout:2304 read 0x1b2777e thru 0x1b2d041 (0x58c4 bytes) 2024-09-21T15:08:14.561 INFO:teuthology.orchestra.run.smithi161.stdout:2307 read 0x207971e thru 0x207cdce (0x36b1 bytes) 2024-09-21T15:08:14.561 INFO:teuthology.orchestra.run.smithi161.stdout:2308 writesame 0xbfa1059 thru 0xbfad144 data_size 0x2(0xc0ec bytes) 2024-09-21T15:08:14.572 INFO:teuthology.orchestra.run.smithi161.stdout:1700 trunc from 0xec273df to 0x884984a 2024-09-21T15:08:14.575 INFO:teuthology.orchestra.run.smithi161.stdout:1734 write 0x297d5a4 thru 0x297fed1 (0x292e bytes) 2024-09-21T15:08:14.594 INFO:teuthology.orchestra.run.smithi161.stdout:2309 read 0xa209642 thru 0xa216e3a (0xd7f9 bytes) 2024-09-21T15:08:14.594 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.594 INFO:teuthology.orchestra.run.smithi161.stdout:2311 writesame 0x778a9d5 thru 0x778ffd4 data_size 0x40(0x5600 bytes) 2024-09-21T15:08:14.602 INFO:teuthology.orchestra.run.smithi161.stdout:1735 write 0xa18ca2b thru 0xa19b975 (0xef4b bytes) 2024-09-21T15:08:14.608 INFO:teuthology.orchestra.run.smithi161.stdout:2312 read 0x5b2eea3 thru 0x5b333d7 (0x4535 bytes) 2024-09-21T15:08:14.609 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.618 INFO:teuthology.orchestra.run.smithi161.stdout:1736 read 0x904029d thru 0x9044a03 (0x4767 bytes) 2024-09-21T15:08:14.619 INFO:teuthology.orchestra.run.smithi161.stdout:1737 read 0x267dc50 thru 0x268c777 (0xeb28 bytes) 2024-09-21T15:08:14.619 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.619 INFO:teuthology.orchestra.run.smithi161.stdout:1741 write 0x460ee92 thru 0x461d814 (0xe983 bytes) 2024-09-21T15:08:14.624 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.624 INFO:teuthology.orchestra.run.smithi161.stdout:1702 punch from 0x3202181 to 0x320fa30, (0xd8af bytes) 2024-09-21T15:08:14.624 INFO:teuthology.orchestra.run.smithi161.stdout:1703 read 0x5365ed thru 0x545894 (0xf2a8 bytes) 2024-09-21T15:08:14.630 INFO:teuthology.orchestra.run.smithi161.stdout:2316 trunc from 0xee6b280 to 0x57a688a 2024-09-21T15:08:14.643 INFO:teuthology.orchestra.run.smithi161.stdout:1733 write 0x3aee8b8 thru 0x3af30a7 (0x47f0 bytes) 2024-09-21T15:08:14.653 INFO:teuthology.orchestra.run.smithi161.stdout:1743 write 0xac00af4 thru 0xac0937b (0x8888 bytes) 2024-09-21T15:08:14.671 INFO:teuthology.orchestra.run.smithi161.stdout:1704 writesame 0xb767912 thru 0xb77200a data_size 0x5(0xa6f9 bytes) 2024-09-21T15:08:14.679 INFO:teuthology.orchestra.run.smithi161.stdout:1705 writesame 0x6a04e65 thru 0x6a067fd data_size 0x1(0x1999 bytes) 2024-09-21T15:08:14.688 INFO:teuthology.orchestra.run.smithi161.stdout:1744 read 0xb7fabf thru 0xb86419 (0x695b bytes) 2024-09-21T15:08:14.688 INFO:teuthology.orchestra.run.smithi161.stdout:1745 writesame 0x2b03042 thru 0x2b0701c data_size 0x1(0x3fdb bytes) 2024-09-21T15:08:14.700 INFO:teuthology.orchestra.run.smithi161.stdout:1706 read 0x803d764 thru 0x80459b4 (0x8251 bytes) 2024-09-21T15:08:14.714 INFO:teuthology.orchestra.run.smithi161.stdout:2317 trunc from 0x57a688a to 0x3c20fb5 2024-09-21T15:08:14.716 INFO:teuthology.orchestra.run.smithi161.stdout:1734 write 0x3feeda8 thru 0x3ff0c06 (0x1e5f bytes) 2024-09-21T15:08:14.719 INFO:teuthology.orchestra.run.smithi161.stdout:1707 trunc from 0xb77200b to 0x3519e2f 2024-09-21T15:08:14.720 INFO:teuthology.orchestra.run.smithi161.stdout:1747 read 0x25134d thru 0x25fadd (0xe791 bytes) 2024-09-21T15:08:14.724 INFO:teuthology.orchestra.run.smithi161.stdout:1748 write 0x3ff4946 thru 0x3ffe35c (0x9a17 bytes) 2024-09-21T15:08:14.743 INFO:teuthology.orchestra.run.smithi161.stdout:1735 read 0x36b2db4 thru 0x36b84f8 (0x5745 bytes) 2024-09-21T15:08:14.752 INFO:teuthology.orchestra.run.smithi161.stdout:1749 read 0xbca2769 thru 0xbcabbd7 (0x946f bytes) 2024-09-21T15:08:14.753 INFO:teuthology.orchestra.run.smithi161.stdout:1750 writesame 0xc95133e thru 0xc95db51 data_size 0x1a(0xc814 bytes) 2024-09-21T15:08:14.754 INFO:teuthology.orchestra.run.smithi161.stdout:1736 trunc from 0x3ff0c07 to 0x8dee0a9 2024-09-21T15:08:14.761 INFO:teuthology.orchestra.run.smithi161.stdout:2318 read 0x308347d thru 0x3084a9c (0x1620 bytes) 2024-09-21T15:08:14.761 INFO:teuthology.orchestra.run.smithi161.stdout:2320 punch from 0xc601a2 to 0xc62d69, (0x2bc7 bytes) 2024-09-21T15:08:14.779 INFO:teuthology.orchestra.run.smithi161.stdout:1751 write 0x7e370f thru 0x7e7084 (0x3976 bytes) 2024-09-21T15:08:14.787 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.787 INFO:teuthology.orchestra.run.smithi161.stdout:1709 read 0x1629496 thru 0x162c9eb (0x3556 bytes) 2024-09-21T15:08:14.788 INFO:teuthology.orchestra.run.smithi161.stdout:1710 read 0x278b965 thru 0x278c64d (0xce9 bytes) 2024-09-21T15:08:14.796 INFO:teuthology.orchestra.run.smithi161.stdout:2321 writesame 0x66b51ac thru 0x66b958d data_size 0x1(0x43e2 bytes) 2024-09-21T15:08:14.798 INFO:teuthology.orchestra.run.smithi161.stdout:1738 trunc from 0x8dee0a9 to 0x600e6ee 2024-09-21T15:08:14.800 INFO:teuthology.orchestra.run.smithi161.stdout:1754 punch from 0x549496e to 0x549bacb, (0x715d bytes) 2024-09-21T15:08:14.800 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.801 INFO:teuthology.orchestra.run.smithi161.stdout:1756 punch from 0xa51fa2c to 0xa5201b8, (0x78c bytes) 2024-09-21T15:08:14.801 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.801 INFO:teuthology.orchestra.run.smithi161.stdout:1758 writesame 0x1f00095 thru 0x1f0bdc8 data_size 0x2(0xbd34 bytes) 2024-09-21T15:08:14.809 INFO:teuthology.orchestra.run.smithi161.stdout:2322 write 0x4ef98b0 thru 0x4efe488 (0x4bd9 bytes) 2024-09-21T15:08:14.831 INFO:teuthology.orchestra.run.smithi161.stdout:1711 writesame 0x742f75a thru 0x743b236 data_size 0x1(0xbadd bytes) 2024-09-21T15:08:14.835 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.836 INFO:teuthology.orchestra.run.smithi161.stdout:1761 write 0x66cb7ec thru 0x66d5123 (0x9938 bytes) 2024-09-21T15:08:14.840 INFO:teuthology.orchestra.run.smithi161.stdout:1712 read 0xe2eded thru 0xe39c92 (0xaea6 bytes) 2024-09-21T15:08:14.852 INFO:teuthology.orchestra.run.smithi161.stdout:1740 write 0x6a5f5ac thru 0x6a6d430 (0xde85 bytes) 2024-09-21T15:08:14.856 INFO:teuthology.orchestra.run.smithi161.stdout:2323 write 0x855238b thru 0x855b7da (0x9450 bytes) 2024-09-21T15:08:14.859 INFO:teuthology.orchestra.run.smithi161.stdout:1762 punch from 0x1ca816a to 0x1cb3a19, (0xb8af bytes) 2024-09-21T15:08:14.859 INFO:teuthology.orchestra.run.smithi161.stdout:1764 punch from 0xb8eddab to 0xb8fc695, (0xe8ea bytes) 2024-09-21T15:08:14.875 INFO:teuthology.orchestra.run.smithi161.stdout:1765 trunc from 0xdb11253 to 0x6349b3e 2024-09-21T15:08:14.882 INFO:teuthology.orchestra.run.smithi161.stdout:1741 punch from 0x2961f89 to 0x2971772, (0xf7e9 bytes) 2024-09-21T15:08:14.882 INFO:teuthology.orchestra.run.smithi161.stdout:1742 read 0x2c3af5e thru 0x2c46587 (0xb62a bytes) 2024-09-21T15:08:14.883 INFO:teuthology.orchestra.run.smithi161.stdout:1743 write 0x305fb31 thru 0x306db2a (0xdffa bytes) 2024-09-21T15:08:14.887 INFO:teuthology.orchestra.run.smithi161.stdout:2324 punch from 0x50f4c89 to 0x50fe0fc, (0x9473 bytes) 2024-09-21T15:08:14.887 INFO:teuthology.orchestra.run.smithi161.stdout:2326 write 0x3aab12 thru 0x3af8f6 (0x4de5 bytes) 2024-09-21T15:08:14.900 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.900 INFO:teuthology.orchestra.run.smithi161.stdout:2330 read 0x5ed011c thru 0x5edc0fa (0xbfdf bytes) 2024-09-21T15:08:14.900 INFO:teuthology.orchestra.run.smithi161.stdout:1713 write 0xc3e7c2b thru 0xc3f6896 (0xec6c bytes) 2024-09-21T15:08:14.903 INFO:teuthology.orchestra.run.smithi161.stdout:2332 write 0x714aa51 thru 0x7150c54 (0x6204 bytes) 2024-09-21T15:08:14.928 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone10 from 0xe257e3c (overlap 0x69216a) to 0x2a0d5d 2024-09-21T15:08:14.945 INFO:teuthology.orchestra.run.smithi161.stdout:2333 trunc from 0x855b7db to 0x5e68c8c 2024-09-21T15:08:14.952 INFO:teuthology.orchestra.run.smithi161.stdout:1714 trunc from 0xc3f6897 to 0x3cefd1f 2024-09-21T15:08:14.977 INFO:teuthology.orchestra.run.smithi161.stdout:1744 writesame 0x759ead8 thru 0x75a1b0f data_size 0x4(0x3038 bytes) 2024-09-21T15:08:14.983 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.983 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:14.984 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone17 from 0x91cdf9a (overlap 0x469acd8) to 0x0 2024-09-21T15:08:15.045 INFO:teuthology.orchestra.run.smithi161.stdout:1715 read 0x28c4cbf thru 0x28cf864 (0xaba6 bytes) 2024-09-21T15:08:15.059 INFO:teuthology.orchestra.run.smithi161.stdout:1716 trunc from 0x3cefd1f to 0x32fc4 2024-09-21T15:08:15.064 INFO:teuthology.orchestra.run.smithi161.stdout:2334 write 0x3d754ef thru 0x3d7d726 (0x8238 bytes) 2024-09-21T15:08:15.089 INFO:teuthology.orchestra.run.smithi161.stdout:2336 read 0x2558785 thru 0x255fea2 (0x771e bytes) 2024-09-21T15:08:15.089 INFO:teuthology.orchestra.run.smithi161.stdout:2338 write 0x21abe52 thru 0x21b2ad9 (0x6c88 bytes) 2024-09-21T15:08:15.090 INFO:teuthology.orchestra.run.smithi161.stdout:1768 write 0x656dccf thru 0x65738a5 (0x5bd7 bytes) 2024-09-21T15:08:15.130 INFO:teuthology.orchestra.run.smithi161.stdout:2339 write 0x1969988 thru 0x196b49d (0x1b16 bytes) 2024-09-21T15:08:15.150 INFO:teuthology.orchestra.run.smithi161.stdout:1746 writesame 0x9917f48 thru 0x9919641 data_size 0x11(0x16fa bytes) 2024-09-21T15:08:15.157 INFO:teuthology.orchestra.run.smithi161.stdout:1749 read 0x5203772 thru 0x520984e (0x60dd bytes) 2024-09-21T15:08:15.157 INFO:teuthology.orchestra.run.smithi161.stdout:1750 read 0x3e0989a thru 0x3e10f3c (0x76a3 bytes) 2024-09-21T15:08:15.158 INFO:teuthology.orchestra.run.smithi161.stdout:1769 write 0x33c20c9 thru 0x33c9835 (0x776d bytes) 2024-09-21T15:08:15.166 INFO:teuthology.orchestra.run.smithi161.stdout:2340 punch from 0x45f4e7a to 0x45f7cbb, (0x2e41 bytes) 2024-09-21T15:08:15.167 INFO:teuthology.orchestra.run.smithi161.stdout:2341 punch from 0xfd9c86 to 0xfe4b41, (0xaebb bytes) 2024-09-21T15:08:15.167 INFO:teuthology.orchestra.run.smithi161.stdout:2342 punch from 0x180f72a to 0x181c74a, (0xd020 bytes) 2024-09-21T15:08:15.167 INFO:teuthology.orchestra.run.smithi161.stdout:2344 punch from 0x3dcc27b to 0x3dd7ec6, (0xbc4b bytes) 2024-09-21T15:08:15.192 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:15.192 INFO:teuthology.orchestra.run.smithi161.stdout:1773 read 0xb787dc thru 0xb795f2 (0xe17 bytes) 2024-09-21T15:08:15.192 INFO:teuthology.orchestra.run.smithi161.stdout:1774 clone 12 order 23 su 524288 sc 15 2024-09-21T15:08:15.217 INFO:teuthology.orchestra.run.smithi161.stdout:1717 writesame 0xa2e45be thru 0xa2e4725 data_size 0x12(0x168 bytes) 2024-09-21T15:08:15.221 INFO:teuthology.orchestra.run.smithi161.stdout:1719 write 0x7277991 thru 0x727fc59 (0x82c9 bytes) 2024-09-21T15:08:15.222 INFO:teuthology.orchestra.run.smithi161.stdout:1751 write 0xe3a0731 thru 0xe3af058 (0xe928 bytes) 2024-09-21T15:08:15.223 INFO:teuthology.orchestra.run.smithi161.stdout:2345 write 0x9b6a910 thru 0x9b77f8c (0xd67d bytes) 2024-09-21T15:08:15.242 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #9, image image_cluster1.client.mirror.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent10 2024-09-21T15:08:15.246 INFO:teuthology.orchestra.run.smithi161.stdout:1720 trunc from 0xa2e4726 to 0xa60a541 2024-09-21T15:08:15.259 INFO:teuthology.orchestra.run.smithi161.stdout:1752 clone 15 order 25 su 4194304 sc 10 2024-09-21T15:08:15.259 INFO:teuthology.orchestra.run.smithi161.stdout:2346 read 0x3956bcf thru 0x3958443 (0x1875 bytes) 2024-09-21T15:08:15.282 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:15.290 INFO:teuthology.orchestra.run.smithi161.stdout:1722 trunc from 0xa60a541 to 0xd4897f1 2024-09-21T15:08:15.411 INFO:teuthology.orchestra.run.smithi161.stdout:2347 write 0xe6f6ef3 thru 0xe6fefa0 (0x80ae bytes) 2024-09-21T15:08:15.421 INFO:teuthology.orchestra.run.smithi161.stdout:1723 write 0xdd607fd thru 0xdd6ec7d (0xe481 bytes) 2024-09-21T15:08:15.431 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:15.432 INFO:teuthology.orchestra.run.smithi161.stdout:2349 write 0xd539585 thru 0xd546466 (0xcee2 bytes) 2024-09-21T15:08:15.462 INFO:teuthology.orchestra.run.smithi161.stdout:1724 writesame 0xde0feba thru 0xde150b4 data_size 0x1(0x51fb bytes) 2024-09-21T15:08:15.465 INFO:teuthology.orchestra.run.smithi161.stdout:2043 punch from 0xa2d3329 to 0xa2e1db1, (0xea88 bytes) 2024-09-21T15:08:15.465 INFO:teuthology.orchestra.run.smithi161.stdout:1725 read 0x3393cc5 thru 0x339e835 (0xab71 bytes) 2024-09-21T15:08:15.465 INFO:teuthology.orchestra.run.smithi161.stdout:1726 read 0x881feb2 thru 0x88232c3 (0x3412 bytes) 2024-09-21T15:08:15.465 INFO:teuthology.orchestra.run.smithi161.stdout:1727 read 0xbc752d6 thru 0xbc7da1c (0x8747 bytes) 2024-09-21T15:08:15.466 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:15.466 INFO:teuthology.orchestra.run.smithi161.stdout:1729 write 0xc1b42b3 thru 0xc1b5926 (0x1674 bytes) 2024-09-21T15:08:15.470 INFO:teuthology.orchestra.run.smithi161.stdout:2351 trunc from 0xe6fefa1 to 0x119cfcd 2024-09-21T15:08:15.479 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:15.479 INFO:teuthology.orchestra.run.smithi161.stdout:1731 write 0x17d69cb thru 0x17db3eb (0x4a21 bytes) 2024-09-21T15:08:15.483 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #16, image image_cluster1.client.mirror.3-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent17 2024-09-21T15:08:15.494 INFO:teuthology.orchestra.run.smithi161.stdout:2044 punch from 0x4d96703 to 0x4da0dd9, (0xa6d6 bytes) 2024-09-21T15:08:15.494 INFO:teuthology.orchestra.run.smithi161.stdout:2045 write 0x336c366 thru 0x3378025 (0xbcc0 bytes) 2024-09-21T15:08:15.509 INFO:teuthology.orchestra.run.smithi161.stdout:1733 trunc from 0xde150b5 to 0x5850cea 2024-09-21T15:08:15.520 INFO:teuthology.orchestra.run.smithi161.stdout:2046 trunc from 0xe257e3c to 0x8b3ab48 2024-09-21T15:08:15.530 INFO:teuthology.orchestra.run.smithi161.stdout:2352 trunc from 0x119cfcd to 0x68e2894 2024-09-21T15:08:15.591 INFO:teuthology.orchestra.run.smithi161.stdout:2048 read 0x48ee7b2 thru 0x48fd1cf (0xea1e bytes) 2024-09-21T15:08:15.593 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:15.593 INFO:teuthology.orchestra.run.smithi161.stdout:2051 read 0x8000e28 thru 0x800662a (0x5803 bytes) 2024-09-21T15:08:15.594 INFO:teuthology.orchestra.run.smithi161.stdout:2052 write 0x5d8091f thru 0x5d8138f (0xa71 bytes) 2024-09-21T15:08:15.655 INFO:teuthology.orchestra.run.smithi161.stdout:2354 write 0xe8620c9 thru 0xe866a59 (0x4991 bytes) 2024-09-21T15:08:15.660 INFO:teuthology.orchestra.run.smithi161.stdout:1734 writesame 0x9516aed thru 0x952295f data_size 0x31(0xbe73 bytes) 2024-09-21T15:08:15.665 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:15.665 INFO:teuthology.orchestra.run.smithi161.stdout:1737 read 0x2c7e3d7 thru 0x2c85c57 (0x7881 bytes) 2024-09-21T15:08:15.669 INFO:teuthology.orchestra.run.smithi161.stdout:1738 trunc from 0x9522960 to 0xaac89c8 2024-09-21T15:08:15.674 INFO:teuthology.orchestra.run.smithi161.stdout:2355 trunc from 0xe866a5a to 0xd8b1c35 2024-09-21T15:08:15.685 INFO:teuthology.orchestra.run.smithi161.stdout:2053 punch from 0x7c7d38e to 0x7c8cd9e, (0xfa10 bytes) 2024-09-21T15:08:15.685 INFO:teuthology.orchestra.run.smithi161.stdout:2054 write 0x775f2d2 thru 0x77609bb (0x16ea bytes) 2024-09-21T15:08:15.707 INFO:teuthology.orchestra.run.smithi161.stdout:2056 punch from 0x8087e59 to 0x808abc7, (0x2d6e bytes) 2024-09-21T15:08:15.707 INFO:teuthology.orchestra.run.smithi161.stdout:2057 writesame 0x82f6d57 thru 0x82fbb4d data_size 0x1(0x4df7 bytes) 2024-09-21T15:08:15.740 INFO:teuthology.orchestra.run.smithi161.stdout:2356 trunc from 0xd8b1c35 to 0x6a3beb5 2024-09-21T15:08:15.742 INFO:teuthology.orchestra.run.smithi161.stdout:1739 read 0x957b458 thru 0x9589083 (0xdc2c bytes) 2024-09-21T15:08:15.757 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:15.757 INFO:teuthology.orchestra.run.smithi161.stdout:2059 punch from 0x346b26d to 0x346bb1f, (0x8b2 bytes) 2024-09-21T15:08:15.757 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:15.757 INFO:teuthology.orchestra.run.smithi161.stdout:2061 read 0x88b0223 thru 0x88b7407 (0x71e5 bytes) 2024-09-21T15:08:15.774 INFO:teuthology.orchestra.run.smithi161.stdout:1740 writesame 0xaeaa3a6 thru 0xaeace10 data_size 0x1(0x2a6b bytes) 2024-09-21T15:08:15.786 INFO:teuthology.orchestra.run.smithi161.stdout:2357 punch from 0x3e4dbe5 to 0x3e504d9, (0x28f4 bytes) 2024-09-21T15:08:15.811 INFO:teuthology.orchestra.run.smithi161.stdout:1741 write 0xc310d51 thru 0xc316665 (0x5915 bytes) 2024-09-21T15:08:15.822 INFO:teuthology.orchestra.run.smithi161.stdout:1744 read 0x55342cf thru 0x5541aa1 (0xd7d3 bytes) 2024-09-21T15:08:15.823 INFO:teuthology.orchestra.run.smithi161.stdout:1745 read 0x615c5a4 thru 0x616b30e (0xed6b bytes) 2024-09-21T15:08:15.823 INFO:teuthology.orchestra.run.smithi161.stdout:1747 write 0x4da928e thru 0x4dad91d (0x4690 bytes) 2024-09-21T15:08:15.824 INFO:teuthology.orchestra.run.smithi161.stdout:2360 writesame 0x7221558 thru 0x72308e6 data_size 0x1(0xf38f bytes) 2024-09-21T15:08:15.825 INFO:teuthology.orchestra.run.smithi161.stdout:2062 write 0xe66fe28 thru 0xe6719ce (0x1ba7 bytes) 2024-09-21T15:08:15.829 INFO:teuthology.orchestra.run.smithi161.stdout:2361 punch from 0x4055ae to 0x412a3f, (0xd491 bytes) 2024-09-21T15:08:15.833 INFO:teuthology.orchestra.run.smithi161.stdout:1749 read 0x48c2687 thru 0x48cdc3f (0xb5b9 bytes) 2024-09-21T15:08:15.833 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:15.838 INFO:teuthology.orchestra.run.smithi161.stdout:2064 read 0x9dfcc28 thru 0x9e04c0a (0x7fe3 bytes) 2024-09-21T15:08:15.839 INFO:teuthology.orchestra.run.smithi161.stdout:2363 trunc from 0x72308e7 to 0x14ddb71 2024-09-21T15:08:15.839 INFO:teuthology.orchestra.run.smithi161.stdout:2065 read 0x933ccd8 thru 0x933cd4d (0x76 bytes) 2024-09-21T15:08:15.839 INFO:teuthology.orchestra.run.smithi161.stdout:2067 write 0x983a89c thru 0x983c7b9 (0x1f1e bytes) 2024-09-21T15:08:15.846 INFO:teuthology.orchestra.run.smithi161.stdout:1752 trunc from 0xc316666 to 0x4c2138d 2024-09-21T15:08:15.849 INFO:teuthology.orchestra.run.smithi161.stdout:2069 write 0xa09c7d5 thru 0xa09fe77 (0x36a3 bytes) 2024-09-21T15:08:15.869 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:15.888 INFO:teuthology.orchestra.run.smithi161.stdout:2073 trunc from 0xe6719cf to 0x3dbcaff 2024-09-21T15:08:15.892 INFO:teuthology.orchestra.run.smithi161.stdout:1753 clone 14 order 24 su 262144 sc 3 2024-09-21T15:08:15.923 INFO:teuthology.orchestra.run.smithi161.stdout:2364 write 0xa98a321 thru 0xa98f144 (0x4e24 bytes) 2024-09-21T15:08:15.934 INFO:teuthology.orchestra.run.smithi161.stdout:2365 read 0xa85774c thru 0xa866376 (0xec2b bytes) 2024-09-21T15:08:15.935 INFO:teuthology.orchestra.run.smithi161.stdout:2366 punch from 0x98b86ed to 0x98be12e, (0x5a41 bytes) 2024-09-21T15:08:15.935 INFO:teuthology.orchestra.run.smithi161.stdout:2367 writesame 0x40876f2 thru 0x408dcda data_size 0x1(0x65e9 bytes) 2024-09-21T15:08:15.941 INFO:teuthology.orchestra.run.smithi161.stdout:1448 trunc from 0x91cdf9a to 0x2c6a30 2024-09-21T15:08:15.968 INFO:teuthology.orchestra.run.smithi161.stdout:2368 read 0x541fa9f thru 0x5424be6 (0x5148 bytes) 2024-09-21T15:08:15.968 INFO:teuthology.orchestra.run.smithi161.stdout:2370 punch from 0x1742f09 to 0x1744fa6, (0x209d bytes) 2024-09-21T15:08:15.968 INFO:teuthology.orchestra.run.smithi161.stdout:2371 read 0x9a691d5 thru 0x9a6ed6e (0x5b9a bytes) 2024-09-21T15:08:15.968 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:15.968 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:15.968 INFO:teuthology.orchestra.run.smithi161.stdout:2376 read 0x9b2cb6c thru 0x9b371d7 (0xa66c bytes) 2024-09-21T15:08:15.969 INFO:teuthology.orchestra.run.smithi161.stdout:2377 read 0x6c33a6d thru 0x6c413db (0xd96f bytes) 2024-09-21T15:08:15.971 INFO:teuthology.orchestra.run.smithi161.stdout:2378 trunc from 0xa98f145 to 0xb8c255e 2024-09-21T15:08:15.988 INFO:teuthology.orchestra.run.smithi161.stdout:2074 trunc from 0x3dbcaff to 0x32bbe5c 2024-09-21T15:08:16.003 INFO:teuthology.orchestra.run.smithi161.stdout:2379 read 0xa2eefb thru 0xa3d9fd (0xeb03 bytes) 2024-09-21T15:08:16.004 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone14 from 0xe3af059 (overlap 0x9ba1cf) to 0x0 2024-09-21T15:08:16.004 INFO:teuthology.orchestra.run.smithi161.stdout:2380 read 0x5b42d1 thru 0x5bbac4 (0x77f4 bytes) 2024-09-21T15:08:16.005 INFO:teuthology.orchestra.run.smithi161.stdout:2381 writesame 0x681caf0 thru 0x6824c92 data_size 0xb(0x81a3 bytes) 2024-09-21T15:08:16.007 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone11 from 0x65738a6 (overlap 0x1b0e78) to 0x103be1 2024-09-21T15:08:16.029 INFO:teuthology.orchestra.run.smithi161.stdout:2383 read 0x9a8f944 thru 0x9a99142 (0x97ff bytes) 2024-09-21T15:08:16.050 INFO:teuthology.orchestra.run.smithi161.stdout:2384 trunc from 0xb8c255e to 0x282979f 2024-09-21T15:08:16.073 INFO:teuthology.orchestra.run.smithi161.stdout:2075 trunc from 0x32bbe5c to 0x8d32ab6 2024-09-21T15:08:16.130 INFO:teuthology.orchestra.run.smithi161.stdout:2076 clone 12 order 22 su 2097152 sc 2 2024-09-21T15:08:16.132 INFO:teuthology.orchestra.run.smithi161.stdout:1449 write 0xdf94861 thru 0xdf994ed (0x4c8d bytes) 2024-09-21T15:08:16.147 INFO:teuthology.orchestra.run.smithi161.stdout:1450 punch from 0x5a2bee to 0x5b1e8c, (0xf29e bytes) 2024-09-21T15:08:16.147 INFO:teuthology.orchestra.run.smithi161.stdout:1451 read 0xb97e33a thru 0xb98169f (0x3366 bytes) 2024-09-21T15:08:16.147 INFO:teuthology.orchestra.run.smithi161.stdout:1452 punch from 0x77de31d to 0x77e95b2, (0xb295 bytes) 2024-09-21T15:08:16.147 INFO:teuthology.orchestra.run.smithi161.stdout:1454 write 0x8ff139 thru 0x90e6f2 (0xf5ba bytes) 2024-09-21T15:08:16.148 INFO:teuthology.orchestra.run.smithi161.stdout:2386 writesame 0x43bd96 thru 0x43ffa1 data_size 0x6(0x420c bytes) 2024-09-21T15:08:16.178 INFO:teuthology.orchestra.run.smithi161.stdout:2389 trunc from 0x282979f to 0xc47f0ad 2024-09-21T15:08:16.210 INFO:teuthology.orchestra.run.smithi161.stdout:2392 writesame 0x3301ac1 thru 0x3311848 data_size 0x98(0xfd88 bytes) 2024-09-21T15:08:16.218 INFO:teuthology.orchestra.run.smithi161.stdout:2393 write 0x25ccafe thru 0x25d945a (0xc95d bytes) 2024-09-21T15:08:16.231 INFO:teuthology.orchestra.run.smithi161.stdout:2394 punch from 0x55d5c4 to 0x5615e4, (0x4020 bytes) 2024-09-21T15:08:16.231 INFO:teuthology.orchestra.run.smithi161.stdout:2395 write 0x3932f97 thru 0x3935ad5 (0x2b3f bytes) 2024-09-21T15:08:16.241 INFO:teuthology.orchestra.run.smithi161.stdout:2396 read 0x6200de8 thru 0x62046e6 (0x38ff bytes) 2024-09-21T15:08:16.241 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:16.241 INFO:teuthology.orchestra.run.smithi161.stdout:2398 write 0x6f88f71 thru 0x6f98084 (0xf114 bytes) 2024-09-21T15:08:16.279 INFO:teuthology.orchestra.run.smithi161.stdout:1455 write 0x9e2193c thru 0x9e22054 (0x719 bytes) 2024-09-21T15:08:16.286 INFO:teuthology.orchestra.run.smithi161.stdout:1456 read 0x986e9f6 thru 0x986f4d8 (0xae3 bytes) 2024-09-21T15:08:16.301 INFO:teuthology.orchestra.run.smithi161.stdout:1458 trunc from 0xdf994ee to 0x85c3f6e 2024-09-21T15:08:16.313 INFO:teuthology.orchestra.run.smithi161.stdout:2399 read 0x89cc552 thru 0x89ce527 (0x1fd6 bytes) 2024-09-21T15:08:16.313 INFO:teuthology.orchestra.run.smithi161.stdout:2400 clone 12 order 23 su 65536 sc 10 2024-09-21T15:08:16.339 INFO:teuthology.orchestra.run.smithi161.stdout:1459 writesame 0x440f63f thru 0x4412a36 data_size 0x4(0x33f8 bytes) 2024-09-21T15:08:16.349 INFO:teuthology.orchestra.run.smithi161.stdout:1461 writesame 0x19192b6 thru 0x191a7ab data_size 0x1(0x14f6 bytes) 2024-09-21T15:08:16.361 INFO:teuthology.orchestra.run.smithi161.stdout:1463 punch from 0x1bbdf3b to 0x1bcc4e4, (0xe5a9 bytes) 2024-09-21T15:08:16.361 INFO:teuthology.orchestra.run.smithi161.stdout:1464 punch from 0x712f40 to 0x715b97, (0x2c57 bytes) 2024-09-21T15:08:16.361 INFO:teuthology.orchestra.run.smithi161.stdout:1466 write 0x78913cd thru 0x7895a91 (0x46c5 bytes) 2024-09-21T15:08:16.378 INFO:teuthology.orchestra.run.smithi161.stdout:1467 read 0x66490ef thru 0x66511fd (0x810f bytes) 2024-09-21T15:08:16.395 INFO:teuthology.orchestra.run.smithi161.stdout:1469 trunc from 0x85c3f6e to 0xc6a6c4 2024-09-21T15:08:16.443 INFO:teuthology.orchestra.run.smithi161.stdout:1471 clone 19 order 24 su 4194304 sc 13 2024-09-21T15:08:16.558 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #10, image image_cluster1.client.mirror.1-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent11 2024-09-21T15:08:16.611 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #13, image image_cluster1.client.mirror.4-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent14 2024-09-21T15:08:16.631 INFO:teuthology.orchestra.run.smithi161.stdout:1776 write 0x115397a thru 0x115424b (0x8d2 bytes) 2024-09-21T15:08:16.674 INFO:teuthology.orchestra.run.smithi161.stdout:1777 write 0x3c96e06 thru 0x3c9828b (0x1486 bytes) 2024-09-21T15:08:16.675 INFO:teuthology.orchestra.run.smithi161.stdout:1753 write 0xe24f2fe thru 0xe25b070 (0xbd73 bytes) 2024-09-21T15:08:16.707 INFO:teuthology.orchestra.run.smithi161.stdout:1778 trunc from 0x65738a6 to 0xd273332 2024-09-21T15:08:16.730 INFO:teuthology.orchestra.run.smithi161.stdout:1755 read 0x8d6cf59 thru 0x8d72b5b (0x5c03 bytes) 2024-09-21T15:08:16.731 INFO:teuthology.orchestra.run.smithi161.stdout:1756 write 0x98ffa95 thru 0x990ed00 (0xf26c bytes) 2024-09-21T15:08:16.748 INFO:teuthology.orchestra.run.smithi161.stdout:1757 read 0xad43c96 thru 0xad448a8 (0xc13 bytes) 2024-09-21T15:08:16.748 INFO:teuthology.orchestra.run.smithi161.stdout:1758 read 0xb70fd2a thru 0xb71767b (0x7952 bytes) 2024-09-21T15:08:16.749 INFO:teuthology.orchestra.run.smithi161.stdout:1759 writesame 0x712814b thru 0x712e1c5 data_size 0x1(0x607b bytes) 2024-09-21T15:08:16.753 INFO:teuthology.orchestra.run.smithi161.stdout:1779 writesame 0x7bb75d1 thru 0x7bbf244 data_size 0x6(0x7c74 bytes) 2024-09-21T15:08:16.776 INFO:teuthology.orchestra.run.smithi161.stdout:1760 read 0x5ef7099 thru 0x5eff25d (0x81c5 bytes) 2024-09-21T15:08:16.776 INFO:teuthology.orchestra.run.smithi161.stdout:1765 punch from 0xc6a155b to 0xc6a5942, (0x43e7 bytes) 2024-09-21T15:08:16.776 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:16.776 INFO:teuthology.orchestra.run.smithi161.stdout:1767 read 0x6aa306d thru 0x6aa884c (0x57e0 bytes) 2024-09-21T15:08:16.777 INFO:teuthology.orchestra.run.smithi161.stdout:1768 write 0x2c3fdf5 thru 0x2c4a552 (0xa75e bytes) 2024-09-21T15:08:16.779 INFO:teuthology.orchestra.run.smithi161.stdout:1782 write 0x45d206a thru 0x45d350d (0x14a4 bytes) 2024-09-21T15:08:16.789 INFO:teuthology.orchestra.run.smithi161.stdout:1783 read 0xbe5ca89 thru 0xbe62a75 (0x5fed bytes) 2024-09-21T15:08:16.789 INFO:teuthology.orchestra.run.smithi161.stdout:1786 write 0x16afed5 thru 0x16b4444 (0x4570 bytes) 2024-09-21T15:08:16.811 INFO:teuthology.orchestra.run.smithi161.stdout:1769 read 0xc2d27c4 thru 0xc2d5b9a (0x33d7 bytes) 2024-09-21T15:08:16.812 INFO:teuthology.orchestra.run.smithi161.stdout:1772 read 0x8be5fac thru 0x8bea28e (0x42e3 bytes) 2024-09-21T15:08:16.812 INFO:teuthology.orchestra.run.smithi161.stdout:1773 read 0x5a9a31e thru 0x5aa835b (0xe03e bytes) 2024-09-21T15:08:16.815 INFO:teuthology.orchestra.run.smithi161.stdout:1787 writesame 0x126da1c thru 0x127ba6e data_size 0x1(0xe053 bytes) 2024-09-21T15:08:16.841 INFO:teuthology.orchestra.run.smithi161.stdout:1774 trunc from 0xe3af059 to 0x3d874a 2024-09-21T15:08:16.878 INFO:teuthology.orchestra.run.smithi161.stdout:1789 writesame 0x8ad814f thru 0x8ad9fcd data_size 0x1(0x1e7f bytes) 2024-09-21T15:08:16.891 INFO:teuthology.orchestra.run.smithi161.stdout:1790 read 0x4ebc20b thru 0x4ec6a90 (0xa886 bytes) 2024-09-21T15:08:16.891 INFO:teuthology.orchestra.run.smithi161.stdout:1791 read 0x1e2fd92 thru 0x1e32914 (0x2b83 bytes) 2024-09-21T15:08:16.892 INFO:teuthology.orchestra.run.smithi161.stdout:1792 read 0x342e6b8 thru 0x34349d9 (0x6322 bytes) 2024-09-21T15:08:16.895 INFO:teuthology.orchestra.run.smithi161.stdout:1795 punch from 0x5eb172c to 0x5eba27e, (0x8b52 bytes) 2024-09-21T15:08:16.927 INFO:teuthology.orchestra.run.smithi161.stdout:1775 punch from 0x2e21ae to 0x2e28b0, (0x702 bytes) 2024-09-21T15:08:16.933 INFO:teuthology.orchestra.run.smithi161.stdout:1796 write 0xe75f394 thru 0xe762d48 (0x39b5 bytes) 2024-09-21T15:08:16.944 INFO:teuthology.orchestra.run.smithi161.stdout:1797 read 0x8c9f13a thru 0x8ca4072 (0x4f39 bytes) 2024-09-21T15:08:16.944 INFO:teuthology.orchestra.run.smithi161.stdout:1798 read 0x2457ebf thru 0x2463cb5 (0xbdf7 bytes) 2024-09-21T15:08:16.944 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:16.944 INFO:teuthology.orchestra.run.smithi161.stdout:1800 write 0x3960756 thru 0x396b45c (0xad07 bytes) 2024-09-21T15:08:16.947 INFO:teuthology.orchestra.run.smithi161.stdout:1776 trunc from 0x3d874a to 0xdb59759 2024-09-21T15:08:16.974 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone13 from 0x4c2138d (overlap 0x32fc4) to 0x23b09 2024-09-21T15:08:16.980 INFO:teuthology.orchestra.run.smithi161.stdout:1801 trunc from 0xe762d49 to 0x892e994 2024-09-21T15:08:16.993 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone11 from 0x8d32ab6 (overlap 0x32bbe5c) to 0x2383873 2024-09-21T15:08:17.003 INFO:teuthology.orchestra.run.smithi161.stdout:1777 write 0xdc4e9bb thru 0xdc4fd4b (0x1391 bytes) 2024-09-21T15:08:17.016 INFO:teuthology.orchestra.run.smithi161.stdout:1778 punch from 0x6b46845 to 0x6b4d9d6, (0x7191 bytes) 2024-09-21T15:08:17.016 INFO:teuthology.orchestra.run.smithi161.stdout:1779 punch from 0x8a421e7 to 0x8a4caeb, (0xa904 bytes) 2024-09-21T15:08:17.018 INFO:teuthology.orchestra.run.smithi161.stdout:1781 trunc from 0xdc4fd4c to 0xe95ce03 2024-09-21T15:08:17.019 INFO:teuthology.orchestra.run.smithi161.stdout:1802 write 0xecbb94 thru 0xed5557 (0x99c4 bytes) 2024-09-21T15:08:17.024 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone18 from 0xc6a6c4 (overlap 0x2c6a30) to 0x47104 2024-09-21T15:08:17.037 INFO:teuthology.orchestra.run.smithi161.stdout:1803 read 0x93a912 thru 0x94257d (0x7c6c bytes) 2024-09-21T15:08:17.059 INFO:teuthology.orchestra.run.smithi161.stdout:1782 writesame 0xd6910c9 thru 0xd69a30a data_size 0x61(0x9242 bytes) 2024-09-21T15:08:17.082 INFO:teuthology.orchestra.run.smithi161.stdout:1783 writesame 0x5f223b8 thru 0x5f22500 data_size 0x1(0x149 bytes) 2024-09-21T15:08:17.094 INFO:teuthology.orchestra.run.smithi161.stdout:1784 read 0x834e11a thru 0x835712a (0x9011 bytes) 2024-09-21T15:08:17.094 INFO:teuthology.orchestra.run.smithi161.stdout:1787 writesame 0x39835fc thru 0x398ec04 data_size 0x1(0xb609 bytes) 2024-09-21T15:08:17.106 INFO:teuthology.orchestra.run.smithi161.stdout:1804 writesame 0xc356237 thru 0xc3632a7 data_size 0x93(0xd071 bytes) 2024-09-21T15:08:17.112 INFO:teuthology.orchestra.run.smithi161.stdout:1806 punch from 0x87f3245 to 0x8801db7, (0xeb72 bytes) 2024-09-21T15:08:17.112 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.112 INFO:teuthology.orchestra.run.smithi161.stdout:1808 read 0xadc99fb thru 0xadcade0 (0x13e6 bytes) 2024-09-21T15:08:17.115 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #12, image image_cluster1.client.mirror.5-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent13 2024-09-21T15:08:17.138 INFO:teuthology.orchestra.run.smithi161.stdout:1790 writesame 0xad7e469 thru 0xad8c1e4 data_size 0x9(0xdd7c bytes) 2024-09-21T15:08:17.148 INFO:teuthology.orchestra.run.smithi161.stdout:1791 read 0x4058164 thru 0x40600e8 (0x7f85 bytes) 2024-09-21T15:08:17.148 INFO:teuthology.orchestra.run.smithi161.stdout:1792 write 0x8182285 thru 0x818cb7e (0xa8fa bytes) 2024-09-21T15:08:17.159 INFO:teuthology.orchestra.run.smithi161.stdout:1793 read 0xcfd4b4a thru 0xcfdc7f4 (0x7cab bytes) 2024-09-21T15:08:17.159 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.159 INFO:teuthology.orchestra.run.smithi161.stdout:1795 writesame 0x609c7b3 thru 0x60aa0d6 data_size 0x1a(0xd924 bytes) 2024-09-21T15:08:17.160 INFO:teuthology.orchestra.run.smithi161.stdout:1754 punch from 0x1a3fc4b to 0x1a46b1b, (0x6ed0 bytes) 2024-09-21T15:08:17.165 INFO:teuthology.orchestra.run.smithi161.stdout:1809 writesame 0xd30d713 thru 0xd30f77c data_size 0x9(0x206a bytes) 2024-09-21T15:08:17.167 INFO:teuthology.orchestra.run.smithi161.stdout:1796 punch from 0xb403e27 to 0xb4120b8, (0xe291 bytes) 2024-09-21T15:08:17.167 INFO:teuthology.orchestra.run.smithi161.stdout:1797 punch from 0x37bdc9c to 0x37cae42, (0xd1a6 bytes) 2024-09-21T15:08:17.167 INFO:teuthology.orchestra.run.smithi161.stdout:1798 read 0xade01c0 thru 0xadef4b9 (0xf2fa bytes) 2024-09-21T15:08:17.168 INFO:teuthology.orchestra.run.smithi161.stdout:1800 write 0x5f59b3b thru 0x5f68ef3 (0xf3b9 bytes) 2024-09-21T15:08:17.170 INFO:teuthology.orchestra.run.smithi161.stdout:1810 writesame 0x1616feb thru 0x1617b8b data_size 0x1(0xba1 bytes) 2024-09-21T15:08:17.177 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.177 INFO:teuthology.orchestra.run.smithi161.stdout:1804 write 0x71df0cd thru 0x71e80f5 (0x9029 bytes) 2024-09-21T15:08:17.179 INFO:teuthology.orchestra.run.smithi161.stdout:1811 read 0x43c8ea3 thru 0x43ceea0 (0x5ffe bytes) 2024-09-21T15:08:17.180 INFO:teuthology.orchestra.run.smithi161.stdout:1812 writesame 0x7bdd7b9 thru 0x7beb181 data_size 0x1(0xd9c9 bytes) 2024-09-21T15:08:17.183 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.186 INFO:teuthology.orchestra.run.smithi161.stdout:1805 write 0xaba6c27 thru 0xabad7af (0x6b89 bytes) 2024-09-21T15:08:17.204 INFO:teuthology.orchestra.run.smithi161.stdout:1806 punch from 0xc19549c to 0xc1a30ac, (0xdc10 bytes) 2024-09-21T15:08:17.204 INFO:teuthology.orchestra.run.smithi161.stdout:1807 read 0xaffc2c0 thru 0xb0013e5 (0x5126 bytes) 2024-09-21T15:08:17.205 INFO:teuthology.orchestra.run.smithi161.stdout:1808 writesame 0x757ce02 thru 0x757f62e data_size 0x37(0x282d bytes) 2024-09-21T15:08:17.218 INFO:teuthology.orchestra.run.smithi161.stdout:1813 writesame 0x68fea22 thru 0x690818f data_size 0x5b(0x976e bytes) 2024-09-21T15:08:17.222 INFO:teuthology.orchestra.run.smithi161.stdout:1809 write 0x947c9a thru 0x95302e (0xb395 bytes) 2024-09-21T15:08:17.227 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #10, image image_cluster1.client.mirror.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent11 2024-09-21T15:08:17.231 INFO:teuthology.orchestra.run.smithi161.stdout:1757 write 0xc1ab7a3 thru 0xc1adc4d (0x24ab bytes) 2024-09-21T15:08:17.241 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #17, image image_cluster1.client.mirror.3-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent18 2024-09-21T15:08:17.250 INFO:teuthology.orchestra.run.smithi161.stdout:1759 read 0xa1ed307 thru 0xa1eee88 (0x1b82 bytes) 2024-09-21T15:08:17.250 INFO:teuthology.orchestra.run.smithi161.stdout:1760 punch from 0x5024fc9 to 0x5031578, (0xc5af bytes) 2024-09-21T15:08:17.250 INFO:teuthology.orchestra.run.smithi161.stdout:1761 punch from 0x5515ce2 to 0x551cf9c, (0x72ba bytes) 2024-09-21T15:08:17.250 INFO:teuthology.orchestra.run.smithi161.stdout:1762 writesame 0x3fd0c51 thru 0x3fd7bc5 data_size 0x1(0x6f75 bytes) 2024-09-21T15:08:17.258 INFO:teuthology.orchestra.run.smithi161.stdout:1810 trunc from 0xe95ce03 to 0x67c1f0f 2024-09-21T15:08:17.273 INFO:teuthology.orchestra.run.smithi161.stdout:1815 write 0xd9c025c thru 0xd9ca992 (0xa737 bytes) 2024-09-21T15:08:17.288 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #10, image image_cluster1.client.mirror.2-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent11 2024-09-21T15:08:17.290 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.290 INFO:teuthology.orchestra.run.smithi161.stdout:1765 punch from 0x82861ba to 0x828bc29, (0x5a6f bytes) 2024-09-21T15:08:17.290 INFO:teuthology.orchestra.run.smithi161.stdout:1766 write 0x26c5f31 thru 0x26cf47c (0x954c bytes) 2024-09-21T15:08:17.315 INFO:teuthology.orchestra.run.smithi161.stdout:1767 read 0x1a73356 thru 0x1a7b8ec (0x8597 bytes) 2024-09-21T15:08:17.319 INFO:teuthology.orchestra.run.smithi161.stdout:1816 trunc from 0xd9ca993 to 0x65cffe1 2024-09-21T15:08:17.344 INFO:teuthology.orchestra.run.smithi161.stdout:1811 write 0x95cc86f thru 0x95d9179 (0xc90b bytes) 2024-09-21T15:08:17.346 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.346 INFO:teuthology.orchestra.run.smithi161.stdout:2403 write 0x9a40837 thru 0x9a4f3ae (0xeb78 bytes) 2024-09-21T15:08:17.362 INFO:teuthology.orchestra.run.smithi161.stdout:1768 write 0xd2c2a38 thru 0xd2cb5f7 (0x8bc0 bytes) 2024-09-21T15:08:17.371 INFO:teuthology.orchestra.run.smithi161.stdout:1812 trunc from 0x95d917a to 0xb031b0d 2024-09-21T15:08:17.384 INFO:teuthology.orchestra.run.smithi161.stdout:1769 punch from 0x9ab6e2 to 0x9ae4fa, (0x2e18 bytes) 2024-09-21T15:08:17.385 INFO:teuthology.orchestra.run.smithi161.stdout:1770 writesame 0x487e1d6 thru 0x4887237 data_size 0x1(0x9062 bytes) 2024-09-21T15:08:17.393 INFO:teuthology.orchestra.run.smithi161.stdout:1472 writesame 0x61f1631 thru 0x61fb05c data_size 0x17(0x9a2c bytes) 2024-09-21T15:08:17.403 INFO:teuthology.orchestra.run.smithi161.stdout:1473 punch from 0x48bf402 to 0x48c7193, (0x7d91 bytes) 2024-09-21T15:08:17.403 INFO:teuthology.orchestra.run.smithi161.stdout:2405 punch from 0xbc980 to 0xc3262, (0x68e2 bytes) 2024-09-21T15:08:17.403 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.403 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.403 INFO:teuthology.orchestra.run.smithi161.stdout:1476 punch from 0x4bebf29 to 0x4bfa808, (0xe8df bytes) 2024-09-21T15:08:17.404 INFO:teuthology.orchestra.run.smithi161.stdout:1477 write 0x1e49dfe thru 0x1e4f6d0 (0x58d3 bytes) 2024-09-21T15:08:17.404 INFO:teuthology.orchestra.run.smithi161.stdout:2406 write 0x511a9a8 thru 0x511d763 (0x2dbc bytes) 2024-09-21T15:08:17.408 INFO:teuthology.orchestra.run.smithi161.stdout:2077 write 0xe7e35d7 thru 0xe7eae90 (0x78ba bytes) 2024-09-21T15:08:17.429 INFO:teuthology.orchestra.run.smithi161.stdout:2078 clone 13 order 22 su 16384 sc 3 2024-09-21T15:08:17.430 INFO:teuthology.orchestra.run.smithi161.stdout:1813 punch from 0x3f5e3a8 to 0x3f67cd6, (0x992e bytes) 2024-09-21T15:08:17.430 INFO:teuthology.orchestra.run.smithi161.stdout:1814 write 0x97da63f thru 0x97e9f48 (0xf90a bytes) 2024-09-21T15:08:17.431 INFO:teuthology.orchestra.run.smithi161.stdout:2407 punch from 0x38f37ac to 0x38f7983, (0x41d7 bytes) 2024-09-21T15:08:17.431 INFO:teuthology.orchestra.run.smithi161.stdout:2409 write 0xaab01f1 thru 0xaabe5c4 (0xe3d4 bytes) 2024-09-21T15:08:17.440 INFO:teuthology.orchestra.run.smithi161.stdout:1771 read 0xe40ad8 thru 0xe4969a (0x8bc3 bytes) 2024-09-21T15:08:17.441 INFO:teuthology.orchestra.run.smithi161.stdout:1773 read 0x760eaee thru 0x76192f1 (0xa804 bytes) 2024-09-21T15:08:17.441 INFO:teuthology.orchestra.run.smithi161.stdout:1775 read 0x97ea7 thru 0x9db28 (0x5c82 bytes) 2024-09-21T15:08:17.442 INFO:teuthology.orchestra.run.smithi161.stdout:1776 writesame 0x5083dd7 thru 0x508deb0 data_size 0x3(0xa0da bytes) 2024-09-21T15:08:17.445 INFO:teuthology.orchestra.run.smithi161.stdout:1815 read 0x1d9b537 thru 0x1da3ab1 (0x857b bytes) 2024-09-21T15:08:17.447 INFO:teuthology.orchestra.run.smithi161.stdout:1816 punch from 0x554e924 to 0x554ece3, (0x3bf bytes) 2024-09-21T15:08:17.447 INFO:teuthology.orchestra.run.smithi161.stdout:1818 write 0x9049669 thru 0x904e292 (0x4c2a bytes) 2024-09-21T15:08:17.454 INFO:teuthology.orchestra.run.smithi161.stdout:2410 read 0xfd6b95 thru 0xfe17a5 (0xac11 bytes) 2024-09-21T15:08:17.455 INFO:teuthology.orchestra.run.smithi161.stdout:2411 read 0x64cd17e thru 0x64d6b17 (0x999a bytes) 2024-09-21T15:08:17.456 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.459 INFO:teuthology.orchestra.run.smithi161.stdout:2413 trunc from 0xc47f0ad to 0xb23ed9e 2024-09-21T15:08:17.461 INFO:teuthology.orchestra.run.smithi161.stdout:1777 punch from 0x393c9cc to 0x393fa9e, (0x30d2 bytes) 2024-09-21T15:08:17.461 INFO:teuthology.orchestra.run.smithi161.stdout:1778 write 0x7daa8c4 thru 0x7db579e (0xaedb bytes) 2024-09-21T15:08:17.466 INFO:teuthology.orchestra.run.smithi161.stdout:1817 writesame 0x6c091f7 thru 0x6c0d2b0 data_size 0x5(0x40ba bytes) 2024-09-21T15:08:17.466 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.466 INFO:teuthology.orchestra.run.smithi161.stdout:1822 read 0xa8d913a thru 0xa8e4db9 (0xbc80 bytes) 2024-09-21T15:08:17.467 INFO:teuthology.orchestra.run.smithi161.stdout:1824 punch from 0x1c6c0fe to 0x1c76ae0, (0xa9e2 bytes) 2024-09-21T15:08:17.467 INFO:teuthology.orchestra.run.smithi161.stdout:1825 punch from 0xa9d7397 to 0xa9db733, (0x439c bytes) 2024-09-21T15:08:17.467 INFO:teuthology.orchestra.run.smithi161.stdout:1826 read 0x7ce7d26 thru 0x7cef547 (0x7822 bytes) 2024-09-21T15:08:17.468 INFO:teuthology.orchestra.run.smithi161.stdout:1827 write 0x22d3e27 thru 0x22ddee2 (0xa0bc bytes) 2024-09-21T15:08:17.472 INFO:teuthology.orchestra.run.smithi161.stdout:1479 write 0x6fd6481 thru 0x6fe3965 (0xd4e5 bytes) 2024-09-21T15:08:17.476 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.476 INFO:teuthology.orchestra.run.smithi161.stdout:1822 read 0x68f2a3b thru 0x68f2ec2 (0x488 bytes) 2024-09-21T15:08:17.477 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.477 INFO:teuthology.orchestra.run.smithi161.stdout:1826 read 0x5586e0 thru 0x55c65c (0x3f7d bytes) 2024-09-21T15:08:17.477 INFO:teuthology.orchestra.run.smithi161.stdout:1780 read 0x72dee90 thru 0x72ec471 (0xd5e2 bytes) 2024-09-21T15:08:17.477 INFO:teuthology.orchestra.run.smithi161.stdout:1828 read 0x2f072e7 thru 0x2f0eeed (0x7c07 bytes) 2024-09-21T15:08:17.478 INFO:teuthology.orchestra.run.smithi161.stdout:1781 write 0x3a79c08 thru 0x3a869c9 (0xcdc2 bytes) 2024-09-21T15:08:17.478 INFO:teuthology.orchestra.run.smithi161.stdout:1829 write 0x9928d09 thru 0x992ccf2 (0x3fea bytes) 2024-09-21T15:08:17.488 INFO:teuthology.orchestra.run.smithi161.stdout:1830 writesame 0x2d4bd5d thru 0x2d5a547 data_size 0x1(0xe7eb bytes) 2024-09-21T15:08:17.488 INFO:teuthology.orchestra.run.smithi161.stdout:1481 trunc from 0x6fe3966 to 0x703f974 2024-09-21T15:08:17.489 INFO:teuthology.orchestra.run.smithi161.stdout:1829 trunc from 0x6c0d2b1 to 0xbe08c48 2024-09-21T15:08:17.491 INFO:teuthology.orchestra.run.smithi161.stdout:1782 write 0x147364b thru 0x1482e64 (0xf81a bytes) 2024-09-21T15:08:17.523 INFO:teuthology.orchestra.run.smithi161.stdout:1783 write 0xa21fb08 thru 0xa22baf2 (0xbfeb bytes) 2024-09-21T15:08:17.536 INFO:teuthology.orchestra.run.smithi161.stdout:1482 writesame 0x88f6d8 thru 0x894a61 data_size 0x25(0x538a bytes) 2024-09-21T15:08:17.541 INFO:teuthology.orchestra.run.smithi161.stdout:1784 write 0xca70848 thru 0xca755f8 (0x4db1 bytes) 2024-09-21T15:08:17.547 INFO:teuthology.orchestra.run.smithi161.stdout:1830 read 0x4e2f08e thru 0x4e3a1d3 (0xb146 bytes) 2024-09-21T15:08:17.548 INFO:teuthology.orchestra.run.smithi161.stdout:1831 read 0xea9df7 thru 0xeb33c9 (0x95d3 bytes) 2024-09-21T15:08:17.548 INFO:teuthology.orchestra.run.smithi161.stdout:2415 read 0x8636568 thru 0x86394d6 (0x2f6f bytes) 2024-09-21T15:08:17.549 INFO:teuthology.orchestra.run.smithi161.stdout:1832 read 0x7adc6ca thru 0x7ade390 (0x1cc7 bytes) 2024-09-21T15:08:17.549 INFO:teuthology.orchestra.run.smithi161.stdout:2416 read 0x4e46d86 thru 0x4e4eeff (0x817a bytes) 2024-09-21T15:08:17.550 INFO:teuthology.orchestra.run.smithi161.stdout:1833 punch from 0x8bc69df to 0x8bcb30a, (0x492b bytes) 2024-09-21T15:08:17.550 INFO:teuthology.orchestra.run.smithi161.stdout:1836 write 0xaa3ff52 thru 0xaa4de9b (0xdf4a bytes) 2024-09-21T15:08:17.556 INFO:teuthology.orchestra.run.smithi161.stdout:2417 trunc from 0xb23ed9e to 0xdc0f2bf 2024-09-21T15:08:17.556 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.556 INFO:teuthology.orchestra.run.smithi161.stdout:1490 read 0x4e4183b thru 0x4e4c334 (0xaafa bytes) 2024-09-21T15:08:17.556 INFO:teuthology.orchestra.run.smithi161.stdout:1491 read 0x1074df thru 0x11516f (0xdc91 bytes) 2024-09-21T15:08:17.557 INFO:teuthology.orchestra.run.smithi161.stdout:1785 punch from 0xb236317 to 0xb23ae71, (0x4b5a bytes) 2024-09-21T15:08:17.557 INFO:teuthology.orchestra.run.smithi161.stdout:1788 write 0x591d828 thru 0x592c0af (0xe888 bytes) 2024-09-21T15:08:17.557 INFO:teuthology.orchestra.run.smithi161.stdout:1493 read 0x9739f5 thru 0x981935 (0xdf41 bytes) 2024-09-21T15:08:17.557 INFO:teuthology.orchestra.run.smithi161.stdout:1831 trunc from 0xb031b0d to 0x2f22b3c 2024-09-21T15:08:17.558 INFO:teuthology.orchestra.run.smithi161.stdout:1494 write 0x5e5e155 thru 0x5e632b2 (0x515e bytes) 2024-09-21T15:08:17.573 INFO:teuthology.orchestra.run.smithi161.stdout:1837 write 0xab40edb thru 0xab4877f (0x78a5 bytes) 2024-09-21T15:08:17.574 INFO:teuthology.orchestra.run.smithi161.stdout:1790 read 0x2ec83e4 thru 0x2ed0a94 (0x86b1 bytes) 2024-09-21T15:08:17.589 INFO:teuthology.orchestra.run.smithi161.stdout:1838 read 0x7d8025f thru 0x7d8fdd3 (0xfb75 bytes) 2024-09-21T15:08:17.592 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.592 INFO:teuthology.orchestra.run.smithi161.stdout:2419 clone 13 order 25 su 131072 sc 9 2024-09-21T15:08:17.594 INFO:teuthology.orchestra.run.smithi161.stdout:1495 trunc from 0x703f974 to 0xc41a32f 2024-09-21T15:08:17.602 INFO:teuthology.orchestra.run.smithi161.stdout:1832 write 0xf0ca57 thru 0xf0d1e2 (0x78c bytes) 2024-09-21T15:08:17.607 INFO:teuthology.orchestra.run.smithi161.stdout:1833 read 0x68180e thru 0x68447d (0x2c70 bytes) 2024-09-21T15:08:17.609 INFO:teuthology.orchestra.run.smithi161.stdout:1791 write 0xed60b15 thru 0xed6d05f (0xc54b bytes) 2024-09-21T15:08:17.620 INFO:teuthology.orchestra.run.smithi161.stdout:1497 writesame 0x2e24b80 thru 0x2e285a2 data_size 0x3(0x3a23 bytes) 2024-09-21T15:08:17.622 INFO:teuthology.orchestra.run.smithi161.stdout:1839 write 0xed76965 thru 0xed827a4 (0xbe40 bytes) 2024-09-21T15:08:17.632 INFO:teuthology.orchestra.run.smithi161.stdout:1498 read 0x66501cb thru 0x6655c6f (0x5aa5 bytes) 2024-09-21T15:08:17.633 INFO:teuthology.orchestra.run.smithi161.stdout:1502 read 0x2b7b613 thru 0x2b7d699 (0x2087 bytes) 2024-09-21T15:08:17.635 INFO:teuthology.orchestra.run.smithi161.stdout:1840 write 0x9a60dda thru 0x9a68a6b (0x7c92 bytes) 2024-09-21T15:08:17.637 INFO:teuthology.orchestra.run.smithi161.stdout:1792 trunc from 0xed6d060 to 0x5829454 2024-09-21T15:08:17.643 INFO:teuthology.orchestra.run.smithi161.stdout:1504 trunc from 0xc41a32f to 0x7b855ce 2024-09-21T15:08:17.653 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.653 INFO:teuthology.orchestra.run.smithi161.stdout:1842 punch from 0x4249afc to 0x424c179, (0x267d bytes) 2024-09-21T15:08:17.653 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.653 INFO:teuthology.orchestra.run.smithi161.stdout:1844 read 0xe32ce0b thru 0xe3371c6 (0xa3bc bytes) 2024-09-21T15:08:17.674 INFO:teuthology.orchestra.run.smithi161.stdout:1845 trunc from 0xed827a5 to 0x487b9ef 2024-09-21T15:08:17.676 INFO:teuthology.orchestra.run.smithi161.stdout:1836 write 0xc5be215 thru 0xc5cca23 (0xe80f bytes) 2024-09-21T15:08:17.693 INFO:teuthology.orchestra.run.smithi161.stdout:1837 write 0x1c15327 thru 0x1c1fd2a (0xaa04 bytes) 2024-09-21T15:08:17.712 INFO:teuthology.orchestra.run.smithi161.stdout:1838 read 0x1cace47 thru 0x1cbb5c7 (0xe781 bytes) 2024-09-21T15:08:17.720 INFO:teuthology.orchestra.run.smithi161.stdout:1505 punch from 0x1a86841 to 0x1a90ca5, (0xa464 bytes) 2024-09-21T15:08:17.720 INFO:teuthology.orchestra.run.smithi161.stdout:1508 write 0x7191bae thru 0x719365e (0x1ab1 bytes) 2024-09-21T15:08:17.728 INFO:teuthology.orchestra.run.smithi161.stdout:1794 trunc from 0x5829454 to 0x5ce1694 2024-09-21T15:08:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:1839 trunc from 0xc5cca24 to 0x573a861 2024-09-21T15:08:17.735 INFO:teuthology.orchestra.run.smithi161.stdout:1509 read 0x9be69 thru 0xa00da (0x4272 bytes) 2024-09-21T15:08:17.736 INFO:teuthology.orchestra.run.smithi161.stdout:1510 write 0x71a0915 thru 0x71ada0d (0xd0f9 bytes) 2024-09-21T15:08:17.760 INFO:teuthology.orchestra.run.smithi161.stdout:1847 read 0x1118fef thru 0x1128578 (0xf58a bytes) 2024-09-21T15:08:17.761 INFO:teuthology.orchestra.run.smithi161.stdout:1795 read 0x16e6bf1 thru 0x16f63b9 (0xf7c9 bytes) 2024-09-21T15:08:17.761 INFO:teuthology.orchestra.run.smithi161.stdout:1848 read 0x4873ec6 thru 0x487b9ee (0x7b29 bytes) 2024-09-21T15:08:17.761 INFO:teuthology.orchestra.run.smithi161.stdout:1796 read 0x3ee3b16 thru 0x3ee8232 (0x471d bytes) 2024-09-21T15:08:17.761 INFO:teuthology.orchestra.run.smithi161.stdout:1849 read 0x6e9b4d thru 0x6f6dc5 (0xd279 bytes) 2024-09-21T15:08:17.762 INFO:teuthology.orchestra.run.smithi161.stdout:1797 read 0x8e6009 thru 0x8eac86 (0x4c7e bytes) 2024-09-21T15:08:17.763 INFO:teuthology.orchestra.run.smithi161.stdout:1851 punch from 0x47c86b3 to 0x47d0c64, (0x85b1 bytes) 2024-09-21T15:08:17.763 INFO:teuthology.orchestra.run.smithi161.stdout:1853 read 0xe2589d thru 0xe2d0fe (0x7862 bytes) 2024-09-21T15:08:17.763 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.763 INFO:teuthology.orchestra.run.smithi161.stdout:1800 read 0x2d11a71 thru 0x2d1e3f7 (0xc987 bytes) 2024-09-21T15:08:17.763 INFO:teuthology.orchestra.run.smithi161.stdout:1854 read 0x2009d04 thru 0x200b2b9 (0x15b6 bytes) 2024-09-21T15:08:17.764 INFO:teuthology.orchestra.run.smithi161.stdout:1801 read 0x110b5ee thru 0x111a7b2 (0xf1c5 bytes) 2024-09-21T15:08:17.764 INFO:teuthology.orchestra.run.smithi161.stdout:1855 read 0x2757691 thru 0x27615da (0x9f4a bytes) 2024-09-21T15:08:17.764 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.764 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.765 INFO:teuthology.orchestra.run.smithi161.stdout:1858 writesame 0xf80a71 thru 0xf8d571 data_size 0x11(0xcb01 bytes) 2024-09-21T15:08:17.771 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.771 INFO:teuthology.orchestra.run.smithi161.stdout:1843 read 0x50a3ab6 thru 0x50af82a (0xbd75 bytes) 2024-09-21T15:08:17.772 INFO:teuthology.orchestra.run.smithi161.stdout:1845 read 0x4cc1e4 thru 0x4d4d11 (0x8b2e bytes) 2024-09-21T15:08:17.773 INFO:teuthology.orchestra.run.smithi161.stdout:1846 read 0x38a4f90 thru 0x38a8d00 (0x3d71 bytes) 2024-09-21T15:08:17.773 INFO:teuthology.orchestra.run.smithi161.stdout:1847 read 0x5002101 thru 0x50104d4 (0xe3d4 bytes) 2024-09-21T15:08:17.779 INFO:teuthology.orchestra.run.smithi161.stdout:1804 trunc from 0x5ce1694 to 0xeb8dd96 2024-09-21T15:08:17.796 INFO:teuthology.orchestra.run.smithi161.stdout:1511 writesame 0xd75d46a thru 0xd75e3b8 data_size 0x1(0xf4f bytes) 2024-09-21T15:08:17.801 INFO:teuthology.orchestra.run.smithi161.stdout:1848 write 0x6641487 thru 0x664b610 (0xa18a bytes) 2024-09-21T15:08:17.816 INFO:teuthology.orchestra.run.smithi161.stdout:1805 trunc from 0xeb8dd96 to 0xda60973 2024-09-21T15:08:17.823 INFO:teuthology.orchestra.run.smithi161.stdout:1859 write 0xd6379ca thru 0xd63cfb1 (0x55e8 bytes) 2024-09-21T15:08:17.826 INFO:teuthology.orchestra.run.smithi161.stdout:1849 trunc from 0x664b611 to 0x95759 2024-09-21T15:08:17.826 INFO:teuthology.orchestra.run.smithi161.stdout:1512 trunc from 0xd75e3b9 to 0x177845f 2024-09-21T15:08:17.858 INFO:teuthology.orchestra.run.smithi161.stdout:1860 trunc from 0xd63cfb2 to 0x62dbfc5 2024-09-21T15:08:17.866 INFO:teuthology.orchestra.run.smithi161.stdout:1807 punch from 0x33077d1 to 0x330d26d, (0x5a9c bytes) 2024-09-21T15:08:17.867 INFO:teuthology.orchestra.run.smithi161.stdout:1809 write 0x32b9ec6 thru 0x32c910d (0xf248 bytes) 2024-09-21T15:08:17.881 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.881 INFO:teuthology.orchestra.run.smithi161.stdout:1811 read 0x5a952b1 thru 0x5aa3160 (0xdeb0 bytes) 2024-09-21T15:08:17.882 INFO:teuthology.orchestra.run.smithi161.stdout:1812 write 0x6d5bbc8 thru 0x6d5be9e (0x2d7 bytes) 2024-09-21T15:08:17.898 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.898 INFO:teuthology.orchestra.run.smithi161.stdout:1814 read 0xcf2b3e thru 0xcf9c91 (0x7154 bytes) 2024-09-21T15:08:17.899 INFO:teuthology.orchestra.run.smithi161.stdout:1815 punch from 0xd71e874 to 0xd726e69, (0x85f5 bytes) 2024-09-21T15:08:17.899 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.899 INFO:teuthology.orchestra.run.smithi161.stdout:1817 read 0x433c50d thru 0x4346821 (0xa315 bytes) 2024-09-21T15:08:17.909 INFO:teuthology.orchestra.run.smithi161.stdout:1850 read 0x7d789 thru 0x838f2 (0x616a bytes) 2024-09-21T15:08:17.909 INFO:teuthology.orchestra.run.smithi161.stdout:1513 write 0xe51d13 thru 0xe5f706 (0xd9f4 bytes) 2024-09-21T15:08:17.910 INFO:teuthology.orchestra.run.smithi161.stdout:1852 punch from 0x56327 to 0x61880, (0xb559 bytes) 2024-09-21T15:08:17.914 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.2-clone12 intact 2024-09-21T15:08:17.915 INFO:teuthology.orchestra.run.smithi161.stdout:1820 trunc from 0xda60973 to 0x7ae89a7 2024-09-21T15:08:17.916 INFO:teuthology.orchestra.run.smithi161.stdout:1516 punch from 0x4266ff to 0x42b61d, (0x4f1e bytes) 2024-09-21T15:08:17.916 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.917 INFO:teuthology.orchestra.run.smithi161.stdout:1518 read 0x120687a thru 0x1215b6e (0xf2f5 bytes) 2024-09-21T15:08:17.917 INFO:teuthology.orchestra.run.smithi161.stdout:1519 punch from 0x1485e52 to 0x148ece3, (0x8e91 bytes) 2024-09-21T15:08:17.917 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:17.917 INFO:teuthology.orchestra.run.smithi161.stdout:1521 read 0x334794 thru 0x3435ba (0xee27 bytes) 2024-09-21T15:08:17.917 INFO:teuthology.orchestra.run.smithi161.stdout:1522 read 0x76a7ee thru 0x7727f2 (0x8005 bytes) 2024-09-21T15:08:17.934 INFO:teuthology.orchestra.run.smithi161.stdout:1853 write 0x1bddc72 thru 0x1bde3a1 (0x730 bytes) 2024-09-21T15:08:17.951 INFO:teuthology.orchestra.run.smithi161.stdout:1861 write 0xb78904a thru 0xb78c1c3 (0x317a bytes) 2024-09-21T15:08:17.955 INFO:teuthology.orchestra.run.smithi161.stdout:1821 trunc from 0x7ae89a7 to 0x5ce0958 2024-09-21T15:08:17.957 INFO:teuthology.orchestra.run.smithi161.stdout:1523 writesame 0x3f54ddf thru 0x3f5dd3e data_size 0x25(0x8f60 bytes) 2024-09-21T15:08:17.957 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone12 from 0xe7eae91 (overlap 0x8d32ab6) to 0x1c3d557 2024-09-21T15:08:17.971 INFO:teuthology.orchestra.run.smithi161.stdout:1862 write 0x1f2c899 thru 0x1f2f0fe (0x2866 bytes) 2024-09-21T15:08:17.987 INFO:teuthology.orchestra.run.smithi161.stdout:1863 punch from 0x143a501 to 0x144958a, (0xf089 bytes) 2024-09-21T15:08:17.987 INFO:teuthology.orchestra.run.smithi161.stdout:1864 write 0xc8c0fd thru 0xc93ff0 (0x7ef4 bytes) 2024-09-21T15:08:18.006 INFO:teuthology.orchestra.run.smithi161.stdout:1865 punch from 0x1d75281 to 0x1d78062, (0x2de1 bytes) 2024-09-21T15:08:18.006 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:18.006 INFO:teuthology.orchestra.run.smithi161.stdout:1868 read 0xaf8cd50 thru 0xaf96cb5 (0x9f66 bytes) 2024-09-21T15:08:18.017 INFO:teuthology.orchestra.run.smithi161.stdout:1855 write 0x96b4014 thru 0x96b5588 (0x1575 bytes) 2024-09-21T15:08:18.023 INFO:teuthology.orchestra.run.smithi161.stdout:1869 trunc from 0xb78c1c4 to 0x338d71f 2024-09-21T15:08:18.036 INFO:teuthology.orchestra.run.smithi161.stdout:1524 write 0x4c3f010 thru 0x4c47c41 (0x8c32 bytes) 2024-09-21T15:08:18.037 INFO:teuthology.orchestra.run.smithi161.stdout:1823 punch from 0xad6ea8 to 0xae5e5c, (0xefb4 bytes) 2024-09-21T15:08:18.037 INFO:teuthology.orchestra.run.smithi161.stdout:1825 writesame 0x4fd8413 thru 0x4fdf59f data_size 0x1(0x718d bytes) 2024-09-21T15:08:18.038 INFO:teuthology.orchestra.run.smithi161.stdout:1856 writesame 0x3677abb thru 0x3681106 data_size 0x2(0x964c bytes) 2024-09-21T15:08:18.063 INFO:teuthology.orchestra.run.smithi161.stdout:1526 punch from 0x669428 to 0x66a68d, (0x1265 bytes) 2024-09-21T15:08:18.066 INFO:teuthology.orchestra.run.smithi161.stdout:1857 writesame 0x2793296 thru 0x27a2778 data_size 0x1(0xf4e3 bytes) 2024-09-21T15:08:18.070 INFO:teuthology.orchestra.run.smithi161.stdout:1826 read 0x3698333 thru 0x36a7331 (0xefff bytes) 2024-09-21T15:08:18.072 INFO:teuthology.orchestra.run.smithi161.stdout:1827 read 0x4eac880 thru 0x4eb1571 (0x4cf2 bytes) 2024-09-21T15:08:18.073 INFO:teuthology.orchestra.run.smithi161.stdout:1828 read 0x4a4d41 thru 0x4b4cc4 (0xff84 bytes) 2024-09-21T15:08:18.076 INFO:teuthology.orchestra.run.smithi161.stdout:1829 trunc from 0x5ce0958 to 0x4db7efd 2024-09-21T15:08:18.080 INFO:teuthology.orchestra.run.smithi161.stdout:1527 trunc from 0x4c47c42 to 0xdcc605a 2024-09-21T15:08:18.121 INFO:teuthology.orchestra.run.smithi161.stdout:1858 read 0x33f96e6 thru 0x3405ba3 (0xc4be bytes) 2024-09-21T15:08:18.122 INFO:teuthology.orchestra.run.smithi161.stdout:1859 trunc from 0x96b5589 to 0x9497339 2024-09-21T15:08:18.131 INFO:teuthology.orchestra.run.smithi161.stdout:1870 punch from 0x153ac9b to 0x153e755, (0x3aba bytes) 2024-09-21T15:08:18.132 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:18.132 INFO:teuthology.orchestra.run.smithi161.stdout:1831 write 0x2f8277f thru 0x2f8d9a8 (0xb22a bytes) 2024-09-21T15:08:18.141 INFO:teuthology.orchestra.run.smithi161.stdout:1528 read 0xb26dfb4 thru 0xb271045 (0x3092 bytes) 2024-09-21T15:08:18.141 INFO:teuthology.orchestra.run.smithi161.stdout:1530 read 0xdc59ff2 thru 0xdc6324e (0x925d bytes) 2024-09-21T15:08:18.141 INFO:teuthology.orchestra.run.smithi161.stdout:1531 punch from 0x156a5e7 to 0x15787de, (0xe1f7 bytes) 2024-09-21T15:08:18.141 INFO:teuthology.orchestra.run.smithi161.stdout:1534 write 0x5c18fe3 thru 0x5c25b8c (0xcbaa bytes) 2024-09-21T15:08:18.145 INFO:teuthology.orchestra.run.smithi161.stdout:1833 write 0x22af410 thru 0x22b3d8b (0x497c bytes) 2024-09-21T15:08:18.163 INFO:teuthology.orchestra.run.smithi161.stdout:1535 write 0x3a19245 thru 0x3a19c7f (0xa3b bytes) 2024-09-21T15:08:18.168 INFO:teuthology.orchestra.run.smithi161.stdout:1860 punch from 0x3e9b325 to 0x3ea0f9a, (0x5c75 bytes) 2024-09-21T15:08:18.169 INFO:teuthology.orchestra.run.smithi161.stdout:1862 write 0x551a351 thru 0x552901c (0xeccc bytes) 2024-09-21T15:08:18.172 INFO:teuthology.orchestra.run.smithi161.stdout:1536 punch from 0x6d47b40 to 0x6d4d42b, (0x58eb bytes) 2024-09-21T15:08:18.172 INFO:teuthology.orchestra.run.smithi161.stdout:1537 write 0x4abe0f thru 0x4b5a67 (0x9c59 bytes) 2024-09-21T15:08:18.180 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #11, image image_cluster1.client.mirror.2-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent12 2024-09-21T15:08:18.180 INFO:teuthology.orchestra.run.smithi161.stdout:1873 write 0x4f367ce thru 0x4f3d9d8 (0x720b bytes) 2024-09-21T15:08:18.189 INFO:teuthology.orchestra.run.smithi161.stdout:1538 punch from 0x4543608 to 0x454fab4, (0xc4ac bytes) 2024-09-21T15:08:18.189 INFO:teuthology.orchestra.run.smithi161.stdout:1539 writesame 0xdac7f97 thru 0xdacb6c7 data_size 0x1(0x3731 bytes) 2024-09-21T15:08:18.192 INFO:teuthology.orchestra.run.smithi161.stdout:1863 writesame 0x84cdbb5 thru 0x84da2c2 data_size 0x95(0xc70e bytes) 2024-09-21T15:08:18.193 INFO:teuthology.orchestra.run.smithi161.stdout:1874 read 0x27a2f92 thru 0x27a7a9b (0x4b0a bytes) 2024-09-21T15:08:18.194 INFO:teuthology.orchestra.run.smithi161.stdout:1875 read 0x1bec6e0 thru 0x1bf2a2d (0x634e bytes) 2024-09-21T15:08:18.195 INFO:teuthology.orchestra.run.smithi161.stdout:1877 write 0x105a5f6 thru 0x10611a4 (0x6baf bytes) 2024-09-21T15:08:18.207 INFO:teuthology.orchestra.run.smithi161.stdout:1878 read 0x3cd2a thru 0x46b8a (0x9e61 bytes) 2024-09-21T15:08:18.207 INFO:teuthology.orchestra.run.smithi161.stdout:1540 writesame 0x9e1cacb thru 0x9e25b86 data_size 0x4(0x90bc bytes) 2024-09-21T15:08:18.209 INFO:teuthology.orchestra.run.smithi161.stdout:1864 trunc from 0x9497339 to 0x64566c1 2024-09-21T15:08:18.213 INFO:teuthology.orchestra.run.smithi161.stdout:1837 writesame 0x6984d74 thru 0x698d565 data_size 0x1(0x87f2 bytes) 2024-09-21T15:08:18.219 INFO:teuthology.orchestra.run.smithi161.stdout:1544 write 0x2546038 thru 0x254ca25 (0x69ee bytes) 2024-09-21T15:08:18.237 INFO:teuthology.orchestra.run.smithi161.stdout:1545 write 0x7dba3f6 thru 0x7dbe05a (0x3c65 bytes) 2024-09-21T15:08:18.243 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:18.249 INFO:teuthology.orchestra.run.smithi161.stdout:1546 write 0x87ddade thru 0x87ddc96 (0x1b9 bytes) 2024-09-21T15:08:18.256 INFO:teuthology.orchestra.run.smithi161.stdout:1879 writesame 0x88270b1 thru 0x8829173 data_size 0x1(0x20c3 bytes) 2024-09-21T15:08:18.257 INFO:teuthology.orchestra.run.smithi161.stdout:1866 trunc from 0x64566c1 to 0xe5e12dd 2024-09-21T15:08:18.257 INFO:teuthology.orchestra.run.smithi161.stdout:1838 write 0x8cf5992 thru 0x8cf7a2e (0x209d bytes) 2024-09-21T15:08:18.274 INFO:teuthology.orchestra.run.smithi161.stdout:1841 read 0x3a15507 thru 0x3a1e408 (0x8f02 bytes) 2024-09-21T15:08:18.275 INFO:teuthology.orchestra.run.smithi161.stdout:1842 read 0x6fcf8bd thru 0x6fd6b86 (0x72ca bytes) 2024-09-21T15:08:18.275 INFO:teuthology.orchestra.run.smithi161.stdout:1843 read 0x17ab50d thru 0x17b96ec (0xe1e0 bytes) 2024-09-21T15:08:18.276 INFO:teuthology.orchestra.run.smithi161.stdout:1845 read 0x50be716 thru 0x50c6c4d (0x8538 bytes) 2024-09-21T15:08:18.276 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:18.279 INFO:teuthology.orchestra.run.smithi161.stdout:1548 trunc from 0xdcc605a to 0x3b1e7e3 2024-09-21T15:08:18.282 INFO:teuthology.orchestra.run.smithi161.stdout:1847 trunc from 0x8cf7a2f to 0xc5542a3 2024-09-21T15:08:18.285 INFO:teuthology.orchestra.run.smithi161.stdout:1867 write 0xc204ebd thru 0xc20ca21 (0x7b65 bytes) 2024-09-21T15:08:18.288 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #11, image image_cluster1.client.mirror.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent12 2024-09-21T15:08:18.304 INFO:teuthology.orchestra.run.smithi161.stdout:1868 read 0xa9babab thru 0xa9c5df0 (0xb246 bytes) 2024-09-21T15:08:18.304 INFO:teuthology.orchestra.run.smithi161.stdout:1869 read 0x85426aa thru 0x8548bc8 (0x651f bytes) 2024-09-21T15:08:18.305 INFO:teuthology.orchestra.run.smithi161.stdout:1870 write 0xbbab52f thru 0xbbaf0bd (0x3b8f bytes) 2024-09-21T15:08:18.309 INFO:teuthology.orchestra.run.smithi161.stdout:1881 write 0xbe68ef8 thru 0xbe75612 (0xc71b bytes) 2024-09-21T15:08:18.321 INFO:teuthology.orchestra.run.smithi161.stdout:1871 clone 16 order 19 su 16384 sc 9 2024-09-21T15:08:18.329 INFO:teuthology.orchestra.run.smithi161.stdout:1883 write 0x9659f74 thru 0x9661589 (0x7616 bytes) 2024-09-21T15:08:18.335 INFO:teuthology.orchestra.run.smithi161.stdout:1848 read 0x6843d99 thru 0x684ae85 (0x70ed bytes) 2024-09-21T15:08:18.335 INFO:teuthology.orchestra.run.smithi161.stdout:1849 read 0x43cf1b1 thru 0x43d6538 (0x7388 bytes) 2024-09-21T15:08:18.337 INFO:teuthology.orchestra.run.smithi161.stdout:1850 read 0x9547bbc thru 0x9549b5c (0x1fa1 bytes) 2024-09-21T15:08:18.337 INFO:teuthology.orchestra.run.smithi161.stdout:1852 read 0xa5ec519 thru 0xa5f6d88 (0xa870 bytes) 2024-09-21T15:08:18.337 INFO:teuthology.orchestra.run.smithi161.stdout:1853 write 0x65300f7 thru 0x6533144 (0x304e bytes) 2024-09-21T15:08:18.346 INFO:teuthology.orchestra.run.smithi161.stdout:1885 write 0x3cc125f thru 0x3cc52ee (0x4090 bytes) 2024-09-21T15:08:18.351 INFO:teuthology.orchestra.run.smithi161.stdout:1856 read 0x4212fa5 thru 0x4218a6e (0x5aca bytes) 2024-09-21T15:08:18.352 INFO:teuthology.orchestra.run.smithi161.stdout:1886 read 0x42adadc thru 0x42b3d19 (0x623e bytes) 2024-09-21T15:08:18.352 INFO:teuthology.orchestra.run.smithi161.stdout:1857 clone 15 order 25 su 524288 sc 7 2024-09-21T15:08:18.383 INFO:teuthology.orchestra.run.smithi161.stdout:1887 write 0xcc961a3 thru 0xcc9d7cd (0x762b bytes) 2024-09-21T15:08:18.399 INFO:teuthology.orchestra.run.smithi161.stdout:1549 write 0xd6de663 thru 0xd6eba38 (0xd3d6 bytes) 2024-09-21T15:08:18.414 INFO:teuthology.orchestra.run.smithi161.stdout:1550 punch from 0x36acbef to 0x36b08a4, (0x3cb5 bytes) 2024-09-21T15:08:18.414 INFO:teuthology.orchestra.run.smithi161.stdout:1551 write 0x23426d6 thru 0x2351bbe (0xf4e9 bytes) 2024-09-21T15:08:18.418 INFO:teuthology.orchestra.run.smithi161.stdout:1890 trunc from 0xcc9d7ce to 0xa9643d 2024-09-21T15:08:18.436 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:18.436 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:18.436 INFO:teuthology.orchestra.run.smithi161.stdout:2084 write 0xab18416 thru 0xab27e62 (0xfa4d bytes) 2024-09-21T15:08:18.476 INFO:teuthology.orchestra.run.smithi161.stdout:1554 write 0xdb6d212 thru 0xdb6ec9a (0x1a89 bytes) 2024-09-21T15:08:18.492 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:18.492 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:18.492 INFO:teuthology.orchestra.run.smithi161.stdout:1559 punch from 0xb78b31e to 0xb78ea1a, (0x36fc bytes) 2024-09-21T15:08:18.492 INFO:teuthology.orchestra.run.smithi161.stdout:1560 write 0xb016f0c thru 0xb01ce04 (0x5ef9 bytes) 2024-09-21T15:08:18.507 INFO:teuthology.orchestra.run.smithi161.stdout:1892 trunc from 0xa9643d to 0xd6f0bc0 2024-09-21T15:08:18.509 INFO:teuthology.orchestra.run.smithi161.stdout:1561 trunc from 0xdb6ec9b to 0xc3fba2b 2024-09-21T15:08:18.511 INFO:teuthology.orchestra.run.smithi161.stdout:2086 trunc from 0xe7eae91 to 0xbc8a9d5 2024-09-21T15:08:18.558 INFO:teuthology.orchestra.run.smithi161.stdout:1893 trunc from 0xd6f0bc0 to 0x38f61dc 2024-09-21T15:08:18.559 INFO:teuthology.orchestra.run.smithi161.stdout:1564 write 0x1d2e155 thru 0x1d3db54 (0xfa00 bytes) 2024-09-21T15:08:18.593 INFO:teuthology.orchestra.run.smithi161.stdout:1895 read 0x319d483 thru 0x31acc45 (0xf7c3 bytes) 2024-09-21T15:08:18.594 INFO:teuthology.orchestra.run.smithi161.stdout:1896 writesame 0x27f8cd2 thru 0x27fcf60 data_size 0x1(0x428f bytes) 2024-09-21T15:08:18.616 INFO:teuthology.orchestra.run.smithi161.stdout:2087 trunc from 0xbc8a9d5 to 0xa743f49 2024-09-21T15:08:18.621 INFO:teuthology.orchestra.run.smithi161.stdout:1565 writesame 0xeda46e7 thru 0xeda6c3b data_size 0x1(0x2555 bytes) 2024-09-21T15:08:18.624 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.7576757350558416) > weight (0.25) 2024-09-21T15:08:18.624 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.1 2024-09-21T15:08:18.624 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Sent signal 15 2024-09-21T15:08:18.625 INFO:tasks.rbd_mirror_thrash:waiting for 4 secs before reviving daemons 2024-09-21T15:08:18.626 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:08:18.625+0000 7f601eb64700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 (PID: 24775) UID: 1000 2024-09-21T15:08:18.626 INFO:teuthology.orchestra.run.smithi161.stdout:1566 punch from 0xc52417d to 0xc528039, (0x3ebc bytes) 2024-09-21T15:08:18.627 INFO:teuthology.orchestra.run.smithi161.stdout:1568 writesame 0x363e522 thru 0x364da32 data_size 0x1(0xf511 bytes) 2024-09-21T15:08:18.637 INFO:teuthology.orchestra.run.smithi161.stdout:2420 trunc from 0xdc0f2bf to 0x9bf7ed2 2024-09-21T15:08:18.684 INFO:teuthology.orchestra.run.smithi161.stdout:1898 write 0x3b866eb thru 0x3b8aef7 (0x480d bytes) 2024-09-21T15:08:18.685 INFO:teuthology.orchestra.run.smithi161.stdout:1569 write 0x2004c95 thru 0x2012f41 (0xe2ad bytes) 2024-09-21T15:08:18.710 INFO:teuthology.orchestra.run.smithi161.stdout:1899 punch from 0x6345d8 to 0x63cb91, (0x85b9 bytes) 2024-09-21T15:08:18.783 INFO:teuthology.orchestra.run.smithi161.stdout:1570 read 0x5c5b22c thru 0x5c5d62d (0x2402 bytes) 2024-09-21T15:08:18.784 INFO:teuthology.orchestra.run.smithi161.stdout:1571 read 0x8fd202e thru 0x8fde145 (0xc118 bytes) 2024-09-21T15:08:18.784 INFO:teuthology.orchestra.run.smithi161.stdout:1574 read 0x52b2e7e thru 0x52b54ce (0x2651 bytes) 2024-09-21T15:08:18.785 INFO:teuthology.orchestra.run.smithi161.stdout:1577 read 0x61b0cf1 thru 0x61bd5a1 (0xc8b1 bytes) 2024-09-21T15:08:18.785 INFO:teuthology.orchestra.run.smithi161.stdout:1578 writesame 0x4060d01 thru 0x4061643 data_size 0x1(0x943 bytes) 2024-09-21T15:08:18.836 INFO:teuthology.orchestra.run.smithi161.stdout:1900 write 0x4c703da thru 0x4c7d181 (0xcda8 bytes) 2024-09-21T15:08:18.852 INFO:teuthology.orchestra.run.smithi161.stdout:1579 trunc from 0xeda6c3c to 0x3002d62 2024-09-21T15:08:18.882 INFO:teuthology.orchestra.run.smithi161.stdout:2088 punch from 0x55934ec to 0x559bd70, (0x8884 bytes) 2024-09-21T15:08:18.914 INFO:teuthology.orchestra.run.smithi161.stdout:1902 trunc from 0x4c7d182 to 0x6bf272a 2024-09-21T15:08:18.969 INFO:teuthology.orchestra.run.smithi161.stdout:1903 read 0x1fec1c6 thru 0x1ff270d (0x6548 bytes) 2024-09-21T15:08:18.971 INFO:teuthology.orchestra.run.smithi161.stdout:1904 read 0x1b204f4 thru 0x1b2908a (0x8b97 bytes) 2024-09-21T15:08:18.982 INFO:teuthology.orchestra.run.smithi161.stdout:2089 write 0xe911c15 thru 0xe91d9a6 (0xbd92 bytes) 2024-09-21T15:08:18.991 INFO:teuthology.orchestra.run.smithi161.stdout:1580 read 0x1ce0076 thru 0x1ce745c (0x73e7 bytes) 2024-09-21T15:08:19.063 INFO:teuthology.orchestra.run.smithi161.stdout:2090 writesame 0x35139bf thru 0x351c633 data_size 0x1(0x8c75 bytes) 2024-09-21T15:08:19.064 INFO:teuthology.orchestra.run.smithi161.stdout:1907 write 0x6f94c1b thru 0x6fa33f7 (0xe7dd bytes) 2024-09-21T15:08:19.122 INFO:teuthology.orchestra.run.smithi161.stdout:1908 read 0x9f3867 thru 0x9f920f (0x59a9 bytes) 2024-09-21T15:08:19.138 INFO:teuthology.orchestra.run.smithi161.stdout:1909 trunc from 0x6fa33f8 to 0xe432069 2024-09-21T15:08:19.140 INFO:teuthology.orchestra.run.smithi161.stdout:1581 write 0xec490a4 thru 0xec516ca (0x8627 bytes) 2024-09-21T15:08:19.165 INFO:teuthology.orchestra.run.smithi161.stdout:1582 read 0xd6b12be thru 0xd6be75b (0xd49e bytes) 2024-09-21T15:08:19.166 INFO:teuthology.orchestra.run.smithi161.stdout:1583 write 0x84d9bab thru 0x84e2707 (0x8b5d bytes) 2024-09-21T15:08:19.174 INFO:teuthology.orchestra.run.smithi161.stdout:1587 punch from 0xb2a44ac to 0xb2aa778, (0x62cc bytes) 2024-09-21T15:08:19.174 INFO:teuthology.orchestra.run.smithi161.stdout:1589 writesame 0x11467e9 thru 0x11536b6 data_size 0x2(0xcece bytes) 2024-09-21T15:08:19.176 INFO:teuthology.orchestra.run.smithi161.stdout:1911 write 0x915d0d9 thru 0x915d346 (0x26e bytes) 2024-09-21T15:08:19.188 INFO:teuthology.orchestra.run.smithi161.stdout:1913 punch from 0x7b15b39 to 0x7b1961e, (0x3ae5 bytes) 2024-09-21T15:08:19.188 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.188 INFO:teuthology.orchestra.run.smithi161.stdout:1915 read 0xa0b471c thru 0xa0c4017 (0xf8fc bytes) 2024-09-21T15:08:19.188 INFO:teuthology.orchestra.run.smithi161.stdout:1916 read 0x94dd71e thru 0x94e6105 (0x89e8 bytes) 2024-09-21T15:08:19.188 INFO:teuthology.orchestra.run.smithi161.stdout:1917 write 0xf6d367 thru 0xf7318d (0x5e27 bytes) 2024-09-21T15:08:19.203 INFO:teuthology.orchestra.run.smithi161.stdout:1591 write 0x3ef1284 thru 0x3efeb6c (0xd8e9 bytes) 2024-09-21T15:08:19.215 INFO:teuthology.orchestra.run.smithi161.stdout:1919 read 0x165f98e thru 0x166c47a (0xcaed bytes) 2024-09-21T15:08:19.216 INFO:teuthology.orchestra.run.smithi161.stdout:1920 punch from 0x8f551bf to 0x8f5922d, (0x406e bytes) 2024-09-21T15:08:19.216 INFO:teuthology.orchestra.run.smithi161.stdout:1921 write 0x999326b thru 0x999a13e (0x6ed4 bytes) 2024-09-21T15:08:19.220 INFO:teuthology.orchestra.run.smithi161.stdout:1592 read 0x60812e6 thru 0x60881a0 (0x6ebb bytes) 2024-09-21T15:08:19.221 INFO:teuthology.orchestra.run.smithi161.stdout:1593 writesame 0x9e90596 thru 0x9e9824b data_size 0x33(0x7cb6 bytes) 2024-09-21T15:08:19.235 INFO:teuthology.orchestra.run.smithi161.stdout:1595 write 0x5c3b584 thru 0x5c3d85e (0x22db bytes) 2024-09-21T15:08:19.235 INFO:teuthology.orchestra.run.smithi161.stdout:1922 write 0x7dc178c thru 0x7dce143 (0xc9b8 bytes) 2024-09-21T15:08:19.248 INFO:teuthology.orchestra.run.smithi161.stdout:2421 write 0xb64e4b7 thru 0xb65c6c1 (0xe20b bytes) 2024-09-21T15:08:19.256 INFO:teuthology.orchestra.run.smithi161.stdout:1596 read 0x44174ab thru 0x4421e97 (0xa9ed bytes) 2024-09-21T15:08:19.258 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.258 INFO:teuthology.orchestra.run.smithi161.stdout:1600 punch from 0x195227f to 0x195601a, (0x3d9b bytes) 2024-09-21T15:08:19.258 INFO:teuthology.orchestra.run.smithi161.stdout:1602 read 0x9eca575 thru 0x9ed3f69 (0x99f5 bytes) 2024-09-21T15:08:19.258 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.259 INFO:teuthology.orchestra.run.smithi161.stdout:1604 read 0xd54baf0 thru 0xd55aca3 (0xf1b4 bytes) 2024-09-21T15:08:19.265 INFO:teuthology.orchestra.run.smithi161.stdout:1923 writesame 0x1c087d5 thru 0x1c12ed0 data_size 0x2(0xa6fc bytes) 2024-09-21T15:08:19.269 INFO:teuthology.orchestra.run.smithi161.stdout:2422 writesame 0x73b148 thru 0x74af9c data_size 0xb(0xfe55 bytes) 2024-09-21T15:08:19.271 INFO:teuthology.orchestra.run.smithi161.stdout:2092 punch from 0xc9e3797 to 0xc9e4839, (0x10a2 bytes) 2024-09-21T15:08:19.271 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.271 INFO:teuthology.orchestra.run.smithi161.stdout:2094 read 0xdc349f0 thru 0xdc43ebe (0xf4cf bytes) 2024-09-21T15:08:19.278 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.5-clone14 intact 2024-09-21T15:08:19.283 INFO:teuthology.orchestra.run.smithi161.stdout:2425 write 0x6b3f30c thru 0x6b3f666 (0x35b bytes) 2024-09-21T15:08:19.287 INFO:teuthology.orchestra.run.smithi161.stdout:1926 write 0x84ee931 thru 0x84f0011 (0x16e1 bytes) 2024-09-21T15:08:19.290 INFO:teuthology.orchestra.run.smithi161.stdout:2427 read 0x3315070 thru 0x3322c89 (0xdc1a bytes) 2024-09-21T15:08:19.291 INFO:teuthology.orchestra.run.smithi161.stdout:1605 trunc from 0xec516cb to 0x52d4af6 2024-09-21T15:08:19.291 INFO:teuthology.orchestra.run.smithi161.stdout:2428 writesame 0x6c7ddcb thru 0x6c8663a data_size 0x8(0x8870 bytes) 2024-09-21T15:08:19.297 INFO:teuthology.orchestra.run.smithi161.stdout:1928 writesame 0xc20053c thru 0xc20dffd data_size 0x1(0xdac2 bytes) 2024-09-21T15:08:19.303 INFO:teuthology.orchestra.run.smithi161.stdout:2096 trunc from 0xe91d9a7 to 0x117f18e 2024-09-21T15:08:19.307 INFO:teuthology.orchestra.run.smithi161.stdout:2429 read 0x703f60 thru 0x70b947 (0x79e8 bytes) 2024-09-21T15:08:19.309 INFO:teuthology.orchestra.run.smithi161.stdout:2430 read 0x6b4e278 thru 0x6b51561 (0x32ea bytes) 2024-09-21T15:08:19.311 INFO:teuthology.orchestra.run.smithi161.stdout:2432 write 0x80e924c thru 0x80f3e35 (0xabea bytes) 2024-09-21T15:08:19.352 INFO:teuthology.orchestra.run.smithi161.stdout:1929 writesame 0x4600447 thru 0x460cbca data_size 0x4(0xc784 bytes) 2024-09-21T15:08:19.357 INFO:teuthology.orchestra.run.smithi161.stdout:2433 trunc from 0xb65c6c2 to 0x2a2f364 2024-09-21T15:08:19.368 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.368 INFO:teuthology.orchestra.run.smithi161.stdout:1932 writesame 0x66a0d11 thru 0x66af417 data_size 0x47(0xe707 bytes) 2024-09-21T15:08:19.378 INFO:teuthology.orchestra.run.smithi161.stdout:1933 trunc from 0xe432069 to 0xcb3b73a 2024-09-21T15:08:19.441 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.4-clone15 intact 2024-09-21T15:08:19.459 INFO:teuthology.orchestra.run.smithi161.stdout:1938 read 0x471a8c8 thru 0x472896f (0xe0a8 bytes) 2024-09-21T15:08:19.464 INFO:teuthology.orchestra.run.smithi161.stdout:1939 trunc from 0xcb3b73a to 0xe8800ca 2024-09-21T15:08:19.472 INFO:teuthology.orchestra.run.smithi161.stdout:2434 read 0xc2e33 thru 0xd29cf (0xfb9d bytes) 2024-09-21T15:08:19.473 INFO:teuthology.orchestra.run.smithi161.stdout:2435 punch from 0x249534f to 0x249ac97, (0x5948 bytes) 2024-09-21T15:08:19.473 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.473 INFO:teuthology.orchestra.run.smithi161.stdout:2440 trunc from 0x2a2f364 to 0x2ca7c27 2024-09-21T15:08:19.488 INFO:teuthology.orchestra.run.smithi161.stdout:1940 read 0x7be021e thru 0x7be764e (0x7431 bytes) 2024-09-21T15:08:19.489 INFO:teuthology.orchestra.run.smithi161.stdout:1942 read 0x6f73086 thru 0x6f7b62d (0x85a8 bytes) 2024-09-21T15:08:19.490 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.490 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.490 INFO:teuthology.orchestra.run.smithi161.stdout:1947 write 0x1cf8648 thru 0x1d00dc5 (0x877e bytes) 2024-09-21T15:08:19.511 INFO:teuthology.orchestra.run.smithi161.stdout:1948 writesame 0xf2c2ea thru 0xf2dcb3 data_size 0x2(0x19ca bytes) 2024-09-21T15:08:19.522 INFO:teuthology.orchestra.run.smithi161.stdout:2441 read 0x11eec80 thru 0x11f5fa4 (0x7325 bytes) 2024-09-21T15:08:19.523 INFO:teuthology.orchestra.run.smithi161.stdout:2442 read 0x20f77f9 thru 0x20fe9e9 (0x71f1 bytes) 2024-09-21T15:08:19.524 INFO:teuthology.orchestra.run.smithi161.stdout:1950 writesame 0x9b5efc5 thru 0x9b67243 data_size 0x1(0x827f bytes) 2024-09-21T15:08:19.525 INFO:teuthology.orchestra.run.smithi161.stdout:2443 punch from 0x10724d5 to 0x1076516, (0x4041 bytes) 2024-09-21T15:08:19.525 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.525 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.525 INFO:teuthology.orchestra.run.smithi161.stdout:2448 punch from 0xe355fd to 0xe38faf, (0x39b2 bytes) 2024-09-21T15:08:19.525 INFO:teuthology.orchestra.run.smithi161.stdout:2450 read 0x69880f thru 0x6990c6 (0x8b8 bytes) 2024-09-21T15:08:19.541 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.542 INFO:teuthology.orchestra.run.smithi161.stdout:1606 write 0x59339cf thru 0x5941740 (0xdd72 bytes) 2024-09-21T15:08:19.549 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #13, image image_cluster1.client.mirror.5-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent14 2024-09-21T15:08:19.557 INFO:teuthology.orchestra.run.smithi161.stdout:2100 trunc from 0x117f18e to 0xad520eb 2024-09-21T15:08:19.559 INFO:teuthology.orchestra.run.smithi161.stdout:1951 writesame 0x1a0329d thru 0x1a093de data_size 0x3b(0x6142 bytes) 2024-09-21T15:08:19.574 INFO:teuthology.orchestra.run.smithi161.stdout:1952 trunc from 0xe8800ca to 0xd41aa80 2024-09-21T15:08:19.574 INFO:teuthology.orchestra.run.smithi161.stdout:2451 writesame 0x8805d0a thru 0x8806cbd data_size 0x14(0xfb4 bytes) 2024-09-21T15:08:19.579 INFO:teuthology.orchestra.run.smithi161.stdout:1607 trunc from 0x5941741 to 0xc65619d 2024-09-21T15:08:19.579 INFO:teuthology.orchestra.run.smithi161.stdout:2101 writesame 0x3386d29 thru 0x33964eb data_size 0x77(0xf7c3 bytes) 2024-09-21T15:08:19.581 INFO:teuthology.orchestra.run.smithi161.stdout:2452 read 0x2db8147 thru 0x2dba09c (0x1f56 bytes) 2024-09-21T15:08:19.596 INFO:teuthology.orchestra.run.smithi161.stdout:2102 writesame 0x6d5db15 thru 0x6d60e3a data_size 0x1(0x3326 bytes) 2024-09-21T15:08:19.598 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.599 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.599 INFO:teuthology.orchestra.run.smithi161.stdout:1860 writesame 0x9e7ab8c thru 0x9e7edda data_size 0x23(0x424f bytes) 2024-09-21T15:08:19.620 INFO:teuthology.orchestra.run.smithi161.stdout:2103 write 0x716da7 thru 0x71f144 (0x839e bytes) 2024-09-21T15:08:19.623 INFO:teuthology.orchestra.run.smithi161.stdout:1953 write 0x34d98d8 thru 0x34e91df (0xf908 bytes) 2024-09-21T15:08:19.629 INFO:teuthology.orchestra.run.smithi161.stdout:1608 write 0x3b7df99 thru 0x3b88e9f (0xaf07 bytes) 2024-09-21T15:08:19.631 INFO:teuthology.orchestra.run.smithi161.stdout:2453 write 0x88916e5 thru 0x8898361 (0x6c7d bytes) 2024-09-21T15:08:19.638 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.641 INFO:teuthology.orchestra.run.smithi161.stdout:1609 read 0x53427e9 thru 0x534f3fb (0xcc13 bytes) 2024-09-21T15:08:19.643 INFO:teuthology.orchestra.run.smithi161.stdout:1611 read 0x4734997 thru 0x47389b0 (0x401a bytes) 2024-09-21T15:08:19.644 INFO:teuthology.orchestra.run.smithi161.stdout:2454 read 0x4834479 thru 0x48374e1 (0x3069 bytes) 2024-09-21T15:08:19.645 INFO:teuthology.orchestra.run.smithi161.stdout:1612 read 0xadc7396 thru 0xadd64e7 (0xf152 bytes) 2024-09-21T15:08:19.645 INFO:teuthology.orchestra.run.smithi161.stdout:2455 read 0x53944b8 thru 0x539a4ad (0x5ff6 bytes) 2024-09-21T15:08:19.645 INFO:teuthology.orchestra.run.smithi161.stdout:2456 read 0x55a14cb thru 0x55b090c (0xf442 bytes) 2024-09-21T15:08:19.646 INFO:teuthology.orchestra.run.smithi161.stdout:2458 read 0x11e2378 thru 0x11ee75d (0xc3e6 bytes) 2024-09-21T15:08:19.648 INFO:teuthology.orchestra.run.smithi161.stdout:1613 write 0x8092048 thru 0x809ea58 (0xca11 bytes) 2024-09-21T15:08:19.657 INFO:teuthology.orchestra.run.smithi161.stdout:2459 trunc from 0x8898362 to 0xd0a3618 2024-09-21T15:08:19.682 INFO:teuthology.orchestra.run.smithi161.stdout:1861 write 0xbde175a thru 0xbdeed99 (0xd640 bytes) 2024-09-21T15:08:19.682 INFO:teuthology.orchestra.run.smithi161.stdout:1955 write 0xed70e37 thru 0xed7f7ce (0xe998 bytes) 2024-09-21T15:08:19.690 INFO:teuthology.orchestra.run.smithi161.stdout:2460 punch from 0xbe9c497 to 0xbea1964, (0x54cd bytes) 2024-09-21T15:08:19.690 INFO:teuthology.orchestra.run.smithi161.stdout:2461 read 0xccd9db0 thru 0xccde966 (0x4bb7 bytes) 2024-09-21T15:08:19.691 INFO:teuthology.orchestra.run.smithi161.stdout:2462 write 0xba114e8 thru 0xba16fbc (0x5ad5 bytes) 2024-09-21T15:08:19.693 INFO:teuthology.orchestra.run.smithi161.stdout:1614 trunc from 0xc65619d to 0x16225e 2024-09-21T15:08:19.701 INFO:teuthology.orchestra.run.smithi161.stdout:2463 writesame 0x87f55b0 thru 0x87fe9d9 data_size 0x5(0x942a bytes) 2024-09-21T15:08:19.713 INFO:teuthology.orchestra.run.smithi161.stdout:1862 write 0x7bafa51 thru 0x7bb8899 (0x8e49 bytes) 2024-09-21T15:08:19.714 INFO:teuthology.orchestra.run.smithi161.stdout:2464 writesame 0xaa6f17e thru 0xaa7de07 data_size 0x89(0xec8a bytes) 2024-09-21T15:08:19.724 INFO:teuthology.orchestra.run.smithi161.stdout:1956 trunc from 0xed7f7cf to 0x42d98c8 2024-09-21T15:08:19.736 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.736 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.736 INFO:teuthology.orchestra.run.smithi161.stdout:2468 punch from 0xa863c48 to 0xa8664b1, (0x2869 bytes) 2024-09-21T15:08:19.736 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.736 INFO:teuthology.orchestra.run.smithi161.stdout:2474 punch from 0x3c6ee9a to 0x3c7ec5b, (0xfdc1 bytes) 2024-09-21T15:08:19.736 INFO:teuthology.orchestra.run.smithi161.stdout:2475 punch from 0x254afd5 to 0x254c6f7, (0x1722 bytes) 2024-09-21T15:08:19.736 INFO:teuthology.orchestra.run.smithi161.stdout:2476 write 0x778276a thru 0x778e4c2 (0xbd59 bytes) 2024-09-21T15:08:19.759 INFO:teuthology.orchestra.run.smithi161.stdout:2477 write 0xa432e79 thru 0xa43904f (0x61d7 bytes) 2024-09-21T15:08:19.774 INFO:teuthology.orchestra.run.smithi161.stdout:2479 punch from 0x8e0bdec to 0x8e0c3c3, (0x5d7 bytes) 2024-09-21T15:08:19.774 INFO:teuthology.orchestra.run.smithi161.stdout:2480 write 0x6377545 thru 0x637a057 (0x2b13 bytes) 2024-09-21T15:08:19.781 INFO:teuthology.orchestra.run.smithi161.stdout:2481 read 0xc095432 thru 0xc09e566 (0x9135 bytes) 2024-09-21T15:08:19.782 INFO:teuthology.orchestra.run.smithi161.stdout:2482 read 0x8d540f thru 0x8dc2cd (0x6ebf bytes) 2024-09-21T15:08:19.783 INFO:teuthology.orchestra.run.smithi161.stdout:2483 read 0x66840c0 thru 0x668554d (0x148e bytes) 2024-09-21T15:08:19.794 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.794 INFO:teuthology.orchestra.run.smithi161.stdout:1864 write 0x5aa7dcf thru 0x5ab2c57 (0xae89 bytes) 2024-09-21T15:08:19.810 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #14, image image_cluster1.client.mirror.4-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent15 2024-09-21T15:08:19.821 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.821 INFO:teuthology.orchestra.run.smithi161.stdout:1958 writesame 0x3d88f0f thru 0x3d95bf0 data_size 0x19(0xcce2 bytes) 2024-09-21T15:08:19.826 INFO:teuthology.orchestra.run.smithi161.stdout:2484 write 0xe5e0f5d thru 0xe5e6b09 (0x5bad bytes) 2024-09-21T15:08:19.830 INFO:teuthology.orchestra.run.smithi161.stdout:1959 read 0x39f0f8e thru 0x39f4a2d (0x3aa0 bytes) 2024-09-21T15:08:19.832 INFO:teuthology.orchestra.run.smithi161.stdout:1960 write 0x1ad60e thru 0x1b8e22 (0xb815 bytes) 2024-09-21T15:08:19.839 INFO:teuthology.orchestra.run.smithi161.stdout:2485 writesame 0xcc3e304 thru 0xcc48046 data_size 0x1(0x9d43 bytes) 2024-09-21T15:08:19.842 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.859 INFO:teuthology.orchestra.run.smithi161.stdout:1963 trunc from 0x42d98c8 to 0xcef1786 2024-09-21T15:08:19.868 INFO:teuthology.orchestra.run.smithi161.stdout:1615 write 0xbd05d6d thru 0xbd0620d (0x4a1 bytes) 2024-09-21T15:08:19.870 INFO:teuthology.orchestra.run.smithi161.stdout:2487 write 0x5b68af1 thru 0x5b77671 (0xeb81 bytes) 2024-09-21T15:08:19.883 INFO:teuthology.orchestra.run.smithi161.stdout:2488 punch from 0x4822649 to 0x482fac2, (0xd479 bytes) 2024-09-21T15:08:19.883 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.883 INFO:teuthology.orchestra.run.smithi161.stdout:2490 write 0x1ab8227 thru 0x1ac3f93 (0xbd6d bytes) 2024-09-21T15:08:19.888 INFO:teuthology.orchestra.run.smithi161.stdout:1616 write 0x2386214 thru 0x238f927 (0x9714 bytes) 2024-09-21T15:08:19.895 INFO:teuthology.orchestra.run.smithi161.stdout:2493 writesame 0x3bb061 thru 0x3c4b5e data_size 0x1(0x9afe bytes) 2024-09-21T15:08:19.897 INFO:teuthology.orchestra.run.smithi161.stdout:1868 writesame 0xcb69d9f thru 0xcb6ad33 data_size 0x1(0xf95 bytes) 2024-09-21T15:08:19.899 INFO:teuthology.orchestra.run.smithi161.stdout:1965 read 0xae95842 thru 0xae9f3ec (0x9bab bytes) 2024-09-21T15:08:19.900 INFO:teuthology.orchestra.run.smithi161.stdout:1966 read 0x32a9412 thru 0x32a992f (0x51e bytes) 2024-09-21T15:08:19.904 INFO:teuthology.orchestra.run.smithi161.stdout:1967 trunc from 0xcef1786 to 0xbb9dfd9 2024-09-21T15:08:19.918 INFO:teuthology.orchestra.run.smithi161.stdout:2495 writesame 0x2dc25d2 thru 0x2dc3307 data_size 0x2(0xd36 bytes) 2024-09-21T15:08:19.923 INFO:teuthology.orchestra.run.smithi161.stdout:2104 write 0xd63545d thru 0xd6382a6 (0x2e4a bytes) 2024-09-21T15:08:19.926 INFO:teuthology.orchestra.run.smithi161.stdout:2496 writesame 0x595d687 thru 0x5968e15 data_size 0x7(0xb78f bytes) 2024-09-21T15:08:19.927 INFO:teuthology.orchestra.run.smithi161.stdout:1870 write 0xbd01a9e thru 0xbd07c62 (0x61c5 bytes) 2024-09-21T15:08:19.930 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.930 INFO:teuthology.orchestra.run.smithi161.stdout:1969 writesame 0x255134f thru 0x255f2e3 data_size 0x1(0xdf95 bytes) 2024-09-21T15:08:19.936 INFO:teuthology.orchestra.run.smithi161.stdout:1871 writesame 0x9af7ffe thru 0x9af9b47 data_size 0x7(0x1b4a bytes) 2024-09-21T15:08:19.941 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.941 INFO:teuthology.orchestra.run.smithi161.stdout:2106 punch from 0xbc73266 to 0xbc7af86, (0x7d20 bytes) 2024-09-21T15:08:19.942 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.942 INFO:teuthology.orchestra.run.smithi161.stdout:2108 read 0x1814a90 thru 0x181f5d6 (0xab47 bytes) 2024-09-21T15:08:19.942 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.942 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.942 INFO:teuthology.orchestra.run.smithi161.stdout:2499 write 0x62862f4 thru 0x6288454 (0x2161 bytes) 2024-09-21T15:08:19.943 INFO:teuthology.orchestra.run.smithi161.stdout:2110 read 0xa7a53f5 thru 0xa7abd59 (0x6965 bytes) 2024-09-21T15:08:19.943 INFO:teuthology.orchestra.run.smithi161.stdout:2111 writesame 0x7e10e4b thru 0x7e1e09d data_size 0x1(0xd253 bytes) 2024-09-21T15:08:19.955 INFO:teuthology.orchestra.run.smithi161.stdout:1617 write 0xe43b195 thru 0xe4488e1 (0xd74d bytes) 2024-09-21T15:08:19.965 INFO:teuthology.orchestra.run.smithi161.stdout:2500 write 0x5d277f3 thru 0x5d2f813 (0x8021 bytes) 2024-09-21T15:08:19.977 INFO:teuthology.orchestra.run.smithi161.stdout:1970 write 0x425a91e thru 0x42628ad (0x7f90 bytes) 2024-09-21T15:08:19.983 INFO:teuthology.orchestra.run.smithi161.stdout:2502 write 0x7c9e513 thru 0x7ca67ea (0x82d8 bytes) 2024-09-21T15:08:19.992 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.992 INFO:teuthology.orchestra.run.smithi161.stdout:1972 punch from 0xa5944e6 to 0xa59cc3f, (0x8759 bytes) 2024-09-21T15:08:19.992 INFO:teuthology.orchestra.run.smithi161.stdout:1973 punch from 0x23071a to 0x233239, (0x2b1f bytes) 2024-09-21T15:08:19.993 INFO:teuthology.orchestra.run.smithi161.stdout:1618 read 0x70c599a thru 0x70c8c14 (0x327b bytes) 2024-09-21T15:08:19.993 INFO:teuthology.orchestra.run.smithi161.stdout:1620 read 0xb7f7954 thru 0xb806370 (0xea1d bytes) 2024-09-21T15:08:19.994 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.995 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:19.995 INFO:teuthology.orchestra.run.smithi161.stdout:1623 writesame 0x151ee26 thru 0x15291db data_size 0x7f(0xa3b6 bytes) 2024-09-21T15:08:19.997 INFO:teuthology.orchestra.run.smithi161.stdout:2504 write 0x22f3b02 thru 0x22f7a01 (0x3f00 bytes) 2024-09-21T15:08:19.999 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.000 INFO:teuthology.orchestra.run.smithi161.stdout:2113 punch from 0x9cd8c66 to 0x9cd8fdb, (0x375 bytes) 2024-09-21T15:08:20.000 INFO:teuthology.orchestra.run.smithi161.stdout:2114 writesame 0x2d4ef84 thru 0x2d51331 data_size 0x1(0x23ae bytes) 2024-09-21T15:08:20.009 INFO:teuthology.orchestra.run.smithi161.stdout:1873 writesame 0xd30b9bf thru 0xd312344 data_size 0xd(0x6986 bytes) 2024-09-21T15:08:20.009 INFO:teuthology.orchestra.run.smithi161.stdout:2505 read 0xe32ef6 thru 0xe356df (0x27ea bytes) 2024-09-21T15:08:20.012 INFO:teuthology.orchestra.run.smithi161.stdout:2508 punch from 0x690a1c3 to 0x690d29b, (0x30d8 bytes) 2024-09-21T15:08:20.012 INFO:teuthology.orchestra.run.smithi161.stdout:2509 write 0x1428e9b thru 0x14355ef (0xc755 bytes) 2024-09-21T15:08:20.013 INFO:teuthology.orchestra.run.smithi161.stdout:1625 writesame 0x4778844 thru 0x477aa7c data_size 0x1(0x2239 bytes) 2024-09-21T15:08:20.024 INFO:teuthology.orchestra.run.smithi161.stdout:1874 write 0x9f10587 thru 0x9f14521 (0x3f9b bytes) 2024-09-21T15:08:20.024 INFO:teuthology.orchestra.run.smithi161.stdout:2117 punch from 0x49a4f15 to 0x49b02b3, (0xb39e bytes) 2024-09-21T15:08:20.024 INFO:teuthology.orchestra.run.smithi161.stdout:2118 read 0x2ae439b thru 0x2aeb29f (0x6f05 bytes) 2024-09-21T15:08:20.027 INFO:teuthology.orchestra.run.smithi161.stdout:2512 writesame 0xafaa3d thru 0xafe3b8 data_size 0x1a(0x397c bytes) 2024-09-21T15:08:20.027 INFO:teuthology.orchestra.run.smithi161.stdout:2119 writesame 0x7578ca1 thru 0x758483d data_size 0x1(0xbb9d bytes) 2024-09-21T15:08:20.039 INFO:teuthology.orchestra.run.smithi161.stdout:1626 read 0x21cefbf thru 0x21d27a1 (0x37e3 bytes) 2024-09-21T15:08:20.040 INFO:teuthology.orchestra.run.smithi161.stdout:2514 punch from 0x7bdcbf9 to 0x7be4703, (0x7b0a bytes) 2024-09-21T15:08:20.050 INFO:teuthology.orchestra.run.smithi161.stdout:2516 trunc from 0xe5e6b0a to 0xad24d2e 2024-09-21T15:08:20.053 INFO:teuthology.orchestra.run.smithi161.stdout:1627 punch from 0x78ac303 to 0x78b3fa3, (0x7ca0 bytes) 2024-09-21T15:08:20.053 INFO:teuthology.orchestra.run.smithi161.stdout:1628 read 0x54ced1d thru 0x54cf4d0 (0x7b4 bytes) 2024-09-21T15:08:20.053 INFO:teuthology.orchestra.run.smithi161.stdout:2120 write 0x6d1d8ce thru 0x6d2946a (0xbb9d bytes) 2024-09-21T15:08:20.053 INFO:teuthology.orchestra.run.smithi161.stdout:1629 writesame 0x436cff5 thru 0x4371882 data_size 0x25(0x488e bytes) 2024-09-21T15:08:20.057 INFO:teuthology.orchestra.run.smithi161.stdout:1875 read 0x4ee4bc2 thru 0x4ee6a04 (0x1e43 bytes) 2024-09-21T15:08:20.058 INFO:teuthology.orchestra.run.smithi161.stdout:1876 punch from 0xa9f769c to 0xaa0446d, (0xcdd1 bytes) 2024-09-21T15:08:20.058 INFO:teuthology.orchestra.run.smithi161.stdout:1877 read 0x9857dc4 thru 0x985907e (0x12bb bytes) 2024-09-21T15:08:20.058 INFO:teuthology.orchestra.run.smithi161.stdout:1878 write 0xb617170 thru 0xb61b685 (0x4516 bytes) 2024-09-21T15:08:20.063 INFO:teuthology.orchestra.run.smithi161.stdout:1974 write 0xeb6018c thru 0xeb695f6 (0x946b bytes) 2024-09-21T15:08:20.074 INFO:teuthology.orchestra.run.smithi161.stdout:2121 trunc from 0xd6382a7 to 0xd5a38a3 2024-09-21T15:08:20.077 INFO:teuthology.orchestra.run.smithi161.stdout:1630 read 0x6414dc7 thru 0x64242dc (0xf516 bytes) 2024-09-21T15:08:20.077 INFO:teuthology.orchestra.run.smithi161.stdout:1631 write 0x9a31ecf thru 0x9a36b30 (0x4c62 bytes) 2024-09-21T15:08:20.080 INFO:teuthology.orchestra.run.smithi161.stdout:1879 punch from 0x23d294b to 0x23df1a8, (0xc85d bytes) 2024-09-21T15:08:20.080 INFO:teuthology.orchestra.run.smithi161.stdout:1881 write 0x8601f88 thru 0x860a521 (0x859a bytes) 2024-09-21T15:08:20.091 INFO:teuthology.orchestra.run.smithi161.stdout:1975 write 0xd2b6b66 thru 0xd2b777d (0xc18 bytes) 2024-09-21T15:08:20.092 INFO:teuthology.orchestra.run.smithi161.stdout:1874 read 0x1381513 thru 0x1384e11 (0x38ff bytes) 2024-09-21T15:08:20.097 INFO:teuthology.orchestra.run.smithi161.stdout:1633 read 0x67adf78 thru 0x67b9d14 (0xbd9d bytes) 2024-09-21T15:08:20.097 INFO:teuthology.orchestra.run.smithi161.stdout:1883 write 0x637b2d4 thru 0x6385a7c (0xa7a9 bytes) 2024-09-21T15:08:20.098 INFO:teuthology.orchestra.run.smithi161.stdout:1634 punch from 0x128773f to 0x12935be, (0xbe7f bytes) 2024-09-21T15:08:20.099 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.099 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.099 INFO:teuthology.orchestra.run.smithi161.stdout:1640 punch from 0x5038b05 to 0x503dff8, (0x54f3 bytes) 2024-09-21T15:08:20.099 INFO:teuthology.orchestra.run.smithi161.stdout:1641 write 0x4d24007 thru 0x4d25d81 (0x1d7b bytes) 2024-09-21T15:08:20.111 INFO:teuthology.orchestra.run.smithi161.stdout:2518 trunc from 0xad24d2e to 0xcd98a1e 2024-09-21T15:08:20.111 INFO:teuthology.orchestra.run.smithi161.stdout:1885 read 0x46ad505 thru 0x46b198e (0x448a bytes) 2024-09-21T15:08:20.112 INFO:teuthology.orchestra.run.smithi161.stdout:1976 writesame 0x96df7cd thru 0x96ed130 data_size 0x2(0xd964 bytes) 2024-09-21T15:08:20.112 INFO:teuthology.orchestra.run.smithi161.stdout:1886 read 0xafa7e7a thru 0xafb3d7e (0xbf05 bytes) 2024-09-21T15:08:20.114 INFO:teuthology.orchestra.run.smithi161.stdout:1887 punch from 0xa947b43 to 0xa9550f0, (0xd5ad bytes) 2024-09-21T15:08:20.114 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.114 INFO:teuthology.orchestra.run.smithi161.stdout:1889 writesame 0x5eb6be2 thru 0x5ebf9f1 data_size 0x8(0x8e10 bytes) 2024-09-21T15:08:20.123 INFO:teuthology.orchestra.run.smithi161.stdout:1642 read 0xe30537a thru 0xe30f1b6 (0x9e3d bytes) 2024-09-21T15:08:20.123 INFO:teuthology.orchestra.run.smithi161.stdout:1645 write 0x7865764 thru 0x7869212 (0x3aaf bytes) 2024-09-21T15:08:20.131 INFO:teuthology.orchestra.run.smithi161.stdout:1875 writesame 0x3f9f0ac thru 0x3faa7f3 data_size 0x44(0xb748 bytes) 2024-09-21T15:08:20.134 INFO:teuthology.orchestra.run.smithi161.stdout:1646 read 0x3b79544 thru 0x3b7b3e6 (0x1ea3 bytes) 2024-09-21T15:08:20.134 INFO:teuthology.orchestra.run.smithi161.stdout:1647 write 0x7ba148e thru 0x7ba6e85 (0x59f8 bytes) 2024-09-21T15:08:20.138 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.138 INFO:teuthology.orchestra.run.smithi161.stdout:2123 read 0xd021beb thru 0xd030412 (0xe828 bytes) 2024-09-21T15:08:20.141 INFO:teuthology.orchestra.run.smithi161.stdout:1978 read 0x2e30e37 thru 0x2e405d2 (0xf79c bytes) 2024-09-21T15:08:20.142 INFO:teuthology.orchestra.run.smithi161.stdout:1979 write 0xe71292f thru 0xe71daca (0xb19c bytes) 2024-09-21T15:08:20.142 INFO:teuthology.orchestra.run.smithi161.stdout:2124 read 0xbe1a643 thru 0xbe25abf (0xb47d bytes) 2024-09-21T15:08:20.143 INFO:teuthology.orchestra.run.smithi161.stdout:2125 writesame 0x5c8766f thru 0x5c94b78 data_size 0xb(0xd50a bytes) 2024-09-21T15:08:20.152 INFO:teuthology.orchestra.run.smithi161.stdout:2519 read 0x172e9e0 thru 0x1730f1b (0x253c bytes) 2024-09-21T15:08:20.153 INFO:teuthology.orchestra.run.smithi161.stdout:1648 read 0x3b86963 thru 0x3b94489 (0xdb27 bytes) 2024-09-21T15:08:20.153 INFO:teuthology.orchestra.run.smithi161.stdout:1651 punch from 0xa398c8a to 0xa3a14dd, (0x8853 bytes) 2024-09-21T15:08:20.153 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.153 INFO:teuthology.orchestra.run.smithi161.stdout:1653 read 0x47898e0 thru 0x478e513 (0x4c34 bytes) 2024-09-21T15:08:20.156 INFO:teuthology.orchestra.run.smithi161.stdout:1890 trunc from 0xd312345 to 0x2412904 2024-09-21T15:08:20.165 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.165 INFO:teuthology.orchestra.run.smithi161.stdout:1982 punch from 0x96509da to 0x965c6dd, (0xbd03 bytes) 2024-09-21T15:08:20.165 INFO:teuthology.orchestra.run.smithi161.stdout:1983 read 0x2f37591 thru 0x2f3f64c (0x80bc bytes) 2024-09-21T15:08:20.165 INFO:teuthology.orchestra.run.smithi161.stdout:2520 punch from 0x9863885 to 0x98653b6, (0x1b31 bytes) 2024-09-21T15:08:20.165 INFO:teuthology.orchestra.run.smithi161.stdout:2522 punch from 0x64e98c1 to 0x64f5797, (0xbed6 bytes) 2024-09-21T15:08:20.165 INFO:teuthology.orchestra.run.smithi161.stdout:2523 read 0x19e59b9 thru 0x19f07a3 (0xadeb bytes) 2024-09-21T15:08:20.166 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.166 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xee33df5 2024-09-21T15:08:20.166 INFO:teuthology.orchestra.run.smithi161.stdout:1984 write 0x99c8441 thru 0x99d4b5a (0xc71a bytes) 2024-09-21T15:08:20.166 INFO:teuthology.orchestra.run.smithi161.stdout:1656 trunc from 0xe4488e2 to 0xee33df5 2024-09-21T15:08:20.167 INFO:teuthology.orchestra.run.smithi161.stdout:2525 write 0x3ba8eed thru 0x3bb2622 (0x9736 bytes) 2024-09-21T15:08:20.173 INFO:teuthology.orchestra.run.smithi161.stdout:2126 read 0x1b2997a thru 0x1b36707 (0xcd8e bytes) 2024-09-21T15:08:20.173 INFO:teuthology.orchestra.run.smithi161.stdout:2128 writesame 0x17e35b9 thru 0x17eb7a4 data_size 0xa(0x81ec bytes) 2024-09-21T15:08:20.187 INFO:teuthology.orchestra.run.smithi161.stdout:2526 read 0xb34d7f0 thru 0xb35c3fd (0xec0e bytes) 2024-09-21T15:08:20.189 INFO:teuthology.orchestra.run.smithi161.stdout:2527 write 0x861d944 thru 0x86246e7 (0x6da4 bytes) 2024-09-21T15:08:20.191 INFO:teuthology.orchestra.run.smithi161.stdout:2129 read 0x57b3c03 thru 0x57bca33 (0x8e31 bytes) 2024-09-21T15:08:20.191 INFO:teuthology.orchestra.run.smithi161.stdout:1986 write 0x5555397 thru 0x556221f (0xce89 bytes) 2024-09-21T15:08:20.195 INFO:teuthology.orchestra.run.smithi161.stdout:2130 trunc from 0xd5a38a3 to 0xbbff29f 2024-09-21T15:08:20.197 INFO:teuthology.orchestra.run.smithi161.stdout:1876 punch from 0x731379 to 0x731801, (0x488 bytes) 2024-09-21T15:08:20.197 INFO:teuthology.orchestra.run.smithi161.stdout:1879 clone 17 order 24 su 1048576 sc 10 2024-09-21T15:08:20.201 INFO:teuthology.orchestra.run.smithi161.stdout:2529 write 0x968518e thru 0x968dc6b (0x8ade bytes) 2024-09-21T15:08:20.206 INFO:teuthology.orchestra.run.smithi161.stdout:1989 trunc from 0xeb695f7 to 0xc80a751 2024-09-21T15:08:20.209 INFO:teuthology.orchestra.run.smithi161.stdout:1657 writesame 0x96ffb81 thru 0x970d35e data_size 0x1(0xd7de bytes) 2024-09-21T15:08:20.212 INFO:teuthology.orchestra.run.smithi161.stdout:2530 read 0xa3a2d1e thru 0xa3a2e29 (0x10c bytes) 2024-09-21T15:08:20.213 INFO:teuthology.orchestra.run.smithi161.stdout:2531 write 0x56dbc32 thru 0x56e66fd (0xaacc bytes) 2024-09-21T15:08:20.227 INFO:teuthology.orchestra.run.smithi161.stdout:2532 writesame 0x61ef109 thru 0x61f796f data_size 0x1(0x8867 bytes) 2024-09-21T15:08:20.254 INFO:teuthology.orchestra.run.smithi161.stdout:2131 punch from 0x69a07f5 to 0x69aa506, (0x9d11 bytes) 2024-09-21T15:08:20.254 INFO:teuthology.orchestra.run.smithi161.stdout:2132 writesame 0x9aa943a thru 0x9aafa0d data_size 0x2(0x65d4 bytes) 2024-09-21T15:08:20.255 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.255 INFO:teuthology.orchestra.run.smithi161.stdout:1659 read 0xe00425d thru 0xe01284a (0xe5ee bytes) 2024-09-21T15:08:20.258 INFO:teuthology.orchestra.run.smithi161.stdout:1892 write 0x39e8058 thru 0x39e873b (0x6e4 bytes) 2024-09-21T15:08:20.265 INFO:teuthology.orchestra.run.smithi161.stdout:1893 read 0x33f84e0 thru 0x33fae8d (0x29ae bytes) 2024-09-21T15:08:20.270 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.270 INFO:teuthology.orchestra.run.smithi161.stdout:2534 write 0x9697fef thru 0x96a6ba3 (0xebb5 bytes) 2024-09-21T15:08:20.278 INFO:teuthology.orchestra.run.smithi161.stdout:1660 trunc from 0xee33df5 to 0x381402a 2024-09-21T15:08:20.286 INFO:teuthology.orchestra.run.smithi161.stdout:2133 write 0x65d0cb2 thru 0x65d7fbe (0x730d bytes) 2024-09-21T15:08:20.290 INFO:teuthology.orchestra.run.smithi161.stdout:1991 write 0x99f8431 thru 0x99f9eef (0x1abf bytes) 2024-09-21T15:08:20.297 INFO:teuthology.orchestra.run.smithi161.stdout:2134 read 0x14e50f9 thru 0x14f43b8 (0xf2c0 bytes) 2024-09-21T15:08:20.299 INFO:teuthology.orchestra.run.smithi161.stdout:2135 read 0x49ca114 thru 0x49d2687 (0x8574 bytes) 2024-09-21T15:08:20.299 INFO:teuthology.orchestra.run.smithi161.stdout:2136 punch from 0x306334e to 0x306fdd9, (0xca8b bytes) 2024-09-21T15:08:20.305 INFO:teuthology.orchestra.run.smithi161.stdout:2535 trunc from 0xcd98a1e to 0x3218148 2024-09-21T15:08:20.307 INFO:teuthology.orchestra.run.smithi161.stdout:1894 writesame 0x664674a thru 0x6651ca6 data_size 0x1(0xb55d bytes) 2024-09-21T15:08:20.314 INFO:teuthology.orchestra.run.smithi161.stdout:1895 write 0x33c6fb7 thru 0x33d243b (0xb485 bytes) 2024-09-21T15:08:20.335 INFO:teuthology.orchestra.run.smithi161.stdout:1992 write 0xec2f8a8 thru 0xec32185 (0x28de bytes) 2024-09-21T15:08:20.339 INFO:teuthology.orchestra.run.smithi161.stdout:2137 write 0xe1c4028 thru 0xe1d2c2c (0xec05 bytes) 2024-09-21T15:08:20.341 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.341 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.341 INFO:teuthology.orchestra.run.smithi161.stdout:1995 writesame 0xe9e995f thru 0xe9ecf7d data_size 0x11(0x361f bytes) 2024-09-21T15:08:20.344 INFO:teuthology.orchestra.run.smithi161.stdout:2537 write 0x28d723b thru 0x28d9897 (0x265d bytes) 2024-09-21T15:08:20.356 INFO:teuthology.orchestra.run.smithi161.stdout:2538 read 0xc357f5 thru 0xc36580 (0xd8c bytes) 2024-09-21T15:08:20.359 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.360 INFO:teuthology.orchestra.run.smithi161.stdout:2139 read 0x1a72465 thru 0x1a7b55f (0x90fb bytes) 2024-09-21T15:08:20.360 INFO:teuthology.orchestra.run.smithi161.stdout:1996 punch from 0x644a412 to 0x6456d04, (0xc8f2 bytes) 2024-09-21T15:08:20.360 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.360 INFO:teuthology.orchestra.run.smithi161.stdout:2141 read 0xb78b1fa thru 0xb78c2b9 (0x10c0 bytes) 2024-09-21T15:08:20.361 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.361 INFO:teuthology.orchestra.run.smithi161.stdout:1998 writesame 0xa7867a6 thru 0xa7917f8 data_size 0x1(0xb053 bytes) 2024-09-21T15:08:20.376 INFO:teuthology.orchestra.run.smithi161.stdout:1661 writesame 0xbbfbbb3 thru 0xbc09959 data_size 0x1(0xdda7 bytes) 2024-09-21T15:08:20.379 INFO:teuthology.orchestra.run.smithi161.stdout:1897 writesame 0xdba945e thru 0xdbaf072 data_size 0x1(0x5c15 bytes) 2024-09-21T15:08:20.381 INFO:teuthology.orchestra.run.smithi161.stdout:2143 trunc from 0xe1d2c2d to 0x4a9e3ef 2024-09-21T15:08:20.389 INFO:teuthology.orchestra.run.smithi161.stdout:1662 write 0x3dde7c6 thru 0x3deaaa9 (0xc2e4 bytes) 2024-09-21T15:08:20.394 INFO:teuthology.orchestra.run.smithi161.stdout:1999 write 0x296979a thru 0x2971395 (0x7bfc bytes) 2024-09-21T15:08:20.399 INFO:teuthology.orchestra.run.smithi161.stdout:1898 read 0x534ffa1 thru 0x5353c7b (0x3cdb bytes) 2024-09-21T15:08:20.399 INFO:teuthology.orchestra.run.smithi161.stdout:1899 read 0x8626df0 thru 0x8626e10 (0x21 bytes) 2024-09-21T15:08:20.400 INFO:teuthology.orchestra.run.smithi161.stdout:1900 writesame 0x5d3f288 thru 0x5d4b1cf data_size 0x4(0xbf48 bytes) 2024-09-21T15:08:20.420 INFO:teuthology.orchestra.run.smithi161.stdout:2000 read 0x1fd60c6 thru 0x1fd7347 (0x1282 bytes) 2024-09-21T15:08:20.421 INFO:teuthology.orchestra.run.smithi161.stdout:1901 write 0xa00fd0 thru 0xa0a08c (0x90bd bytes) 2024-09-21T15:08:20.424 INFO:teuthology.orchestra.run.smithi161.stdout:1664 writesame 0xb0c39f7 thru 0xb0cbac3 data_size 0x3(0x80cd bytes) 2024-09-21T15:08:20.435 INFO:teuthology.orchestra.run.smithi161.stdout:1902 punch from 0x90b5e2f to 0x90bb5b4, (0x5785 bytes) 2024-09-21T15:08:20.435 INFO:teuthology.orchestra.run.smithi161.stdout:1903 writesame 0x3a63a36 thru 0x3a6ce75 data_size 0x20(0x9440 bytes) 2024-09-21T15:08:20.436 INFO:teuthology.orchestra.run.smithi161.stdout:2542 write 0xecf5bf1 thru 0xecfb0b5 (0x54c5 bytes) 2024-09-21T15:08:20.439 INFO:teuthology.orchestra.run.smithi161.stdout:2001 trunc from 0xec32186 to 0x564b5f8 2024-09-21T15:08:20.444 INFO:teuthology.orchestra.run.smithi161.stdout:1665 writesame 0x33d5489 thru 0x33d788b data_size 0x7(0x2403 bytes) 2024-09-21T15:08:20.444 INFO:teuthology.orchestra.run.smithi161.stdout:1904 read 0x623ed8a thru 0x6247468 (0x86df bytes) 2024-09-21T15:08:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:1906 read 0x7bc0115 thru 0x7bcde29 (0xdd15 bytes) 2024-09-21T15:08:20.446 INFO:teuthology.orchestra.run.smithi161.stdout:2543 punch from 0xa849824 to 0xa856b3d, (0xd319 bytes) 2024-09-21T15:08:20.446 INFO:teuthology.orchestra.run.smithi161.stdout:2544 punch from 0x7d3c7e6 to 0x7d4bb8a, (0xf3a4 bytes) 2024-09-21T15:08:20.446 INFO:teuthology.orchestra.run.smithi161.stdout:2546 read 0x44d1e54 thru 0x44d39f2 (0x1b9f bytes) 2024-09-21T15:08:20.446 INFO:teuthology.orchestra.run.smithi161.stdout:1907 write 0x5610067 thru 0x5618c35 (0x8bcf bytes) 2024-09-21T15:08:20.446 INFO:teuthology.orchestra.run.smithi161.stdout:2547 read 0xbf90c2 thru 0xc01201 (0x8140 bytes) 2024-09-21T15:08:20.448 INFO:teuthology.orchestra.run.smithi161.stdout:2550 read 0xc56c0a1 thru 0xc56f89f (0x37ff bytes) 2024-09-21T15:08:20.448 INFO:teuthology.orchestra.run.smithi161.stdout:2551 read 0x2ddba15 thru 0x2ddd8c4 (0x1eb0 bytes) 2024-09-21T15:08:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:2553 read 0xce69ea8 thru 0xce6aa44 (0xb9d bytes) 2024-09-21T15:08:20.450 INFO:teuthology.orchestra.run.smithi161.stdout:2555 write 0xe9522e5 thru 0xe95b8d1 (0x95ed bytes) 2024-09-21T15:08:20.455 INFO:teuthology.orchestra.run.smithi161.stdout:1667 read 0x5137a59 thru 0x5138be8 (0x1190 bytes) 2024-09-21T15:08:20.456 INFO:teuthology.orchestra.run.smithi161.stdout:1908 writesame 0x9ea5412 thru 0x9eab2b7 data_size 0x5(0x5ea6 bytes) 2024-09-21T15:08:20.460 INFO:teuthology.orchestra.run.smithi161.stdout:2558 read 0x9b29e24 thru 0x9b3599a (0xbb77 bytes) 2024-09-21T15:08:20.461 INFO:teuthology.orchestra.run.smithi161.stdout:2559 write 0x54dc6ad thru 0x54e8137 (0xba8b bytes) 2024-09-21T15:08:20.461 INFO:teuthology.orchestra.run.smithi161.stdout:2144 read 0x39b42 thru 0x4635c (0xc81b bytes) 2024-09-21T15:08:20.465 INFO:teuthology.orchestra.run.smithi161.stdout:2145 punch from 0x73961a to 0x73d2e9, (0x3ccf bytes) 2024-09-21T15:08:20.466 INFO:teuthology.orchestra.run.smithi161.stdout:1909 writesame 0x89f9f39 thru 0x89fad93 data_size 0xf(0xe5b bytes) 2024-09-21T15:08:20.470 INFO:teuthology.orchestra.run.smithi161.stdout:1668 trunc from 0xbc0995a to 0x5447fd5 2024-09-21T15:08:20.475 INFO:teuthology.orchestra.run.smithi161.stdout:2560 write 0xcaab2cf thru 0xcab6520 (0xb252 bytes) 2024-09-21T15:08:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:1912 read 0x4f97397 thru 0x4fa47e6 (0xd450 bytes) 2024-09-21T15:08:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:1916 write 0xb3bb514 thru 0xb3c0457 (0x4f44 bytes) 2024-09-21T15:08:20.484 INFO:teuthology.orchestra.run.smithi161.stdout:2146 trunc from 0x4a9e3ef to 0xe476c27 2024-09-21T15:08:20.489 INFO:teuthology.orchestra.run.smithi161.stdout:2564 write 0x9f7ce07 thru 0x9f80e4a (0x4044 bytes) 2024-09-21T15:08:20.498 INFO:teuthology.orchestra.run.smithi161.stdout:1917 writesame 0x257316b thru 0x2577343 data_size 0x3(0x41d9 bytes) 2024-09-21T15:08:20.503 INFO:teuthology.orchestra.run.smithi161.stdout:2566 writesame 0xc97c066 thru 0xc97d30c data_size 0x5(0x12a7 bytes) 2024-09-21T15:08:20.510 INFO:teuthology.orchestra.run.smithi161.stdout:1918 read 0xd0dacb3 thru 0xd0dadf1 (0x13f bytes) 2024-09-21T15:08:20.511 INFO:teuthology.orchestra.run.smithi161.stdout:1919 read 0x3fc3d45 thru 0x3fd3b06 (0xfdc2 bytes) 2024-09-21T15:08:20.512 INFO:teuthology.orchestra.run.smithi161.stdout:1921 punch from 0x7a5fe86 to 0x7a65100, (0x527a bytes) 2024-09-21T15:08:20.512 INFO:teuthology.orchestra.run.smithi161.stdout:1922 write 0xcc79788 thru 0xcc7ef81 (0x57fa bytes) 2024-09-21T15:08:20.515 INFO:teuthology.orchestra.run.smithi161.stdout:2568 read 0x78886dc thru 0x7895b4b (0xd470 bytes) 2024-09-21T15:08:20.516 INFO:teuthology.orchestra.run.smithi161.stdout:2569 read 0x1f2be22 thru 0x1f36be2 (0xadc1 bytes) 2024-09-21T15:08:20.518 INFO:teuthology.orchestra.run.smithi161.stdout:2570 write 0x88df0b1 thru 0x88e18c5 (0x2815 bytes) 2024-09-21T15:08:20.520 INFO:teuthology.orchestra.run.smithi161.stdout:2147 writesame 0x9fae978 thru 0x9fb6c58 data_size 0x1(0x82e1 bytes) 2024-09-21T15:08:20.533 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.533 INFO:teuthology.orchestra.run.smithi161.stdout:2572 write 0xdabdc41 thru 0xdac7d33 (0xa0f3 bytes) 2024-09-21T15:08:20.542 INFO:teuthology.orchestra.run.smithi161.stdout:1669 trunc from 0x5447fd5 to 0x1c7c130 2024-09-21T15:08:20.547 INFO:teuthology.orchestra.run.smithi161.stdout:1923 trunc from 0xdbaf073 to 0x6607e15 2024-09-21T15:08:20.553 INFO:teuthology.orchestra.run.smithi161.stdout:2573 writesame 0xec97eff thru 0xeca6224 data_size 0x19(0xe326 bytes) 2024-09-21T15:08:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:2148 read 0xad4f8df thru 0xad53d40 (0x4462 bytes) 2024-09-21T15:08:20.554 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:2003 writesame 0x7f792cf thru 0x7f79cff data_size 0x1(0xa31 bytes) 2024-09-21T15:08:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:2151 trunc from 0xe476c27 to 0xee0ab96 2024-09-21T15:08:20.563 INFO:teuthology.orchestra.run.smithi161.stdout:2004 read 0x6a5cd31 thru 0x6a676f8 (0xa9c8 bytes) 2024-09-21T15:08:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:2575 writesame 0x6c3aca thru 0x6c698f data_size 0x1(0x2ec6 bytes) 2024-09-21T15:08:20.598 INFO:teuthology.orchestra.run.smithi161.stdout:2579 trunc from 0xecfb0b6 to 0xa9c639c 2024-09-21T15:08:20.607 INFO:teuthology.orchestra.run.smithi161.stdout:1924 write 0xdef191 thru 0xdfb83c (0xc6ac bytes) 2024-09-21T15:08:20.607 INFO:teuthology.orchestra.run.smithi161.stdout:2152 writesame 0x17d184f thru 0x17d2724 data_size 0x3(0xed6 bytes) 2024-09-21T15:08:20.619 INFO:teuthology.orchestra.run.smithi161.stdout:2153 write 0x75c3e11 thru 0x75d0cfc (0xceec bytes) 2024-09-21T15:08:20.620 INFO:teuthology.orchestra.run.smithi161.stdout:1925 read 0x27e85e4 thru 0x27ed8e8 (0x5305 bytes) 2024-09-21T15:08:20.622 INFO:teuthology.orchestra.run.smithi161.stdout:1926 punch from 0x4e19d4b to 0x4e23102, (0x93b7 bytes) 2024-09-21T15:08:20.622 INFO:teuthology.orchestra.run.smithi161.stdout:1927 punch from 0x52fd5ea to 0x5302d63, (0x5779 bytes) 2024-09-21T15:08:20.622 INFO:teuthology.orchestra.run.smithi161.stdout:1928 write 0x5823c9 thru 0x582e20 (0xa58 bytes) 2024-09-21T15:08:20.627 INFO:teuthology.orchestra.run.smithi161.stdout:2005 write 0xd0a468f thru 0xd0af0df (0xaa51 bytes) 2024-09-21T15:08:20.629 INFO:teuthology.orchestra.run.smithi161.stdout:1929 read 0x3cc5140 thru 0x3cc6df6 (0x1cb7 bytes) 2024-09-21T15:08:20.641 INFO:teuthology.orchestra.run.smithi161.stdout:2006 writesame 0x300bd59 thru 0x3011179 data_size 0x3(0x5421 bytes) 2024-09-21T15:08:20.642 INFO:teuthology.orchestra.run.smithi161.stdout:2580 writesame 0x34973d5 thru 0x34a42ed data_size 0x1(0xcf19 bytes) 2024-09-21T15:08:20.650 INFO:teuthology.orchestra.run.smithi161.stdout:2154 trunc from 0xee0ab96 to 0x8cd6dc2 2024-09-21T15:08:20.657 INFO:teuthology.orchestra.run.smithi161.stdout:2008 write 0xecf0ef thru 0xed377b (0x468d bytes) 2024-09-21T15:08:20.675 INFO:teuthology.orchestra.run.smithi161.stdout:2581 write 0x95b8ca thru 0x964a80 (0x91b7 bytes) 2024-09-21T15:08:20.676 INFO:teuthology.orchestra.run.smithi161.stdout:1670 write 0xdbacbb5 thru 0xdbb4ad1 (0x7f1d bytes) 2024-09-21T15:08:20.680 INFO:teuthology.orchestra.run.smithi161.stdout:2009 punch from 0x1d06e9c to 0x1d07e1d, (0xf81 bytes) 2024-09-21T15:08:20.681 INFO:teuthology.orchestra.run.smithi161.stdout:2010 writesame 0x674e9fc thru 0x6756031 data_size 0x1(0x7636 bytes) 2024-09-21T15:08:20.693 INFO:teuthology.orchestra.run.smithi161.stdout:1930 writesame 0xd90131b thru 0xd90d0d5 data_size 0x1(0xbdbb bytes) 2024-09-21T15:08:20.696 INFO:teuthology.orchestra.run.smithi161.stdout:1672 read 0x776629e thru 0x7768f80 (0x2ce3 bytes) 2024-09-21T15:08:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:1673 read 0x1eb9220 thru 0x1ec2e81 (0x9c62 bytes) 2024-09-21T15:08:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:1674 read 0x8572fe3 thru 0x8577753 (0x4771 bytes) 2024-09-21T15:08:20.697 INFO:teuthology.orchestra.run.smithi161.stdout:1677 punch from 0xa89850a to 0xa89b4e4, (0x2fda bytes) 2024-09-21T15:08:20.705 INFO:teuthology.orchestra.run.smithi161.stdout:2583 trunc from 0xa9c639c to 0x25f9528 2024-09-21T15:08:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:1931 read 0xbdf4e3f thru 0xbe00452 (0xb614 bytes) 2024-09-21T15:08:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.710 INFO:teuthology.orchestra.run.smithi161.stdout:2014 write 0x9a130f1 thru 0x9a17b4e (0x4a5e bytes) 2024-09-21T15:08:20.711 INFO:teuthology.orchestra.run.smithi161.stdout:1934 read 0x3b62ecd thru 0x3b710f2 (0xe226 bytes) 2024-09-21T15:08:20.713 INFO:teuthology.orchestra.run.smithi161.stdout:1935 trunc from 0xd90d0d6 to 0xe6499b1 2024-09-21T15:08:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:1678 trunc from 0xdbb4ad2 to 0x5576471 2024-09-21T15:08:20.715 INFO:teuthology.orchestra.run.smithi161.stdout:2156 read 0x874821a thru 0x87540a5 (0xbe8c bytes) 2024-09-21T15:08:20.716 INFO:teuthology.orchestra.run.smithi161.stdout:2159 trunc from 0x8cd6dc2 to 0x905521e 2024-09-21T15:08:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:2015 write 0x3d40d1b thru 0x3d4cab6 (0xbd9c bytes) 2024-09-21T15:08:20.745 INFO:teuthology.orchestra.run.smithi161.stdout:2018 write 0xa5b9063 thru 0xa5be8fc (0x589a bytes) 2024-09-21T15:08:20.757 INFO:teuthology.orchestra.run.smithi161.stdout:2019 writesame 0x3a2ea7a thru 0x3a3b699 data_size 0x5c(0xcc20 bytes) 2024-09-21T15:08:20.760 INFO:teuthology.orchestra.run.smithi161.stdout:2160 punch from 0x4c51e8b to 0x4c60dd0, (0xef45 bytes) 2024-09-21T15:08:20.760 INFO:teuthology.orchestra.run.smithi161.stdout:2161 write 0x36313ac thru 0x3639838 (0x848d bytes) 2024-09-21T15:08:20.762 INFO:teuthology.orchestra.run.smithi161.stdout:1936 write 0xecdf93 thru 0xeda0aa (0xc118 bytes) 2024-09-21T15:08:20.772 INFO:teuthology.orchestra.run.smithi161.stdout:1937 punch from 0xc5b0efe to 0xc5be821, (0xd923 bytes) 2024-09-21T15:08:20.774 INFO:teuthology.orchestra.run.smithi161.stdout:2584 punch from 0x21c8301 to 0x21d1823, (0x9522 bytes) 2024-09-21T15:08:20.774 INFO:teuthology.orchestra.run.smithi161.stdout:2585 read 0x7d86f6 thru 0x7dce50 (0x475b bytes) 2024-09-21T15:08:20.775 INFO:teuthology.orchestra.run.smithi161.stdout:2586 read 0x25d3a01 thru 0x25e34f0 (0xfaf0 bytes) 2024-09-21T15:08:20.781 INFO:teuthology.orchestra.run.smithi161.stdout:1679 punch from 0x161e5f4 to 0x1629466, (0xae72 bytes) 2024-09-21T15:08:20.800 INFO:teuthology.orchestra.run.smithi161.stdout:2162 trunc from 0x905521e to 0x33da8e7 2024-09-21T15:08:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:2020 trunc from 0xd0af0e0 to 0x5865ba 2024-09-21T15:08:20.805 INFO:teuthology.orchestra.run.smithi161.stdout:1938 trunc from 0xe6499b1 to 0x16087c5 2024-09-21T15:08:20.821 INFO:teuthology.orchestra.run.smithi161.stdout:1680 write 0x8145f55 thru 0x81530c9 (0xd175 bytes) 2024-09-21T15:08:20.832 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:20.832 INFO:teuthology.orchestra.run.smithi161.stdout:1682 read 0x25c2d86 thru 0x25ca5a1 (0x781c bytes) 2024-09-21T15:08:20.841 INFO:teuthology.orchestra.run.smithi161.stdout:2589 writesame 0xb2b9309 thru 0xb2ba152 data_size 0x2(0xe4a bytes) 2024-09-21T15:08:20.863 INFO:teuthology.orchestra.run.smithi161.stdout:2590 trunc from 0xb2ba153 to 0x7f620a2 2024-09-21T15:08:20.875 INFO:teuthology.orchestra.run.smithi161.stdout:1683 writesame 0x86165e1 thru 0x8616c62 data_size 0x22(0x682 bytes) 2024-09-21T15:08:20.886 INFO:teuthology.orchestra.run.smithi161.stdout:1685 trunc from 0x8616c63 to 0x4998553 2024-09-21T15:08:20.886 INFO:teuthology.orchestra.run.smithi161.stdout:2022 read 0x559b9e thru 0x563c89 (0xa0ec bytes) 2024-09-21T15:08:20.892 INFO:teuthology.orchestra.run.smithi161.stdout:1939 write 0x44ae433 thru 0x44b685a (0x8428 bytes) 2024-09-21T15:08:20.905 INFO:teuthology.orchestra.run.smithi161.stdout:1940 read 0x348fc70 thru 0x349a93f (0xacd0 bytes) 2024-09-21T15:08:20.907 INFO:teuthology.orchestra.run.smithi161.stdout:2592 read 0x6aec0b7 thru 0x6aef429 (0x3373 bytes) 2024-09-21T15:08:20.908 INFO:teuthology.orchestra.run.smithi161.stdout:2593 punch from 0x5c27661 to 0x5c2eecf, (0x786e bytes) 2024-09-21T15:08:20.918 INFO:teuthology.orchestra.run.smithi161.stdout:2594 trunc from 0x7f620a2 to 0x2df572c 2024-09-21T15:08:20.920 INFO:teuthology.orchestra.run.smithi161.stdout:2163 write 0xa7b4a6b thru 0xa7b7797 (0x2d2d bytes) 2024-09-21T15:08:20.928 INFO:teuthology.orchestra.run.smithi161.stdout:1686 read 0x48e3fd7 thru 0x48ed9d4 (0x99fe bytes) 2024-09-21T15:08:20.932 INFO:teuthology.orchestra.run.smithi161.stdout:2024 write 0xb32c7ae thru 0xb337e2b (0xb67e bytes) 2024-09-21T15:08:20.932 INFO:teuthology.orchestra.run.smithi161.stdout:2164 writesame 0x11add47 thru 0x11bc27b data_size 0x1(0xe535 bytes) 2024-09-21T15:08:20.935 INFO:teuthology.orchestra.run.smithi161.stdout:1687 trunc from 0x4998553 to 0x6ffa2a2 2024-09-21T15:08:20.961 INFO:teuthology.orchestra.run.smithi161.stdout:2166 read 0x94758eb thru 0x947cd45 (0x745b bytes) 2024-09-21T15:08:20.962 INFO:teuthology.orchestra.run.smithi161.stdout:1943 write 0xbaad543 thru 0xbaae474 (0xf32 bytes) 2024-09-21T15:08:20.962 INFO:teuthology.orchestra.run.smithi161.stdout:2167 read 0x679fb37 thru 0x67a20db (0x25a5 bytes) 2024-09-21T15:08:20.962 INFO:teuthology.orchestra.run.smithi161.stdout:2168 writesame 0x1247b59 thru 0x124cbe6 data_size 0x15(0x508e bytes) 2024-09-21T15:08:20.963 INFO:teuthology.orchestra.run.smithi161.stdout:2025 punch from 0x7d4641e to 0x7d51eac, (0xba8e bytes) 2024-09-21T15:08:20.963 INFO:teuthology.orchestra.run.smithi161.stdout:2026 write 0x6869af4 thru 0x6872e6a (0x9377 bytes) 2024-09-21T15:08:20.980 INFO:teuthology.orchestra.run.smithi161.stdout:1944 clone 16 order 20 su 524288 sc 13 2024-09-21T15:08:20.983 INFO:teuthology.orchestra.run.smithi161.stdout:2169 trunc from 0xa7b7798 to 0xb45cbe4 2024-09-21T15:08:20.988 INFO:teuthology.orchestra.run.smithi161.stdout:1688 punch from 0x685df1d to 0x685e98f, (0xa72 bytes) 2024-09-21T15:08:21.019 INFO:teuthology.orchestra.run.smithi161.stdout:2595 write 0x84f11ed thru 0x84f6fc0 (0x5dd4 bytes) 2024-09-21T15:08:21.021 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.021 INFO:teuthology.orchestra.run.smithi161.stdout:2171 read 0x8438ea5 thru 0x843b0d3 (0x222f bytes) 2024-09-21T15:08:21.021 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.021 INFO:teuthology.orchestra.run.smithi161.stdout:2173 punch from 0xa03ebbd to 0xa0484c2, (0x9905 bytes) 2024-09-21T15:08:21.027 INFO:teuthology.orchestra.run.smithi161.stdout:2596 punch from 0x43d4ae1 to 0x43df00f, (0xa52e bytes) 2024-09-21T15:08:21.031 INFO:teuthology.orchestra.run.smithi161.stdout:2027 write 0xcb355a2 thru 0xcb43add (0xe53c bytes) 2024-09-21T15:08:21.032 INFO:teuthology.orchestra.run.smithi161.stdout:1689 write 0xbb4e54b thru 0xbb52e34 (0x48ea bytes) 2024-09-21T15:08:21.051 INFO:teuthology.orchestra.run.smithi161.stdout:2030 write 0x7be5646 thru 0x7bf1286 (0xbc41 bytes) 2024-09-21T15:08:21.060 INFO:teuthology.orchestra.run.smithi161.stdout:2174 write 0xe951340 thru 0xe95c6ff (0xb3c0 bytes) 2024-09-21T15:08:21.060 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.4-clone16 intact 2024-09-21T15:08:21.068 INFO:teuthology.orchestra.run.smithi161.stdout:1691 trunc from 0xbb52e35 to 0x44af2b0 2024-09-21T15:08:21.071 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.071 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.071 INFO:teuthology.orchestra.run.smithi161.stdout:2034 write 0x6c4c255 thru 0x6c5355c (0x7308 bytes) 2024-09-21T15:08:21.084 INFO:teuthology.orchestra.run.smithi161.stdout:2597 writesame 0xc8d3e7e thru 0xc8d4b1a data_size 0x1(0xc9d bytes) 2024-09-21T15:08:21.086 INFO:teuthology.orchestra.run.smithi161.stdout:2035 write 0xc1dfd0c thru 0xc1e3b72 (0x3e67 bytes) 2024-09-21T15:08:21.088 INFO:teuthology.orchestra.run.smithi161.stdout:2176 writesame 0x8b38ad thru 0x8b4624 data_size 0x4(0xd78 bytes) 2024-09-21T15:08:21.098 INFO:teuthology.orchestra.run.smithi161.stdout:2178 write 0xa0188c5 thru 0xa01b8d8 (0x3014 bytes) 2024-09-21T15:08:21.101 INFO:teuthology.orchestra.run.smithi161.stdout:2037 read 0x18e81d0 thru 0x18f67bd (0xe5ee bytes) 2024-09-21T15:08:21.103 INFO:teuthology.orchestra.run.smithi161.stdout:2038 read 0x93ca44e thru 0x93d3098 (0x8c4b bytes) 2024-09-21T15:08:21.103 INFO:teuthology.orchestra.run.smithi161.stdout:2039 punch from 0x6508cec to 0x651211c, (0x9430 bytes) 2024-09-21T15:08:21.103 INFO:teuthology.orchestra.run.smithi161.stdout:2041 read 0x18fdfb7 thru 0x1902cda (0x4d24 bytes) 2024-09-21T15:08:21.106 INFO:teuthology.orchestra.run.smithi161.stdout:2043 trunc from 0xcb43ade to 0xbb5018b 2024-09-21T15:08:21.109 INFO:teuthology.orchestra.run.smithi161.stdout:2179 punch from 0xd4eb72b to 0xd4f7d9c, (0xc671 bytes) 2024-09-21T15:08:21.109 INFO:teuthology.orchestra.run.smithi161.stdout:2180 punch from 0x439105a to 0x43911a0, (0x146 bytes) 2024-09-21T15:08:21.109 INFO:teuthology.orchestra.run.smithi161.stdout:2182 read 0xde36a2c thru 0xde3a473 (0x3a48 bytes) 2024-09-21T15:08:21.109 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.109 INFO:teuthology.orchestra.run.smithi161.stdout:2184 write 0x7e7c6e8 thru 0x7e8bca3 (0xf5bc bytes) 2024-09-21T15:08:21.109 INFO:teuthology.orchestra.run.smithi161.stdout:2598 trunc from 0xc8d4b1b to 0x74fa418 2024-09-21T15:08:21.112 INFO:teuthology.orchestra.run.smithi161.stdout:1692 trunc from 0x44af2b0 to 0x227f41a 2024-09-21T15:08:21.134 INFO:teuthology.orchestra.run.smithi161.stdout:2186 writesame 0x9fd85fe thru 0x9fdc76f data_size 0x1(0x4172 bytes) 2024-09-21T15:08:21.158 INFO:teuthology.orchestra.run.smithi161.stdout:2187 punch from 0x90f0ab1 to 0x90f25f3, (0x1b42 bytes) 2024-09-21T15:08:21.159 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.159 INFO:teuthology.orchestra.run.smithi161.stdout:2189 read 0x843f6ce thru 0x844840a (0x8d3d bytes) 2024-09-21T15:08:21.161 INFO:teuthology.orchestra.run.smithi161.stdout:2046 punch from 0x3ab120c to 0x3ab6f36, (0x5d2a bytes) 2024-09-21T15:08:21.162 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.162 INFO:teuthology.orchestra.run.smithi161.stdout:2600 read 0x72625de thru 0x726e9d8 (0xc3fb bytes) 2024-09-21T15:08:21.163 INFO:teuthology.orchestra.run.smithi161.stdout:2601 writesame 0x5102bab thru 0x5109b6c data_size 0x5(0x6fc2 bytes) 2024-09-21T15:08:21.170 INFO:teuthology.orchestra.run.smithi161.stdout:2049 trunc from 0xbb5018b to 0x79edccd 2024-09-21T15:08:21.174 INFO:teuthology.orchestra.run.smithi161.stdout:2602 punch from 0xb912d8 to 0xb9ed8e, (0xdab6 bytes) 2024-09-21T15:08:21.174 INFO:teuthology.orchestra.run.smithi161.stdout:2605 punch from 0x3542849 to 0x3547e41, (0x55f8 bytes) 2024-09-21T15:08:21.174 INFO:teuthology.orchestra.run.smithi161.stdout:2606 read 0x61080c0 thru 0x610b4d8 (0x3419 bytes) 2024-09-21T15:08:21.174 INFO:teuthology.orchestra.run.smithi161.stdout:2608 read 0x5ac5728 thru 0x5ad1a64 (0xc33d bytes) 2024-09-21T15:08:21.175 INFO:teuthology.orchestra.run.smithi161.stdout:2190 trunc from 0xe95c700 to 0x8b0ccdf 2024-09-21T15:08:21.176 INFO:teuthology.orchestra.run.smithi161.stdout:2609 read 0x40d2ec7 thru 0x40d372a (0x864 bytes) 2024-09-21T15:08:21.184 INFO:teuthology.orchestra.run.smithi161.stdout:2610 trunc from 0x74fa418 to 0xb76efde 2024-09-21T15:08:21.198 INFO:teuthology.orchestra.run.smithi161.stdout:1693 write 0x4318c3c thru 0x4324291 (0xb656 bytes) 2024-09-21T15:08:21.228 INFO:teuthology.orchestra.run.smithi161.stdout:2050 punch from 0xb31592 to 0xb31f21, (0x98f bytes) 2024-09-21T15:08:21.229 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.244 INFO:teuthology.orchestra.run.smithi161.stdout:2611 trunc from 0xb76efde to 0x374c29e 2024-09-21T15:08:21.251 INFO:teuthology.orchestra.run.smithi161.stdout:1694 writesame 0xa21a634 thru 0xa224e83 data_size 0x8(0xa850 bytes) 2024-09-21T15:08:21.256 INFO:teuthology.orchestra.run.smithi161.stdout:1695 read 0x8f42cb8 thru 0x8f4e882 (0xbbcb bytes) 2024-09-21T15:08:21.256 INFO:teuthology.orchestra.run.smithi161.stdout:1696 write 0x3d390b2 thru 0x3d3b55b (0x24aa bytes) 2024-09-21T15:08:21.272 INFO:teuthology.orchestra.run.smithi161.stdout:2191 write 0xaa217a5 thru 0xaa2644c (0x4ca8 bytes) 2024-09-21T15:08:21.276 INFO:teuthology.orchestra.run.smithi161.stdout:2052 write 0xd92c664 thru 0xd9395ee (0xcf8b bytes) 2024-09-21T15:08:21.279 INFO:teuthology.orchestra.run.smithi161.stdout:2615 read 0x26f6780 thru 0x270098b (0xa20c bytes) 2024-09-21T15:08:21.280 INFO:teuthology.orchestra.run.smithi161.stdout:2618 read 0x1b8415b thru 0x1b8c1c7 (0x806d bytes) 2024-09-21T15:08:21.286 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.286 INFO:teuthology.orchestra.run.smithi161.stdout:2193 write 0x21ba37c thru 0x21c2b8a (0x880f bytes) 2024-09-21T15:08:21.291 INFO:teuthology.orchestra.run.smithi161.stdout:2054 writesame 0x3ab5f0d thru 0x3ab7b64 data_size 0x4(0x1c58 bytes) 2024-09-21T15:08:21.301 INFO:teuthology.orchestra.run.smithi161.stdout:2194 write 0x10e2348 thru 0x10eed8e (0xca47 bytes) 2024-09-21T15:08:21.307 INFO:teuthology.orchestra.run.smithi161.stdout:2056 punch from 0x90dae33 to 0x90dd4e1, (0x26ae bytes) 2024-09-21T15:08:21.307 INFO:teuthology.orchestra.run.smithi161.stdout:2057 read 0x7cc77b3 thru 0x7cd4a50 (0xd29e bytes) 2024-09-21T15:08:21.310 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.310 INFO:teuthology.orchestra.run.smithi161.stdout:2196 write 0x2cb2e78 thru 0x2cbd5e4 (0xa76d bytes) 2024-09-21T15:08:21.314 INFO:teuthology.orchestra.run.smithi161.stdout:1697 write 0xda5e0f6 thru 0xda629b9 (0x48c4 bytes) 2024-09-21T15:08:21.316 INFO:teuthology.orchestra.run.smithi161.stdout:2058 trunc from 0xd9395ef to 0x954d33f 2024-09-21T15:08:21.322 INFO:teuthology.orchestra.run.smithi161.stdout:2619 writesame 0x9b9fa7e thru 0x9ba008a data_size 0x1(0x60d bytes) 2024-09-21T15:08:21.322 INFO:teuthology.orchestra.run.smithi161.stdout:2197 write 0x559c6fa thru 0x55a8904 (0xc20b bytes) 2024-09-21T15:08:21.329 INFO:teuthology.orchestra.run.smithi161.stdout:1698 clone 20 order 19 su 4096 sc 3 2024-09-21T15:08:21.334 INFO:teuthology.orchestra.run.smithi161.stdout:2620 punch from 0x960ca08 to 0x96136f8, (0x6cf0 bytes) 2024-09-21T15:08:21.334 INFO:teuthology.orchestra.run.smithi161.stdout:2621 read 0x72a7b06 thru 0x72afcdd (0x81d8 bytes) 2024-09-21T15:08:21.335 INFO:teuthology.orchestra.run.smithi161.stdout:2623 writesame 0x51c4f98 thru 0x51c7d49 data_size 0x1(0x2db2 bytes) 2024-09-21T15:08:21.358 INFO:teuthology.orchestra.run.smithi161.stdout:2198 trunc from 0xaa2644d to 0x1dc1e7f 2024-09-21T15:08:21.364 INFO:teuthology.orchestra.run.smithi161.stdout:2059 clone 13 order 23 su 4194304 sc 3 2024-09-21T15:08:21.391 INFO:teuthology.orchestra.run.smithi161.stdout:2624 write 0xa0d3b4b thru 0xa0e31ca (0xf680 bytes) 2024-09-21T15:08:21.399 INFO:teuthology.orchestra.run.smithi161.stdout:2625 read 0x2fe70e2 thru 0x2feecb1 (0x7bd0 bytes) 2024-09-21T15:08:21.400 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.400 INFO:teuthology.orchestra.run.smithi161.stdout:2628 read 0x18f1688 thru 0x18f2667 (0xfe0 bytes) 2024-09-21T15:08:21.401 INFO:teuthology.orchestra.run.smithi161.stdout:2630 read 0x4975027 thru 0x49804ca (0xb4a4 bytes) 2024-09-21T15:08:21.402 INFO:teuthology.orchestra.run.smithi161.stdout:2633 read 0x5612208 thru 0x5612bed (0x9e6 bytes) 2024-09-21T15:08:21.402 INFO:teuthology.orchestra.run.smithi161.stdout:2634 writesame 0x4c5b58b thru 0x4c62658 data_size 0x3(0x70ce bytes) 2024-09-21T15:08:21.411 INFO:teuthology.orchestra.run.smithi161.stdout:2200 read 0xac17c4 thru 0xacd852 (0xc08f bytes) 2024-09-21T15:08:21.413 INFO:teuthology.orchestra.run.smithi161.stdout:2635 writesame 0x90b32bc thru 0x90ba273 data_size 0x1a(0x6fb8 bytes) 2024-09-21T15:08:21.431 INFO:teuthology.orchestra.run.smithi161.stdout:2201 trunc from 0x1dc1e7f to 0xbe19577 2024-09-21T15:08:21.463 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.463 INFO:teuthology.orchestra.run.smithi161.stdout:2203 write 0x7cf6a20 thru 0x7cf6ed7 (0x4b8 bytes) 2024-09-21T15:08:21.465 INFO:teuthology.orchestra.run.smithi161.stdout:2638 write 0xcd7a64b thru 0xcd86e99 (0xc84f bytes) 2024-09-21T15:08:21.474 INFO:teuthology.orchestra.run.smithi161.stdout:2639 writesame 0xa2edf51 thru 0xa2fb72f data_size 0x6d(0xd7df bytes) 2024-09-21T15:08:21.476 INFO:teuthology.orchestra.run.smithi161.stdout:2204 writesame 0x29025ac thru 0x290791c data_size 0x1(0x5371 bytes) 2024-09-21T15:08:21.487 INFO:teuthology.orchestra.run.smithi161.stdout:2640 trunc from 0xcd86e9a to 0xbe60131 2024-09-21T15:08:21.504 INFO:teuthology.orchestra.run.smithi161.stdout:2205 write 0x8a48b2a thru 0x8a4db54 (0x502b bytes) 2024-09-21T15:08:21.521 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.521 INFO:teuthology.orchestra.run.smithi161.stdout:2209 write 0x443ac84 thru 0x443af02 (0x27f bytes) 2024-09-21T15:08:21.532 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #15, image image_cluster1.client.mirror.4-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent16 2024-09-21T15:08:21.542 INFO:teuthology.orchestra.run.smithi161.stdout:2643 read 0x312b4b9 thru 0x3135166 (0x9cae bytes) 2024-09-21T15:08:21.543 INFO:teuthology.orchestra.run.smithi161.stdout:2211 trunc from 0xbe19577 to 0x94c1967 2024-09-21T15:08:21.543 INFO:teuthology.orchestra.run.smithi161.stdout:2644 write 0x30b74bb thru 0x30bc9c9 (0x550f bytes) 2024-09-21T15:08:21.553 INFO:teuthology.orchestra.run.smithi161.stdout:2645 flatten 2024-09-21T15:08:21.583 INFO:teuthology.orchestra.run.smithi161.stdout:2646 writesame 0x27669b8 thru 0x2769ee1 data_size 0x5(0x352a bytes) 2024-09-21T15:08:21.584 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.584 INFO:teuthology.orchestra.run.smithi161.stdout:2213 read 0x61a045 thru 0x61d87a (0x3836 bytes) 2024-09-21T15:08:21.585 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.585 INFO:teuthology.orchestra.run.smithi161.stdout:2217 write 0x8db8235 thru 0x8db9215 (0xfe1 bytes) 2024-09-21T15:08:21.591 INFO:teuthology.orchestra.run.smithi161.stdout:2648 write 0x3f31d0e thru 0x3f33576 (0x1869 bytes) 2024-09-21T15:08:21.593 INFO:teuthology.orchestra.run.smithi161.stdout:2218 read 0x67adb44 thru 0x67b6126 (0x85e3 bytes) 2024-09-21T15:08:21.596 INFO:teuthology.orchestra.run.smithi161.stdout:2219 trunc from 0x94c1967 to 0x7b908d4 2024-09-21T15:08:21.597 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.634 INFO:teuthology.orchestra.run.smithi161.stdout:2651 write 0xde33d5d thru 0xde3496d (0xc11 bytes) 2024-09-21T15:08:21.638 INFO:teuthology.orchestra.run.smithi161.stdout:2221 write 0x58febb3 thru 0x58ff1fb (0x649 bytes) 2024-09-21T15:08:21.642 INFO:teuthology.orchestra.run.smithi161.stdout:2653 write 0x5a46777 thru 0x5a53c27 (0xd4b1 bytes) 2024-09-21T15:08:21.655 INFO:teuthology.orchestra.run.smithi161.stdout:2654 read 0xaf5c79d thru 0xaf60b70 (0x43d4 bytes) 2024-09-21T15:08:21.656 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.656 INFO:teuthology.orchestra.run.smithi161.stdout:2658 write 0x5ea91a5 thru 0x5eb016a (0x6fc6 bytes) 2024-09-21T15:08:21.658 INFO:teuthology.orchestra.run.smithi161.stdout:2222 write 0x340722b thru 0x340f65e (0x8434 bytes) 2024-09-21T15:08:21.669 INFO:teuthology.orchestra.run.smithi161.stdout:2660 trunc from 0xde3496e to 0xc7962b2 2024-09-21T15:08:21.678 INFO:teuthology.orchestra.run.smithi161.stdout:2223 read 0x5b7344 thru 0x5bcabb (0x5778 bytes) 2024-09-21T15:08:21.704 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone15 from 0xbaae475 (overlap 0x16087c5) to 0x2340c6 2024-09-21T15:08:21.719 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone19 from 0xda629ba (overlap 0x16225e) to 0x0 2024-09-21T15:08:21.728 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone12 from 0x954d33f (overlap 0x5865ba) to 0x0 2024-09-21T15:08:21.730 INFO:teuthology.orchestra.run.smithi161.stdout:2661 punch from 0xbfb52bb to 0xbfb97a0, (0x44e5 bytes) 2024-09-21T15:08:21.738 INFO:teuthology.orchestra.run.smithi161.stdout:2224 write 0xe6b5c43 thru 0xe6b961b (0x39d9 bytes) 2024-09-21T15:08:21.744 INFO:teuthology.orchestra.run.smithi161.stdout:2662 trunc from 0xc7962b2 to 0x53e0935 2024-09-21T15:08:21.761 INFO:teuthology.orchestra.run.smithi161.stdout:2226 punch from 0x3e652bc to 0x3e7218f, (0xced3 bytes) 2024-09-21T15:08:21.761 INFO:teuthology.orchestra.run.smithi161.stdout:2227 read 0x88808f4 thru 0x88820fb (0x1808 bytes) 2024-09-21T15:08:21.761 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.762 INFO:teuthology.orchestra.run.smithi161.stdout:2231 writesame 0x91437a1 thru 0x914d367 data_size 0x3f(0x9bc7 bytes) 2024-09-21T15:08:21.781 INFO:teuthology.orchestra.run.smithi161.stdout:2234 writesame 0xbb007a0 thru 0xbb038ea data_size 0x1(0x314b bytes) 2024-09-21T15:08:21.799 INFO:teuthology.orchestra.run.smithi161.stdout:2235 read 0xe137c79 thru 0xe13fbd7 (0x7f5f bytes) 2024-09-21T15:08:21.799 INFO:teuthology.orchestra.run.smithi161.stdout:2236 write 0x527f436 thru 0x528113b (0x1d06 bytes) 2024-09-21T15:08:21.814 INFO:teuthology.orchestra.run.smithi161.stdout:2237 read 0xaac1693 thru 0xaacc524 (0xae92 bytes) 2024-09-21T15:08:21.814 INFO:teuthology.orchestra.run.smithi161.stdout:2239 write 0x2729e1b thru 0x2732279 (0x845f bytes) 2024-09-21T15:08:21.820 INFO:teuthology.orchestra.run.smithi161.stdout:2663 write 0x8cd57c6 thru 0x8cd7641 (0x1e7c bytes) 2024-09-21T15:08:21.827 INFO:teuthology.orchestra.run.smithi161.stdout:2665 read 0x859b5d7 thru 0x859fcd8 (0x4702 bytes) 2024-09-21T15:08:21.828 INFO:teuthology.orchestra.run.smithi161.stdout:2667 read 0x5af4f58 thru 0x5b029cf (0xda78 bytes) 2024-09-21T15:08:21.851 INFO:teuthology.orchestra.run.smithi161.stdout:2241 write 0xe989cb8 thru 0xe98eb84 (0x4ecd bytes) 2024-09-21T15:08:21.867 INFO:teuthology.orchestra.run.smithi161.stdout:2242 punch from 0x5980a2b to 0x598fd01, (0xf2d6 bytes) 2024-09-21T15:08:21.868 INFO:teuthology.orchestra.run.smithi161.stdout:2244 flatten 2024-09-21T15:08:21.871 INFO:teuthology.orchestra.run.smithi161.stdout:2669 writesame 0xed327f1 thru 0xed3aa39 data_size 0x1(0x8249 bytes) 2024-09-21T15:08:21.881 INFO:teuthology.orchestra.run.smithi161.stdout:2670 write 0x806eff thru 0x80af53 (0x4055 bytes) 2024-09-21T15:08:21.890 INFO:teuthology.orchestra.run.smithi161.stdout:2671 writesame 0x11ffce3 thru 0x120df48 data_size 0x1(0xe266 bytes) 2024-09-21T15:08:21.899 INFO:teuthology.orchestra.run.smithi161.stdout:2245 read 0xe52a776 thru 0xe52cb27 (0x23b2 bytes) 2024-09-21T15:08:21.900 INFO:teuthology.orchestra.run.smithi161.stdout:2246 write 0x5af635c thru 0x5b04847 (0xe4ec bytes) 2024-09-21T15:08:21.929 INFO:teuthology.orchestra.run.smithi161.stdout:2673 write 0x9571c76 thru 0x957f20d (0xd598 bytes) 2024-09-21T15:08:21.941 INFO:teuthology.orchestra.run.smithi161.stdout:2674 writesame 0xc727500 thru 0xc72cbb0 data_size 0x1(0x56b1 bytes) 2024-09-21T15:08:21.953 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #18, image image_cluster1.client.mirror.3-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent19 2024-09-21T15:08:21.956 INFO:teuthology.orchestra.run.smithi161.stdout:2248 trunc from 0xe98eb85 to 0x5210226 2024-09-21T15:08:21.961 INFO:teuthology.orchestra.run.smithi161.stdout:2675 write 0x3a25232 thru 0x3a317c2 (0xc591 bytes) 2024-09-21T15:08:21.964 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #14, image image_cluster1.client.mirror.5-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent15 2024-09-21T15:08:21.965 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #11, image image_cluster1.client.mirror.1-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent12 2024-09-21T15:08:21.972 INFO:teuthology.orchestra.run.smithi161.stdout:2676 read 0x726ca6a thru 0x7272b82 (0x6119 bytes) 2024-09-21T15:08:21.974 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.974 INFO:teuthology.orchestra.run.smithi161.stdout:2678 read 0xe2e3d54 thru 0xe2e3eda (0x187 bytes) 2024-09-21T15:08:21.975 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:21.995 INFO:teuthology.orchestra.run.smithi161.stdout:2680 trunc from 0xed3aa3a to 0x3023fee 2024-09-21T15:08:21.997 INFO:teuthology.orchestra.run.smithi161.stdout:1699 punch from 0x2cd2b37 to 0x2cd32c7, (0x790 bytes) 2024-09-21T15:08:22.006 INFO:teuthology.orchestra.run.smithi161.stdout:1882 read 0x7b1fc30 thru 0x7b2ec8b (0xf05c bytes) 2024-09-21T15:08:22.014 INFO:teuthology.orchestra.run.smithi161.stdout:2249 read 0x19f89b1 thru 0x19ff648 (0x6c98 bytes) 2024-09-21T15:08:22.030 INFO:teuthology.orchestra.run.smithi161.stdout:1700 read 0x439499a thru 0x439cf2c (0x8593 bytes) 2024-09-21T15:08:22.034 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:22.034 INFO:teuthology.orchestra.run.smithi161.stdout:1703 read 0xb8e4b98 thru 0xb8e750b (0x2974 bytes) 2024-09-21T15:08:22.041 INFO:teuthology.orchestra.run.smithi161.stdout:2682 read 0xf3ab0e thru 0xf48668 (0xdb5b bytes) 2024-09-21T15:08:22.043 INFO:teuthology.orchestra.run.smithi161.stdout:2683 read 0x7a7adc thru 0x7b4226 (0xc74b bytes) 2024-09-21T15:08:22.044 INFO:teuthology.orchestra.run.smithi161.stdout:1883 read 0x5b280b9 thru 0x5b2ae93 (0x2ddb bytes) 2024-09-21T15:08:22.045 INFO:teuthology.orchestra.run.smithi161.stdout:2686 read 0x2ea77ad thru 0x2eac1ed (0x4a41 bytes) 2024-09-21T15:08:22.045 INFO:teuthology.orchestra.run.smithi161.stdout:1884 write 0xb60dfb0 thru 0xb61bb80 (0xdbd1 bytes) 2024-09-21T15:08:22.045 INFO:teuthology.orchestra.run.smithi161.stdout:2687 read 0x3cf5cb thru 0x3d58b6 (0x62ec bytes) 2024-09-21T15:08:22.052 INFO:teuthology.orchestra.run.smithi161.stdout:2688 trunc from 0x3023fee to 0x5f55d56 2024-09-21T15:08:22.058 INFO:teuthology.orchestra.run.smithi161.stdout:2251 write 0xbee3418 thru 0xbeeb6f4 (0x82dd bytes) 2024-09-21T15:08:22.079 INFO:teuthology.orchestra.run.smithi161.stdout:1704 write 0xe282cc3 thru 0xe28430e (0x164c bytes) 2024-09-21T15:08:22.085 INFO:teuthology.orchestra.run.smithi161.stdout:2252 punch from 0x9875aab to 0x987884c, (0x2da1 bytes) 2024-09-21T15:08:22.085 INFO:teuthology.orchestra.run.smithi161.stdout:2253 punch from 0x345ec28 to 0x3466c6a, (0x8042 bytes) 2024-09-21T15:08:22.085 INFO:teuthology.orchestra.run.smithi161.stdout:2254 punch from 0x2f5a20d to 0x2f6406b, (0x9e5e bytes) 2024-09-21T15:08:22.085 INFO:teuthology.orchestra.run.smithi161.stdout:2255 read 0x178f8ca thru 0x179bf19 (0xc650 bytes) 2024-09-21T15:08:22.099 INFO:teuthology.orchestra.run.smithi161.stdout:1705 write 0xc310dac thru 0xc317608 (0x685d bytes) 2024-09-21T15:08:22.104 INFO:teuthology.orchestra.run.smithi161.stdout:2690 trunc from 0x5f55d56 to 0x43a7012 2024-09-21T15:08:22.108 INFO:teuthology.orchestra.run.smithi161.stdout:2256 trunc from 0xbeeb6f5 to 0x5f02e06 2024-09-21T15:08:22.113 INFO:teuthology.orchestra.run.smithi161.stdout:1885 read 0xe0bb86a thru 0xe0c9d3a (0xe4d1 bytes) 2024-09-21T15:08:22.115 INFO:teuthology.orchestra.run.smithi161.stdout:1886 write 0x94397e thru 0x944b30 (0x11b3 bytes) 2024-09-21T15:08:22.120 INFO:teuthology.orchestra.run.smithi161.stdout:1706 write 0x111eddd thru 0x112a4f6 (0xb71a bytes) 2024-09-21T15:08:22.125 INFO:teuthology.orchestra.run.smithi161.stdout:2060 writesame 0xe582edd thru 0xe586317 data_size 0x1(0x343b bytes) 2024-09-21T15:08:22.149 INFO:teuthology.orchestra.run.smithi161.stdout:2258 trunc from 0x5f02e06 to 0x417cdcb 2024-09-21T15:08:22.151 INFO:teuthology.orchestra.run.smithi161.stdout:2691 read 0x31e884e thru 0x31f0d30 (0x84e3 bytes) 2024-09-21T15:08:22.151 INFO:teuthology.orchestra.run.smithi161.stdout:2692 clone 14 order 18 su 1024 sc 13 2024-09-21T15:08:22.154 INFO:teuthology.orchestra.run.smithi161.stdout:2061 trunc from 0xe586318 to 0x43f8298 2024-09-21T15:08:22.202 INFO:teuthology.orchestra.run.smithi161.stdout:2260 writesame 0x1324977 thru 0x133137d data_size 0x1(0xca07 bytes) 2024-09-21T15:08:22.240 INFO:teuthology.orchestra.run.smithi161.stdout:1707 write 0x2dcf50c thru 0x2dd8372 (0x8e67 bytes) 2024-09-21T15:08:22.240 INFO:teuthology.orchestra.run.smithi161.stdout:2261 trunc from 0x417cdcb to 0x1a47e3c 2024-09-21T15:08:22.275 INFO:teuthology.orchestra.run.smithi161.stdout:2062 read 0x369cd39 thru 0x369e172 (0x143a bytes) 2024-09-21T15:08:22.275 INFO:teuthology.orchestra.run.smithi161.stdout:2063 read 0x36d0fc7 thru 0x36dfb66 (0xeba0 bytes) 2024-09-21T15:08:22.276 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:22.292 INFO:teuthology.orchestra.run.smithi161.stdout:1887 write 0x4d15bb1 thru 0x4d21c1b (0xc06b bytes) 2024-09-21T15:08:22.307 INFO:teuthology.orchestra.run.smithi161.stdout:2065 writesame 0x62ac232 thru 0x62b4890 data_size 0x1(0x865f bytes) 2024-09-21T15:08:22.312 INFO:teuthology.orchestra.run.smithi161.stdout:2066 read 0x1327cc8 thru 0x132d967 (0x5ca0 bytes) 2024-09-21T15:08:22.328 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:22.370 INFO:teuthology.orchestra.run.smithi161.stdout:2067 write 0x9e9ed84 thru 0x9ea8762 (0x99df bytes) 2024-09-21T15:08:22.379 INFO:teuthology.orchestra.run.smithi161.stdout:2263 write 0xedb35c3 thru 0xedb9b4b (0x6589 bytes) 2024-09-21T15:08:22.384 INFO:teuthology.orchestra.run.smithi161.stdout:1708 write 0xe7a709f thru 0xe7adcd3 (0x6c35 bytes) 2024-09-21T15:08:22.391 INFO:teuthology.orchestra.run.smithi161.stdout:2068 writesame 0x1e80786 thru 0x1e88c12 data_size 0x1(0x848d bytes) 2024-09-21T15:08:22.399 INFO:teuthology.orchestra.run.smithi161.stdout:1888 write 0x7ddf672 thru 0x7ddf797 (0x126 bytes) 2024-09-21T15:08:22.400 INFO:teuthology.orchestra.run.smithi161.stdout:2265 write 0x7cbfc45 thru 0x7cca346 (0xa702 bytes) 2024-09-21T15:08:22.409 INFO:teuthology.orchestra.run.smithi161.stdout:1709 write 0xcd68676 thru 0xcd74252 (0xbbdd bytes) 2024-09-21T15:08:22.418 INFO:teuthology.orchestra.run.smithi161.stdout:1946 write 0x388c0c2 thru 0x3892f4d (0x6e8c bytes) 2024-09-21T15:08:22.435 INFO:teuthology.orchestra.run.smithi161.stdout:2266 writesame 0x4bcce10 thru 0x4bcf4b9 data_size 0x1(0x26aa bytes) 2024-09-21T15:08:22.449 INFO:teuthology.orchestra.run.smithi161.stdout:2070 read 0x33fabdb thru 0x3402970 (0x7d96 bytes) 2024-09-21T15:08:22.455 INFO:teuthology.orchestra.run.smithi161.stdout:1710 writesame 0x6e99ef7 thru 0x6ea5ceb data_size 0x1(0xbdf5 bytes) 2024-09-21T15:08:22.465 INFO:teuthology.orchestra.run.smithi161.stdout:2071 read 0x52581b3 thru 0x525977d (0x15cb bytes) 2024-09-21T15:08:22.466 INFO:teuthology.orchestra.run.smithi161.stdout:2073 writesame 0x4e62634 thru 0x4e7209c data_size 0x1(0xfa69 bytes) 2024-09-21T15:08:22.473 INFO:teuthology.orchestra.run.smithi161.stdout:2267 write 0x3feb8fa thru 0x3ff0def (0x54f6 bytes) 2024-09-21T15:08:22.483 INFO:teuthology.orchestra.run.smithi161.stdout:1948 read 0x3cf05c7 thru 0x3cfa94b (0xa385 bytes) 2024-09-21T15:08:22.490 INFO:teuthology.orchestra.run.smithi161.stdout:1949 read 0x6064f99 thru 0x6070e23 (0xbe8b bytes) 2024-09-21T15:08:22.499 INFO:teuthology.orchestra.run.smithi161.stdout:1711 writesame 0xd7ec67a thru 0xd7f3f01 data_size 0x4c(0x7888 bytes) 2024-09-21T15:08:22.510 INFO:teuthology.orchestra.run.smithi161.stdout:2268 write 0xe156acb thru 0xe15f52e (0x8a64 bytes) 2024-09-21T15:08:22.519 INFO:teuthology.orchestra.run.smithi161.stdout:1713 write 0x28abc41 thru 0x28b84b6 (0xc876 bytes) 2024-09-21T15:08:22.526 INFO:teuthology.orchestra.run.smithi161.stdout:2269 write 0x4d64c76 thru 0x4d6c3f8 (0x7783 bytes) 2024-09-21T15:08:22.529 INFO:teuthology.orchestra.run.smithi161.stdout:2075 write 0x2f26028 thru 0x2f3356b (0xd544 bytes) 2024-09-21T15:08:22.539 INFO:teuthology.orchestra.run.smithi161.stdout:2270 read 0xcd2c354 thru 0xcd3aeaa (0xeb57 bytes) 2024-09-21T15:08:22.539 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:22.539 INFO:teuthology.orchestra.run.smithi161.stdout:2273 write 0x94a6795 thru 0x94afd43 (0x95af bytes) 2024-09-21T15:08:22.541 INFO:teuthology.orchestra.run.smithi161.stdout:1950 write 0xe29c823 thru 0xe2ac169 (0xf947 bytes) 2024-09-21T15:08:22.549 INFO:teuthology.orchestra.run.smithi161.stdout:1714 clone 21 order 18 su 16384 sc 2 2024-09-21T15:08:22.561 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:22.561 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:22.561 INFO:teuthology.orchestra.run.smithi161.stdout:2277 write 0x987faaa thru 0x988e85e (0xedb5 bytes) 2024-09-21T15:08:22.579 INFO:teuthology.orchestra.run.smithi161.stdout:1951 trunc from 0xe2ac16a to 0x5c32006 2024-09-21T15:08:22.591 INFO:teuthology.orchestra.run.smithi161.stdout:2278 write 0x882a185 thru 0x883345a (0x92d6 bytes) 2024-09-21T15:08:22.609 INFO:teuthology.orchestra.run.smithi161.stdout:2077 write 0xb900927 thru 0xb9046c6 (0x3da0 bytes) 2024-09-21T15:08:22.612 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:22.612 INFO:teuthology.orchestra.run.smithi161.stdout:2280 write 0x99052bb thru 0x9909f65 (0x4cab bytes) 2024-09-21T15:08:22.613 INFO:teuthology.orchestra.run.smithi161.stdout:1889 writesame 0x1165876 thru 0x116764f data_size 0x1(0x1dda bytes) 2024-09-21T15:08:22.625 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.1 2024-09-21T15:08:22.625 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:08:22.625 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.1 2024-09-21T15:08:22.625 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2024-09-21T15:08:22.625 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2024-09-21T15:08:22.626 INFO:teuthology.orchestra.run.smithi161.stdout:2281 write 0x4006216 thru 0x4012c82 (0xca6d bytes) 2024-09-21T15:08:22.627 INFO:teuthology.orchestra.run.smithi161.stdout:2078 trunc from 0xb9046c7 to 0xb1634fa 2024-09-21T15:08:22.628 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2024-09-21T15:08:22.628 INFO:tasks.rbd_mirror_thrash:waiting for 66 secs before thrashing 2024-09-21T15:08:22.629 INFO:teuthology.orchestra.run.smithi161.stdout:1890 clone 18 order 21 su 131072 sc 5 2024-09-21T15:08:22.654 INFO:teuthology.orchestra.run.smithi161.stdout:2080 read 0x781f4a thru 0x78aa38 (0x8aef bytes) 2024-09-21T15:08:22.655 INFO:teuthology.orchestra.run.smithi161.stdout:2081 read 0x78eae9 thru 0x78ecc8 (0x1e0 bytes) 2024-09-21T15:08:22.656 INFO:teuthology.orchestra.run.smithi161.stdout:2082 write 0x6a8684f thru 0x6a8b75e (0x4f10 bytes) 2024-09-21T15:08:22.668 INFO:teuthology.orchestra.run.smithi161.stdout:2282 trunc from 0xedb9b4c to 0x98a160 2024-09-21T15:08:22.701 INFO:teuthology.orchestra.run.smithi161.stdout:1952 writesame 0xc1da9fb thru 0xc1e480f data_size 0xd(0x9e15 bytes) 2024-09-21T15:08:22.711 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:22.711 INFO:teuthology.orchestra.run.smithi161.stdout:1954 read 0x330892e thru 0x3309182 (0x855 bytes) 2024-09-21T15:08:22.715 INFO:teuthology.orchestra.run.smithi161.stdout:1955 trunc from 0xc1e4810 to 0xeaadadb 2024-09-21T15:08:22.722 INFO:teuthology.orchestra.run.smithi161.stdout:2083 write 0xb24c67f thru 0xb253232 (0x6bb4 bytes) 2024-09-21T15:08:22.755 INFO:teuthology.orchestra.run.smithi161.stdout:2084 trunc from 0xb253233 to 0x57cf644 2024-09-21T15:08:22.759 INFO:teuthology.orchestra.run.smithi161.stdout:2283 writesame 0x83f3a6 thru 0x84d833 data_size 0x5(0xe48e bytes) 2024-09-21T15:08:22.763 INFO:teuthology.orchestra.run.smithi161.stdout:1958 punch from 0xe8da964 to 0xe8daf50, (0x5ec bytes) 2024-09-21T15:08:22.763 INFO:teuthology.orchestra.run.smithi161.stdout:1959 read 0x98caa77 thru 0x98d0bcc (0x6156 bytes) 2024-09-21T15:08:22.780 INFO:teuthology.orchestra.run.smithi161.stdout:1960 trunc from 0xeaadadb to 0x66e45af 2024-09-21T15:08:22.780 INFO:teuthology.orchestra.run.smithi161.stdout:2284 trunc from 0x98a160 to 0x4e56dd1 2024-09-21T15:08:22.799 INFO:teuthology.orchestra.run.smithi161.stdout:2085 read 0x311c09f thru 0x3126f3a (0xae9c bytes) 2024-09-21T15:08:22.799 INFO:teuthology.orchestra.run.smithi161.stdout:1961 writesame 0x2f122f1 thru 0x2f15b7a data_size 0x1(0x388a bytes) 2024-09-21T15:08:22.799 INFO:teuthology.orchestra.run.smithi161.stdout:2086 read 0x4223264 thru 0x4230539 (0xd2d6 bytes) 2024-09-21T15:08:22.801 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:22.801 INFO:teuthology.orchestra.run.smithi161.stdout:2089 punch from 0xd863d9 to 0xd904b1, (0xa0d8 bytes) 2024-09-21T15:08:22.801 INFO:teuthology.orchestra.run.smithi161.stdout:2092 writesame 0x33f55d9 thru 0x33fd4fb data_size 0x3(0x7f23 bytes) 2024-09-21T15:08:22.819 INFO:teuthology.orchestra.run.smithi161.stdout:2285 write 0x161e373 thru 0x162b34e (0xcfdc bytes) 2024-09-21T15:08:22.820 INFO:teuthology.orchestra.run.smithi161.stdout:2093 read 0x35a8798 thru 0x35ab4b6 (0x2d1f bytes) 2024-09-21T15:08:22.821 INFO:teuthology.orchestra.run.smithi161.stdout:1962 trunc from 0x66e45af to 0x87055b3 2024-09-21T15:08:22.855 INFO:teuthology.orchestra.run.smithi161.stdout:2286 trunc from 0x4e56dd1 to 0xa2441b2 2024-09-21T15:08:22.863 INFO:teuthology.orchestra.run.smithi161.stdout:1964 read 0x1ae16ca thru 0x1aeac46 (0x957d bytes) 2024-09-21T15:08:22.864 INFO:teuthology.orchestra.run.smithi161.stdout:1965 writesame 0x6d3ccbb thru 0x6d4057f data_size 0x1(0x38c5 bytes) 2024-09-21T15:08:22.876 INFO:teuthology.orchestra.run.smithi161.stdout:2094 writesame 0xe116961 thru 0xe11e11a data_size 0x19(0x77ba bytes) 2024-09-21T15:08:22.890 INFO:teuthology.orchestra.run.smithi161.stdout:2095 write 0x9d8a99 thru 0x9d99d9 (0xf41 bytes) 2024-09-21T15:08:22.900 INFO:teuthology.orchestra.run.smithi161.stdout:1966 trunc from 0x87055b3 to 0x2fab97e 2024-09-21T15:08:22.906 INFO:teuthology.orchestra.run.smithi161.stdout:2096 write 0x13f7315 thru 0x13f8a33 (0x171f bytes) 2024-09-21T15:08:22.911 INFO:teuthology.orchestra.run.smithi161.stdout:2289 clone 14 order 23 su 131072 sc 13 2024-09-21T15:08:22.917 INFO:teuthology.orchestra.run.smithi161.stdout:2097 write 0x1ab148 thru 0x1ae94e (0x3807 bytes) 2024-09-21T15:08:22.936 INFO:teuthology.orchestra.run.smithi161.stdout:2098 write 0xd6311b0 thru 0xd638d3b (0x7b8c bytes) 2024-09-21T15:08:22.967 INFO:teuthology.orchestra.run.smithi161.stdout:1967 read 0x192728f thru 0x192e4b9 (0x722b bytes) 2024-09-21T15:08:22.968 INFO:teuthology.orchestra.run.smithi161.stdout:1968 punch from 0x168a204 to 0x1692a74, (0x8870 bytes) 2024-09-21T15:08:22.968 INFO:teuthology.orchestra.run.smithi161.stdout:1970 read 0xf53e6f thru 0xf602d3 (0xc465 bytes) 2024-09-21T15:08:22.969 INFO:teuthology.orchestra.run.smithi161.stdout:1971 write 0x11431fd thru 0x114505d (0x1e61 bytes) 2024-09-21T15:08:22.969 INFO:teuthology.orchestra.run.smithi161.stdout:2099 trunc from 0xe11e11b to 0x4cdd3a9 2024-09-21T15:08:22.985 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone20 from 0xe7adcd4 (overlap 0xda629ba) to 0x575aa4a 2024-09-21T15:08:23.037 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #12, image image_cluster1.client.mirror.2-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent13 2024-09-21T15:08:23.045 INFO:teuthology.orchestra.run.smithi161.stdout:2102 read 0x1d5e27 thru 0x1da696 (0x4870 bytes) 2024-09-21T15:08:23.046 INFO:teuthology.orchestra.run.smithi161.stdout:2104 write 0x3ed73fb thru 0x3ee5a94 (0xe69a bytes) 2024-09-21T15:08:23.056 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone17 from 0xe5e12dd (overlap 0xe5e12dd) to 0x72f096e 2024-09-21T15:08:23.056 INFO:teuthology.orchestra.run.smithi161.stdout:1972 writesame 0xa4932b0 thru 0xa49cc1f data_size 0x28(0x9970 bytes) 2024-09-21T15:08:23.062 INFO:teuthology.orchestra.run.smithi161.stdout:2105 trunc from 0x4cdd3a9 to 0x8391cb8 2024-09-21T15:08:23.073 INFO:teuthology.orchestra.run.smithi161.stdout:1973 trunc from 0xa49cc20 to 0x3d4da21 2024-09-21T15:08:23.135 INFO:teuthology.orchestra.run.smithi161.stdout:1978 trunc from 0x3d4da21 to 0x8e93edb 2024-09-21T15:08:23.171 INFO:teuthology.orchestra.run.smithi161.stdout:1979 read 0x87656ae thru 0x876e673 (0x8fc6 bytes) 2024-09-21T15:08:23.181 INFO:teuthology.orchestra.run.smithi161.stdout:1980 trunc from 0x8e93edb to 0x310258a 2024-09-21T15:08:23.186 INFO:teuthology.orchestra.run.smithi161.stdout:2106 read 0x6d19e1f thru 0x6d1c17b (0x235d bytes) 2024-09-21T15:08:23.186 INFO:teuthology.orchestra.run.smithi161.stdout:2109 write 0x1a2c31c thru 0x1a2d864 (0x1549 bytes) 2024-09-21T15:08:23.225 INFO:teuthology.orchestra.run.smithi161.stdout:1981 read 0x8c1637 thru 0x8cbee2 (0xa8ac bytes) 2024-09-21T15:08:23.227 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:23.227 INFO:teuthology.orchestra.run.smithi161.stdout:1985 punch from 0x4cd429 to 0x4d1598, (0x416f bytes) 2024-09-21T15:08:23.227 INFO:teuthology.orchestra.run.smithi161.stdout:1986 punch from 0x25783a8 to 0x2581884, (0x94dc bytes) 2024-09-21T15:08:23.227 INFO:teuthology.orchestra.run.smithi161.stdout:1987 read 0xde97f5 thru 0xdeee86 (0x5692 bytes) 2024-09-21T15:08:23.227 INFO:teuthology.orchestra.run.smithi161.stdout:1988 read 0xc43020 thru 0xc4f51e (0xc4ff bytes) 2024-09-21T15:08:23.228 INFO:teuthology.orchestra.run.smithi161.stdout:1989 read 0x25350c3 thru 0x2540b77 (0xbab5 bytes) 2024-09-21T15:08:23.228 INFO:teuthology.orchestra.run.smithi161.stdout:1990 read 0x216836e thru 0x216a013 (0x1ca6 bytes) 2024-09-21T15:08:23.229 INFO:teuthology.orchestra.run.smithi161.stdout:1991 read 0xb71f42 thru 0xb7e934 (0xc9f3 bytes) 2024-09-21T15:08:23.229 INFO:teuthology.orchestra.run.smithi161.stdout:1992 read 0x1000059 thru 0x1004797 (0x473f bytes) 2024-09-21T15:08:23.252 INFO:teuthology.orchestra.run.smithi161.stdout:1993 punch from 0x17b8fd4 to 0x17c139b, (0x83c7 bytes) 2024-09-21T15:08:23.293 INFO:teuthology.orchestra.run.smithi161.stdout:1995 writesame 0x5eb3cde thru 0x5ebf3a2 data_size 0x1(0xb6c5 bytes) 2024-09-21T15:08:23.299 INFO:teuthology.orchestra.run.smithi161.stdout:1996 read 0x383345b thru 0x383683b (0x33e1 bytes) 2024-09-21T15:08:23.300 INFO:teuthology.orchestra.run.smithi161.stdout:1997 punch from 0x114d288 to 0x1151cae, (0x4a26 bytes) 2024-09-21T15:08:23.309 INFO:teuthology.orchestra.run.smithi161.stdout:1998 trunc from 0x5ebf3a3 to 0x9ff7d43 2024-09-21T15:08:23.469 INFO:teuthology.orchestra.run.smithi161.stdout:1999 read 0x1634a59 thru 0x163b91f (0x6ec7 bytes) 2024-09-21T15:08:23.470 INFO:teuthology.orchestra.run.smithi161.stdout:2000 read 0x94f2c62 thru 0x94f6cf2 (0x4091 bytes) 2024-09-21T15:08:23.470 INFO:teuthology.orchestra.run.smithi161.stdout:2002 read 0x7c82230 thru 0x7c853d6 (0x31a7 bytes) 2024-09-21T15:08:23.470 INFO:teuthology.orchestra.run.smithi161.stdout:2004 read 0x5ca1782 thru 0x5cad6a3 (0xbf22 bytes) 2024-09-21T15:08:23.563 INFO:teuthology.orchestra.run.smithi161.stdout:2005 writesame 0xc501876 thru 0xc508c25 data_size 0x18(0x73b0 bytes) 2024-09-21T15:08:23.571 INFO:teuthology.orchestra.run.smithi161.stdout:2006 read 0x514a694 thru 0x5151c38 (0x75a5 bytes) 2024-09-21T15:08:23.572 INFO:teuthology.orchestra.run.smithi161.stdout:2007 flatten 2024-09-21T15:08:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:2110 write 0x94cc92e thru 0x94d5ed0 (0x95a3 bytes) 2024-09-21T15:08:23.618 INFO:teuthology.orchestra.run.smithi161.stdout:2111 write 0x5f643e4 thru 0x5f679d0 (0x35ed bytes) 2024-09-21T15:08:23.649 INFO:teuthology.orchestra.run.smithi161.stdout:2113 trunc from 0x94d5ed1 to 0x415b4b4 2024-09-21T15:08:23.818 INFO:teuthology.orchestra.run.smithi161.stdout:2115 read 0x37b408 thru 0x37bb77 (0x770 bytes) 2024-09-21T15:08:23.946 INFO:teuthology.orchestra.run.smithi161.stdout:2116 writesame 0x4912b3c thru 0x49229fd data_size 0x1(0xfec2 bytes) 2024-09-21T15:08:23.966 INFO:teuthology.orchestra.run.smithi161.stdout:2118 read 0x678963 thru 0x67f867 (0x6f05 bytes) 2024-09-21T15:08:23.974 INFO:teuthology.orchestra.run.smithi161.stdout:2119 read 0x28ca795 thru 0x28d7417 (0xcc83 bytes) 2024-09-21T15:08:23.976 INFO:teuthology.orchestra.run.smithi161.stdout:2120 writesame 0x2a79512 thru 0x2a82a25 data_size 0x7(0x9514 bytes) 2024-09-21T15:08:23.999 INFO:teuthology.orchestra.run.smithi161.stdout:2121 read 0x12f201c thru 0x12f7d92 (0x5d77 bytes) 2024-09-21T15:08:24.000 INFO:teuthology.orchestra.run.smithi161.stdout:2122 write 0x6b76a8 thru 0x6c2cfa (0xb653 bytes) 2024-09-21T15:08:24.018 INFO:teuthology.orchestra.run.smithi161.stdout:2008 punch from 0x7e4dbff to 0x7e4df7c, (0x37d bytes) 2024-09-21T15:08:24.018 INFO:teuthology.orchestra.run.smithi161.stdout:2010 read 0x7edfd6 thru 0x7f4877 (0x68a2 bytes) 2024-09-21T15:08:24.018 INFO:teuthology.orchestra.run.smithi161.stdout:2012 write 0x7620411 thru 0x762fd79 (0xf969 bytes) 2024-09-21T15:08:24.069 INFO:teuthology.orchestra.run.smithi161.stdout:2693 write 0xea77321 thru 0xea7bec7 (0x4ba7 bytes) 2024-09-21T15:08:24.069 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:24.079 INFO:teuthology.orchestra.run.smithi161.stdout:2125 trunc from 0x49229fe to 0x8c24c3 2024-09-21T15:08:24.099 INFO:teuthology.orchestra.run.smithi161.stdout:2013 punch from 0x365d65d to 0x365f83c, (0x21df bytes) 2024-09-21T15:08:24.099 INFO:teuthology.orchestra.run.smithi161.stdout:2014 write 0x628bb97 thru 0x6291253 (0x56bd bytes) 2024-09-21T15:08:24.163 INFO:teuthology.orchestra.run.smithi161.stdout:2016 trunc from 0xc508c26 to 0xa6aa32a 2024-09-21T15:08:24.191 INFO:teuthology.orchestra.run.smithi161.stdout:2694 write 0xb41e137 thru 0xb41f623 (0x14ed bytes) 2024-09-21T15:08:24.224 INFO:teuthology.orchestra.run.smithi161.stdout:2696 writesame 0x635745f thru 0x635f760 data_size 0x29(0x8302 bytes) 2024-09-21T15:08:24.229 INFO:teuthology.orchestra.run.smithi161.stdout:2126 read 0x652440 thru 0x653285 (0xe46 bytes) 2024-09-21T15:08:24.231 INFO:teuthology.orchestra.run.smithi161.stdout:2127 punch from 0x4e9266 to 0x4ea442, (0x11dc bytes) 2024-09-21T15:08:24.231 INFO:teuthology.orchestra.run.smithi161.stdout:2128 read 0x23d354 thru 0x24a9f4 (0xd6a1 bytes) 2024-09-21T15:08:24.298 INFO:teuthology.orchestra.run.smithi161.stdout:2697 read 0x6c35c66 thru 0x6c39b8d (0x3f28 bytes) 2024-09-21T15:08:24.298 INFO:teuthology.orchestra.run.smithi161.stdout:2698 read 0xa36a49a thru 0xa3757a4 (0xb30b bytes) 2024-09-21T15:08:24.298 INFO:teuthology.orchestra.run.smithi161.stdout:2699 write 0x9393aa thru 0x940565 (0x71bc bytes) 2024-09-21T15:08:24.327 INFO:teuthology.orchestra.run.smithi161.stdout:2019 writesame 0x21d232d thru 0x21d9197 data_size 0x1(0x6e6b bytes) 2024-09-21T15:08:24.333 INFO:teuthology.orchestra.run.smithi161.stdout:2129 writesame 0xb598ab6 thru 0xb59c6b7 data_size 0x1(0x3c02 bytes) 2024-09-21T15:08:24.362 INFO:teuthology.orchestra.run.smithi161.stdout:2130 write 0x823104f thru 0x8231e1c (0xdce bytes) 2024-09-21T15:08:24.371 INFO:teuthology.orchestra.run.smithi161.stdout:2020 read 0x6e1969c thru 0x6e21ef1 (0x8856 bytes) 2024-09-21T15:08:24.371 INFO:teuthology.orchestra.run.smithi161.stdout:2022 read 0x92cccaa thru 0x92d508d (0x83e4 bytes) 2024-09-21T15:08:24.371 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:24.371 INFO:teuthology.orchestra.run.smithi161.stdout:2025 write 0x263f487 thru 0x264a8eb (0xb465 bytes) 2024-09-21T15:08:24.427 INFO:teuthology.orchestra.run.smithi161.stdout:2026 read 0x97378d9 thru 0x974242a (0xab52 bytes) 2024-09-21T15:08:24.427 INFO:teuthology.orchestra.run.smithi161.stdout:2027 read 0x57dd017 thru 0x57e377d (0x6767 bytes) 2024-09-21T15:08:24.427 INFO:teuthology.orchestra.run.smithi161.stdout:2028 write 0x367a3de thru 0x367b52c (0x114f bytes) 2024-09-21T15:08:24.461 INFO:teuthology.orchestra.run.smithi161.stdout:2031 read 0x6c5c08c thru 0x6c6a885 (0xe7fa bytes) 2024-09-21T15:08:24.461 INFO:teuthology.orchestra.run.smithi161.stdout:2032 punch from 0x349498c to 0x349a783, (0x5df7 bytes) 2024-09-21T15:08:24.461 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:24.461 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:24.461 INFO:teuthology.orchestra.run.smithi161.stdout:2037 clone 17 order 24 su 65536 sc 2 2024-09-21T15:08:24.500 INFO:teuthology.orchestra.run.smithi161.stdout:2132 punch from 0x5208471 to 0x520957d, (0x110c bytes) 2024-09-21T15:08:24.500 INFO:teuthology.orchestra.run.smithi161.stdout:2133 read 0x66359c3 thru 0x663638d (0x9cb bytes) 2024-09-21T15:08:24.500 INFO:teuthology.orchestra.run.smithi161.stdout:2134 read 0xab3db1 thru 0xab4a59 (0xca9 bytes) 2024-09-21T15:08:24.501 INFO:teuthology.orchestra.run.smithi161.stdout:2135 write 0x1fec4be thru 0x1ff3147 (0x6c8a bytes) 2024-09-21T15:08:24.553 INFO:teuthology.orchestra.run.smithi161.stdout:2701 read 0x5011b60 thru 0x501d582 (0xba23 bytes) 2024-09-21T15:08:24.553 INFO:teuthology.orchestra.run.smithi161.stdout:2703 read 0x3a4a218 thru 0x3a55832 (0xb61b bytes) 2024-09-21T15:08:24.564 INFO:teuthology.orchestra.run.smithi161.stdout:2704 punch from 0x2117bb1 to 0x212394c, (0xbd9b bytes) 2024-09-21T15:08:24.564 INFO:teuthology.orchestra.run.smithi161.stdout:2705 punch from 0x4036272 to 0x4040784, (0xa512 bytes) 2024-09-21T15:08:24.564 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:24.564 INFO:teuthology.orchestra.run.smithi161.stdout:2707 punch from 0x3918ce6 to 0x3927214, (0xe52e bytes) 2024-09-21T15:08:24.564 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:24.565 INFO:teuthology.orchestra.run.smithi161.stdout:2709 punch from 0x9aebecd to 0x9af13f8, (0x552b bytes) 2024-09-21T15:08:24.565 INFO:teuthology.orchestra.run.smithi161.stdout:2710 write 0xa4d8c15 thru 0xa4da682 (0x1a6e bytes) 2024-09-21T15:08:24.607 INFO:teuthology.orchestra.run.smithi161.stdout:2136 punch from 0x4cf5777 to 0x4cf8122, (0x29ab bytes) 2024-09-21T15:08:24.608 INFO:teuthology.orchestra.run.smithi161.stdout:2139 read 0x207493f thru 0x207b91d (0x6fdf bytes) 2024-09-21T15:08:24.608 INFO:teuthology.orchestra.run.smithi161.stdout:2140 write 0x6af6fb1 thru 0x6af7438 (0x488 bytes) 2024-09-21T15:08:24.613 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:24.614 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:24.614 INFO:teuthology.orchestra.run.smithi161.stdout:2715 write 0xa60ccf1 thru 0xa61be60 (0xf170 bytes) 2024-09-21T15:08:24.631 INFO:teuthology.orchestra.run.smithi161.stdout:2141 punch from 0x2dfcbcc to 0x2dfe71d, (0x1b51 bytes) 2024-09-21T15:08:24.631 INFO:teuthology.orchestra.run.smithi161.stdout:2142 read 0x1730cbb thru 0x1738a7b (0x7dc1 bytes) 2024-09-21T15:08:24.632 INFO:teuthology.orchestra.run.smithi161.stdout:2143 punch from 0x5b858f1 to 0x5b923cc, (0xcadb bytes) 2024-09-21T15:08:24.633 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #12, image image_cluster1.client.mirror.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent13 2024-09-21T15:08:24.639 INFO:teuthology.orchestra.run.smithi161.stdout:2144 trunc from 0xb59c6b8 to 0xe635617 2024-09-21T15:08:24.753 INFO:teuthology.orchestra.run.smithi161.stdout:2290 read 0x12e0a04 thru 0x12eff3c (0xf539 bytes) 2024-09-21T15:08:24.754 INFO:teuthology.orchestra.run.smithi161.stdout:2716 writesame 0x717ddaa thru 0x7185960 data_size 0x45(0x7bb7 bytes) 2024-09-21T15:08:24.796 INFO:teuthology.orchestra.run.smithi161.stdout:2146 writesame 0x8a43f86 thru 0x8a4e7da data_size 0x1(0xa855 bytes) 2024-09-21T15:08:24.820 INFO:teuthology.orchestra.run.smithi161.stdout:2291 trunc from 0xa2441b2 to 0x51bf903 2024-09-21T15:08:24.844 INFO:teuthology.orchestra.run.smithi161.stdout:2147 write 0x7d072e3 thru 0x7d0ed4b (0x7a69 bytes) 2024-09-21T15:08:24.846 INFO:teuthology.orchestra.run.smithi161.stdout:2718 read 0xc562ee thru 0xc59c2e (0x3941 bytes) 2024-09-21T15:08:24.849 INFO:teuthology.orchestra.run.smithi161.stdout:2719 read 0x1c7247e thru 0x1c8201d (0xfba0 bytes) 2024-09-21T15:08:24.901 INFO:teuthology.orchestra.run.smithi161.stdout:2148 read 0x67d61c7 thru 0x67d66d3 (0x50d bytes) 2024-09-21T15:08:24.901 INFO:teuthology.orchestra.run.smithi161.stdout:2150 write 0x4774672 thru 0x4778353 (0x3ce2 bytes) 2024-09-21T15:08:24.905 INFO:teuthology.orchestra.run.smithi161.stdout:2721 read 0xa36f46d thru 0xa37b6ae (0xc242 bytes) 2024-09-21T15:08:24.907 INFO:teuthology.orchestra.run.smithi161.stdout:2722 write 0xcb68149 thru 0xcb72aeb (0xa9a3 bytes) 2024-09-21T15:08:24.925 INFO:teuthology.orchestra.run.smithi161.stdout:2151 write 0xde1f6a7 thru 0xde2c7aa (0xd104 bytes) 2024-09-21T15:08:24.950 INFO:teuthology.orchestra.run.smithi161.stdout:2723 punch from 0x9b5284 to 0x9bf9fc, (0xa778 bytes) 2024-09-21T15:08:24.950 INFO:teuthology.orchestra.run.smithi161.stdout:2724 write 0xbc9bf91 thru 0xbca0357 (0x43c7 bytes) 2024-09-21T15:08:24.959 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:24.983 INFO:teuthology.orchestra.run.smithi161.stdout:2293 read 0x2131141 thru 0x21398a7 (0x8767 bytes) 2024-09-21T15:08:24.985 INFO:teuthology.orchestra.run.smithi161.stdout:2295 punch from 0x30bb7c8 to 0x30c375b, (0x7f93 bytes) 2024-09-21T15:08:24.985 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:24.985 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:24.985 INFO:teuthology.orchestra.run.smithi161.stdout:2298 write 0x399c644 thru 0x399e1d8 (0x1b95 bytes) 2024-09-21T15:08:24.988 INFO:teuthology.orchestra.run.smithi161.stdout:2725 read 0x5ea34df thru 0x5eae6fa (0xb21c bytes) 2024-09-21T15:08:24.988 INFO:teuthology.orchestra.run.smithi161.stdout:2726 write 0x662b6fe thru 0x662f97f (0x4282 bytes) 2024-09-21T15:08:24.990 INFO:teuthology.orchestra.run.smithi161.stdout:2299 punch from 0x3e10169 to 0x3e18e02, (0x8c99 bytes) 2024-09-21T15:08:24.991 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:24.991 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:25.015 INFO:teuthology.orchestra.run.smithi161.stdout:2153 write 0xe656989 thru 0xe659913 (0x2f8b bytes) 2024-09-21T15:08:25.024 INFO:teuthology.orchestra.run.smithi161.stdout:2154 punch from 0x7fd4639 to 0x7fdc8e6, (0x82ad bytes) 2024-09-21T15:08:25.024 INFO:teuthology.orchestra.run.smithi161.stdout:2155 writesame 0x62a72ef thru 0x62b5364 data_size 0x1(0xe076 bytes) 2024-09-21T15:08:25.026 INFO:teuthology.orchestra.run.smithi161.stdout:2727 trunc from 0xea7bec8 to 0xa561a52 2024-09-21T15:08:25.076 INFO:teuthology.orchestra.run.smithi161.stdout:2157 read 0x8757a58 thru 0x87626e3 (0xac8c bytes) 2024-09-21T15:08:25.076 INFO:teuthology.orchestra.run.smithi161.stdout:2158 read 0xbb55b33 thru 0xbb55e55 (0x323 bytes) 2024-09-21T15:08:25.077 INFO:teuthology.orchestra.run.smithi161.stdout:2159 read 0x3d0b2af thru 0x3d16195 (0xaee7 bytes) 2024-09-21T15:08:25.077 INFO:teuthology.orchestra.run.smithi161.stdout:2161 read 0xbda6d39 thru 0xbdb5729 (0xe9f1 bytes) 2024-09-21T15:08:25.077 INFO:teuthology.orchestra.run.smithi161.stdout:2163 write 0x8c7f47f thru 0x8c80588 (0x110a bytes) 2024-09-21T15:08:25.088 INFO:teuthology.orchestra.run.smithi161.stdout:2302 writesame 0xc8d5eb1 thru 0xc8e35d0 data_size 0x10(0xd720 bytes) 2024-09-21T15:08:25.095 INFO:teuthology.orchestra.run.smithi161.stdout:2164 writesame 0xb95ef9f thru 0xb964ed8 data_size 0x33(0x5f3a bytes) 2024-09-21T15:08:25.096 INFO:teuthology.orchestra.run.smithi161.stdout:2304 flatten 2024-09-21T15:08:25.120 INFO:teuthology.orchestra.run.smithi161.stdout:2166 write 0x38dc6a6 thru 0x38dda3c (0x1397 bytes) 2024-09-21T15:08:25.130 INFO:teuthology.orchestra.run.smithi161.stdout:2167 write 0xa490c90 thru 0xa499f32 (0x92a3 bytes) 2024-09-21T15:08:25.139 INFO:teuthology.orchestra.run.smithi161.stdout:2305 write 0x7a2e473 thru 0x7a3913e (0xaccc bytes) 2024-09-21T15:08:25.143 INFO:teuthology.orchestra.run.smithi161.stdout:2168 write 0xc43b431 thru 0xc449aab (0xe67b bytes) 2024-09-21T15:08:25.164 INFO:teuthology.orchestra.run.smithi161.stdout:2728 punch from 0x15c91ea to 0x15d4943, (0xb759 bytes) 2024-09-21T15:08:25.164 INFO:teuthology.orchestra.run.smithi161.stdout:2729 read 0x363ae6c thru 0x3642a9f (0x7c34 bytes) 2024-09-21T15:08:25.167 INFO:teuthology.orchestra.run.smithi161.stdout:2169 write 0x1882023 thru 0x1887c6d (0x5c4b bytes) 2024-09-21T15:08:25.181 INFO:teuthology.orchestra.run.smithi161.stdout:2306 write 0x9878d3c thru 0x9888cdb (0xffa0 bytes) 2024-09-21T15:08:25.187 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:25.187 INFO:teuthology.orchestra.run.smithi161.stdout:2171 read 0x3bc8f8 thru 0x3bd07f (0x788 bytes) 2024-09-21T15:08:25.187 INFO:teuthology.orchestra.run.smithi161.stdout:2172 write 0xbae8ec thru 0xbaf037 (0x74c bytes) 2024-09-21T15:08:25.198 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:25.198 INFO:teuthology.orchestra.run.smithi161.stdout:2176 punch from 0x5e574aa to 0x5e5c5da, (0x5130 bytes) 2024-09-21T15:08:25.198 INFO:teuthology.orchestra.run.smithi161.stdout:2178 writesame 0x1502b2d thru 0x1507e52 data_size 0x1d(0x5326 bytes) 2024-09-21T15:08:25.204 INFO:teuthology.orchestra.run.smithi161.stdout:2731 write 0xe43041a thru 0xe43aab7 (0xa69e bytes) 2024-09-21T15:08:25.207 INFO:teuthology.orchestra.run.smithi161.stdout:2179 read 0x189dd50 thru 0x18abc0e (0xdebf bytes) 2024-09-21T15:08:25.207 INFO:teuthology.orchestra.run.smithi161.stdout:2180 read 0x98bb3fa thru 0x98c194e (0x6555 bytes) 2024-09-21T15:08:25.208 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:25.226 INFO:teuthology.orchestra.run.smithi161.stdout:2185 trunc from 0xe659914 to 0x5b474af 2024-09-21T15:08:25.277 INFO:teuthology.orchestra.run.smithi161.stdout:2732 trunc from 0xe43aab8 to 0xc0578cd 2024-09-21T15:08:25.303 INFO:teuthology.orchestra.run.smithi161.stdout:2309 punch from 0xa8c2063 to 0xa8cfe66, (0xde03 bytes) 2024-09-21T15:08:25.304 INFO:teuthology.orchestra.run.smithi161.stdout:2311 write 0x532835a thru 0x532d08f (0x4d36 bytes) 2024-09-21T15:08:25.307 INFO:teuthology.orchestra.run.smithi161.stdout:2186 trunc from 0x5b474af to 0x4cc1c2a 2024-09-21T15:08:25.316 INFO:teuthology.orchestra.run.smithi161.stdout:2314 read 0x8573b3e thru 0x8578f21 (0x53e4 bytes) 2024-09-21T15:08:25.316 INFO:teuthology.orchestra.run.smithi161.stdout:2315 read 0x67285f8 thru 0x6734c64 (0xc66d bytes) 2024-09-21T15:08:25.317 INFO:teuthology.orchestra.run.smithi161.stdout:2316 writesame 0xc4af1d7 thru 0xc4b9d44 data_size 0x1(0xab6e bytes) 2024-09-21T15:08:25.348 INFO:teuthology.orchestra.run.smithi161.stdout:2733 write 0x7ffea77 thru 0x8009e5d (0xb3e7 bytes) 2024-09-21T15:08:25.355 INFO:teuthology.orchestra.run.smithi161.stdout:2187 punch from 0x3060bf to 0x30967f, (0x35c0 bytes) 2024-09-21T15:08:25.366 INFO:teuthology.orchestra.run.smithi161.stdout:2317 trunc from 0xc8e35d1 to 0xa30787b 2024-09-21T15:08:25.383 INFO:teuthology.orchestra.run.smithi161.stdout:2734 writesame 0xb8d9bf6 thru 0xb8db300 data_size 0x1(0x170b bytes) 2024-09-21T15:08:25.403 INFO:teuthology.orchestra.run.smithi161.stdout:2188 write 0x817f12a thru 0x818aafb (0xb9d2 bytes) 2024-09-21T15:08:25.405 INFO:teuthology.orchestra.run.smithi161.stdout:2735 read 0x8aa7cca thru 0x8aadaaf (0x5de6 bytes) 2024-09-21T15:08:25.405 INFO:teuthology.orchestra.run.smithi161.stdout:2736 read 0x1047140 thru 0x1056454 (0xf315 bytes) 2024-09-21T15:08:25.446 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:25.446 INFO:teuthology.orchestra.run.smithi161.stdout:2322 write 0x1258a97 thru 0x125f597 (0x6b01 bytes) 2024-09-21T15:08:25.448 INFO:teuthology.orchestra.run.smithi161.stdout:2190 write 0xa223921 thru 0xa224f9d (0x167d bytes) 2024-09-21T15:08:25.455 INFO:teuthology.orchestra.run.smithi161.stdout:2192 write 0x7978f67 thru 0x79838e5 (0xa97f bytes) 2024-09-21T15:08:25.466 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #16, image image_cluster1.client.mirror.4-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent17 2024-09-21T15:08:25.467 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:25.467 INFO:teuthology.orchestra.run.smithi161.stdout:2196 read 0x8db9a64 thru 0x8dbb4e6 (0x1a83 bytes) 2024-09-21T15:08:25.474 INFO:teuthology.orchestra.run.smithi161.stdout:2737 write 0xbabb8fa thru 0xbac1a5c (0x6163 bytes) 2024-09-21T15:08:25.475 INFO:teuthology.orchestra.run.smithi161.stdout:2197 trunc from 0xa224f9e to 0x6d4c91a 2024-09-21T15:08:25.516 INFO:teuthology.orchestra.run.smithi161.stdout:2323 punch from 0x169cf75 to 0x16a259b, (0x5626 bytes) 2024-09-21T15:08:25.517 INFO:teuthology.orchestra.run.smithi161.stdout:2739 write 0x911ff52 thru 0x912b332 (0xb3e1 bytes) 2024-09-21T15:08:25.517 INFO:teuthology.orchestra.run.smithi161.stdout:2324 punch from 0x2cc112c to 0x2cced03, (0xdbd7 bytes) 2024-09-21T15:08:25.517 INFO:teuthology.orchestra.run.smithi161.stdout:2325 write 0x3d5c2e2 thru 0x3d678e8 (0xb607 bytes) 2024-09-21T15:08:25.559 INFO:teuthology.orchestra.run.smithi161.stdout:2741 read 0x326630 thru 0x334fa5 (0xe976 bytes) 2024-09-21T15:08:25.570 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:25.570 INFO:teuthology.orchestra.run.smithi161.stdout:2200 read 0x60a9199 thru 0x60af27f (0x60e7 bytes) 2024-09-21T15:08:25.570 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:25.570 INFO:teuthology.orchestra.run.smithi161.stdout:2202 writesame 0x5eedb0e thru 0x5eee2b3 data_size 0x2(0x7a6 bytes) 2024-09-21T15:08:25.576 INFO:teuthology.orchestra.run.smithi161.stdout:2742 read 0x97be945 thru 0x97c71cd (0x8889 bytes) 2024-09-21T15:08:25.576 INFO:teuthology.orchestra.run.smithi161.stdout:2745 write 0x676b5f3 thru 0x6770b8e (0x559c bytes) 2024-09-21T15:08:25.596 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #15, image image_cluster1.client.mirror.5-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent16 2024-09-21T15:08:25.597 INFO:teuthology.orchestra.run.smithi161.stdout:2204 punch from 0x3f2dea7 to 0x3f33e13, (0x5f6c bytes) 2024-09-21T15:08:25.597 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:25.601 INFO:teuthology.orchestra.run.smithi161.stdout:2746 punch from 0x38e0c55 to 0x38ec247, (0xb5f2 bytes) 2024-09-21T15:08:25.601 INFO:teuthology.orchestra.run.smithi161.stdout:2747 write 0x9ee9ce7 thru 0x9eea8bc (0xbd6 bytes) 2024-09-21T15:08:25.609 INFO:teuthology.orchestra.run.smithi161.stdout:2326 write 0xd7edeb8 thru 0xd7f7e71 (0x9fba bytes) 2024-09-21T15:08:25.609 INFO:teuthology.orchestra.run.smithi161.stdout:2206 trunc from 0x6d4c91a to 0xc99b1bf 2024-09-21T15:08:25.686 INFO:teuthology.orchestra.run.smithi161.stdout:2327 write 0x652158a thru 0x652966a (0x80e1 bytes) 2024-09-21T15:08:25.708 INFO:teuthology.orchestra.run.smithi161.stdout:2038 read 0x5ad3b4 thru 0x5b1620 (0x426d bytes) 2024-09-21T15:08:25.714 INFO:teuthology.orchestra.run.smithi161.stdout:2208 read 0x3a68b45 thru 0x3a6ed59 (0x6215 bytes) 2024-09-21T15:08:25.715 INFO:teuthology.orchestra.run.smithi161.stdout:2209 read 0xa2c4ea9 thru 0xa2c786c (0x29c4 bytes) 2024-09-21T15:08:25.719 INFO:teuthology.orchestra.run.smithi161.stdout:2210 trunc from 0xc99b1bf to 0xe96626d 2024-09-21T15:08:25.757 INFO:teuthology.orchestra.run.smithi161.stdout:2328 writesame 0xcca6f65 thru 0xccb3dcd data_size 0x1(0xce69 bytes) 2024-09-21T15:08:25.793 INFO:teuthology.orchestra.run.smithi161.stdout:2748 write 0xd5db7bb thru 0xd5e9425 (0xdc6b bytes) 2024-09-21T15:08:25.807 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:25.807 INFO:teuthology.orchestra.run.smithi161.stdout:2332 write 0xb6a5296 thru 0xb6b0fee (0xbd59 bytes) 2024-09-21T15:08:25.835 INFO:teuthology.orchestra.run.smithi161.stdout:2039 write 0x770f489 thru 0x77177ff (0x8377 bytes) 2024-09-21T15:08:25.839 INFO:teuthology.orchestra.run.smithi161.stdout:2213 punch from 0x1a0cef to 0x1aad22, (0xa033 bytes) 2024-09-21T15:08:25.839 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:25.839 INFO:teuthology.orchestra.run.smithi161.stdout:2216 read 0x3b59a13 thru 0x3b5e2cf (0x48bd bytes) 2024-09-21T15:08:25.839 INFO:teuthology.orchestra.run.smithi161.stdout:2217 read 0x27170e4 thru 0x27258f0 (0xe80d bytes) 2024-09-21T15:08:25.840 INFO:teuthology.orchestra.run.smithi161.stdout:2218 punch from 0x87d5f8f to 0x87e5a50, (0xfac1 bytes) 2024-09-21T15:08:25.840 INFO:teuthology.orchestra.run.smithi161.stdout:2219 clone 14 order 25 su 4194304 sc 11 2024-09-21T15:08:25.875 INFO:teuthology.orchestra.run.smithi161.stdout:2333 write 0xb2d572f thru 0xb2e3487 (0xdd59 bytes) 2024-09-21T15:08:25.884 INFO:teuthology.orchestra.run.smithi161.stdout:2749 write 0x7419e9a thru 0x7419f36 (0x9d bytes) 2024-09-21T15:08:25.889 INFO:teuthology.orchestra.run.smithi161.stdout:2040 read 0xa287af1 thru 0xa28f838 (0x7d48 bytes) 2024-09-21T15:08:25.889 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:25.889 INFO:teuthology.orchestra.run.smithi161.stdout:2042 write 0x561be92 thru 0x561dd3a (0x1ea9 bytes) 2024-09-21T15:08:25.900 INFO:teuthology.orchestra.run.smithi161.stdout:2334 write 0x857c049 thru 0x8586510 (0xa4c8 bytes) 2024-09-21T15:08:25.919 INFO:teuthology.orchestra.run.smithi161.stdout:2044 write 0x54966ec thru 0x549c469 (0x5d7e bytes) 2024-09-21T15:08:25.924 INFO:teuthology.orchestra.run.smithi161.stdout:2335 write 0xa3b87e7 thru 0xa3bd0ea (0x4904 bytes) 2024-09-21T15:08:25.946 INFO:teuthology.orchestra.run.smithi161.stdout:2336 read 0x8988aba thru 0x898f12e (0x6675 bytes) 2024-09-21T15:08:25.947 INFO:teuthology.orchestra.run.smithi161.stdout:2046 read 0xab1fb thru 0xaca93 (0x1899 bytes) 2024-09-21T15:08:25.947 INFO:teuthology.orchestra.run.smithi161.stdout:2337 read 0x7224385 thru 0x7226a84 (0x2700 bytes) 2024-09-21T15:08:25.947 INFO:teuthology.orchestra.run.smithi161.stdout:2338 read 0xa054459 thru 0xa057f83 (0x3b2b bytes) 2024-09-21T15:08:25.947 INFO:teuthology.orchestra.run.smithi161.stdout:2339 writesame 0xbd310ba thru 0xbd3bb09 data_size 0x28(0xaa50 bytes) 2024-09-21T15:08:25.948 INFO:teuthology.orchestra.run.smithi161.stdout:2047 punch from 0x871593f to 0x8716f7d, (0x163e bytes) 2024-09-21T15:08:25.948 INFO:teuthology.orchestra.run.smithi161.stdout:2048 read 0x997b9a0 thru 0x9984c41 (0x92a2 bytes) 2024-09-21T15:08:25.948 INFO:teuthology.orchestra.run.smithi161.stdout:2050 read 0x57f92cd thru 0x57fdd3a (0x4a6e bytes) 2024-09-21T15:08:25.948 INFO:teuthology.orchestra.run.smithi161.stdout:2051 punch from 0x327483e to 0x327d341, (0x8b03 bytes) 2024-09-21T15:08:25.948 INFO:teuthology.orchestra.run.smithi161.stdout:2052 read 0x82d0b0d thru 0x82dad27 (0xa21b bytes) 2024-09-21T15:08:25.949 INFO:teuthology.orchestra.run.smithi161.stdout:2053 write 0x110596f thru 0x111034b (0xa9dd bytes) 2024-09-21T15:08:25.969 INFO:teuthology.orchestra.run.smithi161.stdout:2340 read 0x6a9465 thru 0x6b215b (0x8cf7 bytes) 2024-09-21T15:08:25.974 INFO:teuthology.orchestra.run.smithi161.stdout:2341 punch from 0x9cc27da to 0x9ccf9e9, (0xd20f bytes) 2024-09-21T15:08:25.974 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:25.975 INFO:teuthology.orchestra.run.smithi161.stdout:2345 read 0x4e3c538 thru 0x4e3cf0a (0x9d3 bytes) 2024-09-21T15:08:25.988 INFO:teuthology.orchestra.run.smithi161.stdout:2750 write 0xea3a9e9 thru 0xea3fade (0x50f6 bytes) 2024-09-21T15:08:26.001 INFO:teuthology.orchestra.run.smithi161.stdout:2346 trunc from 0xd7f7e72 to 0x889e7f 2024-09-21T15:08:26.054 INFO:teuthology.orchestra.run.smithi161.stdout:2751 write 0x400f86 thru 0x4038da (0x2955 bytes) 2024-09-21T15:08:26.055 INFO:teuthology.orchestra.run.smithi161.stdout:2055 write 0x28c2416 thru 0x28c2dbd (0x9a8 bytes) 2024-09-21T15:08:26.118 INFO:teuthology.orchestra.run.smithi161.stdout:2056 write 0x88093b1 thru 0x880d1c7 (0x3e17 bytes) 2024-09-21T15:08:26.239 INFO:teuthology.orchestra.run.smithi161.stdout:2058 write 0x578bb32 thru 0x579653d (0xaa0c bytes) 2024-09-21T15:08:26.290 INFO:teuthology.orchestra.run.smithi161.stdout:2059 read 0xa591bdb thru 0xa59d183 (0xb5a9 bytes) 2024-09-21T15:08:26.290 INFO:teuthology.orchestra.run.smithi161.stdout:2060 write 0x42b3c93 thru 0x42be516 (0xa884 bytes) 2024-09-21T15:08:26.321 INFO:teuthology.orchestra.run.smithi161.stdout:2061 punch from 0x9b0596e to 0x9b0fa19, (0xa0ab bytes) 2024-09-21T15:08:26.376 INFO:teuthology.orchestra.run.smithi161.stdout:2752 read 0xe60222e thru 0xe602c98 (0xa6b bytes) 2024-09-21T15:08:26.377 INFO:teuthology.orchestra.run.smithi161.stdout:2755 writesame 0x4cb53e2 thru 0x4cc3fc0 data_size 0x1(0xebdf bytes) 2024-09-21T15:08:26.415 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.469 INFO:teuthology.orchestra.run.smithi161.stdout:2349 write 0x7a37024 thru 0x7a40f75 (0x9f52 bytes) 2024-09-21T15:08:26.471 INFO:teuthology.orchestra.run.smithi161.stdout:2062 write 0xb560cb9 thru 0xb56e0ea (0xd432 bytes) 2024-09-21T15:08:26.483 INFO:teuthology.orchestra.run.smithi161.stdout:2350 write 0x2dd5daa thru 0x2dd7f8a (0x21e1 bytes) 2024-09-21T15:08:26.504 INFO:teuthology.orchestra.run.smithi161.stdout:2351 write 0x4c7ee53 thru 0x4c8158c (0x273a bytes) 2024-09-21T15:08:26.504 INFO:teuthology.orchestra.run.smithi161.stdout:2063 writesame 0xa388ada thru 0xa39098e data_size 0x1(0x7eb5 bytes) 2024-09-21T15:08:26.519 INFO:teuthology.orchestra.run.smithi161.stdout:2352 read 0x22b1a35 thru 0x22b9cce (0x829a bytes) 2024-09-21T15:08:26.520 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.520 INFO:teuthology.orchestra.run.smithi161.stdout:2354 punch from 0x48ff403 to 0x4900043, (0xc40 bytes) 2024-09-21T15:08:26.520 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.520 INFO:teuthology.orchestra.run.smithi161.stdout:2356 write 0x346bf7 thru 0x34f083 (0x848d bytes) 2024-09-21T15:08:26.527 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.542 INFO:teuthology.orchestra.run.smithi161.stdout:2758 trunc from 0xea3fadf to 0x971e504 2024-09-21T15:08:26.544 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #19, image image_cluster1.client.mirror.3-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent20 2024-09-21T15:08:26.544 INFO:teuthology.orchestra.run.smithi161.stdout:2357 trunc from 0x7a40f76 to 0xd070d4a 2024-09-21T15:08:26.552 INFO:teuthology.orchestra.run.smithi161.stdout:2064 trunc from 0xb56e0eb to 0x2ceb7c9 2024-09-21T15:08:26.577 INFO:teuthology.orchestra.run.smithi161.stdout:2359 writesame 0x9db6387 thru 0x9dc1834 data_size 0x27(0xb4ae bytes) 2024-09-21T15:08:26.612 INFO:teuthology.orchestra.run.smithi161.stdout:1715 punch from 0x7e5580d to 0x7e65762, (0xff55 bytes) 2024-09-21T15:08:26.635 INFO:teuthology.orchestra.run.smithi161.stdout:2065 read 0xd26dd2 thru 0xd2ae94 (0x40c3 bytes) 2024-09-21T15:08:26.636 INFO:teuthology.orchestra.run.smithi161.stdout:1716 punch from 0x630eb1c to 0x6310c1c, (0x2100 bytes) 2024-09-21T15:08:26.636 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.636 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.636 INFO:teuthology.orchestra.run.smithi161.stdout:2760 punch from 0xbc3f7 to 0xc17f0, (0x53f9 bytes) 2024-09-21T15:08:26.636 INFO:teuthology.orchestra.run.smithi161.stdout:1719 write 0x364ab57 thru 0x3655392 (0xa83c bytes) 2024-09-21T15:08:26.637 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.664 INFO:teuthology.orchestra.run.smithi161.stdout:2762 write 0xc8179e4 thru 0xc818f3c (0x1559 bytes) 2024-09-21T15:08:26.683 INFO:teuthology.orchestra.run.smithi161.stdout:1720 write 0x29c3736 thru 0x29d0fc0 (0xd88b bytes) 2024-09-21T15:08:26.687 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.687 INFO:teuthology.orchestra.run.smithi161.stdout:2764 read 0xa14c7e2 thru 0xa15743e (0xac5d bytes) 2024-09-21T15:08:26.688 INFO:teuthology.orchestra.run.smithi161.stdout:2766 write 0xa38b8fc thru 0xa3906b7 (0x4dbc bytes) 2024-09-21T15:08:26.690 INFO:teuthology.orchestra.run.smithi161.stdout:2067 write 0xd6b5027 thru 0xd6bf66b (0xa645 bytes) 2024-09-21T15:08:26.711 INFO:teuthology.orchestra.run.smithi161.stdout:2070 writesame 0xd4a9ae3 thru 0xd4ae883 data_size 0x11(0x4da1 bytes) 2024-09-21T15:08:26.712 INFO:teuthology.orchestra.run.smithi161.stdout:1721 punch from 0x5c23bd to 0x5cebee, (0xc831 bytes) 2024-09-21T15:08:26.712 INFO:teuthology.orchestra.run.smithi161.stdout:1722 writesame 0x14c32a0 thru 0x14c418a data_size 0x39(0xeeb bytes) 2024-09-21T15:08:26.715 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.715 INFO:teuthology.orchestra.run.smithi161.stdout:2769 writesame 0x8f77af0 thru 0x8f7ee8c data_size 0x1(0x739d bytes) 2024-09-21T15:08:26.720 INFO:teuthology.orchestra.run.smithi161.stdout:2072 writesame 0x53e56dd thru 0x53f2a72 data_size 0x6a(0xd396 bytes) 2024-09-21T15:08:26.731 INFO:teuthology.orchestra.run.smithi161.stdout:2770 writesame 0xc4ac9a6 thru 0xc4ad0f9 data_size 0x4(0x754 bytes) 2024-09-21T15:08:26.735 INFO:teuthology.orchestra.run.smithi161.stdout:2073 write 0xa86dd38 thru 0xa879f9b (0xc264 bytes) 2024-09-21T15:08:26.756 INFO:teuthology.orchestra.run.smithi161.stdout:2772 punch from 0xa42622 to 0xa4c5d6, (0x9fb4 bytes) 2024-09-21T15:08:26.759 INFO:teuthology.orchestra.run.smithi161.stdout:2074 writesame 0x1ba4aab thru 0x1baf859 data_size 0x1(0xadaf bytes) 2024-09-21T15:08:26.761 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.761 INFO:teuthology.orchestra.run.smithi161.stdout:1724 read 0x51f5b01 thru 0x52028eb (0xcdeb bytes) 2024-09-21T15:08:26.764 INFO:teuthology.orchestra.run.smithi161.stdout:1725 write 0x83241c4 thru 0x832a5d8 (0x6415 bytes) 2024-09-21T15:08:26.772 INFO:teuthology.orchestra.run.smithi161.stdout:2775 trunc from 0xc818f3d to 0x3fa671b 2024-09-21T15:08:26.799 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.799 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.809 INFO:teuthology.orchestra.run.smithi161.stdout:2077 trunc from 0xd6bf66c to 0x817b495 2024-09-21T15:08:26.819 INFO:teuthology.orchestra.run.smithi161.stdout:1727 write 0x284f5f8 thru 0x285be35 (0xc83e bytes) 2024-09-21T15:08:26.820 INFO:teuthology.orchestra.run.smithi161.stdout:2360 read 0x5a64841 thru 0x5a7442e (0xfbee bytes) 2024-09-21T15:08:26.821 INFO:teuthology.orchestra.run.smithi161.stdout:2362 write 0x14b49a6 thru 0x14b69ee (0x2049 bytes) 2024-09-21T15:08:26.841 INFO:teuthology.orchestra.run.smithi161.stdout:2363 read 0xfacdf thru 0x10670a (0xba2c bytes) 2024-09-21T15:08:26.847 INFO:teuthology.orchestra.run.smithi161.stdout:2364 trunc from 0xd070d4a to 0xaef4b31 2024-09-21T15:08:26.847 INFO:teuthology.orchestra.run.smithi161.stdout:1728 read 0x24f13b2 thru 0x24fd70f (0xc35e bytes) 2024-09-21T15:08:26.848 INFO:teuthology.orchestra.run.smithi161.stdout:1729 write 0x24b7136 thru 0x24bed6b (0x7c36 bytes) 2024-09-21T15:08:26.883 INFO:teuthology.orchestra.run.smithi161.stdout:2078 trunc from 0x817b495 to 0x2ff141a 2024-09-21T15:08:26.908 INFO:teuthology.orchestra.run.smithi161.stdout:1730 trunc from 0xe7adcd4 to 0xe345a20 2024-09-21T15:08:26.932 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.932 INFO:teuthology.orchestra.run.smithi161.stdout:1892 writesame 0x2cdbb6e thru 0x2ce8430 data_size 0x13(0xc8c3 bytes) 2024-09-21T15:08:26.965 INFO:teuthology.orchestra.run.smithi161.stdout:2080 read 0x1a285b thru 0x1a3ce8 (0x148e bytes) 2024-09-21T15:08:26.965 INFO:teuthology.orchestra.run.smithi161.stdout:2081 punch from 0x2a8bb1d to 0x2a8e919, (0x2dfc bytes) 2024-09-21T15:08:26.976 INFO:teuthology.orchestra.run.smithi161.stdout:2365 read 0x15592d4 thru 0x155f3bd (0x60ea bytes) 2024-09-21T15:08:26.976 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:26.976 INFO:teuthology.orchestra.run.smithi161.stdout:2367 read 0x3a11b87 thru 0x3a1fe9e (0xe318 bytes) 2024-09-21T15:08:26.982 INFO:teuthology.orchestra.run.smithi161.stdout:2369 trunc from 0xaef4b31 to 0x81d95f3 2024-09-21T15:08:27.024 INFO:teuthology.orchestra.run.smithi161.stdout:2083 write 0x506d5ca thru 0x5079dd2 (0xc809 bytes) 2024-09-21T15:08:27.027 INFO:teuthology.orchestra.run.smithi161.stdout:1733 read 0x2b15a1c thru 0x2b22dd4 (0xd3b9 bytes) 2024-09-21T15:08:27.028 INFO:teuthology.orchestra.run.smithi161.stdout:1734 read 0x8662479 thru 0x866de8d (0xba15 bytes) 2024-09-21T15:08:27.062 INFO:teuthology.orchestra.run.smithi161.stdout:1735 write 0x2c93130 thru 0x2c9ba3b (0x890c bytes) 2024-09-21T15:08:27.074 INFO:teuthology.orchestra.run.smithi161.stdout:2370 read 0x61c148b thru 0x61c7ae8 (0x665e bytes) 2024-09-21T15:08:27.082 INFO:teuthology.orchestra.run.smithi161.stdout:1736 write 0x724f14 thru 0x72d3c4 (0x84b1 bytes) 2024-09-21T15:08:27.085 INFO:teuthology.orchestra.run.smithi161.stdout:2371 trunc from 0x81d95f3 to 0x3464730 2024-09-21T15:08:27.091 INFO:teuthology.orchestra.run.smithi161.stdout:2085 write 0xba3fe77 thru 0xba4bd53 (0xbedd bytes) 2024-09-21T15:08:27.107 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:27.107 INFO:teuthology.orchestra.run.smithi161.stdout:1739 write 0x82df0c thru 0x830fd1 (0x30c6 bytes) 2024-09-21T15:08:27.121 INFO:teuthology.orchestra.run.smithi161.stdout:2086 write 0x45c3bea thru 0x45cfe32 (0xc249 bytes) 2024-09-21T15:08:27.141 INFO:teuthology.orchestra.run.smithi161.stdout:2088 punch from 0x4795d5f to 0x479ab52, (0x4df3 bytes) 2024-09-21T15:08:27.141 INFO:teuthology.orchestra.run.smithi161.stdout:2091 writesame 0x65bb273 thru 0x65bd102 data_size 0x18(0x1e90 bytes) 2024-09-21T15:08:27.148 INFO:teuthology.orchestra.run.smithi161.stdout:2092 trunc from 0xba4bd54 to 0xba2888a 2024-09-21T15:08:27.157 INFO:teuthology.orchestra.run.smithi161.stdout:1893 clone 19 order 22 su 262144 sc 11 2024-09-21T15:08:27.163 INFO:teuthology.orchestra.run.smithi161.stdout:1741 write 0x998eebb thru 0x9997c22 (0x8d68 bytes) 2024-09-21T15:08:27.176 INFO:teuthology.orchestra.run.smithi161.stdout:2372 read 0x1e56372 thru 0x1e6008d (0x9d1c bytes) 2024-09-21T15:08:27.178 INFO:teuthology.orchestra.run.smithi161.stdout:2778 write 0x3c8b4 thru 0x42dd5 (0x6522 bytes) 2024-09-21T15:08:27.184 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone13 from 0xe96626d (overlap 0x8c24c3) to 0x380eb4 2024-09-21T15:08:27.186 INFO:teuthology.orchestra.run.smithi161.stdout:2373 trunc from 0x3464730 to 0x7de7e20 2024-09-21T15:08:27.186 INFO:teuthology.orchestra.run.smithi161.stdout:2094 punch from 0x81d4c3d to 0x81d63c3, (0x1786 bytes) 2024-09-21T15:08:27.186 INFO:teuthology.orchestra.run.smithi161.stdout:2095 write 0x2615b13 thru 0x26206ac (0xab9a bytes) 2024-09-21T15:08:27.190 INFO:teuthology.orchestra.run.smithi161.stdout:1742 punch from 0x6cd08b4 to 0x6cd867e, (0x7dca bytes) 2024-09-21T15:08:27.190 INFO:teuthology.orchestra.run.smithi161.stdout:1743 write 0x22c87c9 thru 0x22d2a1b (0xa253 bytes) 2024-09-21T15:08:27.306 INFO:teuthology.orchestra.run.smithi161.stdout:2096 writesame 0xc90a361 thru 0xc9168be data_size 0x3f(0xc55e bytes) 2024-09-21T15:08:27.310 INFO:teuthology.orchestra.run.smithi161.stdout:2097 write 0x1464b54 thru 0x146bf34 (0x73e1 bytes) 2024-09-21T15:08:27.338 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:27.338 INFO:teuthology.orchestra.run.smithi161.stdout:2099 punch from 0x1f2d276 to 0x1f39250, (0xbfda bytes) 2024-09-21T15:08:27.338 INFO:teuthology.orchestra.run.smithi161.stdout:2102 punch from 0xb9368e5 to 0xb9389e9, (0x2104 bytes) 2024-09-21T15:08:27.338 INFO:teuthology.orchestra.run.smithi161.stdout:2104 writesame 0xb955d09 thru 0xb964eea data_size 0x7(0xf1e2 bytes) 2024-09-21T15:08:27.342 INFO:teuthology.orchestra.run.smithi161.stdout:1745 read 0x626e0e6 thru 0x627dee4 (0xfdff bytes) 2024-09-21T15:08:27.343 INFO:teuthology.orchestra.run.smithi161.stdout:1746 punch from 0x36ee2ea to 0x36f0d80, (0x2a96 bytes) 2024-09-21T15:08:27.343 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:27.343 INFO:teuthology.orchestra.run.smithi161.stdout:1748 write 0x6f7fe85 thru 0x6f8ac30 (0xadac bytes) 2024-09-21T15:08:27.349 INFO:teuthology.orchestra.run.smithi161.stdout:2105 read 0x3f019a6 thru 0x3f09840 (0x7e9b bytes) 2024-09-21T15:08:27.350 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:27.350 INFO:teuthology.orchestra.run.smithi161.stdout:2107 writesame 0x8dc47a8 thru 0x8dcdfb6 data_size 0x43(0x980f bytes) 2024-09-21T15:08:27.363 INFO:teuthology.orchestra.run.smithi161.stdout:2375 read 0x4aae05b thru 0x4ab9059 (0xafff bytes) 2024-09-21T15:08:27.365 INFO:teuthology.orchestra.run.smithi161.stdout:2379 punch from 0x2321843 to 0x232bf07, (0xa6c4 bytes) 2024-09-21T15:08:27.366 INFO:teuthology.orchestra.run.smithi161.stdout:2380 writesame 0x6774529 thru 0x677e37b data_size 0x1(0x9e53 bytes) 2024-09-21T15:08:27.369 INFO:teuthology.orchestra.run.smithi161.stdout:1749 punch from 0x319ed1a to 0x31aad40, (0xc026 bytes) 2024-09-21T15:08:27.369 INFO:teuthology.orchestra.run.smithi161.stdout:1750 punch from 0x771f61b to 0x7720fcc, (0x19b1 bytes) 2024-09-21T15:08:27.369 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:27.369 INFO:teuthology.orchestra.run.smithi161.stdout:1752 read 0xa4299c8 thru 0xa43058b (0x6bc4 bytes) 2024-09-21T15:08:27.373 INFO:teuthology.orchestra.run.smithi161.stdout:2108 trunc from 0xc9168bf to 0x9c1ab72 2024-09-21T15:08:27.373 INFO:teuthology.orchestra.run.smithi161.stdout:1753 write 0x30e46a5 thru 0x30e8e55 (0x47b1 bytes) 2024-09-21T15:08:27.397 INFO:teuthology.orchestra.run.smithi161.stdout:1754 trunc from 0xe345a20 to 0xe6f12e7 2024-09-21T15:08:27.398 INFO:teuthology.orchestra.run.smithi161.stdout:2381 read 0x50e2679 thru 0x50f0bc0 (0xe548 bytes) 2024-09-21T15:08:27.399 INFO:teuthology.orchestra.run.smithi161.stdout:2382 punch from 0x33ca985 to 0x33d4ee2, (0xa55d bytes) 2024-09-21T15:08:27.399 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:27.405 INFO:teuthology.orchestra.run.smithi161.stdout:2779 read 0x43f557 thru 0x44f022 (0xfacc bytes) 2024-09-21T15:08:27.411 INFO:teuthology.orchestra.run.smithi161.stdout:2780 write 0x16ee3e0 thru 0x16f55a4 (0x71c5 bytes) 2024-09-21T15:08:27.431 INFO:teuthology.orchestra.run.smithi161.stdout:2110 writesame 0x2d9a683 thru 0x2da267f data_size 0x1(0x7ffd bytes) 2024-09-21T15:08:27.457 INFO:teuthology.orchestra.run.smithi161.stdout:1755 read 0x42464e6 thru 0x424a961 (0x447c bytes) 2024-09-21T15:08:27.473 INFO:teuthology.orchestra.run.smithi161.stdout:2385 writesame 0xe71ee69 thru 0xe720250 data_size 0x31(0x13e8 bytes) 2024-09-21T15:08:27.474 INFO:teuthology.orchestra.run.smithi161.stdout:1756 read 0x9fc944 thru 0xa07703 (0xadc0 bytes) 2024-09-21T15:08:27.478 INFO:teuthology.orchestra.run.smithi161.stdout:2386 write 0x9e48ef0 thru 0x9e4c956 (0x3a67 bytes) 2024-09-21T15:08:27.499 INFO:teuthology.orchestra.run.smithi161.stdout:2111 write 0x9120b4f thru 0x912dbbb (0xd06d bytes) 2024-09-21T15:08:27.501 INFO:teuthology.orchestra.run.smithi161.stdout:1758 trunc from 0xe6f12e7 to 0x3612db8 2024-09-21T15:08:27.522 INFO:teuthology.orchestra.run.smithi161.stdout:2114 punch from 0x8f2fd6b to 0x8f32dd6, (0x306b bytes) 2024-09-21T15:08:27.554 INFO:teuthology.orchestra.run.smithi161.stdout:2387 trunc from 0xe720251 to 0x6bf854f 2024-09-21T15:08:27.607 INFO:teuthology.orchestra.run.smithi161.stdout:2115 write 0xced16de thru 0xcee0ea0 (0xf7c3 bytes) 2024-09-21T15:08:27.677 INFO:teuthology.orchestra.run.smithi161.stdout:2116 punch from 0x5671692 to 0x5673b1c, (0x248a bytes) 2024-09-21T15:08:27.677 INFO:teuthology.orchestra.run.smithi161.stdout:2117 write 0x91f5fd5 thru 0x91fe543 (0x856f bytes) 2024-09-21T15:08:27.705 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:27.705 INFO:teuthology.orchestra.run.smithi161.stdout:2119 punch from 0x4595aad to 0x45a03e9, (0xa93c bytes) 2024-09-21T15:08:27.706 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:27.706 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:27.706 INFO:teuthology.orchestra.run.smithi161.stdout:2122 punch from 0x7830722 to 0x783c0d9, (0xb9b7 bytes) 2024-09-21T15:08:27.706 INFO:teuthology.orchestra.run.smithi161.stdout:2123 read 0xca0aba thru 0xca62c9 (0x5810 bytes) 2024-09-21T15:08:27.707 INFO:teuthology.orchestra.run.smithi161.stdout:2124 punch from 0x21add53 to 0x21bc31f, (0xe5cc bytes) 2024-09-21T15:08:27.707 INFO:teuthology.orchestra.run.smithi161.stdout:2125 write 0x19ff214 thru 0x1a0c941 (0xd72e bytes) 2024-09-21T15:08:27.709 INFO:teuthology.orchestra.run.smithi161.stdout:2388 trunc from 0x6bf854f to 0x7521f6c 2024-09-21T15:08:27.740 INFO:teuthology.orchestra.run.smithi161.stdout:2128 trunc from 0xcee0ea1 to 0x726fb76 2024-09-21T15:08:27.742 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #12, image image_cluster1.client.mirror.1-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent13 2024-09-21T15:08:27.744 INFO:teuthology.orchestra.run.smithi161.stdout:2389 read 0x52b3241 thru 0x52bc7c0 (0x9580 bytes) 2024-09-21T15:08:27.757 INFO:teuthology.orchestra.run.smithi161.stdout:2390 trunc from 0x7521f6c to 0xd78e0f8 2024-09-21T15:08:27.816 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:27.813+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c23cea0 2024-09-21T15:08:27.816 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:27.813+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c23d6c0 2024-09-21T15:08:27.821 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:27.813+0000 7f1e9c77a700 -1 reset not still connected to 0x56287ce70000 2024-09-21T15:08:27.821 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:27.813+0000 7f1e9c77a700 -1 reset not still connected to 0x5628828a7ba0 2024-09-21T15:08:27.821 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:27.813+0000 7f1e9c77a700 -1 reset not still connected to 0x56288c936270 2024-09-21T15:08:27.821 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:27.817+0000 7f1e9c77a700 -1 reset not still connected to 0x56288ddce0d0 2024-09-21T15:08:27.821 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:27.817+0000 7f1e9c77a700 -1 reset not still connected to 0x562890804820 2024-09-21T15:08:27.826 INFO:teuthology.orchestra.run.smithi161.stdout:2392 write 0xbfe4237 thru 0xbfee571 (0xa33b bytes) 2024-09-21T15:08:27.835 INFO:teuthology.orchestra.run.smithi161.stdout:1760 write 0x4c2de40 thru 0x4c3c946 (0xeb07 bytes) 2024-09-21T15:08:27.844 INFO:teuthology.orchestra.run.smithi161.stdout:2781 write 0x8ece6d7 thru 0x8ecf098 (0x9c2 bytes) 2024-09-21T15:08:27.846 INFO:teuthology.orchestra.run.smithi161.stdout:2221 punch from 0x8e3aabf to 0x8e4680d, (0xbd4e bytes) 2024-09-21T15:08:27.852 INFO:teuthology.orchestra.run.smithi161.stdout:2393 read 0x48563dd thru 0x485f7b5 (0x93d9 bytes) 2024-09-21T15:08:27.852 INFO:teuthology.orchestra.run.smithi161.stdout:2394 writesame 0x7baebd4 thru 0x7bbda22 data_size 0x1(0xee4f bytes) 2024-09-21T15:08:27.856 INFO:teuthology.orchestra.run.smithi161.stdout:2129 read 0x49d4a68 thru 0x49dc296 (0x782f bytes) 2024-09-21T15:08:27.866 INFO:teuthology.orchestra.run.smithi161.stdout:1761 read 0x248477b thru 0x248cb13 (0x8399 bytes) 2024-09-21T15:08:27.868 INFO:teuthology.orchestra.run.smithi161.stdout:2130 writesame 0x6c29898 thru 0x6c39506 data_size 0xd(0xfc6f bytes) 2024-09-21T15:08:27.871 INFO:teuthology.orchestra.run.smithi161.stdout:1762 trunc from 0x4c3c947 to 0x1fd1f7e 2024-09-21T15:08:27.878 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:27.878 INFO:teuthology.orchestra.run.smithi161.stdout:2226 punch from 0x2dcc853 to 0x2dce932, (0x20df bytes) 2024-09-21T15:08:27.878 INFO:teuthology.orchestra.run.smithi161.stdout:2227 read 0xe6b3329 thru 0xe6b92a7 (0x5f7f bytes) 2024-09-21T15:08:27.878 INFO:teuthology.orchestra.run.smithi161.stdout:2228 write 0x80aef72 thru 0x80bb897 (0xc926 bytes) 2024-09-21T15:08:27.878 INFO:teuthology.orchestra.run.smithi161.stdout:2782 read 0x3eba079 thru 0x3ebc9af (0x2937 bytes) 2024-09-21T15:08:27.882 INFO:teuthology.orchestra.run.smithi161.stdout:2783 write 0x13d2228 thru 0x13dc01b (0x9df4 bytes) 2024-09-21T15:08:27.932 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:27.973 INFO:teuthology.orchestra.run.smithi161.stdout:2134 flatten 2024-09-21T15:08:27.980 INFO:teuthology.orchestra.run.smithi161.stdout:2232 write 0x28d1a4c thru 0x28d8acf (0x7084 bytes) 2024-09-21T15:08:28.037 INFO:teuthology.orchestra.run.smithi161.stdout:2233 read 0x964d5b5 thru 0x965cffb (0xfa47 bytes) 2024-09-21T15:08:28.049 INFO:teuthology.orchestra.run.smithi161.stdout:2234 punch from 0x4791580 to 0x479a23f, (0x8cbf bytes) 2024-09-21T15:08:28.058 INFO:teuthology.orchestra.run.smithi161.stdout:2235 write 0x6d92f98 thru 0x6d947d2 (0x183b bytes) 2024-09-21T15:08:28.061 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.069 INFO:teuthology.orchestra.run.smithi161.stdout:2136 trunc from 0x726fb76 to 0x87ff50a 2024-09-21T15:08:28.113 INFO:teuthology.orchestra.run.smithi161.stdout:2137 punch from 0xaeb8f8 to 0xaf65d3, (0xacdb bytes) 2024-09-21T15:08:28.113 INFO:teuthology.orchestra.run.smithi161.stdout:2138 punch from 0x47ffe59 to 0x4809740, (0x98e7 bytes) 2024-09-21T15:08:28.113 INFO:teuthology.orchestra.run.smithi161.stdout:2140 writesame 0x60739f7 thru 0x6082781 data_size 0x1(0xed8b bytes) 2024-09-21T15:08:28.137 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:28.133+0000 7f1e9c77a700 -1 reset not still connected to 0x56287ce70000 2024-09-21T15:08:28.139 INFO:teuthology.orchestra.run.smithi161.stdout:2236 writesame 0x337f06f thru 0x338da28 data_size 0x1(0xe9ba bytes) 2024-09-21T15:08:28.175 INFO:teuthology.orchestra.run.smithi161.stdout:2141 write 0x5dffd8a thru 0x5e06659 (0x68d0 bytes) 2024-09-21T15:08:28.185 INFO:teuthology.orchestra.run.smithi161.stdout:2395 writesame 0xe70969c thru 0xe7119de data_size 0x17(0x8343 bytes) 2024-09-21T15:08:28.198 INFO:teuthology.orchestra.run.smithi161.stdout:2397 read 0x1432c82 thru 0x143c54a (0x98c9 bytes) 2024-09-21T15:08:28.198 INFO:teuthology.orchestra.run.smithi161.stdout:2398 read 0xddd1f6 thru 0xdec6bb (0xf4c6 bytes) 2024-09-21T15:08:28.203 INFO:teuthology.orchestra.run.smithi161.stdout:2399 punch from 0xd4e3e24 to 0xd4e8af5, (0x4cd1 bytes) 2024-09-21T15:08:28.203 INFO:teuthology.orchestra.run.smithi161.stdout:2400 write 0x432e764 thru 0x43381cd (0x9a6a bytes) 2024-09-21T15:08:28.234 INFO:teuthology.orchestra.run.smithi161.stdout:2402 trunc from 0xe7119df to 0x6967fff 2024-09-21T15:08:28.255 INFO:teuthology.orchestra.run.smithi161.stdout:2142 write 0xa38444f thru 0xa391fd4 (0xdb86 bytes) 2024-09-21T15:08:28.273 INFO:teuthology.orchestra.run.smithi161.stdout:2144 write 0x5b72f1e thru 0x5b80685 (0xd768 bytes) 2024-09-21T15:08:28.284 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:28.281+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb830960 handle_clone_image: failed to clone image mirror/10b4bd45da7a to image_cluster1.client.mirror.3-clone15 2024-09-21T15:08:28.306 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:28.305+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb830b40 handle_clone_image: failed to clone image mirror/10add47bd902 to image_cluster1.client.mirror.2-clone14 2024-09-21T15:08:28.319 INFO:teuthology.orchestra.run.smithi161.stdout:1763 writesame 0x458c5f1 thru 0x458dc3d data_size 0x1(0x164d bytes) 2024-09-21T15:08:28.321 INFO:teuthology.orchestra.run.smithi161.stdout:2237 read 0x714ace1 thru 0x714c0a9 (0x13c9 bytes) 2024-09-21T15:08:28.322 INFO:teuthology.orchestra.run.smithi161.stdout:1764 read 0x8eaa6e thru 0x8f3088 (0x861b bytes) 2024-09-21T15:08:28.326 INFO:teuthology.orchestra.run.smithi161.stdout:1765 read 0xede7c9 thru 0xeeb63a (0xce72 bytes) 2024-09-21T15:08:28.326 INFO:teuthology.orchestra.run.smithi161.stdout:2784 read 0x3b3e796 thru 0x3b425f5 (0x3e60 bytes) 2024-09-21T15:08:28.330 INFO:teuthology.orchestra.run.smithi161.stdout:2145 write 0x6446317 thru 0x6451105 (0xadef bytes) 2024-09-21T15:08:28.330 INFO:teuthology.orchestra.run.smithi161.stdout:1767 write 0x3faac75 thru 0x3fb6559 (0xb8e5 bytes) 2024-09-21T15:08:28.334 INFO:teuthology.orchestra.run.smithi161.stdout:2403 write 0x50ac155 thru 0x50b4017 (0x7ec3 bytes) 2024-09-21T15:08:28.335 INFO:teuthology.orchestra.run.smithi161.stdout:2238 trunc from 0xe96626d to 0x7b54c60 2024-09-21T15:08:28.339 INFO:teuthology.orchestra.run.smithi161.stdout:2786 trunc from 0x8ecf099 to 0x6993f49 2024-09-21T15:08:28.353 INFO:teuthology.orchestra.run.smithi161.stdout:2404 writesame 0x493a73e thru 0x493f89d data_size 0x60(0x5160 bytes) 2024-09-21T15:08:28.364 INFO:teuthology.orchestra.run.smithi161.stdout:2405 read 0x1ceae31 thru 0x1cf5ddc (0xafac bytes) 2024-09-21T15:08:28.364 INFO:teuthology.orchestra.run.smithi161.stdout:1768 writesame 0x28fe703 thru 0x2900734 data_size 0x2(0x2032 bytes) 2024-09-21T15:08:28.365 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.370 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:28.369+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cc7eba40 handle_clone_image: failed to clone image mirror/10b74ae0e8d1 to image_cluster1.client.mirror.5-clone9 2024-09-21T15:08:28.371 INFO:teuthology.orchestra.run.smithi161.stdout:2408 trunc from 0x6967fff to 0x9f8ec96 2024-09-21T15:08:28.402 INFO:teuthology.orchestra.run.smithi161.stdout:2146 writesame 0xb42c01b thru 0xb43b072 data_size 0x4(0xf058 bytes) 2024-09-21T15:08:28.411 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.411 INFO:teuthology.orchestra.run.smithi161.stdout:2148 punch from 0xb245411 to 0xb24ff4a, (0xab39 bytes) 2024-09-21T15:08:28.411 INFO:teuthology.orchestra.run.smithi161.stdout:2149 read 0x7d5ed94 thru 0x7d62ddc (0x4049 bytes) 2024-09-21T15:08:28.413 INFO:teuthology.orchestra.run.smithi161.stdout:2150 write 0x3893175 thru 0x389e45b (0xb2e7 bytes) 2024-09-21T15:08:28.418 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.418 INFO:teuthology.orchestra.run.smithi161.stdout:2788 writesame 0x2f12d23 thru 0x2f1fa7f data_size 0x1(0xcd5d bytes) 2024-09-21T15:08:28.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:28.421+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cc7ea3c0 handle_clone_image: failed to clone image mirror/10ae2426d397 to image_cluster1.client.mirror.1-clone9 2024-09-21T15:08:28.426 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.427 INFO:teuthology.orchestra.run.smithi161.stdout:2241 read 0x41bb0ab thru 0x41c0b3a (0x5a90 bytes) 2024-09-21T15:08:28.429 INFO:teuthology.orchestra.run.smithi161.stdout:2151 writesame 0x1be8b4a thru 0x1bf2c5c data_size 0x5(0xa113 bytes) 2024-09-21T15:08:28.429 INFO:teuthology.orchestra.run.smithi161.stdout:2242 write 0x288d0ae thru 0x289100e (0x3f61 bytes) 2024-09-21T15:08:28.452 INFO:teuthology.orchestra.run.smithi161.stdout:2152 write 0x52e0ae1 thru 0x52e26d9 (0x1bf9 bytes) 2024-09-21T15:08:28.458 INFO:teuthology.orchestra.run.smithi161.stdout:2244 read 0x16cb4fd thru 0x16d1c91 (0x6795 bytes) 2024-09-21T15:08:28.462 INFO:teuthology.orchestra.run.smithi161.stdout:2245 punch from 0x381abf5 to 0x381b3d9, (0x7e4 bytes) 2024-09-21T15:08:28.462 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.462 INFO:teuthology.orchestra.run.smithi161.stdout:2248 punch from 0x6570a97 to 0x6571269, (0x7d2 bytes) 2024-09-21T15:08:28.470 INFO:teuthology.orchestra.run.smithi161.stdout:2153 writesame 0x7690c71 thru 0x769501b data_size 0x1(0x43ab bytes) 2024-09-21T15:08:28.473 INFO:teuthology.orchestra.run.smithi161.stdout:2251 trunc from 0x7b54c60 to 0x1315b4a 2024-09-21T15:08:28.504 INFO:teuthology.orchestra.run.smithi161.stdout:2154 read 0x1bfc4ba thru 0x1c08e24 (0xc96b bytes) 2024-09-21T15:08:28.528 INFO:teuthology.orchestra.run.smithi161.stdout:2409 writesame 0xc671a7e thru 0xc67d0ac data_size 0x1(0xb62f bytes) 2024-09-21T15:08:28.562 INFO:teuthology.orchestra.run.smithi161.stdout:2410 punch from 0x16d4f28 to 0x16e109f, (0xc177 bytes) 2024-09-21T15:08:28.562 INFO:teuthology.orchestra.run.smithi161.stdout:2411 write 0x387577e thru 0x387c33f (0x6bc2 bytes) 2024-09-21T15:08:28.590 INFO:teuthology.orchestra.run.smithi161.stdout:2412 read 0x6a31c87 thru 0x6a326aa (0xa24 bytes) 2024-09-21T15:08:28.597 INFO:teuthology.orchestra.run.smithi161.stdout:2155 write 0xda33879 thru 0xda40235 (0xc9bd bytes) 2024-09-21T15:08:28.631 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.645 INFO:teuthology.orchestra.run.smithi161.stdout:2158 trunc from 0xda40236 to 0x6323e43 2024-09-21T15:08:28.649 INFO:teuthology.orchestra.run.smithi161.stdout:1769 writesame 0xc313c31 thru 0xc315c7c data_size 0xd(0x204c bytes) 2024-09-21T15:08:28.650 INFO:teuthology.orchestra.run.smithi161.stdout:2414 writesame 0xd1cb3d1 thru 0xd1d7f6b data_size 0x1(0xcb9b bytes) 2024-09-21T15:08:28.653 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.653 INFO:teuthology.orchestra.run.smithi161.stdout:2418 read 0x4d728c9 thru 0x4d772da (0x4a12 bytes) 2024-09-21T15:08:28.654 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.654 INFO:teuthology.orchestra.run.smithi161.stdout:2421 read 0xc53958f thru 0xc53e229 (0x4c9b bytes) 2024-09-21T15:08:28.654 INFO:teuthology.orchestra.run.smithi161.stdout:2422 write 0x72cb5e4 thru 0x72d3b0f (0x852c bytes) 2024-09-21T15:08:28.662 INFO:teuthology.orchestra.run.smithi161.stdout:1770 write 0x615ce64 thru 0x6161173 (0x4310 bytes) 2024-09-21T15:08:28.677 INFO:teuthology.orchestra.run.smithi161.stdout:2423 punch from 0x1ed9622 to 0x1ee81e8, (0xebc6 bytes) 2024-09-21T15:08:28.677 INFO:teuthology.orchestra.run.smithi161.stdout:2424 read 0x280b7ad thru 0x281792a (0xc17e bytes) 2024-09-21T15:08:28.694 INFO:teuthology.orchestra.run.smithi161.stdout:2425 trunc from 0xd1d7f6c to 0x35cd05f 2024-09-21T15:08:28.709 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:28.709+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb2cd4a0 handle_clone_image: failed to clone image mirror/10ad39bb2737 to image_cluster1.client.mirror.2-clone6 2024-09-21T15:08:28.724 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.4-clone18 intact 2024-09-21T15:08:28.744 INFO:teuthology.orchestra.run.smithi161.stdout:2159 trunc from 0x6323e43 to 0x59a2443 2024-09-21T15:08:28.761 INFO:teuthology.orchestra.run.smithi161.stdout:1773 writesame 0xc39668e thru 0xc3a2feb data_size 0x19(0xc95e bytes) 2024-09-21T15:08:28.775 INFO:teuthology.orchestra.run.smithi161.stdout:1774 punch from 0x764dcdd to 0x765221e, (0x4541 bytes) 2024-09-21T15:08:28.775 INFO:teuthology.orchestra.run.smithi161.stdout:1775 read 0x5ea1dfc thru 0x5eaaa66 (0x8c6b bytes) 2024-09-21T15:08:28.775 INFO:teuthology.orchestra.run.smithi161.stdout:1778 punch from 0x1bfc7e5 to 0x1c0431c, (0x7b37 bytes) 2024-09-21T15:08:28.775 INFO:teuthology.orchestra.run.smithi161.stdout:1780 read 0x980b6c7 thru 0x980ce0a (0x1744 bytes) 2024-09-21T15:08:28.776 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.776 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.776 INFO:teuthology.orchestra.run.smithi161.stdout:1784 read 0xbe13955 thru 0xbe19e63 (0x650f bytes) 2024-09-21T15:08:28.776 INFO:teuthology.orchestra.run.smithi161.stdout:1785 write 0x554c522 thru 0x555a3b7 (0xde96 bytes) 2024-09-21T15:08:28.778 INFO:teuthology.orchestra.run.smithi161.stdout:2789 read 0x1fa4fa8 thru 0x1faff42 (0xaf9b bytes) 2024-09-21T15:08:28.790 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.790 INFO:teuthology.orchestra.run.smithi161.stdout:2253 punch from 0x105136 to 0x11309f, (0xdf69 bytes) 2024-09-21T15:08:28.790 INFO:teuthology.orchestra.run.smithi161.stdout:2254 punch from 0xf546c1 to 0xf5d1eb, (0x8b2a bytes) 2024-09-21T15:08:28.792 INFO:teuthology.orchestra.run.smithi161.stdout:2792 punch from 0x3434d84 to 0x34442fb, (0xf577 bytes) 2024-09-21T15:08:28.793 INFO:teuthology.orchestra.run.smithi161.stdout:2793 read 0x40e499e thru 0x40efcf5 (0xb358 bytes) 2024-09-21T15:08:28.799 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.799 INFO:teuthology.orchestra.run.smithi161.stdout:2795 write 0x429cabe thru 0x42a6ddf (0xa322 bytes) 2024-09-21T15:08:28.807 INFO:teuthology.orchestra.run.smithi161.stdout:1786 write 0x8ba265a thru 0x8ba8bb7 (0x655e bytes) 2024-09-21T15:08:28.818 INFO:teuthology.orchestra.run.smithi161.stdout:2160 read 0x8930b7 thru 0x89708f (0x3fd9 bytes) 2024-09-21T15:08:28.818 INFO:teuthology.orchestra.run.smithi161.stdout:2161 writesame 0x460e09e thru 0x4613e21 data_size 0x85(0x5d84 bytes) 2024-09-21T15:08:28.840 INFO:teuthology.orchestra.run.smithi161.stdout:2163 read 0x284fd87 thru 0x285769e (0x7918 bytes) 2024-09-21T15:08:28.841 INFO:teuthology.orchestra.run.smithi161.stdout:2165 read 0xea839f thru 0xeb2b22 (0xa784 bytes) 2024-09-21T15:08:28.842 INFO:teuthology.orchestra.run.smithi161.stdout:1788 write 0x2377f15 thru 0x2378133 (0x21f bytes) 2024-09-21T15:08:28.854 INFO:teuthology.orchestra.run.smithi161.stdout:2255 write 0x78899ce thru 0x7894bce (0xb201 bytes) 2024-09-21T15:08:28.862 INFO:teuthology.orchestra.run.smithi161.stdout:2796 trunc from 0x6993f49 to 0xcc0002a 2024-09-21T15:08:28.862 INFO:teuthology.orchestra.run.smithi161.stdout:1789 write 0x96a10d2 thru 0x96a403e (0x2f6d bytes) 2024-09-21T15:08:28.884 INFO:teuthology.orchestra.run.smithi161.stdout:1790 read 0xa4e4ad7 thru 0xa4e6a90 (0x1fba bytes) 2024-09-21T15:08:28.884 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.884 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.884 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.884 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.885 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.885 INFO:teuthology.orchestra.run.smithi161.stdout:2258 read 0x5e2703d thru 0x5e335d4 (0xc598 bytes) 2024-09-21T15:08:28.886 INFO:teuthology.orchestra.run.smithi161.stdout:2259 read 0x2f56dee thru 0x2f66719 (0xf92c bytes) 2024-09-21T15:08:28.887 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.887 INFO:teuthology.orchestra.run.smithi161.stdout:2262 read 0x1f8424b thru 0x1f8cc39 (0x89ef bytes) 2024-09-21T15:08:28.887 INFO:teuthology.orchestra.run.smithi161.stdout:2263 punch from 0xb9cd23 to 0xba2134, (0x5411 bytes) 2024-09-21T15:08:28.888 INFO:teuthology.orchestra.run.smithi161.stdout:1797 trunc from 0xc3a2fec to 0xa045f86 2024-09-21T15:08:28.892 INFO:teuthology.orchestra.run.smithi161.stdout:2426 write 0x5410197 thru 0x541a5cb (0xa435 bytes) 2024-09-21T15:08:28.900 INFO:teuthology.orchestra.run.smithi161.stdout:2166 writesame 0xe22b29d thru 0xe22f80e data_size 0x3(0x4572 bytes) 2024-09-21T15:08:28.902 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:28.897+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cd482d20 handle_clone_image: failed to clone image mirror/10b545f73d9 to image_cluster1.client.mirror.0-clone10 2024-09-21T15:08:28.913 INFO:teuthology.orchestra.run.smithi161.stdout:2797 writesame 0xb67a080 thru 0xb67c098 data_size 0xb(0x2019 bytes) 2024-09-21T15:08:28.937 INFO:teuthology.orchestra.run.smithi161.stdout:2265 writesame 0x8e4008c thru 0x8e4cf04 data_size 0x15(0xce79 bytes) 2024-09-21T15:08:28.940 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:28.948 INFO:teuthology.orchestra.run.smithi161.stdout:2798 read 0xa5ada20 thru 0xa5b1de3 (0x43c4 bytes) 2024-09-21T15:08:28.948 INFO:teuthology.orchestra.run.smithi161.stdout:2799 write 0xba578ff thru 0xba60972 (0x9074 bytes) 2024-09-21T15:08:28.950 INFO:teuthology.orchestra.run.smithi161.stdout:2167 write 0xe579d21 thru 0xe580192 (0x6472 bytes) 2024-09-21T15:08:28.954 INFO:teuthology.orchestra.run.smithi161.stdout:2267 trunc from 0x8e4cf05 to 0x73c30c2 2024-09-21T15:08:28.968 INFO:teuthology.orchestra.run.smithi161.stdout:2168 write 0x458c82b thru 0x4592ef6 (0x66cc bytes) 2024-09-21T15:08:28.978 INFO:teuthology.orchestra.run.smithi161.stdout:1800 write 0xaad64a4 thru 0xaadd4c9 (0x7026 bytes) 2024-09-21T15:08:28.985 INFO:teuthology.orchestra.run.smithi161.stdout:2427 writesame 0xd6a915d thru 0xd6b6646 data_size 0x1(0xd4ea bytes) 2024-09-21T15:08:28.985 INFO:teuthology.orchestra.run.smithi161.stdout:2169 write 0x9e0bba thru 0x9efcaa (0xf0f1 bytes) 2024-09-21T15:08:28.986 INFO:teuthology.orchestra.run.smithi161.stdout:2800 punch from 0x658730a to 0x6594c06, (0xd8fc bytes) 2024-09-21T15:08:28.993 INFO:teuthology.orchestra.run.smithi161.stdout:2428 write 0x4cd50ba thru 0x4ce1864 (0xc7ab bytes) 2024-09-21T15:08:28.998 INFO:teuthology.orchestra.run.smithi161.stdout:2801 trunc from 0xcc0002a to 0x5cd0a2d 2024-09-21T15:08:28.999 INFO:teuthology.orchestra.run.smithi161.stdout:2171 punch from 0xcd09d40 to 0xcd15da8, (0xc068 bytes) 2024-09-21T15:08:28.999 INFO:teuthology.orchestra.run.smithi161.stdout:2172 write 0x6f94154 thru 0x6f9b62c (0x74d9 bytes) 2024-09-21T15:08:29.000 INFO:teuthology.orchestra.run.smithi161.stdout:1801 read 0x926e54a thru 0x927b20a (0xccc1 bytes) 2024-09-21T15:08:29.000 INFO:teuthology.orchestra.run.smithi161.stdout:1802 write 0x832df8f thru 0x8337d77 (0x9de9 bytes) 2024-09-21T15:08:29.004 INFO:teuthology.orchestra.run.smithi161.stdout:2429 write 0x67e2c83 thru 0x67eef5e (0xc2dc bytes) 2024-09-21T15:08:29.011 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.011 INFO:teuthology.orchestra.run.smithi161.stdout:2174 write 0xcfc8d74 thru 0xcfca382 (0x160f bytes) 2024-09-21T15:08:29.012 INFO:teuthology.orchestra.run.smithi161.stdout:2432 writesame 0x2a020df thru 0x2a0fe91 data_size 0x1(0xddb3 bytes) 2024-09-21T15:08:29.017 INFO:teuthology.orchestra.run.smithi161.stdout:1804 punch from 0x3e2a79a to 0x3e38a98, (0xe2fe bytes) 2024-09-21T15:08:29.026 INFO:teuthology.orchestra.run.smithi161.stdout:2175 read 0xcbe6392 thru 0xcbe8d72 (0x29e1 bytes) 2024-09-21T15:08:29.026 INFO:teuthology.orchestra.run.smithi161.stdout:2176 read 0x568b391 thru 0x569aa4f (0xf6bf bytes) 2024-09-21T15:08:29.027 INFO:teuthology.orchestra.run.smithi161.stdout:2177 punch from 0x4435852 to 0x4440439, (0xabe7 bytes) 2024-09-21T15:08:29.035 INFO:teuthology.orchestra.run.smithi161.stdout:1805 trunc from 0xaadd4ca to 0x12e812c 2024-09-21T15:08:29.040 INFO:teuthology.orchestra.run.smithi161.stdout:2178 trunc from 0xe580193 to 0x7a40aac 2024-09-21T15:08:29.056 INFO:teuthology.orchestra.run.smithi161.stdout:2433 read 0x8471a32 thru 0x84737d7 (0x1da6 bytes) 2024-09-21T15:08:29.063 INFO:teuthology.orchestra.run.smithi161.stdout:2434 trunc from 0xd6b6647 to 0x9fbcfeb 2024-09-21T15:08:29.067 INFO:teuthology.orchestra.run.smithi161.stdout:2268 write 0xbb16beb thru 0xbb20c7f (0xa095 bytes) 2024-09-21T15:08:29.067 INFO:teuthology.orchestra.run.smithi161.stdout:2802 write 0x5411722 thru 0x541290d (0x11ec bytes) 2024-09-21T15:08:29.082 INFO:teuthology.orchestra.run.smithi161.stdout:2269 write 0x2ac09b2 thru 0x2ac0b0d (0x15c bytes) 2024-09-21T15:08:29.099 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.099 INFO:teuthology.orchestra.run.smithi161.stdout:2804 read 0x4ff01a7 thru 0x4ff84ab (0x8305 bytes) 2024-09-21T15:08:29.104 INFO:teuthology.orchestra.run.smithi161.stdout:2270 writesame 0x715f70 thru 0x721ecb data_size 0x4a(0xbf5c bytes) 2024-09-21T15:08:29.108 INFO:teuthology.orchestra.run.smithi161.stdout:2805 trunc from 0x5cd0a2d to 0x1e81593 2024-09-21T15:08:29.111 INFO:teuthology.orchestra.run.smithi161.stdout:2435 writesame 0x93c239d thru 0x93d0ca1 data_size 0x79(0xe905 bytes) 2024-09-21T15:08:29.115 INFO:teuthology.orchestra.run.smithi161.stdout:2272 write 0x5be74ee thru 0x5bf4f58 (0xda6b bytes) 2024-09-21T15:08:29.124 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.125 INFO:teuthology.orchestra.run.smithi161.stdout:2436 punch from 0x5ceccae to 0x5cf786d, (0xabbf bytes) 2024-09-21T15:08:29.125 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.125 INFO:teuthology.orchestra.run.smithi161.stdout:2438 punch from 0x57fbe48 to 0x5803324, (0x74dc bytes) 2024-09-21T15:08:29.125 INFO:teuthology.orchestra.run.smithi161.stdout:2439 read 0xd10d59 thru 0xd11281 (0x529 bytes) 2024-09-21T15:08:29.126 INFO:teuthology.orchestra.run.smithi161.stdout:2181 write 0x5b2510d thru 0x5b33a8c (0xe980 bytes) 2024-09-21T15:08:29.126 INFO:teuthology.orchestra.run.smithi161.stdout:2440 writesame 0x412594f thru 0x412f80d data_size 0x1(0x9ebf bytes) 2024-09-21T15:08:29.139 INFO:teuthology.orchestra.run.smithi161.stdout:2184 punch from 0x3ec86a0 to 0x3ed14d4, (0x8e34 bytes) 2024-09-21T15:08:29.139 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.139 INFO:teuthology.orchestra.run.smithi161.stdout:2186 read 0x5a63518 thru 0x5a647bd (0x12a6 bytes) 2024-09-21T15:08:29.141 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.141 INFO:teuthology.orchestra.run.smithi161.stdout:2189 punch from 0x14c8d8d to 0x14d6a88, (0xdcfb bytes) 2024-09-21T15:08:29.143 INFO:teuthology.orchestra.run.smithi161.stdout:2274 trunc from 0xbb20c80 to 0x414b8de 2024-09-21T15:08:29.154 INFO:teuthology.orchestra.run.smithi161.stdout:2190 trunc from 0x7a40aac to 0x60332c 2024-09-21T15:08:29.158 INFO:teuthology.orchestra.run.smithi161.stdout:1806 trunc from 0x12e812c to 0x2e31736 2024-09-21T15:08:29.165 INFO:teuthology.orchestra.run.smithi161.stdout:2442 punch from 0xcbc6eb to 0xcca6cc, (0xdfe1 bytes) 2024-09-21T15:08:29.165 INFO:teuthology.orchestra.run.smithi161.stdout:2444 read 0x85bf104 thru 0x85c9a8e (0xa98b bytes) 2024-09-21T15:08:29.165 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.176 INFO:teuthology.orchestra.run.smithi161.stdout:2447 trunc from 0x9fbcfeb to 0xe514917 2024-09-21T15:08:29.270 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.270 INFO:teuthology.orchestra.run.smithi161.stdout:2276 punch from 0x520e6c to 0x52fd37, (0xeecb bytes) 2024-09-21T15:08:29.271 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.272 INFO:teuthology.orchestra.run.smithi161.stdout:2195 read 0x5cf143 thru 0x5d3cb2 (0x4b70 bytes) 2024-09-21T15:08:29.316 INFO:teuthology.orchestra.run.smithi161.stdout:1807 write 0xc5a1ec2 thru 0xc5b0cc4 (0xee03 bytes) 2024-09-21T15:08:29.340 INFO:teuthology.orchestra.run.smithi161.stdout:1808 writesame 0xe48168 thru 0xe4aa55 data_size 0x1f(0x28ee bytes) 2024-09-21T15:08:29.365 INFO:teuthology.orchestra.run.smithi161.stdout:2196 writesame 0x9416bfb thru 0x941f834 data_size 0x3e(0x8c3a bytes) 2024-09-21T15:08:29.370 INFO:teuthology.orchestra.run.smithi161.stdout:2197 read 0x69b6321 thru 0x69c28c1 (0xc5a1 bytes) 2024-09-21T15:08:29.370 INFO:teuthology.orchestra.run.smithi161.stdout:2198 punch from 0x3cca1bd to 0x3cd6e1b, (0xcc5e bytes) 2024-09-21T15:08:29.370 INFO:teuthology.orchestra.run.smithi161.stdout:2199 write 0x3335e2a thru 0x334223b (0xc412 bytes) 2024-09-21T15:08:29.374 INFO:teuthology.orchestra.run.smithi161.stdout:1809 punch from 0x26693dc to 0x266d8cf, (0x44f3 bytes) 2024-09-21T15:08:29.374 INFO:teuthology.orchestra.run.smithi161.stdout:1810 read 0x65c4e3e thru 0x65c8608 (0x37cb bytes) 2024-09-21T15:08:29.374 INFO:teuthology.orchestra.run.smithi161.stdout:1812 writesame 0x4a24665 thru 0x4a27d69 data_size 0xf(0x3705 bytes) 2024-09-21T15:08:29.385 INFO:teuthology.orchestra.run.smithi161.stdout:1813 read 0x787ebda thru 0x78853b3 (0x67da bytes) 2024-09-21T15:08:29.385 INFO:teuthology.orchestra.run.smithi161.stdout:1814 write 0x6c016a0 thru 0x6c0cd27 (0xb688 bytes) 2024-09-21T15:08:29.402 INFO:teuthology.orchestra.run.smithi161.stdout:2278 writesame 0x65b205c thru 0x65b2cd7 data_size 0x2(0xc7c bytes) 2024-09-21T15:08:29.409 INFO:teuthology.orchestra.run.smithi161.stdout:2201 trunc from 0x941f835 to 0xe10d48c 2024-09-21T15:08:29.411 INFO:teuthology.orchestra.run.smithi161.stdout:1815 write 0x1666a7 thru 0x16d00d (0x6967 bytes) 2024-09-21T15:08:29.412 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.412 INFO:teuthology.orchestra.run.smithi161.stdout:2280 punch from 0x3ab1553 to 0x3abfec2, (0xe96f bytes) 2024-09-21T15:08:29.412 INFO:teuthology.orchestra.run.smithi161.stdout:2282 read 0x3144255 thru 0x314d75f (0x950b bytes) 2024-09-21T15:08:29.447 INFO:teuthology.orchestra.run.smithi161.stdout:2202 writesame 0xc53992a thru 0xc53fe28 data_size 0x1(0x64ff bytes) 2024-09-21T15:08:29.471 INFO:teuthology.orchestra.run.smithi161.stdout:1818 write 0x153497 thru 0x15b13c (0x7ca6 bytes) 2024-09-21T15:08:29.473 INFO:teuthology.orchestra.run.smithi161.stdout:2448 write 0xe9a5c13 thru 0xe9ad9a2 (0x7d90 bytes) 2024-09-21T15:08:29.479 INFO:teuthology.orchestra.run.smithi161.stdout:2283 write 0x7278b65 thru 0x7278e8e (0x32a bytes) 2024-09-21T15:08:29.480 INFO:teuthology.orchestra.run.smithi161.stdout:2203 read 0xdc6ba37 thru 0xdc71cef (0x62b9 bytes) 2024-09-21T15:08:29.481 INFO:teuthology.orchestra.run.smithi161.stdout:2204 read 0x45f1624 thru 0x45fcfbd (0xb99a bytes) 2024-09-21T15:08:29.481 INFO:teuthology.orchestra.run.smithi161.stdout:2205 punch from 0x8ae4749 to 0x8af2525, (0xdddc bytes) 2024-09-21T15:08:29.481 INFO:teuthology.orchestra.run.smithi161.stdout:2206 punch from 0xbcf9669 to 0xbd02bc0, (0x9557 bytes) 2024-09-21T15:08:29.481 INFO:teuthology.orchestra.run.smithi161.stdout:2208 punch from 0x111e2f9 to 0x111e9f0, (0x6f7 bytes) 2024-09-21T15:08:29.481 INFO:teuthology.orchestra.run.smithi161.stdout:2209 read 0xc68d820 thru 0xc69c35c (0xeb3d bytes) 2024-09-21T15:08:29.481 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.482 INFO:teuthology.orchestra.run.smithi161.stdout:2211 write 0x86f98b0 thru 0x87068c3 (0xd014 bytes) 2024-09-21T15:08:29.483 INFO:teuthology.orchestra.run.smithi161.stdout:1819 write 0x106dc8 thru 0x10a385 (0x35be bytes) 2024-09-21T15:08:29.494 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.495 INFO:teuthology.orchestra.run.smithi161.stdout:2450 punch from 0x3045d9b to 0x3046a1c, (0xc81 bytes) 2024-09-21T15:08:29.495 INFO:teuthology.orchestra.run.smithi161.stdout:2451 punch from 0x557120c to 0x5574757, (0x354b bytes) 2024-09-21T15:08:29.495 INFO:teuthology.orchestra.run.smithi161.stdout:2452 write 0x7b55219 thru 0x7b5e27b (0x9063 bytes) 2024-09-21T15:08:29.500 INFO:teuthology.orchestra.run.smithi161.stdout:1820 writesame 0x2b4d15 thru 0x2bf9cf data_size 0x1(0xacbb bytes) 2024-09-21T15:08:29.503 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.514 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.515 INFO:teuthology.orchestra.run.smithi161.stdout:2454 punch from 0x4df69bd to 0x4dfa7f9, (0x3e3c bytes) 2024-09-21T15:08:29.515 INFO:teuthology.orchestra.run.smithi161.stdout:2455 read 0x72301e1 thru 0x7234832 (0x4652 bytes) 2024-09-21T15:08:29.515 INFO:teuthology.orchestra.run.smithi161.stdout:2456 clone 15 order 18 su 131072 sc 13 2024-09-21T15:08:29.532 INFO:teuthology.orchestra.run.smithi161.stdout:2806 write 0x788bc08 thru 0x789ad84 (0xf17d bytes) 2024-09-21T15:08:29.536 INFO:teuthology.orchestra.run.smithi161.stdout:2212 write 0xece20dc thru 0xecee386 (0xc2ab bytes) 2024-09-21T15:08:29.551 INFO:teuthology.orchestra.run.smithi161.stdout:2213 trunc from 0xecee387 to 0xd957ecf 2024-09-21T15:08:29.569 INFO:teuthology.orchestra.run.smithi161.stdout:2807 write 0x5ca6d86 thru 0x5ca9d6c (0x2fe7 bytes) 2024-09-21T15:08:29.577 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #17, image image_cluster1.client.mirror.4-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent18 2024-09-21T15:08:29.579 INFO:teuthology.orchestra.run.smithi161.stdout:2288 writesame 0xed43cfb thru 0xed53c5d data_size 0x5d(0xff63 bytes) 2024-09-21T15:08:29.601 INFO:teuthology.orchestra.run.smithi161.stdout:2289 write 0x1b336db thru 0x1b40f95 (0xd8bb bytes) 2024-09-21T15:08:29.606 INFO:teuthology.orchestra.run.smithi161.stdout:2809 write 0x196d357 thru 0x1971591 (0x423b bytes) 2024-09-21T15:08:29.618 INFO:teuthology.orchestra.run.smithi161.stdout:2290 read 0xb4abcb5 thru 0xb4b7998 (0xbce4 bytes) 2024-09-21T15:08:29.619 INFO:teuthology.orchestra.run.smithi161.stdout:2291 punch from 0xc0bb367 to 0xc0bb8ea, (0x583 bytes) 2024-09-21T15:08:29.620 INFO:teuthology.orchestra.run.smithi161.stdout:2292 writesame 0x5d2c663 thru 0x5d36bd8 data_size 0x1(0xa576 bytes) 2024-09-21T15:08:29.621 INFO:teuthology.orchestra.run.smithi161.stdout:2215 write 0x35b419f thru 0x35b998a (0x57ec bytes) 2024-09-21T15:08:29.624 INFO:teuthology.orchestra.run.smithi161.stdout:1823 write 0xe5fd3e9 thru 0xe60a627 (0xd23f bytes) 2024-09-21T15:08:29.633 INFO:teuthology.orchestra.run.smithi161.stdout:2216 writesame 0x67ed055 thru 0x67ee1ef data_size 0x1(0x119b bytes) 2024-09-21T15:08:29.643 INFO:teuthology.orchestra.run.smithi161.stdout:2811 trunc from 0x789ad85 to 0x1e2159 2024-09-21T15:08:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:1824 read 0xd15a026 thru 0xd162c02 (0x8bdd bytes) 2024-09-21T15:08:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:1825 write 0x5c387c3 thru 0x5c4744b (0xec89 bytes) 2024-09-21T15:08:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:2217 read 0x78e48b0 thru 0x78e96d0 (0x4e21 bytes) 2024-09-21T15:08:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:2219 write 0x720cfc6 thru 0x721b1de (0xe219 bytes) 2024-09-21T15:08:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:2294 read 0x5bbe292 thru 0x5bc3fc1 (0x5d30 bytes) 2024-09-21T15:08:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:2297 read 0x1386821 thru 0x1389221 (0x2a01 bytes) 2024-09-21T15:08:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:2298 punch from 0x87db3e0 to 0x87e2f0d, (0x7b2d bytes) 2024-09-21T15:08:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:2299 write 0x610d567 thru 0x61190c4 (0xbb5e bytes) 2024-09-21T15:08:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:2221 write 0x573c64b thru 0x574b9d8 (0xf38e bytes) 2024-09-21T15:08:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:2300 write 0x1f7ab65 thru 0x1f88f27 (0xe3c3 bytes) 2024-09-21T15:08:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:1827 read 0xd937255 thru 0xd943a25 (0xc7d1 bytes) 2024-09-21T15:08:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:1829 read 0x935984c thru 0x9369663 (0xfe18 bytes) 2024-09-21T15:08:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:2222 write 0x3ff8451 thru 0x40055a6 (0xd156 bytes) 2024-09-21T15:08:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:1830 trunc from 0xe60a628 to 0x1575703 2024-09-21T15:08:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:2302 write 0xa201b11 thru 0xa203375 (0x1865 bytes) 2024-09-21T15:08:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:2223 write 0xc737d6b thru 0xc747c79 (0xff0f bytes) 2024-09-21T15:08:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:2303 punch from 0x9f9b0f5 to 0x9fa16a9, (0x65b4 bytes) 2024-09-21T15:08:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:2305 read 0xe027d7d thru 0xe02fa68 (0x7cec bytes) 2024-09-21T15:08:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:2308 write 0xec7ae37 thru 0xec842a4 (0x946e bytes) 2024-09-21T15:08:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:2224 read 0xcd03344 thru 0xcd0e36c (0xb029 bytes) 2024-09-21T15:08:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:2225 read 0xbe5fb2e thru 0xbe6d88f (0xdd62 bytes) 2024-09-21T15:08:29.792 INFO:teuthology.orchestra.run.smithi161.stdout:2813 punch from 0xf438d to 0xfe29e, (0x9f11 bytes) 2024-09-21T15:08:29.794 INFO:teuthology.orchestra.run.smithi161.stdout:1831 punch from 0x36495 to 0x41117, (0xac82 bytes) 2024-09-21T15:08:29.795 INFO:teuthology.orchestra.run.smithi161.stdout:2226 trunc from 0xd957ecf to 0x4099d5c 2024-09-21T15:08:29.803 INFO:teuthology.orchestra.run.smithi161.stdout:2309 trunc from 0xed53c5e to 0x4693117 2024-09-21T15:08:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:1833 trunc from 0x1575703 to 0x91483eb 2024-09-21T15:08:29.838 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.838 INFO:teuthology.orchestra.run.smithi161.stdout:1838 write 0x6a5f2d5 thru 0x6a67a55 (0x8781 bytes) 2024-09-21T15:08:29.844 INFO:teuthology.orchestra.run.smithi161.stdout:2310 write 0xa2a9e7 thru 0xa3849d (0xdab7 bytes) 2024-09-21T15:08:29.848 INFO:teuthology.orchestra.run.smithi161.stdout:2815 writesame 0xb208603 thru 0xb212fb5 data_size 0x9(0xa9b3 bytes) 2024-09-21T15:08:29.849 INFO:teuthology.orchestra.run.smithi161.stdout:2229 read 0x23d4e4b thru 0x23de4f7 (0x96ad bytes) 2024-09-21T15:08:29.853 INFO:teuthology.orchestra.run.smithi161.stdout:1840 read 0x15e3db3 thru 0x15e7b7b (0x3dc9 bytes) 2024-09-21T15:08:29.853 INFO:teuthology.orchestra.run.smithi161.stdout:1841 read 0x4a84297 thru 0x4a878c2 (0x362c bytes) 2024-09-21T15:08:29.854 INFO:teuthology.orchestra.run.smithi161.stdout:1843 write 0x1833a40 thru 0x1841b85 (0xe146 bytes) 2024-09-21T15:08:29.854 INFO:teuthology.orchestra.run.smithi161.stdout:2816 writesame 0x71774c4 thru 0x717ceb3 data_size 0x8(0x59f0 bytes) 2024-09-21T15:08:29.872 INFO:teuthology.orchestra.run.smithi161.stdout:2311 trunc from 0x4693117 to 0xdee7683 2024-09-21T15:08:29.892 INFO:teuthology.orchestra.run.smithi161.stdout:1844 trunc from 0x91483eb to 0x48fdbe5 2024-09-21T15:08:29.893 INFO:teuthology.orchestra.run.smithi161.stdout:2817 writesame 0xe4df35 thru 0xe5b52e data_size 0x3d(0xd5fa bytes) 2024-09-21T15:08:29.920 INFO:teuthology.orchestra.run.smithi161.stdout:2230 write 0xd79b4f9 thru 0xd7a1905 (0x640d bytes) 2024-09-21T15:08:29.927 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.928 INFO:teuthology.orchestra.run.smithi161.stdout:2313 punch from 0x5323d32 to 0x532c8a0, (0x8b6e bytes) 2024-09-21T15:08:29.930 INFO:teuthology.orchestra.run.smithi161.stdout:2314 read 0x496a39a thru 0x4974891 (0xa4f8 bytes) 2024-09-21T15:08:29.931 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.932 INFO:teuthology.orchestra.run.smithi161.stdout:2318 punch from 0x346cd83 to 0x3476296, (0x9513 bytes) 2024-09-21T15:08:29.932 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.932 INFO:teuthology.orchestra.run.smithi161.stdout:2820 read 0x3b0c2f5 thru 0x3b0eedb (0x2be7 bytes) 2024-09-21T15:08:29.932 INFO:teuthology.orchestra.run.smithi161.stdout:2821 writesame 0x14db444 thru 0x14e093e data_size 0x13(0x54fb bytes) 2024-09-21T15:08:29.932 INFO:teuthology.orchestra.run.smithi161.stdout:2320 write 0xda705b1 thru 0xda71c3a (0x168a bytes) 2024-09-21T15:08:29.936 INFO:teuthology.orchestra.run.smithi161.stdout:2232 write 0xa3174fa thru 0xa31dcd3 (0x67da bytes) 2024-09-21T15:08:29.944 INFO:teuthology.orchestra.run.smithi161.stdout:2321 read 0x81ad2e4 thru 0x81b24d7 (0x51f4 bytes) 2024-09-21T15:08:29.948 INFO:teuthology.orchestra.run.smithi161.stdout:2324 write 0x20526b thru 0x209736 (0x44cc bytes) 2024-09-21T15:08:29.958 INFO:teuthology.orchestra.run.smithi161.stdout:1845 punch from 0x52261b to 0x52f5b4, (0xcf99 bytes) 2024-09-21T15:08:29.958 INFO:teuthology.orchestra.run.smithi161.stdout:2234 write 0xbdf81b2 thru 0xbe00cbc (0x8b0b bytes) 2024-09-21T15:08:29.960 INFO:teuthology.orchestra.run.smithi161.stdout:1847 trunc from 0x48fdbe5 to 0x2edffdb 2024-09-21T15:08:29.978 INFO:teuthology.orchestra.run.smithi161.stdout:2822 punch from 0xd6148c to 0xd67468, (0x5fdc bytes) 2024-09-21T15:08:29.978 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:29.982 INFO:teuthology.orchestra.run.smithi161.stdout:2325 trunc from 0xdee7683 to 0x59d8a9a 2024-09-21T15:08:29.983 INFO:teuthology.orchestra.run.smithi161.stdout:2236 read 0xb5c895e thru 0xb5d4664 (0xbd07 bytes) 2024-09-21T15:08:29.984 INFO:teuthology.orchestra.run.smithi161.stdout:2241 writesame 0xc250d79 thru 0xc2586d2 data_size 0x31(0x795a bytes) 2024-09-21T15:08:29.995 INFO:teuthology.orchestra.run.smithi161.stdout:2242 punch from 0xb3e913a to 0xb3f18e5, (0x87ab bytes) 2024-09-21T15:08:29.995 INFO:teuthology.orchestra.run.smithi161.stdout:2243 write 0x5297f6f thru 0x529a2ce (0x2360 bytes) 2024-09-21T15:08:30.001 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.014 INFO:teuthology.orchestra.run.smithi161.stdout:2244 read 0x8aeb374 thru 0x8aedcb6 (0x2943 bytes) 2024-09-21T15:08:30.014 INFO:teuthology.orchestra.run.smithi161.stdout:2246 punch from 0x2c29537 to 0x2c346a7, (0xb170 bytes) 2024-09-21T15:08:30.030 INFO:teuthology.orchestra.run.smithi161.stdout:2824 write 0xb2163c6 thru 0xb2192a9 (0x2ee4 bytes) 2024-09-21T15:08:30.042 INFO:teuthology.orchestra.run.smithi161.stdout:2326 read 0x127d540 thru 0x127dbf9 (0x6ba bytes) 2024-09-21T15:08:30.045 INFO:teuthology.orchestra.run.smithi161.stdout:2327 punch from 0x2d9753 to 0x2e7017, (0xd8c4 bytes) 2024-09-21T15:08:30.045 INFO:teuthology.orchestra.run.smithi161.stdout:2328 read 0x1e4f53b thru 0x1e5da4e (0xe514 bytes) 2024-09-21T15:08:30.045 INFO:teuthology.orchestra.run.smithi161.stdout:2329 read 0x22c1d8b thru 0x22c3dc0 (0x2036 bytes) 2024-09-21T15:08:30.045 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.045 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.045 INFO:teuthology.orchestra.run.smithi161.stdout:1896 read 0xb63416a thru 0xb63fb9e (0xba35 bytes) 2024-09-21T15:08:30.045 INFO:teuthology.orchestra.run.smithi161.stdout:2247 trunc from 0xd7a1906 to 0x72c55bb 2024-09-21T15:08:30.064 INFO:teuthology.orchestra.run.smithi161.stdout:2330 read 0x5819d34 thru 0x5821e05 (0x80d2 bytes) 2024-09-21T15:08:30.065 INFO:teuthology.orchestra.run.smithi161.stdout:2331 punch from 0x96f7d9 to 0x97c83a, (0xd061 bytes) 2024-09-21T15:08:30.065 INFO:teuthology.orchestra.run.smithi161.stdout:2332 read 0x211204d thru 0x21170f2 (0x50a6 bytes) 2024-09-21T15:08:30.073 INFO:teuthology.orchestra.run.smithi161.stdout:2826 write 0x705ac42 thru 0x705cdda (0x2199 bytes) 2024-09-21T15:08:30.078 INFO:teuthology.orchestra.run.smithi161.stdout:1849 writesame 0xb70ed91 thru 0xb71571c data_size 0x46(0x698c bytes) 2024-09-21T15:08:30.084 INFO:teuthology.orchestra.run.smithi161.stdout:1897 read 0xc8655f6 thru 0xc86609d (0xaa8 bytes) 2024-09-21T15:08:30.085 INFO:teuthology.orchestra.run.smithi161.stdout:1899 read 0xd2abf2f thru 0xd2b25f1 (0x66c3 bytes) 2024-09-21T15:08:30.087 INFO:teuthology.orchestra.run.smithi161.stdout:1900 write 0x414cd33 thru 0x415a8c2 (0xdb90 bytes) 2024-09-21T15:08:30.090 INFO:teuthology.orchestra.run.smithi161.stdout:1851 read 0x3963037 thru 0x3966e64 (0x3e2e bytes) 2024-09-21T15:08:30.090 INFO:teuthology.orchestra.run.smithi161.stdout:1852 write 0x76f1f1f thru 0x76fc1e3 (0xa2c5 bytes) 2024-09-21T15:08:30.112 INFO:teuthology.orchestra.run.smithi161.stdout:2248 read 0x1b3a346 thru 0x1b3dece (0x3b89 bytes) 2024-09-21T15:08:30.113 INFO:teuthology.orchestra.run.smithi161.stdout:2249 read 0x5912d72 thru 0x5914f3b (0x21ca bytes) 2024-09-21T15:08:30.121 INFO:teuthology.orchestra.run.smithi161.stdout:2250 trunc from 0x72c55bb to 0xa9e8bab 2024-09-21T15:08:30.131 INFO:teuthology.orchestra.run.smithi161.stdout:2334 write 0xde34898 thru 0xde43bbb (0xf324 bytes) 2024-09-21T15:08:30.132 INFO:teuthology.orchestra.run.smithi161.stdout:1901 writesame 0x65f5cf9 thru 0x6604266 data_size 0x12(0xe56e bytes) 2024-09-21T15:08:30.141 INFO:teuthology.orchestra.run.smithi161.stdout:2829 write 0xe92578f thru 0xe92ffa1 (0xa813 bytes) 2024-09-21T15:08:30.151 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.151 INFO:teuthology.orchestra.run.smithi161.stdout:2336 punch from 0xbaec30c to 0xbaefa30, (0x3724 bytes) 2024-09-21T15:08:30.151 INFO:teuthology.orchestra.run.smithi161.stdout:2337 write 0x7d84e6f thru 0x7d886ad (0x383f bytes) 2024-09-21T15:08:30.160 INFO:teuthology.orchestra.run.smithi161.stdout:2251 read 0xa549ba8 thru 0xa554fbc (0xb415 bytes) 2024-09-21T15:08:30.160 INFO:teuthology.orchestra.run.smithi161.stdout:2252 read 0xcaa2de thru 0xcab9e9 (0x170c bytes) 2024-09-21T15:08:30.161 INFO:teuthology.orchestra.run.smithi161.stdout:1853 writesame 0xbd4b19d thru 0xbd4f858 data_size 0x12(0x46bc bytes) 2024-09-21T15:08:30.170 INFO:teuthology.orchestra.run.smithi161.stdout:1856 writesame 0x6cb6fd8 thru 0x6cbe4d1 data_size 0x5d(0x74fa bytes) 2024-09-21T15:08:30.178 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.178 INFO:teuthology.orchestra.run.smithi161.stdout:2341 write 0x54d38cb thru 0x54e30bd (0xf7f3 bytes) 2024-09-21T15:08:30.181 INFO:teuthology.orchestra.run.smithi161.stdout:2255 trunc from 0xa9e8bab to 0x4606648 2024-09-21T15:08:30.192 INFO:teuthology.orchestra.run.smithi161.stdout:1902 read 0x4335c81 thru 0x4343aeb (0xde6b bytes) 2024-09-21T15:08:30.193 INFO:teuthology.orchestra.run.smithi161.stdout:2831 read 0xc80501f thru 0xc80e3d6 (0x93b8 bytes) 2024-09-21T15:08:30.200 INFO:teuthology.orchestra.run.smithi161.stdout:1857 read 0x9fdc0c2 thru 0x9fea46b (0xe3aa bytes) 2024-09-21T15:08:30.206 INFO:teuthology.orchestra.run.smithi161.stdout:1860 trunc from 0xbd4f859 to 0xda022f3 2024-09-21T15:08:30.206 INFO:teuthology.orchestra.run.smithi161.stdout:2342 writesame 0xbab346b thru 0xbab659d data_size 0xb(0x3133 bytes) 2024-09-21T15:08:30.218 INFO:teuthology.orchestra.run.smithi161.stdout:2832 trunc from 0xe92ffa2 to 0x76b623e 2024-09-21T15:08:30.224 INFO:teuthology.orchestra.run.smithi161.stdout:2343 trunc from 0xde43bbc to 0xead9600 2024-09-21T15:08:30.227 INFO:teuthology.orchestra.run.smithi161.stdout:1903 trunc from 0xe5e12dd to 0x98e617 2024-09-21T15:08:30.227 INFO:teuthology.orchestra.run.smithi161.stdout:2256 punch from 0x2e5ca19 to 0x2e62b59, (0x6140 bytes) 2024-09-21T15:08:30.227 INFO:teuthology.orchestra.run.smithi161.stdout:2257 read 0x73a68 thru 0x7de8a (0xa423 bytes) 2024-09-21T15:08:30.228 INFO:teuthology.orchestra.run.smithi161.stdout:2258 read 0x247c200 thru 0x2489b81 (0xd982 bytes) 2024-09-21T15:08:30.230 INFO:teuthology.orchestra.run.smithi161.stdout:2259 punch from 0x20ab36c to 0x20b2491, (0x7125 bytes) 2024-09-21T15:08:30.230 INFO:teuthology.orchestra.run.smithi161.stdout:2260 punch from 0x34b8f26 to 0x34c4a60, (0xbb3a bytes) 2024-09-21T15:08:30.230 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.230 INFO:teuthology.orchestra.run.smithi161.stdout:2262 write 0x40c645e thru 0x40d0faf (0xab52 bytes) 2024-09-21T15:08:30.251 INFO:teuthology.orchestra.run.smithi161.stdout:2264 punch from 0x2f13160 to 0x2f1447b, (0x131b bytes) 2024-09-21T15:08:30.251 INFO:teuthology.orchestra.run.smithi161.stdout:2265 read 0x3dafdb3 thru 0x3db64dc (0x672a bytes) 2024-09-21T15:08:30.260 INFO:teuthology.orchestra.run.smithi161.stdout:1861 writesame 0xd523ff1 thru 0xd527e73 data_size 0x1(0x3e83 bytes) 2024-09-21T15:08:30.273 INFO:teuthology.orchestra.run.smithi161.stdout:2346 read 0x9ebd54a thru 0x9ec3f91 (0x6a48 bytes) 2024-09-21T15:08:30.274 INFO:teuthology.orchestra.run.smithi161.stdout:2347 read 0x552e70d thru 0x55368a9 (0x819d bytes) 2024-09-21T15:08:30.276 INFO:teuthology.orchestra.run.smithi161.stdout:2348 write 0x3c27e22 thru 0x3c27fdc (0x1bb bytes) 2024-09-21T15:08:30.286 INFO:teuthology.orchestra.run.smithi161.stdout:2349 read 0x67bde75 thru 0x67bf976 (0x1b02 bytes) 2024-09-21T15:08:30.297 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.297 INFO:teuthology.orchestra.run.smithi161.stdout:2351 read 0xd222a39 thru 0xd22df7b (0xb543 bytes) 2024-09-21T15:08:30.297 INFO:teuthology.orchestra.run.smithi161.stdout:2352 trunc from 0xead9600 to 0xd57580a 2024-09-21T15:08:30.297 INFO:teuthology.orchestra.run.smithi161.stdout:2266 writesame 0x6295d5d thru 0x62962c1 data_size 0x1(0x565 bytes) 2024-09-21T15:08:30.305 INFO:teuthology.orchestra.run.smithi161.stdout:1862 punch from 0x79a387f to 0x79b36d7, (0xfe58 bytes) 2024-09-21T15:08:30.305 INFO:teuthology.orchestra.run.smithi161.stdout:1864 punch from 0xa8de0d to 0xa9d175, (0xf368 bytes) 2024-09-21T15:08:30.305 INFO:teuthology.orchestra.run.smithi161.stdout:1865 punch from 0x33ee8f3 to 0x33f51ad, (0x68ba bytes) 2024-09-21T15:08:30.305 INFO:teuthology.orchestra.run.smithi161.stdout:1866 punch from 0x7780202 to 0x7789619, (0x9417 bytes) 2024-09-21T15:08:30.305 INFO:teuthology.orchestra.run.smithi161.stdout:1868 punch from 0x39c6e9c to 0x39d0ad8, (0x9c3c bytes) 2024-09-21T15:08:30.305 INFO:teuthology.orchestra.run.smithi161.stdout:1869 write 0xe4212b thru 0xe42e99 (0xd6f bytes) 2024-09-21T15:08:30.305 INFO:teuthology.orchestra.run.smithi161.stdout:2835 read 0x4e243f8 thru 0x4e340fb (0xfd04 bytes) 2024-09-21T15:08:30.306 INFO:teuthology.orchestra.run.smithi161.stdout:2836 punch from 0x5fedfbb to 0x5ff1ad6, (0x3b1b bytes) 2024-09-21T15:08:30.321 INFO:teuthology.orchestra.run.smithi161.stdout:2837 trunc from 0x76b623e to 0xc86c58 2024-09-21T15:08:30.329 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.355 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #13, image image_cluster1.client.mirror.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent14 2024-09-21T15:08:30.356 INFO:teuthology.orchestra.run.smithi161.stdout:1872 trunc from 0xda022f3 to 0x3f4756d 2024-09-21T15:08:30.364 INFO:teuthology.orchestra.run.smithi161.stdout:2353 write 0x1f5d6ce thru 0x1f6a767 (0xd09a bytes) 2024-09-21T15:08:30.386 INFO:teuthology.orchestra.run.smithi161.stdout:2267 write 0xb7381b3 thru 0xb743225 (0xb073 bytes) 2024-09-21T15:08:30.392 INFO:teuthology.orchestra.run.smithi161.stdout:2355 punch from 0x72d7249 to 0x72e2941, (0xb6f8 bytes) 2024-09-21T15:08:30.392 INFO:teuthology.orchestra.run.smithi161.stdout:2356 read 0xb976a0a thru 0xb97e5e3 (0x7bda bytes) 2024-09-21T15:08:30.393 INFO:teuthology.orchestra.run.smithi161.stdout:skipping zero length punch hole 2024-09-21T15:08:30.393 INFO:teuthology.orchestra.run.smithi161.stdout:2359 write 0x90a510e thru 0x90b1dcf (0xccc2 bytes) 2024-09-21T15:08:30.412 INFO:teuthology.orchestra.run.smithi161.stdout:2838 read 0x524cf5 thru 0x52f86e (0xab7a bytes) 2024-09-21T15:08:30.418 INFO:teuthology.orchestra.run.smithi161.stdout:2842 trunc from 0xc86c58 to 0x3469ac0 2024-09-21T15:08:30.419 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.419 INFO:teuthology.orchestra.run.smithi161.stdout:1874 write 0x2955875 thru 0x2961730 (0xbebc bytes) 2024-09-21T15:08:30.427 INFO:teuthology.orchestra.run.smithi161.stdout:2360 trunc from 0xd57580a to 0x3c09ff0 2024-09-21T15:08:30.449 INFO:teuthology.orchestra.run.smithi161.stdout:2268 writesame 0xd2b99f0 thru 0xd2c7fd6 data_size 0x5(0xe5e7 bytes) 2024-09-21T15:08:30.462 INFO:teuthology.orchestra.run.smithi161.stdout:2271 trunc from 0xd2c7fd7 to 0x93f2dd2 2024-09-21T15:08:30.484 INFO:teuthology.orchestra.run.smithi161.stdout:1906 write 0x453acb thru 0x45d76d (0x9ca3 bytes) 2024-09-21T15:08:30.498 INFO:teuthology.orchestra.run.smithi161.stdout:2361 trunc from 0x3c09ff0 to 0xb17c92b 2024-09-21T15:08:30.501 INFO:teuthology.orchestra.run.smithi161.stdout:1907 read 0x9437ae thru 0x94416a (0x9bd bytes) 2024-09-21T15:08:30.505 INFO:teuthology.orchestra.run.smithi161.stdout:1875 write 0xa21d9d4 thru 0xa227b62 (0xa18f bytes) 2024-09-21T15:08:30.512 INFO:teuthology.orchestra.run.smithi161.stdout:2843 write 0xa525e53 thru 0xa5324d2 (0xc680 bytes) 2024-09-21T15:08:30.527 INFO:teuthology.orchestra.run.smithi161.stdout:1876 read 0x3d93a4 thru 0x3e4ace (0xb72b bytes) 2024-09-21T15:08:30.530 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.531 INFO:teuthology.orchestra.run.smithi161.stdout:1878 punch from 0x15a79f5 to 0x15b27e8, (0xadf3 bytes) 2024-09-21T15:08:30.533 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.533 INFO:teuthology.orchestra.run.smithi161.stdout:1880 read 0x424cca4 thru 0x4251f7c (0x52d9 bytes) 2024-09-21T15:08:30.533 INFO:teuthology.orchestra.run.smithi161.stdout:1881 clone 22 order 25 su 524288 sc 10 2024-09-21T15:08:30.534 INFO:teuthology.orchestra.run.smithi161.stdout:2272 punch from 0x643eafc to 0x6443da7, (0x52ab bytes) 2024-09-21T15:08:30.541 INFO:teuthology.orchestra.run.smithi161.stdout:2362 read 0xe16e6a thru 0xe22568 (0xb6ff bytes) 2024-09-21T15:08:30.542 INFO:teuthology.orchestra.run.smithi161.stdout:2363 read 0x52d6e9 thru 0x53901e (0xb936 bytes) 2024-09-21T15:08:30.544 INFO:teuthology.orchestra.run.smithi161.stdout:2366 read 0x926eb96 thru 0x9271a52 (0x2ebd bytes) 2024-09-21T15:08:30.544 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.545 INFO:teuthology.orchestra.run.smithi161.stdout:2369 punch from 0x23da16e to 0x23ea027, (0xfeb9 bytes) 2024-09-21T15:08:30.545 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.545 INFO:teuthology.orchestra.run.smithi161.stdout:2371 write 0xadb46ab thru 0xadbc5d3 (0x7f29 bytes) 2024-09-21T15:08:30.559 INFO:teuthology.orchestra.run.smithi161.stdout:2373 write 0x9853840 thru 0x985b089 (0x784a bytes) 2024-09-21T15:08:30.560 INFO:teuthology.orchestra.run.smithi161.stdout:2844 writesame 0x767ec51 thru 0x76891a6 data_size 0x1(0xa556 bytes) 2024-09-21T15:08:30.566 INFO:teuthology.orchestra.run.smithi161.stdout:2274 write 0x9c1a8fc thru 0x9c1c2a0 (0x19a5 bytes) 2024-09-21T15:08:30.574 INFO:teuthology.orchestra.run.smithi161.stdout:1909 write 0xeb41f74 thru 0xeb4a78d (0x881a bytes) 2024-09-21T15:08:30.577 INFO:teuthology.orchestra.run.smithi161.stdout:2375 trunc from 0xb17c92b to 0x88444da 2024-09-21T15:08:30.577 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.586 INFO:teuthology.orchestra.run.smithi161.stdout:2276 trunc from 0x9c1c2a1 to 0x13085f4 2024-09-21T15:08:30.591 INFO:teuthology.orchestra.run.smithi161.stdout:1910 read 0x258448 thru 0x26420a (0xbdc3 bytes) 2024-09-21T15:08:30.595 INFO:teuthology.orchestra.run.smithi161.stdout:1913 read 0x6ce7ee4 thru 0x6cf6e7d (0xef9a bytes) 2024-09-21T15:08:30.596 INFO:teuthology.orchestra.run.smithi161.stdout:1915 punch from 0x8436f27 to 0x843ac25, (0x3cfe bytes) 2024-09-21T15:08:30.596 INFO:teuthology.orchestra.run.smithi161.stdout:1916 read 0x70f2d92 thru 0x71023b2 (0xf621 bytes) 2024-09-21T15:08:30.596 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.596 INFO:teuthology.orchestra.run.smithi161.stdout:1918 read 0x7354c76 thru 0x735d9a5 (0x8d30 bytes) 2024-09-21T15:08:30.596 INFO:teuthology.orchestra.run.smithi161.stdout:1921 read 0x11e03ba thru 0x11e8f8e (0x8bd5 bytes) 2024-09-21T15:08:30.597 INFO:teuthology.orchestra.run.smithi161.stdout:1923 writesame 0x8e9c6e3 thru 0x8e9e484 data_size 0x1(0x1da2 bytes) 2024-09-21T15:08:30.622 INFO:teuthology.orchestra.run.smithi161.stdout:1927 writesame 0x779cda0 thru 0x779df04 data_size 0x1(0x1165 bytes) 2024-09-21T15:08:30.623 INFO:teuthology.orchestra.run.smithi161.stdout:2845 trunc from 0xa5324d3 to 0x5495ea4 2024-09-21T15:08:30.636 INFO:teuthology.orchestra.run.smithi161.stdout:2377 punch from 0x62fc6c0 to 0x6308005, (0xb945 bytes) 2024-09-21T15:08:30.637 INFO:teuthology.orchestra.run.smithi161.stdout:2378 write 0x9ce6b8 thru 0x9d4c05 (0x654e bytes) 2024-09-21T15:08:30.656 INFO:teuthology.orchestra.run.smithi161.stdout:2380 read 0x79659ed thru 0x7970ca7 (0xb2bb bytes) 2024-09-21T15:08:30.656 INFO:teuthology.orchestra.run.smithi161.stdout:2381 writesame 0x3de3dd6 thru 0x3de43c5 data_size 0x14(0x5f0 bytes) 2024-09-21T15:08:30.664 INFO:teuthology.orchestra.run.smithi161.stdout:1928 trunc from 0xeb4a78e to 0x4290ecb 2024-09-21T15:08:30.672 INFO:teuthology.orchestra.run.smithi161.stdout:2382 punch from 0x674f621 to 0x675d240, (0xdc1f bytes) 2024-09-21T15:08:30.672 INFO:teuthology.orchestra.run.smithi161.stdout:2383 write 0xa84882 thru 0xa87f43 (0x36c2 bytes) 2024-09-21T15:08:30.680 INFO:teuthology.orchestra.run.smithi161.stdout:2384 writesame 0x6c19038 thru 0x6c276f8 data_size 0xcb(0xe6c1 bytes) 2024-09-21T15:08:30.689 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.689 INFO:teuthology.orchestra.run.smithi161.stdout:2388 read 0x7b2f2f1 thru 0x7b3a6db (0xb3eb bytes) 2024-09-21T15:08:30.690 INFO:teuthology.orchestra.run.smithi161.stdout:2391 read 0x603e8c7 thru 0x6047468 (0x8ba2 bytes) 2024-09-21T15:08:30.690 INFO:teuthology.orchestra.run.smithi161.stdout:2392 punch from 0x2239db4 to 0x224278a, (0x89d6 bytes) 2024-09-21T15:08:30.690 INFO:teuthology.orchestra.run.smithi161.stdout:2394 read 0x128d244 thru 0x1296f63 (0x9d20 bytes) 2024-09-21T15:08:30.691 INFO:teuthology.orchestra.run.smithi161.stdout:2395 read 0x52ccb4c thru 0x52d288d (0x5d42 bytes) 2024-09-21T15:08:30.692 INFO:teuthology.orchestra.run.smithi161.stdout:2396 read 0x236e77 thru 0x23844c (0x15d6 bytes) 2024-09-21T15:08:30.693 INFO:teuthology.orchestra.run.smithi161.stdout:2397 punch from 0x26fa9a1 to 0x2708487, (0xdae6 bytes) 2024-09-21T15:08:30.693 INFO:teuthology.orchestra.run.smithi161.stdout:2399 writesame 0x18d6e39 thru 0x18e5c17 data_size 0x13(0xeddf bytes) 2024-09-21T15:08:30.697 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.697 INFO:teuthology.orchestra.run.smithi161.stdout:2849 punch from 0x11ebe65 to 0x11f8e42, (0xcfdd bytes) 2024-09-21T15:08:30.697 INFO:teuthology.orchestra.run.smithi161.stdout:2850 write 0x1358c0e thru 0x135d744 (0x4b37 bytes) 2024-09-21T15:08:30.697 INFO:teuthology.orchestra.run.smithi161.stdout:2277 writesame 0x13488ee thru 0x1354bf8 data_size 0x1(0xc30b bytes) 2024-09-21T15:08:30.700 INFO:teuthology.orchestra.run.smithi161.stdout:2400 write 0x83d8a82 thru 0x83defa1 (0x6520 bytes) 2024-09-21T15:08:30.705 INFO:teuthology.orchestra.run.smithi161.stdout:2278 read 0x10228b1 thru 0x10281ff (0x594f bytes) 2024-09-21T15:08:30.729 INFO:teuthology.orchestra.run.smithi161.stdout:2853 read 0x49c4a4e thru 0x49c78b9 (0x2e6c bytes) 2024-09-21T15:08:30.738 INFO:teuthology.orchestra.run.smithi161.stdout:2854 trunc from 0x5495ea4 to 0x97d6dc7 2024-09-21T15:08:30.760 INFO:teuthology.orchestra.run.smithi161.stdout:2401 write 0xa207ed1 thru 0xa208f89 (0x10b9 bytes) 2024-09-21T15:08:30.763 INFO:teuthology.orchestra.run.smithi161.stdout:1929 writesame 0xe895245 thru 0xe8a07da data_size 0xb(0xb596 bytes) 2024-09-21T15:08:30.765 INFO:teuthology.orchestra.run.smithi161.stdout:2280 writesame 0x745011b thru 0x7456640 data_size 0x16(0x6526 bytes) 2024-09-21T15:08:30.770 INFO:teuthology.orchestra.run.smithi161.stdout:1931 writesame 0xb96ab95 thru 0xb9715a1 data_size 0x1(0x6a0d bytes) 2024-09-21T15:08:30.786 INFO:teuthology.orchestra.run.smithi161.stdout:2403 read 0xa9a204 thru 0xaa3e36 (0x9c33 bytes) 2024-09-21T15:08:30.787 INFO:teuthology.orchestra.run.smithi161.stdout:2404 punch from 0x1e03161 to 0x1e0fcc2, (0xcb61 bytes) 2024-09-21T15:08:30.787 INFO:teuthology.orchestra.run.smithi161.stdout:2405 read 0xf1706f thru 0xf1f120 (0x80b2 bytes) 2024-09-21T15:08:30.792 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.792 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.792 INFO:teuthology.orchestra.run.smithi161.stdout:2409 read 0x6cf470a thru 0x6cfe965 (0xa25c bytes) 2024-09-21T15:08:30.811 INFO:teuthology.orchestra.run.smithi161.stdout:2410 writesame 0x6e7469a thru 0x6e7744c data_size 0x1(0x2db3 bytes) 2024-09-21T15:08:30.825 INFO:teuthology.orchestra.run.smithi161.stdout:2856 write 0x2672cf6 thru 0x2677729 (0x4a34 bytes) 2024-09-21T15:08:30.834 INFO:teuthology.orchestra.run.smithi161.stdout:2411 punch from 0x7d18fd4 to 0x7d2184c, (0x8878 bytes) 2024-09-21T15:08:30.834 INFO:teuthology.orchestra.run.smithi161.stdout:2412 punch from 0x12b04ee to 0x12baeea, (0xa9fc bytes) 2024-09-21T15:08:30.834 INFO:teuthology.orchestra.run.smithi161.stdout:2415 punch from 0x85691d2 to 0x85735e5, (0xa413 bytes) 2024-09-21T15:08:30.834 INFO:teuthology.orchestra.run.smithi161.stdout:2416 write 0x929308 thru 0x92ce39 (0x3b32 bytes) 2024-09-21T15:08:30.855 INFO:teuthology.orchestra.run.smithi161.stdout:2417 write 0x781173a thru 0x78186ea (0x6fb1 bytes) 2024-09-21T15:08:30.855 INFO:teuthology.orchestra.run.smithi161.stdout:1932 punch from 0x8a001e to 0x8afe55, (0xfe37 bytes) 2024-09-21T15:08:30.856 INFO:teuthology.orchestra.run.smithi161.stdout:1933 write 0x97fe3ee thru 0x980584f (0x7462 bytes) 2024-09-21T15:08:30.875 INFO:teuthology.orchestra.run.smithi161.stdout:2418 read 0x21a4b5a thru 0x21a4baf (0x56 bytes) 2024-09-21T15:08:30.876 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:30.876 INFO:teuthology.orchestra.run.smithi161.stdout:2421 writesame 0x10f316f thru 0x10f59e0 data_size 0x1f(0x2872 bytes) 2024-09-21T15:08:30.881 INFO:teuthology.orchestra.run.smithi161.stdout:1934 write 0x2d75cf0 thru 0x2d7dd78 (0x8089 bytes) 2024-09-21T15:08:30.884 INFO:teuthology.orchestra.run.smithi161.stdout:2282 write 0xe9a5788 thru 0xe9ab512 (0x5d8b bytes) 2024-09-21T15:08:30.897 INFO:teuthology.orchestra.run.smithi161.stdout:2423 trunc from 0xa208f8a to 0x6e66fec 2024-09-21T15:08:30.909 INFO:teuthology.orchestra.run.smithi161.stdout:2283 read 0x8a8564 thru 0x8ac265 (0x3d02 bytes) 2024-09-21T15:08:30.910 INFO:teuthology.orchestra.run.smithi161.stdout:2284 read 0x110d7a6 thru 0x111af27 (0xd782 bytes) 2024-09-21T15:08:30.910 INFO:teuthology.orchestra.run.smithi161.stdout:2287 write 0xad76b3e thru 0xad7f33c (0x87ff bytes) 2024-09-21T15:08:30.913 INFO:teuthology.orchestra.run.smithi161.stdout:1936 writesame 0x3178cb6 thru 0x3181021 data_size 0xd(0x836c bytes) 2024-09-21T15:08:30.938 INFO:teuthology.orchestra.run.smithi161.stdout:1939 read 0xc4d28f5 thru 0xc4de821 (0xbf2d bytes) 2024-09-21T15:08:30.939 INFO:teuthology.orchestra.run.smithi161.stdout:1940 write 0x8b00613 thru 0x8b0f4e7 (0xeed5 bytes) 2024-09-21T15:08:30.962 INFO:teuthology.orchestra.run.smithi161.stdout:2288 trunc from 0xe9ab513 to 0x2b80787 2024-09-21T15:08:30.963 INFO:teuthology.orchestra.run.smithi161.stdout:1942 write 0x434b8e6 thru 0x434fa19 (0x4134 bytes) 2024-09-21T15:08:30.966 INFO:teuthology.orchestra.run.smithi161.stdout:2426 read 0x6c1578c thru 0x6c1c626 (0x6e9b bytes) 2024-09-21T15:08:30.966 INFO:teuthology.orchestra.run.smithi161.stdout:2857 write 0xd0826e0 thru 0xd08e304 (0xbc25 bytes) 2024-09-21T15:08:30.967 INFO:teuthology.orchestra.run.smithi161.stdout:2427 writesame 0x62ea85a thru 0x62ece0c data_size 0x1(0x25b3 bytes) 2024-09-21T15:08:30.980 INFO:teuthology.orchestra.run.smithi161.stdout:1943 read 0xd20bcb8 thru 0xd215f83 (0xa2cc bytes) 2024-09-21T15:08:30.981 INFO:teuthology.orchestra.run.smithi161.stdout:1945 write 0x87414a4 thru 0x87508eb (0xf448 bytes) 2024-09-21T15:08:30.981 INFO:teuthology.orchestra.run.smithi161.stdout:2430 read 0x31fd1a4 thru 0x3207ce2 (0xab3f bytes) 2024-09-21T15:08:30.991 INFO:teuthology.orchestra.run.smithi161.stdout:2431 trunc from 0x6e66fec to 0x398b413 2024-09-21T15:08:30.992 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.000 INFO:teuthology.orchestra.run.smithi161.stdout:1947 trunc from 0xe8a07db to 0xa7e244e 2024-09-21T15:08:31.015 INFO:teuthology.orchestra.run.smithi161.stdout:2858 read 0x3aed739 thru 0x3af63c6 (0x8c8e bytes) 2024-09-21T15:08:31.015 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.015 INFO:teuthology.orchestra.run.smithi161.stdout:2863 write 0x7a8f2e6 thru 0x7a93373 (0x408e bytes) 2024-09-21T15:08:31.030 INFO:teuthology.orchestra.run.smithi161.stdout:2289 punch from 0x25ff913 to 0x260f8b8, (0xffa5 bytes) 2024-09-21T15:08:31.057 INFO:teuthology.orchestra.run.smithi161.stdout:2432 trunc from 0x398b413 to 0x95960b4 2024-09-21T15:08:31.058 INFO:teuthology.orchestra.run.smithi161.stdout:2865 writesame 0x7b2cd1c thru 0x7b31979 data_size 0x55(0x4c5e bytes) 2024-09-21T15:08:31.073 INFO:teuthology.orchestra.run.smithi161.stdout:1948 punch from 0x188a576 to 0x1890092, (0x5b1c bytes) 2024-09-21T15:08:31.079 INFO:teuthology.orchestra.run.smithi161.stdout:2866 write 0x90f3d76 thru 0x90fd8ce (0x9b59 bytes) 2024-09-21T15:08:31.096 INFO:teuthology.orchestra.run.smithi161.stdout:2290 write 0x8ba08d5 thru 0x8bad45f (0xcb8b bytes) 2024-09-21T15:08:31.100 INFO:teuthology.orchestra.run.smithi161.stdout:2433 writesame 0x256e6cc thru 0x256f0f3 data_size 0x2(0xa28 bytes) 2024-09-21T15:08:31.115 INFO:teuthology.orchestra.run.smithi161.stdout:1949 write 0xb5dfc9b thru 0xb5e9faa (0xa310 bytes) 2024-09-21T15:08:31.126 INFO:teuthology.orchestra.run.smithi161.stdout:2869 read 0x38dc815 thru 0x38dd97f (0x116b bytes) 2024-09-21T15:08:31.126 INFO:teuthology.orchestra.run.smithi161.stdout:2870 punch from 0x1b0730e to 0x1b0bf48, (0x4c3a bytes) 2024-09-21T15:08:31.126 INFO:teuthology.orchestra.run.smithi161.stdout:2871 read 0x2a6a5f9 thru 0x2a72a96 (0x849e bytes) 2024-09-21T15:08:31.126 INFO:teuthology.orchestra.run.smithi161.stdout:2435 punch from 0x110e61d to 0x1115816, (0x71f9 bytes) 2024-09-21T15:08:31.126 INFO:teuthology.orchestra.run.smithi161.stdout:2872 read 0x27ca15f thru 0x27d042b (0x62cd bytes) 2024-09-21T15:08:31.135 INFO:teuthology.orchestra.run.smithi161.stdout:2436 trunc from 0x95960b4 to 0xdc72a9e 2024-09-21T15:08:31.136 INFO:teuthology.orchestra.run.smithi161.stdout:1950 trunc from 0xb5e9fab to 0xdbd7a26 2024-09-21T15:08:31.140 INFO:teuthology.orchestra.run.smithi161.stdout:2873 trunc from 0xd08e305 to 0x60211eb 2024-09-21T15:08:31.148 INFO:teuthology.orchestra.run.smithi161.stdout:2291 writesame 0x9c18ae5 thru 0x9c1eabe data_size 0x1(0x5fda bytes) 2024-09-21T15:08:31.162 INFO:teuthology.orchestra.run.smithi161.stdout:2437 punch from 0xce6152 to 0xcea9ac, (0x485a bytes) 2024-09-21T15:08:31.162 INFO:teuthology.orchestra.run.smithi161.stdout:2438 read 0x9713c8 thru 0x9736ad (0x22e6 bytes) 2024-09-21T15:08:31.163 INFO:teuthology.orchestra.run.smithi161.stdout:2439 write 0x11effd thru 0x1273bc (0x83c0 bytes) 2024-09-21T15:08:31.166 INFO:teuthology.orchestra.run.smithi161.stdout:2292 trunc from 0x9c1eabf to 0xe937c0 2024-09-21T15:08:31.184 INFO:teuthology.orchestra.run.smithi161.stdout:2440 punch from 0x291a051 to 0x29285f9, (0xe5a8 bytes) 2024-09-21T15:08:31.184 INFO:teuthology.orchestra.run.smithi161.stdout:2441 punch from 0x1634636 to 0x163e60e, (0x9fd8 bytes) 2024-09-21T15:08:31.184 INFO:teuthology.orchestra.run.smithi161.stdout:2442 read 0x930876e thru 0x930d9b4 (0x5247 bytes) 2024-09-21T15:08:31.193 INFO:teuthology.orchestra.run.smithi161.stdout:2457 trunc from 0xe9ad9a3 to 0x3f341bf 2024-09-21T15:08:31.202 INFO:teuthology.orchestra.run.smithi161.stdout:2444 trunc from 0xdc72a9e to 0x33b0277 2024-09-21T15:08:31.204 INFO:teuthology.orchestra.run.smithi161.stdout:1951 write 0xed37083 thru 0xed3e3b8 (0x7336 bytes) 2024-09-21T15:08:31.217 INFO:teuthology.orchestra.run.smithi161.stdout:2874 read 0x3bfe18d thru 0x3c07e0b (0x9c7f bytes) 2024-09-21T15:08:31.217 INFO:teuthology.orchestra.run.smithi161.stdout:2875 read 0x1206fe1 thru 0x121197d (0xa99d bytes) 2024-09-21T15:08:31.221 INFO:teuthology.orchestra.run.smithi161.stdout:2876 punch from 0x5a5f472 to 0x5a68f6d, (0x9afb bytes) 2024-09-21T15:08:31.224 INFO:teuthology.orchestra.run.smithi161.stdout:1953 punch from 0x2ef2cce to 0x2f011d1, (0xe503 bytes) 2024-09-21T15:08:31.224 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.224 INFO:teuthology.orchestra.run.smithi161.stdout:1956 read 0xc5b8ce9 thru 0xc5bec16 (0x5f2e bytes) 2024-09-21T15:08:31.224 INFO:teuthology.orchestra.run.smithi161.stdout:1957 punch from 0x239f632 to 0x23ab210, (0xbbde bytes) 2024-09-21T15:08:31.225 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.242 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.243 INFO:teuthology.orchestra.run.smithi161.stdout:2294 read 0x1864cb thru 0x18c158 (0x5c8e bytes) 2024-09-21T15:08:31.243 INFO:teuthology.orchestra.run.smithi161.stdout:2295 read 0x95cc39 thru 0x96521c (0x85e4 bytes) 2024-09-21T15:08:31.244 INFO:teuthology.orchestra.run.smithi161.stdout:2296 punch from 0x2f0085 to 0x2fcae7, (0xca62 bytes) 2024-09-21T15:08:31.244 INFO:teuthology.orchestra.run.smithi161.stdout:2298 read 0x1e6c55 thru 0x1f112b (0xa4d7 bytes) 2024-09-21T15:08:31.245 INFO:teuthology.orchestra.run.smithi161.stdout:2299 read 0x352502 thru 0x360f7a (0xea79 bytes) 2024-09-21T15:08:31.246 INFO:teuthology.orchestra.run.smithi161.stdout:1959 trunc from 0xed3e3b9 to 0xeef8ff 2024-09-21T15:08:31.258 INFO:teuthology.orchestra.run.smithi161.stdout:2300 trunc from 0xe937c0 to 0x81d21ba 2024-09-21T15:08:31.267 INFO:teuthology.orchestra.run.smithi161.stdout:2445 punch from 0x1b591f9 to 0x1b5fbc9, (0x69d0 bytes) 2024-09-21T15:08:31.267 INFO:teuthology.orchestra.run.smithi161.stdout:2446 read 0x1d697af thru 0x1d75595 (0xbde7 bytes) 2024-09-21T15:08:31.269 INFO:teuthology.orchestra.run.smithi161.stdout:2877 write 0xb1ffc2c thru 0xb2067c5 (0x6b9a bytes) 2024-09-21T15:08:31.271 INFO:teuthology.orchestra.run.smithi161.stdout:2449 punch from 0x7f5277 to 0x8048a2, (0xf62b bytes) 2024-09-21T15:08:31.285 INFO:teuthology.orchestra.run.smithi161.stdout:2458 read 0x2db8195 thru 0x2dbfc2e (0x7a9a bytes) 2024-09-21T15:08:31.286 INFO:teuthology.orchestra.run.smithi161.stdout:2459 punch from 0xc361ba to 0xc45d01, (0xfb47 bytes) 2024-09-21T15:08:31.296 INFO:teuthology.orchestra.run.smithi161.stdout:2301 trunc from 0x81d21ba to 0xba4b1e3 2024-09-21T15:08:31.299 INFO:teuthology.orchestra.run.smithi161.stdout:2460 trunc from 0x3f341bf to 0xb401afb 2024-09-21T15:08:31.329 INFO:teuthology.orchestra.run.smithi161.stdout:2450 write 0x5a93bb0 thru 0x5a9fc60 (0xc0b1 bytes) 2024-09-21T15:08:31.329 INFO:teuthology.orchestra.run.smithi161.stdout:2304 write 0x84c1068 thru 0x84cd683 (0xc61c bytes) 2024-09-21T15:08:31.335 INFO:teuthology.orchestra.run.smithi161.stdout:2461 read 0x130dce7 thru 0x1317ee6 (0xa200 bytes) 2024-09-21T15:08:31.336 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.336 INFO:teuthology.orchestra.run.smithi161.stdout:2463 writesame 0x57d2272 thru 0x57dce66 data_size 0x1(0xabf5 bytes) 2024-09-21T15:08:31.341 INFO:teuthology.orchestra.run.smithi161.stdout:1960 read 0x585ed6 thru 0x58cc87 (0x6db2 bytes) 2024-09-21T15:08:31.347 INFO:teuthology.orchestra.run.smithi161.stdout:2452 read 0x1945f43 thru 0x1946e3f (0xefd bytes) 2024-09-21T15:08:31.352 INFO:teuthology.orchestra.run.smithi161.stdout:2306 write 0x42f8155 thru 0x43010b0 (0x8f5c bytes) 2024-09-21T15:08:31.359 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.3-clone21 2024-09-21T15:08:31.373 INFO:teuthology.orchestra.run.smithi161.stdout:2878 write 0xbd5c4c3 thru 0xbd68dbf (0xc8fd bytes) 2024-09-21T15:08:31.383 INFO:teuthology.orchestra.run.smithi161.stdout:2307 trunc from 0xba4b1e3 to 0xd385a3f 2024-09-21T15:08:31.383 INFO:teuthology.orchestra.run.smithi161.stdout:2464 write 0x94b8e54 thru 0x94c2243 (0x93f0 bytes) 2024-09-21T15:08:31.398 INFO:teuthology.orchestra.run.smithi161.stdout:1962 write 0x225ba55 thru 0x225fe54 (0x4400 bytes) 2024-09-21T15:08:31.416 INFO:teuthology.orchestra.run.smithi161.stdout:1963 read 0xd3eda8 thru 0xd46267 (0x74c0 bytes) 2024-09-21T15:08:31.425 INFO:teuthology.orchestra.run.smithi161.stdout:2308 read 0x3e282a4 thru 0x3e32b48 (0xa8a5 bytes) 2024-09-21T15:08:31.425 INFO:teuthology.orchestra.run.smithi161.stdout:2309 writesame 0x938cb5e thru 0x939c1d0 data_size 0x1(0xf673 bytes) 2024-09-21T15:08:31.441 INFO:teuthology.orchestra.run.smithi161.stdout:1967 trunc from 0x225fe55 to 0xe4cfdfd 2024-09-21T15:08:31.462 INFO:teuthology.orchestra.run.smithi161.stdout:2453 write 0x6a45946 thru 0x6a50a57 (0xb112 bytes) 2024-09-21T15:08:31.465 INFO:teuthology.orchestra.run.smithi161.stdout:2879 punch from 0x24b5fdb to 0x24bee59, (0x8e7e bytes) 2024-09-21T15:08:31.475 INFO:teuthology.orchestra.run.smithi161.stdout:2454 writesame 0x28f335 thru 0x29cd4f data_size 0xd(0xda1b bytes) 2024-09-21T15:08:31.475 INFO:teuthology.orchestra.run.smithi161.stdout:2311 write 0x45dc95a thru 0x45e9766 (0xce0d bytes) 2024-09-21T15:08:31.486 INFO:teuthology.orchestra.run.smithi161.stdout:2880 trunc from 0xbd68dc0 to 0x368e7e 2024-09-21T15:08:31.495 INFO:teuthology.orchestra.run.smithi161.stdout:2455 read 0x4484fd2 thru 0x44938df (0xe90e bytes) 2024-09-21T15:08:31.499 INFO:teuthology.orchestra.run.smithi161.stdout:2312 write 0xb89bcb8 thru 0xb8a8343 (0xc68c bytes) 2024-09-21T15:08:31.535 INFO:teuthology.orchestra.run.smithi161.stdout:2313 write 0x5a94470 thru 0x5a9e53a (0xa0cb bytes) 2024-09-21T15:08:31.553 INFO:teuthology.orchestra.run.smithi161.stdout:1968 trunc from 0xe4cfdfd to 0xd2412af 2024-09-21T15:08:31.568 INFO:teuthology.orchestra.run.smithi161.stdout:2314 write 0x94f4641 thru 0x94f9914 (0x52d4 bytes) 2024-09-21T15:08:31.574 INFO:teuthology.orchestra.run.smithi161.stdout:2316 read 0x5b76388 thru 0x5b76993 (0x60c bytes) 2024-09-21T15:08:31.581 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.581 INFO:teuthology.orchestra.run.smithi161.stdout:1970 writesame 0x953a540 thru 0x9548f0b data_size 0xd(0xe9cc bytes) 2024-09-21T15:08:31.596 INFO:teuthology.orchestra.run.smithi161.stdout:2465 write 0xc0e7d82 thru 0xc0f18ab (0x9b2a bytes) 2024-09-21T15:08:31.601 INFO:teuthology.orchestra.run.smithi161.stdout:2317 read 0x82d73d7 thru 0x82d7eba (0xae4 bytes) 2024-09-21T15:08:31.602 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.602 INFO:teuthology.orchestra.run.smithi161.stdout:2319 read 0xbac4fc7 thru 0xbac7112 (0x214c bytes) 2024-09-21T15:08:31.603 INFO:teuthology.orchestra.run.smithi161.stdout:1971 punch from 0xb29ea40 to 0xb2a60f8, (0x76b8 bytes) 2024-09-21T15:08:31.603 INFO:teuthology.orchestra.run.smithi161.stdout:1972 write 0x2833cf6 thru 0x283b87b (0x7b86 bytes) 2024-09-21T15:08:31.603 INFO:teuthology.orchestra.run.smithi161.stdout:2321 writesame 0xb6fdd54 thru 0xb7084a9 data_size 0x1(0xa756 bytes) 2024-09-21T15:08:31.620 INFO:teuthology.orchestra.run.smithi161.stdout:2456 write 0x991f839 thru 0x9929713 (0x9edb bytes) 2024-09-21T15:08:31.637 INFO:teuthology.orchestra.run.smithi161.stdout:2322 write 0x6941b8 thru 0x6a3872 (0xf6bb bytes) 2024-09-21T15:08:31.649 INFO:teuthology.orchestra.run.smithi161.stdout:2323 write 0x26a0315 thru 0x26a8167 (0x7e53 bytes) 2024-09-21T15:08:31.659 INFO:teuthology.orchestra.run.smithi161.stdout:2324 read 0x604a0f7 thru 0x6052bcc (0x8ad6 bytes) 2024-09-21T15:08:31.659 INFO:teuthology.orchestra.run.smithi161.stdout:2325 read 0x6ebb9f0 thru 0x6ecb9ee (0xffff bytes) 2024-09-21T15:08:31.659 INFO:teuthology.orchestra.run.smithi161.stdout:2326 writesame 0xb06f709 thru 0xb074a5e data_size 0x1(0x5356 bytes) 2024-09-21T15:08:31.672 INFO:teuthology.orchestra.run.smithi161.stdout:2467 punch from 0x8e678bf to 0x8e6f496, (0x7bd7 bytes) 2024-09-21T15:08:31.672 INFO:teuthology.orchestra.run.smithi161.stdout:2468 writesame 0x140133a thru 0x140cb78 data_size 0x1(0xb83f bytes) 2024-09-21T15:08:31.685 INFO:teuthology.orchestra.run.smithi161.stdout:2457 write 0x7f9e41e thru 0x7fa9330 (0xaf13 bytes) 2024-09-21T15:08:31.690 INFO:teuthology.orchestra.run.smithi161.stdout:1973 trunc from 0xd2412af to 0x4e9a03d 2024-09-21T15:08:31.703 INFO:teuthology.orchestra.run.smithi161.stdout:2458 read 0x7b5c9cb thru 0x7b6c1b1 (0xf7e7 bytes) 2024-09-21T15:08:31.717 INFO:teuthology.orchestra.run.smithi161.stdout:2469 write 0x7d3532f thru 0x7d4193f (0xc611 bytes) 2024-09-21T15:08:31.717 INFO:teuthology.orchestra.run.smithi161.stdout:2327 read 0xc5a3e39 thru 0xc5a93e5 (0x55ad bytes) 2024-09-21T15:08:31.717 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.728 INFO:teuthology.orchestra.run.smithi161.stdout:2460 write 0x18017d2 thru 0x18032f4 (0x1b23 bytes) 2024-09-21T15:08:31.734 INFO:teuthology.orchestra.run.smithi161.stdout:2329 trunc from 0xd385a3f to 0x54ffe17 2024-09-21T15:08:31.758 INFO:teuthology.orchestra.run.smithi161.stdout:2461 punch from 0x5cf1112 to 0x5cfcbae, (0xba9c bytes) 2024-09-21T15:08:31.762 INFO:teuthology.orchestra.run.smithi161.stdout:2462 trunc from 0x9929714 to 0x79aaf81 2024-09-21T15:08:31.786 INFO:teuthology.orchestra.run.smithi161.stdout:2881 writesame 0xa6baed thru 0xa70c93 data_size 0x1(0x51a7 bytes) 2024-09-21T15:08:31.794 INFO:teuthology.orchestra.run.smithi161.stdout:2882 punch from 0x91c300 to 0x91ca07, (0x707 bytes) 2024-09-21T15:08:31.795 INFO:teuthology.orchestra.run.smithi161.stdout:2472 trunc from 0xc0f18ac to 0xb3f22c6 2024-09-21T15:08:31.814 INFO:teuthology.orchestra.run.smithi161.stdout:1974 read 0x1ca0c67 thru 0x1ca44cf (0x3869 bytes) 2024-09-21T15:08:31.820 INFO:teuthology.orchestra.run.smithi161.stdout:2463 write 0x396f3b5 thru 0x39769a2 (0x75ee bytes) 2024-09-21T15:08:31.822 INFO:teuthology.orchestra.run.smithi161.stdout:2330 read 0xa11f55 thru 0xa19f94 (0x8040 bytes) 2024-09-21T15:08:31.839 INFO:teuthology.orchestra.run.smithi161.stdout:2464 punch from 0x4a4da59 to 0x4a58ea2, (0xb449 bytes) 2024-09-21T15:08:31.839 INFO:teuthology.orchestra.run.smithi161.stdout:2466 flatten 2024-09-21T15:08:31.840 INFO:teuthology.orchestra.run.smithi161.stdout:1977 write 0x51db9fd thru 0x51e9e93 (0xe497 bytes) 2024-09-21T15:08:31.843 INFO:teuthology.orchestra.run.smithi161.stdout:2883 write 0x46fbadc thru 0x4703e20 (0x8345 bytes) 2024-09-21T15:08:31.868 INFO:teuthology.orchestra.run.smithi161.stdout:1978 trunc from 0x51e9e94 to 0xb59bbf8 2024-09-21T15:08:31.869 INFO:teuthology.orchestra.run.smithi161.stdout:2332 write 0xc55704c thru 0xc5609e2 (0x9997 bytes) 2024-09-21T15:08:31.893 INFO:teuthology.orchestra.run.smithi161.stdout:2884 trunc from 0x4703e21 to 0x66cf24b 2024-09-21T15:08:31.913 INFO:teuthology.orchestra.run.smithi161.stdout:2335 trunc from 0xc5609e3 to 0x8404b86 2024-09-21T15:08:31.930 INFO:teuthology.orchestra.run.smithi161.stdout:2473 write 0x12c14c1 thru 0x12ce3fa (0xcf3a bytes) 2024-09-21T15:08:31.944 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.944 INFO:teuthology.orchestra.run.smithi161.stdout:2889 punch from 0x5e2faab to 0x5e3e1d9, (0xe72e bytes) 2024-09-21T15:08:31.944 INFO:teuthology.orchestra.run.smithi161.stdout:2890 punch from 0x1195297 to 0x119cfc2, (0x7d2b bytes) 2024-09-21T15:08:31.946 INFO:teuthology.orchestra.run.smithi161.stdout:2468 write 0xe896e74 thru 0xe8a3431 (0xc5be bytes) 2024-09-21T15:08:31.949 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.949 INFO:teuthology.orchestra.run.smithi161.stdout:2475 write 0x5379efa thru 0x537b733 (0x183a bytes) 2024-09-21T15:08:31.957 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.957 INFO:teuthology.orchestra.run.smithi161.stdout:2471 read 0x46fbd26 thru 0x47092a3 (0xd57e bytes) 2024-09-21T15:08:31.958 INFO:teuthology.orchestra.run.smithi161.stdout:2472 punch from 0xb594bc7 to 0xb59ca24, (0x7e5d bytes) 2024-09-21T15:08:31.958 INFO:teuthology.orchestra.run.smithi161.stdout:2474 write 0x141b7b0 thru 0x141cd8a (0x15db bytes) 2024-09-21T15:08:31.961 INFO:teuthology.orchestra.run.smithi161.stdout:1979 writesame 0xed75443 thru 0xed790cb data_size 0x1(0x3c89 bytes) 2024-09-21T15:08:31.965 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.965 INFO:teuthology.orchestra.run.smithi161.stdout:2477 write 0x794c64b thru 0x7954268 (0x7c1e bytes) 2024-09-21T15:08:31.966 INFO:teuthology.orchestra.run.smithi161.stdout:1980 read 0xb0d259e thru 0xb0d627b (0x3cde bytes) 2024-09-21T15:08:31.966 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.966 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.968 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:31.972 INFO:teuthology.orchestra.run.smithi161.stdout:2891 write 0x8f5ccd2 thru 0x8f61434 (0x4763 bytes) 2024-09-21T15:08:31.975 INFO:teuthology.orchestra.run.smithi161.stdout:2478 read 0x6bd7199 thru 0x6be0398 (0x9200 bytes) 2024-09-21T15:08:31.975 INFO:teuthology.orchestra.run.smithi161.stdout:2480 writesame 0xa1a3e77 thru 0xa1aa8ca data_size 0xa(0x6a54 bytes) 2024-09-21T15:08:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:2479 trunc from 0xe8a3432 to 0x468854a 2024-09-21T15:08:31.988 INFO:teuthology.orchestra.run.smithi161.stdout:1981 trunc from 0xed790cc to 0x2caaef6 2024-09-21T15:08:31.991 INFO:teuthology.orchestra.run.smithi161.stdout:2482 punch from 0x40827dd to 0x4085cce, (0x34f1 bytes) 2024-09-21T15:08:31.991 INFO:teuthology.orchestra.run.smithi161.stdout:2483 punch from 0x7df0f8c to 0x7dffc1a, (0xec8e bytes) 2024-09-21T15:08:31.991 INFO:teuthology.orchestra.run.smithi161.stdout:2484 write 0x85b835c thru 0x85c7a92 (0xf737 bytes) 2024-09-21T15:08:31.992 INFO:teuthology.orchestra.run.smithi161.stdout:2337 write 0x873a45a thru 0x8742248 (0x7def bytes) 2024-09-21T15:08:32.013 INFO:teuthology.orchestra.run.smithi161.stdout:2892 trunc from 0x8f61435 to 0x634a731 2024-09-21T15:08:32.018 INFO:teuthology.orchestra.run.smithi161.stdout:2485 write 0xa5b214f thru 0xa5b9e68 (0x7d1a bytes) 2024-09-21T15:08:32.038 INFO:teuthology.orchestra.run.smithi161.stdout:2338 trunc from 0x8742249 to 0x9cfdd2 2024-09-21T15:08:32.044 INFO:teuthology.orchestra.run.smithi161.stdout:2486 trunc from 0xb3f22c6 to 0xd9a3131 2024-09-21T15:08:32.047 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:32.047 INFO:teuthology.orchestra.run.smithi161.stdout:2481 read 0x34233b4 thru 0x3425c38 (0x2885 bytes) 2024-09-21T15:08:32.081 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:32.082 INFO:teuthology.orchestra.run.smithi161.stdout:2896 trunc from 0x634a731 to 0x591bf82 2024-09-21T15:08:32.084 INFO:teuthology.orchestra.run.smithi161.stdout:2482 write 0x64a9eb0 thru 0x64b1717 (0x7868 bytes) 2024-09-21T15:08:32.087 INFO:teuthology.orchestra.run.smithi161.stdout:2487 trunc from 0xd9a3131 to 0xdcb2ee5 2024-09-21T15:08:32.092 INFO:teuthology.orchestra.run.smithi161.stdout:2483 read 0x300b701 thru 0x301989c (0xe19c bytes) 2024-09-21T15:08:32.093 INFO:teuthology.orchestra.run.smithi161.stdout:2484 read 0x16bca7a thru 0x16bdcc2 (0x1249 bytes) 2024-09-21T15:08:32.094 INFO:teuthology.orchestra.run.smithi161.stdout:2486 read 0x66972 thru 0x6c9cd (0x605c bytes) 2024-09-21T15:08:32.095 INFO:teuthology.orchestra.run.smithi161.stdout:2488 write 0x534a72a thru 0x5355be0 (0xb4b7 bytes) 2024-09-21T15:08:32.098 INFO:teuthology.orchestra.run.smithi161.stdout:2339 read 0x5f764b thru 0x6067fc (0xf1b2 bytes) 2024-09-21T15:08:32.099 INFO:teuthology.orchestra.run.smithi161.stdout:2340 clone 18 order 21 su 131072 sc 11 2024-09-21T15:08:32.101 INFO:teuthology.orchestra.run.smithi161.stdout:1982 write 0x7202e90 thru 0x72057a0 (0x2911 bytes) 2024-09-21T15:08:32.104 INFO:teuthology.orchestra.run.smithi161.stdout:2489 write 0x4118395 thru 0x4126fb4 (0xec20 bytes) 2024-09-21T15:08:32.111 INFO:teuthology.orchestra.run.smithi161.stdout:2898 writesame 0x69b3b8 thru 0x6a85e6 data_size 0x1(0xd22f bytes) 2024-09-21T15:08:32.111 INFO:teuthology.orchestra.run.smithi161.stdout:2489 write 0x41b2680 thru 0x41b7cae (0x562f bytes) 2024-09-21T15:08:32.121 INFO:teuthology.orchestra.run.smithi161.stdout:2490 write 0xcc9fe9b thru 0xcca4025 (0x418b bytes) 2024-09-21T15:08:32.153 INFO:teuthology.orchestra.run.smithi161.stdout:2491 writesame 0x1e9646a thru 0x1e993db data_size 0x1(0x2f72 bytes) 2024-09-21T15:08:32.163 INFO:teuthology.orchestra.run.smithi161.stdout:1983 writesame 0x7c74c86 thru 0x7c7f835 data_size 0x10(0xabb0 bytes) 2024-09-21T15:08:32.167 INFO:teuthology.orchestra.run.smithi161.stdout:1984 read 0x8bb8ae thru 0x8c94b7 (0xdc0a bytes) 2024-09-21T15:08:32.172 INFO:teuthology.orchestra.run.smithi161.stdout:1985 trunc from 0x7c7f836 to 0x9787610 2024-09-21T15:08:32.178 INFO:teuthology.orchestra.run.smithi161.stdout:2492 read 0x6b803a1 thru 0x6b82de2 (0x2a42 bytes) 2024-09-21T15:08:32.179 INFO:teuthology.orchestra.run.smithi161.stdout:2493 read 0xf5b654 thru 0xf5ed1e (0x36cb bytes) 2024-09-21T15:08:32.180 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:32.180 INFO:teuthology.orchestra.run.smithi161.stdout:2496 read 0xaf61116 thru 0xaf6a3f7 (0x92e2 bytes) 2024-09-21T15:08:32.180 INFO:teuthology.orchestra.run.smithi161.stdout:2497 write 0x212b815 thru 0x212ecec (0x34d8 bytes) 2024-09-21T15:08:32.181 INFO:teuthology.orchestra.run.smithi161.stdout:2491 writesame 0xc72610e thru 0xc72e419 data_size 0x4(0x830c bytes) 2024-09-21T15:08:32.189 INFO:teuthology.orchestra.run.smithi161.stdout:2492 trunc from 0xc72e41a to 0xc9708cb 2024-09-21T15:08:32.195 INFO:teuthology.orchestra.run.smithi161.stdout:2899 write 0x7c8fa92 thru 0x7c925e4 (0x2b53 bytes) 2024-09-21T15:08:32.226 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #20, image image_cluster1.client.mirror.3-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent21 2024-09-21T15:08:32.228 INFO:teuthology.orchestra.run.smithi161.stdout:2494 punch from 0xa8757b6 to 0xa8822fb, (0xcb45 bytes) 2024-09-21T15:08:32.238 INFO:teuthology.orchestra.run.smithi161.stdout:2495 trunc from 0xc9708cb to 0x8cdf194 2024-09-21T15:08:32.238 INFO:teuthology.orchestra.run.smithi161.stdout:2498 write 0xe4e7177 thru 0xe4e9885 (0x270f bytes) 2024-09-21T15:08:32.245 INFO:teuthology.orchestra.run.smithi161.stdout:2900 trunc from 0x7c925e5 to 0xcc7344 2024-09-21T15:08:32.246 INFO:teuthology.orchestra.run.smithi161.stdout:1986 write 0xb59fb3c thru 0xb5a9ca6 (0xa16b bytes) 2024-09-21T15:08:32.251 INFO:teuthology.orchestra.run.smithi161.stdout:2499 writesame 0x3c69770 thru 0x3c6ef23 data_size 0x6(0x57b4 bytes) 2024-09-21T15:08:32.257 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:32.257 INFO:teuthology.orchestra.run.smithi161.stdout:1989 read 0x5cacfa6 thru 0x5cb3bfd (0x6c58 bytes) 2024-09-21T15:08:32.257 INFO:teuthology.orchestra.run.smithi161.stdout:1990 punch from 0x4211f32 to 0x4221858, (0xf926 bytes) 2024-09-21T15:08:32.265 INFO:teuthology.orchestra.run.smithi161.stdout:2500 read 0x47a2991 thru 0x47a31b2 (0x822 bytes) 2024-09-21T15:08:32.265 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:32.265 INFO:teuthology.orchestra.run.smithi161.stdout:2502 write 0x447fd5e thru 0x44873d5 (0x7678 bytes) 2024-09-21T15:08:32.271 INFO:teuthology.orchestra.run.smithi161.stdout:2496 read 0x4dcf5a8 thru 0x4dde290 (0xece9 bytes) 2024-09-21T15:08:32.271 INFO:teuthology.orchestra.run.smithi161.stdout:1991 trunc from 0xb5a9ca7 to 0x36dcadc 2024-09-21T15:08:32.281 INFO:teuthology.orchestra.run.smithi161.stdout:2497 trunc from 0x8cdf194 to 0xe02d4fc 2024-09-21T15:08:32.310 INFO:teuthology.orchestra.run.smithi161.stdout:2503 trunc from 0xe4e9886 to 0x5f8f938 2024-09-21T15:08:32.324 INFO:teuthology.orchestra.run.smithi161.stdout:2498 punch from 0x9b8d63 to 0x9bdbda, (0x4e77 bytes) 2024-09-21T15:08:32.333 INFO:teuthology.orchestra.run.smithi161.stdout:2500 trunc from 0xe02d4fc to 0xa09beaf 2024-09-21T15:08:32.368 INFO:teuthology.orchestra.run.smithi161.stdout:1993 punch from 0x1c9a71d to 0x1c9d0bb, (0x299e bytes) 2024-09-21T15:08:32.389 INFO:teuthology.orchestra.run.smithi161.stdout:2901 write 0x2ccb4b0 thru 0x2cd4118 (0x8c69 bytes) 2024-09-21T15:08:32.398 INFO:teuthology.orchestra.run.smithi161.stdout:1994 write 0x619f001 thru 0x61a8f79 (0x9f79 bytes) 2024-09-21T15:08:32.453 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:32.453 INFO:teuthology.orchestra.run.smithi161.stdout:1996 read 0x406194 thru 0x415253 (0xf0c0 bytes) 2024-09-21T15:08:32.473 INFO:teuthology.orchestra.run.smithi161.stdout:1997 trunc from 0x61a8f7a to 0xe05e359 2024-09-21T15:08:32.498 INFO:teuthology.orchestra.run.smithi161.stdout:2000 read 0x8ec369e thru 0x8ed2616 (0xef79 bytes) 2024-09-21T15:08:32.498 INFO:teuthology.orchestra.run.smithi161.stdout:2001 write 0x77c15da thru 0x77cc8bb (0xb2e2 bytes) 2024-09-21T15:08:32.546 INFO:teuthology.orchestra.run.smithi161.stdout:2002 write 0x330cc44 thru 0x331a095 (0xd452 bytes) 2024-09-21T15:08:32.569 INFO:teuthology.orchestra.run.smithi161.stdout:2003 punch from 0xcce2dca to 0xcce7d8f, (0x4fc5 bytes) 2024-09-21T15:08:32.569 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:32.569 INFO:teuthology.orchestra.run.smithi161.stdout:2005 writesame 0xb267689 thru 0xb26925c data_size 0x1a(0x1bd4 bytes) 2024-09-21T15:08:32.580 INFO:teuthology.orchestra.run.smithi161.stdout:2006 write 0x54f8610 thru 0x54fc880 (0x4271 bytes) 2024-09-21T15:08:32.582 INFO:teuthology.orchestra.run.smithi161.stdout:2504 write 0xbd48582 thru 0xbd5585f (0xd2de bytes) 2024-09-21T15:08:32.582 INFO:teuthology.orchestra.run.smithi161.stdout:2502 trunc from 0xa09beaf to 0x1d9a752 2024-09-21T15:08:32.602 INFO:teuthology.orchestra.run.smithi161.stdout:2010 punch from 0x210d6ac to 0x2113af0, (0x6444 bytes) 2024-09-21T15:08:32.602 INFO:teuthology.orchestra.run.smithi161.stdout:2012 write 0x1a1af49 thru 0x1a1bb33 (0xbeb bytes) 2024-09-21T15:08:32.619 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:32.619 INFO:teuthology.orchestra.run.smithi161.stdout:2014 read 0x9ffeb78 thru 0xa0084b6 (0x993f bytes) 2024-09-21T15:08:32.619 INFO:teuthology.orchestra.run.smithi161.stdout:2015 write 0x3e3a75f thru 0x3e44a10 (0xa2b2 bytes) 2024-09-21T15:08:32.639 INFO:teuthology.orchestra.run.smithi161.stdout:2017 write 0x5ac7766 thru 0x5acd7b9 (0x6054 bytes) 2024-09-21T15:08:32.655 INFO:teuthology.orchestra.run.smithi161.stdout:2505 punch from 0xb588d64 to 0xb58b8c4, (0x2b60 bytes) 2024-09-21T15:08:32.655 INFO:teuthology.orchestra.run.smithi161.stdout:2507 writesame 0x86dbe98 thru 0x86eae87 data_size 0x58(0xeff0 bytes) 2024-09-21T15:08:32.676 INFO:teuthology.orchestra.run.smithi161.stdout:2505 trunc from 0x1d9a752 to 0xd1b584f 2024-09-21T15:08:32.699 INFO:teuthology.orchestra.run.smithi161.stdout:2902 write 0x9a9a194 thru 0x9aa5d94 (0xbc01 bytes) 2024-09-21T15:08:32.726 INFO:teuthology.orchestra.run.smithi161.stdout:2508 write 0xa85237f thru 0xa85e933 (0xc5b5 bytes) 2024-09-21T15:08:32.737 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:32.737 INFO:teuthology.orchestra.run.smithi161.stdout:2019 writesame 0xc268578 thru 0xc270220 data_size 0x7(0x7ca9 bytes) 2024-09-21T15:08:32.749 INFO:teuthology.orchestra.run.smithi161.stdout:2506 trunc from 0xd1b584f to 0x7489fc6 2024-09-21T15:08:32.757 INFO:teuthology.orchestra.run.smithi161.stdout:2021 trunc from 0xe05e359 to 0xb88618f 2024-09-21T15:08:32.811 INFO:teuthology.orchestra.run.smithi161.stdout:2509 write 0x4492938 thru 0x44a15c8 (0xec91 bytes) 2024-09-21T15:08:32.840 INFO:teuthology.orchestra.run.smithi161.stdout:2510 writesame 0x1d53cea thru 0x1d62c68 data_size 0x6b(0xef7f bytes) 2024-09-21T15:08:32.895 INFO:teuthology.orchestra.run.smithi161.stdout:2512 read 0xaa5839b thru 0xaa63c22 (0xb888 bytes) 2024-09-21T15:08:32.896 INFO:teuthology.orchestra.run.smithi161.stdout:2513 read 0x93e420c thru 0x93f33cc (0xf1c1 bytes) 2024-09-21T15:08:32.896 INFO:teuthology.orchestra.run.smithi161.stdout:2515 punch from 0x562d647 to 0x5632eca, (0x5883 bytes) 2024-09-21T15:08:32.904 INFO:teuthology.orchestra.run.smithi161.stdout:2903 write 0xbb43ea9 thru 0xbb4f039 (0xb191 bytes) 2024-09-21T15:08:32.961 INFO:teuthology.orchestra.run.smithi161.stdout:2022 read 0x38c228f thru 0x38cbbc0 (0x9932 bytes) 2024-09-21T15:08:32.962 INFO:teuthology.orchestra.run.smithi161.stdout:2023 read 0x2f20e5f thru 0x2f2fcab (0xee4d bytes) 2024-09-21T15:08:32.965 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:32.966 INFO:teuthology.orchestra.run.smithi161.stdout:2905 punch from 0x9726766 to 0x972baf9, (0x5393 bytes) 2024-09-21T15:08:32.966 INFO:teuthology.orchestra.run.smithi161.stdout:2907 write 0x54a4743 thru 0x54b3f1a (0xf7d8 bytes) 2024-09-21T15:08:32.974 INFO:teuthology.orchestra.run.smithi161.stdout:2507 clone 15 order 18 su 1024 sc 4 2024-09-21T15:08:33.001 INFO:teuthology.orchestra.run.smithi161.stdout:2516 write 0xbe8aed6 thru 0xbe9326b (0x8396 bytes) 2024-09-21T15:08:33.022 INFO:teuthology.orchestra.run.smithi161.stdout:2517 read 0x7337545 thru 0x7340b73 (0x962f bytes) 2024-09-21T15:08:33.022 INFO:teuthology.orchestra.run.smithi161.stdout:2518 write 0x56d9eb4 thru 0x56dc52d (0x267a bytes) 2024-09-21T15:08:33.036 INFO:teuthology.orchestra.run.smithi161.stdout:2519 writesame 0x3707f8 thru 0x379598 data_size 0x1(0x8da1 bytes) 2024-09-21T15:08:33.055 INFO:teuthology.orchestra.run.smithi161.stdout:2908 write 0xddecb70 thru 0xdded462 (0x8f3 bytes) 2024-09-21T15:08:33.074 INFO:teuthology.orchestra.run.smithi161.stdout:2520 writesame 0x89d7cc2 thru 0x89d821e data_size 0x1(0x55d bytes) 2024-09-21T15:08:33.087 INFO:teuthology.orchestra.run.smithi161.stdout:2521 writesame 0x3773071 thru 0x37765ad data_size 0x21(0x353d bytes) 2024-09-21T15:08:33.089 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:33.089 INFO:teuthology.orchestra.run.smithi161.stdout:2911 punch from 0xa7bb777 to 0xa7bdf9a, (0x2823 bytes) 2024-09-21T15:08:33.098 INFO:teuthology.orchestra.run.smithi161.stdout:2522 write 0xa66b481 thru 0xa672404 (0x6f84 bytes) 2024-09-21T15:08:33.109 INFO:teuthology.orchestra.run.smithi161.stdout:2523 punch from 0x851b142 to 0x851c54b, (0x1409 bytes) 2024-09-21T15:08:33.109 INFO:teuthology.orchestra.run.smithi161.stdout:2524 write 0x4a63760 thru 0x4a6b1ac (0x7a4d bytes) 2024-09-21T15:08:33.119 INFO:teuthology.orchestra.run.smithi161.stdout:2913 trunc from 0xdded463 to 0x2aa0d1 2024-09-21T15:08:33.123 INFO:teuthology.orchestra.run.smithi161.stdout:2525 read 0xba90302 thru 0xba976cb (0x73ca bytes) 2024-09-21T15:08:33.123 INFO:teuthology.orchestra.run.smithi161.stdout:2526 write 0x49fbe55 thru 0x4a0a1d0 (0xe37c bytes) 2024-09-21T15:08:33.146 INFO:teuthology.orchestra.run.smithi161.stdout:2024 write 0xd7b3ca9 thru 0xd7b73b8 (0x3710 bytes) 2024-09-21T15:08:33.160 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:33.161 INFO:teuthology.orchestra.run.smithi161.stdout:2528 read 0x2262422 thru 0x226e02b (0xbc0a bytes) 2024-09-21T15:08:33.164 INFO:teuthology.orchestra.run.smithi161.stdout:2529 trunc from 0xbe9326c to 0xafb0b37 2024-09-21T15:08:33.169 INFO:teuthology.orchestra.run.smithi161.stdout:2025 punch from 0x7b3c725 to 0x7b43f97, (0x7872 bytes) 2024-09-21T15:08:33.173 INFO:teuthology.orchestra.run.smithi161.stdout:2026 trunc from 0xd7b73b9 to 0xb8c6b5e 2024-09-21T15:08:33.273 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #16, image image_cluster1.client.mirror.5-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent17 2024-09-21T15:08:33.416 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.321+0000 7ff753f07700 -1 reset not still connected to 0x560167cc5860 2024-09-21T15:08:33.416 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x560168756a90 2024-09-21T15:08:33.416 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x56016878a1a0 2024-09-21T15:08:33.416 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x56016878ab60 2024-09-21T15:08:33.416 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x56016878ac30 2024-09-21T15:08:33.416 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x56016878add0 2024-09-21T15:08:33.416 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x56016878b110 2024-09-21T15:08:33.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x56016878b1e0 2024-09-21T15:08:33.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x56016878ba00 2024-09-21T15:08:33.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x56016878bc70 2024-09-21T15:08:33.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x560168802750 2024-09-21T15:08:33.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x5601688028f0 2024-09-21T15:08:33.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x560168803ee0 2024-09-21T15:08:33.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x560168ff6dd0 2024-09-21T15:08:33.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x5601692225b0 2024-09-21T15:08:33.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.325+0000 7ff753f07700 -1 reset not still connected to 0x5601692b52b0 2024-09-21T15:08:33.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.329+0000 7ff753f07700 -1 reset not still connected to 0x560169f10270 2024-09-21T15:08:33.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.329+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9c70 2024-09-21T15:08:33.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.329+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e64e0 2024-09-21T15:08:33.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.329+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e72b0 2024-09-21T15:08:33.418 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.329+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72d00 2024-09-21T15:08:33.418 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.329+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72dd0 2024-09-21T15:08:33.418 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:33.329+0000 7ff753f07700 -1 reset not still connected to 0x56016ad41ee0 2024-09-21T15:08:33.418 INFO:teuthology.orchestra.run.smithi161.stdout:2531 read 0x6a70c4d thru 0x6a7eb7c (0xdf30 bytes) 2024-09-21T15:08:33.418 INFO:teuthology.orchestra.run.smithi161.stdout:2532 write 0x6c42e1d thru 0x6c4e396 (0xb57a bytes) 2024-09-21T15:08:33.418 INFO:teuthology.orchestra.run.smithi161.stdout:2533 trunc from 0xafb0b37 to 0x502dc0c 2024-09-21T15:08:33.419 INFO:teuthology.orchestra.run.smithi161.stdout:2027 writesame 0xd0b2c15 thru 0xd0bba9c data_size 0x4(0x8e88 bytes) 2024-09-21T15:08:33.419 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:33.419 INFO:teuthology.orchestra.run.smithi161.stdout:2032 write 0x31c032f thru 0x31cc3ad (0xc07f bytes) 2024-09-21T15:08:33.427 INFO:teuthology.orchestra.run.smithi161.stdout:2033 trunc from 0xd0bba9d to 0x476f67b 2024-09-21T15:08:33.482 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:33.482 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:33.482 INFO:teuthology.orchestra.run.smithi161.stdout:2538 read 0x4154023 thru 0x415e71d (0xa6fb bytes) 2024-09-21T15:08:33.503 INFO:teuthology.orchestra.run.smithi161.stdout:2539 writesame 0x5400d70 thru 0x540e139 data_size 0x1(0xd3ca bytes) 2024-09-21T15:08:33.546 INFO:teuthology.orchestra.run.smithi161.stdout:2914 write 0x90b44e9 thru 0x90bf3f0 (0xaf08 bytes) 2024-09-21T15:08:33.565 INFO:teuthology.orchestra.run.smithi161.stdout:2540 trunc from 0x540e13a to 0x39802af 2024-09-21T15:08:33.590 INFO:teuthology.orchestra.run.smithi161.stdout:2916 punch from 0x4597a6a to 0x45a13d1, (0x9967 bytes) 2024-09-21T15:08:33.606 INFO:teuthology.orchestra.run.smithi161.stdout:2035 writesame 0x6b93334 thru 0x6b9c63a data_size 0x13(0x9307 bytes) 2024-09-21T15:08:33.625 INFO:teuthology.orchestra.run.smithi161.stdout:2917 write 0xbf4c2e6 thru 0xbf5270c (0x6427 bytes) 2024-09-21T15:08:33.674 INFO:teuthology.orchestra.run.smithi161.stdout:2036 write 0xbe3cd4f thru 0xbe444c1 (0x7773 bytes) 2024-09-21T15:08:33.674 INFO:teuthology.orchestra.run.smithi161.stdout:2918 trunc from 0xbf5270d to 0x7fbd607 2024-09-21T15:08:33.698 INFO:teuthology.orchestra.run.smithi161.stdout:2038 write 0x4c92043 thru 0x4c98921 (0x68df bytes) 2024-09-21T15:08:33.744 INFO:teuthology.orchestra.run.smithi161.stdout:2541 write 0xc7c798d thru 0xc7ccde7 (0x545b bytes) 2024-09-21T15:08:33.756 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:33.760 INFO:teuthology.orchestra.run.smithi161.stdout:2542 read 0x86a7726 thru 0x86adefa (0x67d5 bytes) 2024-09-21T15:08:33.760 INFO:teuthology.orchestra.run.smithi161.stdout:2543 write 0xbb72f06 thru 0xbb7aef1 (0x7fec bytes) 2024-09-21T15:08:33.777 INFO:teuthology.orchestra.run.smithi161.stdout:2544 writesame 0x9e2d988 thru 0x9e3a2a5 data_size 0x3(0xc91e bytes) 2024-09-21T15:08:33.812 INFO:teuthology.orchestra.run.smithi161.stdout:2921 write 0xb8d15a6 thru 0xb8dff11 (0xe96c bytes) 2024-09-21T15:08:33.829 INFO:teuthology.orchestra.run.smithi161.stdout:2546 writesame 0x5af65ec thru 0x5afaddd data_size 0x1(0x47f2 bytes) 2024-09-21T15:08:33.865 INFO:teuthology.orchestra.run.smithi161.stdout:2922 read 0x708a452 thru 0x70903fc (0x5fab bytes) 2024-09-21T15:08:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:2923 read 0x1b52570 thru 0x1b592ef (0x6d80 bytes) 2024-09-21T15:08:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:2924 punch from 0xaa7a3b3 to 0xaa883d5, (0xe022 bytes) 2024-09-21T15:08:33.867 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:33.867 INFO:teuthology.orchestra.run.smithi161.stdout:2927 read 0x7fa3047 thru 0x7fb1cdb (0xec95 bytes) 2024-09-21T15:08:33.867 INFO:teuthology.orchestra.run.smithi161.stdout:2928 writesame 0x6039164 thru 0x60454d5 data_size 0x5d(0xc372 bytes) 2024-09-21T15:08:33.878 INFO:teuthology.orchestra.run.smithi161.stdout:2548 trunc from 0xc7ccde8 to 0x4ac874d 2024-09-21T15:08:33.882 INFO:teuthology.orchestra.run.smithi161.stdout:2341 read 0x177a08 thru 0x181dde (0xa3d7 bytes) 2024-09-21T15:08:33.912 INFO:teuthology.orchestra.run.smithi161.stdout:2929 punch from 0x37e79d4 to 0x37e7b33, (0x15f bytes) 2024-09-21T15:08:33.913 INFO:teuthology.orchestra.run.smithi161.stdout:2930 clone 15 order 22 su 2097152 sc 9 2024-09-21T15:08:33.934 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:33.986 INFO:teuthology.orchestra.run.smithi161.stdout:2342 write 0x2b812c5 thru 0x2b87adf (0x681b bytes) 2024-09-21T15:08:33.989 INFO:teuthology.orchestra.run.smithi161.stdout:2552 writesame 0xd418b73 thru 0xd42466f data_size 0x1(0xbafd bytes) 2024-09-21T15:08:33.994 INFO:teuthology.orchestra.run.smithi161.stdout:2553 read 0x2affcb8 thru 0x2b09a60 (0x9da9 bytes) 2024-09-21T15:08:33.995 INFO:teuthology.orchestra.run.smithi161.stdout:2554 write 0x38e5355 thru 0x38ea129 (0x4dd5 bytes) 2024-09-21T15:08:33.998 INFO:teuthology.orchestra.run.smithi161.stdout:2343 read 0x28d66b9 thru 0x28dd215 (0x6b5d bytes) 2024-09-21T15:08:34.006 INFO:teuthology.orchestra.run.smithi161.stdout:2555 writesame 0x46e27d6 thru 0x46eeb62 data_size 0x6f(0xc38d bytes) 2024-09-21T15:08:34.015 INFO:teuthology.orchestra.run.smithi161.stdout:2346 trunc from 0x2b87ae0 to 0xbd74dc9 2024-09-21T15:08:34.020 INFO:teuthology.orchestra.run.smithi161.stdout:2556 write 0x62b8e0a thru 0x62c3aff (0xacf6 bytes) 2024-09-21T15:08:34.042 INFO:teuthology.orchestra.run.smithi161.stdout:2558 writesame 0x4955057 thru 0x495b4a6 data_size 0x78(0x6450 bytes) 2024-09-21T15:08:34.054 INFO:teuthology.orchestra.run.smithi161.stdout:2559 read 0x349ff5b thru 0x34a1504 (0x15aa bytes) 2024-09-21T15:08:34.055 INFO:teuthology.orchestra.run.smithi161.stdout:2560 punch from 0x47ee7df to 0x47fe38f, (0xfbb0 bytes) 2024-09-21T15:08:34.055 INFO:teuthology.orchestra.run.smithi161.stdout:2561 punch from 0xab458b6 to 0xab5522a, (0xf974 bytes) 2024-09-21T15:08:34.055 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.055 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.059 INFO:teuthology.orchestra.run.smithi161.stdout:2348 write 0xccd0c6 thru 0xcdc81e (0xf759 bytes) 2024-09-21T15:08:34.070 INFO:teuthology.orchestra.run.smithi161.stdout:2040 write 0xd343351 thru 0xd34aad5 (0x7785 bytes) 2024-09-21T15:08:34.074 INFO:teuthology.orchestra.run.smithi161.stdout:2349 read 0xad22ca3 thru 0xad28090 (0x53ee bytes) 2024-09-21T15:08:34.080 INFO:teuthology.orchestra.run.smithi161.stdout:2041 punch from 0x6263863 to 0x626ff7a, (0xc717 bytes) 2024-09-21T15:08:34.080 INFO:teuthology.orchestra.run.smithi161.stdout:2042 write 0xab7fafe thru 0xab83dc0 (0x42c3 bytes) 2024-09-21T15:08:34.086 INFO:teuthology.orchestra.run.smithi161.stdout:2566 write 0xdd65eac thru 0xdd745ab (0xe700 bytes) 2024-09-21T15:08:34.087 INFO:teuthology.orchestra.run.smithi161.stdout:2350 trunc from 0xbd74dc9 to 0x4b4d306 2024-09-21T15:08:34.093 INFO:teuthology.orchestra.run.smithi161.stdout:2043 punch from 0x8921413 to 0x8921ca7, (0x894 bytes) 2024-09-21T15:08:34.093 INFO:teuthology.orchestra.run.smithi161.stdout:2045 read 0xc7d991b thru 0xc7e1219 (0x78ff bytes) 2024-09-21T15:08:34.093 INFO:teuthology.orchestra.run.smithi161.stdout:2046 writesame 0x5d2e3b2 thru 0x5d343bf data_size 0x5(0x600e bytes) 2024-09-21T15:08:34.099 INFO:teuthology.orchestra.run.smithi161.stdout:2567 write 0xb718265 thru 0xb721d19 (0x9ab5 bytes) 2024-09-21T15:08:34.105 INFO:teuthology.orchestra.run.smithi161.stdout:2047 punch from 0x8f55875 to 0x8f5ee21, (0x95ac bytes) 2024-09-21T15:08:34.105 INFO:teuthology.orchestra.run.smithi161.stdout:2048 read 0x306bc03 thru 0x3073851 (0x7c4f bytes) 2024-09-21T15:08:34.116 INFO:teuthology.orchestra.run.smithi161.stdout:2050 trunc from 0xd34aad6 to 0x6563839 2024-09-21T15:08:34.118 INFO:teuthology.orchestra.run.smithi161.stdout:2568 punch from 0x2697b36 to 0x269f1c7, (0x7691 bytes) 2024-09-21T15:08:34.118 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.119 INFO:teuthology.orchestra.run.smithi161.stdout:2571 punch from 0x3877122 to 0x387e6eb, (0x75c9 bytes) 2024-09-21T15:08:34.119 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.130 INFO:teuthology.orchestra.run.smithi161.stdout:2574 trunc from 0xdd745ac to 0x7c5ab11 2024-09-21T15:08:34.159 INFO:teuthology.orchestra.run.smithi161.stdout:2353 write 0x7da858d thru 0x7db3b44 (0xb5b8 bytes) 2024-09-21T15:08:34.182 INFO:teuthology.orchestra.run.smithi161.stdout:2575 trunc from 0x7c5ab11 to 0x3d4649c 2024-09-21T15:08:34.193 INFO:teuthology.orchestra.run.smithi161.stdout:2051 writesame 0x718b812 thru 0x7198c63 data_size 0x3(0xd452 bytes) 2024-09-21T15:08:34.198 INFO:teuthology.orchestra.run.smithi161.stdout:2052 punch from 0x4634eef to 0x463b432, (0x6543 bytes) 2024-09-21T15:08:34.198 INFO:teuthology.orchestra.run.smithi161.stdout:2055 read 0x2a08d81 thru 0x2a0c28e (0x350e bytes) 2024-09-21T15:08:34.199 INFO:teuthology.orchestra.run.smithi161.stdout:2056 read 0x3e0bca9 thru 0x3e1abad (0xef05 bytes) 2024-09-21T15:08:34.200 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.200 INFO:teuthology.orchestra.run.smithi161.stdout:2061 read 0x1cb7f10 thru 0x1cb919b (0x128c bytes) 2024-09-21T15:08:34.214 INFO:teuthology.orchestra.run.smithi161.stdout:2354 write 0x9f0051d thru 0x9f02229 (0x1d0d bytes) 2024-09-21T15:08:34.224 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.224 INFO:teuthology.orchestra.run.smithi161.stdout:2356 write 0x225a3af thru 0x226160f (0x7261 bytes) 2024-09-21T15:08:34.231 INFO:teuthology.orchestra.run.smithi161.stdout:2576 read 0x22f750b thru 0x23015e7 (0xa0dd bytes) 2024-09-21T15:08:34.236 INFO:teuthology.orchestra.run.smithi161.stdout:2062 write 0xbc140f4 thru 0xbc163f8 (0x2305 bytes) 2024-09-21T15:08:34.238 INFO:teuthology.orchestra.run.smithi161.stdout:2357 trunc from 0x9f0222a to 0xae0236c 2024-09-21T15:08:34.240 INFO:teuthology.orchestra.run.smithi161.stdout:2577 trunc from 0x3d4649c to 0x7374767 2024-09-21T15:08:34.246 INFO:teuthology.orchestra.run.smithi161.stdout:2063 write 0x9a578db thru 0x9a57c74 (0x39a bytes) 2024-09-21T15:08:34.253 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.253 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.253 INFO:teuthology.orchestra.run.smithi161.stdout:2068 read 0x60f067 thru 0x61414f (0x50e9 bytes) 2024-09-21T15:08:34.254 INFO:teuthology.orchestra.run.smithi161.stdout:2069 read 0xdf3ab4 thru 0xe000e0 (0xc62d bytes) 2024-09-21T15:08:34.255 INFO:teuthology.orchestra.run.smithi161.stdout:2070 write 0x636fc93 thru 0x637a1a4 (0xa512 bytes) 2024-09-21T15:08:34.265 INFO:teuthology.orchestra.run.smithi161.stdout:2578 write 0x374d9a thru 0x381919 (0xcb80 bytes) 2024-09-21T15:08:34.265 INFO:teuthology.orchestra.run.smithi161.stdout:2073 write 0x17416a9 thru 0x1749753 (0x80ab bytes) 2024-09-21T15:08:34.268 INFO:teuthology.orchestra.run.smithi161.stdout:2358 read 0x648946c thru 0x648f7b4 (0x6349 bytes) 2024-09-21T15:08:34.276 INFO:teuthology.orchestra.run.smithi161.stdout:2359 trunc from 0xae0236c to 0xea4bb82 2024-09-21T15:08:34.281 INFO:teuthology.orchestra.run.smithi161.stdout:2581 write 0x544cb86 thru 0x545c08e (0xf509 bytes) 2024-09-21T15:08:34.283 INFO:teuthology.orchestra.run.smithi161.stdout:2074 trunc from 0xbc163f9 to 0xe50cd73 2024-09-21T15:08:34.293 INFO:teuthology.orchestra.run.smithi161.stdout:2582 writesame 0x42c8d34 thru 0x42cce91 data_size 0x3(0x415e bytes) 2024-09-21T15:08:34.298 INFO:teuthology.orchestra.run.smithi161.stdout:2360 writesame 0xd644ed8 thru 0xd651234 data_size 0x3(0xc35d bytes) 2024-09-21T15:08:34.306 INFO:teuthology.orchestra.run.smithi161.stdout:2583 read 0x2e509e6 thru 0x2e55717 (0x4d32 bytes) 2024-09-21T15:08:34.307 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.307 INFO:teuthology.orchestra.run.smithi161.stdout:2587 read 0x6fc2f27 thru 0x6fcdffe (0xb0d8 bytes) 2024-09-21T15:08:34.320 INFO:teuthology.orchestra.run.smithi161.stdout:2364 write 0x1a9715e thru 0x1a9d3d9 (0x627c bytes) 2024-09-21T15:08:34.321 INFO:teuthology.orchestra.run.smithi161.stdout:2588 trunc from 0x7374767 to 0xca607d8 2024-09-21T15:08:34.334 INFO:teuthology.orchestra.run.smithi161.stdout:2366 read 0x5cf24de thru 0x5cfe7d6 (0xc2f9 bytes) 2024-09-21T15:08:34.354 INFO:teuthology.orchestra.run.smithi161.stdout:2367 trunc from 0xea4bb82 to 0x38373ec 2024-09-21T15:08:34.380 INFO:teuthology.orchestra.run.smithi161.stdout:2589 write 0xeda7f6e thru 0xedad796 (0x5829 bytes) 2024-09-21T15:08:34.389 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #13, image image_cluster1.client.mirror.1-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent14 2024-09-21T15:08:34.391 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.391 INFO:teuthology.orchestra.run.smithi161.stdout:2593 read 0xd846b1b thru 0xd85196e (0xae54 bytes) 2024-09-21T15:08:34.391 INFO:teuthology.orchestra.run.smithi161.stdout:2596 punch from 0x4a4ef7 to 0x4af1f5, (0xa2fe bytes) 2024-09-21T15:08:34.392 INFO:teuthology.orchestra.run.smithi161.stdout:2599 writesame 0xacad592 thru 0xacbb738 data_size 0x1(0xe1a7 bytes) 2024-09-21T15:08:34.397 INFO:teuthology.orchestra.run.smithi161.stdout:2368 read 0xb958d1 thru 0xb9ff20 (0xa650 bytes) 2024-09-21T15:08:34.397 INFO:teuthology.orchestra.run.smithi161.stdout:2369 read 0x28ab82d thru 0x28ba252 (0xea26 bytes) 2024-09-21T15:08:34.434 INFO:teuthology.orchestra.run.smithi161.stdout:2075 read 0xd338256 thru 0xd33b1d0 (0x2f7b bytes) 2024-09-21T15:08:34.445 INFO:teuthology.orchestra.run.smithi161.stdout:2600 read 0xb488e36 thru 0xb492b87 (0x9d52 bytes) 2024-09-21T15:08:34.445 INFO:teuthology.orchestra.run.smithi161.stdout:2601 punch from 0xa007c57 to 0xa017352, (0xf6fb bytes) 2024-09-21T15:08:34.445 INFO:teuthology.orchestra.run.smithi161.stdout:2602 writesame 0x51dcb9f thru 0x51e58ca data_size 0x1(0x8d2c bytes) 2024-09-21T15:08:34.445 INFO:teuthology.orchestra.run.smithi161.stdout:2508 write 0x72c3b65 thru 0x72c6706 (0x2ba2 bytes) 2024-09-21T15:08:34.451 INFO:teuthology.orchestra.run.smithi161.stdout:2077 trunc from 0xe50cd73 to 0x6171c71 2024-09-21T15:08:34.465 INFO:teuthology.orchestra.run.smithi161.stdout:2370 writesame 0x96ffbb9 thru 0x9706861 data_size 0x1(0x6ca9 bytes) 2024-09-21T15:08:34.473 INFO:teuthology.orchestra.run.smithi161.stdout:2372 read 0xf98088 thru 0xfa320a (0xb183 bytes) 2024-09-21T15:08:34.474 INFO:teuthology.orchestra.run.smithi161.stdout:2605 read 0xc9d411f thru 0xc9dd6f7 (0x95d9 bytes) 2024-09-21T15:08:34.475 INFO:teuthology.orchestra.run.smithi161.stdout:2606 writesame 0x6c3ee35 thru 0x6c481fe data_size 0x1(0x93ca bytes) 2024-09-21T15:08:34.483 INFO:teuthology.orchestra.run.smithi161.stdout:2374 trunc from 0x9706862 to 0x55471e7 2024-09-21T15:08:34.510 INFO:teuthology.orchestra.run.smithi161.stdout:2607 punch from 0x7c0b32c to 0x7c198fb, (0xe5cf bytes) 2024-09-21T15:08:34.510 INFO:teuthology.orchestra.run.smithi161.stdout:2608 write 0x3f94119 thru 0x3fa2251 (0xe139 bytes) 2024-09-21T15:08:34.522 INFO:teuthology.orchestra.run.smithi161.stdout:2078 read 0x3d86691 thru 0x3d90582 (0x9ef2 bytes) 2024-09-21T15:08:34.522 INFO:teuthology.orchestra.run.smithi161.stdout:2080 read 0x59b1f45 thru 0x59bb37b (0x9437 bytes) 2024-09-21T15:08:34.522 INFO:teuthology.orchestra.run.smithi161.stdout:2081 writesame 0x4364aa8 thru 0x437474b data_size 0x5c(0xfca4 bytes) 2024-09-21T15:08:34.535 INFO:teuthology.orchestra.run.smithi161.stdout:2082 read 0x5196444 thru 0x51a4eeb (0xeaa8 bytes) 2024-09-21T15:08:34.545 INFO:teuthology.orchestra.run.smithi161.stdout:2609 trunc from 0xedad797 to 0x68905ba 2024-09-21T15:08:34.580 INFO:teuthology.orchestra.run.smithi161.stdout:2084 writesame 0xcecec8d thru 0xced5345 data_size 0x1(0x66b9 bytes) 2024-09-21T15:08:34.584 INFO:teuthology.orchestra.run.smithi161.stdout:2089 punch from 0x1b80225 to 0x1b8aeda, (0xacb5 bytes) 2024-09-21T15:08:34.584 INFO:teuthology.orchestra.run.smithi161.stdout:2090 punch from 0x36d173b to 0x36da969, (0x922e bytes) 2024-09-21T15:08:34.584 INFO:teuthology.orchestra.run.smithi161.stdout:2091 read 0x44634b thru 0x44ab7d (0x4833 bytes) 2024-09-21T15:08:34.593 INFO:teuthology.orchestra.run.smithi161.stdout:1884 read 0x2376a87 thru 0x23847bd (0xdd37 bytes) 2024-09-21T15:08:34.608 INFO:teuthology.orchestra.run.smithi161.stdout:2092 trunc from 0xced5346 to 0x44d22d 2024-09-21T15:08:34.618 INFO:teuthology.orchestra.run.smithi161.stdout:1885 punch from 0x2d777ea to 0x2d7f32c, (0x7b42 bytes) 2024-09-21T15:08:34.618 INFO:teuthology.orchestra.run.smithi161.stdout:1886 trunc from 0xa227b63 to 0xa17e454 2024-09-21T15:08:34.636 INFO:teuthology.orchestra.run.smithi161.stdout:2610 punch from 0x166a7c to 0x16bd51, (0x52d5 bytes) 2024-09-21T15:08:34.636 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.637 INFO:teuthology.orchestra.run.smithi161.stdout:2612 read 0x3fd1b thru 0x46849 (0x6b2f bytes) 2024-09-21T15:08:34.673 INFO:teuthology.orchestra.run.smithi161.stdout:2613 writesame 0xbbc4318 thru 0xbbd33c3 data_size 0x49(0xf0ac bytes) 2024-09-21T15:08:34.676 INFO:teuthology.orchestra.run.smithi161.stdout:2614 read 0x1d08fa5 thru 0x1d12e35 (0x9e91 bytes) 2024-09-21T15:08:34.677 INFO:teuthology.orchestra.run.smithi161.stdout:2615 write 0x32f9985 thru 0x3300dbc (0x7438 bytes) 2024-09-21T15:08:34.694 INFO:teuthology.orchestra.run.smithi161.stdout:2616 read 0x8c42419 thru 0x8c4dd43 (0xb92b bytes) 2024-09-21T15:08:34.694 INFO:teuthology.orchestra.run.smithi161.stdout:2617 read 0x7aac670 thru 0x7ab379e (0x712f bytes) 2024-09-21T15:08:34.694 INFO:teuthology.orchestra.run.smithi161.stdout:2618 read 0x9bc0fa thru 0x9c06f3 (0x45fa bytes) 2024-09-21T15:08:34.695 INFO:teuthology.orchestra.run.smithi161.stdout:2619 read 0x67de7e2 thru 0x67e9728 (0xaf47 bytes) 2024-09-21T15:08:34.706 INFO:teuthology.orchestra.run.smithi161.stdout:2509 write 0x135b77f thru 0x135e886 (0x3108 bytes) 2024-09-21T15:08:34.708 INFO:teuthology.orchestra.run.smithi161.stdout:1887 write 0x68b0259 thru 0x68bbcee (0xba96 bytes) 2024-09-21T15:08:34.728 INFO:teuthology.orchestra.run.smithi161.stdout:2093 writesame 0x95594db thru 0x95650ee data_size 0x2(0xbc14 bytes) 2024-09-21T15:08:34.734 INFO:teuthology.orchestra.run.smithi161.stdout:2095 punch from 0x536b92a to 0x53733e5, (0x7abb bytes) 2024-09-21T15:08:34.734 INFO:teuthology.orchestra.run.smithi161.stdout:2096 read 0x2f90ec3 thru 0x2f9f91e (0xea5c bytes) 2024-09-21T15:08:34.734 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.734 INFO:teuthology.orchestra.run.smithi161.stdout:1889 writesame 0x886a243 thru 0x8872c51 data_size 0x99(0x8a0f bytes) 2024-09-21T15:08:34.742 INFO:teuthology.orchestra.run.smithi161.stdout:2097 trunc from 0x95650ef to 0x5ce4e3e 2024-09-21T15:08:34.745 INFO:teuthology.orchestra.run.smithi161.stdout:2622 write 0xe6aa8d7 thru 0xe6ade26 (0x3550 bytes) 2024-09-21T15:08:34.749 INFO:teuthology.orchestra.run.smithi161.stdout:1890 trunc from 0xa17e454 to 0x608aceb 2024-09-21T15:08:34.762 INFO:teuthology.orchestra.run.smithi161.stdout:2623 read 0x40200a8 thru 0x402e364 (0xe2bd bytes) 2024-09-21T15:08:34.762 INFO:teuthology.orchestra.run.smithi161.stdout:2625 writesame 0xe06abbe thru 0xe06b5b0 data_size 0x3(0x9f3 bytes) 2024-09-21T15:08:34.783 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.783 INFO:teuthology.orchestra.run.smithi161.stdout:2629 read 0x8de19c7 thru 0x8de8c5f (0x7299 bytes) 2024-09-21T15:08:34.783 INFO:teuthology.orchestra.run.smithi161.stdout:2630 write 0x64a18a0 thru 0x64a357e (0x1cdf bytes) 2024-09-21T15:08:34.828 INFO:teuthology.orchestra.run.smithi161.stdout:2631 read 0xd77cbe thru 0xd832cc (0xb60f bytes) 2024-09-21T15:08:34.829 INFO:teuthology.orchestra.run.smithi161.stdout:2632 read 0x5e2f344 thru 0x5e356b4 (0x6371 bytes) 2024-09-21T15:08:34.830 INFO:teuthology.orchestra.run.smithi161.stdout:2633 writesame 0xb37efa thru 0xb43dc0 data_size 0x1(0xbec7 bytes) 2024-09-21T15:08:34.845 INFO:teuthology.orchestra.run.smithi161.stdout:2098 write 0xe3aaefa thru 0xe3b4104 (0x920b bytes) 2024-09-21T15:08:34.874 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.874 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.874 INFO:teuthology.orchestra.run.smithi161.stdout:2102 write 0x15e27f3 thru 0x15e98bb (0x70c9 bytes) 2024-09-21T15:08:34.888 INFO:teuthology.orchestra.run.smithi161.stdout:1892 read 0x53deb16 thru 0x53ea6bf (0xbbaa bytes) 2024-09-21T15:08:34.891 INFO:teuthology.orchestra.run.smithi161.stdout:1893 read 0x3f5745d thru 0x3f657f8 (0xe39c bytes) 2024-09-21T15:08:34.893 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:34.899 INFO:teuthology.orchestra.run.smithi161.stdout:2103 write 0xbb7dfcf thru 0xbb7e195 (0x1c7 bytes) 2024-09-21T15:08:34.903 INFO:teuthology.orchestra.run.smithi161.stdout:1895 trunc from 0x608aceb to 0x2110907 2024-09-21T15:08:34.925 INFO:teuthology.orchestra.run.smithi161.stdout:2104 writesame 0x77efa2f thru 0x77fa141 data_size 0x35(0xa713 bytes) 2024-09-21T15:08:34.945 INFO:teuthology.orchestra.run.smithi161.stdout:2105 read 0x4ba59c9 thru 0x4bad299 (0x78d1 bytes) 2024-09-21T15:08:34.945 INFO:teuthology.orchestra.run.smithi161.stdout:2106 punch from 0x7270c4e to 0x72791bf, (0x8571 bytes) 2024-09-21T15:08:34.945 INFO:teuthology.orchestra.run.smithi161.stdout:2107 write 0x7a4d7bd thru 0x7a58f22 (0xb766 bytes) 2024-09-21T15:08:34.957 INFO:teuthology.orchestra.run.smithi161.stdout:2634 flatten 2024-09-21T15:08:34.981 INFO:teuthology.orchestra.run.smithi161.stdout:2108 trunc from 0xe3b4105 to 0x5eb3bce 2024-09-21T15:08:35.006 INFO:teuthology.orchestra.run.smithi161.stdout:1897 trunc from 0x2110907 to 0xedd8a18 2024-09-21T15:08:35.034 INFO:teuthology.orchestra.run.smithi161.stdout:2510 write 0x8471a48 thru 0x84817ec (0xfda5 bytes) 2024-09-21T15:08:35.044 INFO:teuthology.orchestra.run.smithi161.stdout:1899 punch from 0x2e70c98 to 0x2e74117, (0x347f bytes) 2024-09-21T15:08:35.045 INFO:teuthology.orchestra.run.smithi161.stdout:1902 write 0xb62bcd0 thru 0xb638d25 (0xd056 bytes) 2024-09-21T15:08:35.049 INFO:teuthology.orchestra.run.smithi161.stdout:2109 read 0x4178fdd thru 0x417af30 (0x1f54 bytes) 2024-09-21T15:08:35.050 INFO:teuthology.orchestra.run.smithi161.stdout:2376 write 0xebe28b4 thru 0xebed1a3 (0xa8f0 bytes) 2024-09-21T15:08:35.063 INFO:teuthology.orchestra.run.smithi161.stdout:1903 read 0xc4cdfdf thru 0xc4d9c19 (0xbc3b bytes) 2024-09-21T15:08:35.064 INFO:teuthology.orchestra.run.smithi161.stdout:1906 punch from 0x4a15c69 to 0x4a1cd38, (0x70cf bytes) 2024-09-21T15:08:35.064 INFO:teuthology.orchestra.run.smithi161.stdout:1907 writesame 0xdcd6a99 thru 0xdcde3ff data_size 0x1(0x7967 bytes) 2024-09-21T15:08:35.068 INFO:teuthology.orchestra.run.smithi161.stdout:2635 write 0xb6f372b thru 0xb6fa986 (0x725c bytes) 2024-09-21T15:08:35.072 INFO:teuthology.orchestra.run.smithi161.stdout:2377 writesame 0x5cc9ed2 thru 0x5cd601a data_size 0x1(0xc149 bytes) 2024-09-21T15:08:35.075 INFO:teuthology.orchestra.run.smithi161.stdout:2511 trunc from 0x84817ed to 0x35f49ff 2024-09-21T15:08:35.090 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.2-clone14 intact 2024-09-21T15:08:35.092 INFO:teuthology.orchestra.run.smithi161.stdout:2636 punch from 0x21c7ef7 to 0x21d1fc1, (0xa0ca bytes) 2024-09-21T15:08:35.092 INFO:teuthology.orchestra.run.smithi161.stdout:2637 punch from 0xc1d5451 to 0xc1dc5ae, (0x715d bytes) 2024-09-21T15:08:35.092 INFO:teuthology.orchestra.run.smithi161.stdout:2640 write 0xfc31fb thru 0xfc4c58 (0x1a5e bytes) 2024-09-21T15:08:35.093 INFO:teuthology.orchestra.run.smithi161.stdout:1908 read 0xa5eb757 thru 0xa5f8fae (0xd858 bytes) 2024-09-21T15:08:35.094 INFO:teuthology.orchestra.run.smithi161.stdout:1909 read 0x2ce828b thru 0x2ceb5f1 (0x3367 bytes) 2024-09-21T15:08:35.096 INFO:teuthology.orchestra.run.smithi161.stdout:1910 write 0x1017b55 thru 0x1021642 (0x9aee bytes) 2024-09-21T15:08:35.101 INFO:teuthology.orchestra.run.smithi161.stdout:2111 write 0xb78eb37 thru 0xb79bcec (0xd1b6 bytes) 2024-09-21T15:08:35.125 INFO:teuthology.orchestra.run.smithi161.stdout:2641 writesame 0xd538888 thru 0xd53e282 data_size 0x11(0x59fb bytes) 2024-09-21T15:08:35.130 INFO:teuthology.orchestra.run.smithi161.stdout:1911 read 0x229d6c1 thru 0x22a0460 (0x2da0 bytes) 2024-09-21T15:08:35.131 INFO:teuthology.orchestra.run.smithi161.stdout:1912 read 0xb7d20e thru 0xb8b580 (0xe373 bytes) 2024-09-21T15:08:35.133 INFO:teuthology.orchestra.run.smithi161.stdout:1916 read 0x5b4f8ca thru 0x5b50afd (0x1234 bytes) 2024-09-21T15:08:35.136 INFO:teuthology.orchestra.run.smithi161.stdout:2112 write 0x1827d45 thru 0x1833505 (0xb7c1 bytes) 2024-09-21T15:08:35.137 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.138 INFO:teuthology.orchestra.run.smithi161.stdout:2379 write 0x2b6e17c thru 0x2b7625a (0x80df bytes) 2024-09-21T15:08:35.142 INFO:teuthology.orchestra.run.smithi161.stdout:1918 trunc from 0xedd8a18 to 0xc18cd6b 2024-09-21T15:08:35.150 INFO:teuthology.orchestra.run.smithi161.stdout:2642 punch from 0x57b78b8 to 0x57c6d00, (0xf448 bytes) 2024-09-21T15:08:35.150 INFO:teuthology.orchestra.run.smithi161.stdout:2643 read 0x85f9648 thru 0x85feccc (0x5685 bytes) 2024-09-21T15:08:35.150 INFO:teuthology.orchestra.run.smithi161.stdout:2647 punch from 0xf6aa2e to 0xf75464, (0xaa36 bytes) 2024-09-21T15:08:35.150 INFO:teuthology.orchestra.run.smithi161.stdout:2648 punch from 0x8f34e08 to 0x8f3562c, (0x824 bytes) 2024-09-21T15:08:35.150 INFO:teuthology.orchestra.run.smithi161.stdout:2650 write 0xcff216c thru 0xcffe5b3 (0xc448 bytes) 2024-09-21T15:08:35.155 INFO:teuthology.orchestra.run.smithi161.stdout:2113 punch from 0x67e589 to 0x686d22, (0x8799 bytes) 2024-09-21T15:08:35.188 INFO:teuthology.orchestra.run.smithi161.stdout:2114 writesame 0xb8cd743 thru 0xb8da473 data_size 0x1(0xcd31 bytes) 2024-09-21T15:08:35.192 INFO:teuthology.orchestra.run.smithi161.stdout:2380 punch from 0x5b082eb to 0x5b16123, (0xde38 bytes) 2024-09-21T15:08:35.192 INFO:teuthology.orchestra.run.smithi161.stdout:2382 read 0xe549b1b thru 0xe551881 (0x7d67 bytes) 2024-09-21T15:08:35.192 INFO:teuthology.orchestra.run.smithi161.stdout:2383 write 0x60afa5e thru 0x60b4e0f (0x53b2 bytes) 2024-09-21T15:08:35.193 INFO:teuthology.orchestra.run.smithi161.stdout:2115 write 0x50077fb thru 0x501745e (0xfc64 bytes) 2024-09-21T15:08:35.198 INFO:teuthology.orchestra.run.smithi161.stdout:2651 writesame 0x8c3616 thru 0x8c8404 data_size 0x1(0x4def bytes) 2024-09-21T15:08:35.207 INFO:teuthology.orchestra.run.smithi161.stdout:2385 read 0x68823bb thru 0x688cdd8 (0xaa1e bytes) 2024-09-21T15:08:35.207 INFO:teuthology.orchestra.run.smithi161.stdout:2386 write 0x136a4d1 thru 0x1370a83 (0x65b3 bytes) 2024-09-21T15:08:35.215 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.215 INFO:teuthology.orchestra.run.smithi161.stdout:2117 write 0xbc5604 thru 0xbcfd51 (0xa74e bytes) 2024-09-21T15:08:35.227 INFO:teuthology.orchestra.run.smithi161.stdout:2652 write 0x9aa499 thru 0x9b0b7b (0x66e3 bytes) 2024-09-21T15:08:35.229 INFO:teuthology.orchestra.run.smithi161.stdout:2387 write 0x12ecad3 thru 0x12ed32b (0x859 bytes) 2024-09-21T15:08:35.249 INFO:teuthology.orchestra.run.smithi161.stdout:2388 writesame 0x7e300eb thru 0x7e3d177 data_size 0x1d(0xd08d bytes) 2024-09-21T15:08:35.253 INFO:teuthology.orchestra.run.smithi161.stdout:2118 trunc from 0xb8da474 to 0x6657a89 2024-09-21T15:08:35.263 INFO:teuthology.orchestra.run.smithi161.stdout:2390 punch from 0xb8ca5f to 0xb8e0fa, (0x169b bytes) 2024-09-21T15:08:35.263 INFO:teuthology.orchestra.run.smithi161.stdout:2391 writesame 0xb275abf thru 0xb27d06c data_size 0x3(0x75ae bytes) 2024-09-21T15:08:35.265 INFO:teuthology.orchestra.run.smithi161.stdout:2653 trunc from 0xe6ade27 to 0x42e9014 2024-09-21T15:08:35.282 INFO:teuthology.orchestra.run.smithi161.stdout:2393 writesame 0xc7faa91 thru 0xc7fbaf5 data_size 0x1(0x1065 bytes) 2024-09-21T15:08:35.299 INFO:teuthology.orchestra.run.smithi161.stdout:2394 punch from 0x716dc0 to 0x7210be, (0xa2fe bytes) 2024-09-21T15:08:35.299 INFO:teuthology.orchestra.run.smithi161.stdout:2395 read 0xd14f208 thru 0xd1591f0 (0x9fe9 bytes) 2024-09-21T15:08:35.299 INFO:teuthology.orchestra.run.smithi161.stdout:2396 write 0xabc85ab thru 0xabd15bd (0x9013 bytes) 2024-09-21T15:08:35.312 INFO:teuthology.orchestra.run.smithi161.stdout:1919 writesame 0xcea3a0d thru 0xcead6e5 data_size 0x1(0x9cd9 bytes) 2024-09-21T15:08:35.313 INFO:teuthology.orchestra.run.smithi161.stdout:2399 write 0x287760e thru 0x287f395 (0x7d88 bytes) 2024-09-21T15:08:35.319 INFO:teuthology.orchestra.run.smithi161.stdout:1921 punch from 0xa46d060 to 0xa46d684, (0x624 bytes) 2024-09-21T15:08:35.319 INFO:teuthology.orchestra.run.smithi161.stdout:1923 read 0xa7f1cef thru 0xa7fb1a2 (0x94b4 bytes) 2024-09-21T15:08:35.323 INFO:teuthology.orchestra.run.smithi161.stdout:2400 write 0x536c699 thru 0x5378e89 (0xc7f1 bytes) 2024-09-21T15:08:35.331 INFO:teuthology.orchestra.run.smithi161.stdout:2119 clone 20 order 23 su 32768 sc 10 2024-09-21T15:08:35.337 INFO:teuthology.orchestra.run.smithi161.stdout:2401 punch from 0x511d81c to 0x511e9f2, (0x11d6 bytes) 2024-09-21T15:08:35.337 INFO:teuthology.orchestra.run.smithi161.stdout:2402 read 0x69a8b22 thru 0x69b0db4 (0x8293 bytes) 2024-09-21T15:08:35.338 INFO:teuthology.orchestra.run.smithi161.stdout:2403 writesame 0xa5a0b0c thru 0xa5af266 data_size 0x1(0xe75b bytes) 2024-09-21T15:08:35.355 INFO:teuthology.orchestra.run.smithi161.stdout:1924 write 0xdfe36af thru 0xdff0079 (0xc9cb bytes) 2024-09-21T15:08:35.379 INFO:teuthology.orchestra.run.smithi161.stdout:1926 write 0xe0961d thru 0xe17c32 (0xe616 bytes) 2024-09-21T15:08:35.387 INFO:teuthology.orchestra.run.smithi161.stdout:2404 read 0x7c8f4fc thru 0x7c9a9e0 (0xb4e5 bytes) 2024-09-21T15:08:35.387 INFO:teuthology.orchestra.run.smithi161.stdout:2405 write 0xcdcc2c8 thru 0xcdd8899 (0xc5d2 bytes) 2024-09-21T15:08:35.391 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #13, image image_cluster1.client.mirror.2-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent14 2024-09-21T15:08:35.396 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.396 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.396 INFO:teuthology.orchestra.run.smithi161.stdout:1929 punch from 0x4782864 to 0x478641d, (0x3bb9 bytes) 2024-09-21T15:08:35.396 INFO:teuthology.orchestra.run.smithi161.stdout:1931 read 0x9c1ff41 thru 0x9c2baf5 (0xbbb5 bytes) 2024-09-21T15:08:35.397 INFO:teuthology.orchestra.run.smithi161.stdout:2654 write 0x4760446 thru 0x476317b (0x2d36 bytes) 2024-09-21T15:08:35.397 INFO:teuthology.orchestra.run.smithi161.stdout:1934 write 0xd7fed3a thru 0xd80a9cf (0xbc96 bytes) 2024-09-21T15:08:35.400 INFO:teuthology.orchestra.run.smithi161.stdout:2513 writesame 0x70dec96 thru 0x70eaa95 data_size 0x20(0xbe00 bytes) 2024-09-21T15:08:35.407 INFO:teuthology.orchestra.run.smithi161.stdout:2406 punch from 0x7b34595 to 0x7b42be5, (0xe650 bytes) 2024-09-21T15:08:35.407 INFO:teuthology.orchestra.run.smithi161.stdout:2408 read 0xb1141f3 thru 0xb123cb5 (0xfac3 bytes) 2024-09-21T15:08:35.408 INFO:teuthology.orchestra.run.smithi161.stdout:2514 writesame 0x20f8bf2 thru 0x2105e80 data_size 0x1(0xd28f bytes) 2024-09-21T15:08:35.408 INFO:teuthology.orchestra.run.smithi161.stdout:2409 read 0x5149740 thru 0x514fe12 (0x66d3 bytes) 2024-09-21T15:08:35.409 INFO:teuthology.orchestra.run.smithi161.stdout:2410 punch from 0xab54bf4 to 0xab5f11b, (0xa527 bytes) 2024-09-21T15:08:35.409 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.411 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.411 INFO:teuthology.orchestra.run.smithi161.stdout:1936 read 0x7d343b2 thru 0x7d387f4 (0x4443 bytes) 2024-09-21T15:08:35.411 INFO:teuthology.orchestra.run.smithi161.stdout:1938 writesame 0x516380a thru 0x516e710 data_size 0x25(0xaf07 bytes) 2024-09-21T15:08:35.414 INFO:teuthology.orchestra.run.smithi161.stdout:2655 write 0x18b86bd thru 0x18bd8d1 (0x5215 bytes) 2024-09-21T15:08:35.424 INFO:teuthology.orchestra.run.smithi161.stdout:2412 trunc from 0xebed1a4 to 0x8655fdc 2024-09-21T15:08:35.425 INFO:teuthology.orchestra.run.smithi161.stdout:1939 punch from 0x549230e to 0x549b19f, (0x8e91 bytes) 2024-09-21T15:08:35.425 INFO:teuthology.orchestra.run.smithi161.stdout:1940 write 0x2448cf thru 0x245523 (0xc55 bytes) 2024-09-21T15:08:35.435 INFO:teuthology.orchestra.run.smithi161.stdout:2656 read 0x2c66e22 thru 0x2c67be6 (0xdc5 bytes) 2024-09-21T15:08:35.440 INFO:teuthology.orchestra.run.smithi161.stdout:1941 write 0xa581a68 thru 0xa58a64a (0x8be3 bytes) 2024-09-21T15:08:35.473 INFO:teuthology.orchestra.run.smithi161.stdout:2515 punch from 0x6a8f45e to 0x6a8fc0a, (0x7ac bytes) 2024-09-21T15:08:35.473 INFO:teuthology.orchestra.run.smithi161.stdout:2516 read 0x62710b6 thru 0x6277caf (0x6bfa bytes) 2024-09-21T15:08:35.473 INFO:teuthology.orchestra.run.smithi161.stdout:1942 write 0x9b6486f thru 0x9b67744 (0x2ed6 bytes) 2024-09-21T15:08:35.487 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.487 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.488 INFO:teuthology.orchestra.run.smithi161.stdout:1945 write 0xc22d1de thru 0xc238bbf (0xb9e2 bytes) 2024-09-21T15:08:35.488 INFO:teuthology.orchestra.run.smithi161.stdout:2518 trunc from 0x70eaa96 to 0xe7c2efe 2024-09-21T15:08:35.503 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.511 INFO:teuthology.orchestra.run.smithi161.stdout:2657 write 0x92eb995 thru 0x92f12e2 (0x594e bytes) 2024-09-21T15:08:35.516 INFO:teuthology.orchestra.run.smithi161.stdout:2413 write 0xb7e29d thru 0xb81b61 (0x38c5 bytes) 2024-09-21T15:08:35.524 INFO:teuthology.orchestra.run.smithi161.stdout:2658 writesame 0x8650e17 thru 0x865c0c0 data_size 0x42(0xb2aa bytes) 2024-09-21T15:08:35.530 INFO:teuthology.orchestra.run.smithi161.stdout:1947 trunc from 0xdff007a to 0x282c7b0 2024-09-21T15:08:35.535 INFO:teuthology.orchestra.run.smithi161.stdout:2659 read 0x76bae11 thru 0x76be00a (0x31fa bytes) 2024-09-21T15:08:35.537 INFO:teuthology.orchestra.run.smithi161.stdout:2519 punch from 0x1cf1984 to 0x1cff052, (0xd6ce bytes) 2024-09-21T15:08:35.537 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.561 INFO:teuthology.orchestra.run.smithi161.stdout:2521 trunc from 0xe7c2efe to 0x10024ff 2024-09-21T15:08:35.580 INFO:teuthology.orchestra.run.smithi161.stdout:2415 writesame 0xc4260ff thru 0xc42deb2 data_size 0xa(0x7db4 bytes) 2024-09-21T15:08:35.584 INFO:teuthology.orchestra.run.smithi161.stdout:2660 write 0xb5f5655 thru 0xb5fe4bc (0x8e68 bytes) 2024-09-21T15:08:35.585 INFO:teuthology.orchestra.run.smithi161.stdout:2416 writesame 0x50308be thru 0x503aa17 data_size 0x13(0xa15a bytes) 2024-09-21T15:08:35.610 INFO:teuthology.orchestra.run.smithi161.stdout:2661 write 0x62cd9dd thru 0x62d1872 (0x3e96 bytes) 2024-09-21T15:08:35.623 INFO:teuthology.orchestra.run.smithi161.stdout:1948 write 0xcb57d1f thru 0xcb58ba5 (0xe87 bytes) 2024-09-21T15:08:35.630 INFO:teuthology.orchestra.run.smithi161.stdout:1949 write 0x59a6b2c thru 0x59aabaa (0x407f bytes) 2024-09-21T15:08:35.631 INFO:teuthology.orchestra.run.smithi161.stdout:2417 trunc from 0xc42deb3 to 0x9b378d 2024-09-21T15:08:35.640 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.640 INFO:teuthology.orchestra.run.smithi161.stdout:1952 write 0x39fcb1d thru 0x39fef3e (0x2422 bytes) 2024-09-21T15:08:35.654 INFO:teuthology.orchestra.run.smithi161.stdout:1953 write 0x845473d thru 0x845cf49 (0x880d bytes) 2024-09-21T15:08:35.669 INFO:teuthology.orchestra.run.smithi161.stdout:2662 writesame 0xe254464 thru 0xe25c8b8 data_size 0x1(0x8455 bytes) 2024-09-21T15:08:35.674 INFO:teuthology.orchestra.run.smithi161.stdout:2931 write 0x8d428e3 thru 0x8d4f7eb (0xcf09 bytes) 2024-09-21T15:08:35.696 INFO:teuthology.orchestra.run.smithi161.stdout:2663 trunc from 0xe25c8b9 to 0x967360 2024-09-21T15:08:35.699 INFO:teuthology.orchestra.run.smithi161.stdout:1954 write 0xdb861dd thru 0xdb86c44 (0xa68 bytes) 2024-09-21T15:08:35.725 INFO:teuthology.orchestra.run.smithi161.stdout:1956 trunc from 0xdb86c45 to 0x3a58450 2024-09-21T15:08:35.769 INFO:teuthology.orchestra.run.smithi161.stdout:2932 write 0x7ed99d3 thru 0x7ede4fb (0x4b29 bytes) 2024-09-21T15:08:35.794 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.814 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.814 INFO:teuthology.orchestra.run.smithi161.stdout:2666 read 0x4852e6 thru 0x490c1e (0xb939 bytes) 2024-09-21T15:08:35.845 INFO:teuthology.orchestra.run.smithi161.stdout:2935 write 0xc431565 thru 0xc43b99a (0xa436 bytes) 2024-09-21T15:08:35.854 INFO:teuthology.orchestra.run.smithi161.stdout:1957 write 0x995381d thru 0x995bf87 (0x876b bytes) 2024-09-21T15:08:35.864 INFO:teuthology.orchestra.run.smithi161.stdout:1958 writesame 0x3d2c480 thru 0x3d30d05 data_size 0x1(0x4886 bytes) 2024-09-21T15:08:35.867 INFO:teuthology.orchestra.run.smithi161.stdout:2938 punch from 0x60a1560 to 0x60a6586, (0x5026 bytes) 2024-09-21T15:08:35.867 INFO:teuthology.orchestra.run.smithi161.stdout:2939 writesame 0xa7b193b thru 0xa7b46fa data_size 0x6(0x2dc0 bytes) 2024-09-21T15:08:35.871 INFO:teuthology.orchestra.run.smithi161.stdout:2667 write 0x58cd357 thru 0x58cee62 (0x1b0c bytes) 2024-09-21T15:08:35.883 INFO:teuthology.orchestra.run.smithi161.stdout:2941 read 0x39a213f thru 0x39a2791 (0x653 bytes) 2024-09-21T15:08:35.883 INFO:teuthology.orchestra.run.smithi161.stdout:2942 writesame 0x56329a8 thru 0x563fa65 data_size 0x16(0xd0be bytes) 2024-09-21T15:08:35.887 INFO:teuthology.orchestra.run.smithi161.stdout:2668 punch from 0x406debd to 0x4076d75, (0x8eb8 bytes) 2024-09-21T15:08:35.887 INFO:teuthology.orchestra.run.smithi161.stdout:2670 read 0x55e7e51 thru 0x55edc63 (0x5e13 bytes) 2024-09-21T15:08:35.898 INFO:teuthology.orchestra.run.smithi161.stdout:2418 writesame 0x1f040aa thru 0x1f0cd0f data_size 0x1(0x8c66 bytes) 2024-09-21T15:08:35.903 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.903 INFO:teuthology.orchestra.run.smithi161.stdout:2945 write 0xa12ce04 thru 0xa135a49 (0x8c46 bytes) 2024-09-21T15:08:35.904 INFO:teuthology.orchestra.run.smithi161.stdout:2421 punch from 0x1c4720c to 0x1c4c42b, (0x521f bytes) 2024-09-21T15:08:35.904 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.925 INFO:teuthology.orchestra.run.smithi161.stdout:2946 punch from 0x8203717 to 0x8204589, (0xe72 bytes) 2024-09-21T15:08:35.926 INFO:teuthology.orchestra.run.smithi161.stdout:2947 clone 16 order 20 su 131072 sc 3 2024-09-21T15:08:35.931 INFO:teuthology.orchestra.run.smithi161.stdout:1959 write 0xd665ad6 thru 0xd66f327 (0x9852 bytes) 2024-09-21T15:08:35.944 INFO:teuthology.orchestra.run.smithi161.stdout:1960 read 0x501f7e5 thru 0x5029d4d (0xa569 bytes) 2024-09-21T15:08:35.945 INFO:teuthology.orchestra.run.smithi161.stdout:1961 write 0x683334f thru 0x6836920 (0x35d2 bytes) 2024-09-21T15:08:35.949 INFO:teuthology.orchestra.run.smithi161.stdout:2671 writesame 0xe19c2ad thru 0xe1a98d1 data_size 0x1(0xd625 bytes) 2024-09-21T15:08:35.953 INFO:teuthology.orchestra.run.smithi161.stdout:1962 punch from 0x460b54c to 0x4619738, (0xe1ec bytes) 2024-09-21T15:08:35.953 INFO:teuthology.orchestra.run.smithi161.stdout:1964 punch from 0x2e8be1b to 0x2e8fd15, (0x3efa bytes) 2024-09-21T15:08:35.953 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.953 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:35.953 INFO:teuthology.orchestra.run.smithi161.stdout:1968 write 0x919cdc9 thru 0x91acc3b (0xfe73 bytes) 2024-09-21T15:08:35.959 INFO:teuthology.orchestra.run.smithi161.stdout:2672 writesame 0x79c080d thru 0x79ca567 data_size 0x1(0x9d5b bytes) 2024-09-21T15:08:35.961 INFO:teuthology.orchestra.run.smithi161.stdout:1969 read 0x6784da5 thru 0x67864f1 (0x174d bytes) 2024-09-21T15:08:35.962 INFO:teuthology.orchestra.run.smithi161.stdout:1970 writesame 0xa94b59 thru 0xa9fba9 data_size 0x1(0xb051 bytes) 2024-09-21T15:08:35.966 INFO:teuthology.orchestra.run.smithi161.stdout:2423 writesame 0xebe565f thru 0xebf4971 data_size 0x1(0xf313 bytes) 2024-09-21T15:08:35.969 INFO:teuthology.orchestra.run.smithi161.stdout:2424 writesame 0xb8062eb thru 0xb80b801 data_size 0x35(0x5517 bytes) 2024-09-21T15:08:36.003 INFO:teuthology.orchestra.run.smithi161.stdout:2673 writesame 0xa72eb2c thru 0xa732aa2 data_size 0xb(0x3f77 bytes) 2024-09-21T15:08:36.003 INFO:teuthology.orchestra.run.smithi161.stdout:2427 read 0xf34c6c thru 0xf38fa3 (0x4338 bytes) 2024-09-21T15:08:36.006 INFO:teuthology.orchestra.run.smithi161.stdout:2428 write 0xe5b3383 thru 0xe5b9c69 (0x68e7 bytes) 2024-09-21T15:08:36.012 INFO:teuthology.orchestra.run.smithi161.stdout:1971 read 0x7ce3505 thru 0x7cec808 (0x9304 bytes) 2024-09-21T15:08:36.012 INFO:teuthology.orchestra.run.smithi161.stdout:1972 writesame 0xb5648d1 thru 0xb570254 data_size 0x3e(0xb984 bytes) 2024-09-21T15:08:36.018 INFO:teuthology.orchestra.run.smithi161.stdout:2674 write 0x9950136 thru 0x9951d02 (0x1bcd bytes) 2024-09-21T15:08:36.020 INFO:teuthology.orchestra.run.smithi161.stdout:1973 writesame 0x9129338 thru 0x912b3b9 data_size 0x6(0x2082 bytes) 2024-09-21T15:08:36.026 INFO:teuthology.orchestra.run.smithi161.stdout:2429 punch from 0x2c9ce39 to 0x2ca3e86, (0x704d bytes) 2024-09-21T15:08:36.031 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:36.034 INFO:teuthology.orchestra.run.smithi161.stdout:2430 trunc from 0xebf4972 to 0xb00bc60 2024-09-21T15:08:36.036 INFO:teuthology.orchestra.run.smithi161.stdout:2675 write 0x2004e23 thru 0x2013a48 (0xec26 bytes) 2024-09-21T15:08:36.047 INFO:teuthology.orchestra.run.smithi161.stdout:1976 trunc from 0xd66f328 to 0x3c908bc 2024-09-21T15:08:36.054 INFO:teuthology.orchestra.run.smithi161.stdout:2676 writesame 0x3cf8fc0 thru 0x3d00f9a data_size 0x1(0x7fdb bytes) 2024-09-21T15:08:36.089 INFO:teuthology.orchestra.run.smithi161.stdout:2679 read 0xdecabfa thru 0xdecc68d (0x1a94 bytes) 2024-09-21T15:08:36.089 INFO:teuthology.orchestra.run.smithi161.stdout:2680 write 0x3a19298 thru 0x3a1a381 (0x10ea bytes) 2024-09-21T15:08:36.095 INFO:teuthology.orchestra.run.smithi161.stdout:1977 read 0xef8415 thru 0xeff6fc (0x72e8 bytes) 2024-09-21T15:08:36.099 INFO:teuthology.orchestra.run.smithi161.stdout:2682 write 0x9b5e3c3 thru 0x9b62358 (0x3f96 bytes) 2024-09-21T15:08:36.115 INFO:teuthology.orchestra.run.smithi161.stdout:2683 write 0x210159c thru 0x2105bed (0x4652 bytes) 2024-09-21T15:08:36.116 INFO:teuthology.orchestra.run.smithi161.stdout:2431 punch from 0x758fa88 to 0x759e9ef, (0xef67 bytes) 2024-09-21T15:08:36.116 INFO:teuthology.orchestra.run.smithi161.stdout:2432 read 0x1775ba8 thru 0x1782383 (0xc7dc bytes) 2024-09-21T15:08:36.116 INFO:teuthology.orchestra.run.smithi161.stdout:2522 read 0xb29613 thru 0xb342f6 (0xace4 bytes) 2024-09-21T15:08:36.116 INFO:teuthology.orchestra.run.smithi161.stdout:2433 writesame 0x6963148 thru 0x696d15b data_size 0x1(0xa014 bytes) 2024-09-21T15:08:36.126 INFO:teuthology.orchestra.run.smithi161.stdout:2523 read 0xa6363f thru 0xa6854f (0x4f11 bytes) 2024-09-21T15:08:36.128 INFO:teuthology.orchestra.run.smithi161.stdout:2685 write 0x66b9ebc thru 0x66c5beb (0xbd30 bytes) 2024-09-21T15:08:36.131 INFO:teuthology.orchestra.run.smithi161.stdout:2524 read 0xf89f67 thru 0xf96ba2 (0xcc3c bytes) 2024-09-21T15:08:36.151 INFO:teuthology.orchestra.run.smithi161.stdout:2434 write 0x1f3f4cb thru 0x1f45844 (0x637a bytes) 2024-09-21T15:08:36.151 INFO:teuthology.orchestra.run.smithi161.stdout:1978 writesame 0x81958f7 thru 0x819b36a data_size 0xe(0x5a74 bytes) 2024-09-21T15:08:36.157 INFO:teuthology.orchestra.run.smithi161.stdout:2686 writesame 0xc3a929c thru 0xc3b1b6c data_size 0x19(0x88d1 bytes) 2024-09-21T15:08:36.168 INFO:teuthology.orchestra.run.smithi161.stdout:1979 read 0x68c7e71 thru 0x68cfc41 (0x7dd1 bytes) 2024-09-21T15:08:36.171 INFO:teuthology.orchestra.run.smithi161.stdout:2435 write 0x903d0be thru 0x9044d8f (0x7cd2 bytes) 2024-09-21T15:08:36.178 INFO:teuthology.orchestra.run.smithi161.stdout:2687 write 0x1c65935 thru 0x1c676a2 (0x1d6e bytes) 2024-09-21T15:08:36.200 INFO:teuthology.orchestra.run.smithi161.stdout:2436 write 0x5efa4a9 thru 0x5f0302d (0x8b85 bytes) 2024-09-21T15:08:36.201 INFO:teuthology.orchestra.run.smithi161.stdout:2688 write 0x418d3a2 thru 0x418fe06 (0x2a65 bytes) 2024-09-21T15:08:36.203 INFO:teuthology.orchestra.run.smithi161.stdout:2525 writesame 0xc3638f1 thru 0xc373738 data_size 0x9e(0xfe48 bytes) 2024-09-21T15:08:36.215 INFO:teuthology.orchestra.run.smithi161.stdout:2689 read 0x85900a6 thru 0x8591f59 (0x1eb4 bytes) 2024-09-21T15:08:36.215 INFO:teuthology.orchestra.run.smithi161.stdout:2690 read 0xc4b45e5 thru 0xc4ba50b (0x5f27 bytes) 2024-09-21T15:08:36.215 INFO:teuthology.orchestra.run.smithi161.stdout:2691 read 0x1bc4fd9 thru 0x1bcc6e3 (0x770b bytes) 2024-09-21T15:08:36.216 INFO:teuthology.orchestra.run.smithi161.stdout:2692 read 0x3637a0a thru 0x363e15a (0x6751 bytes) 2024-09-21T15:08:36.216 INFO:teuthology.orchestra.run.smithi161.stdout:2693 read 0x1b298ac thru 0x1b2ce42 (0x3597 bytes) 2024-09-21T15:08:36.216 INFO:teuthology.orchestra.run.smithi161.stdout:2694 punch from 0xa9efe83 to 0xa9ff012, (0xf18f bytes) 2024-09-21T15:08:36.216 INFO:teuthology.orchestra.run.smithi161.stdout:2695 writesame 0x36fa8ab thru 0x3704f63 data_size 0x29(0xa6b9 bytes) 2024-09-21T15:08:36.221 INFO:teuthology.orchestra.run.smithi161.stdout:2437 writesame 0x7c01228 thru 0x7c0dd95 data_size 0xd(0xcb6e bytes) 2024-09-21T15:08:36.223 INFO:teuthology.orchestra.run.smithi161.stdout:1980 writesame 0xbfe8791 thru 0xbff2c35 data_size 0x1(0xa4a5 bytes) 2024-09-21T15:08:36.224 INFO:teuthology.orchestra.run.smithi161.stdout:2526 trunc from 0xc373739 to 0x6599198 2024-09-21T15:08:36.237 INFO:teuthology.orchestra.run.smithi161.stdout:2696 write 0xded3224 thru 0xdedbaff (0x88dc bytes) 2024-09-21T15:08:36.243 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone19 from 0x6657a89 (overlap 0x44d22d) to 0x0 2024-09-21T15:08:36.252 INFO:teuthology.orchestra.run.smithi161.stdout:2438 trunc from 0xb00bc60 to 0x4499bfa 2024-09-21T15:08:36.253 INFO:teuthology.orchestra.run.smithi161.stdout:2697 writesame 0x342196b thru 0x3427355 data_size 0x1(0x59eb bytes) 2024-09-21T15:08:36.283 INFO:teuthology.orchestra.run.smithi161.stdout:2700 write 0x4019124 thru 0x4026a0a (0xd8e7 bytes) 2024-09-21T15:08:36.284 INFO:teuthology.orchestra.run.smithi161.stdout:1984 writesame 0xee47832 thru 0xee48c46 data_size 0x1(0x1415 bytes) 2024-09-21T15:08:36.299 INFO:teuthology.orchestra.run.smithi161.stdout:1985 punch from 0x5f8f6b9 to 0x5f9af7b, (0xb8c2 bytes) 2024-09-21T15:08:36.299 INFO:teuthology.orchestra.run.smithi161.stdout:1986 write 0x50fa29f thru 0x51043d5 (0xa137 bytes) 2024-09-21T15:08:36.303 INFO:teuthology.orchestra.run.smithi161.stdout:2701 read 0xd934c58 thru 0xd9382e8 (0x3691 bytes) 2024-09-21T15:08:36.303 INFO:teuthology.orchestra.run.smithi161.stdout:2702 write 0x2243cf2 thru 0x22460bb (0x23ca bytes) 2024-09-21T15:08:36.312 INFO:teuthology.orchestra.run.smithi161.stdout:2703 read 0xac5af83 thru 0xac627d7 (0x7855 bytes) 2024-09-21T15:08:36.313 INFO:teuthology.orchestra.run.smithi161.stdout:2527 write 0x8105efd thru 0x81140c1 (0xe1c5 bytes) 2024-09-21T15:08:36.321 INFO:teuthology.orchestra.run.smithi161.stdout:2439 read 0x3a2f4cc thru 0x3a31965 (0x249a bytes) 2024-09-21T15:08:36.321 INFO:teuthology.orchestra.run.smithi161.stdout:2440 read 0x41177c6 thru 0x411ee71 (0x76ac bytes) 2024-09-21T15:08:36.329 INFO:teuthology.orchestra.run.smithi161.stdout:2704 trunc from 0xe1a98d2 to 0x718797f 2024-09-21T15:08:36.335 INFO:teuthology.orchestra.run.smithi161.stdout:1988 trunc from 0xee48c47 to 0x34fbbdd 2024-09-21T15:08:36.382 INFO:teuthology.orchestra.run.smithi161.stdout:2441 write 0xc010954 thru 0xc01394c (0x2ff9 bytes) 2024-09-21T15:08:36.388 INFO:teuthology.orchestra.run.smithi161.stdout:1991 punch from 0x1fa1c7b to 0x1fab7a6, (0x9b2b bytes) 2024-09-21T15:08:36.388 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:36.389 INFO:teuthology.orchestra.run.smithi161.stdout:1994 read 0xf79722 thru 0xf7cc3b (0x351a bytes) 2024-09-21T15:08:36.390 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:36.392 INFO:teuthology.orchestra.run.smithi161.stdout:2529 write 0xb98f8e3 thru 0xb99c2ea (0xca08 bytes) 2024-09-21T15:08:36.392 INFO:teuthology.orchestra.run.smithi161.stdout:2442 writesame 0x41962da thru 0x41a4a77 data_size 0x17(0xe79e bytes) 2024-09-21T15:08:36.411 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:36.411 INFO:teuthology.orchestra.run.smithi161.stdout:2445 punch from 0xb72610a to 0xb7282fb, (0x21f1 bytes) 2024-09-21T15:08:36.411 INFO:teuthology.orchestra.run.smithi161.stdout:2447 write 0x65ab5ef thru 0x65b1d87 (0x6799 bytes) 2024-09-21T15:08:36.412 INFO:teuthology.orchestra.run.smithi161.stdout:2532 writesame 0x90588e5 thru 0x90623ec data_size 0x79(0x9b08 bytes) 2024-09-21T15:08:36.424 INFO:teuthology.orchestra.run.smithi161.stdout:2448 read 0x64bb038 thru 0x64bd060 (0x2029 bytes) 2024-09-21T15:08:36.427 INFO:teuthology.orchestra.run.smithi161.stdout:1997 write 0x8a0e1da thru 0x8a12a84 (0x48ab bytes) 2024-09-21T15:08:36.430 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:36.430 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:36.430 INFO:teuthology.orchestra.run.smithi161.stdout:2538 write 0x2be1ee9 thru 0x2bea8b8 (0x89d0 bytes) 2024-09-21T15:08:36.436 INFO:teuthology.orchestra.run.smithi161.stdout:2705 write 0xaea55ed thru 0xaeabcec (0x6700 bytes) 2024-09-21T15:08:36.440 INFO:teuthology.orchestra.run.smithi161.stdout:1998 trunc from 0x8a12a85 to 0x944f761 2024-09-21T15:08:36.460 INFO:teuthology.orchestra.run.smithi161.stdout:2540 writesame 0x1729479 thru 0x17368df data_size 0x4b(0xd467 bytes) 2024-09-21T15:08:36.496 INFO:teuthology.orchestra.run.smithi161.stdout:2449 writesame 0xc917b80 thru 0xc91df09 data_size 0x5d(0x638a bytes) 2024-09-21T15:08:36.501 INFO:teuthology.orchestra.run.smithi161.stdout:2450 writesame 0x80920aa thru 0x80a19c0 data_size 0x79(0xf917 bytes) 2024-09-21T15:08:36.512 INFO:teuthology.orchestra.run.smithi161.stdout:2541 write 0x7cb3dc thru 0x7d937e (0xdfa3 bytes) 2024-09-21T15:08:36.528 INFO:teuthology.orchestra.run.smithi161.stdout:2453 read 0xc6b6abd thru 0xc6c05c5 (0x9b09 bytes) 2024-09-21T15:08:36.528 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:36.532 INFO:teuthology.orchestra.run.smithi161.stdout:1999 trunc from 0x944f761 to 0x495c3e3 2024-09-21T15:08:36.552 INFO:teuthology.orchestra.run.smithi161.stdout:2455 trunc from 0xc91df0a to 0x1b1db65 2024-09-21T15:08:36.713 INFO:teuthology.orchestra.run.smithi161.stdout:2706 writesame 0xdb0ce4b thru 0xdb10118 data_size 0x7(0x32ce bytes) 2024-09-21T15:08:36.716 INFO:teuthology.orchestra.run.smithi161.stdout:2707 write 0x15f6907 thru 0x15fdcd5 (0x73cf bytes) 2024-09-21T15:08:36.717 INFO:teuthology.orchestra.run.smithi161.stdout:2457 punch from 0x242fc1 to 0x24cfba, (0x9ff9 bytes) 2024-09-21T15:08:36.717 INFO:teuthology.orchestra.run.smithi161.stdout:2458 punch from 0xc3557b to 0xc3f462, (0x9ee7 bytes) 2024-09-21T15:08:36.736 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #18, image image_cluster1.client.mirror.4-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent19 2024-09-21T15:08:36.739 INFO:teuthology.orchestra.run.smithi161.stdout:2708 write 0xb3ec5ed thru 0xb3fab75 (0xe589 bytes) 2024-09-21T15:08:36.741 INFO:teuthology.orchestra.run.smithi161.stdout:2459 trunc from 0x1b1db65 to 0xdd01d2d 2024-09-21T15:08:36.750 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone15 from 0xc43b99b (overlap 0xb8dff12) to 0x81698f3 2024-09-21T15:08:36.762 INFO:teuthology.orchestra.run.smithi161.stdout:2709 read 0x6a7c537 thru 0x6a84f55 (0x8a1f bytes) 2024-09-21T15:08:36.762 INFO:teuthology.orchestra.run.smithi161.stdout:2711 punch from 0x829adcb to 0x82a3395, (0x85ca bytes) 2024-09-21T15:08:36.762 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:36.768 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:36.776 INFO:teuthology.orchestra.run.smithi161.stdout:2542 writesame 0x16413f8 thru 0x1650129 data_size 0x61(0xed32 bytes) 2024-09-21T15:08:36.795 INFO:teuthology.orchestra.run.smithi161.stdout:2460 trunc from 0xdd01d2d to 0x3f80aac 2024-09-21T15:08:36.802 INFO:teuthology.orchestra.run.smithi161.stdout:2543 write 0x9753610 thru 0x9762c0b (0xf5fc bytes) 2024-09-21T15:08:36.807 INFO:teuthology.orchestra.run.smithi161.stdout:2713 write 0xe1d6768 thru 0xe1df2b2 (0x8b4b bytes) 2024-09-21T15:08:36.824 INFO:teuthology.orchestra.run.smithi161.stdout:2545 read 0x3bbfd68 thru 0x3bcbe00 (0xc099 bytes) 2024-09-21T15:08:36.826 INFO:teuthology.orchestra.run.smithi161.stdout:2714 read 0xc5b76b9 thru 0xc5bf17d (0x7ac5 bytes) 2024-09-21T15:08:36.827 INFO:teuthology.orchestra.run.smithi161.stdout:2715 write 0xf79a65 thru 0xf87408 (0xd9a4 bytes) 2024-09-21T15:08:36.830 INFO:teuthology.orchestra.run.smithi161.stdout:2001 write 0xeaf091a thru 0xeaf33e3 (0x2aca bytes) 2024-09-21T15:08:36.842 INFO:teuthology.orchestra.run.smithi161.stdout:2002 trunc from 0xeaf33e4 to 0xd0d8fcd 2024-09-21T15:08:36.858 INFO:teuthology.orchestra.run.smithi161.stdout:2716 trunc from 0xe1df2b3 to 0x44f187d 2024-09-21T15:08:36.865 INFO:teuthology.orchestra.run.smithi161.stdout:2546 writesame 0xd68eef9 thru 0xd6941a1 data_size 0x1(0x52a9 bytes) 2024-09-21T15:08:36.866 INFO:teuthology.orchestra.run.smithi161.stdout:2463 write 0x789dbbb thru 0x78a09c3 (0x2e09 bytes) 2024-09-21T15:08:36.874 INFO:teuthology.orchestra.run.smithi161.stdout:2547 write 0x333aa48 thru 0x3345d08 (0xb2c1 bytes) 2024-09-21T15:08:36.914 INFO:teuthology.orchestra.run.smithi161.stdout:2464 read 0x3b914af thru 0x3b94d38 (0x388a bytes) 2024-09-21T15:08:36.920 INFO:teuthology.orchestra.run.smithi161.stdout:2465 trunc from 0x78a09c4 to 0xa86af30 2024-09-21T15:08:36.930 INFO:teuthology.orchestra.run.smithi161.stdout:2548 read 0x75303e6 thru 0x7534f6f (0x4b8a bytes) 2024-09-21T15:08:36.934 INFO:teuthology.orchestra.run.smithi161.stdout:2550 trunc from 0xd6941a2 to 0xb5a08ac 2024-09-21T15:08:37.002 INFO:teuthology.orchestra.run.smithi161.stdout:2717 write 0x1f9754b thru 0x1f9b825 (0x42db bytes) 2024-09-21T15:08:37.003 INFO:teuthology.orchestra.run.smithi161.stdout:2551 write 0x4f15397 thru 0x4f224ca (0xd134 bytes) 2024-09-21T15:08:37.019 INFO:teuthology.orchestra.run.smithi161.stdout:2719 write 0x2fe4afd thru 0x2ff14ae (0xc9b2 bytes) 2024-09-21T15:08:37.028 INFO:teuthology.orchestra.run.smithi161.stdout:2552 write 0x2afae98 thru 0x2afd6d3 (0x283c bytes) 2024-09-21T15:08:37.064 INFO:teuthology.orchestra.run.smithi161.stdout:2721 punch from 0x435e8dc to 0x436be04, (0xd528 bytes) 2024-09-21T15:08:37.064 INFO:teuthology.orchestra.run.smithi161.stdout:2722 punch from 0x42b785b to 0x42bb37d, (0x3b22 bytes) 2024-09-21T15:08:37.079 INFO:teuthology.orchestra.run.smithi161.stdout:2555 write 0x3bfd43a thru 0x3c03feb (0x6bb2 bytes) 2024-09-21T15:08:37.145 INFO:teuthology.orchestra.run.smithi161.stdout:2004 punch from 0x2087bc6 to 0x208be89, (0x42c3 bytes) 2024-09-21T15:08:37.145 INFO:teuthology.orchestra.run.smithi161.stdout:2005 read 0xa27df5d thru 0xa281920 (0x39c4 bytes) 2024-09-21T15:08:37.147 INFO:teuthology.orchestra.run.smithi161.stdout:2556 write 0x9d28719 thru 0x9d376eb (0xefd3 bytes) 2024-09-21T15:08:37.147 INFO:teuthology.orchestra.run.smithi161.stdout:2006 read 0x53df681 thru 0x53e4157 (0x4ad7 bytes) 2024-09-21T15:08:37.148 INFO:teuthology.orchestra.run.smithi161.stdout:2007 writesame 0x5fa7f0b thru 0x5fb74f4 data_size 0x1(0xf5ea bytes) 2024-09-21T15:08:37.165 INFO:teuthology.orchestra.run.smithi161.stdout:2466 trunc from 0xa86af30 to 0x675e8d8 2024-09-21T15:08:37.176 INFO:teuthology.orchestra.run.smithi161.stdout:2723 write 0x764b356 thru 0x764edca (0x3a75 bytes) 2024-09-21T15:08:37.213 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:37.213 INFO:teuthology.orchestra.run.smithi161.stdout:2009 writesame 0x744e0a1 thru 0x7456628 data_size 0x4(0x8588 bytes) 2024-09-21T15:08:37.215 INFO:teuthology.orchestra.run.smithi161.stdout:2557 trunc from 0xb5a08ac to 0x1dc1804 2024-09-21T15:08:37.230 INFO:teuthology.orchestra.run.smithi161.stdout:2724 write 0x68e67a6 thru 0x68ec974 (0x61cf bytes) 2024-09-21T15:08:37.247 INFO:teuthology.orchestra.run.smithi161.stdout:2725 writesame 0x67d3d83 thru 0x67e13fd data_size 0x1(0xd67b bytes) 2024-09-21T15:08:37.248 INFO:teuthology.orchestra.run.smithi161.stdout:2012 read 0x62f927f thru 0x62fcbd6 (0x3958 bytes) 2024-09-21T15:08:37.272 INFO:teuthology.orchestra.run.smithi161.stdout:2014 writesame 0xb83379e thru 0xb83cf94 data_size 0x1(0x97f7 bytes) 2024-09-21T15:08:37.306 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #14, image image_cluster1.client.mirror.2-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent15 2024-09-21T15:08:37.313 INFO:teuthology.orchestra.run.smithi161.stdout:2467 punch from 0x26fe93 to 0x2740a1, (0x420e bytes) 2024-09-21T15:08:37.319 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:37.329 INFO:teuthology.orchestra.run.smithi161.stdout:2468 trunc from 0x675e8d8 to 0xe83b904 2024-09-21T15:08:37.367 INFO:teuthology.orchestra.run.smithi161.stdout:2016 write 0xa93456a thru 0xa939ccb (0x5762 bytes) 2024-09-21T15:08:37.418 INFO:teuthology.orchestra.run.smithi161.stdout:2017 punch from 0xcdbf4b5 to 0xcdcdd47, (0xe892 bytes) 2024-09-21T15:08:37.418 INFO:teuthology.orchestra.run.smithi161.stdout:2018 read 0x4b424f2 thru 0x4b5102d (0xeb3c bytes) 2024-09-21T15:08:37.418 INFO:teuthology.orchestra.run.smithi161.stdout:2019 write 0x87ad179 thru 0x87bafb2 (0xde3a bytes) 2024-09-21T15:08:37.430 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:37.430 INFO:teuthology.orchestra.run.smithi161.stdout:2021 write 0x2ca76ff thru 0x2ca7e8d (0x78f bytes) 2024-09-21T15:08:37.431 INFO:teuthology.orchestra.run.smithi161.stdout:2469 read 0x5aad31f thru 0x5abbf68 (0xec4a bytes) 2024-09-21T15:08:37.431 INFO:teuthology.orchestra.run.smithi161.stdout:2471 punch from 0xa08df50 to 0xa097244, (0x92f4 bytes) 2024-09-21T15:08:37.431 INFO:teuthology.orchestra.run.smithi161.stdout:2473 trunc from 0xe83b904 to 0xea3dd20 2024-09-21T15:08:37.432 INFO:teuthology.orchestra.run.smithi161.stdout:2558 write 0x7b5fc1c thru 0x7b61c2e (0x2013 bytes) 2024-09-21T15:08:37.435 INFO:teuthology.orchestra.run.smithi161.stdout:2727 write 0x9911642 thru 0x9916e3a (0x57f9 bytes) 2024-09-21T15:08:37.440 INFO:teuthology.orchestra.run.smithi161.stdout:2025 write 0x1eb1cf4 thru 0x1ebcf13 (0xb220 bytes) 2024-09-21T15:08:37.454 INFO:teuthology.orchestra.run.smithi161.stdout:2728 punch from 0x6afa832 to 0x6aff9ee, (0x51bc bytes) 2024-09-21T15:08:37.456 INFO:teuthology.orchestra.run.smithi161.stdout:2559 trunc from 0x7b61c2f to 0x5b70a4a 2024-09-21T15:08:37.462 INFO:teuthology.orchestra.run.smithi161.stdout:2731 trunc from 0x9916e3b to 0x5b15ca0 2024-09-21T15:08:37.468 INFO:teuthology.orchestra.run.smithi161.stdout:2026 trunc from 0xd0d8fcd to 0x5ddabc7 2024-09-21T15:08:37.480 INFO:teuthology.orchestra.run.smithi161.stdout:2475 write 0xcedcfa9 thru 0xcee940e (0xc466 bytes) 2024-09-21T15:08:37.515 INFO:teuthology.orchestra.run.smithi161.stdout:2476 write 0x113ae5d thru 0x114ac8e (0xfe32 bytes) 2024-09-21T15:08:37.532 INFO:teuthology.orchestra.run.smithi161.stdout:2477 read 0x209b617 thru 0x20a4cbc (0x96a6 bytes) 2024-09-21T15:08:37.532 INFO:teuthology.orchestra.run.smithi161.stdout:2478 read 0x80160f1 thru 0x8021d35 (0xbc45 bytes) 2024-09-21T15:08:37.533 INFO:teuthology.orchestra.run.smithi161.stdout:2479 writesame 0x610ae93 thru 0x610f658 data_size 0x1(0x47c6 bytes) 2024-09-21T15:08:37.542 INFO:teuthology.orchestra.run.smithi161.stdout:2560 read 0x52ef52d thru 0x52f702a (0x7afe bytes) 2024-09-21T15:08:37.559 INFO:teuthology.orchestra.run.smithi161.stdout:2027 punch from 0x37f8e60 to 0x37fe1de, (0x537e bytes) 2024-09-21T15:08:37.559 INFO:teuthology.orchestra.run.smithi161.stdout:2028 read 0x2e59d90 thru 0x2e677dc (0xda4d bytes) 2024-09-21T15:08:37.559 INFO:teuthology.orchestra.run.smithi161.stdout:2029 read 0xc1dd0e thru 0xc2b4d6 (0xd7c9 bytes) 2024-09-21T15:08:37.560 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:37.560 INFO:teuthology.orchestra.run.smithi161.stdout:2031 writesame 0x882430 thru 0x88770a data_size 0x1(0x52db bytes) 2024-09-21T15:08:37.569 INFO:teuthology.orchestra.run.smithi161.stdout:2735 punch from 0xb66e9c to 0xb73f24, (0xd088 bytes) 2024-09-21T15:08:37.594 INFO:teuthology.orchestra.run.smithi161.stdout:2480 trunc from 0xea3dd20 to 0x3929757 2024-09-21T15:08:37.595 INFO:teuthology.orchestra.run.smithi161.stdout:2562 writesame 0xd006bcb thru 0xd012c50 data_size 0x13(0xc086 bytes) 2024-09-21T15:08:37.614 INFO:teuthology.orchestra.run.smithi161.stdout:2563 trunc from 0xd012c51 to 0x716596d 2024-09-21T15:08:37.620 INFO:teuthology.orchestra.run.smithi161.stdout:2737 writesame 0xdd1021c thru 0xdd149ae data_size 0x1(0x4793 bytes) 2024-09-21T15:08:37.625 INFO:teuthology.orchestra.run.smithi161.stdout:2033 writesame 0x6bc1ba1 thru 0x6bc3286 data_size 0x3(0x16e6 bytes) 2024-09-21T15:08:37.639 INFO:teuthology.orchestra.run.smithi161.stdout:2564 read 0x491954d thru 0x492479d (0xb251 bytes) 2024-09-21T15:08:37.641 INFO:teuthology.orchestra.run.smithi161.stdout:2566 trunc from 0x716596d to 0x7d5d4df 2024-09-21T15:08:37.668 INFO:teuthology.orchestra.run.smithi161.stdout:2567 writesame 0x5e6c87f thru 0x5e6e4ae data_size 0x16(0x1c30 bytes) 2024-09-21T15:08:37.689 INFO:teuthology.orchestra.run.smithi161.stdout:2034 write 0xe19bc5f thru 0xe19c151 (0x4f3 bytes) 2024-09-21T15:08:37.700 INFO:teuthology.orchestra.run.smithi161.stdout:2482 writesame 0xbf8209a thru 0xbf8290b data_size 0x17(0x872 bytes) 2024-09-21T15:08:37.705 INFO:teuthology.orchestra.run.smithi161.stdout:2037 read 0x4420fe1 thru 0x442f31c (0xe33c bytes) 2024-09-21T15:08:37.728 INFO:teuthology.orchestra.run.smithi161.stdout:2038 trunc from 0xe19c152 to 0x19d3a6a 2024-09-21T15:08:37.735 INFO:teuthology.orchestra.run.smithi161.stdout:2570 writesame 0xab25cd1 thru 0xab274ce data_size 0x25(0x17fe bytes) 2024-09-21T15:08:37.746 INFO:teuthology.orchestra.run.smithi161.stdout:2483 write 0xe1f1a28 thru 0xe1ff33f (0xd918 bytes) 2024-09-21T15:08:37.747 INFO:teuthology.orchestra.run.smithi161.stdout:2571 trunc from 0xab274cf to 0xdbf50d8 2024-09-21T15:08:37.775 INFO:teuthology.orchestra.run.smithi161.stdout:2572 write 0x790b4c2 thru 0x7914761 (0x92a0 bytes) 2024-09-21T15:08:37.788 INFO:teuthology.orchestra.run.smithi161.stdout:2484 write 0xeb700bf thru 0xeb785a8 (0x84ea bytes) 2024-09-21T15:08:37.794 INFO:teuthology.orchestra.run.smithi161.stdout:2576 write 0x538ab64 thru 0x538b1a3 (0x640 bytes) 2024-09-21T15:08:37.801 INFO:teuthology.orchestra.run.smithi161.stdout:2485 writesame 0x4561a12 thru 0x4566076 data_size 0x1(0x4665 bytes) 2024-09-21T15:08:37.809 INFO:teuthology.orchestra.run.smithi161.stdout:2578 read 0x7f0cacb thru 0x7f0f86d (0x2da3 bytes) 2024-09-21T15:08:37.809 INFO:teuthology.orchestra.run.smithi161.stdout:2579 writesame 0xaddbb25 thru 0xade6d45 data_size 0x1(0xb221 bytes) 2024-09-21T15:08:37.819 INFO:teuthology.orchestra.run.smithi161.stdout:2039 write 0xe2318d5 thru 0xe241504 (0xfc30 bytes) 2024-09-21T15:08:37.824 INFO:teuthology.orchestra.run.smithi161.stdout:2486 punch from 0x1751634 to 0x17614df, (0xfeab bytes) 2024-09-21T15:08:37.824 INFO:teuthology.orchestra.run.smithi161.stdout:2487 read 0x374172a thru 0x3749d4d (0x8624 bytes) 2024-09-21T15:08:37.827 INFO:teuthology.orchestra.run.smithi161.stdout:2488 trunc from 0xeb785a9 to 0xdcf2d4b 2024-09-21T15:08:37.839 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:37.839 INFO:teuthology.orchestra.run.smithi161.stdout:2582 read 0x41e5a2d thru 0x41e60e2 (0x6b6 bytes) 2024-09-21T15:08:37.839 INFO:teuthology.orchestra.run.smithi161.stdout:2040 read 0xfdfc03 thru 0xfe98ad (0x9cab bytes) 2024-09-21T15:08:37.840 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:37.840 INFO:teuthology.orchestra.run.smithi161.stdout:2586 read 0xa0c396e thru 0xa0cb06b (0x76fe bytes) 2024-09-21T15:08:37.840 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:37.840 INFO:teuthology.orchestra.run.smithi161.stdout:2590 punch from 0x3ec9afa to 0x3ed7cb0, (0xe1b6 bytes) 2024-09-21T15:08:37.840 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:37.840 INFO:teuthology.orchestra.run.smithi161.stdout:2593 clone 16 order 23 su 4194304 sc 13 2024-09-21T15:08:37.841 INFO:teuthology.orchestra.run.smithi161.stdout:2041 punch from 0x42f3927 to 0x42f6f12, (0x35eb bytes) 2024-09-21T15:08:37.841 INFO:teuthology.orchestra.run.smithi161.stdout:2042 writesame 0xb715701 thru 0xb7225d0 data_size 0x18(0xced0 bytes) 2024-09-21T15:08:37.849 INFO:teuthology.orchestra.run.smithi161.stdout:2043 punch from 0x14f5bdf to 0x14f9bde, (0x3fff bytes) 2024-09-21T15:08:37.850 INFO:teuthology.orchestra.run.smithi161.stdout:2044 read 0xae9d39c thru 0xaea8620 (0xb285 bytes) 2024-09-21T15:08:37.851 INFO:teuthology.orchestra.run.smithi161.stdout:2045 read 0x3147620 thru 0x314f1c1 (0x7ba2 bytes) 2024-09-21T15:08:37.852 INFO:teuthology.orchestra.run.smithi161.stdout:2049 read 0xbad94ea thru 0xbadb58e (0x20a5 bytes) 2024-09-21T15:08:37.853 INFO:teuthology.orchestra.run.smithi161.stdout:2050 read 0x766f24e thru 0x766f740 (0x4f3 bytes) 2024-09-21T15:08:37.854 INFO:teuthology.orchestra.run.smithi161.stdout:2051 read 0x8b3f0a thru 0x8c0056 (0xc14d bytes) 2024-09-21T15:08:37.860 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:37.860 INFO:teuthology.orchestra.run.smithi161.stdout:2493 read 0x37d2a34 thru 0x37d3504 (0xad1 bytes) 2024-09-21T15:08:37.860 INFO:teuthology.orchestra.run.smithi161.stdout:2495 write 0x449ae2f thru 0x449c3f6 (0x15c8 bytes) 2024-09-21T15:08:37.870 INFO:teuthology.orchestra.run.smithi161.stdout:2052 trunc from 0xe241505 to 0x5e42de4 2024-09-21T15:08:37.873 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:37.873 INFO:teuthology.orchestra.run.smithi161.stdout:2498 read 0x510cb16 thru 0x510e0dc (0x15c7 bytes) 2024-09-21T15:08:37.873 INFO:teuthology.orchestra.run.smithi161.stdout:2499 read 0x1b9fda9 thru 0x1ba6089 (0x62e1 bytes) 2024-09-21T15:08:37.873 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:37.882 INFO:teuthology.orchestra.run.smithi161.stdout:2501 trunc from 0xdcf2d4b to 0x9d33616 2024-09-21T15:08:37.918 INFO:teuthology.orchestra.run.smithi161.stdout:2053 writesame 0x4620ebd thru 0x4622609 data_size 0x1(0x174d bytes) 2024-09-21T15:08:37.932 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:37.932 INFO:teuthology.orchestra.run.smithi161.stdout:2505 write 0xf175cd thru 0xf20b95 (0x95c9 bytes) 2024-09-21T15:08:37.943 INFO:teuthology.orchestra.run.smithi161.stdout:2506 trunc from 0x9d33616 to 0x92c552c 2024-09-21T15:08:37.978 INFO:teuthology.orchestra.run.smithi161.stdout:2054 write 0xe8bb152 thru 0xe8c31de (0x808d bytes) 2024-09-21T15:08:37.989 INFO:teuthology.orchestra.run.smithi161.stdout:2057 write 0xb87ba54 thru 0xb88418f (0x873c bytes) 2024-09-21T15:08:38.000 INFO:teuthology.orchestra.run.smithi161.stdout:2507 read 0x8c14a73 thru 0x8c1dfba (0x9548 bytes) 2024-09-21T15:08:38.005 INFO:teuthology.orchestra.run.smithi161.stdout:2058 read 0x4e5b11c thru 0x4e5bfbc (0xea1 bytes) 2024-09-21T15:08:38.006 INFO:teuthology.orchestra.run.smithi161.stdout:2059 write 0x96fcbec thru 0x96febf0 (0x2005 bytes) 2024-09-21T15:08:38.006 INFO:teuthology.orchestra.run.smithi161.stdout:2948 write 0xdb1c466 thru 0xdb1f062 (0x2bfd bytes) 2024-09-21T15:08:38.016 INFO:teuthology.orchestra.run.smithi161.stdout:2060 read 0xc83e076 thru 0xc843719 (0x56a4 bytes) 2024-09-21T15:08:38.016 INFO:teuthology.orchestra.run.smithi161.stdout:2062 punch from 0xc16247a to 0xc16fc6c, (0xd7f2 bytes) 2024-09-21T15:08:38.017 INFO:teuthology.orchestra.run.smithi161.stdout:2063 read 0x520534f thru 0x520d461 (0x8113 bytes) 2024-09-21T15:08:38.017 INFO:teuthology.orchestra.run.smithi161.stdout:2064 read 0x1155ce0 thru 0x115ec27 (0x8f48 bytes) 2024-09-21T15:08:38.018 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.018 INFO:teuthology.orchestra.run.smithi161.stdout:2066 read 0x60cda0f thru 0x60d7719 (0x9d0b bytes) 2024-09-21T15:08:38.019 INFO:teuthology.orchestra.run.smithi161.stdout:2067 read 0xe1080c3 thru 0xe115537 (0xd475 bytes) 2024-09-21T15:08:38.019 INFO:teuthology.orchestra.run.smithi161.stdout:2068 read 0x97cc194 thru 0x97cd629 (0x1496 bytes) 2024-09-21T15:08:38.020 INFO:teuthology.orchestra.run.smithi161.stdout:2949 read 0x8242432 thru 0x82449bb (0x258a bytes) 2024-09-21T15:08:38.020 INFO:teuthology.orchestra.run.smithi161.stdout:2069 punch from 0x7160d5c to 0x716a3b9, (0x965d bytes) 2024-09-21T15:08:38.020 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.020 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.020 INFO:teuthology.orchestra.run.smithi161.stdout:2073 read 0x3c026e6 thru 0x3c0d9bd (0xb2d8 bytes) 2024-09-21T15:08:38.021 INFO:teuthology.orchestra.run.smithi161.stdout:2951 read 0xac2d6e7 thru 0xac3a27e (0xcb98 bytes) 2024-09-21T15:08:38.021 INFO:teuthology.orchestra.run.smithi161.stdout:2952 read 0x362de53 thru 0x363653d (0x86eb bytes) 2024-09-21T15:08:38.021 INFO:teuthology.orchestra.run.smithi161.stdout:2074 read 0xadcf6c7 thru 0xadd4dbd (0x56f7 bytes) 2024-09-21T15:08:38.022 INFO:teuthology.orchestra.run.smithi161.stdout:2075 read 0xaa46401 thru 0xaa4c479 (0x6079 bytes) 2024-09-21T15:08:38.022 INFO:teuthology.orchestra.run.smithi161.stdout:2076 read 0x6ef21c thru 0x6f110f (0x1ef4 bytes) 2024-09-21T15:08:38.023 INFO:teuthology.orchestra.run.smithi161.stdout:2120 writesame 0xe101f5a thru 0xe10305d data_size 0x12(0x1104 bytes) 2024-09-21T15:08:38.028 INFO:teuthology.orchestra.run.smithi161.stdout:2121 write 0xe0a6b01 thru 0xe0b1269 (0xa769 bytes) 2024-09-21T15:08:38.028 INFO:teuthology.orchestra.run.smithi161.stdout:2953 trunc from 0xdb1f063 to 0x9781511 2024-09-21T15:08:38.029 INFO:teuthology.orchestra.run.smithi161.stdout:2077 trunc from 0xe8c31df to 0xb1fc2a2 2024-09-21T15:08:38.043 INFO:teuthology.orchestra.run.smithi161.stdout:2508 write 0xcf421ca thru 0xcf4455d (0x2394 bytes) 2024-09-21T15:08:38.059 INFO:teuthology.orchestra.run.smithi161.stdout:2123 punch from 0x6132615 to 0x613a9db, (0x83c6 bytes) 2024-09-21T15:08:38.060 INFO:teuthology.orchestra.run.smithi161.stdout:2124 punch from 0xcde1aaf to 0xcdf0dd3, (0xf324 bytes) 2024-09-21T15:08:38.060 INFO:teuthology.orchestra.run.smithi161.stdout:2125 write 0xbb173a0 thru 0xbb1f6ad (0x830e bytes) 2024-09-21T15:08:38.071 INFO:teuthology.orchestra.run.smithi161.stdout:2509 write 0x48acb8c thru 0x48b43a0 (0x7815 bytes) 2024-09-21T15:08:38.085 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.085 INFO:teuthology.orchestra.run.smithi161.stdout:2080 clone 23 order 24 su 131072 sc 11 2024-09-21T15:08:38.090 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.090 INFO:teuthology.orchestra.run.smithi161.stdout:2128 punch from 0x9b26c71 to 0x9b34657, (0xd9e6 bytes) 2024-09-21T15:08:38.090 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.090 INFO:teuthology.orchestra.run.smithi161.stdout:2511 read 0xbf70c6c thru 0xbf7101a (0x3af bytes) 2024-09-21T15:08:38.092 INFO:teuthology.orchestra.run.smithi161.stdout:2512 trunc from 0xcf4455e to 0xdaf9456 2024-09-21T15:08:38.112 INFO:teuthology.orchestra.run.smithi161.stdout:2129 trunc from 0xe10305e to 0x1249678 2024-09-21T15:08:38.138 INFO:teuthology.orchestra.run.smithi161.stdout:2513 trunc from 0xdaf9456 to 0xaa95276 2024-09-21T15:08:38.213 INFO:teuthology.orchestra.run.smithi161.stdout:2954 write 0xecdf32a thru 0xece1d2c (0x2a03 bytes) 2024-09-21T15:08:38.230 INFO:teuthology.orchestra.run.smithi161.stdout:2955 writesame 0x32171ea thru 0x3217714 data_size 0x15(0x52b bytes) 2024-09-21T15:08:38.239 INFO:teuthology.orchestra.run.smithi161.stdout:2514 writesame 0x816b54e thru 0x816f728 data_size 0x1(0x41db bytes) 2024-09-21T15:08:38.268 INFO:teuthology.orchestra.run.smithi161.stdout:2515 read 0x50cfa73 thru 0x50cff9c (0x52a bytes) 2024-09-21T15:08:38.268 INFO:teuthology.orchestra.run.smithi161.stdout:2957 write 0xd3c1977 thru 0xd3c41ae (0x2838 bytes) 2024-09-21T15:08:38.269 INFO:teuthology.orchestra.run.smithi161.stdout:2516 write 0x5f78c7b thru 0x5f7f84f (0x6bd5 bytes) 2024-09-21T15:08:38.279 INFO:teuthology.orchestra.run.smithi161.stdout:2958 write 0xd6f5fca thru 0xd704894 (0xe8cb bytes) 2024-09-21T15:08:38.283 INFO:teuthology.orchestra.run.smithi161.stdout:2517 punch from 0x32f2fb9 to 0x32ff719, (0xc760 bytes) 2024-09-21T15:08:38.283 INFO:teuthology.orchestra.run.smithi161.stdout:2518 punch from 0x1e0945d to 0x1e1828a, (0xee2d bytes) 2024-09-21T15:08:38.284 INFO:teuthology.orchestra.run.smithi161.stdout:2520 writesame 0x5f8d67b thru 0x5f9b6ac data_size 0x1(0xe032 bytes) 2024-09-21T15:08:38.297 INFO:teuthology.orchestra.run.smithi161.stdout:2959 write 0x223e86c thru 0x224b03e (0xc7d3 bytes) 2024-09-21T15:08:38.334 INFO:teuthology.orchestra.run.smithi161.stdout:2521 punch from 0x44f3e42 to 0x44fe6bb, (0xa879 bytes) 2024-09-21T15:08:38.334 INFO:teuthology.orchestra.run.smithi161.stdout:2522 punch from 0x12ebee to 0x137e71, (0x9283 bytes) 2024-09-21T15:08:38.334 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.334 INFO:teuthology.orchestra.run.smithi161.stdout:2524 read 0x525c4a thru 0x52a253 (0x460a bytes) 2024-09-21T15:08:38.335 INFO:teuthology.orchestra.run.smithi161.stdout:2131 punch from 0x3a9fb5 to 0x3b1c95, (0x7ce0 bytes) 2024-09-21T15:08:38.335 INFO:teuthology.orchestra.run.smithi161.stdout:2133 read 0x4de617 thru 0x4e1d01 (0x36eb bytes) 2024-09-21T15:08:38.338 INFO:teuthology.orchestra.run.smithi161.stdout:2526 trunc from 0xaa95276 to 0xb676318 2024-09-21T15:08:38.339 INFO:teuthology.orchestra.run.smithi161.stdout:2960 read 0xefa180 thru 0xefb2b2 (0x1133 bytes) 2024-09-21T15:08:38.340 INFO:teuthology.orchestra.run.smithi161.stdout:2961 write 0xdc14add thru 0xdc24200 (0xf724 bytes) 2024-09-21T15:08:38.368 INFO:teuthology.orchestra.run.smithi161.stdout:2527 read 0x96008cd thru 0x9603971 (0x30a5 bytes) 2024-09-21T15:08:38.369 INFO:teuthology.orchestra.run.smithi161.stdout:2528 punch from 0x18170bb to 0x1817ea4, (0xde9 bytes) 2024-09-21T15:08:38.369 INFO:teuthology.orchestra.run.smithi161.stdout:2529 write 0x78ad0de thru 0x78b743c (0xa35f bytes) 2024-09-21T15:08:38.373 INFO:teuthology.orchestra.run.smithi161.stdout:2962 trunc from 0xece1d2d to 0x614c08a 2024-09-21T15:08:38.377 INFO:teuthology.orchestra.run.smithi161.stdout:2137 write 0x452d394 thru 0x45384db (0xb148 bytes) 2024-09-21T15:08:38.385 INFO:teuthology.orchestra.run.smithi161.stdout:2530 write 0x10dc6bd thru 0x10df545 (0x2e89 bytes) 2024-09-21T15:08:38.387 INFO:teuthology.orchestra.run.smithi161.stdout:2138 read 0x1088f23 thru 0x108eb3a (0x5c18 bytes) 2024-09-21T15:08:38.388 INFO:teuthology.orchestra.run.smithi161.stdout:2139 read 0x3290e85 thru 0x329475b (0x38d7 bytes) 2024-09-21T15:08:38.389 INFO:teuthology.orchestra.run.smithi161.stdout:2140 read 0x283d7d9 thru 0x2849460 (0xbc88 bytes) 2024-09-21T15:08:38.397 INFO:teuthology.orchestra.run.smithi161.stdout:2531 write 0x9a76dcd thru 0x9a7d879 (0x6aad bytes) 2024-09-21T15:08:38.415 INFO:teuthology.orchestra.run.smithi161.stdout:2533 write 0x38f8bb7 thru 0x390055d (0x79a7 bytes) 2024-09-21T15:08:38.442 INFO:teuthology.orchestra.run.smithi161.stdout:2142 write 0xa075080 thru 0xa07e543 (0x94c4 bytes) 2024-09-21T15:08:38.444 INFO:teuthology.orchestra.run.smithi161.stdout:2534 trunc from 0xb676318 to 0x6da0be4 2024-09-21T15:08:38.447 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.459 INFO:teuthology.orchestra.run.smithi161.stdout:2146 write 0x87eaec7 thru 0x87f62ec (0xb426 bytes) 2024-09-21T15:08:38.499 INFO:teuthology.orchestra.run.smithi161.stdout:2147 punch from 0x4572596 to 0x4573ef7, (0x1961 bytes) 2024-09-21T15:08:38.499 INFO:teuthology.orchestra.run.smithi161.stdout:2148 writesame 0x5c8587b thru 0x5c878d3 data_size 0x1(0x2059 bytes) 2024-09-21T15:08:38.510 INFO:teuthology.orchestra.run.smithi161.stdout:2964 writesame 0xbcd7cb4 thru 0xbcd9d19 data_size 0x1d(0x2066 bytes) 2024-09-21T15:08:38.516 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.516 INFO:teuthology.orchestra.run.smithi161.stdout:2966 read 0x6584b60 thru 0x658baeb (0x6f8c bytes) 2024-09-21T15:08:38.517 INFO:teuthology.orchestra.run.smithi161.stdout:2149 write 0x9207c95 thru 0x9213e78 (0xc1e4 bytes) 2024-09-21T15:08:38.518 INFO:teuthology.orchestra.run.smithi161.stdout:2967 read 0x9e3cd17 thru 0x9e3fcdd (0x2fc7 bytes) 2024-09-21T15:08:38.518 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.518 INFO:teuthology.orchestra.run.smithi161.stdout:2970 write 0x50d68da thru 0x50dc90d (0x6034 bytes) 2024-09-21T15:08:38.538 INFO:teuthology.orchestra.run.smithi161.stdout:2536 read 0x252605b thru 0x25308c7 (0xa86d bytes) 2024-09-21T15:08:38.545 INFO:teuthology.orchestra.run.smithi161.stdout:2971 punch from 0x6679af4 to 0x6685e20, (0xc32c bytes) 2024-09-21T15:08:38.545 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.545 INFO:teuthology.orchestra.run.smithi161.stdout:2152 read 0x1adb980 thru 0x1ae83d9 (0xca5a bytes) 2024-09-21T15:08:38.546 INFO:teuthology.orchestra.run.smithi161.stdout:2973 punch from 0x38cd3b8 to 0x38d8267, (0xaeaf bytes) 2024-09-21T15:08:38.546 INFO:teuthology.orchestra.run.smithi161.stdout:2974 punch from 0x5c26db6 to 0x5c2ee03, (0x804d bytes) 2024-09-21T15:08:38.546 INFO:teuthology.orchestra.run.smithi161.stdout:2975 punch from 0x2c005e7 to 0x2c03b1c, (0x3535 bytes) 2024-09-21T15:08:38.553 INFO:teuthology.orchestra.run.smithi161.stdout:2738 write 0xea66181 thru 0xea6c5f6 (0x6476 bytes) 2024-09-21T15:08:38.553 INFO:teuthology.orchestra.run.smithi161.stdout:2976 trunc from 0xbcd9d1a to 0x7bb734d 2024-09-21T15:08:38.567 INFO:teuthology.orchestra.run.smithi161.stdout:2739 read 0xcff9895 thru 0xcffacad (0x1419 bytes) 2024-09-21T15:08:38.567 INFO:teuthology.orchestra.run.smithi161.stdout:2741 write 0x7e73e3e thru 0x7e7c669 (0x882c bytes) 2024-09-21T15:08:38.582 INFO:teuthology.orchestra.run.smithi161.stdout:2537 writesame 0xde9b09c thru 0xdea0957 data_size 0x9(0x58bc bytes) 2024-09-21T15:08:38.582 INFO:teuthology.orchestra.run.smithi161.stdout:2742 read 0x4af0360 thru 0x4af08de (0x57f bytes) 2024-09-21T15:08:38.582 INFO:teuthology.orchestra.run.smithi161.stdout:2743 writesame 0xac05b66 thru 0xac08653 data_size 0x23(0x2aee bytes) 2024-09-21T15:08:38.587 INFO:teuthology.orchestra.run.smithi161.stdout:2538 punch from 0x2cd09ff to 0x2cd46bc, (0x3cbd bytes) 2024-09-21T15:08:38.587 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.587 INFO:teuthology.orchestra.run.smithi161.stdout:2540 write 0xd547a4 thru 0xd63162 (0xe9bf bytes) 2024-09-21T15:08:38.596 INFO:teuthology.orchestra.run.smithi161.stdout:2153 write 0xb882cde thru 0xb88c690 (0x99b3 bytes) 2024-09-21T15:08:38.597 INFO:teuthology.orchestra.run.smithi161.stdout:2977 punch from 0x35b9f4b to 0x35c0bf0, (0x6ca5 bytes) 2024-09-21T15:08:38.597 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.597 INFO:teuthology.orchestra.run.smithi161.stdout:2979 read 0x6e7859e thru 0x6e79c49 (0x16ac bytes) 2024-09-21T15:08:38.601 INFO:teuthology.orchestra.run.smithi161.stdout:2541 read 0x7230d6b thru 0x723d60b (0xc8a1 bytes) 2024-09-21T15:08:38.601 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.601 INFO:teuthology.orchestra.run.smithi161.stdout:2543 writesame 0x4e4f3fe thru 0x4e57272 data_size 0x21(0x7e75 bytes) 2024-09-21T15:08:38.606 INFO:teuthology.orchestra.run.smithi161.stdout:2744 read 0x3acd4d1 thru 0x3acdba5 (0x6d5 bytes) 2024-09-21T15:08:38.606 INFO:teuthology.orchestra.run.smithi161.stdout:2745 write 0xc465d12 thru 0xc47011c (0xa40b bytes) 2024-09-21T15:08:38.617 INFO:teuthology.orchestra.run.smithi161.stdout:2155 write 0x9d6bee2 thru 0x9d70290 (0x43af bytes) 2024-09-21T15:08:38.623 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.623 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.623 INFO:teuthology.orchestra.run.smithi161.stdout:2546 read 0x78e2c1f thru 0x78f0866 (0xdc48 bytes) 2024-09-21T15:08:38.624 INFO:teuthology.orchestra.run.smithi161.stdout:2547 punch from 0x87e2ac0 to 0x87f0a89, (0xdfc9 bytes) 2024-09-21T15:08:38.624 INFO:teuthology.orchestra.run.smithi161.stdout:2548 read 0x37e0075 thru 0x37e55ba (0x5546 bytes) 2024-09-21T15:08:38.624 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.624 INFO:teuthology.orchestra.run.smithi161.stdout:2552 write 0x7ca7287 thru 0x7cb5e78 (0xebf2 bytes) 2024-09-21T15:08:38.626 INFO:teuthology.orchestra.run.smithi161.stdout:2747 read 0xbeca127 thru 0xbed2c8e (0x8b68 bytes) 2024-09-21T15:08:38.639 INFO:teuthology.orchestra.run.smithi161.stdout:2157 punch from 0x1e3e745 to 0x1e3ebe9, (0x4a4 bytes) 2024-09-21T15:08:38.639 INFO:teuthology.orchestra.run.smithi161.stdout:2159 write 0x735998a thru 0x735de4a (0x44c1 bytes) 2024-09-21T15:08:38.642 INFO:teuthology.orchestra.run.smithi161.stdout:2981 write 0xa887819 thru 0xa896b77 (0xf35f bytes) 2024-09-21T15:08:38.642 INFO:teuthology.orchestra.run.smithi161.stdout:2748 trunc from 0xea6c5f7 to 0x7d44c55 2024-09-21T15:08:38.647 INFO:teuthology.orchestra.run.smithi161.stdout:2553 write 0x633c3c9 thru 0x6342bf2 (0x682a bytes) 2024-09-21T15:08:38.659 INFO:teuthology.orchestra.run.smithi161.stdout:2160 read 0x6b8f618 thru 0x6b911b4 (0x1b9d bytes) 2024-09-21T15:08:38.660 INFO:teuthology.orchestra.run.smithi161.stdout:2161 punch from 0x2b992c0 to 0x2ba146b, (0x81ab bytes) 2024-09-21T15:08:38.660 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.660 INFO:teuthology.orchestra.run.smithi161.stdout:2164 read 0xa0fdb72 thru 0xa10101b (0x34aa bytes) 2024-09-21T15:08:38.660 INFO:teuthology.orchestra.run.smithi161.stdout:2165 writesame 0x56454e0 thru 0x564d5c4 data_size 0x3(0x80e5 bytes) 2024-09-21T15:08:38.661 INFO:teuthology.orchestra.run.smithi161.stdout:2982 write 0x8f59745 thru 0x8f5d4a3 (0x3d5f bytes) 2024-09-21T15:08:38.665 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:08:38.660+0000 7f7fd044c700 -1 reset not still connected to 0x5636ad239110 2024-09-21T15:08:38.672 INFO:teuthology.orchestra.run.smithi161.stdout:2554 writesame 0x468bbc9 thru 0x4699da9 data_size 0x4b(0xe1e1 bytes) 2024-09-21T15:08:38.678 INFO:teuthology.orchestra.run.smithi161.stdout:2167 write 0x98d8038 thru 0x98e49cb (0xc994 bytes) 2024-09-21T15:08:38.682 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.682 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.682 INFO:teuthology.orchestra.run.smithi161.stdout:2985 read 0x8ad4d65 thru 0x8ad5f44 (0x11e0 bytes) 2024-09-21T15:08:38.682 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.682 INFO:teuthology.orchestra.run.smithi161.stdout:2988 write 0x87f727 thru 0x886557 (0x6e31 bytes) 2024-09-21T15:08:38.692 INFO:teuthology.orchestra.run.smithi161.stdout:2555 read 0x4bf4b5f thru 0x4bfcd83 (0x8225 bytes) 2024-09-21T15:08:38.693 INFO:teuthology.orchestra.run.smithi161.stdout:2556 read 0xa222830 thru 0xa22a126 (0x78f7 bytes) 2024-09-21T15:08:38.693 INFO:teuthology.orchestra.run.smithi161.stdout:2557 punch from 0x449dca9 to 0x44a7e96, (0xa1ed bytes) 2024-09-21T15:08:38.693 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.693 INFO:teuthology.orchestra.run.smithi161.stdout:2560 read 0x578b8f2 thru 0x57932a7 (0x79b6 bytes) 2024-09-21T15:08:38.694 INFO:teuthology.orchestra.run.smithi161.stdout:2561 writesame 0x4078eb0 thru 0x4088b24 data_size 0x2b(0xfc75 bytes) 2024-09-21T15:08:38.712 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone15 from 0xdbf50d8 (overlap 0x10024ff) to 0x4cd7e6 2024-09-21T15:08:38.713 INFO:teuthology.orchestra.run.smithi161.stdout:2990 read 0x9053c5e thru 0x9059987 (0x5d2a bytes) 2024-09-21T15:08:38.713 INFO:teuthology.orchestra.run.smithi161.stdout:2992 read 0x381f8a thru 0x38d3c3 (0xb43a bytes) 2024-09-21T15:08:38.713 INFO:teuthology.orchestra.run.smithi161.stdout:2993 write 0x146da01 thru 0x146ed03 (0x1303 bytes) 2024-09-21T15:08:38.718 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone22 from 0xb1fc2a2 (overlap 0x19d3a6a) to 0x0 2024-09-21T15:08:38.723 INFO:teuthology.orchestra.run.smithi161.stdout:2749 clone 16 order 24 su 524288 sc 12 2024-09-21T15:08:38.725 INFO:teuthology.orchestra.run.smithi161.stdout:2562 trunc from 0xdea0958 to 0x7a71013 2024-09-21T15:08:38.732 INFO:teuthology.orchestra.run.smithi161.stdout:2995 read 0x540497a thru 0x5408965 (0x3fec bytes) 2024-09-21T15:08:38.745 INFO:teuthology.orchestra.run.smithi161.stdout:2168 write 0xd0a81ff thru 0xd0b37b3 (0xb5b5 bytes) 2024-09-21T15:08:38.748 INFO:teuthology.orchestra.run.smithi161.stdout:2996 trunc from 0xa896b78 to 0x27486d8 2024-09-21T15:08:38.759 INFO:teuthology.orchestra.run.smithi161.stdout:2169 read 0x52b3555 thru 0x52b6938 (0x33e4 bytes) 2024-09-21T15:08:38.759 INFO:teuthology.orchestra.run.smithi161.stdout:2170 read 0x885ced thru 0x892903 (0xcc17 bytes) 2024-09-21T15:08:38.761 INFO:teuthology.orchestra.run.smithi161.stdout:2172 write 0xa9d0a99 thru 0xa9d39d1 (0x2f39 bytes) 2024-09-21T15:08:38.767 INFO:teuthology.orchestra.run.smithi161.stdout:2174 punch from 0x34d0500 to 0x34d3ff6, (0x3af6 bytes) 2024-09-21T15:08:38.767 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:38.767 INFO:teuthology.orchestra.run.smithi161.stdout:2176 read 0x1bb9cc4 thru 0x1bc95b8 (0xf8f5 bytes) 2024-09-21T15:08:38.819 INFO:teuthology.orchestra.run.smithi161.stdout:2181 punch from 0x3e0e0da to 0x3e182ff, (0xa225 bytes) 2024-09-21T15:08:38.842 INFO:teuthology.orchestra.run.smithi161.stdout:2185 trunc from 0xd0b37b4 to 0x135e2ab 2024-09-21T15:08:38.894 INFO:teuthology.orchestra.run.smithi161.stdout:2998 read 0x226838f thru 0x227734c (0xefbe bytes) 2024-09-21T15:08:38.894 INFO:teuthology.orchestra.run.smithi161.stdout:3000 punch from 0x1f3ce63 to 0x1f43588, (0x6725 bytes) 2024-09-21T15:08:38.895 INFO:teuthology.orchestra.run.smithi161.stdout:3001 read 0xe1b1cc thru 0xe27cb6 (0xcaeb bytes) 2024-09-21T15:08:38.898 INFO:teuthology.orchestra.run.smithi161.stdout:2563 write 0x290353c thru 0x2904688 (0x114d bytes) 2024-09-21T15:08:38.919 INFO:teuthology.orchestra.run.smithi161.stdout:2564 read 0x41f4230 thru 0x41f5e4c (0x1c1d bytes) 2024-09-21T15:08:38.920 INFO:teuthology.orchestra.run.smithi161.stdout:2565 read 0x64012be thru 0x6410973 (0xf6b6 bytes) 2024-09-21T15:08:38.920 INFO:teuthology.orchestra.run.smithi161.stdout:2567 writesame 0x695abc1 thru 0x695d529 data_size 0x1(0x2969 bytes) 2024-09-21T15:08:38.937 INFO:teuthology.orchestra.run.smithi161.stdout:3003 writesame 0x2cdc7e9 thru 0x2ce5808 data_size 0x10(0x9020 bytes) 2024-09-21T15:08:38.956 INFO:teuthology.orchestra.run.smithi161.stdout:2186 trunc from 0x135e2ab to 0x2fd700d 2024-09-21T15:08:39.040 INFO:teuthology.orchestra.run.smithi161.stdout:3004 writesame 0xdbf056d thru 0xdbff9b0 data_size 0x24(0xf444 bytes) 2024-09-21T15:08:39.045 INFO:teuthology.orchestra.run.smithi161.stdout:3005 punch from 0x21041d7 to 0x210f50a, (0xb333 bytes) 2024-09-21T15:08:39.051 INFO:teuthology.orchestra.run.smithi161.stdout:2187 writesame 0xcb4221c thru 0xcb4e709 data_size 0x2(0xc4ee bytes) 2024-09-21T15:08:39.053 INFO:teuthology.orchestra.run.smithi161.stdout:2568 write 0xe456dc3 thru 0xe457dbf (0xffd bytes) 2024-09-21T15:08:39.057 INFO:teuthology.orchestra.run.smithi161.stdout:2188 write 0xac26c11 thru 0xac33bea (0xcfda bytes) 2024-09-21T15:08:39.074 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:39.074 INFO:teuthology.orchestra.run.smithi161.stdout:2570 read 0xc0ee538 thru 0xc0f700b (0x8ad4 bytes) 2024-09-21T15:08:39.074 INFO:teuthology.orchestra.run.smithi161.stdout:2571 read 0x401b7df thru 0x4029f95 (0xe7b7 bytes) 2024-09-21T15:08:39.074 INFO:teuthology.orchestra.run.smithi161.stdout:2578 write 0x17a1abe thru 0x17a339a (0x18dd bytes) 2024-09-21T15:08:39.077 INFO:teuthology.orchestra.run.smithi161.stdout:2189 read 0x938c9d1 thru 0x9393d08 (0x7338 bytes) 2024-09-21T15:08:39.084 INFO:teuthology.orchestra.run.smithi161.stdout:2192 trunc from 0xcb4e70a to 0xa1ce231 2024-09-21T15:08:39.118 INFO:teuthology.orchestra.run.smithi161.stdout:2579 read 0xa8d63d6 thru 0xa8e3ca2 (0xd8cd bytes) 2024-09-21T15:08:39.118 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:39.118 INFO:teuthology.orchestra.run.smithi161.stdout:2581 read 0x1767abd thru 0x176c170 (0x46b4 bytes) 2024-09-21T15:08:39.118 INFO:teuthology.orchestra.run.smithi161.stdout:2582 punch from 0x32174b8 to 0x321e715, (0x725d bytes) 2024-09-21T15:08:39.118 INFO:teuthology.orchestra.run.smithi161.stdout:2584 writesame 0x6b586f2 thru 0x6b60b8d data_size 0x7b(0x849c bytes) 2024-09-21T15:08:39.147 INFO:teuthology.orchestra.run.smithi161.stdout:2585 punch from 0x7ce98d7 to 0x7ce9a09, (0x132 bytes) 2024-09-21T15:08:39.147 INFO:teuthology.orchestra.run.smithi161.stdout:2586 write 0xb3413cd thru 0xb34cded (0xba21 bytes) 2024-09-21T15:08:39.150 INFO:teuthology.orchestra.run.smithi161.stdout:3009 write 0xe88e893 thru 0xe895a45 (0x71b3 bytes) 2024-09-21T15:08:39.166 INFO:teuthology.orchestra.run.smithi161.stdout:2588 write 0x34c9cb3 thru 0x34d7717 (0xda65 bytes) 2024-09-21T15:08:39.172 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:39.172 INFO:teuthology.orchestra.run.smithi161.stdout:2194 writesame 0x9203801 thru 0x9206584 data_size 0x6(0x2d84 bytes) 2024-09-21T15:08:39.181 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:39.181 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:39.181 INFO:teuthology.orchestra.run.smithi161.stdout:2198 read 0x1e02b85 thru 0x1e047b8 (0x1c34 bytes) 2024-09-21T15:08:39.182 INFO:teuthology.orchestra.run.smithi161.stdout:2199 read 0x430abea thru 0x430cbb7 (0x1fce bytes) 2024-09-21T15:08:39.182 INFO:teuthology.orchestra.run.smithi161.stdout:2200 trunc from 0xa1ce231 to 0xa110c22 2024-09-21T15:08:39.213 INFO:teuthology.orchestra.run.smithi161.stdout:3010 punch from 0x1b3aaed to 0x1b4984f, (0xed62 bytes) 2024-09-21T15:08:39.213 INFO:teuthology.orchestra.run.smithi161.stdout:3011 write 0xa39f92d thru 0xa3ad8b0 (0xdf84 bytes) 2024-09-21T15:08:39.238 INFO:teuthology.orchestra.run.smithi161.stdout:3012 write 0x391fb2a thru 0x39238d8 (0x3daf bytes) 2024-09-21T15:08:39.255 INFO:teuthology.orchestra.run.smithi161.stdout:2589 write 0xba3a991 thru 0xba3fe7e (0x54ee bytes) 2024-09-21T15:08:39.264 INFO:teuthology.orchestra.run.smithi161.stdout:3014 read 0x61b76b6 thru 0x61c1389 (0x9cd4 bytes) 2024-09-21T15:08:39.264 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:39.264 INFO:teuthology.orchestra.run.smithi161.stdout:3018 write 0x80c5bdf thru 0x80cc588 (0x69aa bytes) 2024-09-21T15:08:39.267 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:39.267 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:39.267 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:39.267 INFO:teuthology.orchestra.run.smithi161.stdout:2595 writesame 0x8ad65c9 thru 0x8adea4a data_size 0x7(0x8482 bytes) 2024-09-21T15:08:39.281 INFO:teuthology.orchestra.run.smithi161.stdout:2596 read 0x2621b03 thru 0x262b0ac (0x95aa bytes) 2024-09-21T15:08:39.282 INFO:teuthology.orchestra.run.smithi161.stdout:3021 writesame 0xc3fa3e3 thru 0xc3fb5b5 data_size 0x1b(0x11d3 bytes) 2024-09-21T15:08:39.282 INFO:teuthology.orchestra.run.smithi161.stdout:2597 clone 19 order 19 su 32768 sc 12 2024-09-21T15:08:39.290 INFO:teuthology.orchestra.run.smithi161.stdout:3022 read 0x7663bda thru 0x7664764 (0xb8b bytes) 2024-09-21T15:08:39.290 INFO:teuthology.orchestra.run.smithi161.stdout:3023 write 0x28e0aba thru 0x28e9021 (0x8568 bytes) 2024-09-21T15:08:39.302 INFO:teuthology.orchestra.run.smithi161.stdout:3024 punch from 0x64c82be to 0x64d33df, (0xb121 bytes) 2024-09-21T15:08:39.302 INFO:teuthology.orchestra.run.smithi161.stdout:3025 read 0x4eec6c4 thru 0x4eef8ba (0x31f7 bytes) 2024-09-21T15:08:39.302 INFO:teuthology.orchestra.run.smithi161.stdout:3027 write 0x201545f thru 0x201984f (0x43f1 bytes) 2024-09-21T15:08:39.320 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:39.320 INFO:teuthology.orchestra.run.smithi161.stdout:3029 punch from 0x96120b8 to 0x9620ddc, (0xed24 bytes) 2024-09-21T15:08:39.320 INFO:teuthology.orchestra.run.smithi161.stdout:3030 write 0x1f0adc8 thru 0x1f0fe0e (0x5047 bytes) 2024-09-21T15:08:39.336 INFO:teuthology.orchestra.run.smithi161.stdout:3031 trunc from 0xe895a46 to 0xd220011 2024-09-21T15:08:39.376 INFO:teuthology.orchestra.run.smithi161.stdout:2201 write 0xd0429c9 thru 0xd047754 (0x4d8c bytes) 2024-09-21T15:08:39.386 INFO:teuthology.orchestra.run.smithi161.stdout:2202 punch from 0x864612b to 0x8652c0a, (0xcadf bytes) 2024-09-21T15:08:39.386 INFO:teuthology.orchestra.run.smithi161.stdout:2203 write 0x5084bd7 thru 0x50881bd (0x35e7 bytes) 2024-09-21T15:08:39.413 INFO:teuthology.orchestra.run.smithi161.stdout:2204 trunc from 0xd047755 to 0x7663139 2024-09-21T15:08:39.463 INFO:teuthology.orchestra.run.smithi161.stdout:3032 write 0x66b0b63 thru 0x66b9d56 (0x91f4 bytes) 2024-09-21T15:08:39.475 INFO:teuthology.orchestra.run.smithi161.stdout:3034 writesame 0x31c0942 thru 0x31d0220 data_size 0x3(0xf8df bytes) 2024-09-21T15:08:39.484 INFO:teuthology.orchestra.run.smithi161.stdout:2205 write 0x516fc58 thru 0x517f06f (0xf418 bytes) 2024-09-21T15:08:39.514 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #21, image image_cluster1.client.mirror.3-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent22 2024-09-21T15:08:39.525 INFO:teuthology.orchestra.run.smithi161.stdout:2206 write 0x39df1bd thru 0x39e62d2 (0x7116 bytes) 2024-09-21T15:08:39.545 INFO:teuthology.orchestra.run.smithi161.stdout:3035 write 0xbdea1f1 thru 0xbdf2064 (0x7e74 bytes) 2024-09-21T15:08:39.548 INFO:teuthology.orchestra.run.smithi161.stdout:2207 writesame 0x278225a thru 0x2791042 data_size 0xd(0xede9 bytes) 2024-09-21T15:08:39.566 INFO:teuthology.orchestra.run.smithi161.stdout:3036 write 0x58dcfb7 thru 0x58e92f3 (0xc33d bytes) 2024-09-21T15:08:39.571 INFO:teuthology.orchestra.run.smithi161.stdout:2209 trunc from 0x7663139 to 0xabade00 2024-09-21T15:08:39.603 INFO:teuthology.orchestra.run.smithi161.stdout:3037 read 0xb260ac6 thru 0xb268934 (0x7e6f bytes) 2024-09-21T15:08:39.603 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:39.603 INFO:teuthology.orchestra.run.smithi161.stdout:3039 trunc from 0xd220011 to 0xd4bd563 2024-09-21T15:08:39.673 INFO:teuthology.orchestra.run.smithi161.stdout:2210 read 0x1533caf thru 0x153b776 (0x7ac8 bytes) 2024-09-21T15:08:39.674 INFO:teuthology.orchestra.run.smithi161.stdout:2211 punch from 0x760bb73 to 0x7612fa8, (0x7435 bytes) 2024-09-21T15:08:39.674 INFO:teuthology.orchestra.run.smithi161.stdout:2212 writesame 0x312a175 thru 0x312f7f5 data_size 0x2b(0x5681 bytes) 2024-09-21T15:08:39.742 INFO:teuthology.orchestra.run.smithi161.stdout:3042 clone 17 order 24 su 4194304 sc 2 2024-09-21T15:08:39.803 INFO:teuthology.orchestra.run.smithi161.stdout:2213 writesame 0xe1a43a4 thru 0xe1b242b data_size 0x28(0xe088 bytes) 2024-09-21T15:08:39.808 INFO:teuthology.orchestra.run.smithi161.stdout:2214 write 0x2bd17c5 thru 0x2bd9e88 (0x86c4 bytes) 2024-09-21T15:08:39.824 INFO:teuthology.orchestra.run.smithi161.stdout:2215 write 0xac60510 thru 0xac6cf7e (0xca6f bytes) 2024-09-21T15:08:39.850 INFO:teuthology.orchestra.run.smithi161.stdout:2216 read 0x5b991fa thru 0x5ba6e6b (0xdc72 bytes) 2024-09-21T15:08:39.855 INFO:teuthology.orchestra.run.smithi161.stdout:2217 writesame 0xd28b79 thru 0xd30b48 data_size 0x10(0x7fd0 bytes) 2024-09-21T15:08:39.892 INFO:teuthology.orchestra.run.smithi161.stdout:2218 trunc from 0xe1b242c to 0x9194222 2024-09-21T15:08:39.936 INFO:teuthology.orchestra.run.smithi161.stdout:2081 trunc from 0xb1fc2a2 to 0x27b593c 2024-09-21T15:08:40.194 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:40.194 INFO:teuthology.orchestra.run.smithi161.stdout:2083 read 0xc76144 thru 0xc7e4c3 (0x8380 bytes) 2024-09-21T15:08:40.195 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:40.236 INFO:teuthology.orchestra.run.smithi161.stdout:2085 write 0x9d7e067 thru 0x9d8d1db (0xf175 bytes) 2024-09-21T15:08:40.245 INFO:teuthology.orchestra.run.smithi161.stdout:2086 write 0x8ba60c8 thru 0x8bb15cf (0xb508 bytes) 2024-09-21T15:08:40.252 INFO:teuthology.orchestra.run.smithi161.stdout:2087 punch from 0x4596ae5 to 0x459bf46, (0x5461 bytes) 2024-09-21T15:08:40.253 INFO:teuthology.orchestra.run.smithi161.stdout:2090 punch from 0x66bd160 to 0x66caa68, (0xd908 bytes) 2024-09-21T15:08:40.253 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:40.253 INFO:teuthology.orchestra.run.smithi161.stdout:2093 read 0x2045b38 thru 0x2052a09 (0xced2 bytes) 2024-09-21T15:08:40.253 INFO:teuthology.orchestra.run.smithi161.stdout:2096 clone 24 order 20 su 32768 sc 10 2024-09-21T15:08:40.570 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone18 from 0xe457dc0 (overlap 0x9b378d) to 0x8bb1fe 2024-09-21T15:08:40.574 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #14, image image_cluster1.client.mirror.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent15 2024-09-21T15:08:40.575 INFO:teuthology.orchestra.run.smithi161.stdout:2219 write 0xc3feddc thru 0xc401e00 (0x3025 bytes) 2024-09-21T15:08:40.603 INFO:teuthology.orchestra.run.smithi161.stdout:2220 punch from 0x2fb1030 to 0x2fb9b4a, (0x8b1a bytes) 2024-09-21T15:08:40.603 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:40.603 INFO:teuthology.orchestra.run.smithi161.stdout:2224 write 0x7679790 thru 0x76838fe (0xa16f bytes) 2024-09-21T15:08:40.625 INFO:teuthology.orchestra.run.smithi161.stdout:2225 read 0xa132be5 thru 0xa1423a8 (0xf7c4 bytes) 2024-09-21T15:08:40.625 INFO:teuthology.orchestra.run.smithi161.stdout:2228 read 0x68d2a2a thru 0x68d9667 (0x6c3e bytes) 2024-09-21T15:08:40.626 INFO:teuthology.orchestra.run.smithi161.stdout:2229 read 0x227b1cb thru 0x2280f0d (0x5d43 bytes) 2024-09-21T15:08:40.628 INFO:teuthology.orchestra.run.smithi161.stdout:2231 punch from 0x6401058 to 0x6401906, (0x8ae bytes) 2024-09-21T15:08:40.628 INFO:teuthology.orchestra.run.smithi161.stdout:2234 punch from 0x4cd062c to 0x4cd3a9c, (0x3470 bytes) 2024-09-21T15:08:40.628 INFO:teuthology.orchestra.run.smithi161.stdout:2236 writesame 0x1823426 thru 0x1828ecc data_size 0x1(0x5aa7 bytes) 2024-09-21T15:08:40.729 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone23 from 0x9d8d1dc (overlap 0x27b593c) to 0x0 2024-09-21T15:08:40.736 INFO:teuthology.orchestra.run.smithi161.stdout:2239 writesame 0xcdee833 thru 0xcdfc18f data_size 0x1f(0xd95d bytes) 2024-09-21T15:08:40.777 INFO:teuthology.orchestra.run.smithi161.stdout:2240 write 0x26174f7 thru 0x2624cd7 (0xd7e1 bytes) 2024-09-21T15:08:40.795 INFO:teuthology.orchestra.run.smithi161.stdout:2241 writesame 0xa18d2f0 thru 0xa190197 data_size 0x4(0x2ea8 bytes) 2024-09-21T15:08:40.824 INFO:teuthology.orchestra.run.smithi161.stdout:2243 write 0x4c35ae0 thru 0x4c398cc (0x3ded bytes) 2024-09-21T15:08:40.886 INFO:teuthology.orchestra.run.smithi161.stdout:2244 read 0xca8b433 thru 0xca8c34f (0xf1d bytes) 2024-09-21T15:08:40.889 INFO:teuthology.orchestra.run.smithi161.stdout:2245 write 0x59724b3 thru 0x5973b6c (0x16ba bytes) 2024-09-21T15:08:40.901 INFO:teuthology.orchestra.run.smithi161.stdout:2246 flatten 2024-09-21T15:08:40.910 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #17, image image_cluster1.client.mirror.5-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent18 2024-09-21T15:08:40.945 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone16 from 0xd4bd563 (overlap 0x27486d8) to 0x1791db4 2024-09-21T15:08:40.985 INFO:teuthology.orchestra.run.smithi161.stdout:2247 write 0x9e1eb4c thru 0x9e2c04d (0xd502 bytes) 2024-09-21T15:08:41.005 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:41.006 INFO:teuthology.orchestra.run.smithi161.stdout:2252 punch from 0x262b3c1 to 0x2633f17, (0x8b56 bytes) 2024-09-21T15:08:41.006 INFO:teuthology.orchestra.run.smithi161.stdout:2253 writesame 0x5ec8010 thru 0x5ecd90d data_size 0x3(0x58fe bytes) 2024-09-21T15:08:41.042 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:41.042 INFO:teuthology.orchestra.run.smithi161.stdout:2255 read 0x228f09c thru 0x229146c (0x23d1 bytes) 2024-09-21T15:08:41.042 INFO:teuthology.orchestra.run.smithi161.stdout:2598 write 0xe35d347 thru 0xe36643b (0x90f5 bytes) 2024-09-21T15:08:41.043 INFO:teuthology.orchestra.run.smithi161.stdout:2256 write 0xb65cbfc thru 0xb6614de (0x48e3 bytes) 2024-09-21T15:08:41.062 INFO:teuthology.orchestra.run.smithi161.stdout:2257 read 0x92b29cd thru 0x92b66cd (0x3d01 bytes) 2024-09-21T15:08:41.062 INFO:teuthology.orchestra.run.smithi161.stdout:2258 read 0x82ba57b thru 0x82c4817 (0xa29d bytes) 2024-09-21T15:08:41.062 INFO:teuthology.orchestra.run.smithi161.stdout:2259 writesame 0xc348057 thru 0xc348a57 data_size 0x1(0xa01 bytes) 2024-09-21T15:08:41.068 INFO:teuthology.orchestra.run.smithi161.stdout:2261 writesame 0x56fbfc thru 0x5724f0 data_size 0xf(0x28f5 bytes) 2024-09-21T15:08:41.078 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #22, image image_cluster1.client.mirror.3-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent23 2024-09-21T15:08:41.082 INFO:teuthology.orchestra.run.smithi161.stdout:2262 write 0xb4a6e30 thru 0xb4af45c (0x862d bytes) 2024-09-21T15:08:41.092 INFO:teuthology.orchestra.run.smithi161.stdout:2599 read 0xc9afdce thru 0xc9b14c5 (0x16f8 bytes) 2024-09-21T15:08:41.092 INFO:teuthology.orchestra.run.smithi161.stdout:2601 write 0x92e1c9 thru 0x92fb26 (0x195e bytes) 2024-09-21T15:08:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:2263 trunc from 0xcdfc190 to 0x8b29349 2024-09-21T15:08:41.110 INFO:teuthology.orchestra.run.smithi161.stdout:2602 read 0x6d05ff3 thru 0x6d1144a (0xb458 bytes) 2024-09-21T15:08:41.111 INFO:teuthology.orchestra.run.smithi161.stdout:2603 writesame 0x8c41d94 thru 0x8c46b1b data_size 0xc(0x4d88 bytes) 2024-09-21T15:08:41.136 INFO:teuthology.orchestra.run.smithi161.stdout:2750 writesame 0x32eafbe thru 0x32ebee3 data_size 0x7(0xf26 bytes) 2024-09-21T15:08:41.138 INFO:teuthology.orchestra.run.smithi161.stdout:2604 trunc from 0xe457dc0 to 0x852fbad 2024-09-21T15:08:41.147 INFO:teuthology.orchestra.run.smithi161.stdout:2265 punch from 0x432c834 to 0x4337d56, (0xb522 bytes) 2024-09-21T15:08:41.147 INFO:teuthology.orchestra.run.smithi161.stdout:2268 read 0x5e0ce63 thru 0x5e19d30 (0xcece bytes) 2024-09-21T15:08:41.156 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #14, image image_cluster1.client.mirror.1-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent15 2024-09-21T15:08:41.191 INFO:teuthology.orchestra.run.smithi161.stdout:2269 write 0xb879dc6 thru 0xb87c7d9 (0x2a14 bytes) 2024-09-21T15:08:41.195 INFO:teuthology.orchestra.run.smithi161.stdout:2753 trunc from 0x7d44c55 to 0x4950481 2024-09-21T15:08:41.197 INFO:teuthology.orchestra.run.smithi161.stdout:2097 write 0xbca0965 thru 0xbca6e45 (0x64e1 bytes) 2024-09-21T15:08:41.213 INFO:teuthology.orchestra.run.smithi161.stdout:2270 writesame 0xa7dbdf7 thru 0xa7e5929 data_size 0x1(0x9b33 bytes) 2024-09-21T15:08:41.216 INFO:teuthology.orchestra.run.smithi161.stdout:2606 read 0x6766789 thru 0x676cc94 (0x650c bytes) 2024-09-21T15:08:41.217 INFO:teuthology.orchestra.run.smithi161.stdout:2098 read 0x96a3647 thru 0x96b1dac (0xe766 bytes) 2024-09-21T15:08:41.220 INFO:teuthology.orchestra.run.smithi161.stdout:2099 flatten 2024-09-21T15:08:41.228 INFO:teuthology.orchestra.run.smithi161.stdout:2608 trunc from 0x852fbad to 0x250d916 2024-09-21T15:08:41.229 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #15, image image_cluster1.client.mirror.2-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent16 2024-09-21T15:08:41.359 INFO:teuthology.orchestra.run.smithi161.stdout:2271 writesame 0xe5fbb8f thru 0xe6048f2 data_size 0x2(0x8d64 bytes) 2024-09-21T15:08:41.369 INFO:teuthology.orchestra.run.smithi161.stdout:2272 writesame 0xb959d02 thru 0xb95d2fb data_size 0x5e(0x35fa bytes) 2024-09-21T15:08:41.425 INFO:teuthology.orchestra.run.smithi161.stdout:2274 writesame 0x4ff0f18 thru 0x4ff3393 data_size 0x5(0x247c bytes) 2024-09-21T15:08:41.427 INFO:teuthology.orchestra.run.smithi161.stdout:2610 punch from 0x1cb65f to 0x1d7e66, (0xc807 bytes) 2024-09-21T15:08:41.446 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:41.447 INFO:teuthology.orchestra.run.smithi161.stdout:2276 read 0x92195c8 thru 0x921cd7f (0x37b8 bytes) 2024-09-21T15:08:41.449 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:41.449 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:41.449 INFO:teuthology.orchestra.run.smithi161.stdout:2280 clone 21 order 18 su 131072 sc 5 2024-09-21T15:08:41.478 INFO:teuthology.orchestra.run.smithi161.stdout:2754 writesame 0xbfc35e5 thru 0xbfcbd2e data_size 0x1(0x874a bytes) 2024-09-21T15:08:41.489 INFO:teuthology.orchestra.run.smithi161.stdout:2755 write 0x33b119b thru 0x33b326b (0x20d1 bytes) 2024-09-21T15:08:41.517 INFO:teuthology.orchestra.run.smithi161.stdout:2757 read 0x40bff32 thru 0x40cfaa9 (0xfb78 bytes) 2024-09-21T15:08:41.518 INFO:teuthology.orchestra.run.smithi161.stdout:2759 punch from 0x64f2d1d to 0x64fd131, (0xa414 bytes) 2024-09-21T15:08:41.518 INFO:teuthology.orchestra.run.smithi161.stdout:2760 read 0x4884142 thru 0x48930b4 (0xef73 bytes) 2024-09-21T15:08:41.522 INFO:teuthology.orchestra.run.smithi161.stdout:2761 writesame 0x1d1ee85 thru 0x1d2653a data_size 0xf(0x76b6 bytes) 2024-09-21T15:08:41.524 INFO:teuthology.orchestra.run.smithi161.stdout:2612 write 0x3d12fef thru 0x3d16902 (0x3914 bytes) 2024-09-21T15:08:41.544 INFO:teuthology.orchestra.run.smithi161.stdout:2595 writesame 0x48832b5 thru 0x488c69a data_size 0xb(0x93e6 bytes) 2024-09-21T15:08:41.585 INFO:teuthology.orchestra.run.smithi161.stdout:2762 read 0x47e3b1a thru 0x47efc94 (0xc17b bytes) 2024-09-21T15:08:41.586 INFO:teuthology.orchestra.run.smithi161.stdout:2764 punch from 0x21473fd to 0x2155fc2, (0xebc5 bytes) 2024-09-21T15:08:41.586 INFO:teuthology.orchestra.run.smithi161.stdout:2766 read 0x106a153 thru 0x1070d5f (0x6c0d bytes) 2024-09-21T15:08:41.621 INFO:teuthology.orchestra.run.smithi161.stdout:2767 read 0x9a6a7f1 thru 0x9a757e5 (0xaff5 bytes) 2024-09-21T15:08:41.626 INFO:teuthology.orchestra.run.smithi161.stdout:2768 read 0x93a2299 thru 0x93aba8b (0x97f3 bytes) 2024-09-21T15:08:41.627 INFO:teuthology.orchestra.run.smithi161.stdout:2769 read 0x92a8897 thru 0x92b4559 (0xbcc3 bytes) 2024-09-21T15:08:41.628 INFO:teuthology.orchestra.run.smithi161.stdout:2770 punch from 0xb4b8bf7 to 0xb4c6fc8, (0xe3d1 bytes) 2024-09-21T15:08:41.628 INFO:teuthology.orchestra.run.smithi161.stdout:2771 write 0x9fb00d thru 0x9fb63f (0x633 bytes) 2024-09-21T15:08:41.706 INFO:teuthology.orchestra.run.smithi161.stdout:2596 trunc from 0xdbf50d8 to 0xbfd5b8c 2024-09-21T15:08:41.748 INFO:teuthology.orchestra.run.smithi161.stdout:2772 write 0xd5caba1 thru 0xd5d97da (0xec3a bytes) 2024-09-21T15:08:41.761 INFO:teuthology.orchestra.run.smithi161.stdout:2613 write 0xe9d283c thru 0xe9e214f (0xf914 bytes) 2024-09-21T15:08:41.770 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:41.770 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:41.774 INFO:teuthology.orchestra.run.smithi161.stdout:3043 punch from 0xcee459b to 0xceea123, (0x5b88 bytes) 2024-09-21T15:08:41.778 INFO:teuthology.orchestra.run.smithi161.stdout:2775 trunc from 0xd5d97db to 0x89892c8 2024-09-21T15:08:41.788 INFO:teuthology.orchestra.run.smithi161.stdout:2614 punch from 0xdd17e21 to 0xdd222fc, (0xa4db bytes) 2024-09-21T15:08:41.793 INFO:teuthology.orchestra.run.smithi161.stdout:2100 punch from 0x33f98f0 to 0x33fbfb0, (0x26c0 bytes) 2024-09-21T15:08:41.793 INFO:teuthology.orchestra.run.smithi161.stdout:2101 write 0x69c1ad3 thru 0x69cbdc6 (0xa2f4 bytes) 2024-09-21T15:08:41.810 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:41.811 INFO:teuthology.orchestra.run.smithi161.stdout:3045 trunc from 0xd4bd563 to 0xda181b0 2024-09-21T15:08:41.811 INFO:teuthology.orchestra.run.smithi161.stdout:2615 trunc from 0xe9e2150 to 0x86dcd0 2024-09-21T15:08:41.813 INFO:teuthology.orchestra.run.smithi161.stdout:2598 write 0x6288a1a thru 0x62983d4 (0xf9bb bytes) 2024-09-21T15:08:41.820 INFO:teuthology.orchestra.run.smithi161.stdout:2102 write 0x38d06e7 thru 0x38d27bd (0x20d7 bytes) 2024-09-21T15:08:41.822 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:41.821+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cd482b40 handle_clone_image: failed to clone image mirror/10b5658c3140 to image_cluster1.client.mirror.0-clone16 2024-09-21T15:08:41.843 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:41.843 INFO:teuthology.orchestra.run.smithi161.stdout:2104 read 0x4d57d7a thru 0x4d5d1e9 (0x5470 bytes) 2024-09-21T15:08:41.843 INFO:teuthology.orchestra.run.smithi161.stdout:2105 read 0xb17a69b thru 0xb1806c3 (0x6029 bytes) 2024-09-21T15:08:41.843 INFO:teuthology.orchestra.run.smithi161.stdout:2106 punch from 0x9e76757 to 0x9e861be, (0xfa67 bytes) 2024-09-21T15:08:41.863 INFO:teuthology.orchestra.run.smithi161.stdout:2107 trunc from 0xbca6e46 to 0x4cd8a13 2024-09-21T15:08:41.866 INFO:teuthology.orchestra.run.smithi161.stdout:2599 trunc from 0xbfd5b8c to 0x5b4b642 2024-09-21T15:08:41.880 INFO:teuthology.orchestra.run.smithi161.stdout:3046 trunc from 0xda181b0 to 0x7439ee7 2024-09-21T15:08:41.924 INFO:teuthology.orchestra.run.smithi161.stdout:2776 write 0xd3690f9 thru 0xd36b390 (0x2298 bytes) 2024-09-21T15:08:41.944 INFO:teuthology.orchestra.run.smithi161.stdout:2777 read 0x590d99 thru 0x59944a (0x86b2 bytes) 2024-09-21T15:08:41.944 INFO:teuthology.orchestra.run.smithi161.stdout:3047 punch from 0x376752e to 0x376d9f5, (0x64c7 bytes) 2024-09-21T15:08:41.945 INFO:teuthology.orchestra.run.smithi161.stdout:3048 read 0x73924ba thru 0x7397ace (0x5615 bytes) 2024-09-21T15:08:41.945 INFO:teuthology.orchestra.run.smithi161.stdout:2778 writesame 0x6f06e9b thru 0x6f0e5a9 data_size 0x1(0x770f bytes) 2024-09-21T15:08:41.947 INFO:teuthology.orchestra.run.smithi161.stdout:2109 punch from 0x4419f86 to 0x441ee29, (0x4ea3 bytes) 2024-09-21T15:08:41.947 INFO:teuthology.orchestra.run.smithi161.stdout:2113 read 0x34a8b79 thru 0x34b6e81 (0xe309 bytes) 2024-09-21T15:08:41.955 INFO:teuthology.orchestra.run.smithi161.stdout:2616 trunc from 0x86dcd0 to 0xeeef36 2024-09-21T15:08:41.957 INFO:teuthology.orchestra.run.smithi161.stdout:3051 trunc from 0x7439ee7 to 0xd96da9e 2024-09-21T15:08:41.975 INFO:teuthology.orchestra.run.smithi161.stdout:2779 read 0x52a15fa thru 0x52aa85b (0x9262 bytes) 2024-09-21T15:08:41.976 INFO:teuthology.orchestra.run.smithi161.stdout:2780 write 0x239aebc thru 0x23a5f41 (0xb086 bytes) 2024-09-21T15:08:41.986 INFO:teuthology.orchestra.run.smithi161.stdout:2600 read 0xe3bb6f thru 0xe3bcaf (0x141 bytes) 2024-09-21T15:08:41.988 INFO:teuthology.orchestra.run.smithi161.stdout:2781 write 0x31a4860 thru 0x31aec3e (0xa3df bytes) 2024-09-21T15:08:41.990 INFO:teuthology.orchestra.run.smithi161.stdout:2114 write 0x7189029 thru 0x7198fab (0xff83 bytes) 2024-09-21T15:08:41.991 INFO:teuthology.orchestra.run.smithi161.stdout:2617 read 0x822aa1 thru 0x8262c7 (0x3827 bytes) 2024-09-21T15:08:41.992 INFO:teuthology.orchestra.run.smithi161.stdout:2619 read 0x40c52e thru 0x40e33e (0x1e11 bytes) 2024-09-21T15:08:41.997 INFO:teuthology.orchestra.run.smithi161.stdout:2782 clone 17 order 24 su 524288 sc 2 2024-09-21T15:08:42.007 INFO:teuthology.orchestra.run.smithi161.stdout:3052 read 0x3bc281a thru 0x3bccad4 (0xa2bb bytes) 2024-09-21T15:08:42.008 INFO:teuthology.orchestra.run.smithi161.stdout:3053 read 0x896b0ce thru 0x896eb9c (0x3acf bytes) 2024-09-21T15:08:42.021 INFO:teuthology.orchestra.run.smithi161.stdout:2115 trunc from 0x7198fac to 0xdd1224d 2024-09-21T15:08:42.025 INFO:teuthology.orchestra.run.smithi161.stdout:2603 write 0xc65ef2d thru 0xc66af71 (0xc045 bytes) 2024-09-21T15:08:42.025 INFO:teuthology.orchestra.run.smithi161.stdout:3054 trunc from 0xd96da9e to 0x58aef3d 2024-09-21T15:08:42.041 INFO:teuthology.orchestra.run.smithi161.stdout:2623 write 0x9b39f47 thru 0x9b3ca22 (0x2adc bytes) 2024-09-21T15:08:42.049 INFO:teuthology.orchestra.run.smithi161.stdout:2604 punch from 0x2831061 to 0x2835cdc, (0x4c7b bytes) 2024-09-21T15:08:42.049 INFO:teuthology.orchestra.run.smithi161.stdout:2606 writesame 0x3a3efa1 thru 0x3a41aa0 data_size 0x2b(0x2b00 bytes) 2024-09-21T15:08:42.056 INFO:teuthology.orchestra.run.smithi161.stdout:2117 read 0xbea7af8 thru 0xbeb1def (0xa2f8 bytes) 2024-09-21T15:08:42.056 INFO:teuthology.orchestra.run.smithi161.stdout:2118 read 0xc45c85a thru 0xc469ff3 (0xd79a bytes) 2024-09-21T15:08:42.058 INFO:teuthology.orchestra.run.smithi161.stdout:2122 trunc from 0xdd1224d to 0xd2d3d70 2024-09-21T15:08:42.067 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.067 INFO:teuthology.orchestra.run.smithi161.stdout:2625 punch from 0x4e1bf0 to 0x4ede5f, (0xc26f bytes) 2024-09-21T15:08:42.067 INFO:teuthology.orchestra.run.smithi161.stdout:2626 write 0x6dbcaf7 thru 0x6dcb0f6 (0xe600 bytes) 2024-09-21T15:08:42.094 INFO:teuthology.orchestra.run.smithi161.stdout:2627 read 0x37fda4a thru 0x380d753 (0xfd0a bytes) 2024-09-21T15:08:42.095 INFO:teuthology.orchestra.run.smithi161.stdout:3056 punch from 0x30420dd to 0x3044b09, (0x2a2c bytes) 2024-09-21T15:08:42.095 INFO:teuthology.orchestra.run.smithi161.stdout:3057 read 0x2bd0619 thru 0x2bd680b (0x61f3 bytes) 2024-09-21T15:08:42.095 INFO:teuthology.orchestra.run.smithi161.stdout:3058 read 0x444843b thru 0x4455038 (0xcbfe bytes) 2024-09-21T15:08:42.096 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.096 INFO:teuthology.orchestra.run.smithi161.stdout:3060 read 0x3c118c thru 0x3cd6e7 (0xc55c bytes) 2024-09-21T15:08:42.096 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.096 INFO:teuthology.orchestra.run.smithi161.stdout:3063 read 0x589ac1d thru 0x58a7df1 (0xd1d5 bytes) 2024-09-21T15:08:42.097 INFO:teuthology.orchestra.run.smithi161.stdout:3065 punch from 0x57e1497 to 0x57e9948, (0x84b1 bytes) 2024-09-21T15:08:42.097 INFO:teuthology.orchestra.run.smithi161.stdout:3068 read 0x255b682 thru 0x25672f8 (0xbc77 bytes) 2024-09-21T15:08:42.098 INFO:teuthology.orchestra.run.smithi161.stdout:3070 read 0x33669b thru 0x34648f (0xfdf5 bytes) 2024-09-21T15:08:42.111 INFO:teuthology.orchestra.run.smithi161.stdout:3071 read 0xe30845 thru 0xe36bae (0x636a bytes) 2024-09-21T15:08:42.112 INFO:teuthology.orchestra.run.smithi161.stdout:3072 punch from 0x1361506 to 0x1364582, (0x307c bytes) 2024-09-21T15:08:42.112 INFO:teuthology.orchestra.run.smithi161.stdout:3073 writesame 0x9094fe thru 0x90e6a3 data_size 0x7(0x51a6 bytes) 2024-09-21T15:08:42.113 INFO:teuthology.orchestra.run.smithi161.stdout:2123 read 0x7ac05f thru 0x7b11fb (0x519d bytes) 2024-09-21T15:08:42.114 INFO:teuthology.orchestra.run.smithi161.stdout:2124 punch from 0x2402671 to 0x240e68f, (0xc01e bytes) 2024-09-21T15:08:42.114 INFO:teuthology.orchestra.run.smithi161.stdout:2125 writesame 0x3f221f thru 0x3f54f1 data_size 0x1(0x32d3 bytes) 2024-09-21T15:08:42.144 INFO:teuthology.orchestra.run.smithi161.stdout:2127 read 0x34ea8e3 thru 0x34eeb1a (0x4238 bytes) 2024-09-21T15:08:42.144 INFO:teuthology.orchestra.run.smithi161.stdout:2128 read 0x1de658d thru 0x1df16b3 (0xb127 bytes) 2024-09-21T15:08:42.145 INFO:teuthology.orchestra.run.smithi161.stdout:2129 punch from 0x4f0ccd8 to 0x4f161a7, (0x94cf bytes) 2024-09-21T15:08:42.145 INFO:teuthology.orchestra.run.smithi161.stdout:2132 punch from 0x9f58b6c to 0x9f66872, (0xdd06 bytes) 2024-09-21T15:08:42.145 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.145 INFO:teuthology.orchestra.run.smithi161.stdout:2134 writesame 0x80ec352 thru 0x80ee2bc data_size 0x7(0x1f6b bytes) 2024-09-21T15:08:42.180 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #19, image image_cluster1.client.mirror.4-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent20 2024-09-21T15:08:42.204 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.204 INFO:teuthology.orchestra.run.smithi161.stdout:2136 punch from 0x6f7cde8 to 0x6f825ff, (0x5817 bytes) 2024-09-21T15:08:42.204 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.204 INFO:teuthology.orchestra.run.smithi161.stdout:2138 read 0x673f1c6 thru 0x6740e38 (0x1c73 bytes) 2024-09-21T15:08:42.204 INFO:teuthology.orchestra.run.smithi161.stdout:2139 write 0x3ec71ac thru 0x3ecc5cd (0x5422 bytes) 2024-09-21T15:08:42.232 INFO:teuthology.orchestra.run.smithi161.stdout:2282 read 0x3e9b386 thru 0x3ea6995 (0xb610 bytes) 2024-09-21T15:08:42.243 INFO:teuthology.orchestra.run.smithi161.stdout:2141 punch from 0xb9e8831 to 0xb9ee236, (0x5a05 bytes) 2024-09-21T15:08:42.243 INFO:teuthology.orchestra.run.smithi161.stdout:2142 read 0xac25e82 thru 0xac2719d (0x131c bytes) 2024-09-21T15:08:42.243 INFO:teuthology.orchestra.run.smithi161.stdout:2144 read 0x827c017 thru 0x82846c8 (0x86b2 bytes) 2024-09-21T15:08:42.243 INFO:teuthology.orchestra.run.smithi161.stdout:2145 write 0x97a8b17 thru 0x97ab468 (0x2952 bytes) 2024-09-21T15:08:42.248 INFO:teuthology.orchestra.run.smithi161.stdout:3074 trunc from 0x58aef3d to 0x7f0d7bd 2024-09-21T15:08:42.257 INFO:teuthology.orchestra.run.smithi161.stdout:2147 read 0x281ff47 thru 0x282c2db (0xc395 bytes) 2024-09-21T15:08:42.257 INFO:teuthology.orchestra.run.smithi161.stdout:2148 write 0x1ad03d4 thru 0x1adbdf4 (0xba21 bytes) 2024-09-21T15:08:42.262 INFO:teuthology.orchestra.run.smithi161.stdout:2283 trunc from 0xe6048f3 to 0xaeab6cf 2024-09-21T15:08:42.301 INFO:teuthology.orchestra.run.smithi161.stdout:2284 read 0x98f6436 thru 0x98f95fc (0x31c7 bytes) 2024-09-21T15:08:42.302 INFO:teuthology.orchestra.run.smithi161.stdout:2286 punch from 0x2c6c8ac to 0x2c6f6f4, (0x2e48 bytes) 2024-09-21T15:08:42.302 INFO:teuthology.orchestra.run.smithi161.stdout:3075 trunc from 0x7f0d7bd to 0x22d9d11 2024-09-21T15:08:42.303 INFO:teuthology.orchestra.run.smithi161.stdout:2287 read 0x2f614d thru 0x3034dd (0xd391 bytes) 2024-09-21T15:08:42.303 INFO:teuthology.orchestra.run.smithi161.stdout:2288 read 0x5c260e9 thru 0x5c30cbf (0xabd7 bytes) 2024-09-21T15:08:42.304 INFO:teuthology.orchestra.run.smithi161.stdout:2151 trunc from 0xd2d3d70 to 0x67ab51e 2024-09-21T15:08:42.305 INFO:teuthology.orchestra.run.smithi161.stdout:2289 read 0x9e433eb thru 0x9e46b5a (0x3770 bytes) 2024-09-21T15:08:42.305 INFO:teuthology.orchestra.run.smithi161.stdout:2291 punch from 0x3b76449 to 0x3b7d9ae, (0x7565 bytes) 2024-09-21T15:08:42.305 INFO:teuthology.orchestra.run.smithi161.stdout:2292 read 0x1774a28 thru 0x1779338 (0x4911 bytes) 2024-09-21T15:08:42.306 INFO:teuthology.orchestra.run.smithi161.stdout:2293 trunc from 0xaeab6cf to 0xb59c9b9 2024-09-21T15:08:42.344 INFO:teuthology.orchestra.run.smithi161.stdout:2295 trunc from 0xb59c9b9 to 0xe3f86de 2024-09-21T15:08:42.358 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.364 INFO:teuthology.orchestra.run.smithi161.stdout:2296 read 0xde8577b thru 0xde8a964 (0x51ea bytes) 2024-09-21T15:08:42.365 INFO:teuthology.orchestra.run.smithi161.stdout:2297 trunc from 0xe3f86de to 0xe554847 2024-09-21T15:08:42.379 INFO:teuthology.orchestra.run.smithi161.stdout:3078 trunc from 0x22d9d11 to 0xce45c9a 2024-09-21T15:08:42.389 INFO:teuthology.orchestra.run.smithi161.stdout:2299 write 0x6706e9c thru 0x670c966 (0x5acb bytes) 2024-09-21T15:08:42.403 INFO:teuthology.orchestra.run.smithi161.stdout:2152 punch from 0x2573ee2 to 0x25835fe, (0xf71c bytes) 2024-09-21T15:08:42.403 INFO:teuthology.orchestra.run.smithi161.stdout:2153 write 0x2d11318 thru 0x2d19cce (0x89b7 bytes) 2024-09-21T15:08:42.406 INFO:teuthology.orchestra.run.smithi161.stdout:3080 trunc from 0xce45c9a to 0xcfcffad 2024-09-21T15:08:42.407 INFO:teuthology.orchestra.run.smithi161.stdout:2300 writesame 0xb136e6e thru 0xb137354 data_size 0x5(0x4e7 bytes) 2024-09-21T15:08:42.421 INFO:teuthology.orchestra.run.smithi161.stdout:2301 write 0x71c4b71 thru 0x71c75e0 (0x2a70 bytes) 2024-09-21T15:08:42.458 INFO:teuthology.orchestra.run.smithi161.stdout:3081 writesame 0xdaecf27 thru 0xdaf29e3 data_size 0x1d(0x5abd bytes) 2024-09-21T15:08:42.461 INFO:teuthology.orchestra.run.smithi161.stdout:3083 punch from 0xbbb2fb5 to 0xbbb3339, (0x384 bytes) 2024-09-21T15:08:42.462 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.462 INFO:teuthology.orchestra.run.smithi161.stdout:3086 write 0x1ba2504 thru 0x1ba4f0e (0x2a0b bytes) 2024-09-21T15:08:42.477 INFO:teuthology.orchestra.run.smithi161.stdout:2154 trunc from 0x67ab51e to 0x7865068 2024-09-21T15:08:42.484 INFO:teuthology.orchestra.run.smithi161.stdout:3087 trunc from 0xdaf29e4 to 0x54e501a 2024-09-21T15:08:42.489 INFO:teuthology.orchestra.run.smithi161.stdout:2303 write 0x940759f thru 0x940f58d (0x7fef bytes) 2024-09-21T15:08:42.516 INFO:teuthology.orchestra.run.smithi161.stdout:2304 write 0x37f6a45 thru 0x3802e01 (0xc3bd bytes) 2024-09-21T15:08:42.524 INFO:teuthology.orchestra.run.smithi161.stdout:3088 punch from 0x2ef547f to 0x2efca9c, (0x761d bytes) 2024-09-21T15:08:42.524 INFO:teuthology.orchestra.run.smithi161.stdout:3090 punch from 0x2ec8132 to 0x2ec9b3f, (0x1a0d bytes) 2024-09-21T15:08:42.524 INFO:teuthology.orchestra.run.smithi161.stdout:3091 read 0x1467503 thru 0x14676bb (0x1b9 bytes) 2024-09-21T15:08:42.569 INFO:teuthology.orchestra.run.smithi161.stdout:3092 writesame 0xc6816b0 thru 0xc689ae5 data_size 0x3(0x8436 bytes) 2024-09-21T15:08:42.571 INFO:teuthology.orchestra.run.smithi161.stdout:3094 write 0x8305ddb thru 0x83068c2 (0xae8 bytes) 2024-09-21T15:08:42.574 INFO:teuthology.orchestra.run.smithi161.stdout:2155 clone 25 order 22 su 131072 sc 14 2024-09-21T15:08:42.576 INFO:teuthology.orchestra.run.smithi161.stdout:2630 write 0xe305bdf thru 0xe312049 (0xc46b bytes) 2024-09-21T15:08:42.596 INFO:teuthology.orchestra.run.smithi161.stdout:3095 write 0x2143cf1 thru 0x21463e6 (0x26f6 bytes) 2024-09-21T15:08:42.605 INFO:teuthology.orchestra.run.smithi161.stdout:2631 punch from 0x447be3c to 0x447eb2d, (0x2cf1 bytes) 2024-09-21T15:08:42.609 INFO:teuthology.orchestra.run.smithi161.stdout:3096 write 0x73b3d6d thru 0x73c08f2 (0xcb86 bytes) 2024-09-21T15:08:42.614 INFO:teuthology.orchestra.run.smithi161.stdout:2305 trunc from 0xe554847 to 0x13a38f 2024-09-21T15:08:42.624 INFO:teuthology.orchestra.run.smithi161.stdout:3097 read 0x4ce131a thru 0x4ce815c (0x6e43 bytes) 2024-09-21T15:08:42.624 INFO:teuthology.orchestra.run.smithi161.stdout:3098 writesame 0x63588b9 thru 0x6363dfa data_size 0x1(0xb542 bytes) 2024-09-21T15:08:42.644 INFO:teuthology.orchestra.run.smithi161.stdout:2632 writesame 0xe88d06a thru 0xe89a540 data_size 0x17(0xd4d7 bytes) 2024-09-21T15:08:42.647 INFO:teuthology.orchestra.run.smithi161.stdout:2633 punch from 0x7148a2c to 0x714cbd8, (0x41ac bytes) 2024-09-21T15:08:42.647 INFO:teuthology.orchestra.run.smithi161.stdout:2634 read 0x2ea0b7c thru 0x2eaca58 (0xbedd bytes) 2024-09-21T15:08:42.647 INFO:teuthology.orchestra.run.smithi161.stdout:2636 write 0xd015e16 thru 0xd019127 (0x3312 bytes) 2024-09-21T15:08:42.663 INFO:teuthology.orchestra.run.smithi161.stdout:2637 write 0x81cf576 thru 0x81dc758 (0xd1e3 bytes) 2024-09-21T15:08:42.665 INFO:teuthology.orchestra.run.smithi161.stdout:3101 read 0x9b9a4a5 thru 0x9b9a8e5 (0x441 bytes) 2024-09-21T15:08:42.666 INFO:teuthology.orchestra.run.smithi161.stdout:3102 write 0x88fb532 thru 0x88fea83 (0x3552 bytes) 2024-09-21T15:08:42.678 INFO:teuthology.orchestra.run.smithi161.stdout:3103 read 0xa53151b thru 0xa53b1a1 (0x9c87 bytes) 2024-09-21T15:08:42.678 INFO:teuthology.orchestra.run.smithi161.stdout:3105 write 0x8d69e94 thru 0x8d74558 (0xa6c5 bytes) 2024-09-21T15:08:42.689 INFO:teuthology.orchestra.run.smithi161.stdout:2638 trunc from 0xe89a541 to 0xceb5068 2024-09-21T15:08:42.702 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.713 INFO:teuthology.orchestra.run.smithi161.stdout:2309 trunc from 0x13a38f to 0x6119b30 2024-09-21T15:08:42.729 INFO:teuthology.orchestra.run.smithi161.stdout:2607 trunc from 0xc66af72 to 0x28d22c9 2024-09-21T15:08:42.736 INFO:teuthology.orchestra.run.smithi161.stdout:3106 writesame 0xc72743b thru 0xc7360a0 data_size 0x1(0xec66 bytes) 2024-09-21T15:08:42.745 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.745 INFO:teuthology.orchestra.run.smithi161.stdout:3108 write 0xa7d50f thru 0xa86628 (0x911a bytes) 2024-09-21T15:08:42.749 INFO:teuthology.orchestra.run.smithi161.stdout:2639 punch from 0x5af3c45 to 0x5af657f, (0x293a bytes) 2024-09-21T15:08:42.749 INFO:teuthology.orchestra.run.smithi161.stdout:2640 write 0x8d0abaf thru 0x8d16b6b (0xbfbd bytes) 2024-09-21T15:08:42.755 INFO:teuthology.orchestra.run.smithi161.stdout:2310 read 0x24f6582 thru 0x2505fe6 (0xfa65 bytes) 2024-09-21T15:08:42.755 INFO:teuthology.orchestra.run.smithi161.stdout:2312 writesame 0xc43b60 thru 0xc460a0 data_size 0x21(0x2541 bytes) 2024-09-21T15:08:42.766 INFO:teuthology.orchestra.run.smithi161.stdout:2641 read 0xb84f253 thru 0xb8508cd (0x167b bytes) 2024-09-21T15:08:42.768 INFO:teuthology.orchestra.run.smithi161.stdout:2643 trunc from 0xceb5068 to 0xc676d29 2024-09-21T15:08:42.770 INFO:teuthology.orchestra.run.smithi161.stdout:2313 punch from 0x5464672 to 0x546663f, (0x1fcd bytes) 2024-09-21T15:08:42.770 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.771 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.771 INFO:teuthology.orchestra.run.smithi161.stdout:2316 read 0x292d9e4 thru 0x2932123 (0x4740 bytes) 2024-09-21T15:08:42.771 INFO:teuthology.orchestra.run.smithi161.stdout:2318 read 0x4489e0a thru 0x4494e25 (0xb01c bytes) 2024-09-21T15:08:42.771 INFO:teuthology.orchestra.run.smithi161.stdout:2319 punch from 0x446218 to 0x450e49, (0xac31 bytes) 2024-09-21T15:08:42.776 INFO:teuthology.orchestra.run.smithi161.stdout:3109 trunc from 0xc7360a1 to 0x36eae81 2024-09-21T15:08:42.819 INFO:teuthology.orchestra.run.smithi161.stdout:2320 writesame 0x6cebc25 thru 0x6cf8210 data_size 0x6a(0xc5ec bytes) 2024-09-21T15:08:42.824 INFO:teuthology.orchestra.run.smithi161.stdout:2322 read 0x23971ac thru 0x239b437 (0x428c bytes) 2024-09-21T15:08:42.824 INFO:teuthology.orchestra.run.smithi161.stdout:2323 write 0x589ea05 thru 0x58a8778 (0x9d74 bytes) 2024-09-21T15:08:42.825 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone16 from 0xd36b391 (overlap 0x4950481) to 0x2bfcf80 2024-09-21T15:08:42.846 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.846 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.846 INFO:teuthology.orchestra.run.smithi161.stdout:2327 read 0x1043f8b thru 0x1051834 (0xd8aa bytes) 2024-09-21T15:08:42.846 INFO:teuthology.orchestra.run.smithi161.stdout:2328 read 0x2e079fb thru 0x2e16027 (0xe62d bytes) 2024-09-21T15:08:42.850 INFO:teuthology.orchestra.run.smithi161.stdout:3110 trunc from 0x36eae81 to 0x131a3b 2024-09-21T15:08:42.890 INFO:teuthology.orchestra.run.smithi161.stdout:2331 write 0x8c068f2 thru 0x8c15f7d (0xf68c bytes) 2024-09-21T15:08:42.906 INFO:teuthology.orchestra.run.smithi161.stdout:2332 write 0x638f652 thru 0x639670c (0x70bb bytes) 2024-09-21T15:08:42.923 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:42.923 INFO:teuthology.orchestra.run.smithi161.stdout:2334 write 0x52f4661 thru 0x52fc190 (0x7b30 bytes) 2024-09-21T15:08:42.941 INFO:teuthology.orchestra.run.smithi161.stdout:2335 trunc from 0x8c15f7e to 0x6aabc0d 2024-09-21T15:08:42.961 INFO:teuthology.orchestra.run.smithi161.stdout:3111 write 0xbb52007 thru 0xbb5e30f (0xc309 bytes) 2024-09-21T15:08:42.985 INFO:teuthology.orchestra.run.smithi161.stdout:3114 write 0x34ee89 thru 0x350c5e (0x1dd6 bytes) 2024-09-21T15:08:43.001 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:43.015 INFO:teuthology.orchestra.run.smithi161.stdout:3117 trunc from 0xbb5e310 to 0x4010df6 2024-09-21T15:08:43.021 INFO:teuthology.orchestra.run.smithi161.stdout:2336 write 0xc1f5c1d thru 0xc1f6863 (0xc47 bytes) 2024-09-21T15:08:43.030 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:43.030 INFO:teuthology.orchestra.run.smithi161.stdout:2338 punch from 0xb9812fb to 0xb98c6f8, (0xb3fd bytes) 2024-09-21T15:08:43.030 INFO:teuthology.orchestra.run.smithi161.stdout:2339 punch from 0xbeca06d to 0xbed9c75, (0xfc08 bytes) 2024-09-21T15:08:43.030 INFO:teuthology.orchestra.run.smithi161.stdout:2340 write 0xab18bbd thru 0xab27a8d (0xeed1 bytes) 2024-09-21T15:08:43.047 INFO:teuthology.orchestra.run.smithi161.stdout:2341 trunc from 0xc1f6864 to 0xc90c3ec 2024-09-21T15:08:43.067 INFO:teuthology.orchestra.run.smithi161.stdout:3119 trunc from 0x4010df6 to 0x9bf5ae8 2024-09-21T15:08:43.083 INFO:teuthology.orchestra.run.smithi161.stdout:2645 writesame 0x7cadaae thru 0x7cb50bc data_size 0x1(0x760f bytes) 2024-09-21T15:08:43.091 INFO:teuthology.orchestra.run.smithi161.stdout:2342 writesame 0xbf1b0b5 thru 0xbf1c097 data_size 0x7(0xfe3 bytes) 2024-09-21T15:08:43.106 INFO:teuthology.orchestra.run.smithi161.stdout:3120 read 0x1ea43b3 thru 0x1eb3243 (0xee91 bytes) 2024-09-21T15:08:43.113 INFO:teuthology.orchestra.run.smithi161.stdout:2344 writesame 0x86b71fe thru 0x86badc8 data_size 0x1(0x3bcb bytes) 2024-09-21T15:08:43.124 INFO:teuthology.orchestra.run.smithi161.stdout:2646 trunc from 0xc676d29 to 0x6351de5 2024-09-21T15:08:43.136 INFO:teuthology.orchestra.run.smithi161.stdout:2345 read 0x92b775a thru 0x92c0622 (0x8ec9 bytes) 2024-09-21T15:08:43.137 INFO:teuthology.orchestra.run.smithi161.stdout:2346 write 0x1105163 thru 0x1106e5e (0x1cfc bytes) 2024-09-21T15:08:43.142 INFO:teuthology.orchestra.run.smithi161.stdout:3121 write 0xcee17db thru 0xcee8d82 (0x75a8 bytes) 2024-09-21T15:08:43.145 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #15, image image_cluster1.client.mirror.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent16 2024-09-21T15:08:43.148 INFO:teuthology.orchestra.run.smithi161.stdout:2349 write 0xc81ee97 thru 0xc82eaf6 (0xfc60 bytes) 2024-09-21T15:08:43.156 INFO:teuthology.orchestra.run.smithi161.stdout:3122 punch from 0xd142d6 to 0xd237b8, (0xf4e2 bytes) 2024-09-21T15:08:43.157 INFO:teuthology.orchestra.run.smithi161.stdout:3123 write 0x141d7d3 thru 0x1427c27 (0xa455 bytes) 2024-09-21T15:08:43.171 INFO:teuthology.orchestra.run.smithi161.stdout:2350 write 0x891845f thru 0x8925c35 (0xd7d7 bytes) 2024-09-21T15:08:43.178 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:43.178 INFO:teuthology.orchestra.run.smithi161.stdout:3127 write 0x9ea95c4 thru 0x9eaff72 (0x69af bytes) 2024-09-21T15:08:43.220 INFO:teuthology.orchestra.run.smithi161.stdout:3128 write 0xd5822c6 thru 0xd58365a (0x1395 bytes) 2024-09-21T15:08:43.259 INFO:teuthology.orchestra.run.smithi161.stdout:3129 write 0xe003d8f thru 0xe00dd17 (0x9f89 bytes) 2024-09-21T15:08:43.273 INFO:teuthology.orchestra.run.smithi161.stdout:3131 read 0xdb8a147 thru 0xdb8c880 (0x273a bytes) 2024-09-21T15:08:43.273 INFO:teuthology.orchestra.run.smithi161.stdout:3133 write 0x37c437a thru 0x37c8102 (0x3d89 bytes) 2024-09-21T15:08:43.283 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:43.283 INFO:teuthology.orchestra.run.smithi161.stdout:3135 write 0x297779b thru 0x2983589 (0xbdef bytes) 2024-09-21T15:08:43.294 INFO:teuthology.orchestra.run.smithi161.stdout:3136 write 0x73077c3 thru 0x7308359 (0xb97 bytes) 2024-09-21T15:08:43.302 INFO:teuthology.orchestra.run.smithi161.stdout:3137 read 0x2ad7bce thru 0x2ad9579 (0x19ac bytes) 2024-09-21T15:08:43.337 INFO:teuthology.orchestra.run.smithi161.stdout:3138 write 0xeda6b39 thru 0xeda9831 (0x2cf9 bytes) 2024-09-21T15:08:43.349 INFO:teuthology.orchestra.run.smithi161.stdout:3140 write 0x536567e thru 0x536e9ca (0x934d bytes) 2024-09-21T15:08:43.375 INFO:teuthology.orchestra.run.smithi161.stdout:3141 read 0x596ba5d thru 0x5977a5b (0xbfff bytes) 2024-09-21T15:08:43.376 INFO:teuthology.orchestra.run.smithi161.stdout:3145 writesame 0xc716310 thru 0xc7182c1 data_size 0x1(0x1fb2 bytes) 2024-09-21T15:08:43.379 INFO:teuthology.orchestra.run.smithi161.stdout:2351 writesame 0x959df97 thru 0x95a881b data_size 0x1(0xa885 bytes) 2024-09-21T15:08:43.387 INFO:teuthology.orchestra.run.smithi161.stdout:3146 read 0x4f39398 thru 0x4f3d311 (0x3f7a bytes) 2024-09-21T15:08:43.387 INFO:teuthology.orchestra.run.smithi161.stdout:3148 write 0x4c81e0d thru 0x4c88f0b (0x70ff bytes) 2024-09-21T15:08:43.413 INFO:teuthology.orchestra.run.smithi161.stdout:3149 read 0xe448a57 thru 0xe44b2ce (0x2878 bytes) 2024-09-21T15:08:43.414 INFO:teuthology.orchestra.run.smithi161.stdout:3150 read 0x42e3b11 thru 0x42f2f9a (0xf48a bytes) 2024-09-21T15:08:43.415 INFO:teuthology.orchestra.run.smithi161.stdout:3152 write 0xe9b08aa thru 0xe9b234c (0x1aa3 bytes) 2024-09-21T15:08:43.423 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:43.423 INFO:teuthology.orchestra.run.smithi161.stdout:3154 read 0x7b19e28 thru 0x7b1cd9e (0x2f77 bytes) 2024-09-21T15:08:43.424 INFO:teuthology.orchestra.run.smithi161.stdout:2352 read 0xb865158 thru 0xb87045d (0xb306 bytes) 2024-09-21T15:08:43.424 INFO:teuthology.orchestra.run.smithi161.stdout:3155 write 0x2da549e thru 0x2db2db2 (0xd915 bytes) 2024-09-21T15:08:43.424 INFO:teuthology.orchestra.run.smithi161.stdout:2353 writesame 0x21a0227 thru 0x21a95aa data_size 0x12(0x9384 bytes) 2024-09-21T15:08:43.435 INFO:teuthology.orchestra.run.smithi161.stdout:3156 read 0x1f3d8d7 thru 0x1f47694 (0x9dbe bytes) 2024-09-21T15:08:43.436 INFO:teuthology.orchestra.run.smithi161.stdout:3157 punch from 0xe7f437e to 0xe7f5d34, (0x19b6 bytes) 2024-09-21T15:08:43.436 INFO:teuthology.orchestra.run.smithi161.stdout:3158 writesame 0x23a5ae4 thru 0x23af707 data_size 0x6(0x9c24 bytes) 2024-09-21T15:08:43.437 INFO:teuthology.orchestra.run.smithi161.stdout:2354 write 0x7937a4f thru 0x7944423 (0xc9d5 bytes) 2024-09-21T15:08:43.446 INFO:teuthology.orchestra.run.smithi161.stdout:3160 punch from 0x1edf179 to 0x1eeacec, (0xbb73 bytes) 2024-09-21T15:08:43.446 INFO:teuthology.orchestra.run.smithi161.stdout:3161 writesame 0x877563f thru 0x877c70d data_size 0x1(0x70cf bytes) 2024-09-21T15:08:43.451 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:43.451 INFO:teuthology.orchestra.run.smithi161.stdout:2356 read 0x9ed6471 thru 0x9ee3c64 (0xd7f4 bytes) 2024-09-21T15:08:43.475 INFO:teuthology.orchestra.run.smithi161.stdout:3162 punch from 0x17682f7 to 0x1769b58, (0x1861 bytes) 2024-09-21T15:08:43.497 INFO:teuthology.orchestra.run.smithi161.stdout:3163 trunc from 0xeda9832 to 0x57f2ddb 2024-09-21T15:08:43.506 INFO:teuthology.orchestra.run.smithi161.stdout:2357 write 0xd9e5483 thru 0xd9f0db6 (0xb934 bytes) 2024-09-21T15:08:43.558 INFO:teuthology.orchestra.run.smithi161.stdout:3165 trunc from 0x57f2ddb to 0x47746e1 2024-09-21T15:08:43.593 INFO:teuthology.orchestra.run.smithi161.stdout:3166 read 0x2ea4f53 thru 0x2ea608c (0x113a bytes) 2024-09-21T15:08:43.594 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:43.599 INFO:teuthology.orchestra.run.smithi161.stdout:3168 trunc from 0x47746e1 to 0x6258fd1 2024-09-21T15:08:43.636 INFO:teuthology.orchestra.run.smithi161.stdout:3169 punch from 0x428d888 to 0x42902b9, (0x2a31 bytes) 2024-09-21T15:08:43.636 INFO:teuthology.orchestra.run.smithi161.stdout:3170 write 0x2c01e24 thru 0x2c063c8 (0x45a5 bytes) 2024-09-21T15:08:43.646 INFO:teuthology.orchestra.run.smithi161.stdout:3171 writesame 0x4d76c82 thru 0x4d83b7b data_size 0x3(0xcefa bytes) 2024-09-21T15:08:43.666 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:43.754 INFO:teuthology.orchestra.run.smithi161.stdout:3173 writesame 0x666e968 thru 0x6674def data_size 0x4(0x6488 bytes) 2024-09-21T15:08:43.758 INFO:teuthology.orchestra.run.smithi161.stdout:3174 read 0x6343f28 thru 0x634eca7 (0xad80 bytes) 2024-09-21T15:08:43.760 INFO:teuthology.orchestra.run.smithi161.stdout:3175 trunc from 0x6674df0 to 0x5d764ba 2024-09-21T15:08:43.799 INFO:teuthology.orchestra.run.smithi161.stdout:2358 trunc from 0xd9f0db7 to 0x280da7a 2024-09-21T15:08:43.909 INFO:teuthology.orchestra.run.smithi161.stdout:3176 write 0x6cb364 thru 0x6ceb98 (0x3835 bytes) 2024-09-21T15:08:43.932 INFO:teuthology.orchestra.run.smithi161.stdout:2647 write 0xedc3a57 thru 0xedc7ab8 (0x4062 bytes) 2024-09-21T15:08:43.945 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:43.945 INFO:teuthology.orchestra.run.smithi161.stdout:2650 write 0x50de6d6 thru 0x50df1a5 (0xad0 bytes) 2024-09-21T15:08:43.964 INFO:teuthology.orchestra.run.smithi161.stdout:3177 write 0xd41b57f thru 0xd424423 (0x8ea5 bytes) 2024-09-21T15:08:43.981 INFO:teuthology.orchestra.run.smithi161.stdout:3179 read 0x4640d18 thru 0x464da4c (0xcd35 bytes) 2024-09-21T15:08:43.982 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:43.982 INFO:teuthology.orchestra.run.smithi161.stdout:3181 write 0x36713f thru 0x36bc1f (0x4ae1 bytes) 2024-09-21T15:08:43.982 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:43.988 INFO:teuthology.orchestra.run.smithi161.stdout:2784 trunc from 0xd36b391 to 0x928e9ff 2024-09-21T15:08:43.989 INFO:teuthology.orchestra.run.smithi161.stdout:3183 trunc from 0xd424424 to 0xd05a2e8 2024-09-21T15:08:44.005 INFO:teuthology.orchestra.run.smithi161.stdout:2651 read 0xc9b21ae thru 0xc9beaf0 (0xc943 bytes) 2024-09-21T15:08:44.005 INFO:teuthology.orchestra.run.smithi161.stdout:2652 read 0x21e873f thru 0x21f28dc (0xa19e bytes) 2024-09-21T15:08:44.017 INFO:teuthology.orchestra.run.smithi161.stdout:2653 trunc from 0xedc7ab9 to 0x916eb11 2024-09-21T15:08:44.022 INFO:teuthology.orchestra.run.smithi161.stdout:3184 punch from 0x354f534 to 0x355ce5e, (0xd92a bytes) 2024-09-21T15:08:44.022 INFO:teuthology.orchestra.run.smithi161.stdout:3185 write 0x1aa6661 thru 0x1aaef08 (0x88a8 bytes) 2024-09-21T15:08:44.035 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:44.038 INFO:teuthology.orchestra.run.smithi161.stdout:3192 trunc from 0xd05a2e8 to 0xb75fe13 2024-09-21T15:08:44.071 INFO:teuthology.orchestra.run.smithi161.stdout:2654 punch from 0x74261b to 0x74e4cf, (0xbeb4 bytes) 2024-09-21T15:08:44.072 INFO:teuthology.orchestra.run.smithi161.stdout:2655 read 0x71e468e thru 0x71f05df (0xbf52 bytes) 2024-09-21T15:08:44.072 INFO:teuthology.orchestra.run.smithi161.stdout:2656 punch from 0x2ef67e to 0x2f618c, (0x6b0e bytes) 2024-09-21T15:08:44.077 INFO:teuthology.orchestra.run.smithi161.stdout:2359 read 0x1e0c70e thru 0x1e0ffbd (0x38b0 bytes) 2024-09-21T15:08:44.078 INFO:teuthology.orchestra.run.smithi161.stdout:2361 write 0x2581f7 thru 0x259596 (0x13a0 bytes) 2024-09-21T15:08:44.078 INFO:teuthology.orchestra.run.smithi161.stdout:3193 write 0xa76995f thru 0xa776a28 (0xd0ca bytes) 2024-09-21T15:08:44.091 INFO:teuthology.orchestra.run.smithi161.stdout:3194 writesame 0x3451ec6 thru 0x34608f6 data_size 0x1(0xea31 bytes) 2024-09-21T15:08:44.107 INFO:teuthology.orchestra.run.smithi161.stdout:2657 write 0xe5961db thru 0xe59f99d (0x97c3 bytes) 2024-09-21T15:08:44.140 INFO:teuthology.orchestra.run.smithi161.stdout:3195 read 0x1fe8082 thru 0x1ff11dd (0x915c bytes) 2024-09-21T15:08:44.140 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:44.140 INFO:teuthology.orchestra.run.smithi161.stdout:3199 read 0x32f8cd8 thru 0x3307097 (0xe3c0 bytes) 2024-09-21T15:08:44.141 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:44.141 INFO:teuthology.orchestra.run.smithi161.stdout:3201 read 0x4ca5a6 thru 0x4d5c7d (0xb6d8 bytes) 2024-09-21T15:08:44.142 INFO:teuthology.orchestra.run.smithi161.stdout:3202 writesame 0x9d4d6c6 thru 0x9d57c51 data_size 0xd(0xa58c bytes) 2024-09-21T15:08:44.158 INFO:teuthology.orchestra.run.smithi161.stdout:3204 write 0x2e1b7c2 thru 0x2e29eb5 (0xe6f4 bytes) 2024-09-21T15:08:44.172 INFO:teuthology.orchestra.run.smithi161.stdout:3205 write 0x3e2834c thru 0x3e30931 (0x85e6 bytes) 2024-09-21T15:08:44.180 INFO:teuthology.orchestra.run.smithi161.stdout:3206 write 0xa1cf00b thru 0xa1da239 (0xb22f bytes) 2024-09-21T15:08:44.180 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:44.194 INFO:teuthology.orchestra.run.smithi161.stdout:3208 writesame 0xa1690bc thru 0xa179003 data_size 0x54(0xff48 bytes) 2024-09-21T15:08:44.207 INFO:teuthology.orchestra.run.smithi161.stdout:2660 trunc from 0xe59f99e to 0x1281ca8 2024-09-21T15:08:44.207 INFO:teuthology.orchestra.run.smithi161.stdout:3209 trunc from 0xb75fe13 to 0x7d70a70 2024-09-21T15:08:44.225 INFO:teuthology.orchestra.run.smithi161.stdout:2785 writesame 0x3534132 thru 0x353f2c8 data_size 0x1(0xb197 bytes) 2024-09-21T15:08:44.292 INFO:teuthology.orchestra.run.smithi161.stdout:2661 read 0xd1129b thru 0xd1df47 (0xccad bytes) 2024-09-21T15:08:44.313 INFO:teuthology.orchestra.run.smithi161.stdout:2786 read 0x6568cb thru 0x663fe0 (0xd716 bytes) 2024-09-21T15:08:44.329 INFO:teuthology.orchestra.run.smithi161.stdout:2788 write 0x189cae9 thru 0x18ab354 (0xe86c bytes) 2024-09-21T15:08:44.332 INFO:teuthology.orchestra.run.smithi161.stdout:2662 writesame 0x945c3bc thru 0x9467698 data_size 0x1(0xb2dd bytes) 2024-09-21T15:08:44.338 INFO:teuthology.orchestra.run.smithi161.stdout:2665 read 0x2e1cbc9 thru 0x2e23853 (0x6c8b bytes) 2024-09-21T15:08:44.338 INFO:teuthology.orchestra.run.smithi161.stdout:2667 read 0x1dd940e thru 0x1de6480 (0xd073 bytes) 2024-09-21T15:08:44.338 INFO:teuthology.orchestra.run.smithi161.stdout:2668 read 0x8a66649 thru 0x8a66b55 (0x50d bytes) 2024-09-21T15:08:44.338 INFO:teuthology.orchestra.run.smithi161.stdout:2669 writesame 0x8df1c04 thru 0x8df4fa9 data_size 0xb(0x33a6 bytes) 2024-09-21T15:08:44.348 INFO:teuthology.orchestra.run.smithi161.stdout:2670 punch from 0x35a11e6 to 0x35ab440, (0xa25a bytes) 2024-09-21T15:08:44.348 INFO:teuthology.orchestra.run.smithi161.stdout:2673 write 0x75933cf thru 0x759a907 (0x7539 bytes) 2024-09-21T15:08:44.418 INFO:teuthology.orchestra.run.smithi161.stdout:2674 write 0x6d5b599 thru 0x6d5fd10 (0x4778 bytes) 2024-09-21T15:08:44.438 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:44.461 INFO:teuthology.orchestra.run.smithi161.stdout:2789 write 0x69a2a3b thru 0x69ac6db (0x9ca1 bytes) 2024-09-21T15:08:44.482 INFO:teuthology.orchestra.run.smithi161.stdout:2676 write 0xd056ad1 thru 0xd061b50 (0xb080 bytes) 2024-09-21T15:08:44.493 INFO:teuthology.orchestra.run.smithi161.stdout:3210 read 0xe7da57 thru 0xe7e90a (0xeb4 bytes) 2024-09-21T15:08:44.493 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:44.494 INFO:teuthology.orchestra.run.smithi161.stdout:3213 write 0x1eb0221 thru 0x1ebac1b (0xa9fb bytes) 2024-09-21T15:08:44.509 INFO:teuthology.orchestra.run.smithi161.stdout:2678 read 0x788b0a6 thru 0x789793f (0xc89a bytes) 2024-09-21T15:08:44.510 INFO:teuthology.orchestra.run.smithi161.stdout:2680 write 0x56333fc thru 0x563f255 (0xbe5a bytes) 2024-09-21T15:08:44.513 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:44.521 INFO:teuthology.orchestra.run.smithi161.stdout:3216 trunc from 0x7d70a70 to 0xc088bb2 2024-09-21T15:08:44.521 INFO:teuthology.orchestra.run.smithi161.stdout:2790 writesame 0x30ccd19 thru 0x30d804d data_size 0x1(0xb335 bytes) 2024-09-21T15:08:44.528 INFO:teuthology.orchestra.run.smithi161.stdout:2681 trunc from 0xd061b51 to 0xb113952 2024-09-21T15:08:44.563 INFO:teuthology.orchestra.run.smithi161.stdout:2365 write 0x61d9791 thru 0x61e75d7 (0xde47 bytes) 2024-09-21T15:08:44.576 INFO:teuthology.orchestra.run.smithi161.stdout:3217 write 0xc8ad02 thru 0xc985c4 (0xd8c3 bytes) 2024-09-21T15:08:44.579 INFO:teuthology.orchestra.run.smithi161.stdout:2682 read 0xa76c5b6 thru 0xa778a90 (0xc4db bytes) 2024-09-21T15:08:44.585 INFO:teuthology.orchestra.run.smithi161.stdout:3218 punch from 0x35ccab9 to 0x35d0f87, (0x44ce bytes) 2024-09-21T15:08:44.585 INFO:teuthology.orchestra.run.smithi161.stdout:3219 read 0x99e1814 thru 0x99e259b (0xd88 bytes) 2024-09-21T15:08:44.585 INFO:teuthology.orchestra.run.smithi161.stdout:3223 read 0xcc1ff8 thru 0xccb288 (0x9291 bytes) 2024-09-21T15:08:44.585 INFO:teuthology.orchestra.run.smithi161.stdout:3224 read 0x9bc0d59 thru 0x9bc8b2e (0x7dd6 bytes) 2024-09-21T15:08:44.586 INFO:teuthology.orchestra.run.smithi161.stdout:3225 punch from 0xb11f376 to 0xb12366b, (0x42f5 bytes) 2024-09-21T15:08:44.586 INFO:teuthology.orchestra.run.smithi161.stdout:3228 punch from 0x8ffb0fc to 0x90097df, (0xe6e3 bytes) 2024-09-21T15:08:44.586 INFO:teuthology.orchestra.run.smithi161.stdout:3229 write 0xb596768 thru 0xb59893e (0x21d7 bytes) 2024-09-21T15:08:44.594 INFO:teuthology.orchestra.run.smithi161.stdout:3233 read 0x56a5c03 thru 0x56a664c (0xa4a bytes) 2024-09-21T15:08:44.595 INFO:teuthology.orchestra.run.smithi161.stdout:2792 punch from 0x75a2a07 to 0x75a35cd, (0xbc6 bytes) 2024-09-21T15:08:44.595 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:44.595 INFO:teuthology.orchestra.run.smithi161.stdout:2794 punch from 0x3bd4d89 to 0x3bd5c83, (0xefa bytes) 2024-09-21T15:08:44.595 INFO:teuthology.orchestra.run.smithi161.stdout:3234 write 0x45b5f89 thru 0x45c3a88 (0xdb00 bytes) 2024-09-21T15:08:44.595 INFO:teuthology.orchestra.run.smithi161.stdout:2795 write 0x243436b thru 0x2436fde (0x2c74 bytes) 2024-09-21T15:08:44.601 INFO:teuthology.orchestra.run.smithi161.stdout:2797 writesame 0x3a70171 thru 0x3a7d8ca data_size 0x25(0xd75a bytes) 2024-09-21T15:08:44.606 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:44.626 INFO:teuthology.orchestra.run.smithi161.stdout:2683 flatten 2024-09-21T15:08:44.686 INFO:teuthology.orchestra.run.smithi161.stdout:2800 write 0x98543ca thru 0x985d953 (0x958a bytes) 2024-09-21T15:08:44.688 INFO:teuthology.orchestra.run.smithi161.stdout:2366 read 0x567ec87 thru 0x5680d2f (0x20a9 bytes) 2024-09-21T15:08:44.689 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:44.689 INFO:teuthology.orchestra.run.smithi161.stdout:2368 write 0x179f5f6 thru 0x17acadb (0xd4e6 bytes) 2024-09-21T15:08:44.702 INFO:teuthology.orchestra.run.smithi161.stdout:3235 writesame 0x9fa221e thru 0x9fae3cd data_size 0x2(0xc1b0 bytes) 2024-09-21T15:08:44.714 INFO:teuthology.orchestra.run.smithi161.stdout:2801 trunc from 0x985d954 to 0x6e77267 2024-09-21T15:08:44.717 INFO:teuthology.orchestra.run.smithi161.stdout:2369 read 0x2442b65 thru 0x2451df5 (0xf291 bytes) 2024-09-21T15:08:44.719 INFO:teuthology.orchestra.run.smithi161.stdout:2370 trunc from 0x61e75d8 to 0x765ec92 2024-09-21T15:08:44.722 INFO:teuthology.orchestra.run.smithi161.stdout:2684 write 0x108eda2 thru 0x109171b (0x297a bytes) 2024-09-21T15:08:44.736 INFO:teuthology.orchestra.run.smithi161.stdout:3236 read 0x8e9d19c thru 0x8ea130d (0x4172 bytes) 2024-09-21T15:08:44.736 INFO:teuthology.orchestra.run.smithi161.stdout:3237 write 0x8f6c1f4 thru 0x8f7a720 (0xe52d bytes) 2024-09-21T15:08:44.752 INFO:teuthology.orchestra.run.smithi161.stdout:2687 write 0x1ec33cb thru 0x1ed28e1 (0xf517 bytes) 2024-09-21T15:08:44.753 INFO:teuthology.orchestra.run.smithi161.stdout:3240 punch from 0x3233abe to 0x3237c9c, (0x41de bytes) 2024-09-21T15:08:44.753 INFO:teuthology.orchestra.run.smithi161.stdout:3242 read 0x204a1e6 thru 0x204a62b (0x446 bytes) 2024-09-21T15:08:44.762 INFO:teuthology.orchestra.run.smithi161.stdout:3243 trunc from 0xc088bb2 to 0x709cfcb 2024-09-21T15:08:44.792 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #23, image image_cluster1.client.mirror.3-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent24 2024-09-21T15:08:44.808 INFO:teuthology.orchestra.run.smithi161.stdout:2690 write 0x3e6bbb thru 0x3edeba (0x7300 bytes) 2024-09-21T15:08:44.814 INFO:teuthology.orchestra.run.smithi161.stdout:2371 write 0x39b2498 thru 0x39b7d79 (0x58e2 bytes) 2024-09-21T15:08:44.826 INFO:teuthology.orchestra.run.smithi161.stdout:2803 write 0x42337ad thru 0x423997a (0x61ce bytes) 2024-09-21T15:08:44.833 INFO:teuthology.orchestra.run.smithi161.stdout:2374 punch from 0x3b8290c to 0x3b88de1, (0x64d5 bytes) 2024-09-21T15:08:44.833 INFO:teuthology.orchestra.run.smithi161.stdout:2375 read 0x537a413 thru 0x537efaa (0x4b98 bytes) 2024-09-21T15:08:44.833 INFO:teuthology.orchestra.run.smithi161.stdout:2378 read 0x6662331 thru 0x666ea01 (0xc6d1 bytes) 2024-09-21T15:08:44.835 INFO:teuthology.orchestra.run.smithi161.stdout:2156 write 0x5a2acb8 thru 0x5a2e509 (0x3852 bytes) 2024-09-21T15:08:44.843 INFO:teuthology.orchestra.run.smithi161.stdout:2379 trunc from 0x765ec92 to 0xbd075da 2024-09-21T15:08:44.850 INFO:teuthology.orchestra.run.smithi161.stdout:2804 writesame 0x32836d7 thru 0x328f13c data_size 0x63(0xba66 bytes) 2024-09-21T15:08:44.862 INFO:teuthology.orchestra.run.smithi161.stdout:3244 writesame 0x75f2f82 thru 0x76026ba data_size 0x1(0xf739 bytes) 2024-09-21T15:08:44.870 INFO:teuthology.orchestra.run.smithi161.stdout:2691 writesame 0xd0aaa14 thru 0xd0ad381 data_size 0x1(0x296e bytes) 2024-09-21T15:08:44.877 INFO:teuthology.orchestra.run.smithi161.stdout:3245 trunc from 0x76026bb to 0x48aac23 2024-09-21T15:08:44.880 INFO:teuthology.orchestra.run.smithi161.stdout:2692 write 0xb3389d9 thru 0xb34692c (0xdf54 bytes) 2024-09-21T15:08:44.888 INFO:teuthology.orchestra.run.smithi161.stdout:2380 punch from 0x24dd0c1 to 0x24ed062, (0xffa1 bytes) 2024-09-21T15:08:44.888 INFO:teuthology.orchestra.run.smithi161.stdout:2157 read 0x15ab8b3 thru 0x15b7b27 (0xc275 bytes) 2024-09-21T15:08:44.901 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:44.902 INFO:teuthology.orchestra.run.smithi161.stdout:2695 write 0x529ab4f thru 0x52a4403 (0x98b5 bytes) 2024-09-21T15:08:44.910 INFO:teuthology.orchestra.run.smithi161.stdout:2805 writesame 0x8dd9502 thru 0x8de24a4 data_size 0x15(0x8fa3 bytes) 2024-09-21T15:08:44.916 INFO:teuthology.orchestra.run.smithi161.stdout:2808 read 0x20d19cb thru 0x20d713a (0x5770 bytes) 2024-09-21T15:08:44.928 INFO:teuthology.orchestra.run.smithi161.stdout:2698 trunc from 0xd0ad382 to 0xd61989c 2024-09-21T15:08:44.931 INFO:teuthology.orchestra.run.smithi161.stdout:3246 read 0x3df3328 thru 0x3dfd101 (0x9dda bytes) 2024-09-21T15:08:44.932 INFO:teuthology.orchestra.run.smithi161.stdout:3249 write 0x162469a thru 0x1627a90 (0x33f7 bytes) 2024-09-21T15:08:44.934 INFO:teuthology.orchestra.run.smithi161.stdout:2381 write 0xcb166f9 thru 0xcb20b04 (0xa40c bytes) 2024-09-21T15:08:44.937 INFO:teuthology.orchestra.run.smithi161.stdout:2158 write 0xaccc784 thru 0xacd1091 (0x490e bytes) 2024-09-21T15:08:44.949 INFO:teuthology.orchestra.run.smithi161.stdout:3251 trunc from 0x48aac23 to 0x275563b 2024-09-21T15:08:44.951 INFO:teuthology.orchestra.run.smithi161.stdout:2382 write 0x31c5e26 thru 0x31c8163 (0x233e bytes) 2024-09-21T15:08:44.952 INFO:teuthology.orchestra.run.smithi161.stdout:2159 punch from 0x94dfaab to 0x94e5ad8, (0x602d bytes) 2024-09-21T15:08:44.952 INFO:teuthology.orchestra.run.smithi161.stdout:2160 read 0x3602477 thru 0x360a511 (0x809b bytes) 2024-09-21T15:08:44.953 INFO:teuthology.orchestra.run.smithi161.stdout:2161 write 0x67ff04d thru 0x680b879 (0xc82d bytes) 2024-09-21T15:08:44.965 INFO:teuthology.orchestra.run.smithi161.stdout:2383 write 0x66f4c1b thru 0x66f4ffe (0x3e4 bytes) 2024-09-21T15:08:44.971 INFO:teuthology.orchestra.run.smithi161.stdout:2699 read 0x94472cc thru 0x944c7ca (0x54ff bytes) 2024-09-21T15:08:44.971 INFO:teuthology.orchestra.run.smithi161.stdout:2700 writesame 0x480cd47 thru 0x48110c4 data_size 0x35(0x437e bytes) 2024-09-21T15:08:44.974 INFO:teuthology.orchestra.run.smithi161.stdout:2809 writesame 0xdfefc5c thru 0xdff0cb6 data_size 0x1(0x105b bytes) 2024-09-21T15:08:44.982 INFO:teuthology.orchestra.run.smithi161.stdout:2810 read 0xd3b738d thru 0xd3c7157 (0xfdcb bytes) 2024-09-21T15:08:44.983 INFO:teuthology.orchestra.run.smithi161.stdout:2163 read 0x90b391b thru 0x90ba316 (0x69fc bytes) 2024-09-21T15:08:44.983 INFO:teuthology.orchestra.run.smithi161.stdout:2165 write 0x25ee46b thru 0x25f23ee (0x3f84 bytes) 2024-09-21T15:08:44.983 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:44.983 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:44.983 INFO:teuthology.orchestra.run.smithi161.stdout:2816 write 0x1d83059 thru 0x1d8f089 (0xc031 bytes) 2024-09-21T15:08:44.988 INFO:teuthology.orchestra.run.smithi161.stdout:2385 write 0x19d6aae thru 0x19e11bb (0xa70e bytes) 2024-09-21T15:08:45.004 INFO:teuthology.orchestra.run.smithi161.stdout:2702 punch from 0xb3eeb07 to 0xb3f6230, (0x7729 bytes) 2024-09-21T15:08:45.004 INFO:teuthology.orchestra.run.smithi161.stdout:2703 read 0x433f21d thru 0x4349b3f (0xa923 bytes) 2024-09-21T15:08:45.004 INFO:teuthology.orchestra.run.smithi161.stdout:2705 writesame 0x4c5979e thru 0x4c5d608 data_size 0x1(0x3e6b bytes) 2024-09-21T15:08:45.005 INFO:teuthology.orchestra.run.smithi161.stdout:2819 write 0x9f6ccac thru 0x9f7524a (0x859f bytes) 2024-09-21T15:08:45.015 INFO:teuthology.orchestra.run.smithi161.stdout:2386 read 0x5722d22 thru 0x572c8db (0x9bba bytes) 2024-09-21T15:08:45.015 INFO:teuthology.orchestra.run.smithi161.stdout:2387 writesame 0x3a6c2cd thru 0x3a77bd2 data_size 0xb(0xb906 bytes) 2024-09-21T15:08:45.023 INFO:teuthology.orchestra.run.smithi161.stdout:2166 punch from 0x4c42b1e to 0x4c4cfa1, (0xa483 bytes) 2024-09-21T15:08:45.024 INFO:teuthology.orchestra.run.smithi161.stdout:2167 punch from 0x71bc84 to 0x71daa8, (0x1e24 bytes) 2024-09-21T15:08:45.035 INFO:teuthology.orchestra.run.smithi161.stdout:2388 writesame 0x37202a5 thru 0x37210c2 data_size 0xd(0xe1e bytes) 2024-09-21T15:08:45.037 INFO:teuthology.orchestra.run.smithi161.stdout:2608 writesame 0x3bc3da0 thru 0x3bcc249 data_size 0x1(0x84aa bytes) 2024-09-21T15:08:45.038 INFO:teuthology.orchestra.run.smithi161.stdout:2706 writesame 0x8260485 thru 0x826b453 data_size 0x1(0xafcf bytes) 2024-09-21T15:08:45.052 INFO:teuthology.orchestra.run.smithi161.stdout:2389 read 0x18038e thru 0x1807fc (0x46f bytes) 2024-09-21T15:08:45.052 INFO:teuthology.orchestra.run.smithi161.stdout:2390 punch from 0x1f9ef2b to 0x1fae9fe, (0xfad3 bytes) 2024-09-21T15:08:45.052 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.052 INFO:teuthology.orchestra.run.smithi161.stdout:2393 read 0x7cea963 thru 0x7cf834e (0xd9ec bytes) 2024-09-21T15:08:45.052 INFO:teuthology.orchestra.run.smithi161.stdout:2394 write 0x30b5d9f thru 0x30b8970 (0x2bd2 bytes) 2024-09-21T15:08:45.053 INFO:teuthology.orchestra.run.smithi161.stdout:2820 trunc from 0xdff0cb7 to 0x63d3eeb 2024-09-21T15:08:45.076 INFO:teuthology.orchestra.run.smithi161.stdout:2707 write 0x83c7dea thru 0x83d662a (0xe841 bytes) 2024-09-21T15:08:45.077 INFO:teuthology.orchestra.run.smithi161.stdout:2398 write 0x81bdda6 thru 0x81cb3b8 (0xd613 bytes) 2024-09-21T15:08:45.084 INFO:teuthology.orchestra.run.smithi161.stdout:2168 write 0xd501563 thru 0xd508812 (0x72b0 bytes) 2024-09-21T15:08:45.091 INFO:teuthology.orchestra.run.smithi161.stdout:3252 writesame 0x88c628c thru 0x88d5f07 data_size 0x71(0xfc7c bytes) 2024-09-21T15:08:45.096 INFO:teuthology.orchestra.run.smithi161.stdout:3253 read 0x233a250 thru 0x233bd6d (0x1b1e bytes) 2024-09-21T15:08:45.097 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.097 INFO:teuthology.orchestra.run.smithi161.stdout:2170 read 0x70bd8ad thru 0x70cb0bf (0xd813 bytes) 2024-09-21T15:08:45.097 INFO:teuthology.orchestra.run.smithi161.stdout:3254 punch from 0x7469168 to 0x7475cf7, (0xcb8f bytes) 2024-09-21T15:08:45.097 INFO:teuthology.orchestra.run.smithi161.stdout:3255 write 0x6f83cf3 thru 0x6f86342 (0x2650 bytes) 2024-09-21T15:08:45.098 INFO:teuthology.orchestra.run.smithi161.stdout:2171 read 0x3d0c168 thru 0x3d1594c (0x97e5 bytes) 2024-09-21T15:08:45.098 INFO:teuthology.orchestra.run.smithi161.stdout:2399 read 0x3177b01 thru 0x3180c4f (0x914f bytes) 2024-09-21T15:08:45.098 INFO:teuthology.orchestra.run.smithi161.stdout:2173 punch from 0xd39ed8b to 0xd3adbc2, (0xee37 bytes) 2024-09-21T15:08:45.098 INFO:teuthology.orchestra.run.smithi161.stdout:2174 write 0x5186be5 thru 0x518d0fd (0x6519 bytes) 2024-09-21T15:08:45.099 INFO:teuthology.orchestra.run.smithi161.stdout:2400 read 0x7a8b6af thru 0x7a8e508 (0x2e5a bytes) 2024-09-21T15:08:45.099 INFO:teuthology.orchestra.run.smithi161.stdout:2401 writesame 0x50201f0 thru 0x502d92c data_size 0x1(0xd73d bytes) 2024-09-21T15:08:45.104 INFO:teuthology.orchestra.run.smithi161.stdout:2609 writesame 0x48fb409 thru 0x49071e1 data_size 0x35(0xbdd9 bytes) 2024-09-21T15:08:45.108 INFO:teuthology.orchestra.run.smithi161.stdout:2708 trunc from 0xd61989c to 0x8a3b971 2024-09-21T15:08:45.111 INFO:teuthology.orchestra.run.smithi161.stdout:3256 punch from 0x16a2f6c to 0x16b02e7, (0xd37b bytes) 2024-09-21T15:08:45.111 INFO:teuthology.orchestra.run.smithi161.stdout:3257 writesame 0x34d089f thru 0x34df768 data_size 0x5(0xeeca bytes) 2024-09-21T15:08:45.124 INFO:teuthology.orchestra.run.smithi161.stdout:2821 writesame 0x57f3229 thru 0x57fd6c3 data_size 0x1(0xa49b bytes) 2024-09-21T15:08:45.128 INFO:teuthology.orchestra.run.smithi161.stdout:3258 writesame 0x23312f6 thru 0x23338f8 data_size 0x1(0x2603 bytes) 2024-09-21T15:08:45.146 INFO:teuthology.orchestra.run.smithi161.stdout:2175 read 0x95fe776 thru 0x9609fd8 (0xb863 bytes) 2024-09-21T15:08:45.146 INFO:teuthology.orchestra.run.smithi161.stdout:2176 read 0x748cb3 thru 0x74d2cc (0x461a bytes) 2024-09-21T15:08:45.148 INFO:teuthology.orchestra.run.smithi161.stdout:2177 read 0x34a5ab0 thru 0x34a7cf5 (0x2246 bytes) 2024-09-21T15:08:45.148 INFO:teuthology.orchestra.run.smithi161.stdout:2178 read 0xa30618b thru 0xa30b46c (0x52e2 bytes) 2024-09-21T15:08:45.149 INFO:teuthology.orchestra.run.smithi161.stdout:2179 read 0x42cab9d thru 0x42d0a5c (0x5ec0 bytes) 2024-09-21T15:08:45.150 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.150 INFO:teuthology.orchestra.run.smithi161.stdout:2181 read 0xa0a6acc thru 0xa0b6279 (0xf7ae bytes) 2024-09-21T15:08:45.150 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.151 INFO:teuthology.orchestra.run.smithi161.stdout:2185 write 0x50740b2 thru 0x50764cf (0x241e bytes) 2024-09-21T15:08:45.151 INFO:teuthology.orchestra.run.smithi161.stdout:3260 trunc from 0x88d5f08 to 0xa5cd4fe 2024-09-21T15:08:45.161 INFO:teuthology.orchestra.run.smithi161.stdout:2402 trunc from 0xcb20b05 to 0x7332163 2024-09-21T15:08:45.168 INFO:teuthology.orchestra.run.smithi161.stdout:2186 write 0x8084f0e thru 0x808cd9d (0x7e90 bytes) 2024-09-21T15:08:45.169 INFO:teuthology.orchestra.run.smithi161.stdout:2822 writesame 0x514e737 thru 0x515088b data_size 0x7(0x2155 bytes) 2024-09-21T15:08:45.190 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.190 INFO:teuthology.orchestra.run.smithi161.stdout:2188 writesame 0x9fdca64 thru 0x9fdd016 data_size 0x1(0x5b3 bytes) 2024-09-21T15:08:45.191 INFO:teuthology.orchestra.run.smithi161.stdout:2610 write 0x86a31cd thru 0x86a51c1 (0x1ff5 bytes) 2024-09-21T15:08:45.204 INFO:teuthology.orchestra.run.smithi161.stdout:2189 punch from 0x47ad4d7 to 0x47bacde, (0xd807 bytes) 2024-09-21T15:08:45.210 INFO:teuthology.orchestra.run.smithi161.stdout:3262 trunc from 0xa5cd4fe to 0x5fd5790 2024-09-21T15:08:45.215 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.215 INFO:teuthology.orchestra.run.smithi161.stdout:2613 punch from 0xcb8a79 to 0xcc303e, (0xa5c5 bytes) 2024-09-21T15:08:45.215 INFO:teuthology.orchestra.run.smithi161.stdout:2614 write 0x804b83f thru 0x80506ef (0x4eb1 bytes) 2024-09-21T15:08:45.223 INFO:teuthology.orchestra.run.smithi161.stdout:2709 writesame 0x7af3d80 thru 0x7af7ca0 data_size 0x1(0x3f21 bytes) 2024-09-21T15:08:45.232 INFO:teuthology.orchestra.run.smithi161.stdout:2403 trunc from 0x7332163 to 0x8bdb373 2024-09-21T15:08:45.235 INFO:teuthology.orchestra.run.smithi161.stdout:2616 read 0x1e0b40d thru 0x1e10c04 (0x57f8 bytes) 2024-09-21T15:08:45.251 INFO:teuthology.orchestra.run.smithi161.stdout:2823 write 0xe9443f2 thru 0xe944a03 (0x612 bytes) 2024-09-21T15:08:45.251 INFO:teuthology.orchestra.run.smithi161.stdout:2191 writesame 0xd5cc49e thru 0xd5db75a data_size 0x1(0xf2bd bytes) 2024-09-21T15:08:45.261 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.265 INFO:teuthology.orchestra.run.smithi161.stdout:2711 trunc from 0x8a3b971 to 0x27ea1cf 2024-09-21T15:08:45.269 INFO:teuthology.orchestra.run.smithi161.stdout:2825 trunc from 0xe944a04 to 0xd31adb9 2024-09-21T15:08:45.272 INFO:teuthology.orchestra.run.smithi161.stdout:2617 write 0xc1b6c53 thru 0xc1c2617 (0xb9c5 bytes) 2024-09-21T15:08:45.272 INFO:teuthology.orchestra.run.smithi161.stdout:3264 trunc from 0x5fd5790 to 0xf9160a 2024-09-21T15:08:45.273 INFO:teuthology.orchestra.run.smithi161.stdout:2404 trunc from 0x8bdb373 to 0xbac697d 2024-09-21T15:08:45.283 INFO:teuthology.orchestra.run.smithi161.stdout:2192 trunc from 0xd5db75b to 0x10df9a7 2024-09-21T15:08:45.300 INFO:teuthology.orchestra.run.smithi161.stdout:2618 write 0x424b3a4 thru 0x4254ba9 (0x9806 bytes) 2024-09-21T15:08:45.312 INFO:teuthology.orchestra.run.smithi161.stdout:2619 read 0x4d9d540 thru 0x4da20c2 (0x4b83 bytes) 2024-09-21T15:08:45.313 INFO:teuthology.orchestra.run.smithi161.stdout:2620 read 0x838b4e4 thru 0x8394607 (0x9124 bytes) 2024-09-21T15:08:45.314 INFO:teuthology.orchestra.run.smithi161.stdout:2622 read 0x9cb4b0b thru 0x9cc2ef5 (0xe3eb bytes) 2024-09-21T15:08:45.314 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.314 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.314 INFO:teuthology.orchestra.run.smithi161.stdout:2626 writesame 0x526cdf7 thru 0x5271a53 data_size 0x1(0x4c5d bytes) 2024-09-21T15:08:45.320 INFO:teuthology.orchestra.run.smithi161.stdout:2405 read 0x5599103 thru 0x559d6bb (0x45b9 bytes) 2024-09-21T15:08:45.321 INFO:teuthology.orchestra.run.smithi161.stdout:2406 writesame 0x11174e4 thru 0x1124bce data_size 0x1(0xd6eb bytes) 2024-09-21T15:08:45.397 INFO:teuthology.orchestra.run.smithi161.stdout:2712 punch from 0x163521f to 0x163f955, (0xa736 bytes) 2024-09-21T15:08:45.405 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.406 INFO:teuthology.orchestra.run.smithi161.stdout:2830 read 0xbe47ccc thru 0xbe5431f (0xc654 bytes) 2024-09-21T15:08:45.406 INFO:teuthology.orchestra.run.smithi161.stdout:2832 write 0xc72cfec thru 0xc73803d (0xb052 bytes) 2024-09-21T15:08:45.413 INFO:teuthology.orchestra.run.smithi161.stdout:2407 read 0xee1c8e thru 0xef177d (0xfaf0 bytes) 2024-09-21T15:08:45.414 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.414 INFO:teuthology.orchestra.run.smithi161.stdout:2411 write 0x80cd0aa thru 0x80d4787 (0x76de bytes) 2024-09-21T15:08:45.422 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.429 INFO:teuthology.orchestra.run.smithi161.stdout:2834 punch from 0x2cab716 to 0x2cb4718, (0x9002 bytes) 2024-09-21T15:08:45.429 INFO:teuthology.orchestra.run.smithi161.stdout:2835 punch from 0x59c8f64 to 0x59ce63a, (0x56d6 bytes) 2024-09-21T15:08:45.430 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.430 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.430 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.430 INFO:teuthology.orchestra.run.smithi161.stdout:2839 writesame 0xb33462 thru 0xb3e297 data_size 0x3(0xae36 bytes) 2024-09-21T15:08:45.433 INFO:teuthology.orchestra.run.smithi161.stdout:2412 write 0x922aab8 thru 0x922b7d3 (0xd1c bytes) 2024-09-21T15:08:45.436 INFO:teuthology.orchestra.run.smithi161.stdout:3266 trunc from 0xf9160a to 0x858bbb6 2024-09-21T15:08:45.444 INFO:teuthology.orchestra.run.smithi161.stdout:2627 writesame 0xd97282d thru 0xd97e719 data_size 0x1(0xbeed bytes) 2024-09-21T15:08:45.447 INFO:teuthology.orchestra.run.smithi161.stdout:2413 read 0x23b1e16 thru 0x23be64b (0xc836 bytes) 2024-09-21T15:08:45.447 INFO:teuthology.orchestra.run.smithi161.stdout:2414 punch from 0x1cf1610 to 0x1cf312f, (0x1b1f bytes) 2024-09-21T15:08:45.447 INFO:teuthology.orchestra.run.smithi161.stdout:2713 write 0x9f7e6cb thru 0x9f81ec4 (0x37fa bytes) 2024-09-21T15:08:45.448 INFO:teuthology.orchestra.run.smithi161.stdout:2628 writesame 0x83228c5 thru 0x832af16 data_size 0x21(0x8652 bytes) 2024-09-21T15:08:45.463 INFO:teuthology.orchestra.run.smithi161.stdout:2629 read 0x29e1649 thru 0x29e8021 (0x69d9 bytes) 2024-09-21T15:08:45.464 INFO:teuthology.orchestra.run.smithi161.stdout:2630 writesame 0x2aef937 thru 0x2afb76c data_size 0x61(0xbe36 bytes) 2024-09-21T15:08:45.465 INFO:teuthology.orchestra.run.smithi161.stdout:2840 write 0x4cf8bbd thru 0x4cfd679 (0x4abd bytes) 2024-09-21T15:08:45.466 INFO:teuthology.orchestra.run.smithi161.stdout:3267 writesame 0x43d55b8 thru 0x43d5747 data_size 0x10(0x190 bytes) 2024-09-21T15:08:45.468 INFO:teuthology.orchestra.run.smithi161.stdout:2193 punch from 0xe0d8c4 to 0xe14b12, (0x724e bytes) 2024-09-21T15:08:45.468 INFO:teuthology.orchestra.run.smithi161.stdout:2194 read 0xd5d404 thru 0xd5edfb (0x19f8 bytes) 2024-09-21T15:08:45.475 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.475 INFO:teuthology.orchestra.run.smithi161.stdout:2632 write 0x1efc73f thru 0x1efd62f (0xef1 bytes) 2024-09-21T15:08:45.487 INFO:teuthology.orchestra.run.smithi161.stdout:2715 trunc from 0x9f81ec5 to 0xeb3df4 2024-09-21T15:08:45.489 INFO:teuthology.orchestra.run.smithi161.stdout:3268 writesame 0x292cee9 thru 0x2932879 data_size 0x1(0x5991 bytes) 2024-09-21T15:08:45.490 INFO:teuthology.orchestra.run.smithi161.stdout:2633 trunc from 0xd97e71a to 0xdeb0083 2024-09-21T15:08:45.497 INFO:teuthology.orchestra.run.smithi161.stdout:2415 write 0xc8b05c6 thru 0xc8bc484 (0xbebf bytes) 2024-09-21T15:08:45.507 INFO:teuthology.orchestra.run.smithi161.stdout:2841 trunc from 0xd31adb9 to 0x187cd94 2024-09-21T15:08:45.510 INFO:teuthology.orchestra.run.smithi161.stdout:2195 writesame 0x117b727 thru 0x1188daa data_size 0x2(0xd684 bytes) 2024-09-21T15:08:45.521 INFO:teuthology.orchestra.run.smithi161.stdout:2416 write 0xb72175 thru 0xb7f7a8 (0xd634 bytes) 2024-09-21T15:08:45.525 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.525 INFO:teuthology.orchestra.run.smithi161.stdout:3270 read 0x8064dbb thru 0x806e582 (0x97c8 bytes) 2024-09-21T15:08:45.539 INFO:teuthology.orchestra.run.smithi161.stdout:2196 punch from 0xad9deb to 0xae0241, (0x6456 bytes) 2024-09-21T15:08:45.539 INFO:teuthology.orchestra.run.smithi161.stdout:2197 writesame 0x72d784 thru 0x72f4ca data_size 0x1(0x1d47 bytes) 2024-09-21T15:08:45.546 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.546 INFO:teuthology.orchestra.run.smithi161.stdout:2418 write 0x815d50f thru 0x816961e (0xc110 bytes) 2024-09-21T15:08:45.554 INFO:teuthology.orchestra.run.smithi161.stdout:2198 read 0xd1ffb3 thru 0xd217b4 (0x1802 bytes) 2024-09-21T15:08:45.563 INFO:teuthology.orchestra.run.smithi161.stdout:2419 punch from 0x933d7f6 to 0x933ea99, (0x12a3 bytes) 2024-09-21T15:08:45.563 INFO:teuthology.orchestra.run.smithi161.stdout:2420 write 0xaa7f582 thru 0xaa80c4a (0x16c9 bytes) 2024-09-21T15:08:45.563 INFO:teuthology.orchestra.run.smithi161.stdout:2636 punch from 0x2a33d02 to 0x2a3c04a, (0x8348 bytes) 2024-09-21T15:08:45.563 INFO:teuthology.orchestra.run.smithi161.stdout:2638 writesame 0x362df thru 0x4353e data_size 0x66(0xd260 bytes) 2024-09-21T15:08:45.572 INFO:teuthology.orchestra.run.smithi161.stdout:3271 writesame 0xc1f87cd thru 0xc206be0 data_size 0x16(0xe414 bytes) 2024-09-21T15:08:45.574 INFO:teuthology.orchestra.run.smithi161.stdout:2639 write 0xb7cd02a thru 0xb7d6997 (0x996e bytes) 2024-09-21T15:08:45.578 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.578 INFO:teuthology.orchestra.run.smithi161.stdout:3273 writesame 0x78da087 thru 0x78e95c7 data_size 0x91(0xf541 bytes) 2024-09-21T15:08:45.578 INFO:teuthology.orchestra.run.smithi161.stdout:2421 writesame 0x8a54c1c thru 0x8a613f2 data_size 0x1(0xc7d7 bytes) 2024-09-21T15:08:45.581 INFO:teuthology.orchestra.run.smithi161.stdout:2202 trunc from 0x1188dab to 0xd29faad 2024-09-21T15:08:45.584 INFO:teuthology.orchestra.run.smithi161.stdout:2640 punch from 0x2c4dc0f to 0x2c599b5, (0xbda6 bytes) 2024-09-21T15:08:45.584 INFO:teuthology.orchestra.run.smithi161.stdout:2641 read 0x6d3d5b7 thru 0x6d4aae4 (0xd52e bytes) 2024-09-21T15:08:45.585 INFO:teuthology.orchestra.run.smithi161.stdout:2843 read 0x1666263 thru 0x166c665 (0x6403 bytes) 2024-09-21T15:08:45.585 INFO:teuthology.orchestra.run.smithi161.stdout:2642 write 0x7a36128 thru 0x7a37ec1 (0x1d9a bytes) 2024-09-21T15:08:45.585 INFO:teuthology.orchestra.run.smithi161.stdout:2844 read 0x11ac864 thru 0x11b5c4e (0x93eb bytes) 2024-09-21T15:08:45.586 INFO:teuthology.orchestra.run.smithi161.stdout:2845 read 0x157b4f4 thru 0x158476b (0x9278 bytes) 2024-09-21T15:08:45.592 INFO:teuthology.orchestra.run.smithi161.stdout:3274 trunc from 0xc206be1 to 0xb014cd4 2024-09-21T15:08:45.601 INFO:teuthology.orchestra.run.smithi161.stdout:2846 trunc from 0x187cd94 to 0x811e635 2024-09-21T15:08:45.616 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.616 INFO:teuthology.orchestra.run.smithi161.stdout:2644 read 0x6a676b5 thru 0x6a73dae (0xc6fa bytes) 2024-09-21T15:08:45.616 INFO:teuthology.orchestra.run.smithi161.stdout:2645 write 0x158528a thru 0x1590dd8 (0xbb4f bytes) 2024-09-21T15:08:45.624 INFO:teuthology.orchestra.run.smithi161.stdout:2422 write 0x5d74b3b thru 0x5d806f1 (0xbbb7 bytes) 2024-09-21T15:08:45.639 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.645 INFO:teuthology.orchestra.run.smithi161.stdout:2647 trunc from 0xdeb0083 to 0xb62b96d 2024-09-21T15:08:45.645 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.646 INFO:teuthology.orchestra.run.smithi161.stdout:2424 punch from 0x47866b5 to 0x4792b59, (0xc4a4 bytes) 2024-09-21T15:08:45.647 INFO:teuthology.orchestra.run.smithi161.stdout:2716 write 0xa20d701 thru 0xa21c7ca (0xf0ca bytes) 2024-09-21T15:08:45.654 INFO:teuthology.orchestra.run.smithi161.stdout:2203 trunc from 0xd29faad to 0xa5a2da9 2024-09-21T15:08:45.655 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.656 INFO:teuthology.orchestra.run.smithi161.stdout:3276 trunc from 0xb014cd4 to 0xa139d20 2024-09-21T15:08:45.680 INFO:teuthology.orchestra.run.smithi161.stdout:2717 writesame 0x360d881 thru 0x361c61f data_size 0x1b(0xed9f bytes) 2024-09-21T15:08:45.698 INFO:teuthology.orchestra.run.smithi161.stdout:2204 write 0x7848c21 thru 0x7855077 (0xc457 bytes) 2024-09-21T15:08:45.700 INFO:teuthology.orchestra.run.smithi161.stdout:2426 write 0xcaee371 thru 0xcaf21bd (0x3e4d bytes) 2024-09-21T15:08:45.701 INFO:teuthology.orchestra.run.smithi161.stdout:3278 write 0x59364a9 thru 0x5943501 (0xd059 bytes) 2024-09-21T15:08:45.702 INFO:teuthology.orchestra.run.smithi161.stdout:2718 read 0x52c39d3 thru 0x52ce08f (0xa6bd bytes) 2024-09-21T15:08:45.703 INFO:teuthology.orchestra.run.smithi161.stdout:2719 read 0x5dc749b thru 0x5dcaa0d (0x3573 bytes) 2024-09-21T15:08:45.703 INFO:teuthology.orchestra.run.smithi161.stdout:2720 read 0x2d598eb thru 0x2d5b97c (0x2092 bytes) 2024-09-21T15:08:45.703 INFO:teuthology.orchestra.run.smithi161.stdout:2721 read 0x9a4f441 thru 0x9a549c8 (0x5588 bytes) 2024-09-21T15:08:45.703 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.703 INFO:teuthology.orchestra.run.smithi161.stdout:2723 punch from 0x1e368f2 to 0x1e41697, (0xada5 bytes) 2024-09-21T15:08:45.703 INFO:teuthology.orchestra.run.smithi161.stdout:2724 punch from 0x705c63d to 0x7064f7a, (0x893d bytes) 2024-09-21T15:08:45.705 INFO:teuthology.orchestra.run.smithi161.stdout:2847 write 0xba2e497 thru 0xba38147 (0x9cb1 bytes) 2024-09-21T15:08:45.708 INFO:teuthology.orchestra.run.smithi161.stdout:2648 writesame 0x348488 thru 0x351dee data_size 0x1(0x9967 bytes) 2024-09-21T15:08:45.711 INFO:teuthology.orchestra.run.smithi161.stdout:2725 trunc from 0xa21c7cb to 0x6cb8a2e 2024-09-21T15:08:45.726 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.727 INFO:teuthology.orchestra.run.smithi161.stdout:2207 writesame 0x9bbec5b thru 0x9bc4a75 data_size 0x1(0x5e1b bytes) 2024-09-21T15:08:45.748 INFO:teuthology.orchestra.run.smithi161.stdout:3279 punch from 0xa0088af to 0xa00b17c, (0x28cd bytes) 2024-09-21T15:08:45.749 INFO:teuthology.orchestra.run.smithi161.stdout:3280 writesame 0x21d815d thru 0x21e42cd data_size 0x11(0xc171 bytes) 2024-09-21T15:08:45.749 INFO:teuthology.orchestra.run.smithi161.stdout:2649 read 0x64723e7 thru 0x6480b71 (0xe78b bytes) 2024-09-21T15:08:45.757 INFO:teuthology.orchestra.run.smithi161.stdout:2848 read 0xb316b61 thru 0xb31a1bb (0x365b bytes) 2024-09-21T15:08:45.758 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.758 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.759 INFO:teuthology.orchestra.run.smithi161.stdout:2854 writesame 0x3992d07 thru 0x3993a81 data_size 0x11(0xd7b bytes) 2024-09-21T15:08:45.761 INFO:teuthology.orchestra.run.smithi161.stdout:2650 trunc from 0xb62b96d to 0x5ade48f 2024-09-21T15:08:45.765 INFO:teuthology.orchestra.run.smithi161.stdout:3281 write 0x3ea651f thru 0x3ea8b5d (0x263f bytes) 2024-09-21T15:08:45.772 INFO:teuthology.orchestra.run.smithi161.stdout:2427 write 0xd82eb7b thru 0xd83b301 (0xc787 bytes) 2024-09-21T15:08:45.781 INFO:teuthology.orchestra.run.smithi161.stdout:2855 read 0x97f01b2 thru 0x97f194d (0x179c bytes) 2024-09-21T15:08:45.781 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.781 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.781 INFO:teuthology.orchestra.run.smithi161.stdout:2858 write 0x7b47337 thru 0x7b53683 (0xc34d bytes) 2024-09-21T15:08:45.784 INFO:teuthology.orchestra.run.smithi161.stdout:2726 read 0x537042d thru 0x5378ef6 (0x8aca bytes) 2024-09-21T15:08:45.784 INFO:teuthology.orchestra.run.smithi161.stdout:2727 read 0x1aa67ca thru 0x1aa8db8 (0x25ef bytes) 2024-09-21T15:08:45.784 INFO:teuthology.orchestra.run.smithi161.stdout:2728 punch from 0x206e48a to 0x2079881, (0xb3f7 bytes) 2024-09-21T15:08:45.784 INFO:teuthology.orchestra.run.smithi161.stdout:2729 punch from 0x20e28fc to 0x20e58ad, (0x2fb1 bytes) 2024-09-21T15:08:45.784 INFO:teuthology.orchestra.run.smithi161.stdout:2730 writesame 0x4eac774 thru 0x4eb88cf data_size 0x84(0xc15c bytes) 2024-09-21T15:08:45.786 INFO:teuthology.orchestra.run.smithi161.stdout:3282 read 0x9783e0b thru 0x979058f (0xc785 bytes) 2024-09-21T15:08:45.787 INFO:teuthology.orchestra.run.smithi161.stdout:3285 punch from 0x1dd00b8 to 0x1dd46b1, (0x45f9 bytes) 2024-09-21T15:08:45.787 INFO:teuthology.orchestra.run.smithi161.stdout:3286 write 0xd5c21a thru 0xd6515d (0x8f44 bytes) 2024-09-21T15:08:45.805 INFO:teuthology.orchestra.run.smithi161.stdout:3287 punch from 0x49108c2 to 0x49182e7, (0x7a25 bytes) 2024-09-21T15:08:45.805 INFO:teuthology.orchestra.run.smithi161.stdout:3288 read 0x227237a thru 0x227f4aa (0xd131 bytes) 2024-09-21T15:08:45.808 INFO:teuthology.orchestra.run.smithi161.stdout:3289 punch from 0xd1dc3d to 0xd29f50, (0xc313 bytes) 2024-09-21T15:08:45.813 INFO:teuthology.orchestra.run.smithi161.stdout:2731 punch from 0x522587e to 0x5225fc0, (0x742 bytes) 2024-09-21T15:08:45.813 INFO:teuthology.orchestra.run.smithi161.stdout:2859 write 0x8dc3a50 thru 0x8dcf280 (0xb831 bytes) 2024-09-21T15:08:45.813 INFO:teuthology.orchestra.run.smithi161.stdout:2732 read 0xd327d2 thru 0xd3f216 (0xca45 bytes) 2024-09-21T15:08:45.814 INFO:teuthology.orchestra.run.smithi161.stdout:3290 trunc from 0xa139d20 to 0xc7f546b 2024-09-21T15:08:45.830 INFO:teuthology.orchestra.run.smithi161.stdout:2651 read 0x4ccbc1c thru 0x4cd39ad (0x7d92 bytes) 2024-09-21T15:08:45.830 INFO:teuthology.orchestra.run.smithi161.stdout:2654 read 0x570f623 thru 0x5711917 (0x22f5 bytes) 2024-09-21T15:08:45.831 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.831 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.831 INFO:teuthology.orchestra.run.smithi161.stdout:2661 punch from 0xa97f7c to 0xaa7916, (0xf99a bytes) 2024-09-21T15:08:45.832 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.832 INFO:teuthology.orchestra.run.smithi161.stdout:2861 write 0xa588a30 thru 0xa589c67 (0x1238 bytes) 2024-09-21T15:08:45.834 INFO:teuthology.orchestra.run.smithi161.stdout:2208 write 0xd5ef543 thru 0xd5f772d (0x81eb bytes) 2024-09-21T15:08:45.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:45.837+0000 7f68dde65700 -1 rbd::mirror::ImageReplayer: 0x5581cb30d400 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:08:45.851 INFO:teuthology.orchestra.run.smithi161.stdout:2428 write 0xe868c20 thru 0xe868dad (0x18e bytes) 2024-09-21T15:08:45.856 INFO:teuthology.orchestra.run.smithi161.stdout:2210 read 0xd1d1de5 thru 0xd1d49fe (0x2c1a bytes) 2024-09-21T15:08:45.856 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.856 INFO:teuthology.orchestra.run.smithi161.stdout:2863 read 0x50d1242 thru 0x50d8b0d (0x78cc bytes) 2024-09-21T15:08:45.857 INFO:teuthology.orchestra.run.smithi161.stdout:2211 punch from 0x75c376b to 0x75c55f3, (0x1e88 bytes) 2024-09-21T15:08:45.857 INFO:teuthology.orchestra.run.smithi161.stdout:2212 write 0xce9b037 thru 0xcea6ebd (0xbe87 bytes) 2024-09-21T15:08:45.857 INFO:teuthology.orchestra.run.smithi161.stdout:2865 writesame 0x1a65ba3 thru 0x1a70ddd data_size 0x3(0xb23b bytes) 2024-09-21T15:08:45.869 INFO:teuthology.orchestra.run.smithi161.stdout:3291 write 0x166f28c thru 0x16774e3 (0x8258 bytes) 2024-09-21T15:08:45.871 INFO:teuthology.orchestra.run.smithi161.stdout:2734 write 0x7805ccf thru 0x7811fa5 (0xc2d7 bytes) 2024-09-21T15:08:45.879 INFO:teuthology.orchestra.run.smithi161.stdout:2429 writesame 0x6a9c39c thru 0x6aa70a9 data_size 0x11(0xad0e bytes) 2024-09-21T15:08:45.882 INFO:teuthology.orchestra.run.smithi161.stdout:3293 writesame 0x23ffa96 thru 0x2409f5b data_size 0x2e(0xa4c6 bytes) 2024-09-21T15:08:45.888 INFO:teuthology.orchestra.run.smithi161.stdout:2215 read 0x3d1254c thru 0x3d16fc5 (0x4a7a bytes) 2024-09-21T15:08:45.893 INFO:teuthology.orchestra.run.smithi161.stdout:3294 write 0x118282d thru 0x118be1d (0x95f1 bytes) 2024-09-21T15:08:45.895 INFO:teuthology.orchestra.run.smithi161.stdout:2735 punch from 0x368e10d to 0x3692708, (0x45fb bytes) 2024-09-21T15:08:45.896 INFO:teuthology.orchestra.run.smithi161.stdout:2662 writesame 0xcbe3b5b thru 0xcbeaf55 data_size 0x3(0x73fb bytes) 2024-09-21T15:08:45.897 INFO:teuthology.orchestra.run.smithi161.stdout:2430 punch from 0x5622549 to 0x5628dcd, (0x6884 bytes) 2024-09-21T15:08:45.897 INFO:teuthology.orchestra.run.smithi161.stdout:2432 write 0xae638b6 thru 0xae6b7e9 (0x7f34 bytes) 2024-09-21T15:08:45.901 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.901 INFO:teuthology.orchestra.run.smithi161.stdout:2664 read 0x2d3bc60 thru 0x2d410bb (0x545c bytes) 2024-09-21T15:08:45.901 INFO:teuthology.orchestra.run.smithi161.stdout:2666 writesame 0x3f43f73 thru 0x3f485ae data_size 0x1f(0x463c bytes) 2024-09-21T15:08:45.902 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.902 INFO:teuthology.orchestra.run.smithi161.stdout:3296 writesame 0x5e9335c thru 0x5ea2422 data_size 0x1(0xf0c7 bytes) 2024-09-21T15:08:45.904 INFO:teuthology.orchestra.run.smithi161.stdout:2216 trunc from 0xd5f772e to 0x57e3435 2024-09-21T15:08:45.908 INFO:teuthology.orchestra.run.smithi161.stdout:2667 writesame 0x1b2d458 thru 0x1b2dda0 data_size 0x1(0x949 bytes) 2024-09-21T15:08:45.910 INFO:teuthology.orchestra.run.smithi161.stdout:2433 write 0x72566fc thru 0x7256d7c (0x681 bytes) 2024-09-21T15:08:45.915 INFO:teuthology.orchestra.run.smithi161.stdout:2669 read 0xd1af96 thru 0xd246f7 (0x9762 bytes) 2024-09-21T15:08:45.919 INFO:teuthology.orchestra.run.smithi161.stdout:2670 trunc from 0xcbeaf56 to 0xaeb8425 2024-09-21T15:08:45.927 INFO:teuthology.orchestra.run.smithi161.stdout:2434 writesame 0x13ccc68 thru 0x13db03f data_size 0x5c(0xe3d8 bytes) 2024-09-21T15:08:45.938 INFO:teuthology.orchestra.run.smithi161.stdout:2866 write 0xc489d9c thru 0xc48eb9c (0x4e01 bytes) 2024-09-21T15:08:45.951 INFO:teuthology.orchestra.run.smithi161.stdout:3297 read 0x8d20887 thru 0x8d25ac4 (0x523e bytes) 2024-09-21T15:08:45.951 INFO:teuthology.orchestra.run.smithi161.stdout:3298 read 0xaabf784 thru 0xaacdb5b (0xe3d8 bytes) 2024-09-21T15:08:45.951 INFO:teuthology.orchestra.run.smithi161.stdout:3301 clone 18 order 22 su 1048576 sc 9 2024-09-21T15:08:45.962 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.962 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.962 INFO:teuthology.orchestra.run.smithi161.stdout:2869 write 0xae3aa4a thru 0xae3c8ff (0x1eb6 bytes) 2024-09-21T15:08:45.963 INFO:teuthology.orchestra.run.smithi161.stdout:2435 read 0x115312b thru 0x1157035 (0x3f0b bytes) 2024-09-21T15:08:45.963 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.963 INFO:teuthology.orchestra.run.smithi161.stdout:2437 write 0x6173352 thru 0x617eb3b (0xb7ea bytes) 2024-09-21T15:08:45.975 INFO:teuthology.orchestra.run.smithi161.stdout:2870 punch from 0x6cbf72b to 0x6ccd20d, (0xdae2 bytes) 2024-09-21T15:08:45.975 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.975 INFO:teuthology.orchestra.run.smithi161.stdout:2873 write 0x418506c thru 0x418f15d (0xa0f2 bytes) 2024-09-21T15:08:45.978 INFO:teuthology.orchestra.run.smithi161.stdout:2736 writesame 0xb3505f7 thru 0xb35a779 data_size 0x1(0xa183 bytes) 2024-09-21T15:08:45.978 INFO:teuthology.orchestra.run.smithi161.stdout:2218 read 0x29b1aa8 thru 0x29bb721 (0x9c7a bytes) 2024-09-21T15:08:45.979 INFO:teuthology.orchestra.run.smithi161.stdout:2439 read 0x1c7f95e thru 0x1c8ad81 (0xb424 bytes) 2024-09-21T15:08:45.979 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:45.979 INFO:teuthology.orchestra.run.smithi161.stdout:2441 writesame 0x216a171 thru 0x217611b data_size 0x1(0xbfab bytes) 2024-09-21T15:08:45.979 INFO:teuthology.orchestra.run.smithi161.stdout:2220 read 0x1d141fd thru 0x1d15d9d (0x1ba1 bytes) 2024-09-21T15:08:45.980 INFO:teuthology.orchestra.run.smithi161.stdout:2221 read 0x18c5263 thru 0x18cf748 (0xa4e6 bytes) 2024-09-21T15:08:45.981 INFO:teuthology.orchestra.run.smithi161.stdout:2222 read 0x1c473eb thru 0x1c4bc70 (0x4886 bytes) 2024-09-21T15:08:45.982 INFO:teuthology.orchestra.run.smithi161.stdout:2223 write 0x407dc6 thru 0x40990d (0x1b48 bytes) 2024-09-21T15:08:45.986 INFO:teuthology.orchestra.run.smithi161.stdout:2739 trunc from 0xb35a77a to 0xa13a85f 2024-09-21T15:08:45.993 INFO:teuthology.orchestra.run.smithi161.stdout:2672 trunc from 0xaeb8425 to 0x26ce9ed 2024-09-21T15:08:45.999 INFO:teuthology.orchestra.run.smithi161.stdout:2875 write 0x287451 thru 0x2899f6 (0x25a6 bytes) 2024-09-21T15:08:46.002 INFO:teuthology.orchestra.run.smithi161.stdout:2226 trunc from 0x57e3435 to 0x6f5b206 2024-09-21T15:08:46.023 INFO:teuthology.orchestra.run.smithi161.stdout:2876 read 0x8c1d174 thru 0x8c23923 (0x67b0 bytes) 2024-09-21T15:08:46.031 INFO:teuthology.orchestra.run.smithi161.stdout:2443 read 0x50dfe3c thru 0x50e01b2 (0x377 bytes) 2024-09-21T15:08:46.032 INFO:teuthology.orchestra.run.smithi161.stdout:2445 writesame 0x99dec8f thru 0x99e7545 data_size 0x1(0x88b7 bytes) 2024-09-21T15:08:46.046 INFO:teuthology.orchestra.run.smithi161.stdout:2228 punch from 0x3a23533 to 0x3a2bca1, (0x876e bytes) 2024-09-21T15:08:46.046 INFO:teuthology.orchestra.run.smithi161.stdout:2878 trunc from 0xc48eb9d to 0x142408 2024-09-21T15:08:46.049 INFO:teuthology.orchestra.run.smithi161.stdout:2741 punch from 0x5fcaa73 to 0x5fcaf34, (0x4c1 bytes) 2024-09-21T15:08:46.049 INFO:teuthology.orchestra.run.smithi161.stdout:2742 read 0x22a17d8 thru 0x22a3276 (0x1a9f bytes) 2024-09-21T15:08:46.049 INFO:teuthology.orchestra.run.smithi161.stdout:2743 punch from 0xf8cd65 to 0xf96ced, (0x9f88 bytes) 2024-09-21T15:08:46.049 INFO:teuthology.orchestra.run.smithi161.stdout:2744 punch from 0x546f7bd to 0x547d66c, (0xdeaf bytes) 2024-09-21T15:08:46.050 INFO:teuthology.orchestra.run.smithi161.stdout:2673 punch from 0xee75d6 to 0xef1a21, (0xa44b bytes) 2024-09-21T15:08:46.050 INFO:teuthology.orchestra.run.smithi161.stdout:2674 read 0x2619dc0 thru 0x261d385 (0x35c6 bytes) 2024-09-21T15:08:46.051 INFO:teuthology.orchestra.run.smithi161.stdout:2675 read 0x1a91103 thru 0x1a9b27a (0xa178 bytes) 2024-09-21T15:08:46.052 INFO:teuthology.orchestra.run.smithi161.stdout:2678 punch from 0x65484b to 0x655b7f, (0x1334 bytes) 2024-09-21T15:08:46.052 INFO:teuthology.orchestra.run.smithi161.stdout:2679 writesame 0x140c51c thru 0x140ce2d data_size 0x1b(0x912 bytes) 2024-09-21T15:08:46.065 INFO:teuthology.orchestra.run.smithi161.stdout:2446 punch from 0x241ecbf to 0x2429e48, (0xb189 bytes) 2024-09-21T15:08:46.065 INFO:teuthology.orchestra.run.smithi161.stdout:2447 write 0x289981f thru 0x28a57bc (0xbf9e bytes) 2024-09-21T15:08:46.079 INFO:teuthology.orchestra.run.smithi161.stdout:2449 write 0x45f3a37 thru 0x45f81d0 (0x479a bytes) 2024-09-21T15:08:46.083 INFO:teuthology.orchestra.run.smithi161.stdout:2745 write 0xaf03c48 thru 0xaf11ab6 (0xde6f bytes) 2024-09-21T15:08:46.088 INFO:teuthology.orchestra.run.smithi161.stdout:2229 write 0xdf2b50b thru 0xdf33394 (0x7e8a bytes) 2024-09-21T15:08:46.099 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.099 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.099 INFO:teuthology.orchestra.run.smithi161.stdout:2454 write 0x160d873 thru 0x161c46a (0xebf8 bytes) 2024-09-21T15:08:46.105 INFO:teuthology.orchestra.run.smithi161.stdout:2749 punch from 0x908e20b to 0x909be77, (0xdc6c bytes) 2024-09-21T15:08:46.105 INFO:teuthology.orchestra.run.smithi161.stdout:2751 write 0xe29d4b thru 0xe2ee6f (0x5125 bytes) 2024-09-21T15:08:46.108 INFO:teuthology.orchestra.run.smithi161.stdout:2230 read 0x33c542a thru 0x33d193b (0xc512 bytes) 2024-09-21T15:08:46.109 INFO:teuthology.orchestra.run.smithi161.stdout:2231 write 0x90540fb thru 0x905a7db (0x66e1 bytes) 2024-09-21T15:08:46.117 INFO:teuthology.orchestra.run.smithi161.stdout:2680 writesame 0xc8c8002 thru 0xc8cbc86 data_size 0x1(0x3c85 bytes) 2024-09-21T15:08:46.118 INFO:teuthology.orchestra.run.smithi161.stdout:2879 punch from 0x102eed to 0x10908e, (0x61a1 bytes) 2024-09-21T15:08:46.119 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.119 INFO:teuthology.orchestra.run.smithi161.stdout:2882 punch from 0xc44fc to 0xcac1b, (0x671f bytes) 2024-09-21T15:08:46.120 INFO:teuthology.orchestra.run.smithi161.stdout:2455 writesame 0xac04693 thru 0xac12fd7 data_size 0x13(0xe945 bytes) 2024-09-21T15:08:46.120 INFO:teuthology.orchestra.run.smithi161.stdout:2752 punch from 0x81ef82 to 0x81fb93, (0xc11 bytes) 2024-09-21T15:08:46.120 INFO:teuthology.orchestra.run.smithi161.stdout:2753 writesame 0x428c654 thru 0x4290d8a data_size 0x3(0x4737 bytes) 2024-09-21T15:08:46.127 INFO:teuthology.orchestra.run.smithi161.stdout:2681 trunc from 0xc8cbc87 to 0x9f60b90 2024-09-21T15:08:46.128 INFO:teuthology.orchestra.run.smithi161.stdout:2883 trunc from 0x142408 to 0x3e70adc 2024-09-21T15:08:46.129 INFO:teuthology.orchestra.run.smithi161.stdout:2232 read 0xa09ddbd thru 0xa0a9c19 (0xbe5d bytes) 2024-09-21T15:08:46.129 INFO:teuthology.orchestra.run.smithi161.stdout:2234 writesame 0x2f2b56e thru 0x2f2baf8 data_size 0xb(0x58b bytes) 2024-09-21T15:08:46.139 INFO:teuthology.orchestra.run.smithi161.stdout:2457 read 0x84bfddd thru 0x84c8131 (0x8355 bytes) 2024-09-21T15:08:46.139 INFO:teuthology.orchestra.run.smithi161.stdout:2458 write 0xb708439 thru 0xb714f44 (0xcb0c bytes) 2024-09-21T15:08:46.142 INFO:teuthology.orchestra.run.smithi161.stdout:2235 writesame 0xb36cd90 thru 0xb370193 data_size 0x2(0x3404 bytes) 2024-09-21T15:08:46.143 INFO:teuthology.orchestra.run.smithi161.stdout:2755 read 0x1478ef8 thru 0x14866f1 (0xd7fa bytes) 2024-09-21T15:08:46.143 INFO:teuthology.orchestra.run.smithi161.stdout:2758 writesame 0x914b5f2 thru 0x914d84a data_size 0x3(0x2259 bytes) 2024-09-21T15:08:46.160 INFO:teuthology.orchestra.run.smithi161.stdout:2236 read 0x47a2d92 thru 0x47b2167 (0xf3d6 bytes) 2024-09-21T15:08:46.161 INFO:teuthology.orchestra.run.smithi161.stdout:2460 write 0xb65c7bd thru 0xb66591c (0x9160 bytes) 2024-09-21T15:08:46.164 INFO:teuthology.orchestra.run.smithi161.stdout:2759 write 0x65e2012 thru 0x65f0a21 (0xea10 bytes) 2024-09-21T15:08:46.175 INFO:teuthology.orchestra.run.smithi161.stdout:2685 punch from 0x7e6e4 to 0x84daf, (0x66cb bytes) 2024-09-21T15:08:46.175 INFO:teuthology.orchestra.run.smithi161.stdout:2688 writesame 0x51e70bd thru 0x51e9f2d data_size 0x3(0x2e71 bytes) 2024-09-21T15:08:46.175 INFO:teuthology.orchestra.run.smithi161.stdout:2461 punch from 0x3960243 to 0x3964072, (0x3e2f bytes) 2024-09-21T15:08:46.176 INFO:teuthology.orchestra.run.smithi161.stdout:2462 writesame 0x283bf1f thru 0x283fa69 data_size 0x1(0x3b4b bytes) 2024-09-21T15:08:46.177 INFO:teuthology.orchestra.run.smithi161.stdout:2885 punch from 0x94a806 to 0x953241, (0x8a3b bytes) 2024-09-21T15:08:46.177 INFO:teuthology.orchestra.run.smithi161.stdout:2888 punch from 0x2c18985 to 0x2c26bb7, (0xe232 bytes) 2024-09-21T15:08:46.184 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.187 INFO:teuthology.orchestra.run.smithi161.stdout:2237 trunc from 0xdf33395 to 0x537d18 2024-09-21T15:08:46.188 INFO:teuthology.orchestra.run.smithi161.stdout:2760 read 0x2fe9fed thru 0x2ff03e3 (0x63f7 bytes) 2024-09-21T15:08:46.189 INFO:teuthology.orchestra.run.smithi161.stdout:2763 punch from 0x34df584 to 0x34ebeab, (0xc927 bytes) 2024-09-21T15:08:46.189 INFO:teuthology.orchestra.run.smithi161.stdout:2764 punch from 0x50d0fe1 to 0x50de6ac, (0xd6cb bytes) 2024-09-21T15:08:46.189 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.189 INFO:teuthology.orchestra.run.smithi161.stdout:2768 writesame 0x5b0b2a0 thru 0x5b0c60f data_size 0x8(0x1370 bytes) 2024-09-21T15:08:46.198 INFO:teuthology.orchestra.run.smithi161.stdout:2463 trunc from 0xe868dae to 0xb49bf23 2024-09-21T15:08:46.199 INFO:teuthology.orchestra.run.smithi161.stdout:2769 writesame 0x8281a2e thru 0x828f72b data_size 0x3f(0xdcfe bytes) 2024-09-21T15:08:46.214 INFO:teuthology.orchestra.run.smithi161.stdout:2889 writesame 0x545dba4 thru 0x5460cb7 data_size 0x12(0x3114 bytes) 2024-09-21T15:08:46.224 INFO:teuthology.orchestra.run.smithi161.stdout:2770 read 0x930c714 thru 0x93118fb (0x51e8 bytes) 2024-09-21T15:08:46.226 INFO:teuthology.orchestra.run.smithi161.stdout:2693 write 0xcddf1ce thru 0xcde0ba5 (0x19d8 bytes) 2024-09-21T15:08:46.230 INFO:teuthology.orchestra.run.smithi161.stdout:2771 trunc from 0xaf11ab7 to 0xcf757cf 2024-09-21T15:08:46.238 INFO:teuthology.orchestra.run.smithi161.stdout:2694 read 0xbecf524 thru 0xbed7d45 (0x8822 bytes) 2024-09-21T15:08:46.238 INFO:teuthology.orchestra.run.smithi161.stdout:2695 read 0x69cd0e5 thru 0x69cd9a8 (0x8c4 bytes) 2024-09-21T15:08:46.238 INFO:teuthology.orchestra.run.smithi161.stdout:2697 read 0x91347a9 thru 0x913d517 (0x8d6f bytes) 2024-09-21T15:08:46.244 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.251 INFO:teuthology.orchestra.run.smithi161.stdout:2698 trunc from 0xcde0ba6 to 0x6aff1a0 2024-09-21T15:08:46.256 INFO:teuthology.orchestra.run.smithi161.stdout:2772 read 0xc34fede thru 0xc352687 (0x27aa bytes) 2024-09-21T15:08:46.257 INFO:teuthology.orchestra.run.smithi161.stdout:2890 write 0x8e3a35c thru 0x8e42ac6 (0x876b bytes) 2024-09-21T15:08:46.257 INFO:teuthology.orchestra.run.smithi161.stdout:2773 write 0x2e7d6ec thru 0x2e81fa6 (0x48bb bytes) 2024-09-21T15:08:46.257 INFO:teuthology.orchestra.run.smithi161.stdout:2239 trunc from 0x537d18 to 0x69712a7 2024-09-21T15:08:46.278 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.280 INFO:teuthology.orchestra.run.smithi161.stdout:2775 punch from 0xbd349c4 to 0xbd44014, (0xf650 bytes) 2024-09-21T15:08:46.280 INFO:teuthology.orchestra.run.smithi161.stdout:2776 write 0x7dc926 thru 0x7e779a (0xae75 bytes) 2024-09-21T15:08:46.289 INFO:teuthology.orchestra.run.smithi161.stdout:2779 read 0x78a917 thru 0x793dba (0x94a4 bytes) 2024-09-21T15:08:46.290 INFO:teuthology.orchestra.run.smithi161.stdout:2780 read 0x65a450 thru 0x6691a7 (0xed58 bytes) 2024-09-21T15:08:46.291 INFO:teuthology.orchestra.run.smithi161.stdout:2782 writesame 0x7753874 thru 0x7762c62 data_size 0xb(0xf3ef bytes) 2024-09-21T15:08:46.292 INFO:teuthology.orchestra.run.smithi161.stdout:2464 write 0xc19ff83 thru 0xc1a0390 (0x40e bytes) 2024-09-21T15:08:46.293 INFO:teuthology.orchestra.run.smithi161.stdout:2240 writesame 0x61d09d7 thru 0x61da88b data_size 0x3(0x9eb5 bytes) 2024-09-21T15:08:46.308 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.308 INFO:teuthology.orchestra.run.smithi161.stdout:2702 read 0x5e677c5 thru 0x5e6d18d (0x59c9 bytes) 2024-09-21T15:08:46.308 INFO:teuthology.orchestra.run.smithi161.stdout:2703 writesame 0x4d662ab thru 0x4d6fb7d data_size 0x51(0x98d3 bytes) 2024-09-21T15:08:46.310 INFO:teuthology.orchestra.run.smithi161.stdout:2465 read 0xbac32da thru 0xbad276f (0xf496 bytes) 2024-09-21T15:08:46.310 INFO:teuthology.orchestra.run.smithi161.stdout:2467 read 0x97d1f89 thru 0x97df982 (0xd9fa bytes) 2024-09-21T15:08:46.310 INFO:teuthology.orchestra.run.smithi161.stdout:2469 writesame 0xba781ba thru 0xba7edf9 data_size 0x20(0x6c40 bytes) 2024-09-21T15:08:46.314 INFO:teuthology.orchestra.run.smithi161.stdout:2783 read 0x1da9d4a thru 0x1dab7db (0x1a92 bytes) 2024-09-21T15:08:46.314 INFO:teuthology.orchestra.run.smithi161.stdout:2785 read 0x7df6165 thru 0x7dfb607 (0x54a3 bytes) 2024-09-21T15:08:46.316 INFO:teuthology.orchestra.run.smithi161.stdout:2241 punch from 0x67e9754 to 0x67f7c3e, (0xe4ea bytes) 2024-09-21T15:08:46.316 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.316 INFO:teuthology.orchestra.run.smithi161.stdout:2243 read 0x441288f thru 0x4422579 (0xfceb bytes) 2024-09-21T15:08:46.320 INFO:teuthology.orchestra.run.smithi161.stdout:2894 writesame 0xb2f96b9 thru 0xb301f72 data_size 0x2(0x88ba bytes) 2024-09-21T15:08:46.322 INFO:teuthology.orchestra.run.smithi161.stdout:2895 write 0x61c906f thru 0x61d398e (0xa920 bytes) 2024-09-21T15:08:46.327 INFO:teuthology.orchestra.run.smithi161.stdout:2470 trunc from 0xc1a0391 to 0xe456ec7 2024-09-21T15:08:46.337 INFO:teuthology.orchestra.run.smithi161.stdout:2897 punch from 0xa6a9808 to 0xa6ac322, (0x2b1a bytes) 2024-09-21T15:08:46.337 INFO:teuthology.orchestra.run.smithi161.stdout:2898 read 0x8562def thru 0x8569214 (0x6426 bytes) 2024-09-21T15:08:46.338 INFO:teuthology.orchestra.run.smithi161.stdout:2899 punch from 0xa7bfb0d to 0xa7c63ee, (0x68e1 bytes) 2024-09-21T15:08:46.338 INFO:teuthology.orchestra.run.smithi161.stdout:2900 write 0x4decdf2 thru 0x4dfcb0d (0xfd1c bytes) 2024-09-21T15:08:46.356 INFO:teuthology.orchestra.run.smithi161.stdout:2901 punch from 0x668b688 to 0x668e1f0, (0x2b68 bytes) 2024-09-21T15:08:46.356 INFO:teuthology.orchestra.run.smithi161.stdout:2903 read 0x8fcd094 thru 0x8fcd7ca (0x737 bytes) 2024-09-21T15:08:46.356 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.356 INFO:teuthology.orchestra.run.smithi161.stdout:2906 write 0x732f3a9 thru 0x73358da (0x6532 bytes) 2024-09-21T15:08:46.361 INFO:teuthology.orchestra.run.smithi161.stdout:2786 write 0xe5017b1 thru 0xe503cf9 (0x2549 bytes) 2024-09-21T15:08:46.366 INFO:teuthology.orchestra.run.smithi161.stdout:2245 write 0x90924b6 thru 0x909ea3b (0xc586 bytes) 2024-09-21T15:08:46.367 INFO:teuthology.orchestra.run.smithi161.stdout:2704 write 0x9f5297b thru 0x9f58684 (0x5d0a bytes) 2024-09-21T15:08:46.372 INFO:teuthology.orchestra.run.smithi161.stdout:2471 read 0x2dc61f5 thru 0x2dcbfe2 (0x5dee bytes) 2024-09-21T15:08:46.372 INFO:teuthology.orchestra.run.smithi161.stdout:2473 write 0x7afa586 thru 0x7afb59a (0x1015 bytes) 2024-09-21T15:08:46.379 INFO:teuthology.orchestra.run.smithi161.stdout:2907 read 0x5565128 thru 0x556f6b9 (0xa592 bytes) 2024-09-21T15:08:46.379 INFO:teuthology.orchestra.run.smithi161.stdout:2909 write 0x50f9414 thru 0x50fcf69 (0x3b56 bytes) 2024-09-21T15:08:46.380 INFO:teuthology.orchestra.run.smithi161.stdout:2787 read 0x2e42a1 thru 0x2f20fd (0xde5d bytes) 2024-09-21T15:08:46.381 INFO:teuthology.orchestra.run.smithi161.stdout:2788 write 0xc3a384f thru 0xc3aa003 (0x67b5 bytes) 2024-09-21T15:08:46.393 INFO:teuthology.orchestra.run.smithi161.stdout:2246 writesame 0x6997ae thru 0x699909 data_size 0x6(0x15c bytes) 2024-09-21T15:08:46.393 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.393 INFO:teuthology.orchestra.run.smithi161.stdout:2474 punch from 0x66b4223 to 0x66be01f, (0x9dfc bytes) 2024-09-21T15:08:46.394 INFO:teuthology.orchestra.run.smithi161.stdout:2475 punch from 0xd274a5 to 0xd29d25, (0x2880 bytes) 2024-09-21T15:08:46.394 INFO:teuthology.orchestra.run.smithi161.stdout:2911 read 0xb291050 thru 0xb29f806 (0xe7b7 bytes) 2024-09-21T15:08:46.394 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.394 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.395 INFO:teuthology.orchestra.run.smithi161.stdout:2912 read 0x1b6f57e thru 0x1b77649 (0x80cc bytes) 2024-09-21T15:08:46.395 INFO:teuthology.orchestra.run.smithi161.stdout:2478 write 0x8c8a0b7 thru 0x8c91b26 (0x7a70 bytes) 2024-09-21T15:08:46.398 INFO:teuthology.orchestra.run.smithi161.stdout:2914 trunc from 0xb301f73 to 0xc2e6140 2024-09-21T15:08:46.405 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.413 INFO:teuthology.orchestra.run.smithi161.stdout:2479 read 0x22514f9 thru 0x225e888 (0xd390 bytes) 2024-09-21T15:08:46.413 INFO:teuthology.orchestra.run.smithi161.stdout:2709 trunc from 0x9f58685 to 0x18db56a 2024-09-21T15:08:46.414 INFO:teuthology.orchestra.run.smithi161.stdout:2480 read 0x877a17f thru 0x8785cb7 (0xbb39 bytes) 2024-09-21T15:08:46.414 INFO:teuthology.orchestra.run.smithi161.stdout:2481 read 0x3537896 thru 0x353f6b0 (0x7e1b bytes) 2024-09-21T15:08:46.414 INFO:teuthology.orchestra.run.smithi161.stdout:2483 read 0x36eb287 thru 0x36ef075 (0x3def bytes) 2024-09-21T15:08:46.419 INFO:teuthology.orchestra.run.smithi161.stdout:2789 trunc from 0xe503cfa to 0x6ba7197 2024-09-21T15:08:46.420 INFO:teuthology.orchestra.run.smithi161.stdout:2250 trunc from 0x909ea3c to 0xe3e0845 2024-09-21T15:08:46.424 INFO:teuthology.orchestra.run.smithi161.stdout:2484 trunc from 0xe456ec7 to 0x9beab37 2024-09-21T15:08:46.433 INFO:teuthology.orchestra.run.smithi161.stdout:2915 trunc from 0xc2e6140 to 0xca6b62b 2024-09-21T15:08:46.489 INFO:teuthology.orchestra.run.smithi161.stdout:2251 read 0x48eb2e7 thru 0x48ed515 (0x222f bytes) 2024-09-21T15:08:46.489 INFO:teuthology.orchestra.run.smithi161.stdout:2252 read 0x9cc7eaa thru 0x9ccc21e (0x4375 bytes) 2024-09-21T15:08:46.490 INFO:teuthology.orchestra.run.smithi161.stdout:2253 writesame 0xdaea0d2 thru 0xdaf212d data_size 0x1f(0x805c bytes) 2024-09-21T15:08:46.492 INFO:teuthology.orchestra.run.smithi161.stdout:2916 writesame 0x30b87c9 thru 0x30bd3d7 data_size 0x1(0x4c0f bytes) 2024-09-21T15:08:46.500 INFO:teuthology.orchestra.run.smithi161.stdout:2254 read 0x92d6711 thru 0x92df5a9 (0x8e99 bytes) 2024-09-21T15:08:46.500 INFO:teuthology.orchestra.run.smithi161.stdout:2255 clone 26 order 22 su 2097152 sc 7 2024-09-21T15:08:46.502 INFO:teuthology.orchestra.run.smithi161.stdout:2790 punch from 0x3769f4a to 0x376b4fe, (0x15b4 bytes) 2024-09-21T15:08:46.502 INFO:teuthology.orchestra.run.smithi161.stdout:2791 read 0x58b2815 thru 0x58c2406 (0xfbf2 bytes) 2024-09-21T15:08:46.503 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.503 INFO:teuthology.orchestra.run.smithi161.stdout:2486 read 0x55793a0 thru 0x557ed08 (0x5969 bytes) 2024-09-21T15:08:46.503 INFO:teuthology.orchestra.run.smithi161.stdout:2487 writesame 0x3817d6 thru 0x386ece data_size 0x3d(0x56f9 bytes) 2024-09-21T15:08:46.510 INFO:teuthology.orchestra.run.smithi161.stdout:2795 trunc from 0x6ba7197 to 0x423f34c 2024-09-21T15:08:46.520 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.521 INFO:teuthology.orchestra.run.smithi161.stdout:2711 read 0x110e330 thru 0x111844e (0xa11f bytes) 2024-09-21T15:08:46.521 INFO:teuthology.orchestra.run.smithi161.stdout:2712 read 0x576eb0 thru 0x5782be (0x140f bytes) 2024-09-21T15:08:46.523 INFO:teuthology.orchestra.run.smithi161.stdout:2918 trunc from 0xca6b62b to 0xc559556 2024-09-21T15:08:46.525 INFO:teuthology.orchestra.run.smithi161.stdout:2488 trunc from 0x9beab37 to 0x81393f1 2024-09-21T15:08:46.557 INFO:teuthology.orchestra.run.smithi161.stdout:2919 read 0xa607803 thru 0xa60cd89 (0x5587 bytes) 2024-09-21T15:08:46.562 INFO:teuthology.orchestra.run.smithi161.stdout:2713 writesame 0x6efaa8f thru 0x6f02d47 data_size 0x17(0x82b9 bytes) 2024-09-21T15:08:46.565 INFO:teuthology.orchestra.run.smithi161.stdout:2714 writesame 0x4408501 thru 0x4411f21 data_size 0x11(0x9a21 bytes) 2024-09-21T15:08:46.574 INFO:teuthology.orchestra.run.smithi161.stdout:2920 trunc from 0xc559556 to 0x434f043 2024-09-21T15:08:46.577 INFO:teuthology.orchestra.run.smithi161.stdout:2489 punch from 0xb9b646 to 0xba1eb3, (0x686d bytes) 2024-09-21T15:08:46.577 INFO:teuthology.orchestra.run.smithi161.stdout:2491 punch from 0x5d055c7 to 0x5d09c42, (0x467b bytes) 2024-09-21T15:08:46.583 INFO:teuthology.orchestra.run.smithi161.stdout:2492 trunc from 0x81393f1 to 0x42648bf 2024-09-21T15:08:46.586 INFO:teuthology.orchestra.run.smithi161.stdout:2796 trunc from 0x423f34c to 0xea5b12a 2024-09-21T15:08:46.620 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.3649871536780134) > weight (0.25) 2024-09-21T15:08:46.620 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.42574818248040625) > weight (0.25) 2024-09-21T15:08:46.620 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.2 2024-09-21T15:08:46.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Sent signal 15 2024-09-21T15:08:46.621 INFO:tasks.rbd_mirror_thrash:waiting for 2 secs before reviving daemons 2024-09-21T15:08:46.621 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:08:46.621+0000 7f3f5a3a3700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 (PID: 24891) UID: 1000 2024-09-21T15:08:46.637 INFO:teuthology.orchestra.run.smithi161.stdout:2800 read 0x6e8f768 thru 0x6e9a012 (0xa8ab bytes) 2024-09-21T15:08:46.637 INFO:teuthology.orchestra.run.smithi161.stdout:2801 read 0xc0e149b thru 0xc0ebcba (0xa820 bytes) 2024-09-21T15:08:46.637 INFO:teuthology.orchestra.run.smithi161.stdout:2802 writesame 0xdc718e4 thru 0xdc72f52 data_size 0x1(0x166f bytes) 2024-09-21T15:08:46.643 INFO:teuthology.orchestra.run.smithi161.stdout:2715 writesame 0xd81b7ca thru 0xd82763a data_size 0x3(0xbe71 bytes) 2024-09-21T15:08:46.648 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.649 INFO:teuthology.orchestra.run.smithi161.stdout:2496 trunc from 0x42648bf to 0x3f19c6a 2024-09-21T15:08:46.649 INFO:teuthology.orchestra.run.smithi161.stdout:2803 write 0x4e2a88e thru 0x4e39718 (0xee8b bytes) 2024-09-21T15:08:46.666 INFO:teuthology.orchestra.run.smithi161.stdout:2716 trunc from 0xd82763b to 0x234c10e 2024-09-21T15:08:46.676 INFO:teuthology.orchestra.run.smithi161.stdout:2923 writesame 0x917c48d thru 0x918548c data_size 0x80(0x9000 bytes) 2024-09-21T15:08:46.684 INFO:teuthology.orchestra.run.smithi161.stdout:2804 trunc from 0xea5b12a to 0x774bffd 2024-09-21T15:08:46.725 INFO:teuthology.orchestra.run.smithi161.stdout:2717 punch from 0x1dc96cb to 0x1dd3504, (0x9e39 bytes) 2024-09-21T15:08:46.725 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.726 INFO:teuthology.orchestra.run.smithi161.stdout:2719 read 0x149d26 thru 0x1539b4 (0x9c8f bytes) 2024-09-21T15:08:46.730 INFO:teuthology.orchestra.run.smithi161.stdout:2497 writesame 0x4736b34 thru 0x473c75b data_size 0xc(0x5c28 bytes) 2024-09-21T15:08:46.734 INFO:teuthology.orchestra.run.smithi161.stdout:2499 read 0x48c182 thru 0x49313d (0x6fbc bytes) 2024-09-21T15:08:46.734 INFO:teuthology.orchestra.run.smithi161.stdout:2924 writesame 0xe934742 thru 0xe9414af data_size 0xf(0xcd6e bytes) 2024-09-21T15:08:46.737 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.737 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.737 INFO:teuthology.orchestra.run.smithi161.stdout:2929 write 0x1133a2 thru 0x1226cb (0xf32a bytes) 2024-09-21T15:08:46.739 INFO:teuthology.orchestra.run.smithi161.stdout:2500 trunc from 0x473c75c to 0x24cc2d4 2024-09-21T15:08:46.752 INFO:teuthology.orchestra.run.smithi161.stdout:2930 read 0xe2f900a thru 0xe302986 (0x997d bytes) 2024-09-21T15:08:46.753 INFO:teuthology.orchestra.run.smithi161.stdout:2932 write 0x15d60e2 thru 0x15dde9b (0x7dba bytes) 2024-09-21T15:08:46.757 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone17 from 0xc7f546b (overlap 0x131a3b) to 0x7a417 2024-09-21T15:08:46.758 INFO:teuthology.orchestra.run.smithi161.stdout:2805 trunc from 0x774bffd to 0xe816d46 2024-09-21T15:08:46.763 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.764 INFO:teuthology.orchestra.run.smithi161.stdout:2934 trunc from 0xe9414b0 to 0xe120f1e 2024-09-21T15:08:46.780 INFO:teuthology.orchestra.run.smithi161.stdout:2720 writesame 0xa5f1364 thru 0xa5f54a5 data_size 0x1(0x4142 bytes) 2024-09-21T15:08:46.792 INFO:teuthology.orchestra.run.smithi161.stdout:2806 read 0x22a888d thru 0x22b27bb (0x9f2f bytes) 2024-09-21T15:08:46.793 INFO:teuthology.orchestra.run.smithi161.stdout:2808 writesame 0x98337b2 thru 0x984309b data_size 0x97(0xf8ea bytes) 2024-09-21T15:08:46.799 INFO:teuthology.orchestra.run.smithi161.stdout:2935 writesame 0x39c0404 thru 0x39cf298 data_size 0x1(0xee95 bytes) 2024-09-21T15:08:46.811 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.811 INFO:teuthology.orchestra.run.smithi161.stdout:2810 write 0xb6921 thru 0xba7a8 (0x3e88 bytes) 2024-09-21T15:08:46.829 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.829 INFO:teuthology.orchestra.run.smithi161.stdout:2813 punch from 0xcf2e843 to 0xcf35efe, (0x76bb bytes) 2024-09-21T15:08:46.829 INFO:teuthology.orchestra.run.smithi161.stdout:2814 punch from 0xc5495d9 to 0xc5518af, (0x82d6 bytes) 2024-09-21T15:08:46.840 INFO:teuthology.orchestra.run.smithi161.stdout:2721 write 0xac14b99 thru 0xac1b642 (0x6aaa bytes) 2024-09-21T15:08:46.846 INFO:teuthology.orchestra.run.smithi161.stdout:2816 trunc from 0xe816d46 to 0x5bf098f 2024-09-21T15:08:46.852 INFO:teuthology.orchestra.run.smithi161.stdout:2936 read 0x2610144 thru 0x2617548 (0x7405 bytes) 2024-09-21T15:08:46.857 INFO:teuthology.orchestra.run.smithi161.stdout:2722 read 0x583d836 thru 0x58449f0 (0x71bb bytes) 2024-09-21T15:08:46.858 INFO:teuthology.orchestra.run.smithi161.stdout:2724 read 0xaadf246 thru 0xaaec74a (0xd505 bytes) 2024-09-21T15:08:46.864 INFO:teuthology.orchestra.run.smithi161.stdout:2937 trunc from 0xe120f1e to 0x8c85cb3 2024-09-21T15:08:46.907 INFO:teuthology.orchestra.run.smithi161.stdout:2501 writesame 0x838b03f thru 0x839119c data_size 0x67(0x615e bytes) 2024-09-21T15:08:46.907 INFO:teuthology.orchestra.run.smithi161.stdout:2727 writesame 0xd71afd1 thru 0xd71deeb data_size 0x1(0x2f1b bytes) 2024-09-21T15:08:46.908 INFO:teuthology.orchestra.run.smithi161.stdout:2817 read 0x4b242d7 thru 0x4b25a61 (0x178b bytes) 2024-09-21T15:08:46.910 INFO:teuthology.orchestra.run.smithi161.stdout:2728 writesame 0xcae751b thru 0xcaec380 data_size 0x2d(0x4e66 bytes) 2024-09-21T15:08:46.910 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.910 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.910 INFO:teuthology.orchestra.run.smithi161.stdout:2505 write 0x1ecbe3a thru 0x1ed0e53 (0x501a bytes) 2024-09-21T15:08:46.916 INFO:teuthology.orchestra.run.smithi161.stdout:2942 read 0x713d2eb thru 0x714bb59 (0xe86f bytes) 2024-09-21T15:08:46.916 INFO:teuthology.orchestra.run.smithi161.stdout:2943 read 0x26b5600 thru 0x26b787f (0x2280 bytes) 2024-09-21T15:08:46.916 INFO:teuthology.orchestra.run.smithi161.stdout:2818 trunc from 0x5bf098f to 0xa8d0d10 2024-09-21T15:08:46.917 INFO:teuthology.orchestra.run.smithi161.stdout:2944 read 0x276d058 thru 0x277b1ac (0xe155 bytes) 2024-09-21T15:08:46.918 INFO:teuthology.orchestra.run.smithi161.stdout:2946 punch from 0x1fe062 to 0x20e033, (0xffd1 bytes) 2024-09-21T15:08:46.918 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.918 INFO:teuthology.orchestra.run.smithi161.stdout:2948 punch from 0x87ebe59 to 0x87ef053, (0x31fa bytes) 2024-09-21T15:08:46.918 INFO:teuthology.orchestra.run.smithi161.stdout:2949 read 0x4f5018d thru 0x4f513eb (0x125f bytes) 2024-09-21T15:08:46.918 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.918 INFO:teuthology.orchestra.run.smithi161.stdout:2951 read 0x276d75f thru 0x277c24d (0xeaef bytes) 2024-09-21T15:08:46.918 INFO:teuthology.orchestra.run.smithi161.stdout:2952 writesame 0x6e13a89 thru 0x6e17632 data_size 0x7(0x3baa bytes) 2024-09-21T15:08:46.920 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.920 INFO:teuthology.orchestra.run.smithi161.stdout:2730 write 0xacd813a thru 0xace0106 (0x7fcd bytes) 2024-09-21T15:08:46.928 INFO:teuthology.orchestra.run.smithi161.stdout:2953 read 0x1f4f367 thru 0x1f574d6 (0x8170 bytes) 2024-09-21T15:08:46.930 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:46.940 INFO:teuthology.orchestra.run.smithi161.stdout:2954 trunc from 0x8c85cb3 to 0x29d915f 2024-09-21T15:08:46.943 INFO:teuthology.orchestra.run.smithi161.stdout:2819 write 0x3563660 thru 0x3565ba0 (0x2541 bytes) 2024-09-21T15:08:46.954 INFO:teuthology.orchestra.run.smithi161.stdout:2821 write 0x783a8ea thru 0x783dd22 (0x3439 bytes) 2024-09-21T15:08:46.957 INFO:teuthology.orchestra.run.smithi161.stdout:2734 writesame 0xd7d1309 thru 0xd7d6507 data_size 0x1(0x51ff bytes) 2024-09-21T15:08:46.962 INFO:teuthology.orchestra.run.smithi161.stdout:2735 write 0x3fca4f7 thru 0x3fcf007 (0x4b11 bytes) 2024-09-21T15:08:46.962 INFO:teuthology.orchestra.run.smithi161.stdout:2506 write 0xd639d9c thru 0xd63ac0a (0xe6f bytes) 2024-09-21T15:08:46.968 INFO:teuthology.orchestra.run.smithi161.stdout:2823 read 0x680d3ab thru 0x6815369 (0x7fbf bytes) 2024-09-21T15:08:46.972 INFO:teuthology.orchestra.run.smithi161.stdout:2824 trunc from 0xa8d0d10 to 0xd0c3a6a 2024-09-21T15:08:46.974 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xeda864d 2024-09-21T15:08:46.976 INFO:teuthology.orchestra.run.smithi161.stdout:2507 trunc from 0xd63ac0b to 0xeda864d 2024-09-21T15:08:46.981 INFO:teuthology.orchestra.run.smithi161.stdout:2736 trunc from 0xd7d6508 to 0x6b0df47 2024-09-21T15:08:47.001 INFO:teuthology.orchestra.run.smithi161.stdout:2826 write 0x75b7126 thru 0x75bee8a (0x7d65 bytes) 2024-09-21T15:08:47.009 INFO:teuthology.orchestra.run.smithi161.stdout:2509 read 0xe452d75 thru 0xe457cd3 (0x4f5f bytes) 2024-09-21T15:08:47.009 INFO:teuthology.orchestra.run.smithi161.stdout:2510 write 0x13ff136 thru 0x140c0da (0xcfa5 bytes) 2024-09-21T15:08:47.022 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #16, image image_cluster1.client.mirror.2-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent17 2024-09-21T15:08:47.033 INFO:teuthology.orchestra.run.smithi161.stdout:2827 write 0x4c5c33c thru 0x4c5d892 (0x1557 bytes) 2024-09-21T15:08:47.036 INFO:teuthology.orchestra.run.smithi161.stdout:2511 writesame 0x334c886 thru 0x335033c data_size 0x1(0x3ab7 bytes) 2024-09-21T15:08:47.039 INFO:teuthology.orchestra.run.smithi161.stdout:2955 writesame 0x4c4a5c2 thru 0x4c55b21 data_size 0x10(0xb560 bytes) 2024-09-21T15:08:47.043 INFO:teuthology.orchestra.run.smithi161.stdout:2956 writesame 0x46e893e thru 0x46f241d data_size 0x3b(0x9ae0 bytes) 2024-09-21T15:08:47.044 INFO:teuthology.orchestra.run.smithi161.stdout:2737 punch from 0x6252d18 to 0x6261c25, (0xef0d bytes) 2024-09-21T15:08:47.045 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:47.045 INFO:teuthology.orchestra.run.smithi161.stdout:2739 read 0x3b0733a thru 0x3b14e72 (0xdb39 bytes) 2024-09-21T15:08:47.045 INFO:teuthology.orchestra.run.smithi161.stdout:2740 write 0x4e3c5bc thru 0x4e46a6c (0xa4b1 bytes) 2024-09-21T15:08:47.046 INFO:teuthology.orchestra.run.smithi161.stdout:2828 write 0xb8668de thru 0xb8712a9 (0xa9cc bytes) 2024-09-21T15:08:47.061 INFO:teuthology.orchestra.run.smithi161.stdout:2512 writesame 0xae40bd2 thru 0xae4b787 data_size 0x2(0xabb6 bytes) 2024-09-21T15:08:47.063 INFO:teuthology.orchestra.run.smithi161.stdout:2959 read 0x4b6630a thru 0x4b72426 (0xc11d bytes) 2024-09-21T15:08:47.064 INFO:teuthology.orchestra.run.smithi161.stdout:2960 punch from 0x4bc769a to 0x4bcf63c, (0x7fa2 bytes) 2024-09-21T15:08:47.064 INFO:teuthology.orchestra.run.smithi161.stdout:2961 read 0x23d9543 thru 0x23e69eb (0xd4a9 bytes) 2024-09-21T15:08:47.066 INFO:teuthology.orchestra.run.smithi161.stdout:2962 read 0x12110b7 thru 0x121ccc8 (0xbc12 bytes) 2024-09-21T15:08:47.068 INFO:teuthology.orchestra.run.smithi161.stdout:2829 write 0xbe12916 thru 0xbe1834c (0x5a37 bytes) 2024-09-21T15:08:47.070 INFO:teuthology.orchestra.run.smithi161.stdout:2741 trunc from 0x6b0df47 to 0x3108a61 2024-09-21T15:08:47.093 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:47.094 INFO:teuthology.orchestra.run.smithi161.stdout:2514 read 0x77771ff thru 0x777842a (0x122c bytes) 2024-09-21T15:08:47.095 INFO:teuthology.orchestra.run.smithi161.stdout:2515 read 0xbf17616 thru 0xbf1c077 (0x4a62 bytes) 2024-09-21T15:08:47.095 INFO:teuthology.orchestra.run.smithi161.stdout:2517 clone 22 order 22 su 524288 sc 6 2024-09-21T15:08:47.117 INFO:teuthology.orchestra.run.smithi161.stdout:2963 write 0x890bc4e thru 0x890f788 (0x3b3b bytes) 2024-09-21T15:08:47.119 INFO:teuthology.orchestra.run.smithi161.stdout:2833 writesame 0xd2375ce thru 0xd237b15 data_size 0x8(0x548 bytes) 2024-09-21T15:08:47.120 INFO:teuthology.orchestra.run.smithi161.stdout:2742 read 0x1d9c958 thru 0x1da0680 (0x3d29 bytes) 2024-09-21T15:08:47.123 INFO:teuthology.orchestra.run.smithi161.stdout:2834 punch from 0x40a8ac to 0x418dbe, (0xe512 bytes) 2024-09-21T15:08:47.123 INFO:teuthology.orchestra.run.smithi161.stdout:2835 writesame 0x1eb1421 thru 0x1eb9df9 data_size 0x9(0x89d9 bytes) 2024-09-21T15:08:47.128 INFO:teuthology.orchestra.run.smithi161.stdout:2964 read 0x20324c1 thru 0x203c1fe (0x9d3e bytes) 2024-09-21T15:08:47.140 INFO:teuthology.orchestra.run.smithi161.stdout:2965 trunc from 0x890f789 to 0x421ffb9 2024-09-21T15:08:47.154 INFO:teuthology.orchestra.run.smithi161.stdout:2836 trunc from 0xd237b16 to 0x3f6af2f 2024-09-21T15:08:47.172 INFO:teuthology.orchestra.run.smithi161.stdout:3305 trunc from 0xc7f546b to 0x1ed089c 2024-09-21T15:08:47.174 INFO:teuthology.orchestra.run.smithi161.stdout:2743 write 0xa634436 thru 0xa63cedc (0x8aa7 bytes) 2024-09-21T15:08:47.214 INFO:teuthology.orchestra.run.smithi161.stdout:2837 trunc from 0x3f6af2f to 0x4f88fa 2024-09-21T15:08:47.237 INFO:teuthology.orchestra.run.smithi161.stdout:2745 write 0xbbfc932 thru 0xbc08d1f (0xc3ee bytes) 2024-09-21T15:08:47.241 INFO:teuthology.orchestra.run.smithi161.stdout:2966 write 0x8d263f0 thru 0x8d2acba (0x48cb bytes) 2024-09-21T15:08:47.255 INFO:teuthology.orchestra.run.smithi161.stdout:2746 punch from 0xa425846 to 0xa42dade, (0x8298 bytes) 2024-09-21T15:08:47.257 INFO:teuthology.orchestra.run.smithi161.stdout:3306 trunc from 0x1ed089c to 0x519478e 2024-09-21T15:08:47.273 INFO:teuthology.orchestra.run.smithi161.stdout:2838 read 0x3c67b thru 0x3d038 (0x9be bytes) 2024-09-21T15:08:47.273 INFO:teuthology.orchestra.run.smithi161.stdout:2747 trunc from 0xbc08d20 to 0x33350b4 2024-09-21T15:08:47.284 INFO:teuthology.orchestra.run.smithi161.stdout:3307 punch from 0x11bdc80 to 0x11c58fe, (0x7c7e bytes) 2024-09-21T15:08:47.285 INFO:teuthology.orchestra.run.smithi161.stdout:2839 trunc from 0x4f88fa to 0x6ee8fe0 2024-09-21T15:08:47.306 INFO:teuthology.orchestra.run.smithi161.stdout:2968 write 0xdd2306b thru 0xdd27ea3 (0x4e39 bytes) 2024-09-21T15:08:47.320 INFO:teuthology.orchestra.run.smithi161.stdout:2840 read 0x1c3bf41 thru 0x1c3d287 (0x1347 bytes) 2024-09-21T15:08:47.320 INFO:teuthology.orchestra.run.smithi161.stdout:2841 clone 20 order 18 su 1024 sc 8 2024-09-21T15:08:47.321 INFO:teuthology.orchestra.run.smithi161.stdout:2969 read 0x823212c thru 0x823dd72 (0xbc47 bytes) 2024-09-21T15:08:47.322 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:47.322 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:47.322 INFO:teuthology.orchestra.run.smithi161.stdout:2974 punch from 0x91045bd to 0x910ccad, (0x86f0 bytes) 2024-09-21T15:08:47.322 INFO:teuthology.orchestra.run.smithi161.stdout:2975 write 0x482ef43 thru 0x48344f0 (0x55ae bytes) 2024-09-21T15:08:47.340 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:47.340 INFO:teuthology.orchestra.run.smithi161.stdout:2977 write 0xcf61b3f thru 0xcf66835 (0x4cf7 bytes) 2024-09-21T15:08:47.340 INFO:teuthology.orchestra.run.smithi161.stdout:3308 writesame 0xdafb3c7 thru 0xdb089bf data_size 0x1f(0xd5f9 bytes) 2024-09-21T15:08:47.343 INFO:teuthology.orchestra.run.smithi161.stdout:2748 write 0x1fbefc thru 0x202ffb (0x7100 bytes) 2024-09-21T15:08:47.345 INFO:teuthology.orchestra.run.smithi161.stdout:3309 read 0x7d30605 thru 0x7d3da7c (0xd478 bytes) 2024-09-21T15:08:47.345 INFO:teuthology.orchestra.run.smithi161.stdout:3310 read 0x454bf3a thru 0x4555f5c (0xa023 bytes) 2024-09-21T15:08:47.345 INFO:teuthology.orchestra.run.smithi161.stdout:3311 read 0x4bfdcbd thru 0x4c0b891 (0xdbd5 bytes) 2024-09-21T15:08:47.346 INFO:teuthology.orchestra.run.smithi161.stdout:3312 read 0x485109a thru 0x48517b4 (0x71b bytes) 2024-09-21T15:08:47.346 INFO:teuthology.orchestra.run.smithi161.stdout:3315 writesame 0x8ce3c3a thru 0x8cea77a data_size 0x1(0x6b41 bytes) 2024-09-21T15:08:47.349 INFO:teuthology.orchestra.run.smithi161.stdout:2981 read 0x6704600 thru 0x670746e (0x2e6f bytes) 2024-09-21T15:08:47.349 INFO:teuthology.orchestra.run.smithi161.stdout:2982 read 0x2ef09f5 thru 0x2efdc24 (0xd230 bytes) 2024-09-21T15:08:47.350 INFO:teuthology.orchestra.run.smithi161.stdout:2984 read 0x621acca thru 0x6229aa3 (0xedda bytes) 2024-09-21T15:08:47.351 INFO:teuthology.orchestra.run.smithi161.stdout:2749 punch from 0x2ee6ef5 to 0x2ef04b3, (0x95be bytes) 2024-09-21T15:08:47.351 INFO:teuthology.orchestra.run.smithi161.stdout:2985 writesame 0xa333c8f thru 0xa341c9b data_size 0x3(0xe00d bytes) 2024-09-21T15:08:47.351 INFO:teuthology.orchestra.run.smithi161.stdout:2750 punch from 0x18004d9 to 0x181004b, (0xfb72 bytes) 2024-09-21T15:08:47.351 INFO:teuthology.orchestra.run.smithi161.stdout:2751 punch from 0x202bc16 to 0x20332ce, (0x76b8 bytes) 2024-09-21T15:08:47.382 INFO:teuthology.orchestra.run.smithi161.stdout:2986 write 0x3ecd92c thru 0x3edb7f9 (0xdece bytes) 2024-09-21T15:08:47.383 INFO:teuthology.orchestra.run.smithi161.stdout:3316 read 0x656f545 thru 0x65732b4 (0x3d70 bytes) 2024-09-21T15:08:47.407 INFO:teuthology.orchestra.run.smithi161.stdout:2752 write 0x93d1428 thru 0x93deb55 (0xd72e bytes) 2024-09-21T15:08:47.415 INFO:teuthology.orchestra.run.smithi161.stdout:3317 writesame 0xed94ca0 thru 0xed9fea1 data_size 0x15(0xb202 bytes) 2024-09-21T15:08:47.417 INFO:teuthology.orchestra.run.smithi161.stdout:2987 trunc from 0xdd27ea4 to 0x11516d6 2024-09-21T15:08:47.418 INFO:teuthology.orchestra.run.smithi161.stdout:3318 read 0x59af7c0 thru 0x59bba4f (0xc290 bytes) 2024-09-21T15:08:47.418 INFO:teuthology.orchestra.run.smithi161.stdout:3319 write 0x38f2d72 thru 0x39024fc (0xf78b bytes) 2024-09-21T15:08:47.426 INFO:teuthology.orchestra.run.smithi161.stdout:2753 trunc from 0x93deb56 to 0x57747e5 2024-09-21T15:08:47.432 INFO:teuthology.orchestra.run.smithi161.stdout:3320 write 0xa578ff5 thru 0xa583318 (0xa324 bytes) 2024-09-21T15:08:47.446 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:47.446 INFO:teuthology.orchestra.run.smithi161.stdout:3324 writesame 0xa5ef530 thru 0xa5f22a9 data_size 0x1(0x2d7a bytes) 2024-09-21T15:08:47.464 INFO:teuthology.orchestra.run.smithi161.stdout:3325 write 0x86bd4fb thru 0x86c06e4 (0x31ea bytes) 2024-09-21T15:08:47.474 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:47.483 INFO:teuthology.orchestra.run.smithi161.stdout:3326 write 0xb5c3fa0 thru 0xb5cf080 (0xb0e1 bytes) 2024-09-21T15:08:47.503 INFO:teuthology.orchestra.run.smithi161.stdout:3327 read 0x2f4ada6 thru 0x2f59703 (0xe95e bytes) 2024-09-21T15:08:47.505 INFO:teuthology.orchestra.run.smithi161.stdout:3328 read 0x8e5f257 thru 0x8e64528 (0x52d2 bytes) 2024-09-21T15:08:47.505 INFO:teuthology.orchestra.run.smithi161.stdout:3329 read 0x22d131b thru 0x22d92c0 (0x7fa6 bytes) 2024-09-21T15:08:47.506 INFO:teuthology.orchestra.run.smithi161.stdout:3330 write 0xd373dfe thru 0xd37ba83 (0x7c86 bytes) 2024-09-21T15:08:47.527 INFO:teuthology.orchestra.run.smithi161.stdout:2990 writesame 0x5c450b2 thru 0x5c4bd08 data_size 0x2b(0x6c57 bytes) 2024-09-21T15:08:47.529 INFO:teuthology.orchestra.run.smithi161.stdout:3331 writesame 0x8953be0 thru 0x895cae2 data_size 0x1(0x8f03 bytes) 2024-09-21T15:08:47.532 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:47.532 INFO:teuthology.orchestra.run.smithi161.stdout:2993 punch from 0x4a43b0 to 0x4b11bc, (0xce0c bytes) 2024-09-21T15:08:47.535 INFO:teuthology.orchestra.run.smithi161.stdout:2754 write 0x70e89ef thru 0x70e9271 (0x883 bytes) 2024-09-21T15:08:47.548 INFO:teuthology.orchestra.run.smithi161.stdout:2755 read 0xe70ac9 thru 0xe72773 (0x1cab bytes) 2024-09-21T15:08:47.570 INFO:teuthology.orchestra.run.smithi161.stdout:3332 punch from 0x4746dfb to 0x47550f8, (0xe2fd bytes) 2024-09-21T15:08:47.570 INFO:teuthology.orchestra.run.smithi161.stdout:3333 read 0x818fd89 thru 0x819e087 (0xe2ff bytes) 2024-09-21T15:08:47.570 INFO:teuthology.orchestra.run.smithi161.stdout:3334 writesame 0x43b53 thru 0x4571b data_size 0x1(0x1bc9 bytes) 2024-09-21T15:08:47.579 INFO:teuthology.orchestra.run.smithi161.stdout:2994 write 0xe8340c0 thru 0xe8352ea (0x122b bytes) 2024-09-21T15:08:47.587 INFO:teuthology.orchestra.run.smithi161.stdout:2995 write 0x8e25776 thru 0x8e2f935 (0xa1c0 bytes) 2024-09-21T15:08:47.596 INFO:teuthology.orchestra.run.smithi161.stdout:3336 punch from 0x697d28d to 0x698894e, (0xb6c1 bytes) 2024-09-21T15:08:47.597 INFO:teuthology.orchestra.run.smithi161.stdout:3337 read 0xc8603af thru 0xc86b420 (0xb072 bytes) 2024-09-21T15:08:47.600 INFO:teuthology.orchestra.run.smithi161.stdout:2756 write 0xd5bb041 thru 0xd5c121a (0x61da bytes) 2024-09-21T15:08:47.607 INFO:teuthology.orchestra.run.smithi161.stdout:3338 trunc from 0xed9fea2 to 0xb27a00b 2024-09-21T15:08:47.617 INFO:teuthology.orchestra.run.smithi161.stdout:2757 write 0x380e966 thru 0x381a3e0 (0xba7b bytes) 2024-09-21T15:08:47.623 INFO:teuthology.orchestra.run.smithi161.stdout:2998 trunc from 0xe8352eb to 0x2439023 2024-09-21T15:08:47.640 INFO:teuthology.orchestra.run.smithi161.stdout:2759 writesame 0xe3ca29 thru 0xe4c598 data_size 0x30(0xfb70 bytes) 2024-09-21T15:08:47.660 INFO:teuthology.orchestra.run.smithi161.stdout:2760 write 0xb44b01f thru 0xb458e2c (0xde0e bytes) 2024-09-21T15:08:47.682 INFO:teuthology.orchestra.run.smithi161.stdout:3339 read 0x83c8709 thru 0x83c87fb (0xf3 bytes) 2024-09-21T15:08:47.683 INFO:teuthology.orchestra.run.smithi161.stdout:3340 write 0xaca6c7e thru 0xaca81ee (0x1571 bytes) 2024-09-21T15:08:47.699 INFO:teuthology.orchestra.run.smithi161.stdout:3343 write 0x35dd3f1 thru 0x35dfd9e (0x29ae bytes) 2024-09-21T15:08:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:3344 write 0x3836139 thru 0x38397fe (0x36c6 bytes) 2024-09-21T15:08:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:3347 write 0x7508df4 thru 0x750a5eb (0x17f8 bytes) 2024-09-21T15:08:47.723 INFO:teuthology.orchestra.run.smithi161.stdout:2761 write 0xe9e0de6 thru 0xe9ee072 (0xd28d bytes) 2024-09-21T15:08:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:2999 write 0x6606707 thru 0x6610378 (0x9c72 bytes) 2024-09-21T15:08:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:2763 punch from 0xcb29af3 to 0xcb3029d, (0x67aa bytes) 2024-09-21T15:08:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:2767 read 0xb3b4a63 thru 0xb3b9a73 (0x5011 bytes) 2024-09-21T15:08:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:2769 write 0x7528458 thru 0x752a545 (0x20ee bytes) 2024-09-21T15:08:47.741 INFO:teuthology.orchestra.run.smithi161.stdout:3348 trunc from 0xb27a00b to 0xd7274a2 2024-09-21T15:08:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone21 from 0xeda864d (overlap 0x13a38f) to 0x9d1c7 2024-09-21T15:08:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.3-clone25 intact 2024-09-21T15:08:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:2770 read 0xa43917d thru 0xa4432fc (0xa180 bytes) 2024-09-21T15:08:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:2773 write 0x2a56831 thru 0x2a5cd72 (0x6542 bytes) 2024-09-21T15:08:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:3349 punch from 0xc02d677 to 0xc038392, (0xad1b bytes) 2024-09-21T15:08:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:3350 writesame 0xd4a4002 thru 0xd4abb23 data_size 0x1(0x7b22 bytes) 2024-09-21T15:08:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:3000 write 0x71d0814 thru 0x71d7ae3 (0x72d0 bytes) 2024-09-21T15:08:47.802 INFO:teuthology.orchestra.run.smithi161.stdout:2774 trunc from 0xe9ee073 to 0x6f61aaa 2024-09-21T15:08:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:3001 write 0x306f0f2 thru 0x307e856 (0xf765 bytes) 2024-09-21T15:08:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:3351 trunc from 0xd7274a2 to 0x9573c12 2024-09-21T15:08:47.834 INFO:teuthology.orchestra.run.smithi161.stdout:3002 writesame 0xeeeb22 thru 0xeef7cf data_size 0x3(0xcae bytes) 2024-09-21T15:08:47.839 INFO:teuthology.orchestra.run.smithi161.stdout:3006 write 0x4177452 thru 0x418481d (0xd3cc bytes) 2024-09-21T15:08:47.873 INFO:teuthology.orchestra.run.smithi161.stdout:3353 write 0x1cca268 thru 0x1cd4db7 (0xab50 bytes) 2024-09-21T15:08:47.873 INFO:teuthology.orchestra.run.smithi161.stdout:2775 punch from 0x151e83f to 0x1529825, (0xafe6 bytes) 2024-09-21T15:08:47.885 INFO:teuthology.orchestra.run.smithi161.stdout:2776 trunc from 0x6f61aaa to 0x1b7841 2024-09-21T15:08:47.888 INFO:teuthology.orchestra.run.smithi161.stdout:3354 write 0x39267b0 thru 0x39362f6 (0xfb47 bytes) 2024-09-21T15:08:47.902 INFO:teuthology.orchestra.run.smithi161.stdout:3355 read 0x71f8cf2 thru 0x72050d1 (0xc3e0 bytes) 2024-09-21T15:08:47.906 INFO:teuthology.orchestra.run.smithi161.stdout:3007 write 0xc9d5daa thru 0xc9e0c30 (0xae87 bytes) 2024-09-21T15:08:47.908 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #18, image image_cluster1.client.mirror.5-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent19 2024-09-21T15:08:47.931 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #20, image image_cluster1.client.mirror.4-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent21 2024-09-21T15:08:47.931 INFO:teuthology.orchestra.run.smithi161.stdout:3008 writesame 0x8ed11f8 thru 0x8ed5d79 data_size 0x5(0x4b82 bytes) 2024-09-21T15:08:47.955 INFO:teuthology.orchestra.run.smithi161.stdout:3356 write 0xd64fc59 thru 0xd65da8e (0xde36 bytes) 2024-09-21T15:08:47.974 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:47.974 INFO:teuthology.orchestra.run.smithi161.stdout:3360 write 0xb06163d thru 0xb0695e0 (0x7fa4 bytes) 2024-09-21T15:08:47.985 INFO:teuthology.orchestra.run.smithi161.stdout:3361 read 0x4ca1c0d thru 0x4ca8944 (0x6d38 bytes) 2024-09-21T15:08:47.988 INFO:teuthology.orchestra.run.smithi161.stdout:3009 write 0xccd180a thru 0xccd7733 (0x5f2a bytes) 2024-09-21T15:08:47.990 INFO:teuthology.orchestra.run.smithi161.stdout:2842 read 0x5fe7735 thru 0x5ff62c9 (0xeb95 bytes) 2024-09-21T15:08:47.990 INFO:teuthology.orchestra.run.smithi161.stdout:2777 write 0x2bd8d0 thru 0x2bf415 (0x1b46 bytes) 2024-09-21T15:08:47.994 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #24, image image_cluster1.client.mirror.3-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent25 2024-09-21T15:08:48.005 INFO:teuthology.orchestra.run.smithi161.stdout:3362 trunc from 0xd65da8f to 0x48e3321 2024-09-21T15:08:48.012 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.012 INFO:teuthology.orchestra.run.smithi161.stdout:2847 punch from 0x51e9cb to 0x520220, (0x1855 bytes) 2024-09-21T15:08:48.013 INFO:teuthology.orchestra.run.smithi161.stdout:3010 trunc from 0xccd7734 to 0x64334ab 2024-09-21T15:08:48.030 INFO:teuthology.orchestra.run.smithi161.stdout:2778 write 0x25b02a2 thru 0x25bb639 (0xb398 bytes) 2024-09-21T15:08:48.046 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.047 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.047 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.047 INFO:teuthology.orchestra.run.smithi161.stdout:2782 read 0xadd14f thru 0xade849 (0x16fb bytes) 2024-09-21T15:08:48.047 INFO:teuthology.orchestra.run.smithi161.stdout:2783 read 0x1db731d thru 0x1dc0479 (0x915d bytes) 2024-09-21T15:08:48.047 INFO:teuthology.orchestra.run.smithi161.stdout:2848 writesame 0xcdc3331 thru 0xcdcf0a5 data_size 0x33(0xbd75 bytes) 2024-09-21T15:08:48.050 INFO:teuthology.orchestra.run.smithi161.stdout:3364 read 0x273f144 thru 0x274049f (0x135c bytes) 2024-09-21T15:08:48.051 INFO:teuthology.orchestra.run.smithi161.stdout:3365 clone 19 order 22 su 16384 sc 7 2024-09-21T15:08:48.091 INFO:teuthology.orchestra.run.smithi161.stdout:2849 writesame 0xe820851 thru 0xe825113 data_size 0x7(0x48c3 bytes) 2024-09-21T15:08:48.098 INFO:teuthology.orchestra.run.smithi161.stdout:2850 read 0x3431fd2 thru 0x3434252 (0x2281 bytes) 2024-09-21T15:08:48.099 INFO:teuthology.orchestra.run.smithi161.stdout:2851 write 0x48fbea5 thru 0x48fd60c (0x1768 bytes) 2024-09-21T15:08:48.102 INFO:teuthology.orchestra.run.smithi161.stdout:2788 write 0x8ff9fb4 thru 0x8ffa83b (0x888 bytes) 2024-09-21T15:08:48.105 INFO:teuthology.orchestra.run.smithi161.stdout:3011 writesame 0xd59f6f5 thru 0xd5a9875 data_size 0x1(0xa181 bytes) 2024-09-21T15:08:48.120 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.120 INFO:teuthology.orchestra.run.smithi161.stdout:2790 write 0x67ded0d thru 0x67e5875 (0x6b69 bytes) 2024-09-21T15:08:48.144 INFO:teuthology.orchestra.run.smithi161.stdout:2792 write 0x7995d1d thru 0x79a395d (0xdc41 bytes) 2024-09-21T15:08:48.147 INFO:teuthology.orchestra.run.smithi161.stdout:2852 write 0xbc23b6c thru 0xbc2f54e (0xb9e3 bytes) 2024-09-21T15:08:48.161 INFO:teuthology.orchestra.run.smithi161.stdout:3013 write 0xdd5d949 thru 0xdd60f35 (0x35ed bytes) 2024-09-21T15:08:48.164 INFO:teuthology.orchestra.run.smithi161.stdout:2793 write 0x13be2be thru 0x13c620c (0x7f4f bytes) 2024-09-21T15:08:48.173 INFO:teuthology.orchestra.run.smithi161.stdout:2853 read 0xe0c54ff thru 0xe0cb864 (0x6366 bytes) 2024-09-21T15:08:48.174 INFO:teuthology.orchestra.run.smithi161.stdout:2854 punch from 0xa549bb to 0xa5b62d, (0x6c72 bytes) 2024-09-21T15:08:48.174 INFO:teuthology.orchestra.run.smithi161.stdout:3015 writesame 0x9e8989 thru 0x9f68e9 data_size 0x1(0xdf61 bytes) 2024-09-21T15:08:48.177 INFO:teuthology.orchestra.run.smithi161.stdout:2794 punch from 0x50f4aa2 to 0x50fe2ef, (0x984d bytes) 2024-09-21T15:08:48.177 INFO:teuthology.orchestra.run.smithi161.stdout:2795 read 0x88b82e3 thru 0x88bdf81 (0x5c9f bytes) 2024-09-21T15:08:48.177 INFO:teuthology.orchestra.run.smithi161.stdout:2796 read 0x838993 thru 0x8413ae (0x8a1c bytes) 2024-09-21T15:08:48.195 INFO:teuthology.orchestra.run.smithi161.stdout:2797 trunc from 0x8ffa83c to 0x3e1435b 2024-09-21T15:08:48.197 INFO:teuthology.orchestra.run.smithi161.stdout:2856 trunc from 0xe825114 to 0x64d7768 2024-09-21T15:08:48.218 INFO:teuthology.orchestra.run.smithi161.stdout:3016 punch from 0x55ccb3a to 0x55d804a, (0xb510 bytes) 2024-09-21T15:08:48.218 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.218 INFO:teuthology.orchestra.run.smithi161.stdout:3018 writesame 0x13634e thru 0x13cd86 data_size 0x1(0x6a39 bytes) 2024-09-21T15:08:48.242 INFO:teuthology.orchestra.run.smithi161.stdout:3019 write 0xd940ec9 thru 0xd9491d8 (0x8310 bytes) 2024-09-21T15:08:48.259 INFO:teuthology.orchestra.run.smithi161.stdout:3020 writesame 0x9089024 thru 0x908df7c data_size 0x25(0x4f59 bytes) 2024-09-21T15:08:48.277 INFO:teuthology.orchestra.run.smithi161.stdout:3021 write 0xdc01203 thru 0xdc03eb3 (0x2cb1 bytes) 2024-09-21T15:08:48.290 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.291 INFO:teuthology.orchestra.run.smithi161.stdout:3022 punch from 0x4718bc0 to 0x4719240, (0x680 bytes) 2024-09-21T15:08:48.291 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.291 INFO:teuthology.orchestra.run.smithi161.stdout:3028 read 0xa59b4b4 thru 0xa5a129f (0x5dec bytes) 2024-09-21T15:08:48.291 INFO:teuthology.orchestra.run.smithi161.stdout:3029 writesame 0x531d3d1 thru 0x532c2c8 data_size 0xc(0xeef8 bytes) 2024-09-21T15:08:48.304 INFO:teuthology.orchestra.run.smithi161.stdout:3031 write 0xcac776d thru 0xcad37be (0xc052 bytes) 2024-09-21T15:08:48.320 INFO:teuthology.orchestra.run.smithi161.stdout:2798 write 0x85f5419 thru 0x85f8a6c (0x3654 bytes) 2024-09-21T15:08:48.322 INFO:teuthology.orchestra.run.smithi161.stdout:3032 punch from 0xcc4b156 to 0xcc4eaa6, (0x3950 bytes) 2024-09-21T15:08:48.322 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.322 INFO:teuthology.orchestra.run.smithi161.stdout:3037 read 0x45abdcd thru 0x45b1e5a (0x608e bytes) 2024-09-21T15:08:48.323 INFO:teuthology.orchestra.run.smithi161.stdout:3038 write 0x36ed0 thru 0x45266 (0xe397 bytes) 2024-09-21T15:08:48.333 INFO:teuthology.orchestra.run.smithi161.stdout:2859 writesame 0x9afd1fc thru 0x9b07ddb data_size 0x7d(0xabe0 bytes) 2024-09-21T15:08:48.335 INFO:teuthology.orchestra.run.smithi161.stdout:3043 punch from 0x80fd21d to 0x8105470, (0x8253 bytes) 2024-09-21T15:08:48.338 INFO:teuthology.orchestra.run.smithi161.stdout:2799 read 0x6e556ca thru 0x6e60b6b (0xb4a2 bytes) 2024-09-21T15:08:48.338 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.339 INFO:teuthology.orchestra.run.smithi161.stdout:2801 write 0x15fa6ec thru 0x1603561 (0x8e76 bytes) 2024-09-21T15:08:48.340 INFO:teuthology.orchestra.run.smithi161.stdout:2860 read 0x6465e56 thru 0x646f090 (0x923b bytes) 2024-09-21T15:08:48.341 INFO:teuthology.orchestra.run.smithi161.stdout:2861 punch from 0x467d9f1 to 0x468d407, (0xfa16 bytes) 2024-09-21T15:08:48.342 INFO:teuthology.orchestra.run.smithi161.stdout:2862 read 0x7100d8b thru 0x7105d66 (0x4fdc bytes) 2024-09-21T15:08:48.346 INFO:teuthology.orchestra.run.smithi161.stdout:3044 trunc from 0xdd60f36 to 0x96847db 2024-09-21T15:08:48.347 INFO:teuthology.orchestra.run.smithi161.stdout:2256 trunc from 0xe3e0845 to 0xa64db7a 2024-09-21T15:08:48.350 INFO:teuthology.orchestra.run.smithi161.stdout:2802 read 0xa011e6 thru 0xa03449 (0x2264 bytes) 2024-09-21T15:08:48.350 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.350 INFO:teuthology.orchestra.run.smithi161.stdout:2804 read 0x2e36ea5 thru 0x2e3e901 (0x7a5d bytes) 2024-09-21T15:08:48.350 INFO:teuthology.orchestra.run.smithi161.stdout:2805 write 0x55b1680 thru 0x55b6250 (0x4bd1 bytes) 2024-09-21T15:08:48.377 INFO:teuthology.orchestra.run.smithi161.stdout:2863 writesame 0xb177e7a thru 0xb184895 data_size 0x82(0xca1c bytes) 2024-09-21T15:08:48.384 INFO:teuthology.orchestra.run.smithi161.stdout:2864 trunc from 0xb184896 to 0xc468944 2024-09-21T15:08:48.392 INFO:teuthology.orchestra.run.smithi161.stdout:3046 write 0x1d0d498 thru 0x1d1113e (0x3ca7 bytes) 2024-09-21T15:08:48.392 INFO:teuthology.orchestra.run.smithi161.stdout:2807 write 0xb534d69 thru 0xb542228 (0xd4c0 bytes) 2024-09-21T15:08:48.401 INFO:teuthology.orchestra.run.smithi161.stdout:3047 read 0x556d593 thru 0x557c658 (0xf0c6 bytes) 2024-09-21T15:08:48.402 INFO:teuthology.orchestra.run.smithi161.stdout:3048 writesame 0x5e14364 thru 0x5e1df53 data_size 0x28(0x9bf0 bytes) 2024-09-21T15:08:48.408 INFO:teuthology.orchestra.run.smithi161.stdout:3049 write 0x87450f0 thru 0x874a9bc (0x58cd bytes) 2024-09-21T15:08:48.421 INFO:teuthology.orchestra.run.smithi161.stdout:2865 trunc from 0xc468944 to 0x94d6150 2024-09-21T15:08:48.421 INFO:teuthology.orchestra.run.smithi161.stdout:3050 write 0x6f70d53 thru 0x6f7d90e (0xcbbc bytes) 2024-09-21T15:08:48.452 INFO:teuthology.orchestra.run.smithi161.stdout:2260 write 0xed63e12 thru 0xed65589 (0x1778 bytes) 2024-09-21T15:08:48.458 INFO:teuthology.orchestra.run.smithi161.stdout:2808 write 0xcf4930e thru 0xcf4e15a (0x4e4d bytes) 2024-09-21T15:08:48.465 INFO:teuthology.orchestra.run.smithi161.stdout:2867 trunc from 0x94d6150 to 0xb0d4adf 2024-09-21T15:08:48.473 INFO:teuthology.orchestra.run.smithi161.stdout:2261 writesame 0x9528275 thru 0x952b865 data_size 0x1(0x35f1 bytes) 2024-09-21T15:08:48.475 INFO:teuthology.orchestra.run.smithi161.stdout:2519 read 0x206aeea thru 0x20741b3 (0x92ca bytes) 2024-09-21T15:08:48.484 INFO:teuthology.orchestra.run.smithi161.stdout:2810 write 0x537eb98 thru 0x5382b73 (0x3fdc bytes) 2024-09-21T15:08:48.489 INFO:teuthology.orchestra.run.smithi161.stdout:3051 writesame 0xa2a11af thru 0xa2a1bb3 data_size 0x13(0xa05 bytes) 2024-09-21T15:08:48.497 INFO:teuthology.orchestra.run.smithi161.stdout:3053 writesame 0x7ce5e61 thru 0x7ced7b3 data_size 0x57(0x7953 bytes) 2024-09-21T15:08:48.502 INFO:teuthology.orchestra.run.smithi161.stdout:2520 read 0xce79490 thru 0xce820a1 (0x8c12 bytes) 2024-09-21T15:08:48.503 INFO:teuthology.orchestra.run.smithi161.stdout:2522 write 0x4ed733 thru 0x4f3cee (0x65bc bytes) 2024-09-21T15:08:48.507 INFO:teuthology.orchestra.run.smithi161.stdout:2811 write 0xb493dbf thru 0xb496119 (0x235b bytes) 2024-09-21T15:08:48.511 INFO:teuthology.orchestra.run.smithi161.stdout:3055 punch from 0x8e8a56b to 0x8e8b41f, (0xeb4 bytes) 2024-09-21T15:08:48.511 INFO:teuthology.orchestra.run.smithi161.stdout:3057 punch from 0x2ccdf95 to 0x2cd903a, (0xb0a5 bytes) 2024-09-21T15:08:48.511 INFO:teuthology.orchestra.run.smithi161.stdout:3059 punch from 0x6fda99e to 0x6fe1e66, (0x74c8 bytes) 2024-09-21T15:08:48.512 INFO:teuthology.orchestra.run.smithi161.stdout:3060 read 0x6f69eee thru 0x6f6c86e (0x2981 bytes) 2024-09-21T15:08:48.512 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.512 INFO:teuthology.orchestra.run.smithi161.stdout:2871 punch from 0x895ea21 to 0x8969c7b, (0xb25a bytes) 2024-09-21T15:08:48.512 INFO:teuthology.orchestra.run.smithi161.stdout:2872 write 0x28163d0 thru 0x281b794 (0x53c5 bytes) 2024-09-21T15:08:48.513 INFO:teuthology.orchestra.run.smithi161.stdout:3061 read 0x6916098 thru 0x6920f81 (0xaeea bytes) 2024-09-21T15:08:48.518 INFO:teuthology.orchestra.run.smithi161.stdout:3062 trunc from 0xa2a1bb4 to 0x91476b4 2024-09-21T15:08:48.520 INFO:teuthology.orchestra.run.smithi161.stdout:2812 trunc from 0xcf4e15b to 0xc59ea66 2024-09-21T15:08:48.532 INFO:teuthology.orchestra.run.smithi161.stdout:2264 trunc from 0xed6558a to 0xab13f9 2024-09-21T15:08:48.536 INFO:teuthology.orchestra.run.smithi161.stdout:2526 read 0x9870765 thru 0x9877de0 (0x767c bytes) 2024-09-21T15:08:48.536 INFO:teuthology.orchestra.run.smithi161.stdout:2528 write 0x307cc39 thru 0x307fe2d (0x31f5 bytes) 2024-09-21T15:08:48.554 INFO:teuthology.orchestra.run.smithi161.stdout:2529 writesame 0x702da58 thru 0x703899b data_size 0x4(0xaf44 bytes) 2024-09-21T15:08:48.562 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.562 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.562 INFO:teuthology.orchestra.run.smithi161.stdout:2876 read 0x50a639d thru 0x50ac299 (0x5efd bytes) 2024-09-21T15:08:48.568 INFO:teuthology.orchestra.run.smithi161.stdout:2813 writesame 0xa866e9 thru 0xa8ecbf data_size 0x51(0x85d7 bytes) 2024-09-21T15:08:48.571 INFO:teuthology.orchestra.run.smithi161.stdout:3063 read 0x2e7638c thru 0x2e7c8ab (0x6520 bytes) 2024-09-21T15:08:48.573 INFO:teuthology.orchestra.run.smithi161.stdout:3065 punch from 0x3bd9efb to 0x3be3fdf, (0xa0e4 bytes) 2024-09-21T15:08:48.573 INFO:teuthology.orchestra.run.smithi161.stdout:3066 write 0x8f543e9 thru 0x8f588e9 (0x4501 bytes) 2024-09-21T15:08:48.583 INFO:teuthology.orchestra.run.smithi161.stdout:2530 write 0x9652764 thru 0x965d93c (0xb1d9 bytes) 2024-09-21T15:08:48.589 INFO:teuthology.orchestra.run.smithi161.stdout:3067 read 0x1aa1dba thru 0x1ab11ff (0xf446 bytes) 2024-09-21T15:08:48.594 INFO:teuthology.orchestra.run.smithi161.stdout:3068 trunc from 0x91476b4 to 0x6e79bf7 2024-09-21T15:08:48.597 INFO:teuthology.orchestra.run.smithi161.stdout:2814 punch from 0x279e77d to 0x27a4121, (0x59a4 bytes) 2024-09-21T15:08:48.598 INFO:teuthology.orchestra.run.smithi161.stdout:2815 writesame 0x13083c9 thru 0x130e1f6 data_size 0x5(0x5e2e bytes) 2024-09-21T15:08:48.613 INFO:teuthology.orchestra.run.smithi161.stdout:2817 write 0xa02ebeb thru 0xa03e80b (0xfc21 bytes) 2024-09-21T15:08:48.619 INFO:teuthology.orchestra.run.smithi161.stdout:2531 trunc from 0xeda864d to 0x9203d3b 2024-09-21T15:08:48.620 INFO:teuthology.orchestra.run.smithi161.stdout:2879 write 0xe53c1dc thru 0xe54a291 (0xe0b6 bytes) 2024-09-21T15:08:48.622 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.2 2024-09-21T15:08:48.622 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:08:48.622 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.2 2024-09-21T15:08:48.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Restarting daemon 2024-09-21T15:08:48.622 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 2024-09-21T15:08:48.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Started 2024-09-21T15:08:48.625 INFO:tasks.rbd_mirror_thrash:waiting for 90 secs before thrashing 2024-09-21T15:08:48.634 INFO:teuthology.orchestra.run.smithi161.stdout:2818 write 0x76cb77e thru 0x76d37cb (0x804e bytes) 2024-09-21T15:08:48.658 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.658 INFO:teuthology.orchestra.run.smithi161.stdout:2882 punch from 0x74a85e5 to 0x74b4dbd, (0xc7d8 bytes) 2024-09-21T15:08:48.658 INFO:teuthology.orchestra.run.smithi161.stdout:2883 punch from 0xa2f168b to 0xa2f5b09, (0x447e bytes) 2024-09-21T15:08:48.658 INFO:teuthology.orchestra.run.smithi161.stdout:2820 write 0xa1dd1af thru 0xa1e2869 (0x56bb bytes) 2024-09-21T15:08:48.669 INFO:teuthology.orchestra.run.smithi161.stdout:2886 trunc from 0xe54a292 to 0x7f33a86 2024-09-21T15:08:48.673 INFO:teuthology.orchestra.run.smithi161.stdout:3069 read 0x5fbe0a3 thru 0x5fbea4d (0x9ab bytes) 2024-09-21T15:08:48.673 INFO:teuthology.orchestra.run.smithi161.stdout:2265 write 0xa294a40 thru 0xa29a019 (0x55da bytes) 2024-09-21T15:08:48.675 INFO:teuthology.orchestra.run.smithi161.stdout:2821 trunc from 0xc59ea66 to 0x895a8fc 2024-09-21T15:08:48.676 INFO:teuthology.orchestra.run.smithi161.stdout:2533 write 0xf9de36 thru 0xfa42e5 (0x64b0 bytes) 2024-09-21T15:08:48.691 INFO:teuthology.orchestra.run.smithi161.stdout:2266 trunc from 0xa29a01a to 0x8266ab1 2024-09-21T15:08:48.697 INFO:teuthology.orchestra.run.smithi161.stdout:2535 write 0x1868f9f thru 0x186dbff (0x4c61 bytes) 2024-09-21T15:08:48.717 INFO:teuthology.orchestra.run.smithi161.stdout:3071 writesame 0xae28fa7 thru 0xae300ed data_size 0x1(0x7147 bytes) 2024-09-21T15:08:48.722 INFO:teuthology.orchestra.run.smithi161.stdout:2536 write 0x8242241 thru 0x8244916 (0x26d6 bytes) 2024-09-21T15:08:48.729 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.731 INFO:teuthology.orchestra.run.smithi161.stdout:2888 read 0x4c9c83b thru 0x4ca3866 (0x702c bytes) 2024-09-21T15:08:48.732 INFO:teuthology.orchestra.run.smithi161.stdout:2889 write 0x189f098 thru 0x18a2754 (0x36bd bytes) 2024-09-21T15:08:48.737 INFO:teuthology.orchestra.run.smithi161.stdout:2822 read 0x1fd5eea thru 0x1fe56f3 (0xf80a bytes) 2024-09-21T15:08:48.738 INFO:teuthology.orchestra.run.smithi161.stdout:2824 punch from 0x17272ff to 0x172a640, (0x3341 bytes) 2024-09-21T15:08:48.738 INFO:teuthology.orchestra.run.smithi161.stdout:2826 read 0x79e6c29 thru 0x79e95e1 (0x29b9 bytes) 2024-09-21T15:08:48.739 INFO:teuthology.orchestra.run.smithi161.stdout:2827 write 0x486fec7 thru 0x4874b1e (0x4c58 bytes) 2024-09-21T15:08:48.745 INFO:teuthology.orchestra.run.smithi161.stdout:2539 read 0x3be15f6 thru 0x3be9bb0 (0x85bb bytes) 2024-09-21T15:08:48.751 INFO:teuthology.orchestra.run.smithi161.stdout:2830 read 0x4821456 thru 0x482162b (0x1d6 bytes) 2024-09-21T15:08:48.753 INFO:teuthology.orchestra.run.smithi161.stdout:2831 read 0x19ae2c9 thru 0x19b438f (0x60c7 bytes) 2024-09-21T15:08:48.753 INFO:teuthology.orchestra.run.smithi161.stdout:2833 write 0x8149282 thru 0x81519b2 (0x8731 bytes) 2024-09-21T15:08:48.778 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.777+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:08:48.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x5601687569c0 2024-09-21T15:08:48.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x560168756a90 2024-09-21T15:08:48.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016878a1a0 2024-09-21T15:08:48.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016878ab60 2024-09-21T15:08:48.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016878ac30 2024-09-21T15:08:48.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016878add0 2024-09-21T15:08:48.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016878b040 2024-09-21T15:08:48.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016878b110 2024-09-21T15:08:48.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016878b1e0 2024-09-21T15:08:48.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016878ba00 2024-09-21T15:08:48.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016878bc70 2024-09-21T15:08:48.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x560168802750 2024-09-21T15:08:48.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x5601688028f0 2024-09-21T15:08:48.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x560168803860 2024-09-21T15:08:48.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x560168803ee0 2024-09-21T15:08:48.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x560168d92340 2024-09-21T15:08:48.788 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x560168ff6dd0 2024-09-21T15:08:48.788 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x5601692225b0 2024-09-21T15:08:48.788 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x5601692b52b0 2024-09-21T15:08:48.788 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x560169f100d0 2024-09-21T15:08:48.788 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x560169f10270 2024-09-21T15:08:48.788 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9c70 2024-09-21T15:08:48.788 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6340 2024-09-21T15:08:48.788 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e64e0 2024-09-21T15:08:48.788 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6a90 2024-09-21T15:08:48.788 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e72b0 2024-09-21T15:08:48.788 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72d00 2024-09-21T15:08:48.788 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72dd0 2024-09-21T15:08:48.789 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:08:48.781+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72ea0 2024-09-21T15:08:48.793 INFO:teuthology.orchestra.run.smithi161.stdout:3073 write 0xd9833ca thru 0xd98cd3a (0x9971 bytes) 2024-09-21T15:08:48.819 INFO:teuthology.orchestra.run.smithi161.stdout:2890 read 0x44d62fe thru 0x44da7d9 (0x44dc bytes) 2024-09-21T15:08:48.820 INFO:teuthology.orchestra.run.smithi161.stdout:2891 punch from 0x6303f99 to 0x6312320, (0xe387 bytes) 2024-09-21T15:08:48.820 INFO:teuthology.orchestra.run.smithi161.stdout:2892 read 0x78d3bbc thru 0x78d517e (0x15c3 bytes) 2024-09-21T15:08:48.820 INFO:teuthology.orchestra.run.smithi161.stdout:2893 read 0x6d17653 thru 0x6d22c52 (0xb600 bytes) 2024-09-21T15:08:48.821 INFO:teuthology.orchestra.run.smithi161.stdout:2540 write 0xb598447 thru 0xb5a652f (0xe0e9 bytes) 2024-09-21T15:08:48.823 INFO:teuthology.orchestra.run.smithi161.stdout:3075 trunc from 0xd98cd3b to 0xd014eae 2024-09-21T15:08:48.824 INFO:teuthology.orchestra.run.smithi161.stdout:2268 write 0x961426f thru 0x9614f34 (0xcc6 bytes) 2024-09-21T15:08:48.833 INFO:teuthology.orchestra.run.smithi161.stdout:2834 writesame 0xa2d49ab thru 0xa2df960 data_size 0x99(0xafb6 bytes) 2024-09-21T15:08:48.836 INFO:teuthology.orchestra.run.smithi161.stdout:2541 write 0x3cdfb4e thru 0x3cea8f3 (0xada6 bytes) 2024-09-21T15:08:48.841 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone18 from 0x48e3321 (overlap 0x1ed089c) to 0xc536a4 2024-09-21T15:08:48.844 INFO:teuthology.orchestra.run.smithi161.stdout:2835 writesame 0x225815d thru 0x225c2a3 data_size 0x1(0x4147 bytes) 2024-09-21T15:08:48.861 INFO:teuthology.orchestra.run.smithi161.stdout:2895 writesame 0x8137bc2 thru 0x8145f18 data_size 0x1(0xe357 bytes) 2024-09-21T15:08:48.866 INFO:teuthology.orchestra.run.smithi161.stdout:2836 writesame 0x74cd77 thru 0x752c69 data_size 0x1(0x5ef3 bytes) 2024-09-21T15:08:48.869 INFO:teuthology.orchestra.run.smithi161.stdout:3076 writesame 0x7c98ad thru 0x7d92da data_size 0x1f(0xfa2e bytes) 2024-09-21T15:08:48.872 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.872 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.872 INFO:teuthology.orchestra.run.smithi161.stdout:2546 punch from 0x111e167 to 0x111e815, (0x6ae bytes) 2024-09-21T15:08:48.872 INFO:teuthology.orchestra.run.smithi161.stdout:2896 punch from 0x52eef1d to 0x52f9115, (0xa1f8 bytes) 2024-09-21T15:08:48.872 INFO:teuthology.orchestra.run.smithi161.stdout:2901 trunc from 0x8145f19 to 0x817aa62 2024-09-21T15:08:48.889 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.889 INFO:teuthology.orchestra.run.smithi161.stdout:3078 write 0xb78dc7f thru 0xb78eb8e (0xf10 bytes) 2024-09-21T15:08:48.910 INFO:teuthology.orchestra.run.smithi161.stdout:2838 write 0x64d2c0 thru 0x64d3e0 (0x121 bytes) 2024-09-21T15:08:48.911 INFO:teuthology.orchestra.run.smithi161.stdout:2269 writesame 0xe358004 thru 0xe35ae65 data_size 0x3(0x2e62 bytes) 2024-09-21T15:08:48.916 INFO:teuthology.orchestra.run.smithi161.stdout:2270 punch from 0x7728253 to 0x77297fc, (0x15a9 bytes) 2024-09-21T15:08:48.916 INFO:teuthology.orchestra.run.smithi161.stdout:2271 read 0x7c50752 thru 0x7c5ca1d (0xc2cc bytes) 2024-09-21T15:08:48.916 INFO:teuthology.orchestra.run.smithi161.stdout:2272 read 0x339f227 thru 0x33ade5c (0xec36 bytes) 2024-09-21T15:08:48.917 INFO:teuthology.orchestra.run.smithi161.stdout:2273 flatten 2024-09-21T15:08:48.918 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:48.917+0000 7f68dd664700 -1 rbd::mirror::ImageReplayer: 0x5581cd214500 [3/ab585917-bbfb-41ce-a268-5e9596e12ef3] start: already running 2024-09-21T15:08:48.926 INFO:teuthology.orchestra.run.smithi161.stdout:2840 writesame 0x4330e66 thru 0x4333361 data_size 0x3(0x24fc bytes) 2024-09-21T15:08:48.927 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:48.925+0000 7f68dde65700 -1 rbd::mirror::ImageReplayer: 0x5581cd214280 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:08:48.927 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:48.925+0000 7f68dde65700 -1 rbd::mirror::ImageReplayer: 0x5581cb30ca00 [3/6019fe59-e961-41f3-881e-27522f0e43d6] start: already running 2024-09-21T15:08:48.927 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:48.925+0000 7f68dde65700 -1 rbd::mirror::ImageReplayer: 0x5581cb30ca00 [3/6019fe59-e961-41f3-881e-27522f0e43d6] start: already running 2024-09-21T15:08:48.927 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:48.925+0000 7f68dde65700 -1 rbd::mirror::ImageReplayer: 0x5581cd214000 [3/2df7d008-2aa8-45c9-992d-6135bdf46eec] start: already running 2024-09-21T15:08:48.931 INFO:teuthology.orchestra.run.smithi161.stdout:3080 trunc from 0xd014eae to 0x6f00173 2024-09-21T15:08:48.939 INFO:teuthology.orchestra.run.smithi161.stdout:2902 read 0x6d619bc thru 0x6d6b6e6 (0x9d2b bytes) 2024-09-21T15:08:48.939 INFO:teuthology.orchestra.run.smithi161.stdout:2903 read 0x1898ae3 thru 0x18a01d4 (0x76f2 bytes) 2024-09-21T15:08:48.942 INFO:teuthology.orchestra.run.smithi161.stdout:2547 write 0xc4a87f1 thru 0xc4a98d4 (0x10e4 bytes) 2024-09-21T15:08:48.945 INFO:teuthology.orchestra.run.smithi161.stdout:2904 trunc from 0x817aa62 to 0xa3bda93 2024-09-21T15:08:48.948 INFO:teuthology.orchestra.run.smithi161.stdout:2841 read 0x44fe92d thru 0x45083fb (0x9acf bytes) 2024-09-21T15:08:48.948 INFO:teuthology.orchestra.run.smithi161.stdout:2843 write 0x42a4cfa thru 0x42a5f72 (0x1279 bytes) 2024-09-21T15:08:48.958 INFO:teuthology.orchestra.run.smithi161.stdout:2551 write 0x5523ff6 thru 0x552c29e (0x82a9 bytes) 2024-09-21T15:08:48.964 INFO:teuthology.orchestra.run.smithi161.stdout:2844 punch from 0x5fbead4 to 0x5fcc469, (0xd995 bytes) 2024-09-21T15:08:48.964 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.964 INFO:teuthology.orchestra.run.smithi161.stdout:2848 write 0x746472f thru 0x74656a4 (0xf76 bytes) 2024-09-21T15:08:48.968 INFO:teuthology.orchestra.run.smithi161.stdout:2274 read 0x4bc1b33 thru 0x4bcd641 (0xbb0f bytes) 2024-09-21T15:08:48.969 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:48.969 INFO:teuthology.orchestra.run.smithi161.stdout:2276 read 0x30b2f62 thru 0x30b6dcc (0x3e6b bytes) 2024-09-21T15:08:48.969 INFO:teuthology.orchestra.run.smithi161.stdout:2277 writesame 0x63137df thru 0x631a690 data_size 0x3(0x6eb2 bytes) 2024-09-21T15:08:48.974 INFO:teuthology.orchestra.run.smithi161.stdout:2849 read 0x94bd001 thru 0x94c3899 (0x6899 bytes) 2024-09-21T15:08:48.975 INFO:teuthology.orchestra.run.smithi161.stdout:2552 trunc from 0xc4a98d5 to 0xbe60dd1 2024-09-21T15:08:48.981 INFO:teuthology.orchestra.run.smithi161.stdout:2905 punch from 0x853d9f0 to 0x8548e26, (0xb436 bytes) 2024-09-21T15:08:48.981 INFO:teuthology.orchestra.run.smithi161.stdout:2907 writesame 0x2b816f4 thru 0x2b89403 data_size 0x74(0x7d10 bytes) 2024-09-21T15:08:48.988 INFO:teuthology.orchestra.run.smithi161.stdout:2279 punch from 0x8058a4e to 0x8064385, (0xb937 bytes) 2024-09-21T15:08:49.014 INFO:teuthology.orchestra.run.smithi161.stdout:2850 writesame 0xae78ecd thru 0xae7d22c data_size 0x62(0x4360 bytes) 2024-09-21T15:08:49.021 INFO:teuthology.orchestra.run.smithi161.stdout:2856 writesame 0x2b4577 thru 0x2b8388 data_size 0x23(0x3e12 bytes) 2024-09-21T15:08:49.025 INFO:teuthology.orchestra.run.smithi161.stdout:2556 write 0x470e7e9 thru 0x471cc62 (0xe47a bytes) 2024-09-21T15:08:49.026 INFO:teuthology.orchestra.run.smithi161.stdout:2282 write 0xe708ddd thru 0xe70f272 (0x6496 bytes) 2024-09-21T15:08:49.030 INFO:teuthology.orchestra.run.smithi161.stdout:3081 write 0x93d92cd thru 0x93e7789 (0xe4bd bytes) 2024-09-21T15:08:49.033 INFO:teuthology.orchestra.run.smithi161.stdout:2908 write 0x56b9b94 thru 0x56bed56 (0x51c3 bytes) 2024-09-21T15:08:49.039 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.039 INFO:teuthology.orchestra.run.smithi161.stdout:2859 write 0xa915618 thru 0xa91dce6 (0x86cf bytes) 2024-09-21T15:08:49.045 INFO:teuthology.orchestra.run.smithi161.stdout:2283 read 0x521f92c thru 0x522437a (0x4a4f bytes) 2024-09-21T15:08:49.045 INFO:teuthology.orchestra.run.smithi161.stdout:2284 write 0x6c5652 thru 0x6cda9a (0x8449 bytes) 2024-09-21T15:08:49.050 INFO:teuthology.orchestra.run.smithi161.stdout:2557 write 0x9341d61 thru 0x9345c73 (0x3f13 bytes) 2024-09-21T15:08:49.054 INFO:teuthology.orchestra.run.smithi161.stdout:3083 write 0xe77775 thru 0xe7c1b4 (0x4a40 bytes) 2024-09-21T15:08:49.058 INFO:teuthology.orchestra.run.smithi161.stdout:2862 read 0xae035f6 thru 0xae09709 (0x6114 bytes) 2024-09-21T15:08:49.058 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.062 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.063 INFO:teuthology.orchestra.run.smithi161.stdout:2287 write 0xb0b47e9 thru 0xb0b78b9 (0x30d1 bytes) 2024-09-21T15:08:49.064 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.064 INFO:teuthology.orchestra.run.smithi161.stdout:2559 writesame 0xfbc3f1 thru 0xfc76c1 data_size 0x1(0xb2d1 bytes) 2024-09-21T15:08:49.065 INFO:teuthology.orchestra.run.smithi161.stdout:3084 read 0x13a47ee thru 0x13a579d (0xfb0 bytes) 2024-09-21T15:08:49.065 INFO:teuthology.orchestra.run.smithi161.stdout:3085 read 0x7909d48 thru 0x790f9f6 (0x5caf bytes) 2024-09-21T15:08:49.066 INFO:teuthology.orchestra.run.smithi161.stdout:3086 write 0x5d27d4b thru 0x5d29261 (0x1517 bytes) 2024-09-21T15:08:49.077 INFO:teuthology.orchestra.run.smithi161.stdout:2909 write 0x7320942 thru 0x7327d8d (0x744c bytes) 2024-09-21T15:08:49.080 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.080 INFO:teuthology.orchestra.run.smithi161.stdout:3089 write 0x33a3222 thru 0x33ad7c9 (0xa5a8 bytes) 2024-09-21T15:08:49.087 INFO:teuthology.orchestra.run.smithi161.stdout:2288 writesame 0xd25fd6c thru 0xd26d0a2 data_size 0x1(0xd337 bytes) 2024-09-21T15:08:49.107 INFO:teuthology.orchestra.run.smithi161.stdout:2866 writesame 0xb8f6b7c thru 0xb8f961f data_size 0x2(0x2aa4 bytes) 2024-09-21T15:08:49.107 INFO:teuthology.orchestra.run.smithi161.stdout:2911 read 0xa28baf0 thru 0xa28fad6 (0x3fe7 bytes) 2024-09-21T15:08:49.109 INFO:teuthology.orchestra.run.smithi161.stdout:2561 read 0x94405d1 thru 0x944df5e (0xd98e bytes) 2024-09-21T15:08:49.110 INFO:teuthology.orchestra.run.smithi161.stdout:2562 punch from 0xa7368d2 to 0xa7462e2, (0xfa10 bytes) 2024-09-21T15:08:49.110 INFO:teuthology.orchestra.run.smithi161.stdout:2563 read 0x96e9147 thru 0x96f59db (0xc895 bytes) 2024-09-21T15:08:49.113 INFO:teuthology.orchestra.run.smithi161.stdout:3091 read 0x4b1336f thru 0x4b1900f (0x5ca1 bytes) 2024-09-21T15:08:49.113 INFO:teuthology.orchestra.run.smithi161.stdout:2868 writesame 0x5d65d39 thru 0x5d6ff23 data_size 0x29(0xa1eb bytes) 2024-09-21T15:08:49.114 INFO:teuthology.orchestra.run.smithi161.stdout:3092 read 0x7b78bbd thru 0x7b7feb5 (0x72f9 bytes) 2024-09-21T15:08:49.115 INFO:teuthology.orchestra.run.smithi161.stdout:3093 writesame 0x1ad29a0 thru 0x1ae24a8 data_size 0x1(0xfb09 bytes) 2024-09-21T15:08:49.144 INFO:teuthology.orchestra.run.smithi161.stdout:2869 trunc from 0xb8f9620 to 0x5a0333e 2024-09-21T15:08:49.155 INFO:teuthology.orchestra.run.smithi161.stdout:2564 write 0xccdb328 thru 0xcce5902 (0xa5db bytes) 2024-09-21T15:08:49.162 INFO:teuthology.orchestra.run.smithi161.stdout:3094 read 0x19dbbc7 thru 0x19de176 (0x25b0 bytes) 2024-09-21T15:08:49.163 INFO:teuthology.orchestra.run.smithi161.stdout:3096 write 0x2d833f9 thru 0x2d8569f (0x22a7 bytes) 2024-09-21T15:08:49.171 INFO:teuthology.orchestra.run.smithi161.stdout:2912 writesame 0xd7bec51 thru 0xd7c61df data_size 0xd(0x758f bytes) 2024-09-21T15:08:49.180 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #17, image image_cluster1.client.mirror.2-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent18 2024-09-21T15:08:49.180 INFO:teuthology.orchestra.run.smithi161.stdout:3097 writesame 0x3b2f589 thru 0x3b3b5d9 data_size 0x1(0xc051 bytes) 2024-09-21T15:08:49.181 INFO:teuthology.orchestra.run.smithi161.stdout:2913 write 0xc15904d thru 0xc161843 (0x87f7 bytes) 2024-09-21T15:08:49.189 INFO:teuthology.orchestra.run.smithi161.stdout:2565 trunc from 0xcce5903 to 0x99736de 2024-09-21T15:08:49.217 INFO:teuthology.orchestra.run.smithi161.stdout:2915 write 0x9a7a5b8 thru 0x9a7bfd7 (0x1a20 bytes) 2024-09-21T15:08:49.257 INFO:teuthology.orchestra.run.smithi161.stdout:3367 write 0x334978c thru 0x3353ad0 (0xa345 bytes) 2024-09-21T15:08:49.275 INFO:teuthology.orchestra.run.smithi161.stdout:2566 write 0x5666a9 thru 0x56f7bd (0x9115 bytes) 2024-09-21T15:08:49.282 INFO:teuthology.orchestra.run.smithi161.stdout:2871 write 0xa93d921 thru 0xa93e34f (0xa2f bytes) 2024-09-21T15:08:49.284 INFO:teuthology.orchestra.run.smithi161.stdout:3098 write 0xe1934b6 thru 0xe19dd49 (0xa894 bytes) 2024-09-21T15:08:49.287 INFO:teuthology.orchestra.run.smithi161.stdout:2917 write 0xe2b6680 thru 0xe2bdb79 (0x74fa bytes) 2024-09-21T15:08:49.298 INFO:teuthology.orchestra.run.smithi161.stdout:2567 punch from 0x97a6110 to 0x97ad4b7, (0x73a7 bytes) 2024-09-21T15:08:49.311 INFO:teuthology.orchestra.run.smithi161.stdout:2872 trunc from 0xa93e350 to 0xe5af575 2024-09-21T15:08:49.315 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.315 INFO:teuthology.orchestra.run.smithi161.stdout:3100 writesame 0x33a00ed thru 0x33abe7d data_size 0x1(0xbd91 bytes) 2024-09-21T15:08:49.317 INFO:teuthology.orchestra.run.smithi161.stdout:2568 trunc from 0x99736de to 0xb757e9 2024-09-21T15:08:49.329 INFO:teuthology.orchestra.run.smithi161.stdout:3368 punch from 0x479af47 to 0x47a9ac9, (0xeb82 bytes) 2024-09-21T15:08:49.329 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.329 INFO:teuthology.orchestra.run.smithi161.stdout:2920 read 0x4e7fe4 thru 0x4ea6b5 (0x26d2 bytes) 2024-09-21T15:08:49.330 INFO:teuthology.orchestra.run.smithi161.stdout:2921 read 0xa676481 thru 0xa67aaaf (0x462f bytes) 2024-09-21T15:08:49.330 INFO:teuthology.orchestra.run.smithi161.stdout:2922 punch from 0x238f362 to 0x238f763, (0x401 bytes) 2024-09-21T15:08:49.330 INFO:teuthology.orchestra.run.smithi161.stdout:2923 punch from 0xa19682 to 0xa21a1c, (0x839a bytes) 2024-09-21T15:08:49.330 INFO:teuthology.orchestra.run.smithi161.stdout:2925 writesame 0x17f3831 thru 0x17f390f data_size 0x1(0xdf bytes) 2024-09-21T15:08:49.353 INFO:teuthology.orchestra.run.smithi161.stdout:3101 write 0xd1d79be thru 0xd1e240c (0xaa4f bytes) 2024-09-21T15:08:49.361 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.361 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.361 INFO:teuthology.orchestra.run.smithi161.stdout:2878 write 0x6febf50 thru 0x6fef850 (0x3901 bytes) 2024-09-21T15:08:49.362 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.363 INFO:teuthology.orchestra.run.smithi161.stdout:2928 write 0x54fbdd8 thru 0x5503557 (0x7780 bytes) 2024-09-21T15:08:49.377 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.377 INFO:teuthology.orchestra.run.smithi161.stdout:3105 punch from 0x1c7cb3a to 0x1c80a1d, (0x3ee3 bytes) 2024-09-21T15:08:49.377 INFO:teuthology.orchestra.run.smithi161.stdout:3106 read 0x6356748 thru 0x635c1aa (0x5a63 bytes) 2024-09-21T15:08:49.378 INFO:teuthology.orchestra.run.smithi161.stdout:3107 read 0x61f2a1d thru 0x61f3df1 (0x13d5 bytes) 2024-09-21T15:08:49.379 INFO:teuthology.orchestra.run.smithi161.stdout:3108 read 0x225488f thru 0x225969c (0x4e0e bytes) 2024-09-21T15:08:49.379 INFO:teuthology.orchestra.run.smithi161.stdout:3369 write 0x5c67bf4 thru 0x5c6cbfa (0x5007 bytes) 2024-09-21T15:08:49.380 INFO:teuthology.orchestra.run.smithi161.stdout:3109 write 0xac7d448 thru 0xac8a351 (0xcf0a bytes) 2024-09-21T15:08:49.386 INFO:teuthology.orchestra.run.smithi161.stdout:2881 punch from 0x35b410f to 0x35bd446, (0x9337 bytes) 2024-09-21T15:08:49.386 INFO:teuthology.orchestra.run.smithi161.stdout:2882 writesame 0x5e94157 thru 0x5ea315a data_size 0x2(0xf004 bytes) 2024-09-21T15:08:49.411 INFO:teuthology.orchestra.run.smithi161.stdout:3110 trunc from 0xe19dd4a to 0x9c0f5ca 2024-09-21T15:08:49.424 INFO:teuthology.orchestra.run.smithi161.stdout:3371 trunc from 0x5c6cbfb to 0x14d43d5 2024-09-21T15:08:49.424 INFO:teuthology.orchestra.run.smithi161.stdout:2883 read 0xdacf7ce thru 0xdad9501 (0x9d34 bytes) 2024-09-21T15:08:49.425 INFO:teuthology.orchestra.run.smithi161.stdout:2884 read 0xcc53b3c thru 0xcc580d0 (0x4595 bytes) 2024-09-21T15:08:49.425 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.425 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.425 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.425 INFO:teuthology.orchestra.run.smithi161.stdout:2888 write 0x85d758e thru 0x85d98af (0x2322 bytes) 2024-09-21T15:08:49.438 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.438 INFO:teuthology.orchestra.run.smithi161.stdout:2930 writesame 0xa812bc8 thru 0xa81ac3a data_size 0x61(0x8073 bytes) 2024-09-21T15:08:49.442 INFO:teuthology.orchestra.run.smithi161.stdout:2889 writesame 0x9be11f5 thru 0x9bec380 data_size 0x16(0xb18c bytes) 2024-09-21T15:08:49.451 INFO:teuthology.orchestra.run.smithi161.stdout:2570 writesame 0xc8d48c1 thru 0xc8d7d3d data_size 0x3(0x347d bytes) 2024-09-21T15:08:49.461 INFO:teuthology.orchestra.run.smithi161.stdout:2890 read 0xd5947bb thru 0xd59683c (0x2082 bytes) 2024-09-21T15:08:49.461 INFO:teuthology.orchestra.run.smithi161.stdout:2891 writesame 0x42f98f6 thru 0x42ff481 data_size 0x3f(0x5b8c bytes) 2024-09-21T15:08:49.470 INFO:teuthology.orchestra.run.smithi161.stdout:2571 read 0xb2daf83 thru 0xb2db8ed (0x96b bytes) 2024-09-21T15:08:49.470 INFO:teuthology.orchestra.run.smithi161.stdout:2573 write 0xa1ffbd9 thru 0xa208bf6 (0x901e bytes) 2024-09-21T15:08:49.504 INFO:teuthology.orchestra.run.smithi161.stdout:2931 read 0x805078a thru 0x8050e61 (0x6d8 bytes) 2024-09-21T15:08:49.504 INFO:teuthology.orchestra.run.smithi161.stdout:2934 read 0xbce4d8d thru 0xbcf433c (0xf5b0 bytes) 2024-09-21T15:08:49.505 INFO:teuthology.orchestra.run.smithi161.stdout:2892 read 0x24fc2b4 thru 0x24ff6c3 (0x3410 bytes) 2024-09-21T15:08:49.505 INFO:teuthology.orchestra.run.smithi161.stdout:2935 write 0x5a46281 thru 0x5a5018a (0x9f0a bytes) 2024-09-21T15:08:49.513 INFO:teuthology.orchestra.run.smithi161.stdout:2893 write 0xd4a87aa thru 0xd4b3b6b (0xb3c2 bytes) 2024-09-21T15:08:49.560 INFO:teuthology.orchestra.run.smithi161.stdout:2575 write 0xaddfeb7 thru 0xadebe16 (0xbf60 bytes) 2024-09-21T15:08:49.569 INFO:teuthology.orchestra.run.smithi161.stdout:2897 read 0x6c2348c thru 0x6c3019f (0xcd14 bytes) 2024-09-21T15:08:49.570 INFO:teuthology.orchestra.run.smithi161.stdout:2898 write 0x56dd722 thru 0x56e0e6d (0x374c bytes) 2024-09-21T15:08:49.599 INFO:teuthology.orchestra.run.smithi161.stdout:2578 read 0x720a93 thru 0x72b378 (0xa8e6 bytes) 2024-09-21T15:08:49.600 INFO:teuthology.orchestra.run.smithi161.stdout:2579 punch from 0xc09fa36 to 0xc0a2426, (0x29f0 bytes) 2024-09-21T15:08:49.600 INFO:teuthology.orchestra.run.smithi161.stdout:2580 read 0xade0dc5 thru 0xade4135 (0x3371 bytes) 2024-09-21T15:08:49.601 INFO:teuthology.orchestra.run.smithi161.stdout:2899 punch from 0xd7b83db to 0xd7c0a9b, (0x86c0 bytes) 2024-09-21T15:08:49.601 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.601 INFO:teuthology.orchestra.run.smithi161.stdout:2901 write 0x3cc3588 thru 0x3cc4c37 (0x16b0 bytes) 2024-09-21T15:08:49.602 INFO:teuthology.orchestra.run.smithi161.stdout:2584 write 0x62e63d5 thru 0x62eb84a (0x5476 bytes) 2024-09-21T15:08:49.608 INFO:teuthology.orchestra.run.smithi161.stdout:3112 read 0x7374b80 thru 0x73834e4 (0xe965 bytes) 2024-09-21T15:08:49.609 INFO:teuthology.orchestra.run.smithi161.stdout:3113 read 0x732f2f6 thru 0x73310b7 (0x1dc2 bytes) 2024-09-21T15:08:49.609 INFO:teuthology.orchestra.run.smithi161.stdout:3114 punch from 0x5750993 to 0x57538d4, (0x2f41 bytes) 2024-09-21T15:08:49.609 INFO:teuthology.orchestra.run.smithi161.stdout:3117 write 0x8fb6d3b thru 0x8fc459d (0xd863 bytes) 2024-09-21T15:08:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:2936 trunc from 0xe2bdb7a to 0x7f3f2eb 2024-09-21T15:08:49.622 INFO:teuthology.orchestra.run.smithi161.stdout:2903 read 0x967eb95 thru 0x967f731 (0xb9d bytes) 2024-09-21T15:08:49.622 INFO:teuthology.orchestra.run.smithi161.stdout:2904 read 0x292aaa0 thru 0x29355b6 (0xab17 bytes) 2024-09-21T15:08:49.623 INFO:teuthology.orchestra.run.smithi161.stdout:2905 read 0x958b128 thru 0x9597566 (0xc43f bytes) 2024-09-21T15:08:49.624 INFO:teuthology.orchestra.run.smithi161.stdout:2906 trunc from 0xe5af575 to 0xdf04487 2024-09-21T15:08:49.635 INFO:teuthology.orchestra.run.smithi161.stdout:3119 trunc from 0x9c0f5ca to 0xfc3b43 2024-09-21T15:08:49.645 INFO:teuthology.orchestra.run.smithi161.stdout:2585 trunc from 0xc8d7d3e to 0x3cfdc0b 2024-09-21T15:08:49.669 INFO:teuthology.orchestra.run.smithi161.stdout:2289 read 0xcd1d276 thru 0xcd26a3e (0x97c9 bytes) 2024-09-21T15:08:49.669 INFO:teuthology.orchestra.run.smithi161.stdout:2290 write 0x57461e6 thru 0x575378e (0xd5a9 bytes) 2024-09-21T15:08:49.698 INFO:teuthology.orchestra.run.smithi161.stdout:3121 trunc from 0xfc3b43 to 0x14b11d2 2024-09-21T15:08:49.719 INFO:teuthology.orchestra.run.smithi161.stdout:2587 punch from 0xe946f4 to 0xe971d2, (0x2ade bytes) 2024-09-21T15:08:49.719 INFO:teuthology.orchestra.run.smithi161.stdout:2588 writesame 0xb72503 thru 0xb800df data_size 0x1(0xdbdd bytes) 2024-09-21T15:08:49.727 INFO:teuthology.orchestra.run.smithi161.stdout:2291 trunc from 0xe70f273 to 0x551e60 2024-09-21T15:08:49.739 INFO:teuthology.orchestra.run.smithi161.stdout:3122 trunc from 0x14b11d2 to 0x5f3ccdd 2024-09-21T15:08:49.749 INFO:teuthology.orchestra.run.smithi161.stdout:3372 write 0xb153580 thru 0xb161162 (0xdbe3 bytes) 2024-09-21T15:08:49.750 INFO:teuthology.orchestra.run.smithi161.stdout:2937 read 0x19a6a64 thru 0x19b5dc5 (0xf362 bytes) 2024-09-21T15:08:49.764 INFO:teuthology.orchestra.run.smithi161.stdout:2908 writesame 0xebb0536 thru 0xebbc8cf data_size 0x1(0xc39a bytes) 2024-09-21T15:08:49.770 INFO:teuthology.orchestra.run.smithi161.stdout:2909 write 0xdd60b1e thru 0xdd68066 (0x7549 bytes) 2024-09-21T15:08:49.779 INFO:teuthology.orchestra.run.smithi161.stdout:3374 read 0x35ff78e thru 0x360d623 (0xde96 bytes) 2024-09-21T15:08:49.779 INFO:teuthology.orchestra.run.smithi161.stdout:3375 read 0x993f585 thru 0x994b2b4 (0xbd30 bytes) 2024-09-21T15:08:49.779 INFO:teuthology.orchestra.run.smithi161.stdout:3381 punch from 0x17d04a to 0x18580d, (0x87c3 bytes) 2024-09-21T15:08:49.779 INFO:teuthology.orchestra.run.smithi161.stdout:3382 write 0xa1de2b0 thru 0xa1e89a2 (0xa6f3 bytes) 2024-09-21T15:08:49.781 INFO:teuthology.orchestra.run.smithi161.stdout:3124 clone 18 order 18 su 16384 sc 10 2024-09-21T15:08:49.787 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:08:49.788+0000 7f7fd044c700 -1 reset not still connected to 0x5636aea728f0 2024-09-21T15:08:49.789 INFO:teuthology.orchestra.run.smithi161.stdout:2910 punch from 0x100ec67 to 0x1019f24, (0xb2bd bytes) 2024-09-21T15:08:49.789 INFO:teuthology.orchestra.run.smithi161.stdout:2912 writesame 0x5d1a40e thru 0x5d2a367 data_size 0xf(0xff5a bytes) 2024-09-21T15:08:49.795 INFO:teuthology.orchestra.run.smithi161.stdout:2938 write 0xde2c38e thru 0xde39053 (0xccc6 bytes) 2024-09-21T15:08:49.809 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.809 INFO:teuthology.orchestra.run.smithi161.stdout:3384 write 0x963db5c thru 0x9647dbb (0xa260 bytes) 2024-09-21T15:08:49.812 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.813 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.813 INFO:teuthology.orchestra.run.smithi161.stdout:2915 writesame 0xa702662 thru 0xa70faf0 data_size 0x1(0xd48f bytes) 2024-09-21T15:08:49.832 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.839 INFO:teuthology.orchestra.run.smithi161.stdout:2940 trunc from 0xde39054 to 0xb655248 2024-09-21T15:08:49.841 INFO:teuthology.orchestra.run.smithi161.stdout:2589 writesame 0xa95cbbc thru 0xa95f3ca data_size 0x7(0x280f bytes) 2024-09-21T15:08:49.843 INFO:teuthology.orchestra.run.smithi161.stdout:3386 trunc from 0xb161163 to 0xb3b40ad 2024-09-21T15:08:49.845 INFO:teuthology.orchestra.run.smithi161.stdout:2590 punch from 0x814dce2 to 0x815dcc4, (0xffe2 bytes) 2024-09-21T15:08:49.845 INFO:teuthology.orchestra.run.smithi161.stdout:2591 punch from 0x5e4b4bf to 0x5e55c22, (0xa763 bytes) 2024-09-21T15:08:49.908 INFO:teuthology.orchestra.run.smithi161.stdout:3388 clone 20 order 24 su 524288 sc 14 2024-09-21T15:08:49.908 INFO:teuthology.orchestra.run.smithi161.stdout:2293 writesame 0x9e801d8 thru 0x9e8d544 data_size 0x19(0xd36d bytes) 2024-09-21T15:08:49.911 INFO:teuthology.orchestra.run.smithi161.stdout:2592 writesame 0xe2f28e7 thru 0xe2fc3cd data_size 0x37(0x9ae7 bytes) 2024-09-21T15:08:49.916 INFO:teuthology.orchestra.run.smithi161.stdout:2593 read 0x46381f0 thru 0x463de40 (0x5c51 bytes) 2024-09-21T15:08:49.917 INFO:teuthology.orchestra.run.smithi161.stdout:2916 write 0xedddb3f thru 0xede3d3a (0x61fc bytes) 2024-09-21T15:08:49.917 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.917 INFO:teuthology.orchestra.run.smithi161.stdout:2595 write 0x9941862 thru 0x994605a (0x47f9 bytes) 2024-09-21T15:08:49.933 INFO:teuthology.orchestra.run.smithi161.stdout:2598 read 0x6a8402e thru 0x6a925e4 (0xe5b7 bytes) 2024-09-21T15:08:49.933 INFO:teuthology.orchestra.run.smithi161.stdout:2600 punch from 0xadb75a to 0xaeb60e, (0xfeb4 bytes) 2024-09-21T15:08:49.933 INFO:teuthology.orchestra.run.smithi161.stdout:2601 write 0x6efac2f thru 0x6f06741 (0xbb13 bytes) 2024-09-21T15:08:49.933 INFO:teuthology.orchestra.run.smithi161.stdout:2917 trunc from 0xede3d3b to 0xd8a2085 2024-09-21T15:08:49.946 INFO:teuthology.orchestra.run.smithi161.stdout:2602 write 0x96f0373 thru 0x96fd9c7 (0xd655 bytes) 2024-09-21T15:08:49.951 INFO:teuthology.orchestra.run.smithi161.stdout:2941 write 0xde7dc43 thru 0xde82e3a (0x51f8 bytes) 2024-09-21T15:08:49.956 INFO:teuthology.orchestra.run.smithi161.stdout:2294 writesame 0xb3f0f53 thru 0xb3fae14 data_size 0x7(0x9ec2 bytes) 2024-09-21T15:08:49.961 INFO:teuthology.orchestra.run.smithi161.stdout:2295 read 0x8851157 thru 0x8853150 (0x1ffa bytes) 2024-09-21T15:08:49.961 INFO:teuthology.orchestra.run.smithi161.stdout:2299 write 0x8e38fe5 thru 0x8e3eafa (0x5b16 bytes) 2024-09-21T15:08:49.964 INFO:teuthology.orchestra.run.smithi161.stdout:2603 read 0x766f38 thru 0x774fe4 (0xe0ad bytes) 2024-09-21T15:08:49.965 INFO:teuthology.orchestra.run.smithi161.stdout:2604 read 0x36e4d13 thru 0x36f064d (0xb93b bytes) 2024-09-21T15:08:49.966 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.974 INFO:teuthology.orchestra.run.smithi161.stdout:2606 trunc from 0xe2fc3ce to 0xac493d9 2024-09-21T15:08:49.983 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.984 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:49.984 INFO:teuthology.orchestra.run.smithi161.stdout:2301 writesame 0x211e831 thru 0x2126590 data_size 0x44(0x7d60 bytes) 2024-09-21T15:08:50.001 INFO:teuthology.orchestra.run.smithi161.stdout:2302 read 0x4e252e0 thru 0x4e2b085 (0x5da6 bytes) 2024-09-21T15:08:50.006 INFO:teuthology.orchestra.run.smithi161.stdout:2943 trunc from 0xde82e3b to 0x3679c07 2024-09-21T15:08:50.017 INFO:teuthology.orchestra.run.smithi161.stdout:2918 trunc from 0xd8a2085 to 0x6640b47 2024-09-21T15:08:50.020 INFO:teuthology.orchestra.run.smithi161.stdout:2607 read 0x3f94a42 thru 0x3f9717a (0x2739 bytes) 2024-09-21T15:08:50.020 INFO:teuthology.orchestra.run.smithi161.stdout:2608 read 0x4345fc8 thru 0x434d224 (0x725d bytes) 2024-09-21T15:08:50.020 INFO:teuthology.orchestra.run.smithi161.stdout:2609 punch from 0x699f7f6 to 0x69aa0ac, (0xa8b6 bytes) 2024-09-21T15:08:50.020 INFO:teuthology.orchestra.run.smithi161.stdout:2610 read 0x6cf6ddf thru 0x6cfc680 (0x58a2 bytes) 2024-09-21T15:08:50.020 INFO:teuthology.orchestra.run.smithi161.stdout:2611 writesame 0x66f186d thru 0x67012ef data_size 0x1(0xfa83 bytes) 2024-09-21T15:08:50.047 INFO:teuthology.orchestra.run.smithi161.stdout:2303 writesame 0xe23efaf thru 0xe24c9aa data_size 0xe(0xd9fc bytes) 2024-09-21T15:08:50.056 INFO:teuthology.orchestra.run.smithi161.stdout:2306 read 0xbfe52e6 thru 0xbfe75ad (0x22c8 bytes) 2024-09-21T15:08:50.056 INFO:teuthology.orchestra.run.smithi161.stdout:2307 writesame 0x4ea606c thru 0x4ea8bdc data_size 0xb(0x2b71 bytes) 2024-09-21T15:08:50.080 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.081 INFO:teuthology.orchestra.run.smithi161.stdout:2310 punch from 0x453feeb to 0x4543b39, (0x3c4e bytes) 2024-09-21T15:08:50.081 INFO:teuthology.orchestra.run.smithi161.stdout:2311 read 0x2eaa837 thru 0x2eb6afd (0xc2c7 bytes) 2024-09-21T15:08:50.082 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.083 INFO:teuthology.orchestra.run.smithi161.stdout:2612 write 0x35e5dd6 thru 0x35f3e3d (0xe068 bytes) 2024-09-21T15:08:50.094 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.096 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.096 INFO:teuthology.orchestra.run.smithi161.stdout:2920 read 0x4ecc03 thru 0x4fbefa (0xf2f8 bytes) 2024-09-21T15:08:50.107 INFO:teuthology.orchestra.run.smithi161.stdout:2313 trunc from 0xe24c9ab to 0x3d0f98c 2024-09-21T15:08:50.127 INFO:teuthology.orchestra.run.smithi161.stdout:2615 write 0xb1c1906 thru 0xb1cf405 (0xdb00 bytes) 2024-09-21T15:08:50.138 INFO:teuthology.orchestra.run.smithi161.stdout:2921 write 0xbf7360b thru 0xbf7e761 (0xb157 bytes) 2024-09-21T15:08:50.151 INFO:teuthology.orchestra.run.smithi161.stdout:2616 write 0xe4d6f9 thru 0xe4d9c0 (0x2c8 bytes) 2024-09-21T15:08:50.154 INFO:teuthology.orchestra.run.smithi161.stdout:2922 read 0x8f2ceac thru 0x8f35235 (0x838a bytes) 2024-09-21T15:08:50.154 INFO:teuthology.orchestra.run.smithi161.stdout:2923 read 0x9e37787 thru 0x9e4186d (0xa0e7 bytes) 2024-09-21T15:08:50.155 INFO:teuthology.orchestra.run.smithi161.stdout:2924 read 0x4f54e3a thru 0x4f5f348 (0xa50f bytes) 2024-09-21T15:08:50.155 INFO:teuthology.orchestra.run.smithi161.stdout:2925 write 0xa77f798 thru 0xa78e3bd (0xec26 bytes) 2024-09-21T15:08:50.161 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.161 INFO:teuthology.orchestra.run.smithi161.stdout:2945 read 0x31a4d4c thru 0x31b3303 (0xe5b8 bytes) 2024-09-21T15:08:50.163 INFO:teuthology.orchestra.run.smithi161.stdout:2617 punch from 0x7f4bad1 to 0x7f5b7c5, (0xfcf4 bytes) 2024-09-21T15:08:50.163 INFO:teuthology.orchestra.run.smithi161.stdout:2946 read 0x5170a thru 0x55ec1 (0x47b8 bytes) 2024-09-21T15:08:50.163 INFO:teuthology.orchestra.run.smithi161.stdout:2618 write 0xab6e120 thru 0xab769a8 (0x8889 bytes) 2024-09-21T15:08:50.167 INFO:teuthology.orchestra.run.smithi161.stdout:2947 read 0x1570832 thru 0x157f10f (0xe8de bytes) 2024-09-21T15:08:50.170 INFO:teuthology.orchestra.run.smithi161.stdout:2950 writesame 0xa52cd5 thru 0xa5e526 data_size 0x1(0xb852 bytes) 2024-09-21T15:08:50.171 INFO:teuthology.orchestra.run.smithi161.stdout:2314 read 0x1a81a2e thru 0x1a8e71b (0xccee bytes) 2024-09-21T15:08:50.172 INFO:teuthology.orchestra.run.smithi161.stdout:2926 write 0x3c331d5 thru 0x3c3d190 (0x9fbc bytes) 2024-09-21T15:08:50.181 INFO:teuthology.orchestra.run.smithi161.stdout:2620 read 0xaa4d5ff thru 0xaa5c8b6 (0xf2b8 bytes) 2024-09-21T15:08:50.181 INFO:teuthology.orchestra.run.smithi161.stdout:2622 write 0x8f75ebb thru 0x8f7cda2 (0x6ee8 bytes) 2024-09-21T15:08:50.184 INFO:teuthology.orchestra.run.smithi161.stdout:2927 write 0x250986f thru 0x25191da (0xf96c bytes) 2024-09-21T15:08:50.203 INFO:teuthology.orchestra.run.smithi161.stdout:2315 write 0x49da8a7 thru 0x49e1b5d (0x72b7 bytes) 2024-09-21T15:08:50.210 INFO:teuthology.orchestra.run.smithi161.stdout:2626 write 0x998aac4 thru 0x99986ae (0xdbeb bytes) 2024-09-21T15:08:50.227 INFO:teuthology.orchestra.run.smithi161.stdout:2316 trunc from 0x49e1b5e to 0x367aff9 2024-09-21T15:08:50.228 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.244 INFO:teuthology.orchestra.run.smithi161.stdout:2928 write 0xc6f945c thru 0xc6fd597 (0x413c bytes) 2024-09-21T15:08:50.252 INFO:teuthology.orchestra.run.smithi161.stdout:2951 write 0x506537b thru 0x506e8d2 (0x9558 bytes) 2024-09-21T15:08:50.256 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.257 INFO:teuthology.orchestra.run.smithi161.stdout:2930 write 0xae4bffc thru 0xae55b97 (0x9b9c bytes) 2024-09-21T15:08:50.260 INFO:teuthology.orchestra.run.smithi161.stdout:2628 write 0xda95695 thru 0xda95876 (0x1e2 bytes) 2024-09-21T15:08:50.269 INFO:teuthology.orchestra.run.smithi161.stdout:2931 write 0x484cc0 thru 0x48680c (0x1b4d bytes) 2024-09-21T15:08:50.277 INFO:teuthology.orchestra.run.smithi161.stdout:2629 write 0x1e80d16 thru 0x1e83cac (0x2f97 bytes) 2024-09-21T15:08:50.280 INFO:teuthology.orchestra.run.smithi161.stdout:2317 trunc from 0x367aff9 to 0xe376cb0 2024-09-21T15:08:50.295 INFO:teuthology.orchestra.run.smithi161.stdout:2630 writesame 0xc8bac45 thru 0xc8c3017 data_size 0x7(0x83d3 bytes) 2024-09-21T15:08:50.306 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.307 INFO:teuthology.orchestra.run.smithi161.stdout:2320 read 0x7368090 thru 0x736cffc (0x4f6d bytes) 2024-09-21T15:08:50.310 INFO:teuthology.orchestra.run.smithi161.stdout:2321 trunc from 0xe376cb0 to 0xc826774 2024-09-21T15:08:50.328 INFO:teuthology.orchestra.run.smithi161.stdout:2932 write 0xdda226c thru 0xddaa4ff (0x8294 bytes) 2024-09-21T15:08:50.334 INFO:teuthology.orchestra.run.smithi161.stdout:2952 write 0xc92b700 thru 0xc92fa7f (0x4380 bytes) 2024-09-21T15:08:50.336 INFO:teuthology.orchestra.run.smithi161.stdout:2631 trunc from 0xda95877 to 0x32080ea 2024-09-21T15:08:50.339 INFO:teuthology.orchestra.run.smithi161.stdout:2322 write 0x181c551 thru 0x182575b (0x920b bytes) 2024-09-21T15:08:50.349 INFO:teuthology.orchestra.run.smithi161.stdout:2933 writesame 0x4b2b10c thru 0x4b33cf9 data_size 0x1(0x8bee bytes) 2024-09-21T15:08:50.363 INFO:teuthology.orchestra.run.smithi161.stdout:2323 read 0x6e86a66 thru 0x6e8f6ad (0x8c48 bytes) 2024-09-21T15:08:50.363 INFO:teuthology.orchestra.run.smithi161.stdout:2324 read 0x586eee thru 0x58deaf (0x6fc2 bytes) 2024-09-21T15:08:50.364 INFO:teuthology.orchestra.run.smithi161.stdout:2327 write 0x57789e7 thru 0x577c632 (0x3c4c bytes) 2024-09-21T15:08:50.364 INFO:teuthology.orchestra.run.smithi161.stdout:2953 punch from 0x5a5c5e0 to 0x5a65caa, (0x96ca bytes) 2024-09-21T15:08:50.364 INFO:teuthology.orchestra.run.smithi161.stdout:2954 punch from 0x2f979e9 to 0x2f993f7, (0x1a0e bytes) 2024-09-21T15:08:50.366 INFO:teuthology.orchestra.run.smithi161.stdout:2955 trunc from 0xc92fa80 to 0xd1954fd 2024-09-21T15:08:50.391 INFO:teuthology.orchestra.run.smithi161.stdout:2328 clone 27 order 24 su 1048576 sc 5 2024-09-21T15:08:50.410 INFO:teuthology.orchestra.run.smithi161.stdout:2957 trunc from 0xd1954fd to 0xc5eb146 2024-09-21T15:08:50.416 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.416 INFO:teuthology.orchestra.run.smithi161.stdout:2934 write 0xe6e5cfb thru 0xe6f35fd (0xd903 bytes) 2024-09-21T15:08:50.419 INFO:teuthology.orchestra.run.smithi161.stdout:2633 trunc from 0x32080ea to 0x1b486d4 2024-09-21T15:08:50.431 INFO:teuthology.orchestra.run.smithi161.stdout:2935 write 0xa8d1dfa thru 0xa8d3b45 (0x1d4c bytes) 2024-09-21T15:08:50.448 INFO:teuthology.orchestra.run.smithi161.stdout:2936 writesame 0xb9e6043 thru 0xb9f1f26 data_size 0x4(0xbee4 bytes) 2024-09-21T15:08:50.464 INFO:teuthology.orchestra.run.smithi161.stdout:2634 trunc from 0x1b486d4 to 0xb101f1a 2024-09-21T15:08:50.468 INFO:teuthology.orchestra.run.smithi161.stdout:2937 writesame 0xba2b669 thru 0xba3a977 data_size 0x7(0xf30f bytes) 2024-09-21T15:08:50.472 INFO:teuthology.orchestra.run.smithi161.stdout:2959 trunc from 0xc5eb146 to 0x1bd9b0c 2024-09-21T15:08:50.492 INFO:teuthology.orchestra.run.smithi161.stdout:2939 write 0x2b368ef thru 0x2b368f9 (0xb bytes) 2024-09-21T15:08:50.499 INFO:teuthology.orchestra.run.smithi161.stdout:2635 punch from 0x47c8cf6 to 0x47cea47, (0x5d51 bytes) 2024-09-21T15:08:50.510 INFO:teuthology.orchestra.run.smithi161.stdout:2940 read 0x6f3728e thru 0x6f3e37f (0x70f2 bytes) 2024-09-21T15:08:50.510 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.510 INFO:teuthology.orchestra.run.smithi161.stdout:2943 read 0x98561 thru 0xa64b2 (0xdf52 bytes) 2024-09-21T15:08:50.512 INFO:teuthology.orchestra.run.smithi161.stdout:2944 write 0x338cb78 thru 0x3392e76 (0x62ff bytes) 2024-09-21T15:08:50.516 INFO:teuthology.orchestra.run.smithi161.stdout:2638 trunc from 0xb101f1a to 0x3825da0 2024-09-21T15:08:50.525 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.525 INFO:teuthology.orchestra.run.smithi161.stdout:2947 read 0xd37ed6d thru 0xd38847d (0x9711 bytes) 2024-09-21T15:08:50.525 INFO:teuthology.orchestra.run.smithi161.stdout:2948 read 0xbbed33f thru 0xbbf32d5 (0x5f97 bytes) 2024-09-21T15:08:50.526 INFO:teuthology.orchestra.run.smithi161.stdout:2949 write 0xb6b9f1b thru 0xb6c2fd4 (0x90ba bytes) 2024-09-21T15:08:50.571 INFO:teuthology.orchestra.run.smithi161.stdout:2951 write 0x42f8a75 thru 0x4305f77 (0xd503 bytes) 2024-09-21T15:08:50.575 INFO:teuthology.orchestra.run.smithi161.stdout:2639 punch from 0x2b5b500 to 0x2b66a4c, (0xb54c bytes) 2024-09-21T15:08:50.586 INFO:teuthology.orchestra.run.smithi161.stdout:2953 writesame 0xcc8e20d thru 0xcc9b97e data_size 0x6d(0xd772 bytes) 2024-09-21T15:08:50.597 INFO:teuthology.orchestra.run.smithi161.stdout:2955 writesame 0x8c356e7 thru 0x8c43b92 data_size 0xa(0xe4ac bytes) 2024-09-21T15:08:50.597 INFO:teuthology.orchestra.run.smithi161.stdout:2961 read 0x150cf5e thru 0x151296d (0x5a10 bytes) 2024-09-21T15:08:50.598 INFO:teuthology.orchestra.run.smithi161.stdout:2962 punch from 0x5fc70a to 0x609825, (0xd11b bytes) 2024-09-21T15:08:50.604 INFO:teuthology.orchestra.run.smithi161.stdout:2963 trunc from 0x1bd9b0c to 0x3bd3070 2024-09-21T15:08:50.609 INFO:teuthology.orchestra.run.smithi161.stdout:2643 writesame 0x4131fac thru 0x413fd0f data_size 0x6(0xdd64 bytes) 2024-09-21T15:08:50.623 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.623 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.623 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.623 INFO:teuthology.orchestra.run.smithi161.stdout:2963 writesame 0x19aee69 thru 0x19bb663 data_size 0x5(0xc7fb bytes) 2024-09-21T15:08:50.638 INFO:teuthology.orchestra.run.smithi161.stdout:2646 trunc from 0x413fd10 to 0xe77b8e6 2024-09-21T15:08:50.641 INFO:teuthology.orchestra.run.smithi161.stdout:2965 read 0x1eaf9f4 thru 0x1eb8c7b (0x9288 bytes) 2024-09-21T15:08:50.641 INFO:teuthology.orchestra.run.smithi161.stdout:2967 punch from 0x14ff5de to 0x1501800, (0x2222 bytes) 2024-09-21T15:08:50.641 INFO:teuthology.orchestra.run.smithi161.stdout:2968 read 0x1d4c812 thru 0x1d59025 (0xc814 bytes) 2024-09-21T15:08:50.643 INFO:teuthology.orchestra.run.smithi161.stdout:2964 write 0x4eb3e01 thru 0x4ebeae2 (0xace2 bytes) 2024-09-21T15:08:50.663 INFO:teuthology.orchestra.run.smithi161.stdout:2966 punch from 0xd7ae8bd to 0xd7b81f3, (0x9936 bytes) 2024-09-21T15:08:50.663 INFO:teuthology.orchestra.run.smithi161.stdout:2968 read 0x876184f thru 0x8761c0b (0x3bd bytes) 2024-09-21T15:08:50.663 INFO:teuthology.orchestra.run.smithi161.stdout:2969 write 0x124f8c5 thru 0x1252de4 (0x3520 bytes) 2024-09-21T15:08:50.680 INFO:teuthology.orchestra.run.smithi161.stdout:2971 read 0x744ab43 thru 0x7459179 (0xe637 bytes) 2024-09-21T15:08:50.684 INFO:teuthology.orchestra.run.smithi161.stdout:2972 trunc from 0xe6f35fe to 0xcb731de 2024-09-21T15:08:50.690 INFO:teuthology.orchestra.run.smithi161.stdout:2647 write 0x5536796 thru 0x553c6f8 (0x5f63 bytes) 2024-09-21T15:08:50.691 INFO:teuthology.orchestra.run.smithi161.stdout:2969 write 0x8f3e966 thru 0x8f44375 (0x5a10 bytes) 2024-09-21T15:08:50.714 INFO:teuthology.orchestra.run.smithi161.stdout:2650 write 0x7e2f4df thru 0x7e3b6a0 (0xc1c2 bytes) 2024-09-21T15:08:50.727 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.735 INFO:teuthology.orchestra.run.smithi161.stdout:2651 punch from 0x744fd59 to 0x745559e, (0x5845 bytes) 2024-09-21T15:08:50.735 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:50.735 INFO:teuthology.orchestra.run.smithi161.stdout:2653 write 0x84ab44c thru 0x84b3369 (0x7f1e bytes) 2024-09-21T15:08:50.749 INFO:teuthology.orchestra.run.smithi161.stdout:2654 punch from 0x24a4eed to 0x24b4e6b, (0xff7e bytes) 2024-09-21T15:08:50.749 INFO:teuthology.orchestra.run.smithi161.stdout:2655 write 0x307acba thru 0x307d033 (0x237a bytes) 2024-09-21T15:08:50.752 INFO:teuthology.orchestra.run.smithi161.stdout:2973 writesame 0x4109a9a thru 0x410d76c data_size 0x1(0x3cd3 bytes) 2024-09-21T15:08:50.761 INFO:teuthology.orchestra.run.smithi161.stdout:2658 write 0xbf3ae60 thru 0xbf47391 (0xc532 bytes) 2024-09-21T15:08:50.765 INFO:teuthology.orchestra.run.smithi161.stdout:2972 write 0xbe0de27 thru 0xbe1cc3d (0xee17 bytes) 2024-09-21T15:08:50.776 INFO:teuthology.orchestra.run.smithi161.stdout:2660 write 0x6b7fc16 thru 0x6b82059 (0x2444 bytes) 2024-09-21T15:08:50.790 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.0-clone17 intact 2024-09-21T15:08:50.797 INFO:teuthology.orchestra.run.smithi161.stdout:2662 write 0x8ec6883 thru 0x8ed38f1 (0xd06f bytes) 2024-09-21T15:08:50.809 INFO:teuthology.orchestra.run.smithi161.stdout:2665 write 0x8867e5e thru 0x88767a5 (0xe948 bytes) 2024-09-21T15:08:50.812 INFO:teuthology.orchestra.run.smithi161.stdout:2973 trunc from 0xbe1cc3e to 0x5ecf8ad 2024-09-21T15:08:50.813 INFO:teuthology.orchestra.run.smithi161.stdout:2974 write 0xdebeeb5 thru 0xdece633 (0xf77f bytes) 2024-09-21T15:08:50.829 INFO:teuthology.orchestra.run.smithi161.stdout:2666 read 0x2adad28 thru 0x2adb063 (0x33c bytes) 2024-09-21T15:08:50.830 INFO:teuthology.orchestra.run.smithi161.stdout:2667 clone 23 order 20 su 32768 sc 15 2024-09-21T15:08:50.838 INFO:teuthology.orchestra.run.smithi161.stdout:2975 read 0x187e31b thru 0x188cc7f (0xe965 bytes) 2024-09-21T15:08:50.839 INFO:teuthology.orchestra.run.smithi161.stdout:2979 read 0xcc71319 thru 0xcc7b9dc (0xa6c4 bytes) 2024-09-21T15:08:50.839 INFO:teuthology.orchestra.run.smithi161.stdout:2980 clone 17 order 23 su 131072 sc 12 2024-09-21T15:08:50.867 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.2-clone19 intact 2024-09-21T15:08:50.871 INFO:teuthology.orchestra.run.smithi161.stdout:2974 trunc from 0x5ecf8ad to 0x53dcee9 2024-09-21T15:08:50.898 INFO:teuthology.orchestra.run.smithi161.stdout:2976 read 0x361257f thru 0x361f7ef (0xd271 bytes) 2024-09-21T15:08:50.898 INFO:teuthology.orchestra.run.smithi161.stdout:2977 read 0x32d591e thru 0x32e0067 (0xa74a bytes) 2024-09-21T15:08:50.937 INFO:teuthology.orchestra.run.smithi161.stdout:2978 write 0xd243b2f thru 0xd245bef (0x20c1 bytes) 2024-09-21T15:08:50.961 INFO:teuthology.orchestra.run.smithi161.stdout:2979 write 0x263984 thru 0x269fef (0x666c bytes) 2024-09-21T15:08:50.982 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #16, image image_cluster1.client.mirror.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent17 2024-09-21T15:08:51.062 INFO:teuthology.orchestra.run.smithi161.stdout:2981 write 0x3121c3b thru 0x312628c (0x4652 bytes) 2024-09-21T15:08:51.088 INFO:teuthology.orchestra.run.smithi161.stdout:2983 read 0xaa8af4f thru 0xaa8c6cf (0x1781 bytes) 2024-09-21T15:08:51.088 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #25, image image_cluster1.client.mirror.3-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent26 2024-09-21T15:08:51.112 INFO:teuthology.orchestra.run.smithi161.stdout:2985 trunc from 0xd245bf0 to 0x2d02eef 2024-09-21T15:08:51.142 INFO:teuthology.orchestra.run.smithi161.stdout:3125 punch from 0x4dd8a3 to 0x4e3c9e, (0x63fb bytes) 2024-09-21T15:08:51.160 INFO:teuthology.orchestra.run.smithi161.stdout:3126 clone 19 order 24 su 2097152 sc 11 2024-09-21T15:08:51.183 INFO:teuthology.orchestra.run.smithi161.stdout:2987 writesame 0x561b561 thru 0x5629c02 data_size 0x35(0xe6a2 bytes) 2024-09-21T15:08:51.190 INFO:teuthology.orchestra.run.smithi161.stdout:2989 trunc from 0x5629c03 to 0x38b6bd1 2024-09-21T15:08:51.220 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:51.220 INFO:teuthology.orchestra.run.smithi161.stdout:2992 read 0x2af0388 thru 0x2af55d1 (0x524a bytes) 2024-09-21T15:08:51.220 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:51.220 INFO:teuthology.orchestra.run.smithi161.stdout:2995 read 0x1b399ff thru 0x1b3d38a (0x398c bytes) 2024-09-21T15:08:51.221 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #18, image image_cluster1.client.mirror.2-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent19 2024-09-21T15:08:51.257 INFO:teuthology.orchestra.run.smithi161.stdout:2996 write 0x9b35d09 thru 0x9b3a9f0 (0x4ce8 bytes) 2024-09-21T15:08:51.285 INFO:teuthology.orchestra.run.smithi161.stdout:2997 read 0x5a5e22f thru 0x5a6b3b3 (0xd185 bytes) 2024-09-21T15:08:51.299 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:51.304 INFO:teuthology.orchestra.run.smithi161.stdout:3391 trunc from 0xb3b40ad to 0x8cab735 2024-09-21T15:08:51.327 INFO:teuthology.orchestra.run.smithi161.stdout:2998 write 0xd54a4a2 thru 0xd5523cc (0x7f2b bytes) 2024-09-21T15:08:51.399 INFO:teuthology.orchestra.run.smithi161.stdout:2999 punch from 0x649c90c to 0x649cc7d, (0x371 bytes) 2024-09-21T15:08:51.399 INFO:teuthology.orchestra.run.smithi161.stdout:3000 writesame 0x905749e thru 0x905be80 data_size 0xf(0x49e3 bytes) 2024-09-21T15:08:51.450 INFO:teuthology.orchestra.run.smithi161.stdout:3001 write 0x263f0f6 thru 0x26414ad (0x23b8 bytes) 2024-09-21T15:08:51.481 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:51.497 INFO:teuthology.orchestra.run.smithi161.stdout:3003 trunc from 0xd5523cd to 0x358f0fc 2024-09-21T15:08:51.500 INFO:teuthology.orchestra.run.smithi161.stdout:3392 write 0xa5748d2 thru 0xa57b503 (0x6c32 bytes) 2024-09-21T15:08:51.516 INFO:teuthology.orchestra.run.smithi161.stdout:3393 trunc from 0xa57b504 to 0x7729a64 2024-09-21T15:08:51.584 INFO:teuthology.orchestra.run.smithi161.stdout:3395 clone 21 order 19 su 16384 sc 10 2024-09-21T15:08:51.591 INFO:teuthology.orchestra.run.smithi161.stdout:3004 read 0x2e7b12c thru 0x2e7b342 (0x217 bytes) 2024-09-21T15:08:51.591 INFO:teuthology.orchestra.run.smithi161.stdout:3005 read 0x5ba5a0 thru 0x5c188a (0x72eb bytes) 2024-09-21T15:08:51.593 INFO:teuthology.orchestra.run.smithi161.stdout:3006 punch from 0x1b61896 to 0x1b71231, (0xf99b bytes) 2024-09-21T15:08:51.632 INFO:teuthology.orchestra.run.smithi161.stdout:3007 writesame 0xd1aac4e thru 0xd1b939c data_size 0xd(0xe74f bytes) 2024-09-21T15:08:51.636 INFO:teuthology.orchestra.run.smithi161.stdout:3008 write 0x29d1922 thru 0x29d8e86 (0x7565 bytes) 2024-09-21T15:08:51.669 INFO:teuthology.orchestra.run.smithi161.stdout:3009 write 0x388baad thru 0x388f299 (0x37ed bytes) 2024-09-21T15:08:51.677 INFO:teuthology.orchestra.run.smithi161.stdout:2329 write 0xda9b5c8 thru 0xda9ffb8 (0x49f1 bytes) 2024-09-21T15:08:51.705 INFO:teuthology.orchestra.run.smithi161.stdout:2330 read 0x7517b8d thru 0x751904c (0x14c0 bytes) 2024-09-21T15:08:51.705 INFO:teuthology.orchestra.run.smithi161.stdout:2331 read 0xd8c88b4 thru 0xd8d4e3f (0xc58c bytes) 2024-09-21T15:08:51.705 INFO:teuthology.orchestra.run.smithi161.stdout:2332 read 0x488f98c thru 0x4890668 (0xcdd bytes) 2024-09-21T15:08:51.706 INFO:teuthology.orchestra.run.smithi161.stdout:2334 write 0x3f04844 thru 0x3f07502 (0x2cbf bytes) 2024-09-21T15:08:51.725 INFO:teuthology.orchestra.run.smithi161.stdout:3010 trunc from 0xd1b939d to 0x35aac93 2024-09-21T15:08:51.735 INFO:teuthology.orchestra.run.smithi161.stdout:2336 write 0x808d0c9 thru 0x8095da4 (0x8cdc bytes) 2024-09-21T15:08:51.756 INFO:teuthology.orchestra.run.smithi161.stdout:2338 write 0x4708ea9 thru 0x470c8d7 (0x3a2f bytes) 2024-09-21T15:08:51.776 INFO:teuthology.orchestra.run.smithi161.stdout:2339 read 0x91aa11c thru 0x91b0d20 (0x6c05 bytes) 2024-09-21T15:08:51.777 INFO:teuthology.orchestra.run.smithi161.stdout:2340 write 0x6dc6a71 thru 0x6dd0a88 (0xa018 bytes) 2024-09-21T15:08:51.782 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.1-clone16 intact 2024-09-21T15:08:51.782 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone22 from 0xe77b8e6 (overlap 0xb757e9) to 0x0 2024-09-21T15:08:51.784 INFO:teuthology.orchestra.run.smithi161.stdout:3011 read 0x1b43a3e thru 0x1b4bfbb (0x857e bytes) 2024-09-21T15:08:51.786 INFO:teuthology.orchestra.run.smithi161.stdout:3012 flatten 2024-09-21T15:08:51.787 INFO:teuthology.orchestra.run.smithi161.stdout:2341 writesame 0x7cb8043 thru 0x7cc6b2b data_size 0x4d(0xeae9 bytes) 2024-09-21T15:08:51.790 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.0-clone18 intact 2024-09-21T15:08:51.809 INFO:teuthology.orchestra.run.smithi161.stdout:2342 flatten 2024-09-21T15:08:51.940 INFO:teuthology.orchestra.run.smithi161.stdout:2343 read 0x8377b07 thru 0x8382c66 (0xb160 bytes) 2024-09-21T15:08:51.940 INFO:teuthology.orchestra.run.smithi161.stdout:2345 read 0x4b837db thru 0x4b8d077 (0x989d bytes) 2024-09-21T15:08:51.940 INFO:teuthology.orchestra.run.smithi161.stdout:2346 read 0x8929aed thru 0x8932d4c (0x9260 bytes) 2024-09-21T15:08:51.941 INFO:teuthology.orchestra.run.smithi161.stdout:2347 writesame 0x9039df4 thru 0x903b99f data_size 0x1(0x1bac bytes) 2024-09-21T15:08:51.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:51.945+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cd2b4960 handle_clone_image: failed to clone image mirror/10b4f7698f79 to image_cluster1.client.mirror.3-clone27 2024-09-21T15:08:51.954 INFO:teuthology.orchestra.run.smithi161.stdout:2348 read 0x3f6d838 thru 0x3f77eaa (0xa673 bytes) 2024-09-21T15:08:51.956 INFO:teuthology.orchestra.run.smithi161.stdout:2350 write 0x21c747c thru 0x21d21fc (0xad81 bytes) 2024-09-21T15:08:51.982 INFO:teuthology.orchestra.run.smithi161.stdout:2351 read 0x92799f3 thru 0x9279f79 (0x587 bytes) 2024-09-21T15:08:51.982 INFO:teuthology.orchestra.run.smithi161.stdout:2353 read 0x399b604 thru 0x39a0a4d (0x544a bytes) 2024-09-21T15:08:51.982 INFO:teuthology.orchestra.run.smithi161.stdout:2354 punch from 0x5c46ed2 to 0x5c532d3, (0xc401 bytes) 2024-09-21T15:08:51.982 INFO:teuthology.orchestra.run.smithi161.stdout:2355 writesame 0x8ecbbb1 thru 0x8ed165b data_size 0x3(0x5aab bytes) 2024-09-21T15:08:51.992 INFO:teuthology.orchestra.run.smithi161.stdout:2358 read 0x1243b50 thru 0x124bb4b (0x7ffc bytes) 2024-09-21T15:08:51.993 INFO:teuthology.orchestra.run.smithi161.stdout:2361 write 0xd8be147 thru 0xd8c43cc (0x6286 bytes) 2024-09-21T15:08:52.003 INFO:teuthology.orchestra.run.smithi161.stdout:2362 write 0xca86925 thru 0xca95c02 (0xf2de bytes) 2024-09-21T15:08:52.014 INFO:teuthology.orchestra.run.smithi161.stdout:2363 punch from 0x7fa7215 to 0x7fb170f, (0xa4fa bytes) 2024-09-21T15:08:52.015 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:52.017 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #17, image image_cluster1.client.mirror.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent18 2024-09-21T15:08:52.027 INFO:teuthology.orchestra.run.smithi161.stdout:2365 trunc from 0xda9ffb9 to 0x67e6d74 2024-09-21T15:08:52.046 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #21, image image_cluster1.client.mirror.4-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent22 2024-09-21T15:08:52.054 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #15, image image_cluster1.client.mirror.1-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent16 2024-09-21T15:08:52.084 INFO:teuthology.orchestra.run.smithi161.stdout:2366 writesame 0x1abe342 thru 0x1abfc95 data_size 0x2(0x1954 bytes) 2024-09-21T15:08:52.101 INFO:teuthology.orchestra.run.smithi161.stdout:2367 write 0x14b68c4 thru 0x14be595 (0x7cd2 bytes) 2024-09-21T15:08:52.101 INFO:teuthology.orchestra.run.smithi161.stdout:2668 write 0x5a19f5f thru 0x5a21a50 (0x7af2 bytes) 2024-09-21T15:08:52.110 INFO:teuthology.orchestra.run.smithi161.stdout:2369 writesame 0x52df427 thru 0x52e094c data_size 0x1(0x1526 bytes) 2024-09-21T15:08:52.138 INFO:teuthology.orchestra.run.smithi161.stdout:2370 punch from 0x649daad to 0x64aa538, (0xca8b bytes) 2024-09-21T15:08:52.138 INFO:teuthology.orchestra.run.smithi161.stdout:2373 write 0x5bf7235 thru 0x5c02b5d (0xb929 bytes) 2024-09-21T15:08:52.157 INFO:teuthology.orchestra.run.smithi161.stdout:2378 punch from 0x3ff16c8 to 0x3ff47a4, (0x30dc bytes) 2024-09-21T15:08:52.206 INFO:teuthology.orchestra.run.smithi161.stdout:2379 write 0xc93a39c thru 0xc93f0ba (0x4d1f bytes) 2024-09-21T15:08:52.218 INFO:teuthology.orchestra.run.smithi161.stdout:2380 read 0x433ede thru 0x443ed9 (0xfffc bytes) 2024-09-21T15:08:52.219 INFO:teuthology.orchestra.run.smithi161.stdout:2671 write 0xb28495b thru 0xb28553e (0xbe4 bytes) 2024-09-21T15:08:52.219 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:52.229 INFO:teuthology.orchestra.run.smithi161.stdout:2672 read 0x7161df1 thru 0x716ced5 (0xb0e5 bytes) 2024-09-21T15:08:52.230 INFO:teuthology.orchestra.run.smithi161.stdout:2675 read 0x3440aed thru 0x344604f (0x5563 bytes) 2024-09-21T15:08:52.230 INFO:teuthology.orchestra.run.smithi161.stdout:2676 write 0x2768f45 thru 0x276cf89 (0x4045 bytes) 2024-09-21T15:08:52.239 INFO:teuthology.orchestra.run.smithi161.stdout:2382 trunc from 0xc93f0bb to 0x481cef 2024-09-21T15:08:52.245 INFO:teuthology.orchestra.run.smithi161.stdout:2677 punch from 0x7a4560e to 0x7a4576c, (0x15e bytes) 2024-09-21T15:08:52.245 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:52.245 INFO:teuthology.orchestra.run.smithi161.stdout:2679 punch from 0x7b4dd7e to 0x7b50c78, (0x2efa bytes) 2024-09-21T15:08:52.245 INFO:teuthology.orchestra.run.smithi161.stdout:2680 read 0xd89c26c thru 0xd8a9bfc (0xd991 bytes) 2024-09-21T15:08:52.245 INFO:teuthology.orchestra.run.smithi161.stdout:2681 write 0xaa0c8e5 thru 0xaa14aaf (0x81cb bytes) 2024-09-21T15:08:52.259 INFO:teuthology.orchestra.run.smithi161.stdout:2682 read 0x10d9083 thru 0x10e40e9 (0xb067 bytes) 2024-09-21T15:08:52.260 INFO:teuthology.orchestra.run.smithi161.stdout:2683 write 0x7a7deb6 thru 0x7a7edf2 (0xf3d bytes) 2024-09-21T15:08:52.281 INFO:teuthology.orchestra.run.smithi161.stdout:2383 read 0x16cebe thru 0x171362 (0x44a5 bytes) 2024-09-21T15:08:52.282 INFO:teuthology.orchestra.run.smithi161.stdout:2384 clone 28 order 23 su 524288 sc 8 2024-09-21T15:08:52.315 INFO:teuthology.orchestra.run.smithi161.stdout:3127 write 0xd663132 thru 0xd66a485 (0x7354 bytes) 2024-09-21T15:08:52.325 INFO:teuthology.orchestra.run.smithi161.stdout:3128 writesame 0x34d108c thru 0x34d14aa data_size 0x1(0x41f bytes) 2024-09-21T15:08:52.358 INFO:teuthology.orchestra.run.smithi161.stdout:2685 write 0xe9feb5d thru 0xea0c7e6 (0xdc8a bytes) 2024-09-21T15:08:52.358 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:52.389 INFO:teuthology.orchestra.run.smithi161.stdout:3130 read 0x1e5ed78 thru 0x1e6e238 (0xf4c1 bytes) 2024-09-21T15:08:52.390 INFO:teuthology.orchestra.run.smithi161.stdout:3133 punch from 0x5ae8b28 to 0x5af69cc, (0xdea4 bytes) 2024-09-21T15:08:52.390 INFO:teuthology.orchestra.run.smithi161.stdout:3135 read 0x4aaecdd thru 0x4ab3124 (0x4448 bytes) 2024-09-21T15:08:52.400 INFO:teuthology.orchestra.run.smithi161.stdout:3137 punch from 0x3d704a to 0x3de47b, (0x7431 bytes) 2024-09-21T15:08:52.413 INFO:teuthology.orchestra.run.smithi161.stdout:3140 trunc from 0xd66a486 to 0x86ac4cd 2024-09-21T15:08:52.429 INFO:teuthology.orchestra.run.smithi161.stdout:2686 write 0x7b070a4 thru 0x7b0c92e (0x588b bytes) 2024-09-21T15:08:52.533 INFO:teuthology.orchestra.run.smithi161.stdout:2688 write 0xa326563 thru 0xa32a9df (0x447d bytes) 2024-09-21T15:08:52.548 INFO:teuthology.orchestra.run.smithi161.stdout:2689 punch from 0xa284717 to 0xa287f31, (0x381a bytes) 2024-09-21T15:08:52.557 INFO:teuthology.orchestra.run.smithi161.stdout:2690 trunc from 0xea0c7e7 to 0xa2f3a55 2024-09-21T15:08:52.693 INFO:teuthology.orchestra.run.smithi161.stdout:3016 write 0x46f5915 thru 0x46faab3 (0x519f bytes) 2024-09-21T15:08:52.732 INFO:teuthology.orchestra.run.smithi161.stdout:3017 write 0x223610 thru 0x22f731 (0xc122 bytes) 2024-09-21T15:08:52.756 INFO:teuthology.orchestra.run.smithi161.stdout:2692 punch from 0x87487cb to 0x874bbe9, (0x341e bytes) 2024-09-21T15:08:52.756 INFO:teuthology.orchestra.run.smithi161.stdout:2693 read 0xb03968 thru 0xb0ebd1 (0xb26a bytes) 2024-09-21T15:08:52.757 INFO:teuthology.orchestra.run.smithi161.stdout:2694 write 0x330f193 thru 0x331151d (0x238b bytes) 2024-09-21T15:08:52.761 INFO:teuthology.orchestra.run.smithi161.stdout:3141 write 0x98b4e5b thru 0x98b97e4 (0x498a bytes) 2024-09-21T15:08:52.771 INFO:teuthology.orchestra.run.smithi161.stdout:3142 write 0x1fc0756 thru 0x1fc8365 (0x7c10 bytes) 2024-09-21T15:08:52.783 INFO:teuthology.orchestra.run.smithi161.stdout:3143 punch from 0xf82563 to 0xf85b35, (0x35d2 bytes) 2024-09-21T15:08:52.783 INFO:teuthology.orchestra.run.smithi161.stdout:3145 write 0x3077c5c thru 0x308098b (0x8d30 bytes) 2024-09-21T15:08:52.796 INFO:teuthology.orchestra.run.smithi161.stdout:3146 read 0x3c5e560 thru 0x3c601ae (0x1c4f bytes) 2024-09-21T15:08:52.797 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:52.797 INFO:teuthology.orchestra.run.smithi161.stdout:3148 read 0x354ae2e thru 0x354e8fd (0x3ad0 bytes) 2024-09-21T15:08:52.798 INFO:teuthology.orchestra.run.smithi161.stdout:3149 read 0x922138a thru 0x922640e (0x5085 bytes) 2024-09-21T15:08:52.813 INFO:teuthology.orchestra.run.smithi161.stdout:3150 trunc from 0x98b97e5 to 0x2bcfe0e 2024-09-21T15:08:52.878 INFO:teuthology.orchestra.run.smithi161.stdout:2696 writesame 0xd8dbe6f thru 0xd8e2849 data_size 0x3(0x69db bytes) 2024-09-21T15:08:52.881 INFO:teuthology.orchestra.run.smithi161.stdout:2699 write 0x402335f thru 0x4023638 (0x2da bytes) 2024-09-21T15:08:52.921 INFO:teuthology.orchestra.run.smithi161.stdout:3018 write 0xc6f04df thru 0xc6f29fb (0x251d bytes) 2024-09-21T15:08:52.924 INFO:teuthology.orchestra.run.smithi161.stdout:3151 write 0xc09ebf1 thru 0xc09fb61 (0xf71 bytes) 2024-09-21T15:08:52.934 INFO:teuthology.orchestra.run.smithi161.stdout:3152 read 0x630c675 thru 0x6312b5a (0x64e6 bytes) 2024-09-21T15:08:52.935 INFO:teuthology.orchestra.run.smithi161.stdout:3153 read 0x9c98fad thru 0x9c9e5ba (0x560e bytes) 2024-09-21T15:08:52.936 INFO:teuthology.orchestra.run.smithi161.stdout:3154 punch from 0x309bf69 to 0x309d82e, (0x18c5 bytes) 2024-09-21T15:08:52.936 INFO:teuthology.orchestra.run.smithi161.stdout:3156 read 0x65278da thru 0x65359f0 (0xe117 bytes) 2024-09-21T15:08:52.937 INFO:teuthology.orchestra.run.smithi161.stdout:3157 write 0x3ac1734 thru 0x3acca0d (0xb2da bytes) 2024-09-21T15:08:52.944 INFO:teuthology.orchestra.run.smithi161.stdout:3020 punch from 0x1c3b01a to 0x1c42f4d, (0x7f33 bytes) 2024-09-21T15:08:52.948 INFO:teuthology.orchestra.run.smithi161.stdout:3021 trunc from 0xc6f29fc to 0xe61305b 2024-09-21T15:08:52.951 INFO:teuthology.orchestra.run.smithi161.stdout:2700 write 0xd81360b thru 0xd81825a (0x4c50 bytes) 2024-09-21T15:08:52.961 INFO:teuthology.orchestra.run.smithi161.stdout:2701 read 0x5a544d6 thru 0x5a5d748 (0x9273 bytes) 2024-09-21T15:08:52.962 INFO:teuthology.orchestra.run.smithi161.stdout:2702 trunc from 0xd8e284a to 0xdafff2b 2024-09-21T15:08:52.985 INFO:teuthology.orchestra.run.smithi161.stdout:3160 write 0xe5ea8fe thru 0xe5f9950 (0xf053 bytes) 2024-09-21T15:08:52.992 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:52.992 INFO:teuthology.orchestra.run.smithi161.stdout:2704 read 0x32e7cb3 thru 0x32e9243 (0x1591 bytes) 2024-09-21T15:08:52.993 INFO:teuthology.orchestra.run.smithi161.stdout:2707 write 0x4c75298 thru 0x4c80f29 (0xbc92 bytes) 2024-09-21T15:08:53.005 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.005 INFO:teuthology.orchestra.run.smithi161.stdout:3162 write 0x36ccbaf thru 0x36d825a (0xb6ac bytes) 2024-09-21T15:08:53.025 INFO:teuthology.orchestra.run.smithi161.stdout:2708 writesame 0x3fb1485 thru 0x3fba556 data_size 0x6f(0x90d2 bytes) 2024-09-21T15:08:53.026 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.026 INFO:teuthology.orchestra.run.smithi161.stdout:3164 writesame 0x20e6a69 thru 0x20ebd64 data_size 0x2f(0x52fc bytes) 2024-09-21T15:08:53.044 INFO:teuthology.orchestra.run.smithi161.stdout:3022 read 0x89f284c thru 0x89f350f (0xcc4 bytes) 2024-09-21T15:08:53.044 INFO:teuthology.orchestra.run.smithi161.stdout:3026 read 0x891de54 thru 0x8929ec1 (0xc06e bytes) 2024-09-21T15:08:53.044 INFO:teuthology.orchestra.run.smithi161.stdout:3027 punch from 0x7239818 to 0x724665d, (0xce45 bytes) 2024-09-21T15:08:53.045 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.045 INFO:teuthology.orchestra.run.smithi161.stdout:3030 punch from 0x93ddf3d to 0x93dea8f, (0xb52 bytes) 2024-09-21T15:08:53.045 INFO:teuthology.orchestra.run.smithi161.stdout:3031 write 0x3fde84a thru 0x3fe0e1a (0x25d1 bytes) 2024-09-21T15:08:53.046 INFO:teuthology.orchestra.run.smithi161.stdout:2709 write 0x2367cba thru 0x2374282 (0xc5c9 bytes) 2024-09-21T15:08:53.050 INFO:teuthology.orchestra.run.smithi161.stdout:3166 trunc from 0xe5f9951 to 0x74ebb43 2024-09-21T15:08:53.075 INFO:teuthology.orchestra.run.smithi161.stdout:3032 write 0x196605c thru 0x196a6bd (0x4662 bytes) 2024-09-21T15:08:53.078 INFO:teuthology.orchestra.run.smithi161.stdout:2712 punch from 0x141a776 to 0x141d285, (0x2b0f bytes) 2024-09-21T15:08:53.079 INFO:teuthology.orchestra.run.smithi161.stdout:2713 trunc from 0xdafff2b to 0xce9fa7f 2024-09-21T15:08:53.085 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #26, image image_cluster1.client.mirror.3-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent27 2024-09-21T15:08:53.093 INFO:teuthology.orchestra.run.smithi161.stdout:3034 write 0xbfff6b9 thru 0xc00f5b4 (0xfefc bytes) 2024-09-21T15:08:53.104 INFO:teuthology.orchestra.run.smithi161.stdout:2981 write 0x776a70f thru 0x776df20 (0x3812 bytes) 2024-09-21T15:08:53.120 INFO:teuthology.orchestra.run.smithi161.stdout:3167 read 0x20f4383 thru 0x20ff17c (0xadfa bytes) 2024-09-21T15:08:53.124 INFO:teuthology.orchestra.run.smithi161.stdout:3035 read 0x57df5e7 thru 0x57e23cb (0x2de5 bytes) 2024-09-21T15:08:53.124 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.124 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.142 INFO:teuthology.orchestra.run.smithi161.stdout:3040 trunc from 0xe61305b to 0x48fd8d2 2024-09-21T15:08:53.143 INFO:teuthology.orchestra.run.smithi161.stdout:2715 writesame 0x6816af7 thru 0x681fe8d data_size 0x1(0x9397 bytes) 2024-09-21T15:08:53.147 INFO:teuthology.orchestra.run.smithi161.stdout:2982 read 0xafc6cc4 thru 0xafd3c08 (0xcf45 bytes) 2024-09-21T15:08:53.148 INFO:teuthology.orchestra.run.smithi161.stdout:2983 writesame 0xd061d11 thru 0xd06eae7 data_size 0xf(0xcdd7 bytes) 2024-09-21T15:08:53.153 INFO:teuthology.orchestra.run.smithi161.stdout:3170 write 0xbf0a33e thru 0xbf0d519 (0x31dc bytes) 2024-09-21T15:08:53.157 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone20 from 0x7729a64 (overlap 0x7729a64) to 0x5369f46 2024-09-21T15:08:53.178 INFO:teuthology.orchestra.run.smithi161.stdout:3171 read 0xaebb4de thru 0xaecb018 (0xfb3b bytes) 2024-09-21T15:08:53.180 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.180 INFO:teuthology.orchestra.run.smithi161.stdout:3174 read 0xa960bae thru 0xa96218d (0x15e0 bytes) 2024-09-21T15:08:53.180 INFO:teuthology.orchestra.run.smithi161.stdout:3176 read 0xbdad062 thru 0xbdaf829 (0x27c8 bytes) 2024-09-21T15:08:53.191 INFO:teuthology.orchestra.run.smithi161.stdout:3178 trunc from 0xbf0d51a to 0x6be0062 2024-09-21T15:08:53.194 INFO:teuthology.orchestra.run.smithi161.stdout:2717 read 0x45d58da thru 0x45def0c (0x9633 bytes) 2024-09-21T15:08:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:2719 write 0x7ad7a20 thru 0x7ad8348 (0x929 bytes) 2024-09-21T15:08:53.222 INFO:teuthology.orchestra.run.smithi161.stdout:2984 writesame 0xdfd38dd thru 0xdfd61be data_size 0x1(0x28e2 bytes) 2024-09-21T15:08:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:2720 read 0x2c542d thru 0x2d1b4c (0xc720 bytes) 2024-09-21T15:08:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:2723 punch from 0x72d5550 to 0x72dfdcc, (0xa87c bytes) 2024-09-21T15:08:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.226 INFO:teuthology.orchestra.run.smithi161.stdout:2725 trunc from 0xce9fa7f to 0xd58c450 2024-09-21T15:08:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:2985 read 0x95f2dc2 thru 0x95fc761 (0x99a0 bytes) 2024-09-21T15:08:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:2986 flatten 2024-09-21T15:08:53.255 INFO:teuthology.orchestra.run.smithi161.stdout:2726 write 0x7f9fa48 thru 0x7fa4ef3 (0x54ac bytes) 2024-09-21T15:08:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:2727 write 0x66b8adb thru 0x66c7a4f (0xef75 bytes) 2024-09-21T15:08:53.341 INFO:teuthology.orchestra.run.smithi161.stdout:3179 write 0xce2500b thru 0xce3024f (0xb245 bytes) 2024-09-21T15:08:53.348 INFO:teuthology.orchestra.run.smithi161.stdout:2728 punch from 0x968e85f to 0x96943c3, (0x5b64 bytes) 2024-09-21T15:08:53.357 INFO:teuthology.orchestra.run.smithi161.stdout:3042 write 0xd6c86a9 thru 0xd6d536c (0xccc4 bytes) 2024-09-21T15:08:53.361 INFO:teuthology.orchestra.run.smithi161.stdout:2729 trunc from 0xd58c450 to 0x6b78fdf 2024-09-21T15:08:53.371 INFO:teuthology.orchestra.run.smithi161.stdout:3180 read 0x448f790 thru 0x449a43b (0xacac bytes) 2024-09-21T15:08:53.372 INFO:teuthology.orchestra.run.smithi161.stdout:3181 read 0x865edaa thru 0x866df6d (0xf1c4 bytes) 2024-09-21T15:08:53.396 INFO:teuthology.orchestra.run.smithi161.stdout:2987 read 0xde4f629 thru 0xde59428 (0x9e00 bytes) 2024-09-21T15:08:53.397 INFO:teuthology.orchestra.run.smithi161.stdout:3043 read 0x15fd121 thru 0x1602430 (0x5310 bytes) 2024-09-21T15:08:53.397 INFO:teuthology.orchestra.run.smithi161.stdout:2989 write 0x1c0e457 thru 0x1c13e48 (0x59f2 bytes) 2024-09-21T15:08:53.400 INFO:teuthology.orchestra.run.smithi161.stdout:3044 writesame 0x585daed thru 0x5868f5f data_size 0x1(0xb473 bytes) 2024-09-21T15:08:53.415 INFO:teuthology.orchestra.run.smithi161.stdout:2990 writesame 0xaecc6ae thru 0xaed9351 data_size 0xe(0xcca4 bytes) 2024-09-21T15:08:53.419 INFO:teuthology.orchestra.run.smithi161.stdout:3183 write 0xd0fae9d thru 0xd104ea6 (0xa00a bytes) 2024-09-21T15:08:53.449 INFO:teuthology.orchestra.run.smithi161.stdout:3184 write 0x70aec42 thru 0x70be29b (0xf65a bytes) 2024-09-21T15:08:53.452 INFO:teuthology.orchestra.run.smithi161.stdout:3045 read 0x9bd3429 thru 0x9be09d2 (0xd5aa bytes) 2024-09-21T15:08:53.452 INFO:teuthology.orchestra.run.smithi161.stdout:3046 punch from 0x89d08b3 to 0x89d7640, (0x6d8d bytes) 2024-09-21T15:08:53.452 INFO:teuthology.orchestra.run.smithi161.stdout:3047 write 0x2b1ce5e thru 0x2b214ae (0x4651 bytes) 2024-09-21T15:08:53.454 INFO:teuthology.orchestra.run.smithi161.stdout:2991 writesame 0xb796b5b thru 0xb799d32 data_size 0x3a(0x31d8 bytes) 2024-09-21T15:08:53.473 INFO:teuthology.orchestra.run.smithi161.stdout:3185 writesame 0x6a45c54 thru 0x6a4cd47 data_size 0x2(0x70f4 bytes) 2024-09-21T15:08:53.477 INFO:teuthology.orchestra.run.smithi161.stdout:2992 punch from 0xcd384e6 to 0xcd47bf2, (0xf70c bytes) 2024-09-21T15:08:53.477 INFO:teuthology.orchestra.run.smithi161.stdout:2993 read 0x4c00cad thru 0x4c0c553 (0xb8a7 bytes) 2024-09-21T15:08:53.477 INFO:teuthology.orchestra.run.smithi161.stdout:2994 read 0x3c54729 thru 0x3c6021a (0xbaf2 bytes) 2024-09-21T15:08:53.478 INFO:teuthology.orchestra.run.smithi161.stdout:2996 punch from 0x526a8f3 to 0x5278552, (0xdc5f bytes) 2024-09-21T15:08:53.479 INFO:teuthology.orchestra.run.smithi161.stdout:2997 read 0xbcd271 thru 0xbdc510 (0xf2a0 bytes) 2024-09-21T15:08:53.479 INFO:teuthology.orchestra.run.smithi161.stdout:2999 punch from 0x743f3b3 to 0x744cfc5, (0xdc12 bytes) 2024-09-21T15:08:53.480 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.480 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.486 INFO:teuthology.orchestra.run.smithi161.stdout:3049 read 0x33b9015 thru 0x33c7c59 (0xec45 bytes) 2024-09-21T15:08:53.492 INFO:teuthology.orchestra.run.smithi161.stdout:3186 read 0x7537a94 thru 0x754153e (0x9aab bytes) 2024-09-21T15:08:53.514 INFO:teuthology.orchestra.run.smithi161.stdout:2730 trunc from 0x6b78fdf to 0x1773f1f 2024-09-21T15:08:53.518 INFO:teuthology.orchestra.run.smithi161.stdout:3002 writesame 0xe9781f4 thru 0xe97fd21 data_size 0x1(0x7b2e bytes) 2024-09-21T15:08:53.522 INFO:teuthology.orchestra.run.smithi161.stdout:3050 write 0xedc6004 thru 0xedd2ab2 (0xcaaf bytes) 2024-09-21T15:08:53.527 INFO:teuthology.orchestra.run.smithi161.stdout:2387 read 0x1223a thru 0x17a50 (0x5817 bytes) 2024-09-21T15:08:53.536 INFO:teuthology.orchestra.run.smithi161.stdout:3004 trunc from 0xe97fd22 to 0x6de0efa 2024-09-21T15:08:53.546 INFO:teuthology.orchestra.run.smithi161.stdout:3187 write 0xe489ac9 thru 0xe49171a (0x7c52 bytes) 2024-09-21T15:08:53.564 INFO:teuthology.orchestra.run.smithi161.stdout:3051 write 0x8f37a63 thru 0x8f42d4a (0xb2e8 bytes) 2024-09-21T15:08:53.564 INFO:teuthology.orchestra.run.smithi161.stdout:3188 read 0xc8cbbec thru 0xc8cefea (0x33ff bytes) 2024-09-21T15:08:53.564 INFO:teuthology.orchestra.run.smithi161.stdout:3191 read 0x9add88b thru 0x9ae7dd1 (0xa547 bytes) 2024-09-21T15:08:53.566 INFO:teuthology.orchestra.run.smithi161.stdout:3193 write 0xa02604f thru 0xa0357ed (0xf79f bytes) 2024-09-21T15:08:53.589 INFO:teuthology.orchestra.run.smithi161.stdout:3194 write 0x802164 thru 0x80cfeb (0xae88 bytes) 2024-09-21T15:08:53.603 INFO:teuthology.orchestra.run.smithi161.stdout:3197 punch from 0x9dc9981 to 0x9dd15a2, (0x7c21 bytes) 2024-09-21T15:08:53.603 INFO:teuthology.orchestra.run.smithi161.stdout:3198 read 0x9b8e742 thru 0x9b9434d (0x5c0c bytes) 2024-09-21T15:08:53.604 INFO:teuthology.orchestra.run.smithi161.stdout:3199 writesame 0x487c903 thru 0x4889f30 data_size 0x5(0xd62e bytes) 2024-09-21T15:08:53.628 INFO:teuthology.orchestra.run.smithi161.stdout:2388 writesame 0x928e58f thru 0x9296119 data_size 0x1(0x7b8b bytes) 2024-09-21T15:08:53.637 INFO:teuthology.orchestra.run.smithi161.stdout:3008 read 0x3f0dfc9 thru 0x3f1c248 (0xe280 bytes) 2024-09-21T15:08:53.639 INFO:teuthology.orchestra.run.smithi161.stdout:3009 read 0xe187bc thru 0xe19b17 (0x135c bytes) 2024-09-21T15:08:53.639 INFO:teuthology.orchestra.run.smithi161.stdout:2389 trunc from 0x929611a to 0xb0553d9 2024-09-21T15:08:53.642 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #19, image image_cluster1.client.mirror.2-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent20 2024-09-21T15:08:53.651 INFO:teuthology.orchestra.run.smithi161.stdout:3052 trunc from 0xedd2ab3 to 0x86bf218 2024-09-21T15:08:53.653 INFO:teuthology.orchestra.run.smithi161.stdout:2732 read 0x9854f7 thru 0x98a470 (0x4f7a bytes) 2024-09-21T15:08:53.655 INFO:teuthology.orchestra.run.smithi161.stdout:2734 punch from 0x19eaa4 to 0x1a655d, (0x7ab9 bytes) 2024-09-21T15:08:53.665 INFO:teuthology.orchestra.run.smithi161.stdout:3201 trunc from 0xe49171b to 0xc47099 2024-09-21T15:08:53.679 INFO:teuthology.orchestra.run.smithi161.stdout:2390 punch from 0x23b0b8f to 0x23bd1bc, (0xc62d bytes) 2024-09-21T15:08:53.679 INFO:teuthology.orchestra.run.smithi161.stdout:2391 punch from 0x3e0066e to 0x3e09284, (0x8c16 bytes) 2024-09-21T15:08:53.679 INFO:teuthology.orchestra.run.smithi161.stdout:2392 read 0xaeda829 thru 0xaee2702 (0x7eda bytes) 2024-09-21T15:08:53.679 INFO:teuthology.orchestra.run.smithi161.stdout:2393 clone 29 order 22 su 32768 sc 11 2024-09-21T15:08:53.697 INFO:teuthology.orchestra.run.smithi161.stdout:3010 write 0xec57147 thru 0xec63b90 (0xca4a bytes) 2024-09-21T15:08:53.698 INFO:teuthology.orchestra.run.smithi161.stdout:2735 write 0x335e466 thru 0x336ba57 (0xd5f2 bytes) 2024-09-21T15:08:53.720 INFO:teuthology.orchestra.run.smithi161.stdout:3011 write 0x514b8ac thru 0x514e00e (0x2763 bytes) 2024-09-21T15:08:53.730 INFO:teuthology.orchestra.run.smithi161.stdout:2736 read 0x411f thru 0x10f23 (0xce05 bytes) 2024-09-21T15:08:53.732 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.733 INFO:teuthology.orchestra.run.smithi161.stdout:2738 read 0xc1d9e4 thru 0xc1e636 (0xc53 bytes) 2024-09-21T15:08:53.733 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.733 INFO:teuthology.orchestra.run.smithi161.stdout:2740 writesame 0x2822bc thru 0x285e8b data_size 0x58(0x3bd0 bytes) 2024-09-21T15:08:53.734 INFO:teuthology.orchestra.run.smithi161.stdout:3013 writesame 0x638a036 thru 0x638d3ee data_size 0x1(0x33b9 bytes) 2024-09-21T15:08:53.752 INFO:teuthology.orchestra.run.smithi161.stdout:3202 trunc from 0xc47099 to 0x2a39239 2024-09-21T15:08:53.755 INFO:teuthology.orchestra.run.smithi161.stdout:3014 read 0xe1e2459 thru 0xe1ecee9 (0xaa91 bytes) 2024-09-21T15:08:53.764 INFO:teuthology.orchestra.run.smithi161.stdout:2741 clone 24 order 18 su 131072 sc 9 2024-09-21T15:08:53.766 INFO:teuthology.orchestra.run.smithi161.stdout:3054 writesame 0x8d4b78c thru 0x8d4dbc4 data_size 0xb(0x2439 bytes) 2024-09-21T15:08:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:3015 trunc from 0xec63b91 to 0x9e05af2 2024-09-21T15:08:53.789 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.810 INFO:teuthology.orchestra.run.smithi161.stdout:3055 writesame 0x9f51baf thru 0x9f52ce5 data_size 0xd(0x1137 bytes) 2024-09-21T15:08:53.816 INFO:teuthology.orchestra.run.smithi161.stdout:3056 write 0x1480a5e thru 0x1480b10 (0xb3 bytes) 2024-09-21T15:08:53.826 INFO:teuthology.orchestra.run.smithi161.stdout:3016 punch from 0x9155e7c to 0x91564c2, (0x646 bytes) 2024-09-21T15:08:53.827 INFO:teuthology.orchestra.run.smithi161.stdout:3206 write 0x792bb77 thru 0x79380d1 (0xc55b bytes) 2024-09-21T15:08:53.827 INFO:teuthology.orchestra.run.smithi161.stdout:3057 read 0x5c3083 thru 0x5cc64c (0x95ca bytes) 2024-09-21T15:08:53.829 INFO:teuthology.orchestra.run.smithi161.stdout:3058 trunc from 0x9f52ce6 to 0xac5a889 2024-09-21T15:08:53.832 INFO:teuthology.orchestra.run.smithi161.stdout:3017 trunc from 0x9e05af2 to 0x6fe74a5 2024-09-21T15:08:53.837 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.837 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.842 INFO:teuthology.orchestra.run.smithi161.stdout:3210 trunc from 0x79380d2 to 0x97fda04 2024-09-21T15:08:53.865 INFO:teuthology.orchestra.run.smithi161.stdout:3211 read 0xa2cef9 thru 0xa33f55 (0x705d bytes) 2024-09-21T15:08:53.866 INFO:teuthology.orchestra.run.smithi161.stdout:3212 read 0x439f33e thru 0x43acf05 (0xdbc8 bytes) 2024-09-21T15:08:53.867 INFO:teuthology.orchestra.run.smithi161.stdout:3213 write 0x523fc0b thru 0x524f374 (0xf76a bytes) 2024-09-21T15:08:53.885 INFO:teuthology.orchestra.run.smithi161.stdout:3018 write 0x74604cf thru 0x746e954 (0xe486 bytes) 2024-09-21T15:08:53.889 INFO:teuthology.orchestra.run.smithi161.stdout:3214 trunc from 0x97fda04 to 0x63998ff 2024-09-21T15:08:53.900 INFO:teuthology.orchestra.run.smithi161.stdout:3019 punch from 0x5ab8a71 to 0x5abc350, (0x38df bytes) 2024-09-21T15:08:53.900 INFO:teuthology.orchestra.run.smithi161.stdout:3020 punch from 0x396c547 to 0x3972152, (0x5c0b bytes) 2024-09-21T15:08:53.900 INFO:teuthology.orchestra.run.smithi161.stdout:3021 punch from 0x5500e38 to 0x550f9f3, (0xebbb bytes) 2024-09-21T15:08:53.900 INFO:teuthology.orchestra.run.smithi161.stdout:3024 punch from 0x66719e to 0x66d19b, (0x5ffd bytes) 2024-09-21T15:08:53.908 INFO:teuthology.orchestra.run.smithi161.stdout:3059 write 0xdcdff27 thru 0xdce8e49 (0x8f23 bytes) 2024-09-21T15:08:53.941 INFO:teuthology.orchestra.run.smithi161.stdout:3065 read 0x439785f thru 0x43a3801 (0xbfa3 bytes) 2024-09-21T15:08:53.941 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.942 INFO:teuthology.orchestra.run.smithi161.stdout:3068 punch from 0x44ac8b4 to 0x44bb4b4, (0xec00 bytes) 2024-09-21T15:08:53.942 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.942 INFO:teuthology.orchestra.run.smithi161.stdout:3070 read 0x9e87ab thru 0x9f262f (0x9e85 bytes) 2024-09-21T15:08:53.942 INFO:teuthology.orchestra.run.smithi161.stdout:3071 write 0x79fdf1f thru 0x7a0ac55 (0xcd37 bytes) 2024-09-21T15:08:53.947 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:53.947 INFO:teuthology.orchestra.run.smithi161.stdout:3217 writesame 0x168fd56 thru 0x169e897 data_size 0x1(0xeb42 bytes) 2024-09-21T15:08:54.000 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.000 INFO:teuthology.orchestra.run.smithi161.stdout:3075 read 0xbc87910 thru 0xbc94260 (0xc951 bytes) 2024-09-21T15:08:54.007 INFO:teuthology.orchestra.run.smithi161.stdout:3025 write 0xd2dd119 thru 0xd2e1568 (0x4450 bytes) 2024-09-21T15:08:54.009 INFO:teuthology.orchestra.run.smithi161.stdout:3220 trunc from 0x63998ff to 0x1e3cca8 2024-09-21T15:08:54.020 INFO:teuthology.orchestra.run.smithi161.stdout:3026 punch from 0x5d2277b to 0x5d304c4, (0xdd49 bytes) 2024-09-21T15:08:54.021 INFO:teuthology.orchestra.run.smithi161.stdout:3027 read 0xc0a99bc thru 0xc0a9e6b (0x4b0 bytes) 2024-09-21T15:08:54.023 INFO:teuthology.orchestra.run.smithi161.stdout:3028 trunc from 0xd2e1569 to 0xb484157 2024-09-21T15:08:54.031 INFO:teuthology.orchestra.run.smithi161.stdout:3076 write 0xecb3d82 thru 0xecbaa0e (0x6c8d bytes) 2024-09-21T15:08:54.039 INFO:teuthology.orchestra.run.smithi161.stdout:3398 punch from 0x244563 to 0x24bbeb, (0x7688 bytes) 2024-09-21T15:08:54.045 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.046 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.046 INFO:teuthology.orchestra.run.smithi161.stdout:3224 read 0xbb6fcd thru 0xbb7c11 (0xc45 bytes) 2024-09-21T15:08:54.067 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.080 INFO:teuthology.orchestra.run.smithi161.stdout:3399 trunc from 0x7729a64 to 0x8c9859e 2024-09-21T15:08:54.089 INFO:teuthology.orchestra.run.smithi161.stdout:3225 write 0xe5e4950 thru 0xe5f2507 (0xdbb8 bytes) 2024-09-21T15:08:54.091 INFO:teuthology.orchestra.run.smithi161.stdout:3081 trunc from 0xecbaa0f to 0x2060a7d 2024-09-21T15:08:54.110 INFO:teuthology.orchestra.run.smithi161.stdout:3227 read 0xd9f262b thru 0xd9fa2e9 (0x7cbf bytes) 2024-09-21T15:08:54.110 INFO:teuthology.orchestra.run.smithi161.stdout:3228 punch from 0x2cff060 to 0x2d017ef, (0x278f bytes) 2024-09-21T15:08:54.110 INFO:teuthology.orchestra.run.smithi161.stdout:3230 punch from 0x7f5d181 to 0x7f64214, (0x7093 bytes) 2024-09-21T15:08:54.110 INFO:teuthology.orchestra.run.smithi161.stdout:3231 read 0x8be71cc thru 0x8be722c (0x61 bytes) 2024-09-21T15:08:54.110 INFO:teuthology.orchestra.run.smithi161.stdout:3233 write 0xb7eff3f thru 0xb7effcf (0x91 bytes) 2024-09-21T15:08:54.111 INFO:teuthology.orchestra.run.smithi161.stdout:3401 read 0xf41ed5 thru 0xf4aab5 (0x8be1 bytes) 2024-09-21T15:08:54.114 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xebe99fa 2024-09-21T15:08:54.116 INFO:teuthology.orchestra.run.smithi161.stdout:3029 write 0xdcf074c thru 0xdcf6329 (0x5bde bytes) 2024-09-21T15:08:54.125 INFO:teuthology.orchestra.run.smithi161.stdout:3403 trunc from 0x8c9859e to 0xebe99fa 2024-09-21T15:08:54.133 INFO:teuthology.orchestra.run.smithi161.stdout:3235 write 0x1698901 thru 0x169eb2f (0x622f bytes) 2024-09-21T15:08:54.142 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.142 INFO:teuthology.orchestra.run.smithi161.stdout:3031 read 0xb7f2cf7 thru 0xb80105b (0xe365 bytes) 2024-09-21T15:08:54.145 INFO:teuthology.orchestra.run.smithi161.stdout:3032 read 0xd7083e7 thru 0xd710d82 (0x899c bytes) 2024-09-21T15:08:54.145 INFO:teuthology.orchestra.run.smithi161.stdout:3034 punch from 0xc80bb54 to 0xc813546, (0x79f2 bytes) 2024-09-21T15:08:54.145 INFO:teuthology.orchestra.run.smithi161.stdout:3035 write 0x577b01d thru 0x5787541 (0xc525 bytes) 2024-09-21T15:08:54.148 INFO:teuthology.orchestra.run.smithi161.stdout:3236 writesame 0x1ae1c1c thru 0x1ae9ba3 data_size 0x6a(0x7f88 bytes) 2024-09-21T15:08:54.163 INFO:teuthology.orchestra.run.smithi161.stdout:3036 read 0x7081d88 thru 0x708bf9b (0xa214 bytes) 2024-09-21T15:08:54.163 INFO:teuthology.orchestra.run.smithi161.stdout:3037 punch from 0xb9740cb to 0xb976585, (0x24ba bytes) 2024-09-21T15:08:54.165 INFO:teuthology.orchestra.run.smithi161.stdout:3404 write 0x97f5c91 thru 0x9801052 (0xb3c2 bytes) 2024-09-21T15:08:54.165 INFO:teuthology.orchestra.run.smithi161.stdout:3237 read 0x11c24dc thru 0x11c29ff (0x524 bytes) 2024-09-21T15:08:54.166 INFO:teuthology.orchestra.run.smithi161.stdout:3238 punch from 0x2b76ebd to 0x2b86c3a, (0xfd7d bytes) 2024-09-21T15:08:54.167 INFO:teuthology.orchestra.run.smithi161.stdout:3240 write 0xa152d70 thru 0xa1629ef (0xfc80 bytes) 2024-09-21T15:08:54.173 INFO:teuthology.orchestra.run.smithi161.stdout:3038 trunc from 0xdcf632a to 0xa2cacce 2024-09-21T15:08:54.182 INFO:teuthology.orchestra.run.smithi161.stdout:3405 read 0xb997d35 thru 0xb9a4e4a (0xd116 bytes) 2024-09-21T15:08:54.183 INFO:teuthology.orchestra.run.smithi161.stdout:3406 write 0xa0aff00 thru 0xa0b5ce3 (0x5de4 bytes) 2024-09-21T15:08:54.187 INFO:teuthology.orchestra.run.smithi161.stdout:3242 trunc from 0xe5f2508 to 0x97dfe31 2024-09-21T15:08:54.192 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.192 INFO:teuthology.orchestra.run.smithi161.stdout:3084 punch from 0x5b4ca7 to 0x5bad71, (0x60ca bytes) 2024-09-21T15:08:54.192 INFO:teuthology.orchestra.run.smithi161.stdout:3085 read 0x18049a5 thru 0x180fb5e (0xb1ba bytes) 2024-09-21T15:08:54.193 INFO:teuthology.orchestra.run.smithi161.stdout:3086 punch from 0x22ada6 to 0x22fb4f, (0x4da9 bytes) 2024-09-21T15:08:54.204 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.204 INFO:teuthology.orchestra.run.smithi161.stdout:3409 punch from 0x5b82049 to 0x5b8474f, (0x2706 bytes) 2024-09-21T15:08:54.205 INFO:teuthology.orchestra.run.smithi161.stdout:3411 read 0x675c1b9 thru 0x676ada3 (0xebeb bytes) 2024-09-21T15:08:54.206 INFO:teuthology.orchestra.run.smithi161.stdout:3413 writesame 0x4d9dfb2 thru 0x4d9fe8f data_size 0x9(0x1ede bytes) 2024-09-21T15:08:54.224 INFO:teuthology.orchestra.run.smithi161.stdout:3414 punch from 0xb2054f3 to 0xb21093d, (0xb44a bytes) 2024-09-21T15:08:54.224 INFO:teuthology.orchestra.run.smithi161.stdout:3415 write 0x6ff84e2 thru 0x7006eff (0xea1e bytes) 2024-09-21T15:08:54.234 INFO:teuthology.orchestra.run.smithi161.stdout:3087 write 0x66b4f16 thru 0x66bdd4a (0x8e35 bytes) 2024-09-21T15:08:54.262 INFO:teuthology.orchestra.run.smithi161.stdout:3416 read 0x707f6be thru 0x708917d (0x9ac0 bytes) 2024-09-21T15:08:54.264 INFO:teuthology.orchestra.run.smithi161.stdout:3417 read 0x8722e10 thru 0x872a481 (0x7672 bytes) 2024-09-21T15:08:54.264 INFO:teuthology.orchestra.run.smithi161.stdout:3418 write 0xe555cc7 thru 0xe55754d (0x1887 bytes) 2024-09-21T15:08:54.265 INFO:teuthology.orchestra.run.smithi161.stdout:3089 punch from 0x5e5769d to 0x5e58a30, (0x1393 bytes) 2024-09-21T15:08:54.268 INFO:teuthology.orchestra.run.smithi161.stdout:3243 punch from 0x451269 to 0x456a37, (0x57ce bytes) 2024-09-21T15:08:54.276 INFO:teuthology.orchestra.run.smithi161.stdout:3420 writesame 0xdbc0b27 thru 0xdbd0ada data_size 0x1e(0xffb4 bytes) 2024-09-21T15:08:54.280 INFO:teuthology.orchestra.run.smithi161.stdout:3039 write 0xbab8fe0 thru 0xbac0a0e (0x7a2f bytes) 2024-09-21T15:08:54.292 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.292 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.292 INFO:teuthology.orchestra.run.smithi161.stdout:3043 write 0xacfe1f thru 0xadf2b3 (0xf495 bytes) 2024-09-21T15:08:54.298 INFO:teuthology.orchestra.run.smithi161.stdout:3421 read 0xe2e75bb thru 0xe2f3556 (0xbf9c bytes) 2024-09-21T15:08:54.298 INFO:teuthology.orchestra.run.smithi161.stdout:3422 write 0x1b051b1 thru 0x1b13859 (0xe6a9 bytes) 2024-09-21T15:08:54.303 INFO:teuthology.orchestra.run.smithi161.stdout:3044 write 0x95582d0 thru 0x9559e8c (0x1bbd bytes) 2024-09-21T15:08:54.313 INFO:teuthology.orchestra.run.smithi161.stdout:3045 write 0x4dcccd6 thru 0x4dd7cb1 (0xafdc bytes) 2024-09-21T15:08:54.318 INFO:teuthology.orchestra.run.smithi161.stdout:3245 write 0xdf30790 thru 0xdf3e369 (0xdbda bytes) 2024-09-21T15:08:54.324 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.324 INFO:teuthology.orchestra.run.smithi161.stdout:3425 read 0xc2dcea9 thru 0xc2e90f3 (0xc24b bytes) 2024-09-21T15:08:54.325 INFO:teuthology.orchestra.run.smithi161.stdout:3426 read 0x4db3668 thru 0x4dbe256 (0xabef bytes) 2024-09-21T15:08:54.326 INFO:teuthology.orchestra.run.smithi161.stdout:3090 writesame 0xb5b085d thru 0xb5b8570 data_size 0xa(0x7d14 bytes) 2024-09-21T15:08:54.326 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.326 INFO:teuthology.orchestra.run.smithi161.stdout:3427 writesame 0xab44011 thru 0xab455f5 data_size 0x1(0x15e5 bytes) 2024-09-21T15:08:54.334 INFO:teuthology.orchestra.run.smithi161.stdout:3246 punch from 0x9aac427 to 0x9ab7e1f, (0xb9f8 bytes) 2024-09-21T15:08:54.334 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.335 INFO:teuthology.orchestra.run.smithi161.stdout:3094 read 0x5490281 thru 0x549695c (0x66dc bytes) 2024-09-21T15:08:54.335 INFO:teuthology.orchestra.run.smithi161.stdout:3095 read 0x5bc7b55 thru 0x5bcec95 (0x7141 bytes) 2024-09-21T15:08:54.335 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.335 INFO:teuthology.orchestra.run.smithi161.stdout:3097 write 0x5ee5f2b thru 0x5eee272 (0x8348 bytes) 2024-09-21T15:08:54.339 INFO:teuthology.orchestra.run.smithi161.stdout:3049 trunc from 0xbac0a0f to 0x5cc9857 2024-09-21T15:08:54.343 INFO:teuthology.orchestra.run.smithi161.stdout:3428 read 0x45810f4 thru 0x4588296 (0x71a3 bytes) 2024-09-21T15:08:54.344 INFO:teuthology.orchestra.run.smithi161.stdout:3429 writesame 0xbdbe40b thru 0xbdcaf3e data_size 0xb4(0xcb34 bytes) 2024-09-21T15:08:54.345 INFO:teuthology.orchestra.run.smithi161.stdout:3248 trunc from 0xdf3e36a to 0x89c17e1 2024-09-21T15:08:54.366 INFO:teuthology.orchestra.run.smithi161.stdout:3431 read 0xc0ced3a thru 0xc0cf4ce (0x795 bytes) 2024-09-21T15:08:54.366 INFO:teuthology.orchestra.run.smithi161.stdout:3432 read 0xdbefac1 thru 0xdbfdc01 (0xe141 bytes) 2024-09-21T15:08:54.367 INFO:teuthology.orchestra.run.smithi161.stdout:3433 write 0xe602096 thru 0xe60cedb (0xae46 bytes) 2024-09-21T15:08:54.400 INFO:teuthology.orchestra.run.smithi161.stdout:3438 punch from 0x7fae243 to 0x7fb0748, (0x2505 bytes) 2024-09-21T15:08:54.400 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.400 INFO:teuthology.orchestra.run.smithi161.stdout:3440 read 0xc18351b thru 0xc192fba (0xfaa0 bytes) 2024-09-21T15:08:54.400 INFO:teuthology.orchestra.run.smithi161.stdout:3442 punch from 0xc3c8fa to 0xc49623, (0xcd29 bytes) 2024-09-21T15:08:54.401 INFO:teuthology.orchestra.run.smithi161.stdout:3443 flatten 2024-09-21T15:08:54.441 INFO:teuthology.orchestra.run.smithi161.stdout:3249 punch from 0x165f692 to 0x166eb04, (0xf472 bytes) 2024-09-21T15:08:54.441 INFO:teuthology.orchestra.run.smithi161.stdout:3250 punch from 0x60e1d1b to 0x60f045e, (0xe743 bytes) 2024-09-21T15:08:54.445 INFO:teuthology.orchestra.run.smithi161.stdout:3050 writesame 0x1c9aabe thru 0x1ca317e data_size 0x3(0x86c1 bytes) 2024-09-21T15:08:54.454 INFO:teuthology.orchestra.run.smithi161.stdout:3251 trunc from 0x89c17e1 to 0xd923b97 2024-09-21T15:08:54.460 INFO:teuthology.orchestra.run.smithi161.stdout:3098 write 0xe6c06d8 thru 0xe6c31db (0x2b04 bytes) 2024-09-21T15:08:54.509 INFO:teuthology.orchestra.run.smithi161.stdout:3099 write 0x2c458aa thru 0x2c4cc11 (0x7368 bytes) 2024-09-21T15:08:54.529 INFO:teuthology.orchestra.run.smithi161.stdout:3252 punch from 0x3edc3af to 0x3edf35e, (0x2faf bytes) 2024-09-21T15:08:54.529 INFO:teuthology.orchestra.run.smithi161.stdout:3253 punch from 0x3852d29 to 0x3853e73, (0x114a bytes) 2024-09-21T15:08:54.529 INFO:teuthology.orchestra.run.smithi161.stdout:3254 punch from 0x4bb9c5e to 0x4bc7251, (0xd5f3 bytes) 2024-09-21T15:08:54.529 INFO:teuthology.orchestra.run.smithi161.stdout:3255 writesame 0xc0f99df thru 0xc0fcb78 data_size 0x7(0x319a bytes) 2024-09-21T15:08:54.555 INFO:teuthology.orchestra.run.smithi161.stdout:3100 read 0x66ddde2 thru 0x66e20b8 (0x42d7 bytes) 2024-09-21T15:08:54.576 INFO:teuthology.orchestra.run.smithi161.stdout:3256 punch from 0xb12c7e7 to 0xb12db68, (0x1381 bytes) 2024-09-21T15:08:54.576 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.576 INFO:teuthology.orchestra.run.smithi161.stdout:3259 writesame 0x6f5abfe thru 0x6f5e442 data_size 0x2b(0x3845 bytes) 2024-09-21T15:08:54.578 INFO:teuthology.orchestra.run.smithi161.stdout:3102 writesame 0x6788138 thru 0x678ad46 data_size 0x1(0x2c0f bytes) 2024-09-21T15:08:54.600 INFO:teuthology.orchestra.run.smithi161.stdout:3052 write 0x723b32a thru 0x7242570 (0x7247 bytes) 2024-09-21T15:08:54.601 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.602 INFO:teuthology.orchestra.run.smithi161.stdout:3261 trunc from 0xd923b97 to 0xde7a1e4 2024-09-21T15:08:54.629 INFO:teuthology.orchestra.run.smithi161.stdout:3105 read 0xca858a3 thru 0xca91317 (0xba75 bytes) 2024-09-21T15:08:54.629 INFO:teuthology.orchestra.run.smithi161.stdout:3106 read 0x1676b1 thru 0x1717b5 (0xa105 bytes) 2024-09-21T15:08:54.633 INFO:teuthology.orchestra.run.smithi161.stdout:3054 read 0x70d4dfc thru 0x70d4f36 (0x13b bytes) 2024-09-21T15:08:54.653 INFO:teuthology.orchestra.run.smithi161.stdout:3107 trunc from 0xe6c31dc to 0x8461563 2024-09-21T15:08:54.694 INFO:teuthology.orchestra.run.smithi161.stdout:3263 trunc from 0xde7a1e4 to 0x949b563 2024-09-21T15:08:54.812 INFO:teuthology.orchestra.run.smithi161.stdout:3264 punch from 0x3ee86dd to 0x3eeba11, (0x3334 bytes) 2024-09-21T15:08:54.812 INFO:teuthology.orchestra.run.smithi161.stdout:3265 punch from 0x41a943a to 0x41b6626, (0xd1ec bytes) 2024-09-21T15:08:54.825 INFO:teuthology.orchestra.run.smithi161.stdout:3266 trunc from 0x949b563 to 0xedb95ac 2024-09-21T15:08:54.828 INFO:teuthology.orchestra.run.smithi161.stdout:3056 write 0xba1593f thru 0xba1def7 (0x85b9 bytes) 2024-09-21T15:08:54.841 INFO:teuthology.orchestra.run.smithi161.stdout:3108 read 0x637ccda thru 0x638c93a (0xfc61 bytes) 2024-09-21T15:08:54.856 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.4-clone23 intact 2024-09-21T15:08:54.877 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:54.890 INFO:teuthology.orchestra.run.smithi161.stdout:3059 trunc from 0xba1def8 to 0x100d587 2024-09-21T15:08:54.894 INFO:teuthology.orchestra.run.smithi161.stdout:3267 write 0x1269ff6 thru 0x12775b4 (0xd5bf bytes) 2024-09-21T15:08:54.900 INFO:teuthology.orchestra.run.smithi161.stdout:3110 writesame 0x97e8604 thru 0x97eb829 data_size 0x1(0x3226 bytes) 2024-09-21T15:08:54.903 INFO:teuthology.orchestra.run.smithi161.stdout:3111 punch from 0x2a8a920 to 0x2a994a7, (0xeb87 bytes) 2024-09-21T15:08:54.910 INFO:teuthology.orchestra.run.smithi161.stdout:3268 read 0xed00ea9 thru 0xed05d23 (0x4e7b bytes) 2024-09-21T15:08:54.911 INFO:teuthology.orchestra.run.smithi161.stdout:3269 writesame 0x4cbb6c0 thru 0x4cc9562 data_size 0x1(0xdea3 bytes) 2024-09-21T15:08:54.915 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone28 from 0xb0553d9 (overlap 0x481cef) to 0x327aa7 2024-09-21T15:08:54.916 INFO:teuthology.orchestra.run.smithi161.stdout:3444 writesame 0x1d3da thru 0x2ca75 data_size 0x6(0xf69c bytes) 2024-09-21T15:08:54.965 INFO:teuthology.orchestra.run.smithi161.stdout:3273 read 0x14c65f6 thru 0x14ce14e (0x7b59 bytes) 2024-09-21T15:08:54.977 INFO:teuthology.orchestra.run.smithi161.stdout:3112 write 0xd320645 thru 0xd32940c (0x8dc8 bytes) 2024-09-21T15:08:54.981 INFO:teuthology.orchestra.run.smithi161.stdout:3445 writesame 0x32e2487 thru 0x32e9fb2 data_size 0x4(0x7b2c bytes) 2024-09-21T15:08:54.984 INFO:teuthology.orchestra.run.smithi161.stdout:3274 trunc from 0xedb95ac to 0x72a7ff1 2024-09-21T15:08:55.011 INFO:teuthology.orchestra.run.smithi161.stdout:3446 punch from 0x1eeca4d to 0x1efa671, (0xdc24 bytes) 2024-09-21T15:08:55.011 INFO:teuthology.orchestra.run.smithi161.stdout:3448 read 0x208e08 thru 0x211b8b (0x8d84 bytes) 2024-09-21T15:08:55.012 INFO:teuthology.orchestra.run.smithi161.stdout:3449 read 0xd26cd3e thru 0xd271e7f (0x5142 bytes) 2024-09-21T15:08:55.012 INFO:teuthology.orchestra.run.smithi161.stdout:3450 writesame 0x6bc75ae thru 0x6bd5463 data_size 0x1d(0xdeb6 bytes) 2024-09-21T15:08:55.014 INFO:teuthology.orchestra.run.smithi161.stdout:3113 read 0x724ed81 thru 0x7258dc3 (0xa043 bytes) 2024-09-21T15:08:55.014 INFO:teuthology.orchestra.run.smithi161.stdout:3114 read 0x69da67f thru 0x69e37f5 (0x9177 bytes) 2024-09-21T15:08:55.014 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.015 INFO:teuthology.orchestra.run.smithi161.stdout:3116 writesame 0x8ce039 thru 0x8d7405 data_size 0x1(0x93cd bytes) 2024-09-21T15:08:55.044 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #22, image image_cluster1.client.mirror.4-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent23 2024-09-21T15:08:55.047 INFO:teuthology.orchestra.run.smithi161.stdout:3117 write 0xa6a161f thru 0xa6b1072 (0xfa54 bytes) 2024-09-21T15:08:55.052 INFO:teuthology.orchestra.run.smithi161.stdout:3451 punch from 0x909706a to 0x90a4d1f, (0xdcb5 bytes) 2024-09-21T15:08:55.052 INFO:teuthology.orchestra.run.smithi161.stdout:3452 read 0xa21a409 thru 0xa21f2af (0x4ea7 bytes) 2024-09-21T15:08:55.054 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.054 INFO:teuthology.orchestra.run.smithi161.stdout:3454 writesame 0x6a4a697 thru 0x6a50b56 data_size 0x1a(0x64c0 bytes) 2024-09-21T15:08:55.056 INFO:teuthology.orchestra.run.smithi161.stdout:3275 trunc from 0x72a7ff1 to 0x3afcabd 2024-09-21T15:08:55.075 INFO:teuthology.orchestra.run.smithi161.stdout:3455 write 0xd63a82a thru 0xd6471da (0xc9b1 bytes) 2024-09-21T15:08:55.085 INFO:teuthology.orchestra.run.smithi161.stdout:3118 writesame 0x9d3cb09 thru 0x9d45601 data_size 0x43(0x8af9 bytes) 2024-09-21T15:08:55.090 INFO:teuthology.orchestra.run.smithi161.stdout:3061 write 0xb3c8627 thru 0xb3d60eb (0xdac5 bytes) 2024-09-21T15:08:55.102 INFO:teuthology.orchestra.run.smithi161.stdout:3456 punch from 0xddfc4cc to 0xddfd73d, (0x1271 bytes) 2024-09-21T15:08:55.102 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.102 INFO:teuthology.orchestra.run.smithi161.stdout:3458 writesame 0xa733a31 thru 0xa738433 data_size 0x1(0x4a03 bytes) 2024-09-21T15:08:55.105 INFO:teuthology.orchestra.run.smithi161.stdout:3276 read 0xbed70 thru 0xbf425 (0x6b6 bytes) 2024-09-21T15:08:55.106 INFO:teuthology.orchestra.run.smithi161.stdout:3279 read 0x278f630 thru 0x279cde8 (0xd7b9 bytes) 2024-09-21T15:08:55.111 INFO:teuthology.orchestra.run.smithi161.stdout:2742 read 0xfc7ffd thru 0xfcb90e (0x3912 bytes) 2024-09-21T15:08:55.113 INFO:teuthology.orchestra.run.smithi161.stdout:3280 trunc from 0x3afcabd to 0x507bcaf 2024-09-21T15:08:55.130 INFO:teuthology.orchestra.run.smithi161.stdout:3459 write 0x7c18891 thru 0x7c1c64b (0x3dbb bytes) 2024-09-21T15:08:55.131 INFO:teuthology.orchestra.run.smithi161.stdout:3063 read 0x77215d2 thru 0x77236a5 (0x20d4 bytes) 2024-09-21T15:08:55.131 INFO:teuthology.orchestra.run.smithi161.stdout:3066 read 0x10f5d03 thru 0x1105c8c (0xff8a bytes) 2024-09-21T15:08:55.132 INFO:teuthology.orchestra.run.smithi161.stdout:3067 punch from 0x9bdffcc to 0x9be2c2d, (0x2c61 bytes) 2024-09-21T15:08:55.132 INFO:teuthology.orchestra.run.smithi161.stdout:3069 read 0x7c8198b thru 0x7c8a208 (0x887e bytes) 2024-09-21T15:08:55.136 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #27, image image_cluster1.client.mirror.3-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent28 2024-09-21T15:08:55.136 INFO:teuthology.orchestra.run.smithi161.stdout:3281 read 0xaa7b44 thru 0xaab3c1 (0x387e bytes) 2024-09-21T15:08:55.138 INFO:teuthology.orchestra.run.smithi161.stdout:3120 trunc from 0xd32940d to 0x82e566a 2024-09-21T15:08:55.146 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.146 INFO:teuthology.orchestra.run.smithi161.stdout:2745 read 0x2e1809f thru 0x2e27396 (0xf2f8 bytes) 2024-09-21T15:08:55.172 INFO:teuthology.orchestra.run.smithi161.stdout:3071 writesame 0xb8e8a4a thru 0xb8f3e3e data_size 0x1(0xb3f5 bytes) 2024-09-21T15:08:55.176 INFO:teuthology.orchestra.run.smithi161.stdout:3073 punch from 0xb1eee91 to 0xb1f3d66, (0x4ed5 bytes) 2024-09-21T15:08:55.176 INFO:teuthology.orchestra.run.smithi161.stdout:3074 punch from 0x2f354db to 0x2f36197, (0xcbc bytes) 2024-09-21T15:08:55.176 INFO:teuthology.orchestra.run.smithi161.stdout:3075 write 0x1cdb2ec thru 0x1ce7ba1 (0xc8b6 bytes) 2024-09-21T15:08:55.177 INFO:teuthology.orchestra.run.smithi161.stdout:3282 writesame 0x869494d thru 0x869ee1a data_size 0x5(0xa4ce bytes) 2024-09-21T15:08:55.183 INFO:teuthology.orchestra.run.smithi161.stdout:2747 write 0x9924fc4 thru 0x992a45e (0x549b bytes) 2024-09-21T15:08:55.186 INFO:teuthology.orchestra.run.smithi161.stdout:3284 read 0x5998790 thru 0x599f46f (0x6ce0 bytes) 2024-09-21T15:08:55.186 INFO:teuthology.orchestra.run.smithi161.stdout:3285 read 0x22484d7 thru 0x224fd4a (0x7874 bytes) 2024-09-21T15:08:55.194 INFO:teuthology.orchestra.run.smithi161.stdout:3286 trunc from 0x869ee1b to 0x5815bbb 2024-09-21T15:08:55.195 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.195 INFO:teuthology.orchestra.run.smithi161.stdout:3078 read 0x88c0b88 thru 0x88c588a (0x4d03 bytes) 2024-09-21T15:08:55.195 INFO:teuthology.orchestra.run.smithi161.stdout:3079 punch from 0x5af7ae7 to 0x5af92b2, (0x17cb bytes) 2024-09-21T15:08:55.195 INFO:teuthology.orchestra.run.smithi161.stdout:3081 write 0xb87dd0e thru 0xb8824eb (0x47de bytes) 2024-09-21T15:08:55.203 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.203 INFO:teuthology.orchestra.run.smithi161.stdout:2395 write 0x67fe0cc thru 0x6803060 (0x4f95 bytes) 2024-09-21T15:08:55.204 INFO:teuthology.orchestra.run.smithi161.stdout:2748 read 0x50fc471 thru 0x50ff5f8 (0x3188 bytes) 2024-09-21T15:08:55.206 INFO:teuthology.orchestra.run.smithi161.stdout:3121 read 0x389b765 thru 0x389e53d (0x2dd9 bytes) 2024-09-21T15:08:55.206 INFO:teuthology.orchestra.run.smithi161.stdout:3122 read 0x34de625 thru 0x34ee01b (0xf9f7 bytes) 2024-09-21T15:08:55.206 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.207 INFO:teuthology.orchestra.run.smithi161.stdout:2750 trunc from 0x992a45f to 0x8a35ff8 2024-09-21T15:08:55.221 INFO:teuthology.orchestra.run.smithi161.stdout:3083 writesame 0x9d4c8cf thru 0x9d56a0d data_size 0x1(0xa13f bytes) 2024-09-21T15:08:55.254 INFO:teuthology.orchestra.run.smithi161.stdout:3125 write 0xb1d7311 thru 0xb1d7c35 (0x925 bytes) 2024-09-21T15:08:55.266 INFO:teuthology.orchestra.run.smithi161.stdout:3287 trunc from 0x5815bbb to 0xd0cbeb5 2024-09-21T15:08:55.269 INFO:teuthology.orchestra.run.smithi161.stdout:3084 trunc from 0xb8f3e3f to 0x4d65a67 2024-09-21T15:08:55.272 INFO:teuthology.orchestra.run.smithi161.stdout:2396 trunc from 0xb0553d9 to 0xe3615ea 2024-09-21T15:08:55.281 INFO:teuthology.orchestra.run.smithi161.stdout:3126 write 0x8a62224 thru 0x8a719c9 (0xf7a6 bytes) 2024-09-21T15:08:55.297 INFO:teuthology.orchestra.run.smithi161.stdout:3288 read 0x391312e thru 0x3919647 (0x651a bytes) 2024-09-21T15:08:55.298 INFO:teuthology.orchestra.run.smithi161.stdout:3291 write 0x889a9a5 thru 0x889dba4 (0x3200 bytes) 2024-09-21T15:08:55.313 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.313 INFO:teuthology.orchestra.run.smithi161.stdout:3295 writesame 0x582142c thru 0x5822a67 data_size 0x2(0x163c bytes) 2024-09-21T15:08:55.315 INFO:teuthology.orchestra.run.smithi161.stdout:3128 writesame 0x6ee23fa thru 0x6eea7d4 data_size 0x2b(0x83db bytes) 2024-09-21T15:08:55.317 INFO:teuthology.orchestra.run.smithi161.stdout:2751 write 0x9b6c008 thru 0x9b74254 (0x824d bytes) 2024-09-21T15:08:55.329 INFO:teuthology.orchestra.run.smithi161.stdout:3296 read 0x619a674 thru 0x61a8c7e (0xe60b bytes) 2024-09-21T15:08:55.330 INFO:teuthology.orchestra.run.smithi161.stdout:3297 writesame 0x9e1d09f thru 0x9e2b098 data_size 0x1(0xdffa bytes) 2024-09-21T15:08:55.336 INFO:teuthology.orchestra.run.smithi161.stdout:2397 read 0x2498c45 thru 0x249f986 (0x6d42 bytes) 2024-09-21T15:08:55.344 INFO:teuthology.orchestra.run.smithi161.stdout:3085 punch from 0x13ddef6 to 0x13de67e, (0x788 bytes) 2024-09-21T15:08:55.344 INFO:teuthology.orchestra.run.smithi161.stdout:3086 read 0x19566f4 thru 0x195caa8 (0x63b5 bytes) 2024-09-21T15:08:55.347 INFO:teuthology.orchestra.run.smithi161.stdout:3130 write 0x53dff1a thru 0x53e1f35 (0x201c bytes) 2024-09-21T15:08:55.348 INFO:teuthology.orchestra.run.smithi161.stdout:2752 trunc from 0x9b74255 to 0xc7f40be 2024-09-21T15:08:55.358 INFO:teuthology.orchestra.run.smithi161.stdout:2398 trunc from 0xe3615ea to 0x42551f1 2024-09-21T15:08:55.375 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.376 INFO:teuthology.orchestra.run.smithi161.stdout:3300 read 0x33ae3c8 thru 0x33b720d (0x8e46 bytes) 2024-09-21T15:08:55.377 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.377 INFO:teuthology.orchestra.run.smithi161.stdout:3302 punch from 0x70370cd to 0x7037376, (0x2a9 bytes) 2024-09-21T15:08:55.378 INFO:teuthology.orchestra.run.smithi161.stdout:3303 writesame 0x12f026f thru 0x12f2d80 data_size 0x2(0x2b12 bytes) 2024-09-21T15:08:55.383 INFO:teuthology.orchestra.run.smithi161.stdout:3132 read 0x71657f7 thru 0x716cce7 (0x74f1 bytes) 2024-09-21T15:08:55.383 INFO:teuthology.orchestra.run.smithi161.stdout:3133 write 0x1109a69 thru 0x1110b94 (0x712c bytes) 2024-09-21T15:08:55.391 INFO:teuthology.orchestra.run.smithi161.stdout:3304 writesame 0x939d2c7 thru 0x93a4f09 data_size 0x1(0x7c43 bytes) 2024-09-21T15:08:55.410 INFO:teuthology.orchestra.run.smithi161.stdout:2753 punch from 0x5decdfd to 0x5df9c8a, (0xce8d bytes) 2024-09-21T15:08:55.427 INFO:teuthology.orchestra.run.smithi161.stdout:3087 write 0xe188d42 thru 0xe18fa15 (0x6cd4 bytes) 2024-09-21T15:08:55.432 INFO:teuthology.orchestra.run.smithi161.stdout:2754 trunc from 0xc7f40be to 0x6b49f4 2024-09-21T15:08:55.436 INFO:teuthology.orchestra.run.smithi161.stdout:3305 read 0x1c4a9a1 thru 0x1c4aae3 (0x143 bytes) 2024-09-21T15:08:55.437 INFO:teuthology.orchestra.run.smithi161.stdout:3308 clone 20 order 21 su 524288 sc 9 2024-09-21T15:08:55.439 INFO:teuthology.orchestra.run.smithi161.stdout:3134 read 0x13cab0b thru 0x13d5fb1 (0xb4a7 bytes) 2024-09-21T15:08:55.439 INFO:teuthology.orchestra.run.smithi161.stdout:3135 write 0x884d650 thru 0x885b3cc (0xdd7d bytes) 2024-09-21T15:08:55.448 INFO:teuthology.orchestra.run.smithi161.stdout:3088 write 0x23e06e5 thru 0x23ee736 (0xe052 bytes) 2024-09-21T15:08:55.469 INFO:teuthology.orchestra.run.smithi161.stdout:3091 write 0x14ae1cb thru 0x14bdb71 (0xf9a7 bytes) 2024-09-21T15:08:55.472 INFO:teuthology.orchestra.run.smithi161.stdout:3136 writesame 0x40b6d8b thru 0x40bf675 data_size 0x1(0x88eb bytes) 2024-09-21T15:08:55.478 INFO:teuthology.orchestra.run.smithi161.stdout:3093 read 0x73aac08 thru 0x73aad3f (0x138 bytes) 2024-09-21T15:08:55.495 INFO:teuthology.orchestra.run.smithi161.stdout:3095 trunc from 0xe18fa16 to 0x69cbfaf 2024-09-21T15:08:55.498 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.498 INFO:teuthology.orchestra.run.smithi161.stdout:2757 punch from 0x2b8a14 to 0x2c2910, (0x9efc bytes) 2024-09-21T15:08:55.499 INFO:teuthology.orchestra.run.smithi161.stdout:2400 read 0x1dbde07 thru 0x1dc55cb (0x77c5 bytes) 2024-09-21T15:08:55.500 INFO:teuthology.orchestra.run.smithi161.stdout:2401 read 0x17f4b0 thru 0x1844c5 (0x5016 bytes) 2024-09-21T15:08:55.503 INFO:teuthology.orchestra.run.smithi161.stdout:2403 write 0x34b29b thru 0x3540be (0x8e24 bytes) 2024-09-21T15:08:55.506 INFO:teuthology.orchestra.run.smithi161.stdout:3137 punch from 0x5527cd6 to 0x553126d, (0x9597 bytes) 2024-09-21T15:08:55.506 INFO:teuthology.orchestra.run.smithi161.stdout:3139 punch from 0x5013d5b to 0x50181dc, (0x4481 bytes) 2024-09-21T15:08:55.506 INFO:teuthology.orchestra.run.smithi161.stdout:3140 read 0x47a07ed thru 0x47ab559 (0xad6d bytes) 2024-09-21T15:08:55.507 INFO:teuthology.orchestra.run.smithi161.stdout:3142 write 0x68345be thru 0x6842a80 (0xe4c3 bytes) 2024-09-21T15:08:55.512 INFO:teuthology.orchestra.run.smithi161.stdout:2758 trunc from 0x6b49f4 to 0x5d6ef92 2024-09-21T15:08:55.548 INFO:teuthology.orchestra.run.smithi161.stdout:2404 writesame 0x463fa8 thru 0x464633 data_size 0x2(0x68c bytes) 2024-09-21T15:08:55.549 INFO:teuthology.orchestra.run.smithi161.stdout:3143 punch from 0x8823951 to 0x882a79e, (0x6e4d bytes) 2024-09-21T15:08:55.549 INFO:teuthology.orchestra.run.smithi161.stdout:3145 read 0x7a08882 thru 0x7a128fe (0xa07d bytes) 2024-09-21T15:08:55.549 INFO:teuthology.orchestra.run.smithi161.stdout:3146 read 0x5cfb18c thru 0x5cff9a8 (0x481d bytes) 2024-09-21T15:08:55.564 INFO:teuthology.orchestra.run.smithi161.stdout:3147 trunc from 0xb1d7c36 to 0x482abe8 2024-09-21T15:08:55.592 INFO:teuthology.orchestra.run.smithi161.stdout:2405 trunc from 0x42551f1 to 0x1b35af7 2024-09-21T15:08:55.606 INFO:teuthology.orchestra.run.smithi161.stdout:2761 write 0xbdf1ec2 thru 0xbdf57e4 (0x3923 bytes) 2024-09-21T15:08:55.617 INFO:teuthology.orchestra.run.smithi161.stdout:3460 write 0x347f240 thru 0x3487b8c (0x894d bytes) 2024-09-21T15:08:55.637 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.637 INFO:teuthology.orchestra.run.smithi161.stdout:2764 write 0xa06aebd thru 0xa06dbeb (0x2d2f bytes) 2024-09-21T15:08:55.644 INFO:teuthology.orchestra.run.smithi161.stdout:3461 read 0x4e30a40 thru 0x4e35d64 (0x5325 bytes) 2024-09-21T15:08:55.644 INFO:teuthology.orchestra.run.smithi161.stdout:3463 write 0x5c8db3 thru 0x5d2ed2 (0xa120 bytes) 2024-09-21T15:08:55.655 INFO:teuthology.orchestra.run.smithi161.stdout:3097 writesame 0xdbaa6fb thru 0xdbaf92d data_size 0x1(0x5233 bytes) 2024-09-21T15:08:55.669 INFO:teuthology.orchestra.run.smithi161.stdout:3099 read 0x1b6e1bd thru 0x1b71baa (0x39ee bytes) 2024-09-21T15:08:55.673 INFO:teuthology.orchestra.run.smithi161.stdout:2765 trunc from 0xbdf57e5 to 0x44bcaab 2024-09-21T15:08:55.681 INFO:teuthology.orchestra.run.smithi161.stdout:3100 punch from 0x1ced611 to 0x1cf25e8, (0x4fd7 bytes) 2024-09-21T15:08:55.681 INFO:teuthology.orchestra.run.smithi161.stdout:3103 read 0x7a546bb thru 0x7a5a746 (0x608c bytes) 2024-09-21T15:08:55.687 INFO:teuthology.orchestra.run.smithi161.stdout:3464 punch from 0x6d83f97 to 0x6d88bc2, (0x4c2b bytes) 2024-09-21T15:08:55.688 INFO:teuthology.orchestra.run.smithi161.stdout:3467 read 0x6cbec2b thru 0x6ccc5ec (0xd9c2 bytes) 2024-09-21T15:08:55.699 INFO:teuthology.orchestra.run.smithi161.stdout:3105 trunc from 0xdbaf92e to 0x3c61ddc 2024-09-21T15:08:55.711 INFO:teuthology.orchestra.run.smithi161.stdout:3148 write 0x43bd6a6 thru 0x43cbea1 (0xe7fc bytes) 2024-09-21T15:08:55.715 INFO:teuthology.orchestra.run.smithi161.stdout:3468 trunc from 0xebe99fa to 0x178c716 2024-09-21T15:08:55.731 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.731 INFO:teuthology.orchestra.run.smithi161.stdout:2769 read 0x37f086e thru 0x37f2713 (0x1ea6 bytes) 2024-09-21T15:08:55.731 INFO:teuthology.orchestra.run.smithi161.stdout:2770 read 0x3900782 thru 0x390f144 (0xe9c3 bytes) 2024-09-21T15:08:55.732 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.736 INFO:teuthology.orchestra.run.smithi161.stdout:2772 trunc from 0x44bcaab to 0x6c24e46 2024-09-21T15:08:55.764 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.764 INFO:teuthology.orchestra.run.smithi161.stdout:3108 punch from 0x36189d6 to 0x3624eae, (0xc4d8 bytes) 2024-09-21T15:08:55.765 INFO:teuthology.orchestra.run.smithi161.stdout:3109 read 0x37d8085 thru 0x37e1354 (0x92d0 bytes) 2024-09-21T15:08:55.774 INFO:teuthology.orchestra.run.smithi161.stdout:3110 trunc from 0x3c61ddc to 0xc0c6f7 2024-09-21T15:08:55.799 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.799 INFO:teuthology.orchestra.run.smithi161.stdout:2774 read 0x141bded thru 0x141e0ae (0x22c2 bytes) 2024-09-21T15:08:55.799 INFO:teuthology.orchestra.run.smithi161.stdout:2775 read 0x464eb1e thru 0x4654db1 (0x6294 bytes) 2024-09-21T15:08:55.807 INFO:teuthology.orchestra.run.smithi161.stdout:2777 trunc from 0x6c24e46 to 0xaa762b9 2024-09-21T15:08:55.830 INFO:teuthology.orchestra.run.smithi161.stdout:3469 read 0xd78ad thru 0xdfb21 (0x8275 bytes) 2024-09-21T15:08:55.830 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.832 INFO:teuthology.orchestra.run.smithi161.stdout:3149 writesame 0xcdf70db thru 0xcdfcf66 data_size 0x6(0x5e8c bytes) 2024-09-21T15:08:55.833 INFO:teuthology.orchestra.run.smithi161.stdout:3471 read 0x47af87 thru 0x485ef9 (0xaf73 bytes) 2024-09-21T15:08:55.834 INFO:teuthology.orchestra.run.smithi161.stdout:3472 punch from 0x15e496e to 0x15e96ae, (0x4d40 bytes) 2024-09-21T15:08:55.834 INFO:teuthology.orchestra.run.smithi161.stdout:3474 read 0x138dddd thru 0x13918c2 (0x3ae6 bytes) 2024-09-21T15:08:55.836 INFO:teuthology.orchestra.run.smithi161.stdout:3114 trunc from 0xc0c6f7 to 0x3728fc7 2024-09-21T15:08:55.837 INFO:teuthology.orchestra.run.smithi161.stdout:3476 read 0x4627f6 thru 0x46e9ac (0xc1b7 bytes) 2024-09-21T15:08:55.838 INFO:teuthology.orchestra.run.smithi161.stdout:3150 read 0x574e77f thru 0x5755d8e (0x7610 bytes) 2024-09-21T15:08:55.844 INFO:teuthology.orchestra.run.smithi161.stdout:2406 write 0xbc4857c thru 0xbc4f0b6 (0x6b3b bytes) 2024-09-21T15:08:55.856 INFO:teuthology.orchestra.run.smithi161.stdout:2407 read 0x70055c thru 0x701134 (0xbd9 bytes) 2024-09-21T15:08:55.857 INFO:teuthology.orchestra.run.smithi161.stdout:2409 write 0x3bc92e7 thru 0x3bcf33d (0x6057 bytes) 2024-09-21T15:08:55.862 INFO:teuthology.orchestra.run.smithi161.stdout:3115 writesame 0x2d364a7 thru 0x2d36b23 data_size 0x1(0x67d bytes) 2024-09-21T15:08:55.864 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone19 from 0xd0cbeb5 (overlap 0xc47099) to 0x4e9370 2024-09-21T15:08:55.872 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.873 INFO:teuthology.orchestra.run.smithi161.stdout:2410 punch from 0x85a88bb to 0x85a9977, (0x10bc bytes) 2024-09-21T15:08:55.877 INFO:teuthology.orchestra.run.smithi161.stdout:3478 write 0x6cc16a6 thru 0x6cd030b (0xec66 bytes) 2024-09-21T15:08:55.880 INFO:teuthology.orchestra.run.smithi161.stdout:3151 write 0xe07cc3a thru 0xe07fe3a (0x3201 bytes) 2024-09-21T15:08:55.887 INFO:teuthology.orchestra.run.smithi161.stdout:2778 write 0xc9ae043 thru 0xc9b28fc (0x48ba bytes) 2024-09-21T15:08:55.911 INFO:teuthology.orchestra.run.smithi161.stdout:3479 write 0x1aed2b8 thru 0x1af480f (0x7558 bytes) 2024-09-21T15:08:55.920 INFO:teuthology.orchestra.run.smithi161.stdout:3152 writesame 0x26c3d8b thru 0x26cb199 data_size 0x25(0x740f bytes) 2024-09-21T15:08:55.939 INFO:teuthology.orchestra.run.smithi161.stdout:3480 writesame 0x67d52d2 thru 0x67dcd6c data_size 0x1(0x7a9b bytes) 2024-09-21T15:08:55.949 INFO:teuthology.orchestra.run.smithi161.stdout:2411 write 0xc80996a thru 0xc80e687 (0x4d1e bytes) 2024-09-21T15:08:55.958 INFO:teuthology.orchestra.run.smithi161.stdout:3117 write 0xc72337b thru 0xc73060c (0xd292 bytes) 2024-09-21T15:08:55.966 INFO:teuthology.orchestra.run.smithi161.stdout:3153 punch from 0x54e98e to 0x55676e, (0x7de0 bytes) 2024-09-21T15:08:55.966 INFO:teuthology.orchestra.run.smithi161.stdout:3154 punch from 0xdb62d47 to 0xdb6d119, (0xa3d2 bytes) 2024-09-21T15:08:55.966 INFO:teuthology.orchestra.run.smithi161.stdout:3155 writesame 0xe473eb thru 0xe51cf0 data_size 0x5(0xa906 bytes) 2024-09-21T15:08:55.978 INFO:teuthology.orchestra.run.smithi161.stdout:3482 trunc from 0x6cd030c to 0x6c4e371 2024-09-21T15:08:55.985 INFO:teuthology.orchestra.run.smithi161.stdout:2412 read 0x5b79b84 thru 0x5b7b508 (0x1985 bytes) 2024-09-21T15:08:55.985 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:55.986 INFO:teuthology.orchestra.run.smithi161.stdout:2779 write 0xee65942 thru 0xee6b27f (0x593e bytes) 2024-09-21T15:08:55.993 INFO:teuthology.orchestra.run.smithi161.stdout:3118 read 0x92200bc thru 0x922e7c6 (0xe70b bytes) 2024-09-21T15:08:55.997 INFO:teuthology.orchestra.run.smithi161.stdout:3119 trunc from 0xc73060d to 0xb37af45 2024-09-21T15:08:56.008 INFO:teuthology.orchestra.run.smithi161.stdout:2415 trunc from 0xc80e688 to 0xb3ded8 2024-09-21T15:08:56.011 INFO:teuthology.orchestra.run.smithi161.stdout:3157 writesame 0x3b28341 thru 0x3b2d958 data_size 0x74(0x5618 bytes) 2024-09-21T15:08:56.014 INFO:teuthology.orchestra.run.smithi161.stdout:2780 read 0x852f306 thru 0x853a5d7 (0xb2d2 bytes) 2024-09-21T15:08:56.025 INFO:teuthology.orchestra.run.smithi161.stdout:2781 trunc from 0xee6b280 to 0x8c8d75d 2024-09-21T15:08:56.043 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562874987ee0 2024-09-21T15:08:56.043 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x5628751c3e10 2024-09-21T15:08:56.044 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x5628762fd6c0 2024-09-21T15:08:56.044 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x56287641fba0 2024-09-21T15:08:56.044 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562876b275f0 2024-09-21T15:08:56.044 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562876d89520 2024-09-21T15:08:56.044 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562879b244e0 2024-09-21T15:08:56.044 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c23cea0 2024-09-21T15:08:56.044 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c23d6c0 2024-09-21T15:08:56.044 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c888f70 2024-09-21T15:08:56.044 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x56287cb1c0d0 2024-09-21T15:08:56.044 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x56287ce70000 2024-09-21T15:08:56.044 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x5628828a7ba0 2024-09-21T15:08:56.045 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562889a931e0 2024-09-21T15:08:56.045 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.040+0000 7f1e9c77a700 -1 reset not still connected to 0x56288c584340 2024-09-21T15:08:56.045 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:56.044+0000 7f1e9c77a700 -1 reset not still connected to 0x562890805d40 2024-09-21T15:08:56.051 INFO:teuthology.orchestra.run.smithi161.stdout:3483 trunc from 0x6c4e371 to 0x9a9c40c 2024-09-21T15:08:56.068 INFO:teuthology.orchestra.run.smithi161.stdout:3159 writesame 0xa9ae9c thru 0xa9c156 data_size 0x7(0x12bb bytes) 2024-09-21T15:08:56.086 INFO:teuthology.orchestra.run.smithi161.stdout:3160 read 0x2e7830e thru 0x2e7f09e (0x6d91 bytes) 2024-09-21T15:08:56.087 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.087 INFO:teuthology.orchestra.run.smithi161.stdout:3162 write 0x65b4d01 thru 0x65bb35b (0x665b bytes) 2024-09-21T15:08:56.089 INFO:teuthology.orchestra.run.smithi161.stdout:3120 punch from 0x77e5933 to 0x77f09c5, (0xb092 bytes) 2024-09-21T15:08:56.089 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.089 INFO:teuthology.orchestra.run.smithi161.stdout:3122 punch from 0x1ed4dd1 to 0x1ed7b41, (0x2d70 bytes) 2024-09-21T15:08:56.089 INFO:teuthology.orchestra.run.smithi161.stdout:3123 punch from 0x269a3 to 0x2d723, (0x6d80 bytes) 2024-09-21T15:08:56.090 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.090 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.090 INFO:teuthology.orchestra.run.smithi161.stdout:3128 punch from 0x5e71035 to 0x5e7e355, (0xd320 bytes) 2024-09-21T15:08:56.090 INFO:teuthology.orchestra.run.smithi161.stdout:3129 punch from 0x9275b04 to 0x927fd86, (0xa282 bytes) 2024-09-21T15:08:56.090 INFO:teuthology.orchestra.run.smithi161.stdout:3130 read 0xaf26dc1 thru 0xaf2fb08 (0x8d48 bytes) 2024-09-21T15:08:56.090 INFO:teuthology.orchestra.run.smithi161.stdout:3131 read 0x4cab964 thru 0x4cb3d4e (0x83eb bytes) 2024-09-21T15:08:56.090 INFO:teuthology.orchestra.run.smithi161.stdout:3132 write 0x31c609 thru 0x328e5f (0xc857 bytes) 2024-09-21T15:08:56.102 INFO:teuthology.orchestra.run.smithi161.stdout:3484 writesame 0x61964db thru 0x6196a47 data_size 0x1(0x56d bytes) 2024-09-21T15:08:56.113 INFO:teuthology.orchestra.run.smithi161.stdout:3133 trunc from 0xb37af45 to 0xde099dd 2024-09-21T15:08:56.123 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.123 INFO:teuthology.orchestra.run.smithi161.stdout:3165 trunc from 0xe07fe3b to 0xedb54ab 2024-09-21T15:08:56.125 INFO:teuthology.orchestra.run.smithi161.stdout:2416 read 0x943f7f thru 0x94f318 (0xb39a bytes) 2024-09-21T15:08:56.126 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.126 INFO:teuthology.orchestra.run.smithi161.stdout:2422 punch from 0x6a3236 to 0x6ad507, (0xa2d1 bytes) 2024-09-21T15:08:56.127 INFO:teuthology.orchestra.run.smithi161.stdout:3487 read 0x57be733 thru 0x57bf699 (0xf67 bytes) 2024-09-21T15:08:56.127 INFO:teuthology.orchestra.run.smithi161.stdout:3489 write 0x8b9e0ed thru 0x8b9e7b1 (0x6c5 bytes) 2024-09-21T15:08:56.134 INFO:teuthology.orchestra.run.smithi161.stdout:2782 write 0x3c86dc0 thru 0x3c95297 (0xe4d8 bytes) 2024-09-21T15:08:56.144 INFO:teuthology.orchestra.run.smithi161.stdout:3490 write 0x8084925 thru 0x808a4a4 (0x5b80 bytes) 2024-09-21T15:08:56.151 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.151 INFO:teuthology.orchestra.run.smithi161.stdout:2784 write 0x498bfc0 thru 0x498c21b (0x25c bytes) 2024-09-21T15:08:56.161 INFO:teuthology.orchestra.run.smithi161.stdout:3491 read 0x78555a3 thru 0x78624c4 (0xcf22 bytes) 2024-09-21T15:08:56.161 INFO:teuthology.orchestra.run.smithi161.stdout:3492 writesame 0x8dbe1b0 thru 0x8dc4467 data_size 0x8(0x62b8 bytes) 2024-09-21T15:08:56.162 INFO:teuthology.orchestra.run.smithi161.stdout:2785 writesame 0x5d6ad22 thru 0x5d7884a data_size 0x31(0xdb29 bytes) 2024-09-21T15:08:56.164 INFO:teuthology.orchestra.run.smithi161.stdout:3166 punch from 0xc472550 to 0xc47ffbb, (0xda6b bytes) 2024-09-21T15:08:56.169 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #18, image image_cluster1.client.mirror.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent19 2024-09-21T15:08:56.172 INFO:teuthology.orchestra.run.smithi161.stdout:3167 trunc from 0xedb54ab to 0xba88f46 2024-09-21T15:08:56.174 INFO:teuthology.orchestra.run.smithi161.stdout:3494 writesame 0x7fd9cd1 thru 0x7fde438 data_size 0x14(0x4768 bytes) 2024-09-21T15:08:56.174 INFO:teuthology.orchestra.run.smithi161.stdout:2424 write 0xa78716b thru 0xa790411 (0x92a7 bytes) 2024-09-21T15:08:56.175 INFO:teuthology.orchestra.run.smithi161.stdout:2786 read 0xa61f98 thru 0xa6d3b2 (0xb41b bytes) 2024-09-21T15:08:56.175 INFO:teuthology.orchestra.run.smithi161.stdout:2787 read 0x7bc5feb thru 0x7bc8667 (0x267d bytes) 2024-09-21T15:08:56.175 INFO:teuthology.orchestra.run.smithi161.stdout:2788 write 0x1658c75 thru 0x16598ad (0xc39 bytes) 2024-09-21T15:08:56.175 INFO:teuthology.orchestra.run.smithi161.stdout:3134 trunc from 0xde099dd to 0x7704b71 2024-09-21T15:08:56.195 INFO:teuthology.orchestra.run.smithi161.stdout:2789 punch from 0x71a68c1 to 0x71a9e09, (0x3548 bytes) 2024-09-21T15:08:56.195 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.195 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.195 INFO:teuthology.orchestra.run.smithi161.stdout:3495 punch from 0x45c3cbb to 0x45cb253, (0x7598 bytes) 2024-09-21T15:08:56.212 INFO:teuthology.orchestra.run.smithi161.stdout:3137 read 0x215c4b6 thru 0x2169b43 (0xd68e bytes) 2024-09-21T15:08:56.213 INFO:teuthology.orchestra.run.smithi161.stdout:3496 trunc from 0x9a9c40c to 0xc03c18 2024-09-21T15:08:56.216 INFO:teuthology.orchestra.run.smithi161.stdout:3138 trunc from 0x7704b71 to 0x90780f7 2024-09-21T15:08:56.256 INFO:teuthology.orchestra.run.smithi161.stdout:2793 write 0xc1a5bcb thru 0xc1b203c (0xc472 bytes) 2024-09-21T15:08:56.256 INFO:teuthology.orchestra.run.smithi161.stdout:2425 writesame 0xccc5090 thru 0xccd2671 data_size 0x7(0xd5e2 bytes) 2024-09-21T15:08:56.265 INFO:teuthology.orchestra.run.smithi161.stdout:2426 write 0xc70b375 thru 0xc7160cd (0xad59 bytes) 2024-09-21T15:08:56.271 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:08:56.272+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbffbde5b0 2024-09-21T15:08:56.286 INFO:teuthology.orchestra.run.smithi161.stdout:3168 writesame 0xcf246f7 thru 0xcf262b9 data_size 0x3(0x1bc3 bytes) 2024-09-21T15:08:56.287 INFO:teuthology.orchestra.run.smithi161.stdout:2795 read 0x919329e thru 0x91a24af (0xf212 bytes) 2024-09-21T15:08:56.288 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.288 INFO:teuthology.orchestra.run.smithi161.stdout:2799 read 0x12a63fe thru 0x12ad72d (0x7330 bytes) 2024-09-21T15:08:56.288 INFO:teuthology.orchestra.run.smithi161.stdout:2800 read 0xab5c441 thru 0xab603f3 (0x3fb3 bytes) 2024-09-21T15:08:56.288 INFO:teuthology.orchestra.run.smithi161.stdout:2801 punch from 0x97b7d6d to 0x97be960, (0x6bf3 bytes) 2024-09-21T15:08:56.288 INFO:teuthology.orchestra.run.smithi161.stdout:2802 write 0x4106430 thru 0x41104f0 (0xa0c1 bytes) 2024-09-21T15:08:56.291 INFO:teuthology.orchestra.run.smithi161.stdout:3139 writesame 0x673134d thru 0x6735223 data_size 0x1(0x3ed7 bytes) 2024-09-21T15:08:56.291 INFO:teuthology.orchestra.run.smithi161.stdout:2427 read 0x897dfb2 thru 0x89803af (0x23fe bytes) 2024-09-21T15:08:56.292 INFO:teuthology.orchestra.run.smithi161.stdout:2428 writesame 0x2232219 thru 0x2235278 data_size 0x30(0x3060 bytes) 2024-09-21T15:08:56.292 INFO:teuthology.orchestra.run.smithi161.stdout:3170 read 0xafe3608 thru 0xafe6b87 (0x3580 bytes) 2024-09-21T15:08:56.292 INFO:teuthology.orchestra.run.smithi161.stdout:3172 read 0x2bdcff0 thru 0x2be0429 (0x343a bytes) 2024-09-21T15:08:56.293 INFO:teuthology.orchestra.run.smithi161.stdout:3173 write 0x41496d thru 0x4246ac (0xfd40 bytes) 2024-09-21T15:08:56.301 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.302 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.302 INFO:teuthology.orchestra.run.smithi161.stdout:2431 writesame 0x5e36f66 thru 0x5e454e5 data_size 0x99(0xe580 bytes) 2024-09-21T15:08:56.330 INFO:teuthology.orchestra.run.smithi161.stdout:2432 punch from 0x264ec40 to 0x265d121, (0xe4e1 bytes) 2024-09-21T15:08:56.330 INFO:teuthology.orchestra.run.smithi161.stdout:2433 write 0x5577717 thru 0x5584d14 (0xd5fe bytes) 2024-09-21T15:08:56.330 INFO:teuthology.orchestra.run.smithi161.stdout:2803 write 0x3d08e32 thru 0x3d0f8ba (0x6a89 bytes) 2024-09-21T15:08:56.339 INFO:teuthology.orchestra.run.smithi161.stdout:3177 punch from 0xe51efc to 0xe559c2, (0x3ac6 bytes) 2024-09-21T15:08:56.339 INFO:teuthology.orchestra.run.smithi161.stdout:3182 read 0x15d572 thru 0x161535 (0x3fc4 bytes) 2024-09-21T15:08:56.346 INFO:teuthology.orchestra.run.smithi161.stdout:3142 read 0x71498df thru 0x7149ac9 (0x1eb bytes) 2024-09-21T15:08:56.348 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.348 INFO:teuthology.orchestra.run.smithi161.stdout:3500 read 0x55bae7 thru 0x56169b (0x5bb5 bytes) 2024-09-21T15:08:56.349 INFO:teuthology.orchestra.run.smithi161.stdout:3502 read 0x235e79 thru 0x23fb14 (0x9c9c bytes) 2024-09-21T15:08:56.354 INFO:teuthology.orchestra.run.smithi161.stdout:3143 trunc from 0x90780f7 to 0xc0c62de 2024-09-21T15:08:56.358 INFO:teuthology.orchestra.run.smithi161.stdout:3504 trunc from 0xc03c18 to 0x35fd9da 2024-09-21T15:08:56.361 INFO:teuthology.orchestra.run.smithi161.stdout:2435 write 0x62aa324 thru 0x62ade55 (0x3b32 bytes) 2024-09-21T15:08:56.376 INFO:teuthology.orchestra.run.smithi161.stdout:2436 clone 30 order 22 su 524288 sc 4 2024-09-21T15:08:56.388 INFO:teuthology.orchestra.run.smithi161.stdout:3506 read 0x243cd52 thru 0x244a0e4 (0xd393 bytes) 2024-09-21T15:08:56.389 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.389 INFO:teuthology.orchestra.run.smithi161.stdout:3509 read 0x9de307 thru 0x9e0638 (0x2332 bytes) 2024-09-21T15:08:56.389 INFO:teuthology.orchestra.run.smithi161.stdout:3510 read 0x2ac7859 thru 0x2ac9af9 (0x22a1 bytes) 2024-09-21T15:08:56.398 INFO:teuthology.orchestra.run.smithi161.stdout:3183 write 0xe113150 thru 0xe118d1d (0x5bce bytes) 2024-09-21T15:08:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:2805 read 0x9f6126f thru 0x9f6de13 (0xcba5 bytes) 2024-09-21T15:08:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:2806 punch from 0x4949307 to 0x494d839, (0x4532 bytes) 2024-09-21T15:08:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:2807 punch from 0x5c58092 to 0x5c5a531, (0x249f bytes) 2024-09-21T15:08:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:2808 read 0x729b9a0 thru 0x729de94 (0x24f5 bytes) 2024-09-21T15:08:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.447 INFO:teuthology.orchestra.run.smithi161.stdout:2810 write 0x67b443 thru 0x67f064 (0x3c22 bytes) 2024-09-21T15:08:56.508 INFO:teuthology.orchestra.run.smithi161.stdout:3184 read 0x74f81c5 thru 0x74fa79c (0x25d8 bytes) 2024-09-21T15:08:56.508 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.508 INFO:teuthology.orchestra.run.smithi161.stdout:3186 punch from 0xa6276c3 to 0xa62e32d, (0x6c6a bytes) 2024-09-21T15:08:56.510 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.517 INFO:teuthology.orchestra.run.smithi161.stdout:3511 writesame 0xc4c22f3 thru 0xc4c42b9 data_size 0x1(0x1fc7 bytes) 2024-09-21T15:08:56.523 INFO:teuthology.orchestra.run.smithi161.stdout:3187 trunc from 0xe118d1e to 0x6c0daf8 2024-09-21T15:08:56.534 INFO:teuthology.orchestra.run.smithi161.stdout:2812 trunc from 0xc1b203d to 0x3b9111 2024-09-21T15:08:56.535 INFO:teuthology.orchestra.run.smithi161.stdout:3512 write 0x4c061c8 thru 0x4c11b3b (0xb974 bytes) 2024-09-21T15:08:56.573 INFO:teuthology.orchestra.run.smithi161.stdout:3144 read 0x3773b65 thru 0x377b53c (0x79d8 bytes) 2024-09-21T15:08:56.574 INFO:teuthology.orchestra.run.smithi161.stdout:3145 read 0x82d194c thru 0x82d3e50 (0x2505 bytes) 2024-09-21T15:08:56.574 INFO:teuthology.orchestra.run.smithi161.stdout:3146 read 0x158e2d7 thru 0x159b507 (0xd231 bytes) 2024-09-21T15:08:56.575 INFO:teuthology.orchestra.run.smithi161.stdout:3147 write 0x9fc6716 thru 0x9fc6f98 (0x883 bytes) 2024-09-21T15:08:56.577 INFO:teuthology.orchestra.run.smithi161.stdout:3513 read 0x7b4e9b9 thru 0x7b55e90 (0x74d8 bytes) 2024-09-21T15:08:56.577 INFO:teuthology.orchestra.run.smithi161.stdout:3514 writesame 0x23457ae thru 0x23479ff data_size 0x17(0x2252 bytes) 2024-09-21T15:08:56.601 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.601 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.601 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.603 INFO:teuthology.orchestra.run.smithi161.stdout:3519 trunc from 0xc4c42ba to 0xba860a5 2024-09-21T15:08:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:3521 read 0x26cbce0 thru 0x26cc027 (0x348 bytes) 2024-09-21T15:08:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:3524 read 0x1f5f884 thru 0x1f68726 (0x8ea3 bytes) 2024-09-21T15:08:56.651 INFO:teuthology.orchestra.run.smithi161.stdout:3528 writesame 0xa56ead8 thru 0xa57cf3f data_size 0x4(0xe468 bytes) 2024-09-21T15:08:56.657 INFO:teuthology.orchestra.run.smithi161.stdout:3148 write 0xd3b9d2b thru 0xd3c6990 (0xcc66 bytes) 2024-09-21T15:08:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:3149 read 0x2956ba9 thru 0x2963f6c (0xd3c4 bytes) 2024-09-21T15:08:56.679 INFO:teuthology.orchestra.run.smithi161.stdout:3529 write 0x2655078 thru 0x265f22e (0xa1b7 bytes) 2024-09-21T15:08:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:3150 punch from 0x792fdbf to 0x793a4d3, (0xa714 bytes) 2024-09-21T15:08:56.681 INFO:teuthology.orchestra.run.smithi161.stdout:3152 read 0xa45b9e thru 0xa4700b (0x146e bytes) 2024-09-21T15:08:56.682 INFO:teuthology.orchestra.run.smithi161.stdout:3153 write 0x5afa667 thru 0x5affe3c (0x57d6 bytes) 2024-09-21T15:08:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:3188 write 0xcf0b8ad thru 0xcf19fe5 (0xe739 bytes) 2024-09-21T15:08:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:3156 punch from 0x73bb0ee to 0x73c419c, (0x90ae bytes) 2024-09-21T15:08:56.692 INFO:teuthology.orchestra.run.smithi161.stdout:3158 write 0xb8d2cc0 thru 0xb8d9dfe (0x713f bytes) 2024-09-21T15:08:56.694 INFO:teuthology.orchestra.run.smithi161.stdout:2813 write 0x488ca4b thru 0x489020b (0x37c1 bytes) 2024-09-21T15:08:56.696 INFO:teuthology.orchestra.run.smithi161.stdout:3530 writesame 0x56eea26 thru 0x56f1733 data_size 0x49(0x2d0e bytes) 2024-09-21T15:08:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:3189 punch from 0x26241d to 0x26f6e7, (0xd2ca bytes) 2024-09-21T15:08:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.727 INFO:teuthology.orchestra.run.smithi161.stdout:3532 trunc from 0xba860a5 to 0xa831081 2024-09-21T15:08:56.732 INFO:teuthology.orchestra.run.smithi161.stdout:2814 trunc from 0x489020c to 0x863a6e7 2024-09-21T15:08:56.739 INFO:teuthology.orchestra.run.smithi161.stdout:3191 trunc from 0xcf19fe6 to 0x4488322 2024-09-21T15:08:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone29 from 0xccd2672 (overlap 0xb3ded8) to 0x8fe579 2024-09-21T15:08:56.747 INFO:teuthology.orchestra.run.smithi161.stdout:3160 trunc from 0xd3c6991 to 0x29cfc6 2024-09-21T15:08:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.758 INFO:teuthology.orchestra.run.smithi161.stdout:3311 write 0x3ee53f thru 0x3f113d (0x2bff bytes) 2024-09-21T15:08:56.794 INFO:teuthology.orchestra.run.smithi161.stdout:2815 punch from 0x2d9ec3e to 0x2da297b, (0x3d3d bytes) 2024-09-21T15:08:56.794 INFO:teuthology.orchestra.run.smithi161.stdout:2816 write 0x2788ca1 thru 0x2798942 (0xfca2 bytes) 2024-09-21T15:08:56.826 INFO:teuthology.orchestra.run.smithi161.stdout:3312 read 0x4bdac05 thru 0x4be35c7 (0x89c3 bytes) 2024-09-21T15:08:56.827 INFO:teuthology.orchestra.run.smithi161.stdout:3313 punch from 0x7618ec5 to 0x76289e0, (0xfb1b bytes) 2024-09-21T15:08:56.828 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.828 INFO:teuthology.orchestra.run.smithi161.stdout:3316 read 0x55e4e7a thru 0x55e9735 (0x48bc bytes) 2024-09-21T15:08:56.829 INFO:teuthology.orchestra.run.smithi161.stdout:3317 read 0x89712bb thru 0x897deac (0xcbf2 bytes) 2024-09-21T15:08:56.830 INFO:teuthology.orchestra.run.smithi161.stdout:3319 write 0x607b003 thru 0x6084d6d (0x9d6b bytes) 2024-09-21T15:08:56.831 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.831 INFO:teuthology.orchestra.run.smithi161.stdout:2818 read 0x106ace0 thru 0x106d67b (0x299c bytes) 2024-09-21T15:08:56.831 INFO:teuthology.orchestra.run.smithi161.stdout:2819 writesame 0x145ee5 thru 0x14f499 data_size 0x69(0x95b5 bytes) 2024-09-21T15:08:56.845 INFO:teuthology.orchestra.run.smithi161.stdout:3534 writesame 0xcf661ae thru 0xcf6feee data_size 0x51(0x9d41 bytes) 2024-09-21T15:08:56.845 INFO:teuthology.orchestra.run.smithi161.stdout:3192 write 0xc918a7 thru 0xc923cb (0xb25 bytes) 2024-09-21T15:08:56.846 INFO:teuthology.orchestra.run.smithi161.stdout:2822 punch from 0x7c4784e to 0x7c47c60, (0x412 bytes) 2024-09-21T15:08:56.848 INFO:teuthology.orchestra.run.smithi161.stdout:3162 read 0x197132 thru 0x19d2f5 (0x61c4 bytes) 2024-09-21T15:08:56.848 INFO:teuthology.orchestra.run.smithi161.stdout:3320 write 0x6e335f9 thru 0x6e35d1b (0x2723 bytes) 2024-09-21T15:08:56.849 INFO:teuthology.orchestra.run.smithi161.stdout:3535 write 0x5b3a7ff thru 0x5b40c32 (0x6434 bytes) 2024-09-21T15:08:56.869 INFO:teuthology.orchestra.run.smithi161.stdout:3536 writesame 0x46ac983 thru 0x46ad2af data_size 0x9(0x92d bytes) 2024-09-21T15:08:56.873 INFO:teuthology.orchestra.run.smithi161.stdout:3163 trunc from 0x29cfc6 to 0xd1a5708 2024-09-21T15:08:56.899 INFO:teuthology.orchestra.run.smithi161.stdout:3321 trunc from 0xd0cbeb5 to 0x243474c 2024-09-21T15:08:56.907 INFO:teuthology.orchestra.run.smithi161.stdout:2823 writesame 0xb1fe58f thru 0xb206cfb data_size 0x1(0x876d bytes) 2024-09-21T15:08:56.907 INFO:teuthology.orchestra.run.smithi161.stdout:3537 trunc from 0xcf6feef to 0x1e75291 2024-09-21T15:08:56.911 INFO:teuthology.orchestra.run.smithi161.stdout:2824 read 0x3829fa4 thru 0x382de9a (0x3ef7 bytes) 2024-09-21T15:08:56.914 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:56.914 INFO:teuthology.orchestra.run.smithi161.stdout:3165 punch from 0x280b04f to 0x280c25c, (0x120d bytes) 2024-09-21T15:08:56.914 INFO:teuthology.orchestra.run.smithi161.stdout:3167 write 0x53ae90c thru 0x53b9795 (0xae8a bytes) 2024-09-21T15:08:56.936 INFO:teuthology.orchestra.run.smithi161.stdout:3194 writesame 0xc1578b6 thru 0xc1677cc data_size 0x13(0xff17 bytes) 2024-09-21T15:08:56.947 INFO:teuthology.orchestra.run.smithi161.stdout:3195 writesame 0xb47fd7a thru 0xb486914 data_size 0xd(0x6b9b bytes) 2024-09-21T15:08:56.969 INFO:teuthology.orchestra.run.smithi161.stdout:2825 write 0xdb566c2 thru 0xdb5e76e (0x80ad bytes) 2024-09-21T15:08:56.981 INFO:teuthology.orchestra.run.smithi161.stdout:2828 read 0x2e0703f thru 0x2e0aa11 (0x39d3 bytes) 2024-09-21T15:08:56.981 INFO:teuthology.orchestra.run.smithi161.stdout:2829 writesame 0x11d34e0 thru 0x11d73f3 data_size 0x16(0x3f14 bytes) 2024-09-21T15:08:56.989 INFO:teuthology.orchestra.run.smithi161.stdout:3168 writesame 0xe0be21e thru 0xe0c8589 data_size 0x2(0xa36c bytes) 2024-09-21T15:08:56.992 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.001 INFO:teuthology.orchestra.run.smithi161.stdout:3196 trunc from 0xc1677cd to 0x23eb8a 2024-09-21T15:08:57.005 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #28, image image_cluster1.client.mirror.3-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent29 2024-09-21T15:08:57.012 INFO:teuthology.orchestra.run.smithi161.stdout:2836 trunc from 0xdb5e76f to 0x50ddbef 2024-09-21T15:08:57.017 INFO:teuthology.orchestra.run.smithi161.stdout:3538 trunc from 0x1e75291 to 0xe488d42 2024-09-21T15:08:57.035 INFO:teuthology.orchestra.run.smithi161.stdout:3171 writesame 0xedcbd46 thru 0xedd1d66 data_size 0xd(0x6021 bytes) 2024-09-21T15:08:57.047 INFO:teuthology.orchestra.run.smithi161.stdout:3172 punch from 0x6ad5807 to 0x6ade528, (0x8d21 bytes) 2024-09-21T15:08:57.047 INFO:teuthology.orchestra.run.smithi161.stdout:3173 write 0xd73dd5d thru 0xd740669 (0x290d bytes) 2024-09-21T15:08:57.060 INFO:teuthology.orchestra.run.smithi161.stdout:3323 write 0x6850430 thru 0x6850896 (0x467 bytes) 2024-09-21T15:08:57.087 INFO:teuthology.orchestra.run.smithi161.stdout:3175 write 0xaebfc49 thru 0xaec552e (0x58e6 bytes) 2024-09-21T15:08:57.092 INFO:teuthology.orchestra.run.smithi161.stdout:3325 read 0x4fb1a64 thru 0x4fbb69b (0x9c38 bytes) 2024-09-21T15:08:57.093 INFO:teuthology.orchestra.run.smithi161.stdout:3539 trunc from 0xe488d42 to 0x31f72d3 2024-09-21T15:08:57.096 INFO:teuthology.orchestra.run.smithi161.stdout:3326 trunc from 0x6850897 to 0x4f875bb 2024-09-21T15:08:57.112 INFO:teuthology.orchestra.run.smithi161.stdout:3176 read 0xcf460f6 thru 0xcf49a17 (0x3922 bytes) 2024-09-21T15:08:57.112 INFO:teuthology.orchestra.run.smithi161.stdout:3177 writesame 0xbb70783 thru 0xbb75a15 data_size 0x1(0x5293 bytes) 2024-09-21T15:08:57.119 INFO:teuthology.orchestra.run.smithi161.stdout:2837 read 0xbd0db9 thru 0xbd87bf (0x7a07 bytes) 2024-09-21T15:08:57.119 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.139 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.139 INFO:teuthology.orchestra.run.smithi161.stdout:3182 write 0xe8ef08d thru 0xe8fdb6e (0xeae2 bytes) 2024-09-21T15:08:57.152 INFO:teuthology.orchestra.run.smithi161.stdout:3540 trunc from 0x31f72d3 to 0x7078db1 2024-09-21T15:08:57.156 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.156 INFO:teuthology.orchestra.run.smithi161.stdout:3184 write 0xb5f3a31 thru 0xb602192 (0xe762 bytes) 2024-09-21T15:08:57.161 INFO:teuthology.orchestra.run.smithi161.stdout:3328 read 0x2f6e3a4 thru 0x2f6f956 (0x15b3 bytes) 2024-09-21T15:08:57.161 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.161 INFO:teuthology.orchestra.run.smithi161.stdout:3330 read 0x3f4a228 thru 0x3f4f56c (0x5345 bytes) 2024-09-21T15:08:57.163 INFO:teuthology.orchestra.run.smithi161.stdout:2437 writesame 0xe9ed688 thru 0xe9ef3fa data_size 0x7(0x1d73 bytes) 2024-09-21T15:08:57.163 INFO:teuthology.orchestra.run.smithi161.stdout:2839 write 0x50f0f29 thru 0x50f4ca8 (0x3d80 bytes) 2024-09-21T15:08:57.172 INFO:teuthology.orchestra.run.smithi161.stdout:2438 read 0xab5fb08 thru 0xab6c28a (0xc783 bytes) 2024-09-21T15:08:57.181 INFO:teuthology.orchestra.run.smithi161.stdout:3185 writesame 0xcc9bc4b thru 0xcca3051 data_size 0x1(0x7407 bytes) 2024-09-21T15:08:57.184 INFO:teuthology.orchestra.run.smithi161.stdout:2842 punch from 0x331f459 to 0x332361c, (0x41c3 bytes) 2024-09-21T15:08:57.187 INFO:teuthology.orchestra.run.smithi161.stdout:2441 trunc from 0xe9ef3fb to 0x608d709 2024-09-21T15:08:57.189 INFO:teuthology.orchestra.run.smithi161.stdout:3541 punch from 0x114a69b to 0x1158ee8, (0xe84d bytes) 2024-09-21T15:08:57.189 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.189 INFO:teuthology.orchestra.run.smithi161.stdout:3544 punch from 0x5430e7f to 0x5437ecb, (0x704c bytes) 2024-09-21T15:08:57.205 INFO:teuthology.orchestra.run.smithi161.stdout:3197 write 0x64db377 thru 0x64dc281 (0xf0b bytes) 2024-09-21T15:08:57.213 INFO:teuthology.orchestra.run.smithi161.stdout:3331 write 0x69f0513 thru 0x69f55b3 (0x50a1 bytes) 2024-09-21T15:08:57.222 INFO:teuthology.orchestra.run.smithi161.stdout:3186 write 0xd630d1c thru 0xd63564b (0x4930 bytes) 2024-09-21T15:08:57.233 INFO:teuthology.orchestra.run.smithi161.stdout:3198 write 0x55a80bf thru 0x55af365 (0x72a7 bytes) 2024-09-21T15:08:57.236 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.236 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.236 INFO:teuthology.orchestra.run.smithi161.stdout:3336 writesame 0x3cd304a thru 0x3cd7e48 data_size 0x1(0x4dff bytes) 2024-09-21T15:08:57.241 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.241 INFO:teuthology.orchestra.run.smithi161.stdout:3189 read 0x440d979 thru 0x4412f8b (0x5613 bytes) 2024-09-21T15:08:57.242 INFO:teuthology.orchestra.run.smithi161.stdout:3545 write 0xdd0e2fe thru 0xdd14ec9 (0x6bcc bytes) 2024-09-21T15:08:57.242 INFO:teuthology.orchestra.run.smithi161.stdout:3190 write 0x4dd9c2f thru 0x4ddc00c (0x23de bytes) 2024-09-21T15:08:57.268 INFO:teuthology.orchestra.run.smithi161.stdout:2844 write 0xca863f1 thru 0xca8d47f (0x708f bytes) 2024-09-21T15:08:57.268 INFO:teuthology.orchestra.run.smithi161.stdout:3546 read 0xa1e3d37 thru 0xa1eff20 (0xc1ea bytes) 2024-09-21T15:08:57.268 INFO:teuthology.orchestra.run.smithi161.stdout:3547 read 0x3b8dd7a thru 0x3b94fbf (0x7246 bytes) 2024-09-21T15:08:57.269 INFO:teuthology.orchestra.run.smithi161.stdout:3548 write 0x363ff8d thru 0x3646462 (0x64d6 bytes) 2024-09-21T15:08:57.270 INFO:teuthology.orchestra.run.smithi161.stdout:3337 write 0x3d70107 thru 0x3d7a182 (0xa07c bytes) 2024-09-21T15:08:57.272 INFO:teuthology.orchestra.run.smithi161.stdout:3199 read 0x3d61f35 thru 0x3d6d17f (0xb24b bytes) 2024-09-21T15:08:57.276 INFO:teuthology.orchestra.run.smithi161.stdout:3191 trunc from 0xedd1d67 to 0x178d80 2024-09-21T15:08:57.276 INFO:teuthology.orchestra.run.smithi161.stdout:2442 punch from 0x25f0f44 to 0x25f4858, (0x3914 bytes) 2024-09-21T15:08:57.276 INFO:teuthology.orchestra.run.smithi161.stdout:2443 read 0x1d3e7cc thru 0x1d476c7 (0x8efc bytes) 2024-09-21T15:08:57.277 INFO:teuthology.orchestra.run.smithi161.stdout:2444 write 0x5381c09 thru 0x538d73b (0xbb33 bytes) 2024-09-21T15:08:57.285 INFO:teuthology.orchestra.run.smithi161.stdout:2845 write 0x27550a1 thru 0x276092d (0xb88d bytes) 2024-09-21T15:08:57.286 INFO:teuthology.orchestra.run.smithi161.stdout:3338 read 0x185ee3 thru 0x18ba04 (0x5b22 bytes) 2024-09-21T15:08:57.286 INFO:teuthology.orchestra.run.smithi161.stdout:3549 write 0xcba0114 thru 0xcbafe54 (0xfd41 bytes) 2024-09-21T15:08:57.287 INFO:teuthology.orchestra.run.smithi161.stdout:3340 read 0x35a9124 thru 0x35b6aef (0xd9cc bytes) 2024-09-21T15:08:57.287 INFO:teuthology.orchestra.run.smithi161.stdout:3341 read 0x1a2675a thru 0x1a34a79 (0xe320 bytes) 2024-09-21T15:08:57.310 INFO:teuthology.orchestra.run.smithi161.stdout:2846 writesame 0x2935f11 thru 0x293c2e1 data_size 0x17(0x63d1 bytes) 2024-09-21T15:08:57.311 INFO:teuthology.orchestra.run.smithi161.stdout:2447 read 0x3724b6d thru 0x3727776 (0x2c0a bytes) 2024-09-21T15:08:57.312 INFO:teuthology.orchestra.run.smithi161.stdout:2449 trunc from 0x608d709 to 0x6c67843 2024-09-21T15:08:57.318 INFO:teuthology.orchestra.run.smithi161.stdout:3551 write 0x23f0365 thru 0x23f6f95 (0x6c31 bytes) 2024-09-21T15:08:57.331 INFO:teuthology.orchestra.run.smithi161.stdout:2847 read 0x19adb05 thru 0x19b20fa (0x45f6 bytes) 2024-09-21T15:08:57.332 INFO:teuthology.orchestra.run.smithi161.stdout:2848 punch from 0xaba2a2f to 0xabae670, (0xbc41 bytes) 2024-09-21T15:08:57.341 INFO:teuthology.orchestra.run.smithi161.stdout:3200 write 0xb76c389 thru 0xb76c9b6 (0x62e bytes) 2024-09-21T15:08:57.348 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.348 INFO:teuthology.orchestra.run.smithi161.stdout:3555 write 0xafd698d thru 0xafd9705 (0x2d79 bytes) 2024-09-21T15:08:57.353 INFO:teuthology.orchestra.run.smithi161.stdout:3343 write 0xe3c8ed2 thru 0xe3d1de3 (0x8f12 bytes) 2024-09-21T15:08:57.361 INFO:teuthology.orchestra.run.smithi161.stdout:2450 writesame 0xa6a688 thru 0xa6de58 data_size 0xb(0x37d1 bytes) 2024-09-21T15:08:57.366 INFO:teuthology.orchestra.run.smithi161.stdout:3202 writesame 0x5b6a44f thru 0x5b742cd data_size 0x19(0x9e7f bytes) 2024-09-21T15:08:57.375 INFO:teuthology.orchestra.run.smithi161.stdout:3556 read 0xca41b14 thru 0xca4dd60 (0xc24d bytes) 2024-09-21T15:08:57.376 INFO:teuthology.orchestra.run.smithi161.stdout:3346 writesame 0x5a923d4 thru 0x5a96c78 data_size 0x1(0x48a5 bytes) 2024-09-21T15:08:57.376 INFO:teuthology.orchestra.run.smithi161.stdout:3557 clone 22 order 19 su 4096 sc 9 2024-09-21T15:08:57.378 INFO:teuthology.orchestra.run.smithi161.stdout:2849 write 0xe53b416 thru 0xe548675 (0xd260 bytes) 2024-09-21T15:08:57.399 INFO:teuthology.orchestra.run.smithi161.stdout:2451 write 0x4bf69ca thru 0x4bf7c16 (0x124d bytes) 2024-09-21T15:08:57.404 INFO:teuthology.orchestra.run.smithi161.stdout:3347 read 0x1e96274 thru 0x1ea03ed (0xa17a bytes) 2024-09-21T15:08:57.407 INFO:teuthology.orchestra.run.smithi161.stdout:3349 trunc from 0xe3d1de4 to 0xea0d6d7 2024-09-21T15:08:57.408 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.409 INFO:teuthology.orchestra.run.smithi161.stdout:3192 write 0x31f33f3 thru 0x31f5782 (0x2390 bytes) 2024-09-21T15:08:57.413 INFO:teuthology.orchestra.run.smithi161.stdout:2850 write 0x50bf9e2 thru 0x50cf2f1 (0xf910 bytes) 2024-09-21T15:08:57.416 INFO:teuthology.orchestra.run.smithi161.stdout:2452 punch from 0x6422e1c to 0x642dd20, (0xaf04 bytes) 2024-09-21T15:08:57.426 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.426 INFO:teuthology.orchestra.run.smithi161.stdout:3194 read 0x21ef7d1 thru 0x21fcee0 (0xd710 bytes) 2024-09-21T15:08:57.427 INFO:teuthology.orchestra.run.smithi161.stdout:3204 trunc from 0xb76c9b7 to 0x191e5bd 2024-09-21T15:08:57.434 INFO:teuthology.orchestra.run.smithi161.stdout:3195 trunc from 0x31f5783 to 0x6a56cf3 2024-09-21T15:08:57.454 INFO:teuthology.orchestra.run.smithi161.stdout:3350 read 0x8558756 thru 0x8566d44 (0xe5ef bytes) 2024-09-21T15:08:57.454 INFO:teuthology.orchestra.run.smithi161.stdout:3352 write 0x70a80bb thru 0x70afcb9 (0x7bff bytes) 2024-09-21T15:08:57.461 INFO:teuthology.orchestra.run.smithi161.stdout:2851 trunc from 0xe548676 to 0x223e6f 2024-09-21T15:08:57.472 INFO:teuthology.orchestra.run.smithi161.stdout:2453 write 0xa5a6aab thru 0xa5b33f3 (0xc949 bytes) 2024-09-21T15:08:57.482 INFO:teuthology.orchestra.run.smithi161.stdout:3353 punch from 0xa6a5d63 to 0xa6aa462, (0x46ff bytes) 2024-09-21T15:08:57.482 INFO:teuthology.orchestra.run.smithi161.stdout:3356 read 0x28872dc thru 0x288c5be (0x52e3 bytes) 2024-09-21T15:08:57.483 INFO:teuthology.orchestra.run.smithi161.stdout:3359 write 0xb77616f thru 0xb77c166 (0x5ff8 bytes) 2024-09-21T15:08:57.508 INFO:teuthology.orchestra.run.smithi161.stdout:3361 read 0x3403866 thru 0x3409b91 (0x632c bytes) 2024-09-21T15:08:57.508 INFO:teuthology.orchestra.run.smithi161.stdout:3363 writesame 0xcf91e0d thru 0xcf9fbb6 data_size 0x11(0xddaa bytes) 2024-09-21T15:08:57.510 INFO:teuthology.orchestra.run.smithi161.stdout:3196 trunc from 0x6a56cf3 to 0xae3c276 2024-09-21T15:08:57.526 INFO:teuthology.orchestra.run.smithi161.stdout:3364 punch from 0x1d5aec to 0x1d79ec, (0x1f00 bytes) 2024-09-21T15:08:57.526 INFO:teuthology.orchestra.run.smithi161.stdout:3365 write 0x3af5ab1 thru 0x3af79e0 (0x1f30 bytes) 2024-09-21T15:08:57.538 INFO:teuthology.orchestra.run.smithi161.stdout:3366 read 0xd369c14 thru 0xd3770c6 (0xd4b3 bytes) 2024-09-21T15:08:57.538 INFO:teuthology.orchestra.run.smithi161.stdout:3367 write 0x4d91ea9 thru 0x4da135d (0xf4b5 bytes) 2024-09-21T15:08:57.541 INFO:teuthology.orchestra.run.smithi161.stdout:3205 trunc from 0x191e5bd to 0x9358473 2024-09-21T15:08:57.544 INFO:teuthology.orchestra.run.smithi161.stdout:3197 punch from 0xac91a6b to 0xac9da77, (0xc00c bytes) 2024-09-21T15:08:57.544 INFO:teuthology.orchestra.run.smithi161.stdout:3203 read 0x7670d0e thru 0x7680c97 (0xff8a bytes) 2024-09-21T15:08:57.544 INFO:teuthology.orchestra.run.smithi161.stdout:3205 punch from 0x4af5fe8 to 0x4af9949, (0x3961 bytes) 2024-09-21T15:08:57.544 INFO:teuthology.orchestra.run.smithi161.stdout:3206 write 0x59f9578 thru 0x5a03599 (0xa022 bytes) 2024-09-21T15:08:57.547 INFO:teuthology.orchestra.run.smithi161.stdout:2454 write 0xe9556ff thru 0xe958610 (0x2f12 bytes) 2024-09-21T15:08:57.548 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.548 INFO:teuthology.orchestra.run.smithi161.stdout:2854 read 0x20cd7a thru 0x21cd4e (0xffd5 bytes) 2024-09-21T15:08:57.550 INFO:teuthology.orchestra.run.smithi161.stdout:2855 read 0x9f9e6 thru 0xa48c7 (0x4ee2 bytes) 2024-09-21T15:08:57.551 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.559 INFO:teuthology.orchestra.run.smithi161.stdout:3369 trunc from 0xea0d6d7 to 0xb4eb65c 2024-09-21T15:08:57.559 INFO:teuthology.orchestra.run.smithi161.stdout:2455 read 0x415673c thru 0x41596e3 (0x2fa8 bytes) 2024-09-21T15:08:57.559 INFO:teuthology.orchestra.run.smithi161.stdout:2456 read 0x539bba thru 0x539c09 (0x50 bytes) 2024-09-21T15:08:57.560 INFO:teuthology.orchestra.run.smithi161.stdout:2457 writesame 0x7a78872 thru 0x7a86369 data_size 0x1c(0xdaf8 bytes) 2024-09-21T15:08:57.565 INFO:teuthology.orchestra.run.smithi161.stdout:3207 trunc from 0xae3c276 to 0xd5be7da 2024-09-21T15:08:57.573 INFO:teuthology.orchestra.run.smithi161.stdout:3206 write 0x2e1deec thru 0x2e2b138 (0xd24d bytes) 2024-09-21T15:08:57.573 INFO:teuthology.orchestra.run.smithi161.stdout:2857 trunc from 0x223e6f to 0xa3523a6 2024-09-21T15:08:57.592 INFO:teuthology.orchestra.run.smithi161.stdout:2458 flatten 2024-09-21T15:08:57.654 INFO:teuthology.orchestra.run.smithi161.stdout:3208 read 0x47e77be thru 0x47ed0b6 (0x58f9 bytes) 2024-09-21T15:08:57.729 INFO:teuthology.orchestra.run.smithi161.stdout:2858 read 0x571c54c thru 0x5727e07 (0xb8bc bytes) 2024-09-21T15:08:57.734 INFO:teuthology.orchestra.run.smithi161.stdout:2860 trunc from 0xa3523a6 to 0x766fae7 2024-09-21T15:08:57.816 INFO:teuthology.orchestra.run.smithi161.stdout:3370 write 0x36ce89 thru 0x37be5a (0xefd2 bytes) 2024-09-21T15:08:57.822 INFO:teuthology.orchestra.run.smithi161.stdout:3208 writesame 0xcc57e0e thru 0xcc65cc3 data_size 0x1d(0xdeb6 bytes) 2024-09-21T15:08:57.832 INFO:teuthology.orchestra.run.smithi161.stdout:3209 writesame 0xed89430 thru 0xed89cee data_size 0x1(0x8bf bytes) 2024-09-21T15:08:57.839 INFO:teuthology.orchestra.run.smithi161.stdout:3210 write 0x25b6ab2 thru 0x25b8692 (0x1be1 bytes) 2024-09-21T15:08:57.843 INFO:teuthology.orchestra.run.smithi161.stdout:2862 writesame 0x629085a thru 0x6296fb3 data_size 0x1(0x675a bytes) 2024-09-21T15:08:57.852 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:57.852 INFO:teuthology.orchestra.run.smithi161.stdout:3373 clone 21 order 20 su 32768 sc 6 2024-09-21T15:08:57.864 INFO:teuthology.orchestra.run.smithi161.stdout:3209 trunc from 0xd5be7da to 0x1cec55c 2024-09-21T15:08:57.868 INFO:teuthology.orchestra.run.smithi161.stdout:2459 punch from 0x148e76b to 0x1495b24, (0x73b9 bytes) 2024-09-21T15:08:57.868 INFO:teuthology.orchestra.run.smithi161.stdout:2460 write 0x32f99a0 thru 0x3304a83 (0xb0e4 bytes) 2024-09-21T15:08:57.907 INFO:teuthology.orchestra.run.smithi161.stdout:2864 write 0x7439077 thru 0x7444c28 (0xbbb2 bytes) 2024-09-21T15:08:57.910 INFO:teuthology.orchestra.run.smithi161.stdout:3212 write 0xbe9019b thru 0xbe91aa5 (0x190b bytes) 2024-09-21T15:08:57.920 INFO:teuthology.orchestra.run.smithi161.stdout:2461 write 0x848d3b thru 0x84acd5 (0x1f9b bytes) 2024-09-21T15:08:57.934 INFO:teuthology.orchestra.run.smithi161.stdout:2462 write 0x2684b06 thru 0x26868f2 (0x1ded bytes) 2024-09-21T15:08:57.944 INFO:teuthology.orchestra.run.smithi161.stdout:2865 writesame 0x159d0d3 thru 0x15a8482 data_size 0x7d(0xb3b0 bytes) 2024-09-21T15:08:57.945 INFO:teuthology.orchestra.run.smithi161.stdout:3213 read 0x70e540 thru 0x70e594 (0x55 bytes) 2024-09-21T15:08:57.959 INFO:teuthology.orchestra.run.smithi161.stdout:2464 write 0x99dfe9e thru 0x99e4ed9 (0x503c bytes) 2024-09-21T15:08:57.969 INFO:teuthology.orchestra.run.smithi161.stdout:2866 punch from 0x764c560 to 0x764eb1d, (0x25bd bytes) 2024-09-21T15:08:57.969 INFO:teuthology.orchestra.run.smithi161.stdout:2867 writesame 0x483c424 thru 0x4843ec8 data_size 0x1(0x7aa5 bytes) 2024-09-21T15:08:57.971 INFO:teuthology.orchestra.run.smithi161.stdout:3214 trunc from 0xed89cef to 0x2ad079a 2024-09-21T15:08:57.980 INFO:teuthology.orchestra.run.smithi161.stdout:2466 trunc from 0xe958611 to 0xe5f7231 2024-09-21T15:08:58.019 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.012+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c23cea0 2024-09-21T15:08:58.020 INFO:teuthology.orchestra.run.smithi161.stdout:2869 write 0x58febb2 thru 0x5904051 (0x54a0 bytes) 2024-09-21T15:08:58.024 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.020+0000 7f1e9c77a700 -1 reset not still connected to 0x56287cb1c0d0 2024-09-21T15:08:58.024 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.020+0000 7f1e9c77a700 -1 reset not still connected to 0x56287ce70000 2024-09-21T15:08:58.026 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.020+0000 7f1e9c77a700 -1 reset not still connected to 0x562880887860 2024-09-21T15:08:58.027 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.024+0000 7f1e9c77a700 -1 reset not still connected to 0x5628828a7ba0 2024-09-21T15:08:58.027 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.024+0000 7f1e9c77a700 -1 reset not still connected to 0x562887ed6000 2024-09-21T15:08:58.027 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.024+0000 7f1e9c77a700 -1 reset not still connected to 0x56288c584340 2024-09-21T15:08:58.027 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.024+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f959ba0 2024-09-21T15:08:58.041 INFO:teuthology.orchestra.run.smithi161.stdout:3210 read 0x16396e7 thru 0x163d7d6 (0x40f0 bytes) 2024-09-21T15:08:58.042 INFO:teuthology.orchestra.run.smithi161.stdout:3213 read 0xa477c7 thru 0xa5440a (0xcc44 bytes) 2024-09-21T15:08:58.043 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562890805d40 2024-09-21T15:08:58.043 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562893ff0f70 2024-09-21T15:08:58.043 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562894870d00 2024-09-21T15:08:58.044 INFO:teuthology.orchestra.run.smithi161.stdout:3214 writesame 0x1322d3a thru 0x132d3ca data_size 0x1(0xa691 bytes) 2024-09-21T15:08:58.045 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af45b0 2024-09-21T15:08:58.045 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5380 2024-09-21T15:08:58.064 INFO:teuthology.orchestra.run.smithi161.stdout:2467 read 0xbb0439e thru 0xbb10365 (0xbfc8 bytes) 2024-09-21T15:08:58.064 INFO:teuthology.orchestra.run.smithi161.stdout:2468 read 0x2202a7 thru 0x228fa6 (0x8d00 bytes) 2024-09-21T15:08:58.065 INFO:teuthology.orchestra.run.smithi161.stdout:2471 write 0x46d0f50 thru 0x46dda00 (0xcab1 bytes) 2024-09-21T15:08:58.112 INFO:teuthology.orchestra.run.smithi161.stdout:3216 trunc from 0x2ad079a to 0xde437ba 2024-09-21T15:08:58.119 INFO:teuthology.orchestra.run.smithi161.stdout:2473 read 0x9e908ec thru 0x9ea017f (0xf894 bytes) 2024-09-21T15:08:58.119 INFO:teuthology.orchestra.run.smithi161.stdout:2474 write 0xcf2f224 thru 0xcf3673f (0x751c bytes) 2024-09-21T15:08:58.147 INFO:teuthology.orchestra.run.smithi161.stdout:3217 write 0x622f0de thru 0x6233344 (0x4267 bytes) 2024-09-21T15:08:58.148 INFO:teuthology.orchestra.run.smithi161.stdout:2477 punch from 0x3376fd1 to 0x3380ada, (0x9b09 bytes) 2024-09-21T15:08:58.148 INFO:teuthology.orchestra.run.smithi161.stdout:2481 punch from 0xcea5317 to 0xceb2f1e, (0xdc07 bytes) 2024-09-21T15:08:58.148 INFO:teuthology.orchestra.run.smithi161.stdout:2870 write 0x8c0e3f1 thru 0x8c17beb (0x97fb bytes) 2024-09-21T15:08:58.149 INFO:teuthology.orchestra.run.smithi161.stdout:2482 read 0x2f3aff7 thru 0x2f43df3 (0x8dfd bytes) 2024-09-21T15:08:58.149 INFO:teuthology.orchestra.run.smithi161.stdout:2483 read 0x6cf7460 thru 0x6d0253a (0xb0db bytes) 2024-09-21T15:08:58.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:58.149+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cc7ead20 handle_clone_image: failed to clone image mirror/10b726b9ae75 to image_cluster1.client.mirror.5-clone18 2024-09-21T15:08:58.156 INFO:teuthology.orchestra.run.smithi161.stdout:2484 trunc from 0xe5f7231 to 0xa8c7a47 2024-09-21T15:08:58.168 INFO:teuthology.orchestra.run.smithi161.stdout:3215 write 0x2c65cbb thru 0x2c67c31 (0x1f77 bytes) 2024-09-21T15:08:58.169 INFO:teuthology.orchestra.run.smithi161.stdout:2872 trunc from 0x8c17bec to 0xaed727c 2024-09-21T15:08:58.180 INFO:teuthology.orchestra.run.smithi161.stdout:3216 read 0x220c9fa thru 0x22111da (0x47e1 bytes) 2024-09-21T15:08:58.181 INFO:teuthology.orchestra.run.smithi161.stdout:3217 trunc from 0x2c67c32 to 0x28b87af 2024-09-21T15:08:58.209 INFO:teuthology.orchestra.run.smithi161.stdout:2873 read 0x4fbd01d thru 0x4fc8437 (0xb41b bytes) 2024-09-21T15:08:58.210 INFO:teuthology.orchestra.run.smithi161.stdout:2874 read 0x93ef763 thru 0x93f04b1 (0xd4f bytes) 2024-09-21T15:08:58.210 INFO:teuthology.orchestra.run.smithi161.stdout:2875 write 0xab17384 thru 0xab1c7db (0x5458 bytes) 2024-09-21T15:08:58.235 INFO:teuthology.orchestra.run.smithi161.stdout:3218 read 0x5a2d8 thru 0x61a07 (0x7730 bytes) 2024-09-21T15:08:58.236 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.236 INFO:teuthology.orchestra.run.smithi161.stdout:3220 read 0xbbb0e6 thru 0xbbfab2 (0x49cd bytes) 2024-09-21T15:08:58.237 INFO:teuthology.orchestra.run.smithi161.stdout:3221 read 0x24bead0 thru 0x24cc368 (0xd899 bytes) 2024-09-21T15:08:58.238 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.238 INFO:teuthology.orchestra.run.smithi161.stdout:3223 write 0x280fce5 thru 0x281449c (0x47b8 bytes) 2024-09-21T15:08:58.240 INFO:teuthology.orchestra.run.smithi161.stdout:2486 trunc from 0xa8c7a47 to 0x63c441e 2024-09-21T15:08:58.294 INFO:teuthology.orchestra.run.smithi161.stdout:2876 writesame 0xb198352 thru 0xb1a188c data_size 0x17(0x953b bytes) 2024-09-21T15:08:58.307 INFO:teuthology.orchestra.run.smithi161.stdout:2877 read 0x58a570e thru 0x58b4924 (0xf217 bytes) 2024-09-21T15:08:58.307 INFO:teuthology.orchestra.run.smithi161.stdout:2878 write 0x611039b thru 0x6114018 (0x3c7e bytes) 2024-09-21T15:08:58.313 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.308+0000 7f1e9c77a700 -1 reset not still connected to 0x5628908044e0 2024-09-21T15:08:58.314 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.308+0000 7f1e9c77a700 -1 reset not still connected to 0x562894429e10 2024-09-21T15:08:58.316 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.312+0000 7f1e9c77a700 -1 reset not still connected to 0x562894870d00 2024-09-21T15:08:58.318 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.316+0000 7f1e9c77a700 -1 reset not still connected to 0x56289587d930 2024-09-21T15:08:58.318 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.316+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af40d0 2024-09-21T15:08:58.318 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:08:58.316+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5380 2024-09-21T15:08:58.343 INFO:teuthology.orchestra.run.smithi161.stdout:2879 read 0x599aa09 thru 0x59a755c (0xcb54 bytes) 2024-09-21T15:08:58.343 INFO:teuthology.orchestra.run.smithi161.stdout:2880 read 0x130950 thru 0x13d7ba (0xce6b bytes) 2024-09-21T15:08:58.344 INFO:teuthology.orchestra.run.smithi161.stdout:2881 write 0x4c77643 thru 0x4c7b5e7 (0x3fa5 bytes) 2024-09-21T15:08:58.350 INFO:teuthology.orchestra.run.smithi161.stdout:3225 write 0xb766fcd thru 0xb77656e (0xf5a2 bytes) 2024-09-21T15:08:58.353 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #20, image image_cluster1.client.mirror.2-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent21 2024-09-21T15:08:58.361 INFO:teuthology.orchestra.run.smithi161.stdout:2487 trunc from 0x63c441e to 0xe3148f5 2024-09-21T15:08:58.378 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:58.377+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cba861e0 handle_clone_image: failed to clone image mirror/10ae5581e04a to image_cluster1.client.mirror.1-clone15 2024-09-21T15:08:58.379 INFO:teuthology.orchestra.run.smithi161.stdout:2883 punch from 0x567e3e2 to 0x56896ad, (0xb2cb bytes) 2024-09-21T15:08:58.379 INFO:teuthology.orchestra.run.smithi161.stdout:2885 read 0x30b27c6 thru 0x30bcbd0 (0xa40b bytes) 2024-09-21T15:08:58.380 INFO:teuthology.orchestra.run.smithi161.stdout:2886 read 0x7673c1d thru 0x76778e1 (0x3cc5 bytes) 2024-09-21T15:08:58.380 INFO:teuthology.orchestra.run.smithi161.stdout:2887 punch from 0x27bb609 to 0x27c9a4c, (0xe443 bytes) 2024-09-21T15:08:58.380 INFO:teuthology.orchestra.run.smithi161.stdout:2888 punch from 0x2b32b43 to 0x2b37f62, (0x541f bytes) 2024-09-21T15:08:58.380 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.380 INFO:teuthology.orchestra.run.smithi161.stdout:2890 read 0x4cbeb42 thru 0x4cc7feb (0x94aa bytes) 2024-09-21T15:08:58.380 INFO:teuthology.orchestra.run.smithi161.stdout:2891 writesame 0x28931b1 thru 0x28a0ffd data_size 0x1(0xde4d bytes) 2024-09-21T15:08:58.391 INFO:teuthology.orchestra.run.smithi161.stdout:3226 punch from 0x916fb9f to 0x917f7e8, (0xfc49 bytes) 2024-09-21T15:08:58.391 INFO:teuthology.orchestra.run.smithi161.stdout:3227 read 0xa6eca18 thru 0xa6fbc56 (0xf23f bytes) 2024-09-21T15:08:58.395 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.395 INFO:teuthology.orchestra.run.smithi161.stdout:3230 write 0x143f9b4 thru 0x1440d90 (0x13dd bytes) 2024-09-21T15:08:58.425 INFO:teuthology.orchestra.run.smithi161.stdout:3231 read 0xa93680 thru 0xa9a18a (0x6b0b bytes) 2024-09-21T15:08:58.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:58.441+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb88c3c0 handle_clone_image: failed to clone image mirror/10b4dd6e99a to image_cluster1.client.mirror.3-clone28 2024-09-21T15:08:58.461 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:08:58.456+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41aa750 2024-09-21T15:08:58.461 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:08:58.456+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41ab790 2024-09-21T15:08:58.461 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:08:58.456+0000 7f7fd044c700 -1 reset not still connected to 0x5636b59e00d0 2024-09-21T15:08:58.462 INFO:teuthology.orchestra.run.smithi161.stdout:2893 punch from 0x2d5b22a to 0x2d5f309, (0x40df bytes) 2024-09-21T15:08:58.463 INFO:teuthology.orchestra.run.smithi161.stdout:2894 read 0xa5711b1 thru 0xa57c209 (0xb059 bytes) 2024-09-21T15:08:58.463 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.463 INFO:teuthology.orchestra.run.smithi161.stdout:2896 read 0x3cb6034 thru 0x3cc2d40 (0xcd0d bytes) 2024-09-21T15:08:58.465 INFO:teuthology.orchestra.run.smithi161.stdout:2488 writesame 0x4333c77 thru 0x4339ad4 data_size 0x2f(0x5e5e bytes) 2024-09-21T15:08:58.487 INFO:teuthology.orchestra.run.smithi161.stdout:2489 punch from 0x1ea9657 to 0x1eb7152, (0xdafb bytes) 2024-09-21T15:08:58.487 INFO:teuthology.orchestra.run.smithi161.stdout:2490 write 0x766c6ac thru 0x76774ea (0xae3f bytes) 2024-09-21T15:08:58.506 INFO:teuthology.orchestra.run.smithi161.stdout:3232 write 0xbe2233f thru 0xbe2721f (0x4ee1 bytes) 2024-09-21T15:08:58.510 INFO:teuthology.orchestra.run.smithi161.stdout:2491 write 0x7582f10 thru 0x759156d (0xe65e bytes) 2024-09-21T15:08:58.526 INFO:teuthology.orchestra.run.smithi161.stdout:2898 write 0xe185671 thru 0xe1950ec (0xfa7c bytes) 2024-09-21T15:08:58.536 INFO:teuthology.orchestra.run.smithi161.stdout:3233 write 0x1d1852d thru 0x1d1f50c (0x6fe0 bytes) 2024-09-21T15:08:58.540 INFO:teuthology.orchestra.run.smithi161.stdout:2493 read 0x15ee0c4 thru 0x15f42cd (0x620a bytes) 2024-09-21T15:08:58.552 INFO:teuthology.orchestra.run.smithi161.stdout:3234 writesame 0x5b62f78 thru 0x5b67e72 data_size 0x1(0x4efb bytes) 2024-09-21T15:08:58.552 INFO:teuthology.orchestra.run.smithi161.stdout:2901 writesame 0x98a0980 thru 0x98a2238 data_size 0x1(0x18b9 bytes) 2024-09-21T15:08:58.555 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:58.553+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb8905a0 handle_clone_image: failed to clone image mirror/10b68cbba86c to image_cluster1.client.mirror.4-clone21 2024-09-21T15:08:58.593 INFO:teuthology.orchestra.run.smithi161.stdout:3235 read 0x4df657f thru 0x4e01f8b (0xba0d bytes) 2024-09-21T15:08:58.597 INFO:teuthology.orchestra.run.smithi161.stdout:3238 read 0x1c84fce thru 0x1c936b5 (0xe6e8 bytes) 2024-09-21T15:08:58.598 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.598 INFO:teuthology.orchestra.run.smithi161.stdout:2904 read 0x51a5618 thru 0x51b42cd (0xecb6 bytes) 2024-09-21T15:08:58.598 INFO:teuthology.orchestra.run.smithi161.stdout:2905 read 0xb744a4e thru 0xb74688f (0x1e42 bytes) 2024-09-21T15:08:58.598 INFO:teuthology.orchestra.run.smithi161.stdout:2906 writesame 0xbf7e693 thru 0xbf87f4e data_size 0x5c(0x98bc bytes) 2024-09-21T15:08:58.602 INFO:teuthology.orchestra.run.smithi161.stdout:3239 punch from 0x7bbadd4 to 0x7bc7f80, (0xd1ac bytes) 2024-09-21T15:08:58.603 INFO:teuthology.orchestra.run.smithi161.stdout:3241 read 0x22665d8 thru 0x227039a (0x9dc3 bytes) 2024-09-21T15:08:58.620 INFO:teuthology.orchestra.run.smithi161.stdout:3242 write 0x17435c8 thru 0x174a132 (0x6b6b bytes) 2024-09-21T15:08:58.631 INFO:teuthology.orchestra.run.smithi161.stdout:2907 writesame 0x383c628 thru 0x384b85a data_size 0x1(0xf233 bytes) 2024-09-21T15:08:58.633 INFO:teuthology.orchestra.run.smithi161.stdout:3244 read 0x491710a thru 0x4924735 (0xd62c bytes) 2024-09-21T15:08:58.634 INFO:teuthology.orchestra.run.smithi161.stdout:3245 writesame 0x4497457 thru 0x44a52b8 data_size 0x5(0xde62 bytes) 2024-09-21T15:08:58.648 INFO:teuthology.orchestra.run.smithi161.stdout:2495 write 0xed47432 thru 0xed5570e (0xe2dd bytes) 2024-09-21T15:08:58.651 INFO:teuthology.orchestra.run.smithi161.stdout:3246 writesame 0x189ff61 thru 0x18a1a30 data_size 0x42(0x1ad0 bytes) 2024-09-21T15:08:58.667 INFO:teuthology.orchestra.run.smithi161.stdout:3558 writesame 0x3797acc thru 0x379e92c data_size 0x1(0x6e61 bytes) 2024-09-21T15:08:58.682 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.683 INFO:teuthology.orchestra.run.smithi161.stdout:3248 read 0x99b27ee thru 0x99bbc11 (0x9424 bytes) 2024-09-21T15:08:58.683 INFO:teuthology.orchestra.run.smithi161.stdout:3250 write 0x4564a0d thru 0x45652b2 (0x8a6 bytes) 2024-09-21T15:08:58.684 INFO:teuthology.orchestra.run.smithi161.stdout:2497 read 0x3c7ae0e thru 0x3c7d732 (0x2925 bytes) 2024-09-21T15:08:58.684 INFO:teuthology.orchestra.run.smithi161.stdout:2499 punch from 0xc8578 to 0xd33e4, (0xae6c bytes) 2024-09-21T15:08:58.685 INFO:teuthology.orchestra.run.smithi161.stdout:2500 write 0x7f3d9a1 thru 0x7f4abdf (0xd23f bytes) 2024-09-21T15:08:58.690 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.690 INFO:teuthology.orchestra.run.smithi161.stdout:3220 read 0x82acbcd thru 0x82b5695 (0x8ac9 bytes) 2024-09-21T15:08:58.690 INFO:teuthology.orchestra.run.smithi161.stdout:3221 read 0xc58ec19 thru 0xc59d739 (0xeb21 bytes) 2024-09-21T15:08:58.691 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.691 INFO:teuthology.orchestra.run.smithi161.stdout:3225 punch from 0x24760cc to 0x2477ef3, (0x1e27 bytes) 2024-09-21T15:08:58.691 INFO:teuthology.orchestra.run.smithi161.stdout:3226 read 0x673205c thru 0x673a09b (0x8040 bytes) 2024-09-21T15:08:58.691 INFO:teuthology.orchestra.run.smithi161.stdout:3227 write 0x2716503 thru 0x271e21e (0x7d1c bytes) 2024-09-21T15:08:58.719 INFO:teuthology.orchestra.run.smithi161.stdout:2909 writesame 0x265eee4 thru 0x2663882 data_size 0x1(0x499f bytes) 2024-09-21T15:08:58.729 INFO:teuthology.orchestra.run.smithi161.stdout:2503 write 0xdbdde20 thru 0xdbdf238 (0x1419 bytes) 2024-09-21T15:08:58.751 INFO:teuthology.orchestra.run.smithi161.stdout:3252 write 0x89e4ff3 thru 0x89eb077 (0x6085 bytes) 2024-09-21T15:08:58.763 INFO:teuthology.orchestra.run.smithi161.stdout:2504 read 0x948cd4a thru 0x948dd95 (0x104c bytes) 2024-09-21T15:08:58.763 INFO:teuthology.orchestra.run.smithi161.stdout:2505 write 0x56a41ed thru 0x56af500 (0xb314 bytes) 2024-09-21T15:08:58.770 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.770 INFO:teuthology.orchestra.run.smithi161.stdout:3231 write 0xd9d582d thru 0xd9dded0 (0x86a4 bytes) 2024-09-21T15:08:58.783 INFO:teuthology.orchestra.run.smithi161.stdout:2910 writesame 0xb8b3986 thru 0xb8bd4dd data_size 0xc(0x9b58 bytes) 2024-09-21T15:08:58.785 INFO:teuthology.orchestra.run.smithi161.stdout:3254 read 0x1c8e95b thru 0x1c92d2a (0x43d0 bytes) 2024-09-21T15:08:58.786 INFO:teuthology.orchestra.run.smithi161.stdout:3255 read 0x7dfa994 thru 0x7e09d63 (0xf3d0 bytes) 2024-09-21T15:08:58.789 INFO:teuthology.orchestra.run.smithi161.stdout:3256 trunc from 0xbe27220 to 0xd0f8ac6 2024-09-21T15:08:58.797 INFO:teuthology.orchestra.run.smithi161.stdout:3559 write 0x38b0b6b thru 0x38b4b2f (0x3fc5 bytes) 2024-09-21T15:08:58.804 INFO:teuthology.orchestra.run.smithi161.stdout:2506 write 0xc98068c thru 0xc98a8d7 (0xa24c bytes) 2024-09-21T15:08:58.816 INFO:teuthology.orchestra.run.smithi161.stdout:3560 punch from 0x8f428f8 to 0x8f5193c, (0xf044 bytes) 2024-09-21T15:08:58.816 INFO:teuthology.orchestra.run.smithi161.stdout:3561 read 0x45a67bb thru 0x45a694b (0x191 bytes) 2024-09-21T15:08:58.817 INFO:teuthology.orchestra.run.smithi161.stdout:3564 write 0x7ff1a6c thru 0x7ff9ca4 (0x8239 bytes) 2024-09-21T15:08:58.817 INFO:teuthology.orchestra.run.smithi161.stdout:3232 read 0x42419ce thru 0x424d394 (0xb9c7 bytes) 2024-09-21T15:08:58.817 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.825 INFO:teuthology.orchestra.run.smithi161.stdout:2508 read 0x81b6dca thru 0x81c0c36 (0x9e6d bytes) 2024-09-21T15:08:58.826 INFO:teuthology.orchestra.run.smithi161.stdout:2509 punch from 0x4499cbd to 0x44a716f, (0xd4b2 bytes) 2024-09-21T15:08:58.826 INFO:teuthology.orchestra.run.smithi161.stdout:2511 write 0x934a57a thru 0x934cece (0x2955 bytes) 2024-09-21T15:08:58.841 INFO:teuthology.orchestra.run.smithi161.stdout:2911 trunc from 0xe1950ed to 0x4c655dd 2024-09-21T15:08:58.845 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.845 INFO:teuthology.orchestra.run.smithi161.stdout:3259 write 0x80e2403 thru 0x80e9df6 (0x79f4 bytes) 2024-09-21T15:08:58.855 INFO:teuthology.orchestra.run.smithi161.stdout:3235 trunc from 0xde437ba to 0x150b773 2024-09-21T15:08:58.870 INFO:teuthology.orchestra.run.smithi161.stdout:2512 trunc from 0xed5570f to 0x5bbad70 2024-09-21T15:08:58.875 INFO:teuthology.orchestra.run.smithi161.stdout:3565 trunc from 0xdd14eca to 0x7c5e470 2024-09-21T15:08:58.937 INFO:teuthology.orchestra.run.smithi161.stdout:3261 writesame 0xecd7767 thru 0xece153f data_size 0x1(0x9dd9 bytes) 2024-09-21T15:08:58.942 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.942 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.942 INFO:teuthology.orchestra.run.smithi161.stdout:2917 punch from 0x29b01a0 to 0x29b928f, (0x90ef bytes) 2024-09-21T15:08:58.949 INFO:teuthology.orchestra.run.smithi161.stdout:2918 punch from 0xdbfd1c to 0xdc0587, (0x86b bytes) 2024-09-21T15:08:58.970 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.974 INFO:teuthology.orchestra.run.smithi161.stdout:2515 trunc from 0x5bbad70 to 0x397a151 2024-09-21T15:08:58.976 INFO:teuthology.orchestra.run.smithi161.stdout:3262 trunc from 0xece1540 to 0x6ab6a09 2024-09-21T15:08:58.986 INFO:teuthology.orchestra.run.smithi161.stdout:2919 writesame 0xcfeefb4 thru 0xcff9b4e data_size 0x1(0xab9b bytes) 2024-09-21T15:08:58.991 INFO:teuthology.orchestra.run.smithi161.stdout:3567 read 0x5ec8651 thru 0x5ed66ce (0xe07e bytes) 2024-09-21T15:08:58.992 INFO:teuthology.orchestra.run.smithi161.stdout:2920 punch from 0xc32ece6 to 0xc338031, (0x934b bytes) 2024-09-21T15:08:58.992 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.992 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:58.992 INFO:teuthology.orchestra.run.smithi161.stdout:2923 write 0x182eb3 thru 0x1850db (0x2229 bytes) 2024-09-21T15:08:58.992 INFO:teuthology.orchestra.run.smithi161.stdout:3568 write 0x2dc9227 thru 0x2dcf4bf (0x6299 bytes) 2024-09-21T15:08:59.016 INFO:teuthology.orchestra.run.smithi161.stdout:2924 writesame 0x93e1fc9 thru 0x93e8390 data_size 0x67(0x63c8 bytes) 2024-09-21T15:08:59.022 INFO:teuthology.orchestra.run.smithi161.stdout:3237 write 0x1773721 thru 0x1778b06 (0x53e6 bytes) 2024-09-21T15:08:59.028 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.028 INFO:teuthology.orchestra.run.smithi161.stdout:3264 write 0x29f0328 thru 0x29f305a (0x2d33 bytes) 2024-09-21T15:08:59.036 INFO:teuthology.orchestra.run.smithi161.stdout:3569 read 0x4baf813 thru 0x4bbbb59 (0xc347 bytes) 2024-09-21T15:08:59.038 INFO:teuthology.orchestra.run.smithi161.stdout:2927 read 0x95a1adc thru 0x95a46f2 (0x2c17 bytes) 2024-09-21T15:08:59.039 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.039 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.039 INFO:teuthology.orchestra.run.smithi161.stdout:2929 read 0x2fbc51c thru 0x2fc322f (0x6d14 bytes) 2024-09-21T15:08:59.039 INFO:teuthology.orchestra.run.smithi161.stdout:2930 writesame 0x1684ff4 thru 0x168b6db data_size 0x25(0x66e8 bytes) 2024-09-21T15:08:59.040 INFO:teuthology.orchestra.run.smithi161.stdout:2516 read 0x26fe89c thru 0x2700225 (0x198a bytes) 2024-09-21T15:08:59.040 INFO:teuthology.orchestra.run.smithi161.stdout:2517 read 0x2f24322 thru 0x2f2ddd7 (0x9ab6 bytes) 2024-09-21T15:08:59.058 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone20 from 0xb4eb65c (overlap 0x243474c) to 0x0 2024-09-21T15:08:59.070 INFO:teuthology.orchestra.run.smithi161.stdout:3240 punch from 0x48217d to 0x48d5e4, (0xb467 bytes) 2024-09-21T15:08:59.074 INFO:teuthology.orchestra.run.smithi161.stdout:3241 trunc from 0x1778b07 to 0x3f09849 2024-09-21T15:08:59.099 INFO:teuthology.orchestra.run.smithi161.stdout:3570 write 0x9d3fab4 thru 0x9d41662 (0x1baf bytes) 2024-09-21T15:08:59.107 INFO:teuthology.orchestra.run.smithi161.stdout:3268 write 0x7162fb5 thru 0x716a3c9 (0x7415 bytes) 2024-09-21T15:08:59.108 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:08:59.105+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581d3114d20 handle_clone_image: failed to clone image mirror/10b6c236dd1e to image_cluster1.client.mirror.4-clone11 2024-09-21T15:08:59.110 INFO:teuthology.orchestra.run.smithi161.stdout:2518 writesame 0xc0d7c7b thru 0xc0e124f data_size 0xb(0x95d5 bytes) 2024-09-21T15:08:59.117 INFO:teuthology.orchestra.run.smithi161.stdout:2519 read 0x92134cb thru 0x921d608 (0xa13e bytes) 2024-09-21T15:08:59.122 INFO:teuthology.orchestra.run.smithi161.stdout:2520 trunc from 0xc0e1250 to 0xe918f79 2024-09-21T15:08:59.133 INFO:teuthology.orchestra.run.smithi161.stdout:2931 writesame 0xdba92bb thru 0xdbb4496 data_size 0x2(0xb1dc bytes) 2024-09-21T15:08:59.135 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.135 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.135 INFO:teuthology.orchestra.run.smithi161.stdout:3574 writesame 0x74a8eaa thru 0x74af570 data_size 0x1(0x66c7 bytes) 2024-09-21T15:08:59.138 INFO:teuthology.orchestra.run.smithi161.stdout:3269 punch from 0x351ad1b to 0x351b528, (0x80d bytes) 2024-09-21T15:08:59.138 INFO:teuthology.orchestra.run.smithi161.stdout:3271 punch from 0x1af8a25 to 0x1aff51b, (0x6af6 bytes) 2024-09-21T15:08:59.138 INFO:teuthology.orchestra.run.smithi161.stdout:3272 punch from 0x11c8f2e to 0x11c9777, (0x849 bytes) 2024-09-21T15:08:59.138 INFO:teuthology.orchestra.run.smithi161.stdout:3274 write 0x25fdddf thru 0x2608920 (0xab42 bytes) 2024-09-21T15:08:59.140 INFO:teuthology.orchestra.run.smithi161.stdout:3242 read 0x128b951 thru 0x128d985 (0x2035 bytes) 2024-09-21T15:08:59.145 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.145 INFO:teuthology.orchestra.run.smithi161.stdout:2934 punch from 0x4cca788 to 0x4ccdcf9, (0x3571 bytes) 2024-09-21T15:08:59.146 INFO:teuthology.orchestra.run.smithi161.stdout:2935 punch from 0x7485bc9 to 0x74902a8, (0xa6df bytes) 2024-09-21T15:08:59.147 INFO:teuthology.orchestra.run.smithi161.stdout:3243 trunc from 0x3f09849 to 0x411868 2024-09-21T15:08:59.160 INFO:teuthology.orchestra.run.smithi161.stdout:2936 trunc from 0xdbb4497 to 0x5b178f1 2024-09-21T15:08:59.361 INFO:teuthology.orchestra.run.smithi161.stdout:3275 punch from 0x50ef219 to 0x50fcc91, (0xda78 bytes) 2024-09-21T15:08:59.370 INFO:teuthology.orchestra.run.smithi161.stdout:3575 punch from 0x334f9cf to 0x3359b8f, (0xa1c0 bytes) 2024-09-21T15:08:59.371 INFO:teuthology.orchestra.run.smithi161.stdout:3276 trunc from 0x716a3ca to 0x3217e77 2024-09-21T15:08:59.378 INFO:teuthology.orchestra.run.smithi161.stdout:2521 writesame 0xd7849c3 thru 0xd789ede data_size 0x1a(0x551c bytes) 2024-09-21T15:08:59.401 INFO:teuthology.orchestra.run.smithi161.stdout:3244 read 0x363a98 thru 0x371723 (0xdc8c bytes) 2024-09-21T15:08:59.402 INFO:teuthology.orchestra.run.smithi161.stdout:3245 read 0xeff71 thru 0xfda89 (0xdb19 bytes) 2024-09-21T15:08:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:2522 trunc from 0xe918f79 to 0x9064862 2024-09-21T15:08:59.427 INFO:teuthology.orchestra.run.smithi161.stdout:3576 writesame 0xde43632 thru 0xde489d4 data_size 0x3d(0x53a3 bytes) 2024-09-21T15:08:59.428 INFO:teuthology.orchestra.run.smithi161.stdout:2937 trunc from 0x5b178f1 to 0x7c07dcc 2024-09-21T15:08:59.434 INFO:teuthology.orchestra.run.smithi161.stdout:3579 write 0x74f9159 thru 0x7503d8a (0xac32 bytes) 2024-09-21T15:08:59.439 INFO:teuthology.orchestra.run.smithi161.stdout:3246 write 0x30b7c3d thru 0x30be976 (0x6d3a bytes) 2024-09-21T15:08:59.444 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.470 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.486 INFO:teuthology.orchestra.run.smithi161.stdout:3278 write 0x889581d thru 0x88a022c (0xaa10 bytes) 2024-09-21T15:08:59.487 INFO:teuthology.orchestra.run.smithi161.stdout:3581 trunc from 0xde489d5 to 0x82b548f 2024-09-21T15:08:59.505 INFO:teuthology.orchestra.run.smithi161.stdout:3280 punch from 0x4acb154 to 0x4ad209d, (0x6f49 bytes) 2024-09-21T15:08:59.506 INFO:teuthology.orchestra.run.smithi161.stdout:3281 trunc from 0x88a022d to 0x7e381b6 2024-09-21T15:08:59.516 INFO:teuthology.orchestra.run.smithi161.stdout:2938 write 0x86e5138 thru 0x86f4231 (0xf0fa bytes) 2024-09-21T15:08:59.518 INFO:teuthology.orchestra.run.smithi161.stdout:2523 writesame 0xc8268c4 thru 0xc83551c data_size 0x1(0xec59 bytes) 2024-09-21T15:08:59.522 INFO:teuthology.orchestra.run.smithi161.stdout:3247 write 0xb3876c5 thru 0xb396f66 (0xf8a2 bytes) 2024-09-21T15:08:59.524 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.525 INFO:teuthology.orchestra.run.smithi161.stdout:2526 punch from 0x45b3e2d to 0x45ba1da, (0x63ad bytes) 2024-09-21T15:08:59.525 INFO:teuthology.orchestra.run.smithi161.stdout:2528 write 0xc274d6f thru 0xc27ae37 (0x60c9 bytes) 2024-09-21T15:08:59.538 INFO:teuthology.orchestra.run.smithi161.stdout:2939 punch from 0x2d01055 to 0x2d05e3a, (0x4de5 bytes) 2024-09-21T15:08:59.542 INFO:teuthology.orchestra.run.smithi161.stdout:2529 punch from 0x4c59ca7 to 0x4c690e7, (0xf440 bytes) 2024-09-21T15:08:59.542 INFO:teuthology.orchestra.run.smithi161.stdout:2530 punch from 0x1abf86f to 0x1ac3c1b, (0x43ac bytes) 2024-09-21T15:08:59.542 INFO:teuthology.orchestra.run.smithi161.stdout:2531 read 0x3390b9a thru 0x3390fd5 (0x43c bytes) 2024-09-21T15:08:59.549 INFO:teuthology.orchestra.run.smithi161.stdout:3582 read 0x57260dc thru 0x5726e15 (0xd3a bytes) 2024-09-21T15:08:59.556 INFO:teuthology.orchestra.run.smithi161.stdout:3250 write 0x7c3612e thru 0x7c3eece (0x8da1 bytes) 2024-09-21T15:08:59.575 INFO:teuthology.orchestra.run.smithi161.stdout:2941 writesame 0x88ccbcb thru 0x88da222 data_size 0x4c(0xd658 bytes) 2024-09-21T15:08:59.587 INFO:teuthology.orchestra.run.smithi161.stdout:2942 write 0x6c02715 thru 0x6c05c04 (0x34f0 bytes) 2024-09-21T15:08:59.591 INFO:teuthology.orchestra.run.smithi161.stdout:2532 write 0xd50417b thru 0xd50e99c (0xa822 bytes) 2024-09-21T15:08:59.600 INFO:teuthology.orchestra.run.smithi161.stdout:3251 read 0x4efe5dd thru 0x4f0e244 (0xfc68 bytes) 2024-09-21T15:08:59.600 INFO:teuthology.orchestra.run.smithi161.stdout:3253 write 0x54d587f thru 0x54e526c (0xf9ee bytes) 2024-09-21T15:08:59.626 INFO:teuthology.orchestra.run.smithi161.stdout:3585 writesame 0xa2ffda1 thru 0xa303c63 data_size 0x1(0x3ec3 bytes) 2024-09-21T15:08:59.631 INFO:teuthology.orchestra.run.smithi161.stdout:2943 read 0x569f6c3 thru 0x56a4594 (0x4ed2 bytes) 2024-09-21T15:08:59.633 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #19, image image_cluster1.client.mirror.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent20 2024-09-21T15:08:59.633 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.642 INFO:teuthology.orchestra.run.smithi161.stdout:3586 trunc from 0xa303c64 to 0xddc17cf 2024-09-21T15:08:59.645 INFO:teuthology.orchestra.run.smithi161.stdout:3284 write 0x82eeb0a thru 0x82f944f (0xa946 bytes) 2024-09-21T15:08:59.654 INFO:teuthology.orchestra.run.smithi161.stdout:2534 trunc from 0xd50e99d to 0x3203552 2024-09-21T15:08:59.660 INFO:teuthology.orchestra.run.smithi161.stdout:3254 punch from 0x8f32954 to 0x8f404a9, (0xdb55 bytes) 2024-09-21T15:08:59.660 INFO:teuthology.orchestra.run.smithi161.stdout:3256 write 0x8619566 thru 0x8624c34 (0xb6cf bytes) 2024-09-21T15:08:59.667 INFO:teuthology.orchestra.run.smithi161.stdout:3285 write 0x7e0db26 thru 0x7e134d3 (0x59ae bytes) 2024-09-21T15:08:59.683 INFO:teuthology.orchestra.run.smithi161.stdout:3286 write 0x478a37d thru 0x47915aa (0x722e bytes) 2024-09-21T15:08:59.690 INFO:teuthology.orchestra.run.smithi161.stdout:2944 writesame 0x99a108e thru 0x99a6963 data_size 0x2(0x58d6 bytes) 2024-09-21T15:08:59.695 INFO:teuthology.orchestra.run.smithi161.stdout:2946 read 0x64c3c64 thru 0x64d2f5b (0xf2f8 bytes) 2024-09-21T15:08:59.696 INFO:teuthology.orchestra.run.smithi161.stdout:3257 read 0x9116af3 thru 0x912067d (0x9b8b bytes) 2024-09-21T15:08:59.696 INFO:teuthology.orchestra.run.smithi161.stdout:2948 writesame 0x439cbed thru 0x439f741 data_size 0x1(0x2b55 bytes) 2024-09-21T15:08:59.696 INFO:teuthology.orchestra.run.smithi161.stdout:3258 read 0x1f74795 thru 0x1f82178 (0xd9e4 bytes) 2024-09-21T15:08:59.709 INFO:teuthology.orchestra.run.smithi161.stdout:3259 trunc from 0xb396f67 to 0x5ef942a 2024-09-21T15:08:59.727 INFO:teuthology.orchestra.run.smithi161.stdout:3374 punch from 0x1e7b0f4 to 0x1e7e2bd, (0x31c9 bytes) 2024-09-21T15:08:59.736 INFO:teuthology.orchestra.run.smithi161.stdout:2949 punch from 0x73b5966 to 0x73c0ae8, (0xb182 bytes) 2024-09-21T15:08:59.736 INFO:teuthology.orchestra.run.smithi161.stdout:2950 write 0x55536d thru 0x55c107 (0x6d9b bytes) 2024-09-21T15:08:59.736 INFO:teuthology.orchestra.run.smithi161.stdout:2539 write 0x18c4640 thru 0x18c7496 (0x2e57 bytes) 2024-09-21T15:08:59.749 INFO:teuthology.orchestra.run.smithi161.stdout:3587 writesame 0xe3857d1 thru 0xe386afc data_size 0x1(0x132c bytes) 2024-09-21T15:08:59.758 INFO:teuthology.orchestra.run.smithi161.stdout:3288 writesame 0x88dd64b thru 0x88e78bd data_size 0xd(0xa273 bytes) 2024-09-21T15:08:59.759 INFO:teuthology.orchestra.run.smithi161.stdout:3588 write 0x589b226 thru 0x58a020b (0x4fe6 bytes) 2024-09-21T15:08:59.761 INFO:teuthology.orchestra.run.smithi161.stdout:2951 writesame 0x2ed6a3e thru 0x2ee2803 data_size 0x9(0xbdc6 bytes) 2024-09-21T15:08:59.765 INFO:teuthology.orchestra.run.smithi161.stdout:3289 writesame 0x4c7c0af thru 0x4c7e21d data_size 0x9(0x216f bytes) 2024-09-21T15:08:59.769 INFO:teuthology.orchestra.run.smithi161.stdout:3375 read 0x390ed68 thru 0x3917341 (0x85da bytes) 2024-09-21T15:08:59.773 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.780 INFO:teuthology.orchestra.run.smithi161.stdout:3291 trunc from 0x88e78be to 0xd3ae1ed 2024-09-21T15:08:59.795 INFO:teuthology.orchestra.run.smithi161.stdout:3590 writesame 0x13939d thru 0x13a1fa data_size 0x3(0xe5e bytes) 2024-09-21T15:08:59.796 INFO:teuthology.orchestra.run.smithi161.stdout:3260 read 0x2bed9b4 thru 0x2bfb69c (0xdce9 bytes) 2024-09-21T15:08:59.796 INFO:teuthology.orchestra.run.smithi161.stdout:3261 punch from 0xbd9d64 to 0xbde324, (0x45c0 bytes) 2024-09-21T15:08:59.796 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.818 INFO:teuthology.orchestra.run.smithi161.stdout:3376 write 0xc9fa8e4 thru 0xca03958 (0x9075 bytes) 2024-09-21T15:08:59.823 INFO:teuthology.orchestra.run.smithi161.stdout:2541 write 0x693d0b4 thru 0x694a0cd (0xd01a bytes) 2024-09-21T15:08:59.831 INFO:teuthology.orchestra.run.smithi161.stdout:3591 write 0x981aae6 thru 0x981bdf1 (0x130c bytes) 2024-09-21T15:08:59.837 INFO:teuthology.orchestra.run.smithi161.stdout:3292 read 0x7eedcb6 thru 0x7efc40f (0xe75a bytes) 2024-09-21T15:08:59.837 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.837 INFO:teuthology.orchestra.run.smithi161.stdout:3295 read 0xae4936f thru 0xae57bc9 (0xe85b bytes) 2024-09-21T15:08:59.837 INFO:teuthology.orchestra.run.smithi161.stdout:3296 punch from 0x193fb50 to 0x194f5ec, (0xfa9c bytes) 2024-09-21T15:08:59.838 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.841 INFO:teuthology.orchestra.run.smithi161.stdout:2542 punch from 0x1ae37ea to 0x1aeb58e, (0x7da4 bytes) 2024-09-21T15:08:59.841 INFO:teuthology.orchestra.run.smithi161.stdout:3297 read 0x985fc6e thru 0x9869f7f (0xa312 bytes) 2024-09-21T15:08:59.842 INFO:teuthology.orchestra.run.smithi161.stdout:3298 read 0x2ae21a9 thru 0x2af1089 (0xeee1 bytes) 2024-09-21T15:08:59.842 INFO:teuthology.orchestra.run.smithi161.stdout:2952 writesame 0x9cf8031 thru 0x9d05d4b data_size 0x17(0xdd1b bytes) 2024-09-21T15:08:59.843 INFO:teuthology.orchestra.run.smithi161.stdout:3299 write 0x374ff5b thru 0x375b442 (0xb4e8 bytes) 2024-09-21T15:08:59.847 INFO:teuthology.orchestra.run.smithi161.stdout:3378 trunc from 0xca03959 to 0xedb9f28 2024-09-21T15:08:59.850 INFO:teuthology.orchestra.run.smithi161.stdout:2953 read 0x662331 thru 0x665ff4 (0x3cc4 bytes) 2024-09-21T15:08:59.851 INFO:teuthology.orchestra.run.smithi161.stdout:3594 writesame 0x109ca40 thru 0x10a4bf5 data_size 0x1(0x81b6 bytes) 2024-09-21T15:08:59.851 INFO:teuthology.orchestra.run.smithi161.stdout:3264 write 0xabd0c43 thru 0xabd25cc (0x198a bytes) 2024-09-21T15:08:59.852 INFO:teuthology.orchestra.run.smithi161.stdout:2954 clone 25 order 20 su 32768 sc 12 2024-09-21T15:08:59.856 INFO:teuthology.orchestra.run.smithi161.stdout:3300 read 0xb8e4d79 thru 0xb8e8d5c (0x3fe4 bytes) 2024-09-21T15:08:59.905 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.905 INFO:teuthology.orchestra.run.smithi161.stdout:3268 write 0x59bf463 thru 0x59c3ad1 (0x466f bytes) 2024-09-21T15:08:59.918 INFO:teuthology.orchestra.run.smithi161.stdout:2545 write 0x8dccd98 thru 0x8dcd0c3 (0x32c bytes) 2024-09-21T15:08:59.921 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:08:59.921 INFO:teuthology.orchestra.run.smithi161.stdout:3596 writesame 0xbf00634 thru 0xbf1000b data_size 0x3(0xf9d8 bytes) 2024-09-21T15:08:59.925 INFO:teuthology.orchestra.run.smithi161.stdout:3380 writesame 0x8703384 thru 0x8709586 data_size 0x1(0x6203 bytes) 2024-09-21T15:08:59.952 INFO:teuthology.orchestra.run.smithi161.stdout:3301 write 0xdb248fa thru 0xdb3315f (0xe866 bytes) 2024-09-21T15:08:59.958 INFO:teuthology.orchestra.run.smithi161.stdout:3269 write 0x8402f52 thru 0x840ea64 (0xbb13 bytes) 2024-09-21T15:08:59.966 INFO:teuthology.orchestra.run.smithi161.stdout:3597 read 0x998213c thru 0x9983445 (0x130a bytes) 2024-09-21T15:08:59.966 INFO:teuthology.orchestra.run.smithi161.stdout:3599 writesame 0x24c6ace thru 0x24c8b58 data_size 0x1(0x208b bytes) 2024-09-21T15:08:59.967 INFO:teuthology.orchestra.run.smithi161.stdout:3381 writesame 0x28f7bbe thru 0x290597d data_size 0x10(0xddc0 bytes) 2024-09-21T15:08:59.986 INFO:teuthology.orchestra.run.smithi161.stdout:3303 trunc from 0xdb33160 to 0x8988f0f 2024-09-21T15:08:59.995 INFO:teuthology.orchestra.run.smithi161.stdout:2546 write 0xb476bc4 thru 0xb47af4c (0x4389 bytes) 2024-09-21T15:09:00.003 INFO:teuthology.orchestra.run.smithi161.stdout:3270 punch from 0x5d49061 to 0x5d56496, (0xd435 bytes) 2024-09-21T15:09:00.004 INFO:teuthology.orchestra.run.smithi161.stdout:3602 writesame 0xb09c07c thru 0xb0a9c69 data_size 0x1(0xdbee bytes) 2024-09-21T15:09:00.008 INFO:teuthology.orchestra.run.smithi161.stdout:3382 read 0x909b5b6 thru 0x90a788c (0xc2d7 bytes) 2024-09-21T15:09:00.008 INFO:teuthology.orchestra.run.smithi161.stdout:3383 read 0x1bed5a0 thru 0x1bfc0f0 (0xeb51 bytes) 2024-09-21T15:09:00.009 INFO:teuthology.orchestra.run.smithi161.stdout:3384 punch from 0xc0914fd to 0xc09c667, (0xb16a bytes) 2024-09-21T15:09:00.010 INFO:teuthology.orchestra.run.smithi161.stdout:3385 punch from 0x23ca78b to 0x23cebdb, (0x4450 bytes) 2024-09-21T15:09:00.010 INFO:teuthology.orchestra.run.smithi161.stdout:3386 writesame 0x65754ff thru 0x657a653 data_size 0x1(0x5155 bytes) 2024-09-21T15:09:00.010 INFO:teuthology.orchestra.run.smithi161.stdout:3271 trunc from 0xabd25cd to 0xe9bea21 2024-09-21T15:09:00.019 INFO:teuthology.orchestra.run.smithi161.stdout:2548 read 0x57a029e thru 0x57add7c (0xdadf bytes) 2024-09-21T15:09:00.020 INFO:teuthology.orchestra.run.smithi161.stdout:2549 punch from 0x1a514c3 to 0x1a5418a, (0x2cc7 bytes) 2024-09-21T15:09:00.020 INFO:teuthology.orchestra.run.smithi161.stdout:2550 read 0xb38773e thru 0xb38b0ef (0x39b2 bytes) 2024-09-21T15:09:00.020 INFO:teuthology.orchestra.run.smithi161.stdout:2551 punch from 0x53a678 to 0x54478f, (0xa117 bytes) 2024-09-21T15:09:00.020 INFO:teuthology.orchestra.run.smithi161.stdout:2552 write 0x1122495 thru 0x112cc4c (0xa7b8 bytes) 2024-09-21T15:09:00.049 INFO:teuthology.orchestra.run.smithi161.stdout:3387 write 0xc3b77ad thru 0xc3c6dc6 (0xf61a bytes) 2024-09-21T15:09:00.057 INFO:teuthology.orchestra.run.smithi161.stdout:2553 read 0x5c41590 thru 0x5c4c9ec (0xb45d bytes) 2024-09-21T15:09:00.057 INFO:teuthology.orchestra.run.smithi161.stdout:2555 write 0xcc64de thru 0xcd3097 (0xcbba bytes) 2024-09-21T15:09:00.064 INFO:teuthology.orchestra.run.smithi161.stdout:3605 read 0xd604fb6 thru 0xd60d22f (0x827a bytes) 2024-09-21T15:09:00.064 INFO:teuthology.orchestra.run.smithi161.stdout:3607 punch from 0x14083e8 to 0x14107d3, (0x83eb bytes) 2024-09-21T15:09:00.065 INFO:teuthology.orchestra.run.smithi161.stdout:3608 flatten 2024-09-21T15:09:00.072 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.075 INFO:teuthology.orchestra.run.smithi161.stdout:3273 writesame 0xb668427 thru 0xb66fdd9 data_size 0x5d(0x79b3 bytes) 2024-09-21T15:09:00.076 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.076 INFO:teuthology.orchestra.run.smithi161.stdout:3390 read 0x16bd34a thru 0x16cb5dc (0xe293 bytes) 2024-09-21T15:09:00.078 INFO:teuthology.orchestra.run.smithi161.stdout:3393 punch from 0xe5118e7 to 0xe519faa, (0x86c3 bytes) 2024-09-21T15:09:00.078 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.078 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.079 INFO:teuthology.orchestra.run.smithi161.stdout:3399 read 0x7d18936 thru 0x7d1c7e1 (0x3eac bytes) 2024-09-21T15:09:00.079 INFO:teuthology.orchestra.run.smithi161.stdout:3400 write 0xd2c4c52 thru 0xd2d22fe (0xd6ad bytes) 2024-09-21T15:09:00.085 INFO:teuthology.orchestra.run.smithi161.stdout:2557 trunc from 0xb47af4d to 0x4065ed7 2024-09-21T15:09:00.139 INFO:teuthology.orchestra.run.smithi161.stdout:3401 writesame 0xb0756f4 thru 0xb07a9a5 data_size 0xa(0x52b2 bytes) 2024-09-21T15:09:00.154 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.154 INFO:teuthology.orchestra.run.smithi161.stdout:3305 read 0x384a459 thru 0x385458c (0xa134 bytes) 2024-09-21T15:09:00.159 INFO:teuthology.orchestra.run.smithi161.stdout:3274 writesame 0xbe05f25 thru 0xbe0bf27 data_size 0x3(0x6003 bytes) 2024-09-21T15:09:00.165 INFO:teuthology.orchestra.run.smithi161.stdout:3306 read 0x34e1e51 thru 0x34e90a8 (0x7258 bytes) 2024-09-21T15:09:00.165 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.167 INFO:teuthology.orchestra.run.smithi161.stdout:3402 writesame 0x66ad77b thru 0x66bd399 data_size 0x13(0xfc1f bytes) 2024-09-21T15:09:00.174 INFO:teuthology.orchestra.run.smithi161.stdout:3308 trunc from 0x8988f0f to 0xe3d7e6d 2024-09-21T15:09:00.228 INFO:teuthology.orchestra.run.smithi161.stdout:3404 read 0x4e0e2ed thru 0x4e14045 (0x5d59 bytes) 2024-09-21T15:09:00.228 INFO:teuthology.orchestra.run.smithi161.stdout:3405 writesame 0x9f7f06 thru 0xa02a8a data_size 0x1(0xab85 bytes) 2024-09-21T15:09:00.254 INFO:teuthology.orchestra.run.smithi161.stdout:3275 punch from 0x960bfab to 0x9614a2f, (0x8a84 bytes) 2024-09-21T15:09:00.255 INFO:teuthology.orchestra.run.smithi161.stdout:3276 read 0x56359f8 thru 0x563b66c (0x5c75 bytes) 2024-09-21T15:09:00.256 INFO:teuthology.orchestra.run.smithi161.stdout:3277 punch from 0x66d07d0 to 0x66db114, (0xa944 bytes) 2024-09-21T15:09:00.256 INFO:teuthology.orchestra.run.smithi161.stdout:3279 writesame 0xa2eb4d5 thru 0xa2f672b data_size 0x17(0xb257 bytes) 2024-09-21T15:09:00.270 INFO:teuthology.orchestra.run.smithi161.stdout:2558 read 0xa66d30 thru 0xa75add (0xedae bytes) 2024-09-21T15:09:00.271 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.272 INFO:teuthology.orchestra.run.smithi161.stdout:2562 punch from 0x330d5e4 to 0x3312444, (0x4e60 bytes) 2024-09-21T15:09:00.289 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.289 INFO:teuthology.orchestra.run.smithi161.stdout:3281 punch from 0xd4150b3 to 0xd41776c, (0x26b9 bytes) 2024-09-21T15:09:00.291 INFO:teuthology.orchestra.run.smithi161.stdout:3310 read 0x42a3a7b thru 0x42b152d (0xdab3 bytes) 2024-09-21T15:09:00.292 INFO:teuthology.orchestra.run.smithi161.stdout:3311 write 0xaeb7bbf thru 0xaebfadf (0x7f21 bytes) 2024-09-21T15:09:00.295 INFO:teuthology.orchestra.run.smithi161.stdout:3406 write 0x69943ab thru 0x69946d3 (0x329 bytes) 2024-09-21T15:09:00.306 INFO:teuthology.orchestra.run.smithi161.stdout:3312 clone 18 order 23 su 32768 sc 12 2024-09-21T15:09:00.308 INFO:teuthology.orchestra.run.smithi161.stdout:3407 punch from 0x99db4f0 to 0x99e44d3, (0x8fe3 bytes) 2024-09-21T15:09:00.309 INFO:teuthology.orchestra.run.smithi161.stdout:3411 trunc from 0xedb9f28 to 0xe2af11c 2024-09-21T15:09:00.309 INFO:teuthology.orchestra.run.smithi161.stdout:2564 write 0x568099d thru 0x5685c3d (0x52a1 bytes) 2024-09-21T15:09:00.316 INFO:teuthology.orchestra.run.smithi161.stdout:3283 trunc from 0xe9bea21 to 0x16f2f20 2024-09-21T15:09:00.327 INFO:teuthology.orchestra.run.smithi161.stdout:2565 read 0x39efab1 thru 0x39fb7a8 (0xbcf8 bytes) 2024-09-21T15:09:00.360 INFO:teuthology.orchestra.run.smithi161.stdout:3412 write 0x9f597e8 thru 0x9f69158 (0xf971 bytes) 2024-09-21T15:09:00.403 INFO:teuthology.orchestra.run.smithi161.stdout:3414 read 0x587d6d5 thru 0x5889780 (0xc0ac bytes) 2024-09-21T15:09:00.403 INFO:teuthology.orchestra.run.smithi161.stdout:3416 clone 22 order 18 su 8192 sc 9 2024-09-21T15:09:00.406 INFO:teuthology.orchestra.run.smithi161.stdout:2566 write 0xb1dc962 thru 0xb1ebde1 (0xf480 bytes) 2024-09-21T15:09:00.419 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.419 INFO:teuthology.orchestra.run.smithi161.stdout:2568 writesame 0x8915b5c thru 0x8917639 data_size 0x13(0x1ade bytes) 2024-09-21T15:09:00.429 INFO:teuthology.orchestra.run.smithi161.stdout:2569 read 0x9780637 thru 0x97858e2 (0x52ac bytes) 2024-09-21T15:09:00.429 INFO:teuthology.orchestra.run.smithi161.stdout:2570 writesame 0x2da7b1b thru 0x2dae3f9 data_size 0x39(0x68df bytes) 2024-09-21T15:09:00.437 INFO:teuthology.orchestra.run.smithi161.stdout:2572 writesame 0x64e0feb thru 0x64efcd3 data_size 0x1(0xece9 bytes) 2024-09-21T15:09:00.440 INFO:teuthology.orchestra.run.smithi161.stdout:3286 trunc from 0x16f2f20 to 0x683e829 2024-09-21T15:09:00.468 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.469 INFO:teuthology.orchestra.run.smithi161.stdout:3288 trunc from 0x683e829 to 0x5c46431 2024-09-21T15:09:00.490 INFO:teuthology.orchestra.run.smithi161.stdout:2573 read 0x296e23d thru 0x29742fd (0x60c1 bytes) 2024-09-21T15:09:00.490 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.490 INFO:teuthology.orchestra.run.smithi161.stdout:2577 punch from 0x936ee03 to 0x9370e9c, (0x2099 bytes) 2024-09-21T15:09:00.490 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.490 INFO:teuthology.orchestra.run.smithi161.stdout:2579 read 0x1ef5a34 thru 0x1efdfd0 (0x859d bytes) 2024-09-21T15:09:00.491 INFO:teuthology.orchestra.run.smithi161.stdout:2580 write 0x4dc7c1 thru 0x4e1ed2 (0x5712 bytes) 2024-09-21T15:09:00.501 INFO:teuthology.orchestra.run.smithi161.stdout:2581 punch from 0x4945d9b to 0x4946f05, (0x116a bytes) 2024-09-21T15:09:00.501 INFO:teuthology.orchestra.run.smithi161.stdout:2582 write 0x5adba3 thru 0x5baba0 (0xcffe bytes) 2024-09-21T15:09:00.515 INFO:teuthology.orchestra.run.smithi161.stdout:3292 punch from 0x5388ad2 to 0x5389ab4, (0xfe2 bytes) 2024-09-21T15:09:00.520 INFO:teuthology.orchestra.run.smithi161.stdout:2583 writesame 0x6dde7b6 thru 0x6dec06d data_size 0x28(0xd8b8 bytes) 2024-09-21T15:09:00.527 INFO:teuthology.orchestra.run.smithi161.stdout:3609 write 0xa9b013b thru 0xa9b3c13 (0x3ad9 bytes) 2024-09-21T15:09:00.530 INFO:teuthology.orchestra.run.smithi161.stdout:3293 trunc from 0x5c46431 to 0xe2e9fb3 2024-09-21T15:09:00.533 INFO:teuthology.orchestra.run.smithi161.stdout:2584 read 0x64c7d1 thru 0x656c81 (0xa4b1 bytes) 2024-09-21T15:09:00.534 INFO:teuthology.orchestra.run.smithi161.stdout:2585 read 0x77f0097 thru 0x77fd54e (0xd4b8 bytes) 2024-09-21T15:09:00.555 INFO:teuthology.orchestra.run.smithi161.stdout:3610 write 0xb71f70 thru 0xb76c5a (0x4ceb bytes) 2024-09-21T15:09:00.581 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.581 INFO:teuthology.orchestra.run.smithi161.stdout:3296 punch from 0xdb4e24e to 0xdb595f9, (0xb3ab bytes) 2024-09-21T15:09:00.581 INFO:teuthology.orchestra.run.smithi161.stdout:3297 write 0x857be0e thru 0x858222e (0x6421 bytes) 2024-09-21T15:09:00.587 INFO:teuthology.orchestra.run.smithi161.stdout:3611 read 0x43f15f thru 0x440c7e (0x1b20 bytes) 2024-09-21T15:09:00.589 INFO:teuthology.orchestra.run.smithi161.stdout:3612 punch from 0x832fe2f to 0x8333c23, (0x3df4 bytes) 2024-09-21T15:09:00.589 INFO:teuthology.orchestra.run.smithi161.stdout:3613 read 0x1c2ca39 thru 0x1c2cf2c (0x4f4 bytes) 2024-09-21T15:09:00.589 INFO:teuthology.orchestra.run.smithi161.stdout:3614 write 0xb5a8f6b thru 0xb5aa3d8 (0x146e bytes) 2024-09-21T15:09:00.593 INFO:teuthology.orchestra.run.smithi161.stdout:2586 writesame 0xdb1b2a0 thru 0xdb2581b data_size 0x22(0xa57c bytes) 2024-09-21T15:09:00.598 INFO:teuthology.orchestra.run.smithi161.stdout:2587 read 0xb6e3097 thru 0xb6e84e8 (0x5452 bytes) 2024-09-21T15:09:00.598 INFO:teuthology.orchestra.run.smithi161.stdout:2589 write 0x4475344 thru 0x447d94f (0x860c bytes) 2024-09-21T15:09:00.635 INFO:teuthology.orchestra.run.smithi161.stdout:3298 read 0x1e1144a thru 0x1e1b970 (0xa527 bytes) 2024-09-21T15:09:00.635 INFO:teuthology.orchestra.run.smithi161.stdout:3299 read 0x8e0184b thru 0x8e08aa8 (0x725e bytes) 2024-09-21T15:09:00.636 INFO:teuthology.orchestra.run.smithi161.stdout:3302 punch from 0x127587e to 0x127e2b2, (0x8a34 bytes) 2024-09-21T15:09:00.636 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.658 INFO:teuthology.orchestra.run.smithi161.stdout:2590 clone 31 order 24 su 1048576 sc 14 2024-09-21T15:09:00.672 INFO:teuthology.orchestra.run.smithi161.stdout:3615 trunc from 0xe386afd to 0x6b7c014 2024-09-21T15:09:00.703 INFO:teuthology.orchestra.run.smithi161.stdout:3304 write 0xe80d090 thru 0xe816905 (0x9876 bytes) 2024-09-21T15:09:00.771 INFO:teuthology.orchestra.run.smithi161.stdout:3617 punch from 0x6cccf9 to 0x6d34b4, (0x67bb bytes) 2024-09-21T15:09:00.771 INFO:teuthology.orchestra.run.smithi161.stdout:3307 trunc from 0xe816906 to 0x5556833 2024-09-21T15:09:00.771 INFO:teuthology.orchestra.run.smithi161.stdout:3618 write 0x5b15c69 thru 0x5b24fb6 (0xf34e bytes) 2024-09-21T15:09:00.813 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:00.813 INFO:teuthology.orchestra.run.smithi161.stdout:3624 read 0x108c28 thru 0x1119a1 (0x8d7a bytes) 2024-09-21T15:09:00.816 INFO:teuthology.orchestra.run.smithi161.stdout:3625 clone 23 order 23 su 1048576 sc 7 2024-09-21T15:09:00.853 INFO:teuthology.orchestra.run.smithi161.stdout:3309 punch from 0x2ad6da8 to 0x2ae35d5, (0xc82d bytes) 2024-09-21T15:09:00.853 INFO:teuthology.orchestra.run.smithi161.stdout:3311 write 0x4bef4c5 thru 0x4bf8a1e (0x955a bytes) 2024-09-21T15:09:00.882 INFO:teuthology.orchestra.run.smithi161.stdout:3312 read 0x4ac347f thru 0x4ac3cfe (0x880 bytes) 2024-09-21T15:09:00.944 INFO:teuthology.orchestra.run.smithi161.stdout:3313 writesame 0xd241027 thru 0xd24bc04 data_size 0x3(0xabde bytes) 2024-09-21T15:09:00.951 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone24 from 0x9d05d4c (overlap 0x223e6f) to 0x1b6525 2024-09-21T15:09:00.951 INFO:teuthology.orchestra.run.smithi161.stdout:3314 read 0xc9dace6 thru 0xc9e11f4 (0x650f bytes) 2024-09-21T15:09:00.951 INFO:teuthology.orchestra.run.smithi161.stdout:3318 write 0x9ca499 thru 0x9cd437 (0x2f9f bytes) 2024-09-21T15:09:00.983 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.0-clone21 2024-09-21T15:09:00.987 INFO:teuthology.orchestra.run.smithi161.stdout:3320 read 0x3856a6e thru 0x3857deb (0x137e bytes) 2024-09-21T15:09:00.988 INFO:teuthology.orchestra.run.smithi161.stdout:3322 read 0x7a71108 thru 0x7a7b718 (0xa611 bytes) 2024-09-21T15:09:00.990 INFO:teuthology.orchestra.run.smithi161.stdout:3323 write 0x8a365b7 thru 0x8a4483d (0xe287 bytes) 2024-09-21T15:09:01.041 INFO:teuthology.orchestra.run.smithi161.stdout:3324 read 0x4733993 thru 0x4735fda (0x2648 bytes) 2024-09-21T15:09:01.041 INFO:teuthology.orchestra.run.smithi161.stdout:3325 writesame 0x388d826 thru 0x389348d data_size 0x4(0x5c68 bytes) 2024-09-21T15:09:01.069 INFO:teuthology.orchestra.run.smithi161.stdout:3327 writesame 0x9a556a1 thru 0x9a5d9c2 data_size 0x2d(0x8322 bytes) 2024-09-21T15:09:01.094 INFO:teuthology.orchestra.run.smithi161.stdout:3328 writesame 0x6f5126a thru 0x6f577f2 data_size 0x11(0x6589 bytes) 2024-09-21T15:09:01.128 INFO:teuthology.orchestra.run.smithi161.stdout:3329 trunc from 0xd24bc05 to 0x663e4bd 2024-09-21T15:09:01.185 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:01.185 INFO:teuthology.orchestra.run.smithi161.stdout:3331 punch from 0x15f8150 to 0x15fd595, (0x5445 bytes) 2024-09-21T15:09:01.256 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #23, image image_cluster1.client.mirror.4-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent24 2024-09-21T15:09:01.266 INFO:teuthology.orchestra.run.smithi161.stdout:3332 writesame 0xc290811 thru 0xc297b25 data_size 0x1(0x7315 bytes) 2024-09-21T15:09:01.276 INFO:teuthology.orchestra.run.smithi161.stdout:3334 write 0x602b0bd thru 0x6036c97 (0xbbdb bytes) 2024-09-21T15:09:01.324 INFO:teuthology.orchestra.run.smithi161.stdout:3337 writesame 0x4dbdbc7 thru 0x4dc7d7d data_size 0x1(0xa1b7 bytes) 2024-09-21T15:09:01.373 INFO:teuthology.orchestra.run.smithi161.stdout:3338 read 0x7d235ee thru 0x7d2ff4c (0xc95f bytes) 2024-09-21T15:09:01.397 INFO:teuthology.orchestra.run.smithi161.stdout:3339 trunc from 0xc297b26 to 0x23a0eee 2024-09-21T15:09:01.493 INFO:teuthology.orchestra.run.smithi161.stdout:3340 write 0x3599e6b thru 0x35a5f04 (0xc09a bytes) 2024-09-21T15:09:01.523 INFO:teuthology.orchestra.run.smithi161.stdout:3341 trunc from 0x35a5f05 to 0x2adbb6d 2024-09-21T15:09:01.545 INFO:teuthology.orchestra.run.smithi161.stdout:2956 read 0x65886e2 thru 0x6592945 (0xa264 bytes) 2024-09-21T15:09:01.564 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.560+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72d00 2024-09-21T15:09:01.564 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.560+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72dd0 2024-09-21T15:09:01.564 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.560+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72ea0 2024-09-21T15:09:01.564 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.560+0000 7ff753f07700 -1 reset not still connected to 0x56016ad41ee0 2024-09-21T15:09:01.564 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.560+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f450 2024-09-21T15:09:01.565 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.560+0000 7ff753f07700 -1 reset not still connected to 0x56016b24fee0 2024-09-21T15:09:01.565 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.560+0000 7ff753f07700 -1 reset not still connected to 0x56016bff6000 2024-09-21T15:09:01.572 INFO:teuthology.orchestra.run.smithi161.stdout:2957 write 0x583c2ae thru 0x5840f7a (0x4ccd bytes) 2024-09-21T15:09:01.603 INFO:teuthology.orchestra.run.smithi161.stdout:2958 trunc from 0x9d05d4c to 0x16a0c37 2024-09-21T15:09:01.633 INFO:teuthology.orchestra.run.smithi161.stdout:3342 write 0xba7cfe8 thru 0xba8c1b6 (0xf1cf bytes) 2024-09-21T15:09:01.674 INFO:teuthology.orchestra.run.smithi161.stdout:3343 write 0x4a10f2e thru 0x4a16980 (0x5a53 bytes) 2024-09-21T15:09:01.712 INFO:teuthology.orchestra.run.smithi161.stdout:3344 read 0x45c7de thru 0x46b607 (0xee2a bytes) 2024-09-21T15:09:01.712 INFO:teuthology.orchestra.run.smithi161.stdout:3345 read 0x403e8c3 thru 0x404d943 (0xf081 bytes) 2024-09-21T15:09:01.719 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #20, image image_cluster1.client.mirror.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent21 2024-09-21T15:09:01.758 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #16, image image_cluster1.client.mirror.1-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent17 2024-09-21T15:09:01.762 INFO:teuthology.orchestra.run.smithi161.stdout:2960 writesame 0x2968561 thru 0x29740c1 data_size 0x1(0xbb61 bytes) 2024-09-21T15:09:01.767 INFO:teuthology.orchestra.run.smithi161.stdout:3346 writesame 0xcf5977c thru 0xcf5cf21 data_size 0x11(0x37a6 bytes) 2024-09-21T15:09:01.768 INFO:teuthology.orchestra.run.smithi161.stdout:2961 read 0x52225e thru 0x526d76 (0x4b19 bytes) 2024-09-21T15:09:01.774 INFO:teuthology.orchestra.run.smithi161.stdout:3347 punch from 0xe3ce86 to 0xe4567c, (0x87f6 bytes) 2024-09-21T15:09:01.774 INFO:teuthology.orchestra.run.smithi161.stdout:3348 writesame 0xb981b87 thru 0xb985730 data_size 0x7(0x3baa bytes) 2024-09-21T15:09:01.787 INFO:teuthology.orchestra.run.smithi161.stdout:3417 write 0x666d517 thru 0x6672796 (0x5280 bytes) 2024-09-21T15:09:01.790 INFO:teuthology.orchestra.run.smithi161.stdout:2962 trunc from 0x29740c2 to 0xd846dde 2024-09-21T15:09:01.819 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:01.819 INFO:teuthology.orchestra.run.smithi161.stdout:3351 read 0x623f1ae thru 0x624a772 (0xb5c5 bytes) 2024-09-21T15:09:01.819 INFO:teuthology.orchestra.run.smithi161.stdout:3352 read 0xba42a01 thru 0xba47098 (0x4698 bytes) 2024-09-21T15:09:01.820 INFO:teuthology.orchestra.run.smithi161.stdout:3353 write 0x6938b thru 0x6c1b1 (0x2e27 bytes) 2024-09-21T15:09:01.834 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.828+0000 7ff753f07700 -1 reset not still connected to 0x560167cc5860 2024-09-21T15:09:01.836 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.832+0000 7ff753f07700 -1 reset not still connected to 0x5601687569c0 2024-09-21T15:09:01.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.832+0000 7ff753f07700 -1 reset not still connected to 0x560168756a90 2024-09-21T15:09:01.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.832+0000 7ff753f07700 -1 reset not still connected to 0x56016878a1a0 2024-09-21T15:09:01.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.832+0000 7ff753f07700 -1 reset not still connected to 0x56016878ab60 2024-09-21T15:09:01.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.832+0000 7ff753f07700 -1 reset not still connected to 0x56016878ac30 2024-09-21T15:09:01.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.832+0000 7ff753f07700 -1 reset not still connected to 0x56016878add0 2024-09-21T15:09:01.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.832+0000 7ff753f07700 -1 reset not still connected to 0x56016878b040 2024-09-21T15:09:01.838 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.836+0000 7ff753f07700 -1 reset not still connected to 0x56016878b110 2024-09-21T15:09:01.842 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.836+0000 7ff753f07700 -1 reset not still connected to 0x56016878b1e0 2024-09-21T15:09:01.842 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.836+0000 7ff753f07700 -1 reset not still connected to 0x56016878ba00 2024-09-21T15:09:01.843 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.836+0000 7ff753f07700 -1 reset not still connected to 0x56016878bc70 2024-09-21T15:09:01.843 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.836+0000 7ff753f07700 -1 reset not still connected to 0x560168802750 2024-09-21T15:09:01.843 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.836+0000 7ff753f07700 -1 reset not still connected to 0x5601688028f0 2024-09-21T15:09:01.845 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.840+0000 7ff753f07700 -1 reset not still connected to 0x560168803ee0 2024-09-21T15:09:01.845 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.840+0000 7ff753f07700 -1 reset not still connected to 0x560168d92340 2024-09-21T15:09:01.846 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.840+0000 7ff753f07700 -1 reset not still connected to 0x560168ff6dd0 2024-09-21T15:09:01.846 INFO:teuthology.orchestra.run.smithi161.stdout:2963 write 0xcc24279 thru 0xcc3030a (0xc092 bytes) 2024-09-21T15:09:01.846 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.840+0000 7ff753f07700 -1 reset not still connected to 0x5601692225b0 2024-09-21T15:09:01.846 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.840+0000 7ff753f07700 -1 reset not still connected to 0x5601692b52b0 2024-09-21T15:09:01.846 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.840+0000 7ff753f07700 -1 reset not still connected to 0x560169ec2dd0 2024-09-21T15:09:01.846 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.840+0000 7ff753f07700 -1 reset not still connected to 0x560169f10270 2024-09-21T15:09:01.847 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.840+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9c70 2024-09-21T15:09:01.847 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.840+0000 7ff753f07700 -1 reset not still connected to 0x56016a50b930 2024-09-21T15:09:01.847 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.840+0000 7ff753f07700 -1 reset not still connected to 0x56016a6df860 2024-09-21T15:09:01.847 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.840+0000 7ff753f07700 -1 reset not still connected to 0x56016a6dfa00 2024-09-21T15:09:01.848 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.844+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e64e0 2024-09-21T15:09:01.848 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.844+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6a90 2024-09-21T15:09:01.848 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.844+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e72b0 2024-09-21T15:09:01.848 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.844+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72d00 2024-09-21T15:09:01.848 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.844+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72dd0 2024-09-21T15:09:01.849 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.844+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72ea0 2024-09-21T15:09:01.849 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.844+0000 7ff753f07700 -1 reset not still connected to 0x56016b24fee0 2024-09-21T15:09:01.849 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:01.844+0000 7ff753f07700 -1 reset not still connected to 0x56016bff6000 2024-09-21T15:09:01.861 INFO:teuthology.orchestra.run.smithi161.stdout:3418 read 0xd0ce4c thru 0xd16b17 (0x9ccc bytes) 2024-09-21T15:09:01.862 INFO:teuthology.orchestra.run.smithi161.stdout:3420 write 0xc4a3569 thru 0xc4a58d9 (0x2371 bytes) 2024-09-21T15:09:01.868 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:01.868 INFO:teuthology.orchestra.run.smithi161.stdout:2965 read 0x17e6d53 thru 0x17ec49e (0x574c bytes) 2024-09-21T15:09:01.869 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:01.873 INFO:teuthology.orchestra.run.smithi161.stdout:2967 trunc from 0xd846dde to 0xb89b891 2024-09-21T15:09:01.882 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:01.882 INFO:teuthology.orchestra.run.smithi161.stdout:3422 punch from 0x3a8f73 to 0x3ad67e, (0x470b bytes) 2024-09-21T15:09:01.882 INFO:teuthology.orchestra.run.smithi161.stdout:3354 write 0xd6f52b7 thru 0xd700359 (0xb0a3 bytes) 2024-09-21T15:09:01.905 INFO:teuthology.orchestra.run.smithi161.stdout:3424 trunc from 0xe2af11c to 0x3644123 2024-09-21T15:09:01.938 INFO:teuthology.orchestra.run.smithi161.stdout:2968 punch from 0xab2c6b to 0xab607b, (0x3410 bytes) 2024-09-21T15:09:01.938 INFO:teuthology.orchestra.run.smithi161.stdout:2969 read 0x6b2a8b2 thru 0x6b33ced (0x943c bytes) 2024-09-21T15:09:01.967 INFO:teuthology.orchestra.run.smithi161.stdout:3355 trunc from 0xd70035a to 0xb7e207 2024-09-21T15:09:01.972 INFO:teuthology.orchestra.run.smithi161.stdout:2971 write 0xed417ca thru 0xed468f5 (0x512c bytes) 2024-09-21T15:09:01.995 INFO:teuthology.orchestra.run.smithi161.stdout:2972 punch from 0x3188931 to 0x318a698, (0x1d67 bytes) 2024-09-21T15:09:01.995 INFO:teuthology.orchestra.run.smithi161.stdout:2975 read 0xaf7e58e thru 0xaf80006 (0x1a79 bytes) 2024-09-21T15:09:01.996 INFO:teuthology.orchestra.run.smithi161.stdout:2976 punch from 0x54f232d to 0x54fa7de, (0x84b1 bytes) 2024-09-21T15:09:01.996 INFO:teuthology.orchestra.run.smithi161.stdout:2978 write 0xaabc45d thru 0xaac9c87 (0xd82b bytes) 2024-09-21T15:09:02.024 INFO:teuthology.orchestra.run.smithi161.stdout:2979 writesame 0x3e2767f thru 0x3e33b34 data_size 0x2a(0xc4b6 bytes) 2024-09-21T15:09:02.042 INFO:teuthology.orchestra.run.smithi161.stdout:2981 writesame 0xc85584f thru 0xc860b5f data_size 0x1(0xb311 bytes) 2024-09-21T15:09:02.058 INFO:teuthology.orchestra.run.smithi161.stdout:3425 write 0x3d8bcdc thru 0x3d95c5d (0x9f82 bytes) 2024-09-21T15:09:02.081 INFO:teuthology.orchestra.run.smithi161.stdout:3356 trunc from 0xb7e207 to 0xabef194 2024-09-21T15:09:02.086 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #21, image image_cluster1.client.mirror.2-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent22 2024-09-21T15:09:02.099 INFO:teuthology.orchestra.run.smithi161.stdout:3426 punch from 0x251c626 to 0x252190e, (0x52e8 bytes) 2024-09-21T15:09:02.103 INFO:teuthology.orchestra.run.smithi161.stdout:2982 read 0x4c3849f thru 0x4c3fa97 (0x75f9 bytes) 2024-09-21T15:09:02.103 INFO:teuthology.orchestra.run.smithi161.stdout:2984 punch from 0x6fe7241 to 0x6ff63c1, (0xf180 bytes) 2024-09-21T15:09:02.103 INFO:teuthology.orchestra.run.smithi161.stdout:2985 read 0x36fbcb6 thru 0x3708885 (0xcbd0 bytes) 2024-09-21T15:09:02.103 INFO:teuthology.orchestra.run.smithi161.stdout:2988 read 0x56dface thru 0x56dffef (0x522 bytes) 2024-09-21T15:09:02.103 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.104 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.107 INFO:teuthology.orchestra.run.smithi161.stdout:2993 trunc from 0xed468f6 to 0xde416f8 2024-09-21T15:09:02.158 INFO:teuthology.orchestra.run.smithi161.stdout:3357 writesame 0xbb2cf96 thru 0xbb32d3d data_size 0x51(0x5da8 bytes) 2024-09-21T15:09:02.162 INFO:teuthology.orchestra.run.smithi161.stdout:3359 read 0xa2085db thru 0xa20c809 (0x422f bytes) 2024-09-21T15:09:02.162 INFO:teuthology.orchestra.run.smithi161.stdout:3362 punch from 0x5c35039 to 0x5c43c72, (0xec39 bytes) 2024-09-21T15:09:02.162 INFO:teuthology.orchestra.run.smithi161.stdout:3364 punch from 0x330b6db to 0x3310731, (0x5056 bytes) 2024-09-21T15:09:02.164 INFO:teuthology.orchestra.run.smithi161.stdout:3365 trunc from 0xbb32d3e to 0xa77365f 2024-09-21T15:09:02.165 INFO:teuthology.orchestra.run.smithi161.stdout:3427 write 0x96267ad thru 0x9631fe6 (0xb83a bytes) 2024-09-21T15:09:02.168 INFO:teuthology.orchestra.run.smithi161.stdout:2994 write 0x3a89ba7 thru 0x3a8c9fe (0x2e58 bytes) 2024-09-21T15:09:02.172 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #29, image image_cluster1.client.mirror.3-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent30 2024-09-21T15:09:02.182 INFO:teuthology.orchestra.run.smithi161.stdout:2997 write 0xdb59509 thru 0xdb68946 (0xf43e bytes) 2024-09-21T15:09:02.194 INFO:teuthology.orchestra.run.smithi161.stdout:3429 writesame 0x42e1752 thru 0x42e18c7 data_size 0x2(0x176 bytes) 2024-09-21T15:09:02.201 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.201 INFO:teuthology.orchestra.run.smithi161.stdout:2999 read 0xd0c4209 thru 0xd0c6f3f (0x2d37 bytes) 2024-09-21T15:09:02.202 INFO:teuthology.orchestra.run.smithi161.stdout:3000 read 0xaf05b0c thru 0xaf14e41 (0xf336 bytes) 2024-09-21T15:09:02.202 INFO:teuthology.orchestra.run.smithi161.stdout:3002 write 0x7ac2f75 thru 0x7acda58 (0xaae4 bytes) 2024-09-21T15:09:02.206 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.207 INFO:teuthology.orchestra.run.smithi161.stdout:3431 punch from 0x5c8750b to 0x5c950bb, (0xdbb0 bytes) 2024-09-21T15:09:02.207 INFO:teuthology.orchestra.run.smithi161.stdout:3432 read 0x2ad015e thru 0x2addceb (0xdb8e bytes) 2024-09-21T15:09:02.207 INFO:teuthology.orchestra.run.smithi161.stdout:3433 writesame 0x1b785a8 thru 0x1b79a5b data_size 0xa(0x14b4 bytes) 2024-09-21T15:09:02.221 INFO:teuthology.orchestra.run.smithi161.stdout:3003 trunc from 0xde416f8 to 0xd305fa1 2024-09-21T15:09:02.223 INFO:teuthology.orchestra.run.smithi161.stdout:3434 read 0x2528706 thru 0x25321c8 (0x9ac3 bytes) 2024-09-21T15:09:02.226 INFO:teuthology.orchestra.run.smithi161.stdout:3436 trunc from 0x9631fe7 to 0xa128145 2024-09-21T15:09:02.241 INFO:teuthology.orchestra.run.smithi161.stdout:3366 writesame 0xbb25277 thru 0xbb2d8d6 data_size 0x64(0x8660 bytes) 2024-09-21T15:09:02.245 INFO:teuthology.orchestra.run.smithi161.stdout:3367 read 0x2f6dac1 thru 0x2f6db0c (0x4c bytes) 2024-09-21T15:09:02.246 INFO:teuthology.orchestra.run.smithi161.stdout:3369 read 0x1d4c06f thru 0x1d4f081 (0x3013 bytes) 2024-09-21T15:09:02.246 INFO:teuthology.orchestra.run.smithi161.stdout:3370 write 0xb69f483 thru 0xb6ac9ef (0xd56d bytes) 2024-09-21T15:09:02.248 INFO:teuthology.orchestra.run.smithi161.stdout:2591 write 0x9681a4a thru 0x968d524 (0xbadb bytes) 2024-09-21T15:09:02.267 INFO:teuthology.orchestra.run.smithi161.stdout:3437 read 0xa54832 thru 0xa5fb37 (0xb306 bytes) 2024-09-21T15:09:02.278 INFO:teuthology.orchestra.run.smithi161.stdout:3004 writesame 0x3460129 thru 0x34667f8 data_size 0x38(0x66d0 bytes) 2024-09-21T15:09:02.307 INFO:teuthology.orchestra.run.smithi161.stdout:3005 trunc from 0xd305fa1 to 0xa57ca0c 2024-09-21T15:09:02.307 INFO:teuthology.orchestra.run.smithi161.stdout:3438 write 0xa847663 thru 0xa84a9a8 (0x3346 bytes) 2024-09-21T15:09:02.309 INFO:teuthology.orchestra.run.smithi161.stdout:2593 write 0xfd6e62 thru 0xfe502b (0xe1ca bytes) 2024-09-21T15:09:02.314 INFO:teuthology.orchestra.run.smithi161.stdout:3314 trunc from 0xe3d7e6d to 0x835e4ea 2024-09-21T15:09:02.330 INFO:teuthology.orchestra.run.smithi161.stdout:3440 punch from 0x75f4ac2 to 0x75fce5d, (0x839b bytes) 2024-09-21T15:09:02.330 INFO:teuthology.orchestra.run.smithi161.stdout:3441 read 0x98674a0 thru 0x986fefc (0x8a5d bytes) 2024-09-21T15:09:02.331 INFO:teuthology.orchestra.run.smithi161.stdout:3442 write 0x5c33b52 thru 0x5c3bd55 (0x8204 bytes) 2024-09-21T15:09:02.337 INFO:teuthology.orchestra.run.smithi161.stdout:2594 read 0xca1612f thru 0xca1d856 (0x7728 bytes) 2024-09-21T15:09:02.339 INFO:teuthology.orchestra.run.smithi161.stdout:2595 trunc from 0xdb2581c to 0xcdf1efe 2024-09-21T15:09:02.344 INFO:teuthology.orchestra.run.smithi161.stdout:3371 writesame 0xcb7a50f thru 0xcb820f3 data_size 0x17(0x7be5 bytes) 2024-09-21T15:09:02.350 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.350 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.351 INFO:teuthology.orchestra.run.smithi161.stdout:3374 read 0x20b5a7e thru 0x20c5539 (0xfabc bytes) 2024-09-21T15:09:02.351 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.351 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.351 INFO:teuthology.orchestra.run.smithi161.stdout:3377 read 0x30728f2 thru 0x3074abe (0x21cd bytes) 2024-09-21T15:09:02.351 INFO:teuthology.orchestra.run.smithi161.stdout:3378 read 0x134c692 thru 0x1351979 (0x52e8 bytes) 2024-09-21T15:09:02.352 INFO:teuthology.orchestra.run.smithi161.stdout:3379 read 0x52964d thru 0x5310c2 (0x7a76 bytes) 2024-09-21T15:09:02.352 INFO:teuthology.orchestra.run.smithi161.stdout:3380 write 0x3a69ceb thru 0x3a76b00 (0xce16 bytes) 2024-09-21T15:09:02.356 INFO:teuthology.orchestra.run.smithi161.stdout:3444 read 0x266ff89 thru 0x26777a9 (0x7821 bytes) 2024-09-21T15:09:02.357 INFO:teuthology.orchestra.run.smithi161.stdout:3445 write 0x11b622c thru 0x11b803c (0x1e11 bytes) 2024-09-21T15:09:02.415 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.431 INFO:teuthology.orchestra.run.smithi161.stdout:3006 write 0xd5d421b thru 0xd5d6700 (0x24e6 bytes) 2024-09-21T15:09:02.457 INFO:teuthology.orchestra.run.smithi161.stdout:3007 read 0x7cfdcaf thru 0x7cfe8b2 (0xc04 bytes) 2024-09-21T15:09:02.457 INFO:teuthology.orchestra.run.smithi161.stdout:3008 punch from 0xb30c436 to 0xb311d59, (0x5923 bytes) 2024-09-21T15:09:02.474 INFO:teuthology.orchestra.run.smithi161.stdout:3010 trunc from 0xd5d6701 to 0x377f666 2024-09-21T15:09:02.481 INFO:teuthology.orchestra.run.smithi161.stdout:3381 read 0x162eb94 thru 0x1639921 (0xad8e bytes) 2024-09-21T15:09:02.481 INFO:teuthology.orchestra.run.smithi161.stdout:3382 read 0x8baffda thru 0x8bbde40 (0xde67 bytes) 2024-09-21T15:09:02.485 INFO:teuthology.orchestra.run.smithi161.stdout:3383 trunc from 0xcb820f4 to 0xb0b8a7c 2024-09-21T15:09:02.502 INFO:teuthology.orchestra.run.smithi161.stdout:3447 write 0xed5ad26 thru 0xed67a65 (0xcd40 bytes) 2024-09-21T15:09:02.518 INFO:teuthology.orchestra.run.smithi161.stdout:2596 read 0xade2327 thru 0xadece17 (0xaaf1 bytes) 2024-09-21T15:09:02.520 INFO:teuthology.orchestra.run.smithi161.stdout:2597 punch from 0x850372 to 0x8570ad, (0x6d3b bytes) 2024-09-21T15:09:02.527 INFO:teuthology.orchestra.run.smithi161.stdout:3448 write 0xdfbcec6 thru 0xdfc49d3 (0x7b0e bytes) 2024-09-21T15:09:02.538 INFO:teuthology.orchestra.run.smithi161.stdout:2598 trunc from 0xcdf1efe to 0x32f48c1 2024-09-21T15:09:02.554 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.555 INFO:teuthology.orchestra.run.smithi161.stdout:3450 read 0xe5c92d5 thru 0xe5d36be (0xa3ea bytes) 2024-09-21T15:09:02.555 INFO:teuthology.orchestra.run.smithi161.stdout:3451 writesame 0xd56fa6 thru 0xd63331 data_size 0xa(0xc38c bytes) 2024-09-21T15:09:02.555 INFO:teuthology.orchestra.run.smithi161.stdout:3315 read 0x1b65c23 thru 0x1b66070 (0x44e bytes) 2024-09-21T15:09:02.556 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.556 INFO:teuthology.orchestra.run.smithi161.stdout:3317 write 0x814ad8e thru 0x8159ade (0xed51 bytes) 2024-09-21T15:09:02.575 INFO:teuthology.orchestra.run.smithi161.stdout:3626 clone 24 order 22 su 2097152 sc 4 2024-09-21T15:09:02.629 INFO:teuthology.orchestra.run.smithi161.stdout:3385 write 0x743fbf8 thru 0x7441f44 (0x234d bytes) 2024-09-21T15:09:02.651 INFO:teuthology.orchestra.run.smithi161.stdout:3318 punch from 0x5d7c5ae to 0x5d83c72, (0x76c4 bytes) 2024-09-21T15:09:02.651 INFO:teuthology.orchestra.run.smithi161.stdout:3319 writesame 0x53aa091 thru 0x53b130f data_size 0x1(0x727f bytes) 2024-09-21T15:09:02.661 INFO:teuthology.orchestra.run.smithi161.stdout:2599 punch from 0x741421 to 0x7466e0, (0x52bf bytes) 2024-09-21T15:09:02.673 INFO:teuthology.orchestra.run.smithi161.stdout:3011 write 0x4dc14c8 thru 0x4dc7b15 (0x664e bytes) 2024-09-21T15:09:02.687 INFO:teuthology.orchestra.run.smithi161.stdout:3453 writesame 0x4753db7 thru 0x47545ee data_size 0x4(0x838 bytes) 2024-09-21T15:09:02.704 INFO:teuthology.orchestra.run.smithi161.stdout:3012 trunc from 0x4dc7b16 to 0x320da95 2024-09-21T15:09:02.705 INFO:teuthology.orchestra.run.smithi161.stdout:3454 write 0xc42855 thru 0xc48d21 (0x64cd bytes) 2024-09-21T15:09:02.706 INFO:teuthology.orchestra.run.smithi161.stdout:3386 read 0x70e733a thru 0x70eb12b (0x3df2 bytes) 2024-09-21T15:09:02.706 INFO:teuthology.orchestra.run.smithi161.stdout:3387 writesame 0x5ff8dc8 thru 0x6002492 data_size 0x1(0x96cb bytes) 2024-09-21T15:09:02.709 INFO:teuthology.orchestra.run.smithi161.stdout:2600 writesame 0x8358be7 thru 0x83640d9 data_size 0x3(0xb4f3 bytes) 2024-09-21T15:09:02.729 INFO:teuthology.orchestra.run.smithi161.stdout:2601 punch from 0x4181efb to 0x4184ca8, (0x2dad bytes) 2024-09-21T15:09:02.741 INFO:teuthology.orchestra.run.smithi161.stdout:2602 trunc from 0x83640da to 0x2c3ca26 2024-09-21T15:09:02.747 INFO:teuthology.orchestra.run.smithi161.stdout:3320 read 0x2c31ad1 thru 0x2c337bc (0x1cec bytes) 2024-09-21T15:09:02.751 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.751 INFO:teuthology.orchestra.run.smithi161.stdout:3322 punch from 0x6f3de19 to 0x6f4bf48, (0xe12f bytes) 2024-09-21T15:09:02.751 INFO:teuthology.orchestra.run.smithi161.stdout:3323 punch from 0x61c35c9 to 0x61cf2cc, (0xbd03 bytes) 2024-09-21T15:09:02.758 INFO:teuthology.orchestra.run.smithi161.stdout:3325 trunc from 0x835e4ea to 0x4b45902 2024-09-21T15:09:02.768 INFO:teuthology.orchestra.run.smithi161.stdout:3388 read 0x8d499b5 thru 0x8d55bfc (0xc248 bytes) 2024-09-21T15:09:02.768 INFO:teuthology.orchestra.run.smithi161.stdout:3455 clone 23 order 25 su 8388608 sc 13 2024-09-21T15:09:02.768 INFO:teuthology.orchestra.run.smithi161.stdout:3389 writesame 0x27d7f44 thru 0x27da4f6 data_size 0x1(0x25b3 bytes) 2024-09-21T15:09:02.797 INFO:teuthology.orchestra.run.smithi161.stdout:3390 write 0x75a308b thru 0x75a8fe8 (0x5f5e bytes) 2024-09-21T15:09:02.810 INFO:teuthology.orchestra.run.smithi161.stdout:2603 read 0x7ec5f5 thru 0x7fab18 (0xe524 bytes) 2024-09-21T15:09:02.813 INFO:teuthology.orchestra.run.smithi161.stdout:2604 read 0x29a25da thru 0x29a49b4 (0x23db bytes) 2024-09-21T15:09:02.843 INFO:teuthology.orchestra.run.smithi161.stdout:2605 read 0xf25b1d thru 0xf2820e (0x26f2 bytes) 2024-09-21T15:09:02.843 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.844 INFO:teuthology.orchestra.run.smithi161.stdout:3391 write 0x1cb5184 thru 0x1cbc613 (0x7490 bytes) 2024-09-21T15:09:02.855 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.855 INFO:teuthology.orchestra.run.smithi161.stdout:3014 read 0xc15dc5 thru 0xc1e6a7 (0x88e3 bytes) 2024-09-21T15:09:02.856 INFO:teuthology.orchestra.run.smithi161.stdout:3015 punch from 0x8753f9 to 0x876bba, (0x17c1 bytes) 2024-09-21T15:09:02.856 INFO:teuthology.orchestra.run.smithi161.stdout:3016 read 0x20195ed thru 0x2026a1b (0xd42f bytes) 2024-09-21T15:09:02.856 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:02.857 INFO:teuthology.orchestra.run.smithi161.stdout:3019 read 0x259cf89 thru 0x25aa3aa (0xd422 bytes) 2024-09-21T15:09:02.975 INFO:teuthology.orchestra.run.smithi161.stdout:3021 write 0xdcafb63 thru 0xdcb3c7a (0x4118 bytes) 2024-09-21T15:09:02.981 INFO:teuthology.orchestra.run.smithi161.stdout:2609 writesame 0xa0ae708 thru 0xa0bc66b data_size 0x22(0xdf64 bytes) 2024-09-21T15:09:03.000 INFO:teuthology.orchestra.run.smithi161.stdout:3025 write 0x1bedf37 thru 0x1bf9acd (0xbb97 bytes) 2024-09-21T15:09:03.033 INFO:teuthology.orchestra.run.smithi161.stdout:3026 flatten 2024-09-21T15:09:03.065 INFO:teuthology.orchestra.run.smithi161.stdout:3393 writesame 0xcf4dec8 thru 0xcf53073 data_size 0x2(0x51ac bytes) 2024-09-21T15:09:03.066 INFO:teuthology.orchestra.run.smithi161.stdout:2611 write 0xd4982d2 thru 0xd49bf1f (0x3c4e bytes) 2024-09-21T15:09:03.074 INFO:teuthology.orchestra.run.smithi161.stdout:3394 read 0x5655df7 thru 0x565de51 (0x805b bytes) 2024-09-21T15:09:03.074 INFO:teuthology.orchestra.run.smithi161.stdout:3395 write 0xffc13b thru 0x1005549 (0x940f bytes) 2024-09-21T15:09:03.086 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:03.087 INFO:teuthology.orchestra.run.smithi161.stdout:2613 read 0x7f184e0 thru 0x7f20809 (0x832a bytes) 2024-09-21T15:09:03.109 INFO:teuthology.orchestra.run.smithi161.stdout:3326 read 0x86e5c0 thru 0x87bcc5 (0xd706 bytes) 2024-09-21T15:09:03.110 INFO:teuthology.orchestra.run.smithi161.stdout:3327 read 0x1440c46 thru 0x144fedb (0xf296 bytes) 2024-09-21T15:09:03.112 INFO:teuthology.orchestra.run.smithi161.stdout:3329 punch from 0x97ff39 to 0x98da9a, (0xdb61 bytes) 2024-09-21T15:09:03.121 INFO:teuthology.orchestra.run.smithi161.stdout:3331 trunc from 0x4b45902 to 0x3c7489 2024-09-21T15:09:03.123 INFO:teuthology.orchestra.run.smithi161.stdout:3027 write 0x8973ba thru 0x89ec77 (0x78be bytes) 2024-09-21T15:09:03.124 INFO:teuthology.orchestra.run.smithi161.stdout:3396 write 0x2dd5472 thru 0x2ddeb02 (0x9691 bytes) 2024-09-21T15:09:03.137 INFO:teuthology.orchestra.run.smithi161.stdout:2615 trunc from 0xd49bf20 to 0x3461846 2024-09-21T15:09:03.143 INFO:teuthology.orchestra.run.smithi161.stdout:3029 write 0xda6357 thru 0xdb2282 (0xbf2c bytes) 2024-09-21T15:09:03.159 INFO:teuthology.orchestra.run.smithi161.stdout:3030 read 0x7b33a60 thru 0x7b33add (0x7e bytes) 2024-09-21T15:09:03.159 INFO:teuthology.orchestra.run.smithi161.stdout:3031 read 0xc516638 thru 0xc5167ea (0x1b3 bytes) 2024-09-21T15:09:03.159 INFO:teuthology.orchestra.run.smithi161.stdout:3032 writesame 0x865338b thru 0x8653520 data_size 0x2(0x196 bytes) 2024-09-21T15:09:03.178 INFO:teuthology.orchestra.run.smithi161.stdout:3398 punch from 0x15ef2b8 to 0x15f2657, (0x339f bytes) 2024-09-21T15:09:03.178 INFO:teuthology.orchestra.run.smithi161.stdout:3400 read 0xa97afa9 thru 0xa9856d8 (0xa730 bytes) 2024-09-21T15:09:03.179 INFO:teuthology.orchestra.run.smithi161.stdout:3034 write 0xac9f00f thru 0xac9ff6c (0xf5e bytes) 2024-09-21T15:09:03.188 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:03.196 INFO:teuthology.orchestra.run.smithi161.stdout:3035 read 0xd522c83 thru 0xd52d0be (0xa43c bytes) 2024-09-21T15:09:03.196 INFO:teuthology.orchestra.run.smithi161.stdout:3037 punch from 0x12d7a04 to 0x12dc4b4, (0x4ab0 bytes) 2024-09-21T15:09:03.196 INFO:teuthology.orchestra.run.smithi161.stdout:3038 write 0x3752ee5 thru 0x3761f92 (0xf0ae bytes) 2024-09-21T15:09:03.205 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:03.200+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cbdb6780 handle_clone_image: failed to clone image mirror/10ada6426906 to image_cluster1.client.mirror.2-clone23 2024-09-21T15:09:03.210 INFO:teuthology.orchestra.run.smithi161.stdout:3039 writesame 0x49a01cc thru 0x49af53d data_size 0x33(0xf372 bytes) 2024-09-21T15:09:03.211 INFO:teuthology.orchestra.run.smithi161.stdout:2617 read 0x2775bf5 thru 0x278038d (0xa799 bytes) 2024-09-21T15:09:03.212 INFO:teuthology.orchestra.run.smithi161.stdout:2618 read 0xdf3e thru 0x1896e (0xaa31 bytes) 2024-09-21T15:09:03.214 INFO:teuthology.orchestra.run.smithi161.stdout:2619 punch from 0x1e046cf to 0x1e06ba1, (0x24d2 bytes) 2024-09-21T15:09:03.214 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:03.212+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cd2b4780 handle_clone_image: failed to clone image mirror/10b4682885a3 to image_cluster1.client.mirror.3-clone31 2024-09-21T15:09:03.221 INFO:teuthology.orchestra.run.smithi161.stdout:3401 writesame 0xd6b60ab thru 0xd6c2ecd data_size 0x1(0xce23 bytes) 2024-09-21T15:09:03.223 INFO:teuthology.orchestra.run.smithi161.stdout:3040 read 0x4d37d48 thru 0x4d4305d (0xb316 bytes) 2024-09-21T15:09:03.227 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:03.227 INFO:teuthology.orchestra.run.smithi161.stdout:3403 write 0x8e6638e thru 0x8e73cb3 (0xd926 bytes) 2024-09-21T15:09:03.228 INFO:teuthology.orchestra.run.smithi161.stdout:3041 trunc from 0xdcb3c7b to 0xbeff7c4 2024-09-21T15:09:03.239 INFO:teuthology.orchestra.run.smithi161.stdout:3334 write 0xd489dff thru 0xd495f62 (0xc164 bytes) 2024-09-21T15:09:03.259 INFO:teuthology.orchestra.run.smithi161.stdout:2620 write 0xb030171 thru 0xb030b4d (0x9dd bytes) 2024-09-21T15:09:03.261 INFO:teuthology.orchestra.run.smithi161.stdout:3404 writesame 0x7e0f60b thru 0x7e13df8 data_size 0x16(0x47ee bytes) 2024-09-21T15:09:03.269 INFO:teuthology.orchestra.run.smithi161.stdout:3335 trunc from 0xd495f63 to 0xa79b7c3 2024-09-21T15:09:03.272 INFO:teuthology.orchestra.run.smithi161.stdout:2622 write 0x20ab613 thru 0x20b0f3f (0x592d bytes) 2024-09-21T15:09:03.284 INFO:teuthology.orchestra.run.smithi161.stdout:3042 read 0xa42ad90 thru 0xa430b48 (0x5db9 bytes) 2024-09-21T15:09:03.284 INFO:teuthology.orchestra.run.smithi161.stdout:3043 punch from 0x51ec9f3 to 0x51ecf88, (0x595 bytes) 2024-09-21T15:09:03.290 INFO:teuthology.orchestra.run.smithi161.stdout:3044 trunc from 0xbeff7c4 to 0xec7c9f7 2024-09-21T15:09:03.294 INFO:teuthology.orchestra.run.smithi161.stdout:2623 writesame 0x9c90fda thru 0x9c9147e data_size 0x1(0x4a5 bytes) 2024-09-21T15:09:03.296 INFO:teuthology.orchestra.run.smithi161.stdout:3405 writesame 0x8eab2fb thru 0x8eae0e8 data_size 0x1(0x2dee bytes) 2024-09-21T15:09:03.310 INFO:teuthology.orchestra.run.smithi161.stdout:2625 punch from 0x59c1af8 to 0x59cbc56, (0xa15e bytes) 2024-09-21T15:09:03.310 INFO:teuthology.orchestra.run.smithi161.stdout:2626 write 0x1511603 thru 0x1516869 (0x5267 bytes) 2024-09-21T15:09:03.316 INFO:teuthology.orchestra.run.smithi161.stdout:3406 read 0x3fe6c01 thru 0x3fead75 (0x4175 bytes) 2024-09-21T15:09:03.320 INFO:teuthology.orchestra.run.smithi161.stdout:3408 trunc from 0xd6c2ece to 0xc0a18bb 2024-09-21T15:09:03.329 INFO:teuthology.orchestra.run.smithi161.stdout:2627 read 0x6079117 thru 0x60795f6 (0x4e0 bytes) 2024-09-21T15:09:03.330 INFO:teuthology.orchestra.run.smithi161.stdout:2628 write 0x5d518f3 thru 0x5d5c831 (0xaf3f bytes) 2024-09-21T15:09:03.337 INFO:teuthology.orchestra.run.smithi161.stdout:3045 read 0x4460a1e thru 0x446bee0 (0xb4c3 bytes) 2024-09-21T15:09:03.337 INFO:teuthology.orchestra.run.smithi161.stdout:3046 write 0x2b6c479 thru 0x2b7bebf (0xfa47 bytes) 2024-09-21T15:09:03.341 INFO:teuthology.orchestra.run.smithi161.stdout:2629 punch from 0x866c75 to 0x86999d, (0x2d28 bytes) 2024-09-21T15:09:03.341 INFO:teuthology.orchestra.run.smithi161.stdout:2630 read 0x973ded2 thru 0x973df98 (0xc7 bytes) 2024-09-21T15:09:03.342 INFO:teuthology.orchestra.run.smithi161.stdout:2631 writesame 0x9f25fd3 thru 0x9f34c18 data_size 0x33(0xec46 bytes) 2024-09-21T15:09:03.343 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:03.358 INFO:teuthology.orchestra.run.smithi161.stdout:3047 write 0xbe08ef1 thru 0xbe17388 (0xe498 bytes) 2024-09-21T15:09:03.365 INFO:teuthology.orchestra.run.smithi161.stdout:2633 trunc from 0xb030b4e to 0xec265ca 2024-09-21T15:09:03.368 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:03.368 INFO:teuthology.orchestra.run.smithi161.stdout:3410 read 0x15965b8 thru 0x159663c (0x85 bytes) 2024-09-21T15:09:03.368 INFO:teuthology.orchestra.run.smithi161.stdout:3412 write 0x596128e thru 0x5966571 (0x52e4 bytes) 2024-09-21T15:09:03.375 INFO:teuthology.orchestra.run.smithi161.stdout:3048 read 0xb0df9ef thru 0xb0e5d9c (0x63ae bytes) 2024-09-21T15:09:03.375 INFO:teuthology.orchestra.run.smithi161.stdout:3049 writesame 0xc4f5fd0 thru 0xc4f7109 data_size 0x31(0x113a bytes) 2024-09-21T15:09:03.376 INFO:teuthology.orchestra.run.smithi161.stdout:3337 write 0xc84a958 thru 0xc84de33 (0x34dc bytes) 2024-09-21T15:09:03.388 INFO:teuthology.orchestra.run.smithi161.stdout:3338 read 0xbf1bb80 thru 0xbf29a5a (0xdedb bytes) 2024-09-21T15:09:03.390 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:03.390 INFO:teuthology.orchestra.run.smithi161.stdout:3054 write 0xacbafde thru 0xacc40b8 (0x90db bytes) 2024-09-21T15:09:03.398 INFO:teuthology.orchestra.run.smithi161.stdout:3339 trunc from 0xc84de34 to 0x8c22516 2024-09-21T15:09:03.398 INFO:teuthology.orchestra.run.smithi161.stdout:3413 write 0x529e66c thru 0x52a926d (0xac02 bytes) 2024-09-21T15:09:03.406 INFO:teuthology.orchestra.run.smithi161.stdout:2635 write 0x6d4e656 thru 0x6d4ee3a (0x7e5 bytes) 2024-09-21T15:09:03.406 INFO:teuthology.orchestra.run.smithi161.stdout:3056 write 0x9425440 thru 0x942aaa0 (0x5661 bytes) 2024-09-21T15:09:03.422 INFO:teuthology.orchestra.run.smithi161.stdout:2636 writesame 0x6209fe0 thru 0x6215c5b data_size 0x6(0xbc7c bytes) 2024-09-21T15:09:03.426 INFO:teuthology.orchestra.run.smithi161.stdout:3057 read 0x7f6e592 thru 0x7f6f649 (0x10b8 bytes) 2024-09-21T15:09:03.426 INFO:teuthology.orchestra.run.smithi161.stdout:3058 punch from 0x8e5238f to 0x8e5d3e8, (0xb059 bytes) 2024-09-21T15:09:03.426 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:03.426 INFO:teuthology.orchestra.run.smithi161.stdout:3060 punch from 0x84ffcf8 to 0x850b058, (0xb360 bytes) 2024-09-21T15:09:03.426 INFO:teuthology.orchestra.run.smithi161.stdout:3061 writesame 0xeb09510 thru 0xeb1789d data_size 0x49(0xe38e bytes) 2024-09-21T15:09:03.430 INFO:teuthology.orchestra.run.smithi161.stdout:3415 read 0x2789d68 thru 0x278c669 (0x2902 bytes) 2024-09-21T15:09:03.435 INFO:teuthology.orchestra.run.smithi161.stdout:3417 writesame 0xde3ab5 thru 0xdedc68 data_size 0x4f(0xa1b4 bytes) 2024-09-21T15:09:03.437 INFO:teuthology.orchestra.run.smithi161.stdout:2637 punch from 0xb49e562 to 0xb4a14c6, (0x2f64 bytes) 2024-09-21T15:09:03.437 INFO:teuthology.orchestra.run.smithi161.stdout:2638 clone 32 order 20 su 32768 sc 11 2024-09-21T15:09:03.447 INFO:teuthology.orchestra.run.smithi161.stdout:3062 write 0x4cdb0fa thru 0x4ce0649 (0x5550 bytes) 2024-09-21T15:09:03.467 INFO:teuthology.orchestra.run.smithi161.stdout:3340 punch from 0x1133366 to 0x113b50c, (0x81a6 bytes) 2024-09-21T15:09:03.467 INFO:teuthology.orchestra.run.smithi161.stdout:3341 punch from 0x5f9e7ca to 0x5fa7fbd, (0x97f3 bytes) 2024-09-21T15:09:03.467 INFO:teuthology.orchestra.run.smithi161.stdout:3343 write 0x747ca87 thru 0x7489b4d (0xd0c7 bytes) 2024-09-21T15:09:03.469 INFO:teuthology.orchestra.run.smithi161.stdout:3418 punch from 0x9a16c5c to 0x9a259b2, (0xed56 bytes) 2024-09-21T15:09:03.471 INFO:teuthology.orchestra.run.smithi161.stdout:3064 read 0xa65b0b7 thru 0xa65e460 (0x33aa bytes) 2024-09-21T15:09:03.471 INFO:teuthology.orchestra.run.smithi161.stdout:3065 writesame 0x522ab49 thru 0x52347b0 data_size 0x6e(0x9c68 bytes) 2024-09-21T15:09:03.490 INFO:teuthology.orchestra.run.smithi161.stdout:3419 trunc from 0xc0a18bb to 0x2bd158f 2024-09-21T15:09:03.510 INFO:teuthology.orchestra.run.smithi161.stdout:3067 trunc from 0xec7c9f7 to 0x2197700 2024-09-21T15:09:03.527 INFO:teuthology.orchestra.run.smithi161.stdout:3344 write 0x8f53f4e thru 0x8f61509 (0xd5bc bytes) 2024-09-21T15:09:03.559 INFO:teuthology.orchestra.run.smithi161.stdout:3347 punch from 0x8f4da3b to 0x8f5bdb0, (0xe375 bytes) 2024-09-21T15:09:03.559 INFO:teuthology.orchestra.run.smithi161.stdout:3348 punch from 0x40023b6 to 0x400712d, (0x4d77 bytes) 2024-09-21T15:09:03.559 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:03.584 INFO:teuthology.orchestra.run.smithi161.stdout:3069 read 0x140764e thru 0x1410a76 (0x9429 bytes) 2024-09-21T15:09:03.599 INFO:teuthology.orchestra.run.smithi161.stdout:3352 writesame 0xe2ccb98 thru 0xe2d65ad data_size 0x16(0x9a16 bytes) 2024-09-21T15:09:03.603 INFO:teuthology.orchestra.run.smithi161.stdout:3353 read 0x8a4c99b thru 0x8a52695 (0x5cfb bytes) 2024-09-21T15:09:03.604 INFO:teuthology.orchestra.run.smithi161.stdout:3355 writesame 0x5cd3c0b thru 0x5cdad1f data_size 0x1(0x7115 bytes) 2024-09-21T15:09:03.651 INFO:teuthology.orchestra.run.smithi161.stdout:3356 writesame 0x609f6d0 thru 0x60adc19 data_size 0x1b(0xe54a bytes) 2024-09-21T15:09:03.671 INFO:teuthology.orchestra.run.smithi161.stdout:3420 write 0xb3a436c thru 0xb3ad818 (0x94ad bytes) 2024-09-21T15:09:03.674 INFO:teuthology.orchestra.run.smithi161.stdout:3357 punch from 0x73d2ef5 to 0x73d5f8a, (0x3095 bytes) 2024-09-21T15:09:03.682 INFO:teuthology.orchestra.run.smithi161.stdout:3071 writesame 0xe7a0956 thru 0xe7a42a7 data_size 0x2e(0x3952 bytes) 2024-09-21T15:09:03.694 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:03.705 INFO:teuthology.orchestra.run.smithi161.stdout:3075 trunc from 0xe7a42a8 to 0xa19c888 2024-09-21T15:09:03.718 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:03.712+0000 7f1e9c77a700 -1 reset not still connected to 0x5628944b1450 2024-09-21T15:09:03.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:03.716+0000 7f1e9c77a700 -1 reset not still connected to 0x562894870d00 2024-09-21T15:09:03.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:03.716+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5380 2024-09-21T15:09:03.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:03.716+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5ad0 2024-09-21T15:09:03.723 INFO:teuthology.orchestra.run.smithi161.stdout:3421 read 0xa19eb4c thru 0xa1a4fbc (0x6471 bytes) 2024-09-21T15:09:03.723 INFO:teuthology.orchestra.run.smithi161.stdout:3422 read 0x3483324 thru 0x348e379 (0xb056 bytes) 2024-09-21T15:09:03.730 INFO:teuthology.orchestra.run.smithi161.stdout:3423 trunc from 0xb3ad819 to 0x89588a7 2024-09-21T15:09:03.735 INFO:teuthology.orchestra.run.smithi161.stdout:3358 write 0xec8f0cf thru 0xec9747d (0x83af bytes) 2024-09-21T15:09:03.767 INFO:teuthology.orchestra.run.smithi161.stdout:3359 write 0x40d00fc thru 0x40ddd41 (0xdc46 bytes) 2024-09-21T15:09:03.776 INFO:teuthology.orchestra.run.smithi161.stdout:3079 read 0x9adc1dd thru 0x9ae43f9 (0x821d bytes) 2024-09-21T15:09:03.776 INFO:teuthology.orchestra.run.smithi161.stdout:3081 read 0x77d7ac9 thru 0x77e24e3 (0xaa1b bytes) 2024-09-21T15:09:03.781 INFO:teuthology.orchestra.run.smithi161.stdout:3360 write 0xa05c86e thru 0xa05f23a (0x29cd bytes) 2024-09-21T15:09:03.795 INFO:teuthology.orchestra.run.smithi161.stdout:3364 write 0x9152ca9 thru 0x915974b (0x6aa3 bytes) 2024-09-21T15:09:03.805 INFO:teuthology.orchestra.run.smithi161.stdout:3425 write 0x19d8f8 thru 0x19e2d4 (0x9dd bytes) 2024-09-21T15:09:03.817 INFO:teuthology.orchestra.run.smithi161.stdout:3365 read 0x3cb1e16 thru 0x3cb3eec (0x20d7 bytes) 2024-09-21T15:09:03.818 INFO:teuthology.orchestra.run.smithi161.stdout:3367 write 0xb6d0d27 thru 0xb6d567e (0x4958 bytes) 2024-09-21T15:09:03.824 INFO:teuthology.orchestra.run.smithi161.stdout:3082 writesame 0xd6c7e45 thru 0xd6d1fb6 data_size 0x5(0xa172 bytes) 2024-09-21T15:09:03.832 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:03.832 INFO:teuthology.orchestra.run.smithi161.stdout:3370 writesame 0x8ba9e16 thru 0x8baf89c data_size 0x19(0x5a87 bytes) 2024-09-21T15:09:03.833 INFO:teuthology.orchestra.run.smithi161.stdout:3427 trunc from 0x89588a7 to 0xe036f28 2024-09-21T15:09:03.835 INFO:teuthology.orchestra.run.smithi161.stdout:3083 read 0x63c6227 thru 0x63cc50b (0x62e5 bytes) 2024-09-21T15:09:03.835 INFO:teuthology.orchestra.run.smithi161.stdout:3085 read 0xd2acb0 thru 0xd3a0e7 (0xf438 bytes) 2024-09-21T15:09:03.836 INFO:teuthology.orchestra.run.smithi161.stdout:3086 writesame 0x1ae11db thru 0x1ae752f data_size 0x1(0x6355 bytes) 2024-09-21T15:09:03.848 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:03.848 INFO:teuthology.orchestra.run.smithi161.stdout:3372 write 0xec345ec thru 0xec37d41 (0x3756 bytes) 2024-09-21T15:09:03.863 INFO:teuthology.orchestra.run.smithi161.stdout:3373 writesame 0x31c5c6b thru 0x31c6f25 data_size 0x7(0x12bb bytes) 2024-09-21T15:09:03.868 INFO:teuthology.orchestra.run.smithi161.stdout:3087 read 0xc5e7088 thru 0xc5f00ed (0x9066 bytes) 2024-09-21T15:09:03.871 INFO:teuthology.orchestra.run.smithi161.stdout:3375 punch from 0x4793750 to 0x4799f8f, (0x683f bytes) 2024-09-21T15:09:03.877 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:03.877 INFO:teuthology.orchestra.run.smithi161.stdout:3431 write 0x8393b8b thru 0x8393daa (0x220 bytes) 2024-09-21T15:09:03.893 INFO:teuthology.orchestra.run.smithi161.stdout:3432 read 0x1a03574 thru 0x1a0c963 (0x93f0 bytes) 2024-09-21T15:09:03.894 INFO:teuthology.orchestra.run.smithi161.stdout:3435 read 0x545edcc thru 0x546357e (0x47b3 bytes) 2024-09-21T15:09:03.894 INFO:teuthology.orchestra.run.smithi161.stdout:3436 write 0x32ef5d5 thru 0x32f2161 (0x2b8d bytes) 2024-09-21T15:09:03.894 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone23 from 0x6b7c014 (overlap 0x6b7c014) to 0x60bc678 2024-09-21T15:09:03.917 INFO:teuthology.orchestra.run.smithi161.stdout:3088 writesame 0xe42f5af thru 0xe43361e data_size 0x8(0x4070 bytes) 2024-09-21T15:09:03.923 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone31 from 0xec265ca (overlap 0x2c3ca26) to 0x1ef73e7 2024-09-21T15:09:03.923 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:03.939 INFO:teuthology.orchestra.run.smithi161.stdout:3376 write 0xecd8aa1 thru 0xecdd978 (0x4ed8 bytes) 2024-09-21T15:09:03.945 INFO:teuthology.orchestra.run.smithi161.stdout:3091 trunc from 0xe43361f to 0x7d7a062 2024-09-21T15:09:03.945 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone22 from 0xed67a66 (overlap 0x3644123) to 0x2b69a82 2024-09-21T15:09:03.964 INFO:teuthology.orchestra.run.smithi161.stdout:3437 punch from 0x7519484 to 0x7526980, (0xd4fc bytes) 2024-09-21T15:09:03.964 INFO:teuthology.orchestra.run.smithi161.stdout:3438 read 0xb88c232 thru 0xb8951bd (0x8f8c bytes) 2024-09-21T15:09:03.964 INFO:teuthology.orchestra.run.smithi161.stdout:3439 read 0xaef579e thru 0xaefe0c4 (0x8927 bytes) 2024-09-21T15:09:03.965 INFO:teuthology.orchestra.run.smithi161.stdout:3440 writesame 0x28c5bce thru 0x28cadb7 data_size 0x12(0x51ea bytes) 2024-09-21T15:09:03.974 INFO:teuthology.orchestra.run.smithi161.stdout:3377 write 0xd7bb08d thru 0xd7bd602 (0x2576 bytes) 2024-09-21T15:09:04.000 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.000 INFO:teuthology.orchestra.run.smithi161.stdout:3380 read 0xad70714 thru 0xad79abc (0x93a9 bytes) 2024-09-21T15:09:04.001 INFO:teuthology.orchestra.run.smithi161.stdout:3381 writesame 0x1b301af thru 0x1b30207 data_size 0x1(0x59 bytes) 2024-09-21T15:09:04.008 INFO:teuthology.orchestra.run.smithi161.stdout:3441 punch from 0xce44d86 to 0xce4dbf3, (0x8e6d bytes) 2024-09-21T15:09:04.008 INFO:teuthology.orchestra.run.smithi161.stdout:3442 writesame 0x68016b7 thru 0x680d24d data_size 0x1(0xbb97 bytes) 2024-09-21T15:09:04.014 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.014 INFO:teuthology.orchestra.run.smithi161.stdout:3095 write 0x61e1159 thru 0x61e316b (0x2013 bytes) 2024-09-21T15:09:04.019 INFO:teuthology.orchestra.run.smithi161.stdout:3382 write 0xe3b7aa4 thru 0xe3bef7c (0x74d9 bytes) 2024-09-21T15:09:04.051 INFO:teuthology.orchestra.run.smithi161.stdout:3098 trunc from 0x7d7a062 to 0xa758d72 2024-09-21T15:09:04.057 INFO:teuthology.orchestra.run.smithi161.stdout:3383 read 0x7d04ced thru 0x7d0d314 (0x8628 bytes) 2024-09-21T15:09:04.058 INFO:teuthology.orchestra.run.smithi161.stdout:3443 punch from 0x97c6213 to 0x97cf8f4, (0x96e1 bytes) 2024-09-21T15:09:04.058 INFO:teuthology.orchestra.run.smithi161.stdout:3444 punch from 0x9a10d40 to 0x9a1b882, (0xab42 bytes) 2024-09-21T15:09:04.059 INFO:teuthology.orchestra.run.smithi161.stdout:3446 writesame 0x7c43cc2 thru 0x7c4add1 data_size 0x9(0x7110 bytes) 2024-09-21T15:09:04.081 INFO:teuthology.orchestra.run.smithi161.stdout:3384 trunc from 0xecdd979 to 0xeea0b8 2024-09-21T15:09:04.101 INFO:teuthology.orchestra.run.smithi161.stdout:3447 writesame 0x410a143 thru 0x4111358 data_size 0x11(0x7216 bytes) 2024-09-21T15:09:04.104 INFO:teuthology.orchestra.run.smithi161.stdout:3099 punch from 0x3497b78 to 0x349cd55, (0x51dd bytes) 2024-09-21T15:09:04.104 INFO:teuthology.orchestra.run.smithi161.stdout:3100 writesame 0x689ac86 thru 0x689f264 data_size 0x1(0x45df bytes) 2024-09-21T15:09:04.138 INFO:teuthology.orchestra.run.smithi161.stdout:3448 read 0x990413f thru 0x9912ac4 (0xe986 bytes) 2024-09-21T15:09:04.163 INFO:teuthology.orchestra.run.smithi161.stdout:3449 punch from 0x40fdd9c to 0x410b88c, (0xdaf0 bytes) 2024-09-21T15:09:04.163 INFO:teuthology.orchestra.run.smithi161.stdout:3450 write 0x77ab765 thru 0x77ac06e (0x90a bytes) 2024-09-21T15:09:04.168 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #30, image image_cluster1.client.mirror.3-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent31 2024-09-21T15:09:04.170 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.170 INFO:teuthology.orchestra.run.smithi161.stdout:3453 read 0x48ba807 thru 0x48beac4 (0x42be bytes) 2024-09-21T15:09:04.170 INFO:teuthology.orchestra.run.smithi161.stdout:3456 write 0xcbf1111 thru 0xcbf7ca9 (0x6b99 bytes) 2024-09-21T15:09:04.182 INFO:teuthology.orchestra.run.smithi161.stdout:3101 writesame 0xa8357b6 thru 0xa83de8e data_size 0x25(0x86d9 bytes) 2024-09-21T15:09:04.186 INFO:teuthology.orchestra.run.smithi161.stdout:3103 read 0x4ea472c thru 0x4ea8670 (0x3f45 bytes) 2024-09-21T15:09:04.186 INFO:teuthology.orchestra.run.smithi161.stdout:3104 punch from 0x6d88edc to 0x6d8dd7c, (0x4ea0 bytes) 2024-09-21T15:09:04.186 INFO:teuthology.orchestra.run.smithi161.stdout:3105 read 0x7820ad1 thru 0x782754e (0x6a7e bytes) 2024-09-21T15:09:04.186 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #22, image image_cluster1.client.mirror.2-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent23 2024-09-21T15:09:04.201 INFO:teuthology.orchestra.run.smithi161.stdout:3457 write 0x4238488 thru 0x424761a (0xf193 bytes) 2024-09-21T15:09:04.203 INFO:teuthology.orchestra.run.smithi161.stdout:3106 trunc from 0xa83de8f to 0x3aa9e81 2024-09-21T15:09:04.236 INFO:teuthology.orchestra.run.smithi161.stdout:3458 punch from 0xaf4a285 to 0xaf4eec1, (0x4c3c bytes) 2024-09-21T15:09:04.236 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.236 INFO:teuthology.orchestra.run.smithi161.stdout:3460 writesame 0x15f0468 thru 0x15f3850 data_size 0x1(0x33e9 bytes) 2024-09-21T15:09:04.240 INFO:teuthology.orchestra.run.smithi161.stdout:3385 write 0x7afd4a8 thru 0x7b0a5fb (0xd154 bytes) 2024-09-21T15:09:04.264 INFO:teuthology.orchestra.run.smithi161.stdout:3108 writesame 0x1eeeea1 thru 0x1efa8e5 data_size 0x55(0xba45 bytes) 2024-09-21T15:09:04.268 INFO:teuthology.orchestra.run.smithi161.stdout:3387 writesame 0x5339b3 thru 0x541e48 data_size 0x9(0xe496 bytes) 2024-09-21T15:09:04.281 INFO:teuthology.orchestra.run.smithi161.stdout:3461 read 0x245c0d7 thru 0x246801f (0xbf49 bytes) 2024-09-21T15:09:04.281 INFO:teuthology.orchestra.run.smithi161.stdout:3463 read 0xb05c97e thru 0xb06c28a (0xf90d bytes) 2024-09-21T15:09:04.283 INFO:teuthology.orchestra.run.smithi161.stdout:3465 read 0xcc1bf3d thru 0xcc1f17b (0x323f bytes) 2024-09-21T15:09:04.283 INFO:teuthology.orchestra.run.smithi161.stdout:3109 read 0x3807a77 thru 0x38085b2 (0xb3c bytes) 2024-09-21T15:09:04.284 INFO:teuthology.orchestra.run.smithi161.stdout:3466 writesame 0x3a72b23 thru 0x3a7522e data_size 0x33(0x270c bytes) 2024-09-21T15:09:04.284 INFO:teuthology.orchestra.run.smithi161.stdout:3110 punch from 0x2f753c6 to 0x2f7b747, (0x6381 bytes) 2024-09-21T15:09:04.289 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.289 INFO:teuthology.orchestra.run.smithi161.stdout:3389 write 0x4e0f34a thru 0x4e13255 (0x3f0c bytes) 2024-09-21T15:09:04.303 INFO:teuthology.orchestra.run.smithi161.stdout:3390 read 0x73c3cf5 thru 0x73c4fc7 (0x12d3 bytes) 2024-09-21T15:09:04.314 INFO:teuthology.orchestra.run.smithi161.stdout:3391 trunc from 0x7b0a5fc to 0xe5d856e 2024-09-21T15:09:04.320 INFO:teuthology.orchestra.run.smithi161.stdout:3467 write 0x5633d27 thru 0x5643b43 (0xfe1d bytes) 2024-09-21T15:09:04.328 INFO:teuthology.orchestra.run.smithi161.stdout:3112 write 0x62d9838 thru 0x62e2ed8 (0x96a1 bytes) 2024-09-21T15:09:04.339 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #21, image image_cluster1.client.mirror.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent22 2024-09-21T15:09:04.348 INFO:teuthology.orchestra.run.smithi161.stdout:3113 writesame 0x890c89 thru 0x897a2f data_size 0x3(0x6da7 bytes) 2024-09-21T15:09:04.351 INFO:teuthology.orchestra.run.smithi161.stdout:3469 write 0x8c3de07 thru 0x8c3e2f6 (0x4f0 bytes) 2024-09-21T15:09:04.357 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.357 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.357 INFO:teuthology.orchestra.run.smithi161.stdout:3395 punch from 0x2041520 to 0x204c3e5, (0xaec5 bytes) 2024-09-21T15:09:04.357 INFO:teuthology.orchestra.run.smithi161.stdout:3396 write 0x2665705 thru 0x266d2af (0x7bab bytes) 2024-09-21T15:09:04.362 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.362 INFO:teuthology.orchestra.run.smithi161.stdout:3116 punch from 0x27dd2ca to 0x27e3748, (0x647e bytes) 2024-09-21T15:09:04.363 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.363 INFO:teuthology.orchestra.run.smithi161.stdout:3471 writesame 0xdc4dc08 thru 0xdc59e49 data_size 0x5(0xc242 bytes) 2024-09-21T15:09:04.365 INFO:teuthology.orchestra.run.smithi161.stdout:3397 write 0xd68a1c2 thru 0xd68aae5 (0x924 bytes) 2024-09-21T15:09:04.381 INFO:teuthology.orchestra.run.smithi161.stdout:3398 read 0xdc54667 thru 0xdc57bc9 (0x3563 bytes) 2024-09-21T15:09:04.381 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.391 INFO:teuthology.orchestra.run.smithi161.stdout:3473 write 0x59179bf thru 0x5922b0d (0xb14f bytes) 2024-09-21T15:09:04.398 INFO:teuthology.orchestra.run.smithi161.stdout:3400 trunc from 0xe5d856e to 0x510c0e4 2024-09-21T15:09:04.408 INFO:teuthology.orchestra.run.smithi161.stdout:3117 write 0x86d27f0 thru 0x86e0e85 (0xe696 bytes) 2024-09-21T15:09:04.429 INFO:teuthology.orchestra.run.smithi161.stdout:3476 read 0x248f586 thru 0x249c2b9 (0xcd34 bytes) 2024-09-21T15:09:04.430 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.430 INFO:teuthology.orchestra.run.smithi161.stdout:3478 read 0x779308b thru 0x7794f3f (0x1eb5 bytes) 2024-09-21T15:09:04.433 INFO:teuthology.orchestra.run.smithi161.stdout:3479 writesame 0x2d86a4b thru 0x2d8908d data_size 0x5(0x2643 bytes) 2024-09-21T15:09:04.434 INFO:teuthology.orchestra.run.smithi161.stdout:3118 write 0x8365f21 thru 0x836822c (0x230c bytes) 2024-09-21T15:09:04.457 INFO:teuthology.orchestra.run.smithi161.stdout:3119 trunc from 0x86e0e86 to 0x4e39afb 2024-09-21T15:09:04.462 INFO:teuthology.orchestra.run.smithi161.stdout:3403 punch from 0x1b6a4 to 0x271d6, (0xbb32 bytes) 2024-09-21T15:09:04.462 INFO:teuthology.orchestra.run.smithi161.stdout:3404 write 0x28a0af4 thru 0x28b049c (0xf9a9 bytes) 2024-09-21T15:09:04.466 INFO:teuthology.orchestra.run.smithi161.stdout:3481 write 0x510deb6 thru 0x510e11f (0x26a bytes) 2024-09-21T15:09:04.486 INFO:teuthology.orchestra.run.smithi161.stdout:3482 punch from 0xf5130d to 0xf5cf85, (0xbc78 bytes) 2024-09-21T15:09:04.486 INFO:teuthology.orchestra.run.smithi161.stdout:3483 write 0x19972c2 thru 0x19a3f51 (0xcc90 bytes) 2024-09-21T15:09:04.487 INFO:teuthology.orchestra.run.smithi161.stdout:3627 write 0x4764caf thru 0x47674d4 (0x2826 bytes) 2024-09-21T15:09:04.524 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.524 INFO:teuthology.orchestra.run.smithi161.stdout:3124 punch from 0x1745b74 to 0x174cfe7, (0x7473 bytes) 2024-09-21T15:09:04.524 INFO:teuthology.orchestra.run.smithi161.stdout:3125 write 0x1a2980b thru 0x1a2abfe (0x13f4 bytes) 2024-09-21T15:09:04.530 INFO:teuthology.orchestra.run.smithi161.stdout:3484 punch from 0x5c2f875 to 0x5c37d5c, (0x84e7 bytes) 2024-09-21T15:09:04.530 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.530 INFO:teuthology.orchestra.run.smithi161.stdout:3491 punch from 0x48e4ce1 to 0x48f2d4a, (0xe069 bytes) 2024-09-21T15:09:04.531 INFO:teuthology.orchestra.run.smithi161.stdout:3492 read 0x3042601 thru 0x3048ed4 (0x68d4 bytes) 2024-09-21T15:09:04.531 INFO:teuthology.orchestra.run.smithi161.stdout:3493 punch from 0xc1a8bbd to 0xc1aee71, (0x62b4 bytes) 2024-09-21T15:09:04.531 INFO:teuthology.orchestra.run.smithi161.stdout:3495 read 0xb791954 thru 0xb79b1a0 (0x984d bytes) 2024-09-21T15:09:04.532 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.532 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.532 INFO:teuthology.orchestra.run.smithi161.stdout:3500 write 0x9347250 thru 0x934890a (0x16bb bytes) 2024-09-21T15:09:04.538 INFO:teuthology.orchestra.run.smithi161.stdout:3126 read 0x21b3438 thru 0x21b7120 (0x3ce9 bytes) 2024-09-21T15:09:04.538 INFO:teuthology.orchestra.run.smithi161.stdout:3127 write 0x2c7af27 thru 0x2c7c541 (0x161b bytes) 2024-09-21T15:09:04.542 INFO:teuthology.orchestra.run.smithi161.stdout:3406 writesame 0xe5b4838 thru 0xe5bda15 data_size 0x1(0x91de bytes) 2024-09-21T15:09:04.543 INFO:teuthology.orchestra.run.smithi161.stdout:3628 punch from 0x222638c to 0x22322bf, (0xbf33 bytes) 2024-09-21T15:09:04.550 INFO:teuthology.orchestra.run.smithi161.stdout:3407 write 0x810655d thru 0x81137a4 (0xd248 bytes) 2024-09-21T15:09:04.560 INFO:teuthology.orchestra.run.smithi161.stdout:3501 write 0x1e2a1b0 thru 0x1e36877 (0xc6c8 bytes) 2024-09-21T15:09:04.577 INFO:teuthology.orchestra.run.smithi161.stdout:3408 write 0x9958723 thru 0x995e416 (0x5cf4 bytes) 2024-09-21T15:09:04.590 INFO:teuthology.orchestra.run.smithi161.stdout:3409 write 0x2f2f74 thru 0x3025c2 (0xf64f bytes) 2024-09-21T15:09:04.595 INFO:teuthology.orchestra.run.smithi161.stdout:3629 write 0x8703865 thru 0x870a4e1 (0x6c7d bytes) 2024-09-21T15:09:04.596 INFO:teuthology.orchestra.run.smithi161.stdout:3506 write 0xd778504 thru 0xd7797a5 (0x12a2 bytes) 2024-09-21T15:09:04.603 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.603 INFO:teuthology.orchestra.run.smithi161.stdout:3411 writesame 0xd8f9173 thru 0xd9011a4 data_size 0x3d(0x8032 bytes) 2024-09-21T15:09:04.606 INFO:teuthology.orchestra.run.smithi161.stdout:3128 write 0x758df4f thru 0x759903b (0xb0ed bytes) 2024-09-21T15:09:04.625 INFO:teuthology.orchestra.run.smithi161.stdout:3412 read 0x8feac81 thru 0x8fedaef (0x2e6f bytes) 2024-09-21T15:09:04.625 INFO:teuthology.orchestra.run.smithi161.stdout:3413 punch from 0x8ac9be6 to 0x8ad4435, (0xa84f bytes) 2024-09-21T15:09:04.625 INFO:teuthology.orchestra.run.smithi161.stdout:3416 write 0x32f1f thru 0x36ede (0x3fc0 bytes) 2024-09-21T15:09:04.628 INFO:teuthology.orchestra.run.smithi161.stdout:3508 read 0x621bd57 thru 0x621f75a (0x3a04 bytes) 2024-09-21T15:09:04.629 INFO:teuthology.orchestra.run.smithi161.stdout:3509 writesame 0x118d94f thru 0x11942f0 data_size 0x3(0x69a2 bytes) 2024-09-21T15:09:04.647 INFO:teuthology.orchestra.run.smithi161.stdout:3417 punch from 0xc8b7846 to 0xc8bb441, (0x3bfb bytes) 2024-09-21T15:09:04.648 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.648 INFO:teuthology.orchestra.run.smithi161.stdout:3419 write 0x56ccf4f thru 0x56d7db6 (0xae68 bytes) 2024-09-21T15:09:04.664 INFO:teuthology.orchestra.run.smithi161.stdout:3420 read 0x74d3226 thru 0x74e0bb7 (0xd992 bytes) 2024-09-21T15:09:04.665 INFO:teuthology.orchestra.run.smithi161.stdout:3421 write 0x6752706 thru 0x6753958 (0x1253 bytes) 2024-09-21T15:09:04.674 INFO:teuthology.orchestra.run.smithi161.stdout:3630 write 0xeca0986 thru 0xeca0e8e (0x509 bytes) 2024-09-21T15:09:04.687 INFO:teuthology.orchestra.run.smithi161.stdout:3422 flatten 2024-09-21T15:09:04.689 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.689 INFO:teuthology.orchestra.run.smithi161.stdout:3632 read 0xb23a601 thru 0xb23daa7 (0x34a7 bytes) 2024-09-21T15:09:04.689 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.689 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.689 INFO:teuthology.orchestra.run.smithi161.stdout:3636 read 0x42e1da0 thru 0x42e6216 (0x4477 bytes) 2024-09-21T15:09:04.690 INFO:teuthology.orchestra.run.smithi161.stdout:3129 write 0x852a981 thru 0x8539ea9 (0xf529 bytes) 2024-09-21T15:09:04.690 INFO:teuthology.orchestra.run.smithi161.stdout:3637 write 0x8553e68 thru 0x855dcac (0x9e45 bytes) 2024-09-21T15:09:04.692 INFO:teuthology.orchestra.run.smithi161.stdout:3510 write 0xe266822 thru 0xe26bc5d (0x543c bytes) 2024-09-21T15:09:04.712 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.712 INFO:teuthology.orchestra.run.smithi161.stdout:3640 punch from 0x7f4a545 to 0x7f56f4d, (0xca08 bytes) 2024-09-21T15:09:04.712 INFO:teuthology.orchestra.run.smithi161.stdout:3642 write 0x52b619d thru 0x52bf67e (0x94e2 bytes) 2024-09-21T15:09:04.716 INFO:teuthology.orchestra.run.smithi161.stdout:3131 read 0x3fa4477 thru 0x3fb2189 (0xdd13 bytes) 2024-09-21T15:09:04.724 INFO:teuthology.orchestra.run.smithi161.stdout:3133 trunc from 0x8539eaa to 0xba54cbd 2024-09-21T15:09:04.731 INFO:teuthology.orchestra.run.smithi161.stdout:3511 read 0x3662bef thru 0x36728be (0xfcd0 bytes) 2024-09-21T15:09:04.731 INFO:teuthology.orchestra.run.smithi161.stdout:3512 writesame 0x828a60f thru 0x828f1d8 data_size 0x2(0x4bca bytes) 2024-09-21T15:09:04.736 INFO:teuthology.orchestra.run.smithi161.stdout:3423 read 0xb000de9 thru 0xb00c358 (0xb570 bytes) 2024-09-21T15:09:04.737 INFO:teuthology.orchestra.run.smithi161.stdout:3424 punch from 0xbe36e81 to 0xbe3c6fe, (0x587d bytes) 2024-09-21T15:09:04.737 INFO:teuthology.orchestra.run.smithi161.stdout:3425 punch from 0x3ab7503 to 0x3ab9664, (0x2161 bytes) 2024-09-21T15:09:04.737 INFO:teuthology.orchestra.run.smithi161.stdout:3426 read 0x99937b3 thru 0x9995754 (0x1fa2 bytes) 2024-09-21T15:09:04.737 INFO:teuthology.orchestra.run.smithi161.stdout:3427 write 0xaca8db9 thru 0xacb0020 (0x7268 bytes) 2024-09-21T15:09:04.751 INFO:teuthology.orchestra.run.smithi161.stdout:3643 read 0xd550490 thru 0xd558f4e (0x8abf bytes) 2024-09-21T15:09:04.751 INFO:teuthology.orchestra.run.smithi161.stdout:3644 read 0x68b5877 thru 0x68c36f9 (0xde83 bytes) 2024-09-21T15:09:04.752 INFO:teuthology.orchestra.run.smithi161.stdout:3645 write 0xc46b758 thru 0xc46df7b (0x2824 bytes) 2024-09-21T15:09:04.759 INFO:teuthology.orchestra.run.smithi161.stdout:3428 read 0xba32f6c thru 0xba3b39b (0x8430 bytes) 2024-09-21T15:09:04.761 INFO:teuthology.orchestra.run.smithi161.stdout:3429 write 0xaca127c thru 0xaca1e31 (0xbb6 bytes) 2024-09-21T15:09:04.765 INFO:teuthology.orchestra.run.smithi161.stdout:3134 read 0x4ea87cf thru 0x4ead618 (0x4e4a bytes) 2024-09-21T15:09:04.765 INFO:teuthology.orchestra.run.smithi161.stdout:3137 punch from 0x5250eff to 0x5257281, (0x6382 bytes) 2024-09-21T15:09:04.765 INFO:teuthology.orchestra.run.smithi161.stdout:3138 punch from 0x2670380 to 0x267340e, (0x308e bytes) 2024-09-21T15:09:04.765 INFO:teuthology.orchestra.run.smithi161.stdout:3139 punch from 0x1b392ab to 0x1b48ce2, (0xfa37 bytes) 2024-09-21T15:09:04.765 INFO:teuthology.orchestra.run.smithi161.stdout:3141 read 0x29f0cd5 thru 0x29ff442 (0xe76e bytes) 2024-09-21T15:09:04.765 INFO:teuthology.orchestra.run.smithi161.stdout:3646 write 0x14e5f0c thru 0x14f300b (0xd100 bytes) 2024-09-21T15:09:04.766 INFO:teuthology.orchestra.run.smithi161.stdout:3142 read 0x4944fdd thru 0x4954580 (0xf5a4 bytes) 2024-09-21T15:09:04.766 INFO:teuthology.orchestra.run.smithi161.stdout:3514 read 0x7f164c2 thru 0x7f17a9b (0x15da bytes) 2024-09-21T15:09:04.766 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.766 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.766 INFO:teuthology.orchestra.run.smithi161.stdout:3517 write 0xa9194b4 thru 0xa927809 (0xe356 bytes) 2024-09-21T15:09:04.778 INFO:teuthology.orchestra.run.smithi161.stdout:3430 writesame 0xc09d244 thru 0xc0a8928 data_size 0x1(0xb6e5 bytes) 2024-09-21T15:09:04.784 INFO:teuthology.orchestra.run.smithi161.stdout:3143 trunc from 0xba54cbd to 0x84eca0 2024-09-21T15:09:04.784 INFO:teuthology.orchestra.run.smithi161.stdout:3647 write 0xbd03a3b thru 0xbd08ced (0x52b3 bytes) 2024-09-21T15:09:04.815 INFO:teuthology.orchestra.run.smithi161.stdout:3648 punch from 0x93d13ca to 0x93daac2, (0x96f8 bytes) 2024-09-21T15:09:04.815 INFO:teuthology.orchestra.run.smithi161.stdout:3649 punch from 0x1efb872 to 0x1f02830, (0x6fbe bytes) 2024-09-21T15:09:04.816 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.816 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.816 INFO:teuthology.orchestra.run.smithi161.stdout:3653 read 0x3cb5a3b thru 0x3cc5167 (0xf72d bytes) 2024-09-21T15:09:04.818 INFO:teuthology.orchestra.run.smithi161.stdout:3654 write 0x58fa818 thru 0x5901ed1 (0x76ba bytes) 2024-09-21T15:09:04.828 INFO:teuthology.orchestra.run.smithi161.stdout:3518 writesame 0xa40c4ee thru 0xa40e019 data_size 0x4(0x1b2c bytes) 2024-09-21T15:09:04.832 INFO:teuthology.orchestra.run.smithi161.stdout:3434 writesame 0x61de1cf thru 0x61e18be data_size 0x8(0x36f0 bytes) 2024-09-21T15:09:04.847 INFO:teuthology.orchestra.run.smithi161.stdout:3435 write 0xb991f11 thru 0xb99e49d (0xc58d bytes) 2024-09-21T15:09:04.851 INFO:teuthology.orchestra.run.smithi161.stdout:3655 write 0xb194655 thru 0xb1a440d (0xfdb9 bytes) 2024-09-21T15:09:04.860 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.860 INFO:teuthology.orchestra.run.smithi161.stdout:3457 write 0xa68881f thru 0xa68ee4c (0x662e bytes) 2024-09-21T15:09:04.862 INFO:teuthology.orchestra.run.smithi161.stdout:3519 read 0xdca4a84 thru 0xdcad883 (0x8e00 bytes) 2024-09-21T15:09:04.864 INFO:teuthology.orchestra.run.smithi161.stdout:3520 writesame 0xaa3e018 thru 0xaa4da96 data_size 0x1(0xfa7f bytes) 2024-09-21T15:09:04.870 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.870 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:04.870 INFO:teuthology.orchestra.run.smithi161.stdout:3438 punch from 0x532de13 to 0x5335800, (0x79ed bytes) 2024-09-21T15:09:04.870 INFO:teuthology.orchestra.run.smithi161.stdout:3439 writesame 0x87bed18 thru 0x87ca62f data_size 0x4(0xb918 bytes) 2024-09-21T15:09:04.877 INFO:teuthology.orchestra.run.smithi161.stdout:3656 read 0x84575c6 thru 0x846245f (0xae9a bytes) 2024-09-21T15:09:04.878 INFO:teuthology.orchestra.run.smithi161.stdout:3657 read 0x5bf56a1 thru 0x5bf691d (0x127d bytes) 2024-09-21T15:09:04.878 INFO:teuthology.orchestra.run.smithi161.stdout:3658 write 0x6b2cd3e thru 0x6b38a64 (0xbd27 bytes) 2024-09-21T15:09:04.895 INFO:teuthology.orchestra.run.smithi161.stdout:3440 write 0xaade5e1 thru 0xaae6e41 (0x8861 bytes) 2024-09-21T15:09:04.918 INFO:teuthology.orchestra.run.smithi161.stdout:3659 punch from 0x7b9545b to 0x7b9b125, (0x5cca bytes) 2024-09-21T15:09:04.919 INFO:teuthology.orchestra.run.smithi161.stdout:3660 write 0x3802d4a thru 0x380952b (0x67e2 bytes) 2024-09-21T15:09:04.921 INFO:teuthology.orchestra.run.smithi161.stdout:3521 write 0x69b8163 thru 0x69c2661 (0xa4ff bytes) 2024-09-21T15:09:04.933 INFO:teuthology.orchestra.run.smithi161.stdout:3441 read 0x821a3ed thru 0x822072b (0x633f bytes) 2024-09-21T15:09:04.935 INFO:teuthology.orchestra.run.smithi161.stdout:3442 punch from 0xd16f1bb to 0xd17ee58, (0xfc9d bytes) 2024-09-21T15:09:04.935 INFO:teuthology.orchestra.run.smithi161.stdout:3443 write 0x27781c7 thru 0x277c6b6 (0x44f0 bytes) 2024-09-21T15:09:04.948 INFO:teuthology.orchestra.run.smithi161.stdout:3444 read 0x21ce7e4 thru 0x21dd1d4 (0xe9f1 bytes) 2024-09-21T15:09:04.948 INFO:teuthology.orchestra.run.smithi161.stdout:3458 write 0x590f612 thru 0x591dbec (0xe5db bytes) 2024-09-21T15:09:04.952 INFO:teuthology.orchestra.run.smithi161.stdout:3661 writesame 0x17172f3 thru 0x1719065 data_size 0x7(0x1d73 bytes) 2024-09-21T15:09:04.953 INFO:teuthology.orchestra.run.smithi161.stdout:3445 read 0x2fb0 thru 0x8e1b (0x5e6c bytes) 2024-09-21T15:09:04.959 INFO:teuthology.orchestra.run.smithi161.stdout:3446 writesame 0xad5a198 thru 0xad61040 data_size 0x1(0x6ea9 bytes) 2024-09-21T15:09:04.965 INFO:teuthology.orchestra.run.smithi161.stdout:3144 write 0x99d9e06 thru 0x99e6eb9 (0xd0b4 bytes) 2024-09-21T15:09:04.984 INFO:teuthology.orchestra.run.smithi161.stdout:3525 trunc from 0xe26bc5e to 0x1ee0445 2024-09-21T15:09:04.986 INFO:teuthology.orchestra.run.smithi161.stdout:3459 write 0x32df2e8 thru 0x32ea8f2 (0xb60b bytes) 2024-09-21T15:09:04.995 INFO:teuthology.orchestra.run.smithi161.stdout:3447 write 0xcc1150f thru 0xcc182ec (0x6dde bytes) 2024-09-21T15:09:04.999 INFO:teuthology.orchestra.run.smithi161.stdout:3145 clone 26 order 18 su 16384 sc 11 2024-09-21T15:09:05.016 INFO:teuthology.orchestra.run.smithi161.stdout:3662 trunc from 0xeca0e8f to 0xc88b941 2024-09-21T15:09:05.031 INFO:teuthology.orchestra.run.smithi161.stdout:3449 read 0x92570db thru 0x925c6a1 (0x55c7 bytes) 2024-09-21T15:09:05.034 INFO:teuthology.orchestra.run.smithi161.stdout:3450 write 0x1a48151 thru 0x1a50d9b (0x8c4b bytes) 2024-09-21T15:09:05.044 INFO:teuthology.orchestra.run.smithi161.stdout:3461 write 0x5f1f8d8 thru 0x5f23a29 (0x4152 bytes) 2024-09-21T15:09:05.053 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.053 INFO:teuthology.orchestra.run.smithi161.stdout:3453 punch from 0x49d6b21 to 0x49d890f, (0x1dee bytes) 2024-09-21T15:09:05.053 INFO:teuthology.orchestra.run.smithi161.stdout:3454 read 0xbbd4b8e thru 0xbbdead4 (0x9f47 bytes) 2024-09-21T15:09:05.053 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.054 INFO:teuthology.orchestra.run.smithi161.stdout:3457 read 0x3b129b7 thru 0x3b12e7c (0x4c6 bytes) 2024-09-21T15:09:05.054 INFO:teuthology.orchestra.run.smithi161.stdout:3460 read 0x13539c2 thru 0x1362ec5 (0xf504 bytes) 2024-09-21T15:09:05.055 INFO:teuthology.orchestra.run.smithi161.stdout:3461 read 0x8cf7918 thru 0x8cf827c (0x965 bytes) 2024-09-21T15:09:05.057 INFO:teuthology.orchestra.run.smithi161.stdout:3463 writesame 0x613802a thru 0x613a10b data_size 0x3d(0x20e2 bytes) 2024-09-21T15:09:05.069 INFO:teuthology.orchestra.run.smithi161.stdout:3462 flatten 2024-09-21T15:09:05.079 INFO:teuthology.orchestra.run.smithi161.stdout:3465 write 0xdff4715 thru 0xdffeab8 (0xa3a4 bytes) 2024-09-21T15:09:05.116 INFO:teuthology.orchestra.run.smithi161.stdout:2640 write 0x9f955bf thru 0x9fa2ee5 (0xd927 bytes) 2024-09-21T15:09:05.186 INFO:teuthology.orchestra.run.smithi161.stdout:3466 write 0x18bb1ea thru 0x18c8e43 (0xdc5a bytes) 2024-09-21T15:09:05.230 INFO:teuthology.orchestra.run.smithi161.stdout:3665 read 0xacdf5dc thru 0xaced2de (0xdd03 bytes) 2024-09-21T15:09:05.231 INFO:teuthology.orchestra.run.smithi161.stdout:3666 write 0x51f98ac thru 0x5203374 (0x9ac9 bytes) 2024-09-21T15:09:05.248 INFO:teuthology.orchestra.run.smithi161.stdout:3467 read 0xcc4e15a thru 0xcc4fcb6 (0x1b5d bytes) 2024-09-21T15:09:05.250 INFO:teuthology.orchestra.run.smithi161.stdout:3468 read 0xdc18bb1 thru 0xdc25589 (0xc9d9 bytes) 2024-09-21T15:09:05.250 INFO:teuthology.orchestra.run.smithi161.stdout:3469 read 0x7784828 thru 0x778c3de (0x7bb7 bytes) 2024-09-21T15:09:05.251 INFO:teuthology.orchestra.run.smithi161.stdout:3470 read 0xb41d430 thru 0xb41ee8d (0x1a5e bytes) 2024-09-21T15:09:05.260 INFO:teuthology.orchestra.run.smithi161.stdout:3471 write 0xa48cdfe thru 0xa49b78a (0xe98d bytes) 2024-09-21T15:09:05.274 INFO:teuthology.orchestra.run.smithi161.stdout:3667 trunc from 0xc88b941 to 0x9634238 2024-09-21T15:09:05.306 INFO:teuthology.orchestra.run.smithi161.stdout:3472 punch from 0x3686b9c to 0x36965c1, (0xfa25 bytes) 2024-09-21T15:09:05.306 INFO:teuthology.orchestra.run.smithi161.stdout:3474 punch from 0x5a464fa to 0x5a4cca8, (0x67ae bytes) 2024-09-21T15:09:05.306 INFO:teuthology.orchestra.run.smithi161.stdout:3476 write 0x19d324b thru 0x19d87d2 (0x5588 bytes) 2024-09-21T15:09:05.327 INFO:teuthology.orchestra.run.smithi161.stdout:2641 writesame 0xcf7e0cd thru 0xcf805f9 data_size 0x1(0x252d bytes) 2024-09-21T15:09:05.351 INFO:teuthology.orchestra.run.smithi161.stdout:2643 writesame 0x77b95e thru 0x780111 data_size 0x1a(0x47b4 bytes) 2024-09-21T15:09:05.370 INFO:teuthology.orchestra.run.smithi161.stdout:3477 write 0xe74cc99 thru 0xe75b862 (0xebca bytes) 2024-09-21T15:09:05.373 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.373 INFO:teuthology.orchestra.run.smithi161.stdout:3671 read 0x39bfc0b thru 0x39ce5e7 (0xe9dd bytes) 2024-09-21T15:09:05.375 INFO:teuthology.orchestra.run.smithi161.stdout:3672 read 0x4f5c6dc thru 0x4f6b890 (0xf1b5 bytes) 2024-09-21T15:09:05.376 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.378 INFO:teuthology.orchestra.run.smithi161.stdout:3675 trunc from 0x9634238 to 0xa9b8f01 2024-09-21T15:09:05.387 INFO:teuthology.orchestra.run.smithi161.stdout:2644 write 0x61f8268 thru 0x61ffeb4 (0x7c4d bytes) 2024-09-21T15:09:05.395 INFO:teuthology.orchestra.run.smithi161.stdout:3479 write 0x4026096 thru 0x402dbd6 (0x7b41 bytes) 2024-09-21T15:09:05.402 INFO:teuthology.orchestra.run.smithi161.stdout:3463 trunc from 0xed67a66 to 0x7ac47bc 2024-09-21T15:09:05.412 INFO:teuthology.orchestra.run.smithi161.stdout:3480 punch from 0x57cd565 to 0x57cee66, (0x1901 bytes) 2024-09-21T15:09:05.412 INFO:teuthology.orchestra.run.smithi161.stdout:3526 writesame 0x27c9948 thru 0x27d7a55 data_size 0x1(0xe10e bytes) 2024-09-21T15:09:05.413 INFO:teuthology.orchestra.run.smithi161.stdout:3481 read 0x68bec4d thru 0x68ce331 (0xf6e5 bytes) 2024-09-21T15:09:05.414 INFO:teuthology.orchestra.run.smithi161.stdout:3482 read 0xd7a9bf7 thru 0xd7b1044 (0x744e bytes) 2024-09-21T15:09:05.417 INFO:teuthology.orchestra.run.smithi161.stdout:3676 write 0x3a1babf thru 0x3a262d1 (0xa813 bytes) 2024-09-21T15:09:05.421 INFO:teuthology.orchestra.run.smithi161.stdout:3528 read 0x98244b thru 0x986687 (0x423d bytes) 2024-09-21T15:09:05.422 INFO:teuthology.orchestra.run.smithi161.stdout:3529 write 0x23cf6c1 thru 0x23d5012 (0x5952 bytes) 2024-09-21T15:09:05.424 INFO:teuthology.orchestra.run.smithi161.stdout:2645 trunc from 0xec265ca to 0x9236241 2024-09-21T15:09:05.436 INFO:teuthology.orchestra.run.smithi161.stdout:3483 trunc from 0xe75b863 to 0x3b82268 2024-09-21T15:09:05.451 INFO:teuthology.orchestra.run.smithi161.stdout:3677 write 0x5addff thru 0x5b465a (0x685c bytes) 2024-09-21T15:09:05.508 INFO:teuthology.orchestra.run.smithi161.stdout:3679 punch from 0x9123377 to 0x913002a, (0xccb3 bytes) 2024-09-21T15:09:05.509 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.511 INFO:teuthology.orchestra.run.smithi161.stdout:3681 trunc from 0xa9b8f01 to 0xbf6dae2 2024-09-21T15:09:05.534 INFO:teuthology.orchestra.run.smithi161.stdout:3464 writesame 0xa3c2c9a thru 0xa3ce12d data_size 0x7f(0xb494 bytes) 2024-09-21T15:09:05.542 INFO:teuthology.orchestra.run.smithi161.stdout:3530 write 0x9d9ef88 thru 0x9da36ad (0x4726 bytes) 2024-09-21T15:09:05.543 INFO:teuthology.orchestra.run.smithi161.stdout:3466 writesame 0xdf6602 thru 0xdfd26a data_size 0x21(0x6c69 bytes) 2024-09-21T15:09:05.552 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.552 INFO:teuthology.orchestra.run.smithi161.stdout:3683 writesame 0x7ffa9c8 thru 0x7fffcd9 data_size 0x7(0x5312 bytes) 2024-09-21T15:09:05.555 INFO:teuthology.orchestra.run.smithi161.stdout:3489 punch from 0x3b5726f to 0x3b57936, (0x6c7 bytes) 2024-09-21T15:09:05.570 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.570 INFO:teuthology.orchestra.run.smithi161.stdout:3473 punch from 0x86ba917 to 0x86bfc3f, (0x5328 bytes) 2024-09-21T15:09:05.570 INFO:teuthology.orchestra.run.smithi161.stdout:3474 writesame 0x49e5385 thru 0x49f13fe data_size 0x47(0xc07a bytes) 2024-09-21T15:09:05.571 INFO:teuthology.orchestra.run.smithi161.stdout:2646 writesame 0x4db39b6 thru 0x4dc260d data_size 0xc(0xec58 bytes) 2024-09-21T15:09:05.579 INFO:teuthology.orchestra.run.smithi161.stdout:3685 read 0x21d2dc3 thru 0x21d7e25 (0x5063 bytes) 2024-09-21T15:09:05.579 INFO:teuthology.orchestra.run.smithi161.stdout:3531 write 0x7368b1c thru 0x737899a (0xfe7f bytes) 2024-09-21T15:09:05.587 INFO:teuthology.orchestra.run.smithi161.stdout:3686 punch from 0x9feb309 to 0x9ffaba9, (0xf8a0 bytes) 2024-09-21T15:09:05.588 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.588 INFO:teuthology.orchestra.run.smithi161.stdout:3688 writesame 0x50fbd09 thru 0x510008d data_size 0x1(0x4385 bytes) 2024-09-21T15:09:05.601 INFO:teuthology.orchestra.run.smithi161.stdout:3475 trunc from 0xa3ce12e to 0x4ac2f90 2024-09-21T15:09:05.610 INFO:teuthology.orchestra.run.smithi161.stdout:3689 flatten 2024-09-21T15:09:05.613 INFO:teuthology.orchestra.run.smithi161.stdout:2647 write 0x888ca thru 0x97001 (0xe738 bytes) 2024-09-21T15:09:05.617 INFO:teuthology.orchestra.run.smithi161.stdout:3490 writesame 0xcc635a2 thru 0xcc6a1e0 data_size 0x3(0x6c3f bytes) 2024-09-21T15:09:05.628 INFO:teuthology.orchestra.run.smithi161.stdout:3491 write 0x8fe32a4 thru 0x8feae1d (0x7b7a bytes) 2024-09-21T15:09:05.628 INFO:teuthology.orchestra.run.smithi161.stdout:3532 write 0x1959172 thru 0x1960040 (0x6ecf bytes) 2024-09-21T15:09:05.678 INFO:teuthology.orchestra.run.smithi161.stdout:3534 read 0x84e2092 thru 0x84e568e (0x35fd bytes) 2024-09-21T15:09:05.678 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.678 INFO:teuthology.orchestra.run.smithi161.stdout:3536 punch from 0x38a97cd to 0x38b8dda, (0xf60d bytes) 2024-09-21T15:09:05.678 INFO:teuthology.orchestra.run.smithi161.stdout:3537 punch from 0x58d33e6 to 0x58d4803, (0x141d bytes) 2024-09-21T15:09:05.682 INFO:teuthology.orchestra.run.smithi161.stdout:3538 trunc from 0x9da36ae to 0x8963ba2 2024-09-21T15:09:05.709 INFO:teuthology.orchestra.run.smithi161.stdout:2648 read 0x719f1f4 thru 0x71a97b6 (0xa5c3 bytes) 2024-09-21T15:09:05.710 INFO:teuthology.orchestra.run.smithi161.stdout:3492 trunc from 0xcc6a1e1 to 0x6917081 2024-09-21T15:09:05.722 INFO:teuthology.orchestra.run.smithi161.stdout:2649 trunc from 0x9236241 to 0xce78786 2024-09-21T15:09:05.749 INFO:teuthology.orchestra.run.smithi161.stdout:3477 trunc from 0x4ac2f90 to 0xd346b5c 2024-09-21T15:09:05.765 INFO:teuthology.orchestra.run.smithi161.stdout:3690 trunc from 0xbf6dae2 to 0x89eb06c 2024-09-21T15:09:05.779 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.779 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.779 INFO:teuthology.orchestra.run.smithi161.stdout:3481 write 0xc987bcf thru 0xc988602 (0xa34 bytes) 2024-09-21T15:09:05.787 INFO:teuthology.orchestra.run.smithi161.stdout:2650 trunc from 0xce78786 to 0x658b5b 2024-09-21T15:09:05.803 INFO:teuthology.orchestra.run.smithi161.stdout:3482 read 0x9da0cb9 thru 0x9da2f0c (0x2254 bytes) 2024-09-21T15:09:05.805 INFO:teuthology.orchestra.run.smithi161.stdout:3483 read 0xb1616c4 thru 0xb164f73 (0x38b0 bytes) 2024-09-21T15:09:05.806 INFO:teuthology.orchestra.run.smithi161.stdout:3484 read 0x8bd079f thru 0x8bd707b (0x68dd bytes) 2024-09-21T15:09:05.806 INFO:teuthology.orchestra.run.smithi161.stdout:3485 punch from 0xc9e26b9 to 0xc9e360e, (0xf55 bytes) 2024-09-21T15:09:05.806 INFO:teuthology.orchestra.run.smithi161.stdout:3487 write 0x1d0ce7a thru 0x1d0e436 (0x15bd bytes) 2024-09-21T15:09:05.809 INFO:teuthology.orchestra.run.smithi161.stdout:3691 punch from 0x5807b54 to 0x580f804, (0x7cb0 bytes) 2024-09-21T15:09:05.813 INFO:teuthology.orchestra.run.smithi161.stdout:3541 write 0xa81944d thru 0xa81b190 (0x1d44 bytes) 2024-09-21T15:09:05.820 INFO:teuthology.orchestra.run.smithi161.stdout:3493 write 0xe7df5fb thru 0xe7ee147 (0xeb4d bytes) 2024-09-21T15:09:05.824 INFO:teuthology.orchestra.run.smithi161.stdout:3488 write 0x846c716 thru 0x846f4c6 (0x2db1 bytes) 2024-09-21T15:09:05.850 INFO:teuthology.orchestra.run.smithi161.stdout:3489 write 0xae8850f thru 0xae94029 (0xbb1b bytes) 2024-09-21T15:09:05.868 INFO:teuthology.orchestra.run.smithi161.stdout:3490 punch from 0x14ec7c1 to 0x14f1cd9, (0x5518 bytes) 2024-09-21T15:09:05.868 INFO:teuthology.orchestra.run.smithi161.stdout:3491 read 0x7f91bf4 thru 0x7f925af (0x9bc bytes) 2024-09-21T15:09:05.869 INFO:teuthology.orchestra.run.smithi161.stdout:3492 writesame 0x1bd09d1 thru 0x1bd43ff data_size 0xf(0x3a2f bytes) 2024-09-21T15:09:05.869 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.869 INFO:teuthology.orchestra.run.smithi161.stdout:3495 punch from 0x9b3ef6a to 0x9b3f5c1, (0x657 bytes) 2024-09-21T15:09:05.869 INFO:teuthology.orchestra.run.smithi161.stdout:3496 write 0x97002fe thru 0x9703b1c (0x381f bytes) 2024-09-21T15:09:05.870 INFO:teuthology.orchestra.run.smithi161.stdout:3542 trunc from 0xa81b191 to 0xb6c5e9c 2024-09-21T15:09:05.870 INFO:teuthology.orchestra.run.smithi161.stdout:3693 write 0xaa46a96 thru 0xaa4b1a2 (0x470d bytes) 2024-09-21T15:09:05.883 INFO:teuthology.orchestra.run.smithi161.stdout:3498 write 0x9fc3fb8 thru 0x9fc9c55 (0x5c9e bytes) 2024-09-21T15:09:05.888 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.888 INFO:teuthology.orchestra.run.smithi161.stdout:3495 read 0x2d1fb0d thru 0x2d2725d (0x7751 bytes) 2024-09-21T15:09:05.889 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.889 INFO:teuthology.orchestra.run.smithi161.stdout:3497 read 0x1241300 thru 0x12447ee (0x34ef bytes) 2024-09-21T15:09:05.891 INFO:teuthology.orchestra.run.smithi161.stdout:3500 punch from 0x7279791 to 0x72845e6, (0xae55 bytes) 2024-09-21T15:09:05.891 INFO:teuthology.orchestra.run.smithi161.stdout:3501 read 0x1c77dcf thru 0x1c7a218 (0x244a bytes) 2024-09-21T15:09:05.893 INFO:teuthology.orchestra.run.smithi161.stdout:3695 read 0x711f936 thru 0x712dea8 (0xe573 bytes) 2024-09-21T15:09:05.893 INFO:teuthology.orchestra.run.smithi161.stdout:3696 writesame 0x6e1adcd thru 0x6e2739b data_size 0x1(0xc5cf bytes) 2024-09-21T15:09:05.896 INFO:teuthology.orchestra.run.smithi161.stdout:3502 trunc from 0xd346b5c to 0xc20c372 2024-09-21T15:09:05.915 INFO:teuthology.orchestra.run.smithi161.stdout:3499 read 0x3b900e7 thru 0x3b9c7dc (0xc6f6 bytes) 2024-09-21T15:09:05.916 INFO:teuthology.orchestra.run.smithi161.stdout:3501 punch from 0x6d4ca69 to 0x6d5ac41, (0xe1d8 bytes) 2024-09-21T15:09:05.916 INFO:teuthology.orchestra.run.smithi161.stdout:3503 writesame 0xd3e8121 thru 0xd3ebb23 data_size 0x1(0x3a03 bytes) 2024-09-21T15:09:05.923 INFO:teuthology.orchestra.run.smithi161.stdout:3543 writesame 0x990a4c2 thru 0x990ccca data_size 0x1(0x2809 bytes) 2024-09-21T15:09:05.926 INFO:teuthology.orchestra.run.smithi161.stdout:2651 read 0x727c7 thru 0x826e0 (0xff1a bytes) 2024-09-21T15:09:05.929 INFO:teuthology.orchestra.run.smithi161.stdout:2652 read 0x34a3b1 thru 0x350c3a (0x688a bytes) 2024-09-21T15:09:05.957 INFO:teuthology.orchestra.run.smithi161.stdout:3504 punch from 0x10271fe to 0x1035056, (0xde58 bytes) 2024-09-21T15:09:05.957 INFO:teuthology.orchestra.run.smithi161.stdout:3506 read 0x6268ce0 thru 0x626eafc (0x5e1d bytes) 2024-09-21T15:09:05.957 INFO:teuthology.orchestra.run.smithi161.stdout:3509 punch from 0x8c3799c to 0x8c421b6, (0xa81a bytes) 2024-09-21T15:09:05.957 INFO:teuthology.orchestra.run.smithi161.stdout:3511 read 0x632f1d4 thru 0x6336c92 (0x7abf bytes) 2024-09-21T15:09:05.957 INFO:teuthology.orchestra.run.smithi161.stdout:3513 punch from 0x972e6f5 to 0x9738ef6, (0xa801 bytes) 2024-09-21T15:09:05.957 INFO:teuthology.orchestra.run.smithi161.stdout:3514 punch from 0x27f2788 to 0x27fa2c0, (0x7b38 bytes) 2024-09-21T15:09:05.957 INFO:teuthology.orchestra.run.smithi161.stdout:3515 punch from 0xb204249 to 0xb209991, (0x5748 bytes) 2024-09-21T15:09:05.958 INFO:teuthology.orchestra.run.smithi161.stdout:3516 punch from 0x7113be9 to 0x7122314, (0xe72b bytes) 2024-09-21T15:09:05.958 INFO:teuthology.orchestra.run.smithi161.stdout:3517 read 0x6f47d7a thru 0x6f57a41 (0xfcc8 bytes) 2024-09-21T15:09:05.958 INFO:teuthology.orchestra.run.smithi161.stdout:3698 write 0x80aaad thru 0x80baec (0x1040 bytes) 2024-09-21T15:09:05.958 INFO:teuthology.orchestra.run.smithi161.stdout:3521 write 0xa54c5b1 thru 0xa54e09d (0x1aed bytes) 2024-09-21T15:09:05.963 INFO:teuthology.orchestra.run.smithi161.stdout:2653 trunc from 0x658b5b to 0xc569df4 2024-09-21T15:09:05.972 INFO:teuthology.orchestra.run.smithi161.stdout:3699 read 0xfa5393 thru 0xfae1db (0x8e49 bytes) 2024-09-21T15:09:05.973 INFO:teuthology.orchestra.run.smithi161.stdout:3522 punch from 0x948fcc7 to 0x949c1cf, (0xc508 bytes) 2024-09-21T15:09:05.973 INFO:teuthology.orchestra.run.smithi161.stdout:3526 writesame 0x11fab thru 0x1809c data_size 0x1(0x60f2 bytes) 2024-09-21T15:09:05.979 INFO:teuthology.orchestra.run.smithi161.stdout:3700 trunc from 0xaa4b1a3 to 0xd348b63 2024-09-21T15:09:05.980 INFO:teuthology.orchestra.run.smithi161.stdout:3505 read 0x4a4dba7 thru 0x4a521d6 (0x4630 bytes) 2024-09-21T15:09:05.981 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:05.981 INFO:teuthology.orchestra.run.smithi161.stdout:3510 write 0x2b955a5 thru 0x2b9f814 (0xa270 bytes) 2024-09-21T15:09:05.997 INFO:teuthology.orchestra.run.smithi161.stdout:3544 trunc from 0xb6c5e9c to 0xebc3730 2024-09-21T15:09:06.016 INFO:teuthology.orchestra.run.smithi161.stdout:3511 writesame 0x7031534 thru 0x7034e21 data_size 0x15(0x38ee bytes) 2024-09-21T15:09:06.018 INFO:teuthology.orchestra.run.smithi161.stdout:3527 trunc from 0xe7ee148 to 0xd76aebf 2024-09-21T15:09:06.027 INFO:teuthology.orchestra.run.smithi161.stdout:3513 read 0xbfdc78e thru 0xbfe0839 (0x40ac bytes) 2024-09-21T15:09:06.029 INFO:teuthology.orchestra.run.smithi161.stdout:3514 read 0x60fc12b thru 0x61008ea (0x47c0 bytes) 2024-09-21T15:09:06.035 INFO:teuthology.orchestra.run.smithi161.stdout:2654 punch from 0x83845e5 to 0x838cf09, (0x8924 bytes) 2024-09-21T15:09:06.035 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.036 INFO:teuthology.orchestra.run.smithi161.stdout:2657 trunc from 0xc569df4 to 0xc933c59 2024-09-21T15:09:06.051 INFO:teuthology.orchestra.run.smithi161.stdout:3701 trunc from 0xd348b63 to 0x816b02e 2024-09-21T15:09:06.054 INFO:teuthology.orchestra.run.smithi161.stdout:3545 read 0xcb9f450 thru 0xcba91e2 (0x9d93 bytes) 2024-09-21T15:09:06.055 INFO:teuthology.orchestra.run.smithi161.stdout:3548 writesame 0x67b10ab thru 0x67b8542 data_size 0x38(0x7498 bytes) 2024-09-21T15:09:06.059 INFO:teuthology.orchestra.run.smithi161.stdout:3528 read 0x58338bc thru 0x583932f (0x5a74 bytes) 2024-09-21T15:09:06.062 INFO:teuthology.orchestra.run.smithi161.stdout:3530 read 0xa344ace thru 0xa349ffa (0x552d bytes) 2024-09-21T15:09:06.062 INFO:teuthology.orchestra.run.smithi161.stdout:3532 writesame 0x6a20e08 thru 0x6a24627 data_size 0x10(0x3820 bytes) 2024-09-21T15:09:06.069 INFO:teuthology.orchestra.run.smithi161.stdout:3515 trunc from 0xc20c372 to 0x2458ae1 2024-09-21T15:09:06.072 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.072 INFO:teuthology.orchestra.run.smithi161.stdout:2659 write 0x23727bc thru 0x238041e (0xdc63 bytes) 2024-09-21T15:09:06.082 INFO:teuthology.orchestra.run.smithi161.stdout:3534 write 0x8dc8d7c thru 0x8dcc25a (0x34df bytes) 2024-09-21T15:09:06.092 INFO:teuthology.orchestra.run.smithi161.stdout:3550 read 0x6825191 thru 0x6834e02 (0xfc72 bytes) 2024-09-21T15:09:06.093 INFO:teuthology.orchestra.run.smithi161.stdout:3553 read 0x2363d3b thru 0x236b99a (0x7c60 bytes) 2024-09-21T15:09:06.094 INFO:teuthology.orchestra.run.smithi161.stdout:3555 write 0xa36bb88 thru 0xa379785 (0xdbfe bytes) 2024-09-21T15:09:06.106 INFO:teuthology.orchestra.run.smithi161.stdout:2660 read 0x9a7df30 thru 0x9a86b58 (0x8c29 bytes) 2024-09-21T15:09:06.106 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.126 INFO:teuthology.orchestra.run.smithi161.stdout:3535 trunc from 0xd76aebf to 0x6c0fb4 2024-09-21T15:09:06.139 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.139 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.139 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.139 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.139 INFO:teuthology.orchestra.run.smithi161.stdout:3563 read 0x99306ef thru 0x993dfba (0xd8cc bytes) 2024-09-21T15:09:06.140 INFO:teuthology.orchestra.run.smithi161.stdout:3564 punch from 0x2f960e6 to 0x2f9d8ee, (0x7808 bytes) 2024-09-21T15:09:06.140 INFO:teuthology.orchestra.run.smithi161.stdout:3565 write 0x9262cb0 thru 0x926fe7c (0xd1cd bytes) 2024-09-21T15:09:06.160 INFO:teuthology.orchestra.run.smithi161.stdout:2662 write 0xcf1e418 thru 0xcf2216d (0x3d56 bytes) 2024-09-21T15:09:06.189 INFO:teuthology.orchestra.run.smithi161.stdout:2663 punch from 0xb8e2d2c to 0xb8e6880, (0x3b54 bytes) 2024-09-21T15:09:06.191 INFO:teuthology.orchestra.run.smithi161.stdout:3566 write 0x4914016 thru 0x491eaab (0xaa96 bytes) 2024-09-21T15:09:06.191 INFO:teuthology.orchestra.run.smithi161.stdout:3516 punch from 0x1aecc8c to 0x1af42dd, (0x7651 bytes) 2024-09-21T15:09:06.195 INFO:teuthology.orchestra.run.smithi161.stdout:3517 trunc from 0x2458ae1 to 0x45e937c 2024-09-21T15:09:06.202 INFO:teuthology.orchestra.run.smithi161.stdout:3702 writesame 0x8afec2e thru 0x8b04dd8 data_size 0x1(0x61ab bytes) 2024-09-21T15:09:06.222 INFO:teuthology.orchestra.run.smithi161.stdout:3703 trunc from 0x8b04dd9 to 0x1ff5d78 2024-09-21T15:09:06.229 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #24, image image_cluster1.client.mirror.4-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent25 2024-09-21T15:09:06.231 INFO:teuthology.orchestra.run.smithi161.stdout:2664 write 0xe23ef28 thru 0xe241758 (0x2831 bytes) 2024-09-21T15:09:06.235 INFO:teuthology.orchestra.run.smithi161.stdout:3567 read 0xd713c3f thru 0xd71888b (0x4c4d bytes) 2024-09-21T15:09:06.235 INFO:teuthology.orchestra.run.smithi161.stdout:3568 write 0x995733c thru 0x995c26b (0x4f30 bytes) 2024-09-21T15:09:06.238 INFO:teuthology.orchestra.run.smithi161.stdout:3518 punch from 0xdf8d66 to 0xdfd013, (0x42ad bytes) 2024-09-21T15:09:06.239 INFO:teuthology.orchestra.run.smithi161.stdout:3519 read 0x4131c4c thru 0x41365c8 (0x497d bytes) 2024-09-21T15:09:06.242 INFO:teuthology.orchestra.run.smithi161.stdout:3520 trunc from 0x45e937c to 0x207885f 2024-09-21T15:09:06.258 INFO:teuthology.orchestra.run.smithi161.stdout:3569 punch from 0x75abc2f to 0x75b222e, (0x65ff bytes) 2024-09-21T15:09:06.258 INFO:teuthology.orchestra.run.smithi161.stdout:3570 writesame 0xe04e435 thru 0xe0596e1 data_size 0x3(0xb2ad bytes) 2024-09-21T15:09:06.260 INFO:teuthology.orchestra.run.smithi161.stdout:2665 write 0x19bf932 thru 0x19c92f6 (0x99c5 bytes) 2024-09-21T15:09:06.274 INFO:teuthology.orchestra.run.smithi161.stdout:3536 writesame 0x185f74b thru 0x1868c32 data_size 0xa(0x94e8 bytes) 2024-09-21T15:09:06.289 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.289 INFO:teuthology.orchestra.run.smithi161.stdout:2668 writesame 0x86bb820 thru 0x86bfd43 data_size 0x32(0x4524 bytes) 2024-09-21T15:09:06.293 INFO:teuthology.orchestra.run.smithi161.stdout:3537 punch from 0x28cfa0 to 0x2934f0, (0x6550 bytes) 2024-09-21T15:09:06.293 INFO:teuthology.orchestra.run.smithi161.stdout:3538 read 0x170dafd thru 0x17170e3 (0x95e7 bytes) 2024-09-21T15:09:06.295 INFO:teuthology.orchestra.run.smithi161.stdout:3539 punch from 0x1364a9d to 0x136e6d0, (0x9c33 bytes) 2024-09-21T15:09:06.295 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.300 INFO:teuthology.orchestra.run.smithi161.stdout:3521 read 0x11c328b thru 0x11d321f (0xff95 bytes) 2024-09-21T15:09:06.301 INFO:teuthology.orchestra.run.smithi161.stdout:3572 writesame 0x8c6ee08 thru 0x8c70f3f data_size 0x1(0x2138 bytes) 2024-09-21T15:09:06.307 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.308 INFO:teuthology.orchestra.run.smithi161.stdout:2673 punch from 0x7154306 to 0x715daf5, (0x97ef bytes) 2024-09-21T15:09:06.308 INFO:teuthology.orchestra.run.smithi161.stdout:2675 write 0xc3b9f18 thru 0xc3ba088 (0x171 bytes) 2024-09-21T15:09:06.318 INFO:teuthology.orchestra.run.smithi161.stdout:3146 read 0x35c82d thru 0x3667d6 (0x9faa bytes) 2024-09-21T15:09:06.324 INFO:teuthology.orchestra.run.smithi161.stdout:2676 write 0xd01d45d thru 0xd022c7e (0x5822 bytes) 2024-09-21T15:09:06.340 INFO:teuthology.orchestra.run.smithi161.stdout:3574 read 0x9670863 thru 0x9675961 (0x50ff bytes) 2024-09-21T15:09:06.340 INFO:teuthology.orchestra.run.smithi161.stdout:2677 write 0x41dce4e thru 0x41e6713 (0x98c6 bytes) 2024-09-21T15:09:06.341 INFO:teuthology.orchestra.run.smithi161.stdout:3575 punch from 0x10951f3 to 0x109c84e, (0x765b bytes) 2024-09-21T15:09:06.341 INFO:teuthology.orchestra.run.smithi161.stdout:3576 read 0xd8b7349 thru 0xd8bf58b (0x8243 bytes) 2024-09-21T15:09:06.344 INFO:teuthology.orchestra.run.smithi161.stdout:3522 writesame 0x66112df thru 0x6611a74 data_size 0x1(0x796 bytes) 2024-09-21T15:09:06.350 INFO:teuthology.orchestra.run.smithi161.stdout:3147 write 0x55c14b8 thru 0x55d0815 (0xf35e bytes) 2024-09-21T15:09:06.350 INFO:teuthology.orchestra.run.smithi161.stdout:3541 writesame 0x59c005f thru 0x59c6bb4 data_size 0xb(0x6b56 bytes) 2024-09-21T15:09:06.353 INFO:teuthology.orchestra.run.smithi161.stdout:3704 writesame 0x36a303b thru 0x36afe15 data_size 0x1(0xcddb bytes) 2024-09-21T15:09:06.354 INFO:teuthology.orchestra.run.smithi161.stdout:3577 trunc from 0xebc3730 to 0x87da8c4 2024-09-21T15:09:06.363 INFO:teuthology.orchestra.run.smithi161.stdout:3705 trunc from 0x36afe16 to 0x29f2e94 2024-09-21T15:09:06.364 INFO:teuthology.orchestra.run.smithi161.stdout:2678 writesame 0x7250241 thru 0x725e9f2 data_size 0x2f(0xe7b2 bytes) 2024-09-21T15:09:06.364 INFO:teuthology.orchestra.run.smithi161.stdout:3524 trunc from 0x6611a75 to 0xeac4e11 2024-09-21T15:09:06.377 INFO:teuthology.orchestra.run.smithi161.stdout:3543 trunc from 0x59c6bb5 to 0x9342473 2024-09-21T15:09:06.377 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:06.376+0000 7f1e9c77a700 -1 reset not still connected to 0x562889a93c70 2024-09-21T15:09:06.392 INFO:teuthology.orchestra.run.smithi161.stdout:3148 read 0x6d6bf1e thru 0x6d72c26 (0x6d09 bytes) 2024-09-21T15:09:06.393 INFO:teuthology.orchestra.run.smithi161.stdout:3149 punch from 0x6e4911c to 0x6e4cc25, (0x3b09 bytes) 2024-09-21T15:09:06.393 INFO:teuthology.orchestra.run.smithi161.stdout:3151 punch from 0x79088c6 to 0x790a643, (0x1d7d bytes) 2024-09-21T15:09:06.393 INFO:teuthology.orchestra.run.smithi161.stdout:3152 punch from 0x4b840eb to 0x4b8d84d, (0x9762 bytes) 2024-09-21T15:09:06.393 INFO:teuthology.orchestra.run.smithi161.stdout:3154 read 0x5816ca3 thru 0x581a0fa (0x3458 bytes) 2024-09-21T15:09:06.394 INFO:teuthology.orchestra.run.smithi161.stdout:3157 read 0x51316fd thru 0x51383a2 (0x6ca6 bytes) 2024-09-21T15:09:06.394 INFO:teuthology.orchestra.run.smithi161.stdout:3159 write 0x11c6e2f thru 0x11d0b07 (0x9cd9 bytes) 2024-09-21T15:09:06.396 INFO:teuthology.orchestra.run.smithi161.stdout:2679 write 0xdcb8a4c thru 0xdcc39cd (0xaf82 bytes) 2024-09-21T15:09:06.418 INFO:teuthology.orchestra.run.smithi161.stdout:2680 write 0x642940e thru 0x6430172 (0x6d65 bytes) 2024-09-21T15:09:06.430 INFO:teuthology.orchestra.run.smithi161.stdout:3160 read 0x24fbf71 thru 0x2509c21 (0xdcb1 bytes) 2024-09-21T15:09:06.431 INFO:teuthology.orchestra.run.smithi161.stdout:3162 read 0x8a22ce7 thru 0x8a2d2bd (0xa5d7 bytes) 2024-09-21T15:09:06.436 INFO:teuthology.orchestra.run.smithi161.stdout:3525 read 0x7b05aa4 thru 0x7b0ba25 (0x5f82 bytes) 2024-09-21T15:09:06.437 INFO:teuthology.orchestra.run.smithi161.stdout:3544 writesame 0x8315583 thru 0x832409a data_size 0x4(0xeb18 bytes) 2024-09-21T15:09:06.437 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.437 INFO:teuthology.orchestra.run.smithi161.stdout:3528 write 0xad9835b thru 0xada5286 (0xcf2c bytes) 2024-09-21T15:09:06.454 INFO:teuthology.orchestra.run.smithi161.stdout:3529 punch from 0x40ef36d to 0x40f0c3e, (0x18d1 bytes) 2024-09-21T15:09:06.454 INFO:teuthology.orchestra.run.smithi161.stdout:3532 punch from 0x4a1d243 to 0x4a22f2e, (0x5ceb bytes) 2024-09-21T15:09:06.454 INFO:teuthology.orchestra.run.smithi161.stdout:3533 writesame 0xca2356b thru 0xca2ba11 data_size 0x1(0x84a7 bytes) 2024-09-21T15:09:06.493 INFO:teuthology.orchestra.run.smithi161.stdout:3545 read 0x4c16e16 thru 0x4c1ccc7 (0x5eb2 bytes) 2024-09-21T15:09:06.495 INFO:teuthology.orchestra.run.smithi161.stdout:3546 writesame 0x2edba1a thru 0x2edea91 data_size 0xc(0x3078 bytes) 2024-09-21T15:09:06.510 INFO:teuthology.orchestra.run.smithi161.stdout:3164 write 0xcf7093a thru 0xcf7e8f2 (0xdfb9 bytes) 2024-09-21T15:09:06.516 INFO:teuthology.orchestra.run.smithi161.stdout:3534 punch from 0x6554663 to 0x655d92b, (0x92c8 bytes) 2024-09-21T15:09:06.516 INFO:teuthology.orchestra.run.smithi161.stdout:3537 punch from 0xb6f52f8 to 0xb7036db, (0xe3e3 bytes) 2024-09-21T15:09:06.516 INFO:teuthology.orchestra.run.smithi161.stdout:3539 read 0xb26a747 thru 0xb27311c (0x89d6 bytes) 2024-09-21T15:09:06.516 INFO:teuthology.orchestra.run.smithi161.stdout:3540 punch from 0x6c3149a to 0x6c408a7, (0xf40d bytes) 2024-09-21T15:09:06.516 INFO:teuthology.orchestra.run.smithi161.stdout:3541 trunc from 0xeac4e11 to 0xed67019 2024-09-21T15:09:06.518 INFO:teuthology.orchestra.run.smithi161.stdout:3706 writesame 0x61bf42b thru 0x61c6b77 data_size 0x1(0x774d bytes) 2024-09-21T15:09:06.522 INFO:teuthology.orchestra.run.smithi161.stdout:2681 write 0xee4ac07 thru 0xee5612e (0xb528 bytes) 2024-09-21T15:09:06.528 INFO:teuthology.orchestra.run.smithi161.stdout:3707 punch from 0x94605d to 0x94f499, (0x943c bytes) 2024-09-21T15:09:06.531 INFO:teuthology.orchestra.run.smithi161.stdout:3547 write 0x7fd5699 thru 0x7fe10a5 (0xba0d bytes) 2024-09-21T15:09:06.552 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.553 INFO:teuthology.orchestra.run.smithi161.stdout:2684 write 0x5b2c0f8 thru 0x5b318dc (0x57e5 bytes) 2024-09-21T15:09:06.555 INFO:teuthology.orchestra.run.smithi161.stdout:3165 writesame 0x9b0db71 thru 0x9b1a469 data_size 0x1(0xc8f9 bytes) 2024-09-21T15:09:06.568 INFO:teuthology.orchestra.run.smithi161.stdout:3578 writesame 0x8e8b836 thru 0x8e91106 data_size 0x35(0x58d1 bytes) 2024-09-21T15:09:06.579 INFO:teuthology.orchestra.run.smithi161.stdout:3580 clone 21 order 18 su 8192 sc 8 2024-09-21T15:09:06.583 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.593 INFO:teuthology.orchestra.run.smithi161.stdout:3549 trunc from 0x9342473 to 0x406b03d 2024-09-21T15:09:06.599 INFO:teuthology.orchestra.run.smithi161.stdout:2687 write 0x1d34cc4 thru 0x1d4389d (0xebda bytes) 2024-09-21T15:09:06.604 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.604 INFO:teuthology.orchestra.run.smithi161.stdout:3543 read 0x32f267c thru 0x32f2f56 (0x8db bytes) 2024-09-21T15:09:06.604 INFO:teuthology.orchestra.run.smithi161.stdout:3544 write 0xc8f99e6 thru 0xc904174 (0xa78f bytes) 2024-09-21T15:09:06.619 INFO:teuthology.orchestra.run.smithi161.stdout:3545 write 0x8ecdf3e thru 0x8ed7636 (0x96f9 bytes) 2024-09-21T15:09:06.621 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.621 INFO:teuthology.orchestra.run.smithi161.stdout:3167 writesame 0x724b785 thru 0x724e452 data_size 0x2(0x2cce bytes) 2024-09-21T15:09:06.624 INFO:teuthology.orchestra.run.smithi161.stdout:3708 write 0x8eb7d89 thru 0x8ebcc6d (0x4ee5 bytes) 2024-09-21T15:09:06.646 INFO:teuthology.orchestra.run.smithi161.stdout:3709 write 0x3fbed23 thru 0x3fc59ed (0x6ccb bytes) 2024-09-21T15:09:06.650 INFO:teuthology.orchestra.run.smithi161.stdout:3168 write 0x95e5aa6 thru 0x95f4d6e (0xf2c9 bytes) 2024-09-21T15:09:06.654 INFO:teuthology.orchestra.run.smithi161.stdout:3546 trunc from 0xed67019 to 0xcd8f1ac 2024-09-21T15:09:06.660 INFO:teuthology.orchestra.run.smithi161.stdout:2688 trunc from 0xee5612f to 0x71a639 2024-09-21T15:09:06.686 INFO:teuthology.orchestra.run.smithi161.stdout:3170 punch from 0xa3021dc to 0xa3068c8, (0x46ec bytes) 2024-09-21T15:09:06.686 INFO:teuthology.orchestra.run.smithi161.stdout:3171 writesame 0xcf00c53 thru 0xcf0a300 data_size 0x9(0x96ae bytes) 2024-09-21T15:09:06.698 INFO:teuthology.orchestra.run.smithi161.stdout:3552 write 0x269947a thru 0x26a3668 (0xa1ef bytes) 2024-09-21T15:09:06.713 INFO:teuthology.orchestra.run.smithi161.stdout:3553 trunc from 0x406b03d to 0x3d0006a 2024-09-21T15:09:06.721 INFO:teuthology.orchestra.run.smithi161.stdout:3175 writesame 0xa9eaf53 thru 0xa9ed8fc data_size 0x1(0x29aa bytes) 2024-09-21T15:09:06.733 INFO:teuthology.orchestra.run.smithi161.stdout:3547 read 0x32257dc thru 0x322f27c (0x9aa1 bytes) 2024-09-21T15:09:06.734 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.734 INFO:teuthology.orchestra.run.smithi161.stdout:3549 read 0xca083d4 thru 0xca0cd9d (0x49ca bytes) 2024-09-21T15:09:06.734 INFO:teuthology.orchestra.run.smithi161.stdout:3550 read 0x3c1c6b2 thru 0x3c23a62 (0x73b1 bytes) 2024-09-21T15:09:06.734 INFO:teuthology.orchestra.run.smithi161.stdout:3551 read 0xa39e967 thru 0xa3a29ae (0x4048 bytes) 2024-09-21T15:09:06.736 INFO:teuthology.orchestra.run.smithi161.stdout:3710 writesame 0xc703965 thru 0xc70ff29 data_size 0x1(0xc5c5 bytes) 2024-09-21T15:09:06.743 INFO:teuthology.orchestra.run.smithi161.stdout:3712 write 0x133f3e thru 0x13e801 (0xa8c4 bytes) 2024-09-21T15:09:06.746 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.746 INFO:teuthology.orchestra.run.smithi161.stdout:3177 write 0x2b6962d thru 0x2b727fa (0x91ce bytes) 2024-09-21T15:09:06.754 INFO:teuthology.orchestra.run.smithi161.stdout:3715 write 0xaf207eb thru 0xaf30104 (0xf91a bytes) 2024-09-21T15:09:06.756 INFO:teuthology.orchestra.run.smithi161.stdout:3552 trunc from 0xcd8f1ac to 0x3324e3d 2024-09-21T15:09:06.756 INFO:teuthology.orchestra.run.smithi161.stdout:2690 read 0x70de9a thru 0x715366 (0x74cd bytes) 2024-09-21T15:09:06.758 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.761 INFO:teuthology.orchestra.run.smithi161.stdout:2692 trunc from 0x71a639 to 0x19c0fc7 2024-09-21T15:09:06.769 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.769 INFO:teuthology.orchestra.run.smithi161.stdout:3181 write 0xb576f22 thru 0xb579482 (0x2561 bytes) 2024-09-21T15:09:06.773 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.773 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.774 INFO:teuthology.orchestra.run.smithi161.stdout:3720 read 0xa399360 thru 0xa3a1c81 (0x8922 bytes) 2024-09-21T15:09:06.774 INFO:teuthology.orchestra.run.smithi161.stdout:3721 read 0x66f3a71 thru 0x66f5727 (0x1cb7 bytes) 2024-09-21T15:09:06.774 INFO:teuthology.orchestra.run.smithi161.stdout:3722 punch from 0x3009b17 to 0x300fabb, (0x5fa4 bytes) 2024-09-21T15:09:06.789 INFO:teuthology.orchestra.run.smithi161.stdout:3183 write 0x81bcb69 thru 0x81c8c22 (0xc0ba bytes) 2024-09-21T15:09:06.797 INFO:teuthology.orchestra.run.smithi161.stdout:2693 read 0x1546535 thru 0x154b18a (0x4c56 bytes) 2024-09-21T15:09:06.797 INFO:teuthology.orchestra.run.smithi161.stdout:2694 read 0x1071f05 thru 0x10797d3 (0x78cf bytes) 2024-09-21T15:09:06.798 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.798 INFO:teuthology.orchestra.run.smithi161.stdout:2698 read 0x91f0da thru 0x9240b4 (0x4fdb bytes) 2024-09-21T15:09:06.798 INFO:teuthology.orchestra.run.smithi161.stdout:2701 punch from 0xb99d2b to 0xba4923, (0xabf8 bytes) 2024-09-21T15:09:06.815 INFO:teuthology.orchestra.run.smithi161.stdout:3184 punch from 0xabe2e5f to 0xabee2ab, (0xb44c bytes) 2024-09-21T15:09:06.815 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.816 INFO:teuthology.orchestra.run.smithi161.stdout:3187 read 0x71dddd thru 0x71e70c (0x930 bytes) 2024-09-21T15:09:06.816 INFO:teuthology.orchestra.run.smithi161.stdout:3553 read 0x2e457f5 thru 0x2e4dff3 (0x87ff bytes) 2024-09-21T15:09:06.816 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.816 INFO:teuthology.orchestra.run.smithi161.stdout:3555 read 0x2bbb755 thru 0x2bc332e (0x7bda bytes) 2024-09-21T15:09:06.817 INFO:teuthology.orchestra.run.smithi161.stdout:3188 punch from 0x57db38e to 0x57de234, (0x2ea6 bytes) 2024-09-21T15:09:06.817 INFO:teuthology.orchestra.run.smithi161.stdout:3190 write 0x5d5d6b0 thru 0x5d5fc17 (0x2568 bytes) 2024-09-21T15:09:06.820 INFO:teuthology.orchestra.run.smithi161.stdout:3556 trunc from 0x3324e3d to 0x4a6c68d 2024-09-21T15:09:06.822 INFO:teuthology.orchestra.run.smithi161.stdout:3723 write 0xc7b19d4 thru 0xc7be7d1 (0xcdfe bytes) 2024-09-21T15:09:06.825 INFO:teuthology.orchestra.run.smithi161.stdout:3554 write 0xd27e0e0 thru 0xd285a20 (0x7941 bytes) 2024-09-21T15:09:06.839 INFO:teuthology.orchestra.run.smithi161.stdout:3191 write 0x1ccd34a thru 0x1cd5d34 (0x89eb bytes) 2024-09-21T15:09:06.849 INFO:teuthology.orchestra.run.smithi161.stdout:3555 write 0xb1dd76 thru 0xb232de (0x5569 bytes) 2024-09-21T15:09:06.855 INFO:teuthology.orchestra.run.smithi161.stdout:2702 write 0x8c888e4 thru 0x8c931db (0xa8f8 bytes) 2024-09-21T15:09:06.865 INFO:teuthology.orchestra.run.smithi161.stdout:3557 read 0x3dd4da5 thru 0x3de2e6b (0xe0c7 bytes) 2024-09-21T15:09:06.865 INFO:teuthology.orchestra.run.smithi161.stdout:3558 read 0x2a370d2 thru 0x2a3d26b (0x619a bytes) 2024-09-21T15:09:06.865 INFO:teuthology.orchestra.run.smithi161.stdout:3559 read 0x21c822 thru 0x2296e4 (0xcec3 bytes) 2024-09-21T15:09:06.867 INFO:teuthology.orchestra.run.smithi161.stdout:3561 punch from 0x16573e8 to 0x165d932, (0x654a bytes) 2024-09-21T15:09:06.867 INFO:teuthology.orchestra.run.smithi161.stdout:3562 punch from 0x349f26d to 0x34a0880, (0x1613 bytes) 2024-09-21T15:09:06.867 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.867 INFO:teuthology.orchestra.run.smithi161.stdout:3566 read 0x3b86dbf thru 0x3b8aa19 (0x3c5b bytes) 2024-09-21T15:09:06.867 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.867 INFO:teuthology.orchestra.run.smithi161.stdout:3568 punch from 0x43a3dba to 0x43abe69, (0x80af bytes) 2024-09-21T15:09:06.867 INFO:teuthology.orchestra.run.smithi161.stdout:3569 punch from 0x2b2de8d to 0x2b3dd85, (0xfef8 bytes) 2024-09-21T15:09:06.869 INFO:teuthology.orchestra.run.smithi161.stdout:3192 punch from 0x8302abd to 0x8311fba, (0xf4fd bytes) 2024-09-21T15:09:06.869 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.869 INFO:teuthology.orchestra.run.smithi161.stdout:3196 punch from 0xa39d45f to 0xa3a50bb, (0x7c5c bytes) 2024-09-21T15:09:06.869 INFO:teuthology.orchestra.run.smithi161.stdout:3197 punch from 0x53b44a2 to 0x53b92b1, (0x4e0f bytes) 2024-09-21T15:09:06.870 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.870 INFO:teuthology.orchestra.run.smithi161.stdout:3559 read 0x1de6d4b thru 0x1df3f64 (0xd21a bytes) 2024-09-21T15:09:06.871 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:06.872 INFO:teuthology.orchestra.run.smithi161.stdout:3561 write 0x92fd41f thru 0x930b535 (0xe117 bytes) 2024-09-21T15:09:06.875 INFO:teuthology.orchestra.run.smithi161.stdout:2704 write 0x33c6dde thru 0x33cafae (0x41d1 bytes) 2024-09-21T15:09:06.882 INFO:teuthology.orchestra.run.smithi161.stdout:3198 trunc from 0xcf7e8f3 to 0x72c2a1c 2024-09-21T15:09:06.896 INFO:teuthology.orchestra.run.smithi161.stdout:3562 writesame 0x754e477 thru 0x7551d63 data_size 0x13(0x38ed bytes) 2024-09-21T15:09:06.899 INFO:teuthology.orchestra.run.smithi161.stdout:2706 punch from 0x559773 to 0x55e34f, (0x4bdc bytes) 2024-09-21T15:09:06.899 INFO:teuthology.orchestra.run.smithi161.stdout:2707 write 0x484cd53 thru 0x4856608 (0x98b6 bytes) 2024-09-21T15:09:06.907 INFO:teuthology.orchestra.run.smithi161.stdout:3725 write 0xe57b445 thru 0xe584eb8 (0x9a74 bytes) 2024-09-21T15:09:06.912 INFO:teuthology.orchestra.run.smithi161.stdout:3563 write 0x2ee9e2c thru 0x2eea33f (0x514 bytes) 2024-09-21T15:09:06.927 INFO:teuthology.orchestra.run.smithi161.stdout:3564 write 0xa2a767e thru 0xa2afa89 (0x840c bytes) 2024-09-21T15:09:06.931 INFO:teuthology.orchestra.run.smithi161.stdout:2709 punch from 0x71c3649 to 0x71ccbc7, (0x957e bytes) 2024-09-21T15:09:06.931 INFO:teuthology.orchestra.run.smithi161.stdout:2712 read 0xdc18a0 thru 0xdc2daa (0x150b bytes) 2024-09-21T15:09:06.931 INFO:teuthology.orchestra.run.smithi161.stdout:2713 write 0xd0d22d thru 0xd17190 (0x9f64 bytes) 2024-09-21T15:09:06.932 INFO:teuthology.orchestra.run.smithi161.stdout:3726 writesame 0x4a43b50 thru 0x4a51d5a data_size 0x1(0xe20b bytes) 2024-09-21T15:09:06.937 INFO:teuthology.orchestra.run.smithi161.stdout:3570 writesame 0xbe1cd00 thru 0xbe2caee data_size 0x5d(0xfdef bytes) 2024-09-21T15:09:06.940 INFO:teuthology.orchestra.run.smithi161.stdout:3571 read 0x6528889 thru 0x65362f2 (0xda6a bytes) 2024-09-21T15:09:06.940 INFO:teuthology.orchestra.run.smithi161.stdout:3572 read 0x956a5a1 thru 0x956e749 (0x41a9 bytes) 2024-09-21T15:09:06.940 INFO:teuthology.orchestra.run.smithi161.stdout:3573 punch from 0xb112d6a to 0xb11b17b, (0x8411 bytes) 2024-09-21T15:09:06.941 INFO:teuthology.orchestra.run.smithi161.stdout:3574 writesame 0xeab524 thru 0xebaccc data_size 0x1(0xf7a9 bytes) 2024-09-21T15:09:07.000 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.001 INFO:teuthology.orchestra.run.smithi161.stdout:3566 writesame 0x3e7a460 thru 0x3e890c6 data_size 0x1(0xec67 bytes) 2024-09-21T15:09:07.002 INFO:teuthology.orchestra.run.smithi161.stdout:3728 write 0xa1601c1 thru 0xa161d33 (0x1b73 bytes) 2024-09-21T15:09:07.003 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.008 INFO:teuthology.orchestra.run.smithi161.stdout:3576 trunc from 0xbe2caef to 0x92bd726 2024-09-21T15:09:07.015 INFO:teuthology.orchestra.run.smithi161.stdout:2715 trunc from 0x8c931dc to 0x29a1051 2024-09-21T15:09:07.031 INFO:teuthology.orchestra.run.smithi161.stdout:3729 read 0x793ab02 thru 0x7942956 (0x7e55 bytes) 2024-09-21T15:09:07.039 INFO:teuthology.orchestra.run.smithi161.stdout:3567 write 0xbd72ed9 thru 0xbd7489c (0x19c4 bytes) 2024-09-21T15:09:07.055 INFO:teuthology.orchestra.run.smithi161.stdout:3568 punch from 0x7b47f77 to 0x7b5376b, (0xb7f4 bytes) 2024-09-21T15:09:07.058 INFO:teuthology.orchestra.run.smithi161.stdout:3569 trunc from 0xd285a21 to 0xe05123a 2024-09-21T15:09:07.063 INFO:teuthology.orchestra.run.smithi161.stdout:3201 read 0x4b38be6 thru 0x4b3e1bb (0x55d6 bytes) 2024-09-21T15:09:07.063 INFO:teuthology.orchestra.run.smithi161.stdout:3203 write 0x6631f54 thru 0x6635a1f (0x3acc bytes) 2024-09-21T15:09:07.066 INFO:teuthology.orchestra.run.smithi161.stdout:3578 read 0x5fa4827 thru 0x5fa52ec (0xac6 bytes) 2024-09-21T15:09:07.067 INFO:teuthology.orchestra.run.smithi161.stdout:3579 punch from 0x5ab4a57 to 0x5ab8b5e, (0x4107 bytes) 2024-09-21T15:09:07.067 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.067 INFO:teuthology.orchestra.run.smithi161.stdout:3581 punch from 0x6879feb to 0x6885a6c, (0xba81 bytes) 2024-09-21T15:09:07.067 INFO:teuthology.orchestra.run.smithi161.stdout:3582 write 0x7fd7562 thru 0x7fd9add (0x257c bytes) 2024-09-21T15:09:07.073 INFO:teuthology.orchestra.run.smithi161.stdout:3730 write 0xe8d66b0 thru 0xe8d6b68 (0x4b9 bytes) 2024-09-21T15:09:07.076 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.076 INFO:teuthology.orchestra.run.smithi161.stdout:3584 read 0x690edb4 thru 0x6916cc3 (0x7f10 bytes) 2024-09-21T15:09:07.077 INFO:teuthology.orchestra.run.smithi161.stdout:3585 writesame 0x91ae4ab thru 0x91b0839 data_size 0x1(0x238f bytes) 2024-09-21T15:09:07.082 INFO:teuthology.orchestra.run.smithi161.stdout:3204 read 0x5ee4a56 thru 0x5eec829 (0x7dd4 bytes) 2024-09-21T15:09:07.085 INFO:teuthology.orchestra.run.smithi161.stdout:3731 read 0x70832af thru 0x70882d6 (0x5028 bytes) 2024-09-21T15:09:07.085 INFO:teuthology.orchestra.run.smithi161.stdout:3733 read 0x203212c thru 0x2034a71 (0x2946 bytes) 2024-09-21T15:09:07.085 INFO:teuthology.orchestra.run.smithi161.stdout:3734 read 0xc6cb3d7 thru 0xc6cb647 (0x271 bytes) 2024-09-21T15:09:07.086 INFO:teuthology.orchestra.run.smithi161.stdout:3735 read 0x3925088 thru 0x3928615 (0x358e bytes) 2024-09-21T15:09:07.086 INFO:teuthology.orchestra.run.smithi161.stdout:3736 write 0x5708a24 thru 0x57179c5 (0xefa2 bytes) 2024-09-21T15:09:07.090 INFO:teuthology.orchestra.run.smithi161.stdout:3571 write 0xc9b216d thru 0xc9b7b1f (0x59b3 bytes) 2024-09-21T15:09:07.093 INFO:teuthology.orchestra.run.smithi161.stdout:3586 read 0x8355d72 thru 0x835b60c (0x589b bytes) 2024-09-21T15:09:07.106 INFO:teuthology.orchestra.run.smithi161.stdout:3737 write 0x9d149c2 thru 0x9d21e4a (0xd489 bytes) 2024-09-21T15:09:07.113 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.122 INFO:teuthology.orchestra.run.smithi161.stdout:2719 write 0x9ee2fc8 thru 0x9eedb5e (0xab97 bytes) 2024-09-21T15:09:07.122 INFO:teuthology.orchestra.run.smithi161.stdout:3575 trunc from 0xe05123a to 0x9815553 2024-09-21T15:09:07.126 INFO:teuthology.orchestra.run.smithi161.stdout:3205 writesame 0xa23fd18 thru 0xa249669 data_size 0x7d(0x9952 bytes) 2024-09-21T15:09:07.136 INFO:teuthology.orchestra.run.smithi161.stdout:3210 trunc from 0xa24966a to 0xd7b64e4 2024-09-21T15:09:07.137 INFO:teuthology.orchestra.run.smithi161.stdout:3738 trunc from 0xe8d6b69 to 0x7bf71e8 2024-09-21T15:09:07.140 INFO:teuthology.orchestra.run.smithi161.stdout:3589 write 0xc7538bc thru 0xc75cd6b (0x94b0 bytes) 2024-09-21T15:09:07.144 INFO:teuthology.orchestra.run.smithi161.stdout:2720 read 0x8ccc0a8 thru 0x8cceb5b (0x2ab4 bytes) 2024-09-21T15:09:07.144 INFO:teuthology.orchestra.run.smithi161.stdout:2722 punch from 0x138eb3f to 0x139c0b2, (0xd573 bytes) 2024-09-21T15:09:07.145 INFO:teuthology.orchestra.run.smithi161.stdout:2723 writesame 0x6399509 thru 0x639971a data_size 0x5(0x212 bytes) 2024-09-21T15:09:07.165 INFO:teuthology.orchestra.run.smithi161.stdout:2724 read 0x48b8933 thru 0x48c1a0a (0x90d8 bytes) 2024-09-21T15:09:07.165 INFO:teuthology.orchestra.run.smithi161.stdout:2726 read 0xfc0736 thru 0xfcf209 (0xead4 bytes) 2024-09-21T15:09:07.166 INFO:teuthology.orchestra.run.smithi161.stdout:2727 read 0x1694497 thru 0x169512e (0xc98 bytes) 2024-09-21T15:09:07.166 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.167 INFO:teuthology.orchestra.run.smithi161.stdout:3590 punch from 0x70143f1 to 0x701e12f, (0x9d3e bytes) 2024-09-21T15:09:07.174 INFO:teuthology.orchestra.run.smithi161.stdout:2730 trunc from 0x9eedb5f to 0x6fc3fc9 2024-09-21T15:09:07.180 INFO:teuthology.orchestra.run.smithi161.stdout:3591 trunc from 0xc75cd6c to 0x7bd8001 2024-09-21T15:09:07.190 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.196 INFO:teuthology.orchestra.run.smithi161.stdout:3212 trunc from 0xd7b64e4 to 0xa4c26bd 2024-09-21T15:09:07.201 INFO:teuthology.orchestra.run.smithi161.stdout:3739 write 0x459d267 thru 0x45a0dc3 (0x3b5d bytes) 2024-09-21T15:09:07.224 INFO:teuthology.orchestra.run.smithi161.stdout:3740 read 0x6db3e9a thru 0x6db94ee (0x5655 bytes) 2024-09-21T15:09:07.227 INFO:teuthology.orchestra.run.smithi161.stdout:3577 writesame 0xbca115a thru 0xbcac7f4 data_size 0x1(0xb69b bytes) 2024-09-21T15:09:07.236 INFO:teuthology.orchestra.run.smithi161.stdout:3593 punch from 0x693e48 to 0x6993ee, (0x55a6 bytes) 2024-09-21T15:09:07.236 INFO:teuthology.orchestra.run.smithi161.stdout:3578 write 0x341f88c thru 0x3429bcf (0xa344 bytes) 2024-09-21T15:09:07.237 INFO:teuthology.orchestra.run.smithi161.stdout:3594 write 0x278b86b thru 0x279b66f (0xfe05 bytes) 2024-09-21T15:09:07.237 INFO:teuthology.orchestra.run.smithi161.stdout:2731 punch from 0x114ec88 to 0x1158b27, (0x9e9f bytes) 2024-09-21T15:09:07.239 INFO:teuthology.orchestra.run.smithi161.stdout:3214 write 0x4a761c2 thru 0x4a77072 (0xeb1 bytes) 2024-09-21T15:09:07.252 INFO:teuthology.orchestra.run.smithi161.stdout:3580 read 0x1846471 thru 0x184bbb2 (0x5742 bytes) 2024-09-21T15:09:07.253 INFO:teuthology.orchestra.run.smithi161.stdout:3581 write 0x78f25c0 thru 0x78f6810 (0x4251 bytes) 2024-09-21T15:09:07.256 INFO:teuthology.orchestra.run.smithi161.stdout:3215 read 0x2fcc009 thru 0x2fd15e2 (0x55da bytes) 2024-09-21T15:09:07.256 INFO:teuthology.orchestra.run.smithi161.stdout:3216 write 0x1c78112 thru 0x1c7d14a (0x5039 bytes) 2024-09-21T15:09:07.257 INFO:teuthology.orchestra.run.smithi161.stdout:3596 trunc from 0x7bd8001 to 0xae31e51 2024-09-21T15:09:07.270 INFO:teuthology.orchestra.run.smithi161.stdout:2732 writesame 0x9be955c thru 0x9bf6299 data_size 0x3f(0xcd3e bytes) 2024-09-21T15:09:07.270 INFO:teuthology.orchestra.run.smithi161.stdout:3582 write 0x886653f thru 0x886b909 (0x53cb bytes) 2024-09-21T15:09:07.277 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.277 INFO:teuthology.orchestra.run.smithi161.stdout:2734 write 0x1b38ff4 thru 0x1b3c82c (0x3839 bytes) 2024-09-21T15:09:07.278 INFO:teuthology.orchestra.run.smithi161.stdout:3741 write 0xde8167b thru 0xde8d14b (0xbad1 bytes) 2024-09-21T15:09:07.288 INFO:teuthology.orchestra.run.smithi161.stdout:3583 write 0x8bff6b6 thru 0x8bffc83 (0x5ce bytes) 2024-09-21T15:09:07.306 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.306 INFO:teuthology.orchestra.run.smithi161.stdout:3599 punch from 0x95e0a42 to 0x95ec87a, (0xbe38 bytes) 2024-09-21T15:09:07.306 INFO:teuthology.orchestra.run.smithi161.stdout:3600 read 0x4769ed6 thru 0x476a8ad (0x9d8 bytes) 2024-09-21T15:09:07.311 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.311 INFO:teuthology.orchestra.run.smithi161.stdout:3603 trunc from 0xae31e51 to 0xcf7b292 2024-09-21T15:09:07.312 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.312 INFO:teuthology.orchestra.run.smithi161.stdout:3742 read 0x1f1c012 thru 0x1f24d71 (0x8d60 bytes) 2024-09-21T15:09:07.312 INFO:teuthology.orchestra.run.smithi161.stdout:3743 write 0x3bd3244 thru 0x3bd964a (0x6407 bytes) 2024-09-21T15:09:07.318 INFO:teuthology.orchestra.run.smithi161.stdout:3219 write 0xc220430 thru 0xc22fc7c (0xf84d bytes) 2024-09-21T15:09:07.333 INFO:teuthology.orchestra.run.smithi161.stdout:3744 writesame 0xcd1aa9f thru 0xcd20e08 data_size 0x19(0x636a bytes) 2024-09-21T15:09:07.352 INFO:teuthology.orchestra.run.smithi161.stdout:3220 read 0x5e40aaa thru 0x5e4d64f (0xcba6 bytes) 2024-09-21T15:09:07.353 INFO:teuthology.orchestra.run.smithi161.stdout:3223 write 0x7aac6ae thru 0x7abadfb (0xe74e bytes) 2024-09-21T15:09:07.362 INFO:teuthology.orchestra.run.smithi161.stdout:3604 read 0x691cd62 thru 0x69207ed (0x3a8c bytes) 2024-09-21T15:09:07.363 INFO:teuthology.orchestra.run.smithi161.stdout:3587 write 0xe333ef5 thru 0xe338f2b (0x5037 bytes) 2024-09-21T15:09:07.363 INFO:teuthology.orchestra.run.smithi161.stdout:3605 clone 24 order 18 su 16384 sc 11 2024-09-21T15:09:07.365 INFO:teuthology.orchestra.run.smithi161.stdout:2736 writesame 0xcf80fbc thru 0xcf8df95 data_size 0x55(0xcfda bytes) 2024-09-21T15:09:07.369 INFO:teuthology.orchestra.run.smithi161.stdout:2738 write 0xa0066a5 thru 0xa00c5a5 (0x5f01 bytes) 2024-09-21T15:09:07.381 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.381 INFO:teuthology.orchestra.run.smithi161.stdout:3590 writesame 0x48ab876 thru 0x48aefcc data_size 0x1(0x3757 bytes) 2024-09-21T15:09:07.384 INFO:teuthology.orchestra.run.smithi161.stdout:3224 read 0x462f8cb thru 0x463811f (0x8855 bytes) 2024-09-21T15:09:07.384 INFO:teuthology.orchestra.run.smithi161.stdout:3225 write 0x40e03fa thru 0x40effe1 (0xfbe8 bytes) 2024-09-21T15:09:07.390 INFO:teuthology.orchestra.run.smithi161.stdout:3746 writesame 0xdffeb5d thru 0xe006d6f data_size 0x43(0x8213 bytes) 2024-09-21T15:09:07.398 INFO:teuthology.orchestra.run.smithi161.stdout:2739 write 0x9718531 thru 0x97196b9 (0x1189 bytes) 2024-09-21T15:09:07.400 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.400 INFO:teuthology.orchestra.run.smithi161.stdout:3593 write 0x793b064 thru 0x794477c (0x9719 bytes) 2024-09-21T15:09:07.409 INFO:teuthology.orchestra.run.smithi161.stdout:3747 read 0x166c6a6 thru 0x166ea84 (0x23df bytes) 2024-09-21T15:09:07.410 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.410 INFO:teuthology.orchestra.run.smithi161.stdout:3749 read 0x31ff782 thru 0x3206d68 (0x75e7 bytes) 2024-09-21T15:09:07.410 INFO:teuthology.orchestra.run.smithi161.stdout:3750 write 0x5f68e71 thru 0x5f772b9 (0xe449 bytes) 2024-09-21T15:09:07.418 INFO:teuthology.orchestra.run.smithi161.stdout:2740 read 0x467feca thru 0x4686124 (0x625b bytes) 2024-09-21T15:09:07.428 INFO:teuthology.orchestra.run.smithi161.stdout:2741 trunc from 0xcf8df96 to 0x776035c 2024-09-21T15:09:07.429 INFO:teuthology.orchestra.run.smithi161.stdout:3226 read 0x64fc4bf thru 0x650a9cc (0xe50e bytes) 2024-09-21T15:09:07.429 INFO:teuthology.orchestra.run.smithi161.stdout:3751 write 0xd5fb8c3 thru 0xd5feb08 (0x3246 bytes) 2024-09-21T15:09:07.430 INFO:teuthology.orchestra.run.smithi161.stdout:3227 writesame 0x5793d7b thru 0x57a2661 data_size 0x1(0xe8e7 bytes) 2024-09-21T15:09:07.434 INFO:teuthology.orchestra.run.smithi161.stdout:3595 clone 19 order 19 su 131072 sc 9 2024-09-21T15:09:07.449 INFO:teuthology.orchestra.run.smithi161.stdout:3758 write 0x97b00d0 thru 0x97ba8f5 (0xa826 bytes) 2024-09-21T15:09:07.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5d40 2024-09-21T15:09:07.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae4ce820 2024-09-21T15:09:07.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae4cf450 2024-09-21T15:09:07.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810b60 2024-09-21T15:09:07.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810dd0 2024-09-21T15:09:07.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1cdd0 2024-09-21T15:09:07.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1cea0 2024-09-21T15:09:07.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1d2b0 2024-09-21T15:09:07.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1d930 2024-09-21T15:09:07.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a4e0 2024-09-21T15:09:07.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:09:07.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b040 2024-09-21T15:09:07.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b790 2024-09-21T15:09:07.492 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aee60750 2024-09-21T15:09:07.492 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aee61c70 2024-09-21T15:09:07.492 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af842270 2024-09-21T15:09:07.492 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac04e0 2024-09-21T15:09:07.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac0a90 2024-09-21T15:09:07.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac1c70 2024-09-21T15:09:07.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:09:07.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd2b0 2024-09-21T15:09:07.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd450 2024-09-21T15:09:07.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd860 2024-09-21T15:09:07.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:09:07.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afe7ed00 2024-09-21T15:09:07.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c821a0 2024-09-21T15:09:07.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:07.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c82ea0 2024-09-21T15:09:07.500 INFO:teuthology.orchestra.run.smithi161.stdout:3760 write 0xaddef73 thru 0xade6eee (0x7f7c bytes) 2024-09-21T15:09:07.519 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:07.520+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa1e80d0 2024-09-21T15:09:07.519 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:07.520+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa338820 2024-09-21T15:09:07.519 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:07.520+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa339110 2024-09-21T15:09:07.519 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:07.520+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa4dcea0 2024-09-21T15:09:07.521 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:07.520+0000 7f7fd044c700 -1 reset not still connected to 0x5636aea724e0 2024-09-21T15:09:07.521 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:07.520+0000 7f7fd044c700 -1 reset not still connected to 0x5636aea72750 2024-09-21T15:09:07.521 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:07.520+0000 7f7fd044c700 -1 reset not still connected to 0x5636aebddee0 2024-09-21T15:09:07.522 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:07.520+0000 7f7fd044c700 -1 reset not still connected to 0x5636b11416c0 2024-09-21T15:09:07.523 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:07.524+0000 7f7fd044c700 -1 reset not still connected to 0x5636b118a750 2024-09-21T15:09:07.523 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:07.524+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41aa000 2024-09-21T15:09:07.523 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:07.524+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41aa270 2024-09-21T15:09:07.523 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:07.524+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41abc70 2024-09-21T15:09:07.523 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:07.524+0000 7f7fd044c700 -1 reset not still connected to 0x5636b494ed00 2024-09-21T15:09:07.541 INFO:teuthology.orchestra.run.smithi161.stdout:3761 punch from 0x2e7c372 to 0x2e8ab0e, (0xe79c bytes) 2024-09-21T15:09:07.541 INFO:teuthology.orchestra.run.smithi161.stdout:3763 read 0x43c97c thru 0x4421a5 (0x582a bytes) 2024-09-21T15:09:07.541 INFO:teuthology.orchestra.run.smithi161.stdout:3228 writesame 0xee372c9 thru 0xee395dc data_size 0xa(0x2314 bytes) 2024-09-21T15:09:07.542 INFO:teuthology.orchestra.run.smithi161.stdout:3764 read 0x64760d8 thru 0x647e8bf (0x87e8 bytes) 2024-09-21T15:09:07.542 INFO:teuthology.orchestra.run.smithi161.stdout:3765 read 0x4c56073 thru 0x4c62c21 (0xcbaf bytes) 2024-09-21T15:09:07.549 INFO:teuthology.orchestra.run.smithi161.stdout:3230 writesame 0x6675434 thru 0x6679cad data_size 0x1(0x487a bytes) 2024-09-21T15:09:07.562 INFO:teuthology.orchestra.run.smithi161.stdout:3767 trunc from 0xe006d70 to 0x3d26cf3 2024-09-21T15:09:07.581 INFO:teuthology.orchestra.run.smithi161.stdout:3232 read 0x94c3ced thru 0x94d0685 (0xc999 bytes) 2024-09-21T15:09:07.589 INFO:teuthology.orchestra.run.smithi161.stdout:2742 writesame 0xe4d1dc1 thru 0xe4d6130 data_size 0x53(0x4370 bytes) 2024-09-21T15:09:07.596 INFO:teuthology.orchestra.run.smithi161.stdout:2743 read 0x3bdb7e1 thru 0x3bea980 (0xf1a0 bytes) 2024-09-21T15:09:07.596 INFO:teuthology.orchestra.run.smithi161.stdout:2744 clone 33 order 20 su 524288 sc 4 2024-09-21T15:09:07.608 INFO:teuthology.orchestra.run.smithi161.stdout:3235 trunc from 0xee395dd to 0x47f31a 2024-09-21T15:09:07.641 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.641 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.641 INFO:teuthology.orchestra.run.smithi161.stdout:3771 read 0x2eae5d3 thru 0x2eb30da (0x4b08 bytes) 2024-09-21T15:09:07.697 INFO:teuthology.orchestra.run.smithi161.stdout:3773 write 0x8d26b28 thru 0x8d2727c (0x755 bytes) 2024-09-21T15:09:07.740 INFO:teuthology.orchestra.run.smithi161.stdout:3236 read 0x3df7d thru 0x40600 (0x2684 bytes) 2024-09-21T15:09:07.745 INFO:teuthology.orchestra.run.smithi161.stdout:3237 trunc from 0x47f31a to 0x28a8b75 2024-09-21T15:09:07.757 INFO:teuthology.orchestra.run.smithi161.stdout:3774 write 0xadc1570 thru 0xadc6cff (0x5790 bytes) 2024-09-21T15:09:07.773 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.796 INFO:teuthology.orchestra.run.smithi161.stdout:3239 trunc from 0x28a8b75 to 0x99affcc 2024-09-21T15:09:07.800 INFO:teuthology.orchestra.run.smithi161.stdout:3775 trunc from 0xadc6d00 to 0x1d26f63 2024-09-21T15:09:07.840 INFO:teuthology.orchestra.run.smithi161.stdout:3241 trunc from 0x99affcc to 0x69e7181 2024-09-21T15:09:07.869 INFO:teuthology.orchestra.run.smithi161.stdout:3242 read 0x6ec9e5 thru 0x6ef45a (0x2a76 bytes) 2024-09-21T15:09:07.872 INFO:teuthology.orchestra.run.smithi161.stdout:3777 trunc from 0x1d26f63 to 0x8444ac4 2024-09-21T15:09:07.872 INFO:teuthology.orchestra.run.smithi161.stdout:3243 read 0x67f2c8 thru 0x68a70a (0xb443 bytes) 2024-09-21T15:09:07.873 INFO:teuthology.orchestra.run.smithi161.stdout:3244 read 0x4e80d2d thru 0x4e8820e (0x74e2 bytes) 2024-09-21T15:09:07.874 INFO:teuthology.orchestra.run.smithi161.stdout:3245 write 0x3c6657a thru 0x3c66917 (0x39e bytes) 2024-09-21T15:09:07.897 INFO:teuthology.orchestra.run.smithi161.stdout:3247 trunc from 0x69e7181 to 0x4b23522 2024-09-21T15:09:07.899 INFO:teuthology.orchestra.run.smithi161.stdout:3779 read 0x1e4abaa thru 0x1e58123 (0xd57a bytes) 2024-09-21T15:09:07.902 INFO:teuthology.orchestra.run.smithi161.stdout:3784 trunc from 0x8444ac4 to 0x6abf1cb 2024-09-21T15:09:07.925 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #19, image image_cluster1.client.mirror.5-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent20 2024-09-21T15:09:07.936 INFO:teuthology.orchestra.run.smithi161.stdout:3785 write 0x4ff91e3 thru 0x4ffea27 (0x5845 bytes) 2024-09-21T15:09:07.939 INFO:teuthology.orchestra.run.smithi161.stdout:3248 write 0x6a5e29 thru 0x6a7c51 (0x1e29 bytes) 2024-09-21T15:09:07.952 INFO:teuthology.orchestra.run.smithi161.stdout:3786 read 0x3134955 thru 0x31416a1 (0xcd4d bytes) 2024-09-21T15:09:07.952 INFO:teuthology.orchestra.run.smithi161.stdout:3787 read 0x173ba9d thru 0x174565b (0x9bbf bytes) 2024-09-21T15:09:07.953 INFO:teuthology.orchestra.run.smithi161.stdout:3788 write 0xa324c7 thru 0xa3dd66 (0xb8a0 bytes) 2024-09-21T15:09:07.958 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:07.972 INFO:teuthology.orchestra.run.smithi161.stdout:3789 read 0x1743953 thru 0x17471f0 (0x389e bytes) 2024-09-21T15:09:07.988 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #17, image image_cluster1.client.mirror.1-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent18 2024-09-21T15:09:07.991 INFO:teuthology.orchestra.run.smithi161.stdout:3254 trunc from 0x4b23522 to 0xb6f2d58 2024-09-21T15:09:08.022 INFO:teuthology.orchestra.run.smithi161.stdout:3790 write 0xd5aa858 thru 0xd5ba75a (0xff03 bytes) 2024-09-21T15:09:08.027 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #22, image image_cluster1.client.mirror.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent23 2024-09-21T15:09:08.037 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.037 INFO:teuthology.orchestra.run.smithi161.stdout:3257 read 0x8a93b7 thru 0x8aaa71 (0x16bb bytes) 2024-09-21T15:09:08.038 INFO:teuthology.orchestra.run.smithi161.stdout:3258 write 0xaed7cd2 thru 0xaee275c (0xaa8b bytes) 2024-09-21T15:09:08.043 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.043 INFO:teuthology.orchestra.run.smithi161.stdout:3794 write 0xb4a7439 thru 0xb4b2e8c (0xba54 bytes) 2024-09-21T15:09:08.057 INFO:teuthology.orchestra.run.smithi161.stdout:3795 punch from 0x59ff106 to 0x5a0ae18, (0xbd12 bytes) 2024-09-21T15:09:08.057 INFO:teuthology.orchestra.run.smithi161.stdout:3798 write 0xc5e5e5e thru 0xc5f175d (0xb900 bytes) 2024-09-21T15:09:08.067 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.067 INFO:teuthology.orchestra.run.smithi161.stdout:3260 punch from 0x5ba3388 to 0x5baaede, (0x7b56 bytes) 2024-09-21T15:09:08.068 INFO:teuthology.orchestra.run.smithi161.stdout:3262 read 0x76b2863 thru 0x76bf376 (0xcb14 bytes) 2024-09-21T15:09:08.068 INFO:teuthology.orchestra.run.smithi161.stdout:3263 write 0x2f7426c thru 0x2f751ad (0xf42 bytes) 2024-09-21T15:09:08.076 INFO:teuthology.orchestra.run.smithi161.stdout:3800 punch from 0x53c5b0c to 0x53ccc4e, (0x7142 bytes) 2024-09-21T15:09:08.077 INFO:teuthology.orchestra.run.smithi161.stdout:3801 write 0x325c276 thru 0x325ffc5 (0x3d50 bytes) 2024-09-21T15:09:08.079 INFO:teuthology.orchestra.run.smithi161.stdout:3265 read 0x3cdca29 thru 0x3ce817f (0xb757 bytes) 2024-09-21T15:09:08.079 INFO:teuthology.orchestra.run.smithi161.stdout:3266 punch from 0x629b6ec to 0x629d3c1, (0x1cd5 bytes) 2024-09-21T15:09:08.079 INFO:teuthology.orchestra.run.smithi161.stdout:3267 punch from 0x277c076 to 0x278b940, (0xf8ca bytes) 2024-09-21T15:09:08.079 INFO:teuthology.orchestra.run.smithi161.stdout:3268 writesame 0x95294f6 thru 0x952d286 data_size 0x1(0x3d91 bytes) 2024-09-21T15:09:08.094 INFO:teuthology.orchestra.run.smithi161.stdout:3804 writesame 0xc672712 thru 0xc67789d data_size 0x2(0x518c bytes) 2024-09-21T15:09:08.157 INFO:teuthology.orchestra.run.smithi161.stdout:3270 read 0x574c8bb thru 0x575652b (0x9c71 bytes) 2024-09-21T15:09:08.235 INFO:teuthology.orchestra.run.smithi161.stdout:3806 trunc from 0xd5ba75b to 0xc26c2b1 2024-09-21T15:09:08.275 INFO:teuthology.orchestra.run.smithi161.stdout:3271 write 0xc1e0f8a thru 0xc1ee3e8 (0xd45f bytes) 2024-09-21T15:09:08.303 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.303 INFO:teuthology.orchestra.run.smithi161.stdout:3273 writesame 0x92552f1 thru 0x9255436 data_size 0x1(0x146 bytes) 2024-09-21T15:09:08.312 INFO:teuthology.orchestra.run.smithi161.stdout:3274 read 0x39b051c thru 0x39be1bd (0xdca2 bytes) 2024-09-21T15:09:08.313 INFO:teuthology.orchestra.run.smithi161.stdout:3275 write 0x813c3e4 thru 0x813f935 (0x3552 bytes) 2024-09-21T15:09:08.318 INFO:teuthology.orchestra.run.smithi161.stdout:3807 write 0x589f9b7 thru 0x58a30af (0x36f9 bytes) 2024-09-21T15:09:08.336 INFO:teuthology.orchestra.run.smithi161.stdout:3810 read 0xad60ecb thru 0xad6dacf (0xcc05 bytes) 2024-09-21T15:09:08.337 INFO:teuthology.orchestra.run.smithi161.stdout:3811 write 0x47f292 thru 0x486da3 (0x7b12 bytes) 2024-09-21T15:09:08.350 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.351 INFO:teuthology.orchestra.run.smithi161.stdout:3584 read 0x1ba4d47 thru 0x1ba78f9 (0x2bb3 bytes) 2024-09-21T15:09:08.351 INFO:teuthology.orchestra.run.smithi161.stdout:3812 writesame 0x189dcde thru 0x18a9da9 data_size 0x36(0xc0cc bytes) 2024-09-21T15:09:08.360 INFO:teuthology.orchestra.run.smithi161.stdout:3813 write 0x9ae758e thru 0x9af74d9 (0xff4c bytes) 2024-09-21T15:09:08.374 INFO:teuthology.orchestra.run.smithi161.stdout:3276 write 0xce7f62c thru 0xce86ba1 (0x7576 bytes) 2024-09-21T15:09:08.375 INFO:teuthology.orchestra.run.smithi161.stdout:3585 punch from 0xc7b87 to 0xd6d0a, (0xf183 bytes) 2024-09-21T15:09:08.376 INFO:teuthology.orchestra.run.smithi161.stdout:3586 punch from 0x2937beb to 0x2940388, (0x879d bytes) 2024-09-21T15:09:08.376 INFO:teuthology.orchestra.run.smithi161.stdout:3587 punch from 0x53ffe49 to 0x540060d, (0x7c4 bytes) 2024-09-21T15:09:08.376 INFO:teuthology.orchestra.run.smithi161.stdout:3589 write 0x55776a3 thru 0x5584fa5 (0xd903 bytes) 2024-09-21T15:09:08.376 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.376 INFO:teuthology.orchestra.run.smithi161.stdout:3816 read 0x7b6f2db thru 0x7b7939b (0xa0c1 bytes) 2024-09-21T15:09:08.376 INFO:teuthology.orchestra.run.smithi161.stdout:3817 read 0x726316c thru 0x7265fbf (0x2e54 bytes) 2024-09-21T15:09:08.376 INFO:teuthology.orchestra.run.smithi161.stdout:3819 write 0xb942b2c thru 0xb94eefb (0xc3d0 bytes) 2024-09-21T15:09:08.384 INFO:teuthology.orchestra.run.smithi161.stdout:3606 write 0x55f7480 thru 0x5606d71 (0xf8f2 bytes) 2024-09-21T15:09:08.396 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.396 INFO:teuthology.orchestra.run.smithi161.stdout:3279 write 0x9e3c6ce thru 0x9e47df7 (0xb72a bytes) 2024-09-21T15:09:08.407 INFO:teuthology.orchestra.run.smithi161.stdout:3822 read 0x2d0dd7f thru 0x2d0de0a (0x8c bytes) 2024-09-21T15:09:08.407 INFO:teuthology.orchestra.run.smithi161.stdout:3824 read 0x509bbd9 thru 0x50a88c2 (0xccea bytes) 2024-09-21T15:09:08.440 INFO:teuthology.orchestra.run.smithi161.stdout:3280 trunc from 0xce86ba2 to 0x3671a13 2024-09-21T15:09:08.448 INFO:teuthology.orchestra.run.smithi161.stdout:3607 punch from 0x51b9096 to 0x51c4275, (0xb1df bytes) 2024-09-21T15:09:08.448 INFO:teuthology.orchestra.run.smithi161.stdout:3608 write 0x78d0c9 thru 0x79867f (0xb5b7 bytes) 2024-09-21T15:09:08.463 INFO:teuthology.orchestra.run.smithi161.stdout:3826 write 0xe54734f thru 0xe552acd (0xb77f bytes) 2024-09-21T15:09:08.522 INFO:teuthology.orchestra.run.smithi161.stdout:3609 write 0x1840710 thru 0x184caf5 (0xc3e6 bytes) 2024-09-21T15:09:08.525 INFO:teuthology.orchestra.run.smithi161.stdout:3590 write 0xc2c1fec thru 0xc2c2f25 (0xf3a bytes) 2024-09-21T15:09:08.525 INFO:teuthology.orchestra.run.smithi161.stdout:3828 write 0x3b6bdce thru 0x3b7393f (0x7b72 bytes) 2024-09-21T15:09:08.541 INFO:teuthology.orchestra.run.smithi161.stdout:3591 read 0x2be03fc thru 0x2beda1e (0xd623 bytes) 2024-09-21T15:09:08.549 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.549 INFO:teuthology.orchestra.run.smithi161.stdout:3282 read 0x14b48c thru 0x14ed51 (0x38c6 bytes) 2024-09-21T15:09:08.555 INFO:teuthology.orchestra.run.smithi161.stdout:3830 trunc from 0xe552ace to 0x7dd43c7 2024-09-21T15:09:08.557 INFO:teuthology.orchestra.run.smithi161.stdout:3592 trunc from 0xc2c2f26 to 0x52b25bf 2024-09-21T15:09:08.575 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.596 INFO:teuthology.orchestra.run.smithi161.stdout:3611 trunc from 0xcf7b292 to 0x1aa8576 2024-09-21T15:09:08.619 INFO:teuthology.orchestra.run.smithi161.stdout:3283 write 0xeb38735 thru 0xeb43cdf (0xb5ab bytes) 2024-09-21T15:09:08.627 INFO:teuthology.orchestra.run.smithi161.stdout:3831 read 0x7da7254 thru 0x7db188c (0xa639 bytes) 2024-09-21T15:09:08.631 INFO:teuthology.orchestra.run.smithi161.stdout:3832 trunc from 0x7dd43c7 to 0x5b762a2 2024-09-21T15:09:08.651 INFO:teuthology.orchestra.run.smithi161.stdout:3284 read 0x674bc25 thru 0x67517b1 (0x5b8d bytes) 2024-09-21T15:09:08.659 INFO:teuthology.orchestra.run.smithi161.stdout:3285 trunc from 0xeb43ce0 to 0xa74c9b2 2024-09-21T15:09:08.667 INFO:teuthology.orchestra.run.smithi161.stdout:3834 write 0x4330689 thru 0x43319db (0x1353 bytes) 2024-09-21T15:09:08.668 INFO:teuthology.orchestra.run.smithi161.stdout:3597 writesame 0x16d3e01 thru 0x16d7ff3 data_size 0x1(0x41f3 bytes) 2024-09-21T15:09:08.669 INFO:teuthology.orchestra.run.smithi161.stdout:3593 writesame 0x277c80d thru 0x278a2c2 data_size 0xb(0xdab6 bytes) 2024-09-21T15:09:08.732 INFO:teuthology.orchestra.run.smithi161.stdout:3595 punch from 0x3592544 to 0x35965ef, (0x40ab bytes) 2024-09-21T15:09:08.733 INFO:teuthology.orchestra.run.smithi161.stdout:3596 punch from 0x208dc2e to 0x2096e1a, (0x91ec bytes) 2024-09-21T15:09:08.733 INFO:teuthology.orchestra.run.smithi161.stdout:3598 read 0xa1ab11b thru 0xa1bab90 (0xfa76 bytes) 2024-09-21T15:09:08.733 INFO:teuthology.orchestra.run.smithi161.stdout:3599 read 0xa8bd805 thru 0xa8c6221 (0x8a1d bytes) 2024-09-21T15:09:08.734 INFO:teuthology.orchestra.run.smithi161.stdout:3601 writesame 0x8f87074 thru 0x8f92f94 data_size 0x1(0xbf21 bytes) 2024-09-21T15:09:08.735 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone32 from 0xe4d6131 (overlap 0x658b5b) to 0x32c5ad 2024-09-21T15:09:08.743 INFO:teuthology.orchestra.run.smithi161.stdout:3287 read 0x4d84958 thru 0x4d94376 (0xfa1f bytes) 2024-09-21T15:09:08.744 INFO:teuthology.orchestra.run.smithi161.stdout:3289 read 0x31a4cd7 thru 0x31ae598 (0x98c2 bytes) 2024-09-21T15:09:08.744 INFO:teuthology.orchestra.run.smithi161.stdout:3597 trunc from 0x52b25bf to 0xbd24435 2024-09-21T15:09:08.744 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.744 INFO:teuthology.orchestra.run.smithi161.stdout:3292 read 0x8f8faf4 thru 0x8f97068 (0x7575 bytes) 2024-09-21T15:09:08.750 INFO:teuthology.orchestra.run.smithi161.stdout:3836 write 0x8d8ab4b thru 0x8d8f7ff (0x4cb5 bytes) 2024-09-21T15:09:08.767 INFO:teuthology.orchestra.run.smithi161.stdout:3837 read 0x156eb93 thru 0x157a586 (0xb9f4 bytes) 2024-09-21T15:09:08.768 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.768 INFO:teuthology.orchestra.run.smithi161.stdout:3841 trunc from 0x8d8f800 to 0x8c58590 2024-09-21T15:09:08.783 INFO:teuthology.orchestra.run.smithi161.stdout:3602 write 0xc967468 thru 0xc96b3c3 (0x3f5c bytes) 2024-09-21T15:09:08.785 INFO:teuthology.orchestra.run.smithi161.stdout:3598 read 0x61febf7 thru 0x620cb76 (0xdf80 bytes) 2024-09-21T15:09:08.790 INFO:teuthology.orchestra.run.smithi161.stdout:3599 trunc from 0xbd24435 to 0xd5a7517 2024-09-21T15:09:08.803 INFO:teuthology.orchestra.run.smithi161.stdout:3294 write 0xd3a1ec8 thru 0xd3af57b (0xd6b4 bytes) 2024-09-21T15:09:08.804 INFO:teuthology.orchestra.run.smithi161.stdout:3603 writesame 0x7b1a9d1 thru 0x7b299bc data_size 0x1(0xefec bytes) 2024-09-21T15:09:08.805 INFO:teuthology.orchestra.run.smithi161.stdout:3612 read 0xd0f224 thru 0xd16f75 (0x7d52 bytes) 2024-09-21T15:09:08.807 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.808 INFO:teuthology.orchestra.run.smithi161.stdout:3614 read 0x1a2adb4 thru 0x1a3a0a4 (0xf2f1 bytes) 2024-09-21T15:09:08.826 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.828 INFO:teuthology.orchestra.run.smithi161.stdout:3615 trunc from 0x1aa8576 to 0xb794fae 2024-09-21T15:09:08.856 INFO:teuthology.orchestra.run.smithi161.stdout:3604 read 0xf07d72 thru 0xf09d71 (0x2000 bytes) 2024-09-21T15:09:08.857 INFO:teuthology.orchestra.run.smithi161.stdout:3605 write 0xc0c1a13 thru 0xc0d0541 (0xeb2f bytes) 2024-09-21T15:09:08.857 INFO:teuthology.orchestra.run.smithi161.stdout:3601 trunc from 0xd5a7517 to 0x22e39fb 2024-09-21T15:09:08.868 INFO:teuthology.orchestra.run.smithi161.stdout:3295 write 0x53d43d8 thru 0x53d4a30 (0x659 bytes) 2024-09-21T15:09:08.888 INFO:teuthology.orchestra.run.smithi161.stdout:3607 write 0xd1cccaa thru 0xd1d94a0 (0xc7f7 bytes) 2024-09-21T15:09:08.900 INFO:teuthology.orchestra.run.smithi161.stdout:3296 write 0x65a2aa thru 0x667d69 (0xdac0 bytes) 2024-09-21T15:09:08.938 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.938 INFO:teuthology.orchestra.run.smithi161.stdout:3609 write 0x885ee3a thru 0x8860a31 (0x1bf8 bytes) 2024-09-21T15:09:08.944 INFO:teuthology.orchestra.run.smithi161.stdout:3616 trunc from 0xb794fae to 0x8c351c 2024-09-21T15:09:08.964 INFO:teuthology.orchestra.run.smithi161.stdout:3842 writesame 0xea2b05b thru 0xea36252 data_size 0x88(0xb1f8 bytes) 2024-09-21T15:09:08.972 INFO:teuthology.orchestra.run.smithi161.stdout:3297 punch from 0xa4ae7bd to 0xa4aec1e, (0x461 bytes) 2024-09-21T15:09:08.974 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.974 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.974 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:08.986 INFO:teuthology.orchestra.run.smithi161.stdout:3301 trunc from 0xd3af57c to 0x964d5cc 2024-09-21T15:09:09.001 INFO:teuthology.orchestra.run.smithi161.stdout:3843 write 0xdffa4c0 thru 0xdffb923 (0x1464 bytes) 2024-09-21T15:09:09.019 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.019 INFO:teuthology.orchestra.run.smithi161.stdout:3613 write 0x4fe9dfd thru 0x4ff7884 (0xda88 bytes) 2024-09-21T15:09:09.037 INFO:teuthology.orchestra.run.smithi161.stdout:3845 punch from 0x85931d8 to 0x8599283, (0x60ab bytes) 2024-09-21T15:09:09.037 INFO:teuthology.orchestra.run.smithi161.stdout:3846 write 0xb3ab220 thru 0xb3b41e7 (0x8fc8 bytes) 2024-09-21T15:09:09.052 INFO:teuthology.orchestra.run.smithi161.stdout:3614 write 0x8d7531a thru 0x8d7a01c (0x4d03 bytes) 2024-09-21T15:09:09.076 INFO:teuthology.orchestra.run.smithi161.stdout:3847 writesame 0x9a466d7 thru 0x9a47a94 data_size 0x13(0x13be bytes) 2024-09-21T15:09:09.080 INFO:teuthology.orchestra.run.smithi161.stdout:3615 read 0x2a2bb22 thru 0x2a347a6 (0x8c85 bytes) 2024-09-21T15:09:09.084 INFO:teuthology.orchestra.run.smithi161.stdout:3617 writesame 0x7606194 thru 0x7609198 data_size 0x1(0x3005 bytes) 2024-09-21T15:09:09.097 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #31, image image_cluster1.client.mirror.3-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent32 2024-09-21T15:09:09.112 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.112 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.112 INFO:teuthology.orchestra.run.smithi161.stdout:3620 read 0xa6ea774 thru 0xa6ef955 (0x51e2 bytes) 2024-09-21T15:09:09.113 INFO:teuthology.orchestra.run.smithi161.stdout:3621 write 0xa7d5699 thru 0xa7df7f0 (0xa158 bytes) 2024-09-21T15:09:09.115 INFO:teuthology.orchestra.run.smithi161.stdout:3849 write 0x51fbd95 thru 0x51fdf82 (0x21ee bytes) 2024-09-21T15:09:09.118 INFO:teuthology.orchestra.run.smithi161.stdout:3302 writesame 0xa6b870d thru 0xa6c81df data_size 0x1(0xfad3 bytes) 2024-09-21T15:09:09.134 INFO:teuthology.orchestra.run.smithi161.stdout:3850 writesame 0xe147208 thru 0xe157099 data_size 0xbe(0xfe92 bytes) 2024-09-21T15:09:09.138 INFO:teuthology.orchestra.run.smithi161.stdout:3622 write 0x449190 thru 0x44a2f5 (0x1166 bytes) 2024-09-21T15:09:09.147 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:09.144+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb2c2d20 handle_clone_image: failed to clone image mirror/10b74908e44c to image_cluster1.client.mirror.5-clone21 2024-09-21T15:09:09.157 INFO:teuthology.orchestra.run.smithi161.stdout:3851 read 0x37c2bed thru 0x37cce2c (0xa240 bytes) 2024-09-21T15:09:09.157 INFO:teuthology.orchestra.run.smithi161.stdout:3623 read 0x3c73ef5 thru 0x3c82f02 (0xf00e bytes) 2024-09-21T15:09:09.159 INFO:teuthology.orchestra.run.smithi161.stdout:3624 writesame 0x4d44858 thru 0x4d47bc2 data_size 0x1(0x336b bytes) 2024-09-21T15:09:09.165 INFO:teuthology.orchestra.run.smithi161.stdout:3852 trunc from 0xea36253 to 0xad5d551 2024-09-21T15:09:09.170 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.173 INFO:teuthology.orchestra.run.smithi161.stdout:3303 write 0xb433168 thru 0xb442b92 (0xfa2b bytes) 2024-09-21T15:09:09.178 INFO:teuthology.orchestra.run.smithi161.stdout:3625 writesame 0x57f2f32 thru 0x57fa7d9 data_size 0x8f(0x78a8 bytes) 2024-09-21T15:09:09.196 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.196 INFO:teuthology.orchestra.run.smithi161.stdout:3627 write 0x7d059bf thru 0x7d08186 (0x27c8 bytes) 2024-09-21T15:09:09.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:09.200+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb7a0b40 handle_clone_image: failed to clone image mirror/10b562439196 to image_cluster1.client.mirror.0-clone24 2024-09-21T15:09:09.209 INFO:teuthology.orchestra.run.smithi161.stdout:3304 read 0x23892b9 thru 0x238b79c (0x24e4 bytes) 2024-09-21T15:09:09.209 INFO:teuthology.orchestra.run.smithi161.stdout:3305 write 0xad8e780 thru 0xad96a4c (0x82cd bytes) 2024-09-21T15:09:09.243 INFO:teuthology.orchestra.run.smithi161.stdout:3617 write 0xacbb2b7 thru 0xacc93ea (0xe134 bytes) 2024-09-21T15:09:09.248 INFO:teuthology.orchestra.run.smithi161.stdout:3307 write 0xa59db22 thru 0xa5ab6ce (0xdbad bytes) 2024-09-21T15:09:09.251 INFO:teuthology.orchestra.run.smithi161.stdout:2745 read 0x63270e9 thru 0x6332ca2 (0xbbba bytes) 2024-09-21T15:09:09.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:09.248+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6a90 2024-09-21T15:09:09.256 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:09.248+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e72b0 2024-09-21T15:09:09.258 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:09.252+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72ea0 2024-09-21T15:09:09.263 INFO:teuthology.orchestra.run.smithi161.stdout:3603 writesame 0xd7a47a2 thru 0xd7b3830 data_size 0x1(0xf08f bytes) 2024-09-21T15:09:09.271 INFO:teuthology.orchestra.run.smithi161.stdout:3604 write 0xa8587da thru 0xa858fa8 (0x7cf bytes) 2024-09-21T15:09:09.273 INFO:teuthology.orchestra.run.smithi161.stdout:3629 trunc from 0xe338f2c to 0xfed3b2 2024-09-21T15:09:09.280 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.280 INFO:teuthology.orchestra.run.smithi161.stdout:3309 read 0x3a90b0 thru 0x3b6e8d (0xddde bytes) 2024-09-21T15:09:09.280 INFO:teuthology.orchestra.run.smithi161.stdout:3618 punch from 0x1c21874 to 0x1c24df4, (0x3580 bytes) 2024-09-21T15:09:09.280 INFO:teuthology.orchestra.run.smithi161.stdout:3619 write 0x1969f4d thru 0x1978f37 (0xefeb bytes) 2024-09-21T15:09:09.284 INFO:teuthology.orchestra.run.smithi161.stdout:2747 write 0xc6f00a6 thru 0xc6f92e4 (0x923f bytes) 2024-09-21T15:09:09.291 INFO:teuthology.orchestra.run.smithi161.stdout:3310 trunc from 0xb442b93 to 0x5811c8f 2024-09-21T15:09:09.294 INFO:teuthology.orchestra.run.smithi161.stdout:3605 read 0xce2f683 thru 0xce3d0c5 (0xda43 bytes) 2024-09-21T15:09:09.295 INFO:teuthology.orchestra.run.smithi161.stdout:3606 writesame 0x3a5ea33 thru 0x3a69bf3 data_size 0x13(0xb1c1 bytes) 2024-09-21T15:09:09.302 INFO:teuthology.orchestra.run.smithi161.stdout:3853 write 0xea7f298 thru 0xea83c20 (0x4989 bytes) 2024-09-21T15:09:09.313 INFO:teuthology.orchestra.run.smithi161.stdout:2748 writesame 0x790e8ed thru 0x791a054 data_size 0x4(0xb768 bytes) 2024-09-21T15:09:09.324 INFO:teuthology.orchestra.run.smithi161.stdout:3620 punch from 0x89ae84a to 0x89bbd11, (0xd4c7 bytes) 2024-09-21T15:09:09.335 INFO:teuthology.orchestra.run.smithi161.stdout:3854 writesame 0x218b84b thru 0x2198eac data_size 0x9(0xd662 bytes) 2024-09-21T15:09:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:2750 read 0x98897fb thru 0x9894c22 (0xb428 bytes) 2024-09-21T15:09:09.347 INFO:teuthology.orchestra.run.smithi161.stdout:2751 read 0x41d78ba thru 0x41e09d6 (0x911d bytes) 2024-09-21T15:09:09.348 INFO:teuthology.orchestra.run.smithi161.stdout:2752 write 0x94758ba thru 0x94843ba (0xeb01 bytes) 2024-09-21T15:09:09.363 INFO:teuthology.orchestra.run.smithi161.stdout:3607 trunc from 0xd7b3831 to 0x26b34c 2024-09-21T15:09:09.371 INFO:teuthology.orchestra.run.smithi161.stdout:3855 read 0xcc7f94d thru 0xcc89b3e (0xa1f2 bytes) 2024-09-21T15:09:09.371 INFO:teuthology.orchestra.run.smithi161.stdout:3856 read 0x1c1459 thru 0x1c212b (0xcd3 bytes) 2024-09-21T15:09:09.373 INFO:teuthology.orchestra.run.smithi161.stdout:3858 trunc from 0xea83c21 to 0xe33a03a 2024-09-21T15:09:09.378 INFO:teuthology.orchestra.run.smithi161.stdout:2753 read 0x1628f46 thru 0x1635fee (0xd0a9 bytes) 2024-09-21T15:09:09.378 INFO:teuthology.orchestra.run.smithi161.stdout:2754 read 0x3515e14 thru 0x3524cfd (0xeeea bytes) 2024-09-21T15:09:09.378 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.378 INFO:teuthology.orchestra.run.smithi161.stdout:2756 writesame 0x2848b42 thru 0x284fab7 data_size 0xb(0x6f76 bytes) 2024-09-21T15:09:09.384 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.384 INFO:teuthology.orchestra.run.smithi161.stdout:3312 writesame 0x1f4f154 thru 0x1f51c41 data_size 0x23(0x2aee bytes) 2024-09-21T15:09:09.398 INFO:teuthology.orchestra.run.smithi161.stdout:3621 write 0xd6ab241 thru 0xd6b16d3 (0x6493 bytes) 2024-09-21T15:09:09.401 INFO:teuthology.orchestra.run.smithi161.stdout:3630 trunc from 0xfed3b2 to 0x44939ea 2024-09-21T15:09:09.403 INFO:teuthology.orchestra.run.smithi161.stdout:2757 punch from 0x9364cd5 to 0x936ac17, (0x5f42 bytes) 2024-09-21T15:09:09.403 INFO:teuthology.orchestra.run.smithi161.stdout:2758 writesame 0x5926a7c thru 0x592b70d data_size 0x36(0x4c92 bytes) 2024-09-21T15:09:09.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ad639ee0 2024-09-21T15:09:09.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.416+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adaa2680 2024-09-21T15:09:09.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.416+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adaa2d00 2024-09-21T15:09:09.429 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adaa2dd0 2024-09-21T15:09:09.429 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adaa3860 2024-09-21T15:09:09.429 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ade4e4e0 2024-09-21T15:09:09.429 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ade4e680 2024-09-21T15:09:09.429 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5110 2024-09-21T15:09:09.429 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c56c0 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5860 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5930 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5a00 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5ba0 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5d40 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae3e7c70 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae4ce820 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae4cf450 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810b60 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810dd0 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1cdd0 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1cea0 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1d2b0 2024-09-21T15:09:09.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1d930 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a4e0 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b040 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b790 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aee60750 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aee61c70 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af30a680 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af76a1a0 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af842270 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af938680 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac04e0 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac0a90 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac1c70 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:09:09.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd2b0 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd450 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd860 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddc70 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afe7ed00 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afeea0d0 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afeebba0 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b014f1e0 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b04ba750 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b04bba00 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc8f0 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cca90 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c06820 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07380 2024-09-21T15:09:09.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07790 2024-09-21T15:09:09.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07930 2024-09-21T15:09:09.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c821a0 2024-09-21T15:09:09.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c82ea0 2024-09-21T15:09:09.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:09:09.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83930 2024-09-21T15:09:09.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:09:09.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:09:09.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049c70 2024-09-21T15:09:09.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049ee0 2024-09-21T15:09:09.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11740d0 2024-09-21T15:09:09.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6b60 2024-09-21T15:09:09.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6ea0 2024-09-21T15:09:09.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e7d40 2024-09-21T15:09:09.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14df040 2024-09-21T15:09:09.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14df380 2024-09-21T15:09:09.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b18321a0 2024-09-21T15:09:09.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1832340 2024-09-21T15:09:09.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1832dd0 2024-09-21T15:09:09.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833040 2024-09-21T15:09:09.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:09:09.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cffba0 2024-09-21T15:09:09.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202c1a0 2024-09-21T15:09:09.435 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:09.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202c750 2024-09-21T15:09:09.435 INFO:teuthology.orchestra.run.smithi161.stdout:2759 punch from 0x31e2012 to 0x31e492f, (0x291d bytes) 2024-09-21T15:09:09.435 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.435 INFO:teuthology.orchestra.run.smithi161.stdout:3315 write 0x56c162a thru 0x56cee31 (0xd808 bytes) 2024-09-21T15:09:09.441 INFO:teuthology.orchestra.run.smithi161.stdout:2760 trunc from 0xe4d6131 to 0x877c754 2024-09-21T15:09:09.453 INFO:teuthology.orchestra.run.smithi161.stdout:3622 punch from 0x7c3eb4a to 0x7c40be4, (0x209a bytes) 2024-09-21T15:09:09.453 INFO:teuthology.orchestra.run.smithi161.stdout:3623 write 0xc6fba19 thru 0xc70b9ec (0xffd4 bytes) 2024-09-21T15:09:09.575 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.575 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.581 INFO:teuthology.orchestra.run.smithi161.stdout:3627 read 0xbbfe54d thru 0xbc0e0c5 (0xfb79 bytes) 2024-09-21T15:09:09.581 INFO:teuthology.orchestra.run.smithi161.stdout:3628 read 0xcd8df24 thru 0xcd9a0fe (0xc1db bytes) 2024-09-21T15:09:09.581 INFO:teuthology.orchestra.run.smithi161.stdout:3629 read 0x914e127 thru 0x9153c2e (0x5b08 bytes) 2024-09-21T15:09:09.581 INFO:teuthology.orchestra.run.smithi161.stdout:3630 write 0x9727ed4 thru 0x972c08c (0x41b9 bytes) 2024-09-21T15:09:09.614 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.624 INFO:teuthology.orchestra.run.smithi161.stdout:3633 trunc from 0xd6b16d4 to 0x8125a6b 2024-09-21T15:09:09.632 INFO:teuthology.orchestra.run.smithi161.stdout:3632 write 0xc8f6e00 thru 0xc8f82c9 (0x14ca bytes) 2024-09-21T15:09:09.642 INFO:teuthology.orchestra.run.smithi161.stdout:3859 write 0x106dc16 thru 0x1078117 (0xa502 bytes) 2024-09-21T15:09:09.664 INFO:teuthology.orchestra.run.smithi161.stdout:3633 write 0xc7d0845 thru 0xc7d162f (0xdeb bytes) 2024-09-21T15:09:09.669 INFO:teuthology.orchestra.run.smithi161.stdout:3318 write 0xc652025 thru 0xc661a03 (0xf9df bytes) 2024-09-21T15:09:09.670 INFO:teuthology.orchestra.run.smithi161.stdout:2761 writesame 0x90b953e thru 0x90c2771 data_size 0x6(0x9234 bytes) 2024-09-21T15:09:09.675 INFO:teuthology.orchestra.run.smithi161.stdout:3860 trunc from 0xe33a03a to 0x7f6f88c 2024-09-21T15:09:09.679 INFO:teuthology.orchestra.run.smithi161.stdout:2762 writesame 0x4e77784 thru 0x4e8166b data_size 0x24(0x9ee8 bytes) 2024-09-21T15:09:09.704 INFO:teuthology.orchestra.run.smithi161.stdout:3319 write 0xc41b337 thru 0xc427077 (0xbd41 bytes) 2024-09-21T15:09:09.717 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:09.716+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa1e80d0 2024-09-21T15:09:09.717 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:09.716+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa338820 2024-09-21T15:09:09.719 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:09.716+0000 7f7fd044c700 -1 reset not still connected to 0x5636aebddee0 2024-09-21T15:09:09.720 INFO:teuthology.orchestra.run.smithi161.stdout:3634 read 0x5a8697c thru 0x5a93a48 (0xd0cd bytes) 2024-09-21T15:09:09.720 INFO:teuthology.orchestra.run.smithi161.stdout:3635 write 0x21f5aee thru 0x21fa0f9 (0x460c bytes) 2024-09-21T15:09:09.721 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:09.720+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41aa270 2024-09-21T15:09:09.721 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:09.720+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41abc70 2024-09-21T15:09:09.721 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:09.720+0000 7f7fd044c700 -1 reset not still connected to 0x5636b494ed00 2024-09-21T15:09:09.721 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:09.720+0000 7f7fd044c700 -1 reset not still connected to 0x5636b59864e0 2024-09-21T15:09:09.724 INFO:teuthology.orchestra.run.smithi161.stdout:3608 trunc from 0x26b34c to 0xe613e46 2024-09-21T15:09:09.735 INFO:teuthology.orchestra.run.smithi161.stdout:3634 write 0xd6a3efa thru 0xd6b2186 (0xe28d bytes) 2024-09-21T15:09:09.749 INFO:teuthology.orchestra.run.smithi161.stdout:3320 write 0x6359569 thru 0x6359f55 (0x9ed bytes) 2024-09-21T15:09:09.764 INFO:teuthology.orchestra.run.smithi161.stdout:3637 trunc from 0x8125a6b to 0xd5efe3c 2024-09-21T15:09:09.770 INFO:teuthology.orchestra.run.smithi161.stdout:3321 trunc from 0xc661a04 to 0xb8c67c5 2024-09-21T15:09:09.774 INFO:teuthology.orchestra.run.smithi161.stdout:3635 punch from 0x45eaa2d to 0x45f2734, (0x7d07 bytes) 2024-09-21T15:09:09.775 INFO:teuthology.orchestra.run.smithi161.stdout:3637 writesame 0x69aef4b thru 0x69b008c data_size 0x2(0x1142 bytes) 2024-09-21T15:09:09.776 INFO:teuthology.orchestra.run.smithi161.stdout:3861 read 0xcfbe48 thru 0xd093c7 (0xd580 bytes) 2024-09-21T15:09:09.777 INFO:teuthology.orchestra.run.smithi161.stdout:3863 write 0x6a1b308 thru 0x6a2ad4b (0xfa44 bytes) 2024-09-21T15:09:09.777 INFO:teuthology.orchestra.run.smithi161.stdout:2763 write 0x99fdeec thru 0x99ff26a (0x137f bytes) 2024-09-21T15:09:09.790 INFO:teuthology.orchestra.run.smithi161.stdout:3609 trunc from 0xe613e46 to 0x2a779ea 2024-09-21T15:09:09.801 INFO:teuthology.orchestra.run.smithi161.stdout:3864 write 0x1d931f3 thru 0x1d954a0 (0x22ae bytes) 2024-09-21T15:09:09.801 INFO:teuthology.orchestra.run.smithi161.stdout:3638 trunc from 0xd6b2187 to 0x7c8c9d5 2024-09-21T15:09:09.811 INFO:teuthology.orchestra.run.smithi161.stdout:2764 trunc from 0x99ff26b to 0x1634041 2024-09-21T15:09:09.820 INFO:teuthology.orchestra.run.smithi161.stdout:3638 writesame 0x54147ba thru 0x541755e data_size 0x29(0x2da5 bytes) 2024-09-21T15:09:09.843 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.843 INFO:teuthology.orchestra.run.smithi161.stdout:3641 write 0x7dd359f thru 0x7dd961e (0x6080 bytes) 2024-09-21T15:09:09.868 INFO:teuthology.orchestra.run.smithi161.stdout:3322 write 0xcb9ddb8 thru 0xcb9e6df (0x928 bytes) 2024-09-21T15:09:09.868 INFO:teuthology.orchestra.run.smithi161.stdout:3642 punch from 0xd117129 to 0xd11d145, (0x601c bytes) 2024-09-21T15:09:09.868 INFO:teuthology.orchestra.run.smithi161.stdout:3643 punch from 0x4eeb908 to 0x4ef2e49, (0x7541 bytes) 2024-09-21T15:09:09.869 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.869 INFO:teuthology.orchestra.run.smithi161.stdout:3645 write 0x29e6721 thru 0x29f20ce (0xb9ae bytes) 2024-09-21T15:09:09.873 INFO:teuthology.orchestra.run.smithi161.stdout:3639 write 0x4a24f18 thru 0x4a2afd3 (0x60bc bytes) 2024-09-21T15:09:09.876 INFO:teuthology.orchestra.run.smithi161.stdout:3611 writesame 0x67bd802 thru 0x67c97d9 data_size 0x1c(0xbfd8 bytes) 2024-09-21T15:09:09.880 INFO:teuthology.orchestra.run.smithi161.stdout:3612 read 0x359f5b thru 0x363241 (0x92e7 bytes) 2024-09-21T15:09:09.882 INFO:teuthology.orchestra.run.smithi161.stdout:3613 punch from 0x4b36efc to 0x4b36fcf, (0xd3 bytes) 2024-09-21T15:09:09.884 INFO:teuthology.orchestra.run.smithi161.stdout:3865 writesame 0xc8091a7 thru 0xc80e996 data_size 0x54(0x57f0 bytes) 2024-09-21T15:09:09.889 INFO:teuthology.orchestra.run.smithi161.stdout:2765 punch from 0xaeb6f5 to 0xaf0b5e, (0x5469 bytes) 2024-09-21T15:09:09.889 INFO:teuthology.orchestra.run.smithi161.stdout:2766 punch from 0x1416bd6 to 0x141f27a, (0x86a4 bytes) 2024-09-21T15:09:09.890 INFO:teuthology.orchestra.run.smithi161.stdout:3323 clone 27 order 24 su 524288 sc 14 2024-09-21T15:09:09.891 INFO:teuthology.orchestra.run.smithi161.stdout:3866 punch from 0x66e304b to 0x66f0d0a, (0xdcbf bytes) 2024-09-21T15:09:09.891 INFO:teuthology.orchestra.run.smithi161.stdout:3867 read 0xb494234 thru 0xb49dc7b (0x9a48 bytes) 2024-09-21T15:09:09.891 INFO:teuthology.orchestra.run.smithi161.stdout:3869 punch from 0x6f86853 to 0x6f941bd, (0xd96a bytes) 2024-09-21T15:09:09.891 INFO:teuthology.orchestra.run.smithi161.stdout:3646 write 0x38a8575 thru 0x38b3fad (0xba39 bytes) 2024-09-21T15:09:09.892 INFO:teuthology.orchestra.run.smithi161.stdout:3640 write 0x97ea78 thru 0x98c743 (0xdccc bytes) 2024-09-21T15:09:09.910 INFO:teuthology.orchestra.run.smithi161.stdout:3871 trunc from 0xc80e997 to 0x1ef1057 2024-09-21T15:09:09.918 INFO:teuthology.orchestra.run.smithi161.stdout:3642 write 0x2b44962 thru 0x2b5319f (0xe83e bytes) 2024-09-21T15:09:09.919 INFO:teuthology.orchestra.run.smithi161.stdout:3647 read 0xc81816a thru 0xc823ca0 (0xbb37 bytes) 2024-09-21T15:09:09.923 INFO:teuthology.orchestra.run.smithi161.stdout:3649 trunc from 0xd5efe3c to 0xbec52a8 2024-09-21T15:09:09.930 INFO:teuthology.orchestra.run.smithi161.stdout:3614 write 0x9ee00ec thru 0x9eeeabc (0xe9d1 bytes) 2024-09-21T15:09:09.937 INFO:teuthology.orchestra.run.smithi161.stdout:3644 punch from 0x255c618 to 0x2563855, (0x723d bytes) 2024-09-21T15:09:09.937 INFO:teuthology.orchestra.run.smithi161.stdout:3646 write 0x5e4c6eb thru 0x5e50cfc (0x4612 bytes) 2024-09-21T15:09:09.946 INFO:teuthology.orchestra.run.smithi161.stdout:2767 write 0x8e23845 thru 0x8e2a58a (0x6d46 bytes) 2024-09-21T15:09:09.964 INFO:teuthology.orchestra.run.smithi161.stdout:3616 write 0x2b68e49 thru 0x2b6dc80 (0x4e38 bytes) 2024-09-21T15:09:09.964 INFO:teuthology.orchestra.run.smithi161.stdout:3647 write 0x5673767 thru 0x567df50 (0xa7ea bytes) 2024-09-21T15:09:09.972 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.973 INFO:teuthology.orchestra.run.smithi161.stdout:2769 read 0x7f03667 thru 0x7f0fe07 (0xc7a1 bytes) 2024-09-21T15:09:09.973 INFO:teuthology.orchestra.run.smithi161.stdout:2770 punch from 0x279a246 to 0x279d8ce, (0x3688 bytes) 2024-09-21T15:09:09.973 INFO:teuthology.orchestra.run.smithi161.stdout:2771 write 0x19a7e5a thru 0x19b3e6c (0xc013 bytes) 2024-09-21T15:09:09.982 INFO:teuthology.orchestra.run.smithi161.stdout:3651 punch from 0x2040cac to 0x204d58e, (0xc8e2 bytes) 2024-09-21T15:09:09.982 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.982 INFO:teuthology.orchestra.run.smithi161.stdout:3653 punch from 0x80748a2 to 0x8074c94, (0x3f2 bytes) 2024-09-21T15:09:09.991 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:09.991 INFO:teuthology.orchestra.run.smithi161.stdout:3618 read 0x1905d8e thru 0x190d036 (0x72a9 bytes) 2024-09-21T15:09:09.996 INFO:teuthology.orchestra.run.smithi161.stdout:2772 trunc from 0x8e2a58b to 0xa377a59 2024-09-21T15:09:10.016 INFO:teuthology.orchestra.run.smithi161.stdout:3619 trunc from 0x9eeeabd to 0x1d02132 2024-09-21T15:09:10.017 INFO:teuthology.orchestra.run.smithi161.stdout:3654 write 0xe5630ef thru 0xe563f69 (0xe7b bytes) 2024-09-21T15:09:10.028 INFO:teuthology.orchestra.run.smithi161.stdout:3655 write 0x2cf9f3e thru 0x2d022dc (0x839f bytes) 2024-09-21T15:09:10.031 INFO:teuthology.orchestra.run.smithi161.stdout:3648 writesame 0x98b2717 thru 0x98c149f data_size 0x49(0xed89 bytes) 2024-09-21T15:09:10.037 INFO:teuthology.orchestra.run.smithi161.stdout:3872 write 0x48a6965 thru 0x48ae4d6 (0x7b72 bytes) 2024-09-21T15:09:10.039 INFO:teuthology.orchestra.run.smithi161.stdout:2774 read 0x3bfdc8a thru 0x3c0d6a0 (0xfa17 bytes) 2024-09-21T15:09:10.040 INFO:teuthology.orchestra.run.smithi161.stdout:2775 writesame 0x1861a0e thru 0x186e50c data_size 0x1(0xcaff bytes) 2024-09-21T15:09:10.040 INFO:teuthology.orchestra.run.smithi161.stdout:3649 read 0x7e88a55 thru 0x7e8eb2d (0x60d9 bytes) 2024-09-21T15:09:10.041 INFO:teuthology.orchestra.run.smithi161.stdout:3650 writesame 0x643c3b2 thru 0x643f3ac data_size 0x1(0x2ffb bytes) 2024-09-21T15:09:10.052 INFO:teuthology.orchestra.run.smithi161.stdout:3656 write 0x56f7fc1 thru 0x5700157 (0x8197 bytes) 2024-09-21T15:09:10.060 INFO:teuthology.orchestra.run.smithi161.stdout:3873 read 0x5a23c0 thru 0x5a8395 (0x5fd6 bytes) 2024-09-21T15:09:10.061 INFO:teuthology.orchestra.run.smithi161.stdout:3874 punch from 0xc8f7b to 0xd042c, (0x74b1 bytes) 2024-09-21T15:09:10.061 INFO:teuthology.orchestra.run.smithi161.stdout:3875 read 0x17512c4 thru 0x175e9c4 (0xd701 bytes) 2024-09-21T15:09:10.063 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.096 INFO:teuthology.orchestra.run.smithi161.stdout:2776 read 0x3535440 thru 0x35451a8 (0xfd69 bytes) 2024-09-21T15:09:10.104 INFO:teuthology.orchestra.run.smithi161.stdout:2777 trunc from 0xa377a59 to 0x6543cb0 2024-09-21T15:09:10.108 INFO:teuthology.orchestra.run.smithi161.stdout:3651 write 0xa83e764 thru 0xa849eef (0xb78c bytes) 2024-09-21T15:09:10.130 INFO:teuthology.orchestra.run.smithi161.stdout:3653 write 0x5ed616d thru 0x5edfd03 (0x9b97 bytes) 2024-09-21T15:09:10.132 INFO:teuthology.orchestra.run.smithi161.stdout:3620 write 0x91b3fff thru 0x91c03d8 (0xc3da bytes) 2024-09-21T15:09:10.144 INFO:teuthology.orchestra.run.smithi161.stdout:3877 write 0xbeeb08d thru 0xbef41ff (0x9173 bytes) 2024-09-21T15:09:10.154 INFO:teuthology.orchestra.run.smithi161.stdout:3657 write 0xe6ff6c7 thru 0xe70a552 (0xae8c bytes) 2024-09-21T15:09:10.154 INFO:teuthology.orchestra.run.smithi161.stdout:3654 write 0x6f2d319 thru 0x6f39f91 (0xcc79 bytes) 2024-09-21T15:09:10.166 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.166 INFO:teuthology.orchestra.run.smithi161.stdout:3623 read 0x678e88 thru 0x67b9af (0x2b28 bytes) 2024-09-21T15:09:10.166 INFO:teuthology.orchestra.run.smithi161.stdout:3626 read 0x2cdc49b thru 0x2ce19c6 (0x552c bytes) 2024-09-21T15:09:10.166 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.169 INFO:teuthology.orchestra.run.smithi161.stdout:3631 trunc from 0x91c03d9 to 0xa18086d 2024-09-21T15:09:10.173 INFO:teuthology.orchestra.run.smithi161.stdout:3655 punch from 0x7080ede to 0x7085ee1, (0x5003 bytes) 2024-09-21T15:09:10.177 INFO:teuthology.orchestra.run.smithi161.stdout:3658 read 0xdbff954 thru 0xdc0cf3a (0xd5e7 bytes) 2024-09-21T15:09:10.189 INFO:teuthology.orchestra.run.smithi161.stdout:3878 trunc from 0xbef4200 to 0x6632a0c 2024-09-21T15:09:10.196 INFO:teuthology.orchestra.run.smithi161.stdout:3659 trunc from 0xe70a553 to 0x40e8497 2024-09-21T15:09:10.204 INFO:teuthology.orchestra.run.smithi161.stdout:3632 punch from 0x650ef1c to 0x6513bf2, (0x4cd6 bytes) 2024-09-21T15:09:10.204 INFO:teuthology.orchestra.run.smithi161.stdout:3633 read 0x915185d thru 0x916054a (0xecee bytes) 2024-09-21T15:09:10.205 INFO:teuthology.orchestra.run.smithi161.stdout:3634 punch from 0x8dd9d7f to 0x8ddd066, (0x32e7 bytes) 2024-09-21T15:09:10.219 INFO:teuthology.orchestra.run.smithi161.stdout:3656 writesame 0xb0c69c8 thru 0xb0ce930 data_size 0xd(0x7f69 bytes) 2024-09-21T15:09:10.221 INFO:teuthology.orchestra.run.smithi161.stdout:2779 write 0xbe50371 thru 0xbe5f115 (0xeda5 bytes) 2024-09-21T15:09:10.229 INFO:teuthology.orchestra.run.smithi161.stdout:3657 punch from 0x2604fda to 0x260b760, (0x6786 bytes) 2024-09-21T15:09:10.251 INFO:teuthology.orchestra.run.smithi161.stdout:3659 trunc from 0xb0ce931 to 0x3c2d52 2024-09-21T15:09:10.254 INFO:teuthology.orchestra.run.smithi161.stdout:3636 write 0xd67b0e7 thru 0xd67f348 (0x4262 bytes) 2024-09-21T15:09:10.262 INFO:teuthology.orchestra.run.smithi161.stdout:3879 writesame 0x5f5aa72 thru 0x5f66094 data_size 0x1(0xb623 bytes) 2024-09-21T15:09:10.274 INFO:teuthology.orchestra.run.smithi161.stdout:2780 trunc from 0xbe5f116 to 0x11263c4 2024-09-21T15:09:10.292 INFO:teuthology.orchestra.run.smithi161.stdout:3637 punch from 0x317d447 to 0x3186382, (0x8f3b bytes) 2024-09-21T15:09:10.292 INFO:teuthology.orchestra.run.smithi161.stdout:3639 write 0x540cfc9 thru 0x54198ef (0xc927 bytes) 2024-09-21T15:09:10.317 INFO:teuthology.orchestra.run.smithi161.stdout:3881 read 0x3084732 thru 0x3085f96 (0x1865 bytes) 2024-09-21T15:09:10.317 INFO:teuthology.orchestra.run.smithi161.stdout:3882 punch from 0x3bf25f to 0x3c9f07, (0xaca8 bytes) 2024-09-21T15:09:10.317 INFO:teuthology.orchestra.run.smithi161.stdout:3885 clone 25 order 22 su 32768 sc 4 2024-09-21T15:09:10.337 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.340 INFO:teuthology.orchestra.run.smithi161.stdout:3660 write 0xe04afb1 thru 0xe058e0b (0xde5b bytes) 2024-09-21T15:09:10.360 INFO:teuthology.orchestra.run.smithi161.stdout:3641 trunc from 0xd67f349 to 0x38ec459 2024-09-21T15:09:10.368 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.368 INFO:teuthology.orchestra.run.smithi161.stdout:3662 write 0x33bd86b thru 0x33c8f4e (0xb6e4 bytes) 2024-09-21T15:09:10.391 INFO:teuthology.orchestra.run.smithi161.stdout:2781 read 0x6684ec thru 0x66a01b (0x1b30 bytes) 2024-09-21T15:09:10.395 INFO:teuthology.orchestra.run.smithi161.stdout:3660 read 0xad03e thru 0xb1a0e (0x49d1 bytes) 2024-09-21T15:09:10.396 INFO:teuthology.orchestra.run.smithi161.stdout:3663 punch from 0x9155f30 to 0x915c68e, (0x675e bytes) 2024-09-21T15:09:10.396 INFO:teuthology.orchestra.run.smithi161.stdout:3663 write 0x2e9f31 thru 0x2f8138 (0xe208 bytes) 2024-09-21T15:09:10.408 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.422 INFO:teuthology.orchestra.run.smithi161.stdout:3642 read 0x3130a11 thru 0x313f3c4 (0xe9b4 bytes) 2024-09-21T15:09:10.422 INFO:teuthology.orchestra.run.smithi161.stdout:3665 trunc from 0xe058e0c to 0xf27255 2024-09-21T15:09:10.423 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.423 INFO:teuthology.orchestra.run.smithi161.stdout:3650 read 0x1d1fa7b thru 0x1d2912b (0x96b1 bytes) 2024-09-21T15:09:10.434 INFO:teuthology.orchestra.run.smithi161.stdout:2782 write 0x966d42b thru 0x967b137 (0xdd0d bytes) 2024-09-21T15:09:10.460 INFO:teuthology.orchestra.run.smithi161.stdout:3651 writesame 0x550509c thru 0x5505528 data_size 0x1(0x48d bytes) 2024-09-21T15:09:10.461 INFO:teuthology.orchestra.run.smithi161.stdout:3665 write 0x69742fc thru 0x69765c2 (0x22c7 bytes) 2024-09-21T15:09:10.463 INFO:teuthology.orchestra.run.smithi161.stdout:3652 read 0x214998b thru 0x214b426 (0x1a9c bytes) 2024-09-21T15:09:10.463 INFO:teuthology.orchestra.run.smithi161.stdout:3654 punch from 0x39d49c8 to 0x39dda0b, (0x9043 bytes) 2024-09-21T15:09:10.463 INFO:teuthology.orchestra.run.smithi161.stdout:3655 write 0x11849d1 thru 0x11912a3 (0xc8d3 bytes) 2024-09-21T15:09:10.469 INFO:teuthology.orchestra.run.smithi161.stdout:2785 trunc from 0x967b138 to 0x39c8e64 2024-09-21T15:09:10.477 INFO:teuthology.orchestra.run.smithi161.stdout:3667 read 0x38e2ee3 thru 0x38ea1a2 (0x72c0 bytes) 2024-09-21T15:09:10.478 INFO:teuthology.orchestra.run.smithi161.stdout:3668 read 0x4ea443e thru 0x4eb2731 (0xe2f4 bytes) 2024-09-21T15:09:10.478 INFO:teuthology.orchestra.run.smithi161.stdout:3669 write 0x3e19328 thru 0x3e1a383 (0x105c bytes) 2024-09-21T15:09:10.499 INFO:teuthology.orchestra.run.smithi161.stdout:3666 punch from 0x61e418 to 0x6256a0, (0x7288 bytes) 2024-09-21T15:09:10.505 INFO:teuthology.orchestra.run.smithi161.stdout:3670 write 0x43dc10d thru 0x43e270e (0x6602 bytes) 2024-09-21T15:09:10.516 INFO:teuthology.orchestra.run.smithi161.stdout:3667 trunc from 0xf27255 to 0x8ac8c3c 2024-09-21T15:09:10.537 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.555 INFO:teuthology.orchestra.run.smithi161.stdout:2786 punch from 0x101ac6a to 0x1026a06, (0xbd9c bytes) 2024-09-21T15:09:10.555 INFO:teuthology.orchestra.run.smithi161.stdout:2787 read 0x12eff24 thru 0x12f30bf (0x319c bytes) 2024-09-21T15:09:10.556 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.556 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.556 INFO:teuthology.orchestra.run.smithi161.stdout:2790 read 0x32b8448 thru 0x32b8df7 (0x9b0 bytes) 2024-09-21T15:09:10.561 INFO:teuthology.orchestra.run.smithi161.stdout:2792 trunc from 0x39c8e64 to 0xbec8b1 2024-09-21T15:09:10.566 INFO:teuthology.orchestra.run.smithi161.stdout:3669 write 0x32c73d3 thru 0x32ce713 (0x7341 bytes) 2024-09-21T15:09:10.570 INFO:teuthology.orchestra.run.smithi161.stdout:3656 write 0xe7b3445 thru 0xe7bde3b (0xa9f7 bytes) 2024-09-21T15:09:10.595 INFO:teuthology.orchestra.run.smithi161.stdout:3670 trunc from 0x8ac8c3c to 0x8e68435 2024-09-21T15:09:10.600 INFO:teuthology.orchestra.run.smithi161.stdout:3672 write 0xae3bae4 thru 0xae4959e (0xdabb bytes) 2024-09-21T15:09:10.605 INFO:teuthology.orchestra.run.smithi161.stdout:3658 read 0xe634eea thru 0xe63d2d9 (0x83f0 bytes) 2024-09-21T15:09:10.607 INFO:teuthology.orchestra.run.smithi161.stdout:3659 write 0x96879ad thru 0x968b926 (0x3f7a bytes) 2024-09-21T15:09:10.631 INFO:teuthology.orchestra.run.smithi161.stdout:3671 writesame 0x406f1a2 thru 0x40777c3 data_size 0x76(0x8622 bytes) 2024-09-21T15:09:10.636 INFO:teuthology.orchestra.run.smithi161.stdout:3660 trunc from 0xe7bde3c to 0xa9a8f18 2024-09-21T15:09:10.637 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.646 INFO:teuthology.orchestra.run.smithi161.stdout:3674 write 0x6c686d1 thru 0x6c764f3 (0xde23 bytes) 2024-09-21T15:09:10.672 INFO:teuthology.orchestra.run.smithi161.stdout:3673 write 0xda1538a thru 0xda178b5 (0x252c bytes) 2024-09-21T15:09:10.674 INFO:teuthology.orchestra.run.smithi161.stdout:3676 read 0x8b657e9 thru 0x8b6f5cb (0x9de3 bytes) 2024-09-21T15:09:10.680 INFO:teuthology.orchestra.run.smithi161.stdout:3677 trunc from 0x8e68435 to 0xb4b7d8b 2024-09-21T15:09:10.690 INFO:teuthology.orchestra.run.smithi161.stdout:2795 write 0x85c3492 thru 0x85c8022 (0x4b91 bytes) 2024-09-21T15:09:10.694 INFO:teuthology.orchestra.run.smithi161.stdout:3663 write 0xa4ba787 thru 0xa4c8d61 (0xe5db bytes) 2024-09-21T15:09:10.694 INFO:teuthology.orchestra.run.smithi161.stdout:3674 write 0x91f3ad3 thru 0x91fa31d (0x684b bytes) 2024-09-21T15:09:10.716 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone26 from 0xcb9e6e0 (overlap 0x47f31a) to 0x325d5f 2024-09-21T15:09:10.719 INFO:teuthology.orchestra.run.smithi161.stdout:2796 read 0x7af6448 thru 0x7b025c1 (0xc17a bytes) 2024-09-21T15:09:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:3664 punch from 0x14c7686 to 0x14caa0e, (0x3388 bytes) 2024-09-21T15:09:10.725 INFO:teuthology.orchestra.run.smithi161.stdout:3666 read 0x4e16eda thru 0x4e24ae5 (0xdc0c bytes) 2024-09-21T15:09:10.726 INFO:teuthology.orchestra.run.smithi161.stdout:3667 write 0x3a140ef thru 0x3a21c2c (0xdb3e bytes) 2024-09-21T15:09:10.732 INFO:teuthology.orchestra.run.smithi161.stdout:3678 punch from 0x430c062 to 0x4310c58, (0x4bf6 bytes) 2024-09-21T15:09:10.733 INFO:teuthology.orchestra.run.smithi161.stdout:3679 trunc from 0xb4b7d8b to 0xad85bb0 2024-09-21T15:09:10.748 INFO:teuthology.orchestra.run.smithi161.stdout:3675 trunc from 0xda178b6 to 0xb1cbff 2024-09-21T15:09:10.776 INFO:teuthology.orchestra.run.smithi161.stdout:3669 trunc from 0xa9a8f18 to 0x583c4b0 2024-09-21T15:09:10.776 INFO:teuthology.orchestra.run.smithi161.stdout:2799 writesame 0x9a3fc3b thru 0x9a454b9 data_size 0x17(0x587f bytes) 2024-09-21T15:09:10.783 INFO:teuthology.orchestra.run.smithi161.stdout:3681 writesame 0x7e65994 thru 0x7e70788 data_size 0x1(0xadf5 bytes) 2024-09-21T15:09:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:3684 punch from 0x197e622 to 0x1988897, (0xa275 bytes) 2024-09-21T15:09:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:3686 read 0xab5ffbd thru 0xab626d4 (0x2718 bytes) 2024-09-21T15:09:10.827 INFO:teuthology.orchestra.run.smithi161.stdout:3687 punch from 0x65a0d2e to 0x65a4e95, (0x4167 bytes) 2024-09-21T15:09:10.834 INFO:teuthology.orchestra.run.smithi161.stdout:3688 trunc from 0xad85bb0 to 0x791fa09 2024-09-21T15:09:10.838 INFO:teuthology.orchestra.run.smithi161.stdout:2802 writesame 0x9ccf72d thru 0x9cd3657 data_size 0x1(0x3f2b bytes) 2024-09-21T15:09:10.846 INFO:teuthology.orchestra.run.smithi161.stdout:2805 punch from 0x5eee7a9 to 0x5ef13c6, (0x2c1d bytes) 2024-09-21T15:09:10.846 INFO:teuthology.orchestra.run.smithi161.stdout:2806 writesame 0x758a835 thru 0x75970e2 data_size 0x11(0xc8ae bytes) 2024-09-21T15:09:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.865 INFO:teuthology.orchestra.run.smithi161.stdout:2808 trunc from 0x9cd3658 to 0xbf51957 2024-09-21T15:09:10.869 INFO:teuthology.orchestra.run.smithi161.stdout:3670 trunc from 0x583c4b0 to 0xb18c775 2024-09-21T15:09:10.879 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #23, image image_cluster1.client.mirror.2-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent24 2024-09-21T15:09:10.884 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.884 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.884 INFO:teuthology.orchestra.run.smithi161.stdout:3693 punch from 0x57e6e48 to 0x57edf07, (0x70bf bytes) 2024-09-21T15:09:10.884 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.884 INFO:teuthology.orchestra.run.smithi161.stdout:3695 write 0x6865d85 thru 0x686c613 (0x688f bytes) 2024-09-21T15:09:10.886 INFO:teuthology.orchestra.run.smithi161.stdout:3676 write 0xe05ed44 thru 0xe065338 (0x65f5 bytes) 2024-09-21T15:09:10.902 INFO:teuthology.orchestra.run.smithi161.stdout:3677 write 0x4c30fe4 thru 0x4c342c4 (0x32e1 bytes) 2024-09-21T15:09:10.903 INFO:teuthology.orchestra.run.smithi161.stdout:3696 read 0x46dca3d thru 0x46e6242 (0x9806 bytes) 2024-09-21T15:09:10.903 INFO:teuthology.orchestra.run.smithi161.stdout:2811 read 0x572de8d thru 0x572febb (0x202f bytes) 2024-09-21T15:09:10.904 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:10.904 INFO:teuthology.orchestra.run.smithi161.stdout:2813 writesame 0x55fb0ea thru 0x560939d data_size 0x16(0xe2b4 bytes) 2024-09-21T15:09:10.906 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #25, image image_cluster1.client.mirror.4-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent26 2024-09-21T15:09:10.909 INFO:teuthology.orchestra.run.smithi161.stdout:3671 trunc from 0xb18c775 to 0x506f74e 2024-09-21T15:09:10.912 INFO:teuthology.orchestra.run.smithi161.stdout:3679 write 0xce465bb thru 0xce4f733 (0x9179 bytes) 2024-09-21T15:09:10.918 INFO:teuthology.orchestra.run.smithi161.stdout:2814 write 0x674a62b thru 0x6755c82 (0xb658 bytes) 2024-09-21T15:09:10.930 INFO:teuthology.orchestra.run.smithi161.stdout:3680 read 0xd4d97f thru 0xd4da8f (0x111 bytes) 2024-09-21T15:09:10.939 INFO:teuthology.orchestra.run.smithi161.stdout:3698 write 0x8b3efff thru 0x8b49afa (0xaafc bytes) 2024-09-21T15:09:10.940 INFO:teuthology.orchestra.run.smithi161.stdout:3672 write 0x4a61e69 thru 0x4a69607 (0x779f bytes) 2024-09-21T15:09:10.946 INFO:teuthology.orchestra.run.smithi161.stdout:2815 trunc from 0xbf51957 to 0x654e5bb 2024-09-21T15:09:10.952 INFO:teuthology.orchestra.run.smithi161.stdout:3681 trunc from 0xe065339 to 0x11200f2 2024-09-21T15:09:10.968 INFO:teuthology.orchestra.run.smithi161.stdout:3699 write 0x875d38b thru 0x87611b8 (0x3e2e bytes) 2024-09-21T15:09:10.985 INFO:teuthology.orchestra.run.smithi161.stdout:3673 punch from 0x4601af7 to 0x4606573, (0x4a7c bytes) 2024-09-21T15:09:11.007 INFO:teuthology.orchestra.run.smithi161.stdout:3700 read 0x63a3a06 thru 0x63b17e0 (0xdddb bytes) 2024-09-21T15:09:11.008 INFO:teuthology.orchestra.run.smithi161.stdout:3701 trunc from 0x8b49afb to 0x7e07364 2024-09-21T15:09:11.039 INFO:teuthology.orchestra.run.smithi161.stdout:2816 read 0x4bb1492 thru 0x4bbe568 (0xd0d7 bytes) 2024-09-21T15:09:11.039 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.063 INFO:teuthology.orchestra.run.smithi161.stdout:2818 trunc from 0x654e5bb to 0xea28872 2024-09-21T15:09:11.067 INFO:teuthology.orchestra.run.smithi161.stdout:3674 writesame 0xa717025 thru 0xa71d734 data_size 0x8(0x6710 bytes) 2024-09-21T15:09:11.073 INFO:teuthology.orchestra.run.smithi161.stdout:3675 punch from 0xcc54e8 to 0xcc855a, (0x3072 bytes) 2024-09-21T15:09:11.073 INFO:teuthology.orchestra.run.smithi161.stdout:3677 write 0x80b4f18 thru 0x80bc8f9 (0x79e2 bytes) 2024-09-21T15:09:11.074 INFO:teuthology.orchestra.run.smithi161.stdout:3703 trunc from 0x7e07364 to 0x86faf89 2024-09-21T15:09:11.101 INFO:teuthology.orchestra.run.smithi161.stdout:2819 punch from 0x77f3c51 to 0x77fcf5d, (0x930c bytes) 2024-09-21T15:09:11.101 INFO:teuthology.orchestra.run.smithi161.stdout:2820 read 0xb99b256 thru 0xb9a4fe3 (0x9d8e bytes) 2024-09-21T15:09:11.101 INFO:teuthology.orchestra.run.smithi161.stdout:2821 writesame 0x435b4f0 thru 0x4365df2 data_size 0x7(0xa903 bytes) 2024-09-21T15:09:11.102 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.102 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.111 INFO:teuthology.orchestra.run.smithi161.stdout:3678 trunc from 0xa71d735 to 0xde7f733 2024-09-21T15:09:11.112 INFO:teuthology.orchestra.run.smithi161.stdout:3707 trunc from 0x86faf89 to 0x2f1a694 2024-09-21T15:09:11.112 INFO:teuthology.orchestra.run.smithi161.stdout:3682 write 0xae84e0b thru 0xae92877 (0xda6d bytes) 2024-09-21T15:09:11.134 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.134 INFO:teuthology.orchestra.run.smithi161.stdout:2823 writesame 0x1d5b30f thru 0x1d60e06 data_size 0x52(0x5af8 bytes) 2024-09-21T15:09:11.143 INFO:teuthology.orchestra.run.smithi161.stdout:3683 writesame 0x989aa49 thru 0x98a71c8 data_size 0x40(0xc780 bytes) 2024-09-21T15:09:11.165 INFO:teuthology.orchestra.run.smithi161.stdout:2825 read 0xad03fa6 thru 0xad08cfc (0x4d57 bytes) 2024-09-21T15:09:11.167 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.167 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.175 INFO:teuthology.orchestra.run.smithi161.stdout:3679 read 0x2440102 thru 0x24429dd (0x28dc bytes) 2024-09-21T15:09:11.175 INFO:teuthology.orchestra.run.smithi161.stdout:3680 writesame 0x37483bd thru 0x3754495 data_size 0x1(0xc0d9 bytes) 2024-09-21T15:09:11.193 INFO:teuthology.orchestra.run.smithi161.stdout:2826 trunc from 0xea28872 to 0x103db42 2024-09-21T15:09:11.198 INFO:teuthology.orchestra.run.smithi161.stdout:3886 trunc from 0x6632a0c to 0xa4d06b1 2024-09-21T15:09:11.199 INFO:teuthology.orchestra.run.smithi161.stdout:3708 trunc from 0x2f1a694 to 0xb7dc10f 2024-09-21T15:09:11.223 INFO:teuthology.orchestra.run.smithi161.stdout:3686 write 0xe8e7394 thru 0xe8f464d (0xd2ba bytes) 2024-09-21T15:09:11.241 INFO:teuthology.orchestra.run.smithi161.stdout:3688 punch from 0xc67835a to 0xc685222, (0xcec8 bytes) 2024-09-21T15:09:11.241 INFO:teuthology.orchestra.run.smithi161.stdout:3689 punch from 0x7343ab6 to 0x73456e6, (0x1c30 bytes) 2024-09-21T15:09:11.241 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xec95d88 2024-09-21T15:09:11.241 INFO:teuthology.orchestra.run.smithi161.stdout:3690 trunc from 0xe8f464e to 0xec95d88 2024-09-21T15:09:11.243 INFO:teuthology.orchestra.run.smithi161.stdout:3709 punch from 0x7a4c6a to 0x7afa03, (0xad99 bytes) 2024-09-21T15:09:11.243 INFO:teuthology.orchestra.run.smithi161.stdout:3710 write 0x6bcf017 thru 0x6bdedfc (0xfde6 bytes) 2024-09-21T15:09:11.247 INFO:teuthology.orchestra.run.smithi161.stdout:3682 trunc from 0xde7f733 to 0x40aeff2 2024-09-21T15:09:11.262 INFO:teuthology.orchestra.run.smithi161.stdout:2828 punch from 0x7c58ea to 0x7d2184, (0xc89a bytes) 2024-09-21T15:09:11.267 INFO:teuthology.orchestra.run.smithi161.stdout:3711 punch from 0x84b0881 to 0x84be73e, (0xdebd bytes) 2024-09-21T15:09:11.267 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.267 INFO:teuthology.orchestra.run.smithi161.stdout:3714 write 0x7885986 thru 0x78942f6 (0xe971 bytes) 2024-09-21T15:09:11.275 INFO:teuthology.orchestra.run.smithi161.stdout:3887 read 0x2d83581 thru 0x2d849fb (0x147b bytes) 2024-09-21T15:09:11.279 INFO:teuthology.orchestra.run.smithi161.stdout:3888 trunc from 0xa4d06b1 to 0x78d06e0 2024-09-21T15:09:11.290 INFO:teuthology.orchestra.run.smithi161.stdout:3691 trunc from 0xec95d88 to 0xc903424 2024-09-21T15:09:11.299 INFO:teuthology.orchestra.run.smithi161.stdout:3716 read 0x62ba494 thru 0x62c9e4c (0xf9b9 bytes) 2024-09-21T15:09:11.300 INFO:teuthology.orchestra.run.smithi161.stdout:3718 read 0xa194aa2 thru 0xa1a42bb (0xf81a bytes) 2024-09-21T15:09:11.311 INFO:teuthology.orchestra.run.smithi161.stdout:3719 trunc from 0xb7dc10f to 0x4a516c0 2024-09-21T15:09:11.313 INFO:teuthology.orchestra.run.smithi161.stdout:3324 read 0x4c5244d thru 0x4c57e06 (0x59ba bytes) 2024-09-21T15:09:11.315 INFO:teuthology.orchestra.run.smithi161.stdout:2830 write 0x8ef7da1 thru 0x8efbf07 (0x4167 bytes) 2024-09-21T15:09:11.321 INFO:teuthology.orchestra.run.smithi161.stdout:3684 trunc from 0x40aeff2 to 0x3681559 2024-09-21T15:09:11.345 INFO:teuthology.orchestra.run.smithi161.stdout:2833 read 0x778e479 thru 0x779130b (0x2e93 bytes) 2024-09-21T15:09:11.345 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.346 INFO:teuthology.orchestra.run.smithi161.stdout:3325 read 0xa12a597 thru 0xa12b752 (0x11bc bytes) 2024-09-21T15:09:11.346 INFO:teuthology.orchestra.run.smithi161.stdout:3326 read 0x4d83cec thru 0x4d8dc89 (0x9f9e bytes) 2024-09-21T15:09:11.346 INFO:teuthology.orchestra.run.smithi161.stdout:3327 write 0xb554355 thru 0xb55dc22 (0x98ce bytes) 2024-09-21T15:09:11.352 INFO:teuthology.orchestra.run.smithi161.stdout:3692 write 0x7f145da thru 0x7f2229d (0xdcc4 bytes) 2024-09-21T15:09:11.372 INFO:teuthology.orchestra.run.smithi161.stdout:3693 write 0x40dd156 thru 0x40e6bc7 (0x9a72 bytes) 2024-09-21T15:09:11.376 INFO:teuthology.orchestra.run.smithi161.stdout:3328 trunc from 0xcb9e6e0 to 0xcc4ad8f 2024-09-21T15:09:11.380 INFO:teuthology.orchestra.run.smithi161.stdout:3890 write 0xcf3c5f2 thru 0xcf453fd (0x8e0c bytes) 2024-09-21T15:09:11.384 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.392 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.392 INFO:teuthology.orchestra.run.smithi161.stdout:3695 punch from 0x44df197 to 0x44e72c6, (0x812f bytes) 2024-09-21T15:09:11.392 INFO:teuthology.orchestra.run.smithi161.stdout:3696 read 0x2408ba4 thru 0x24106fd (0x7b5a bytes) 2024-09-21T15:09:11.393 INFO:teuthology.orchestra.run.smithi161.stdout:3697 write 0x8f5426c thru 0x8f60a8a (0xc81f bytes) 2024-09-21T15:09:11.397 INFO:teuthology.orchestra.run.smithi161.stdout:3891 punch from 0x2dbb682 to 0x2dc7dad, (0xc72b bytes) 2024-09-21T15:09:11.398 INFO:teuthology.orchestra.run.smithi161.stdout:3892 read 0x7db3566 thru 0x7db7b5d (0x45f8 bytes) 2024-09-21T15:09:11.398 INFO:teuthology.orchestra.run.smithi161.stdout:3893 writesame 0x405cfb1 thru 0x4063bc1 data_size 0xb(0x6c11 bytes) 2024-09-21T15:09:11.399 INFO:teuthology.orchestra.run.smithi161.stdout:2835 writesame 0xbbc5d82 thru 0xbbd5a71 data_size 0xd5(0xfcf0 bytes) 2024-09-21T15:09:11.402 INFO:teuthology.orchestra.run.smithi161.stdout:2838 writesame 0xb03dfd5 thru 0xb03e184 data_size 0x12(0x1b0 bytes) 2024-09-21T15:09:11.404 INFO:teuthology.orchestra.run.smithi161.stdout:3685 trunc from 0x3681559 to 0x759de81 2024-09-21T15:09:11.416 INFO:teuthology.orchestra.run.smithi161.stdout:3698 read 0x9bcd1c2 thru 0x9bcef19 (0x1d58 bytes) 2024-09-21T15:09:11.416 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.416 INFO:teuthology.orchestra.run.smithi161.stdout:3702 writesame 0x5348a3f thru 0x53532e1 data_size 0x1(0xa8a3 bytes) 2024-09-21T15:09:11.417 INFO:teuthology.orchestra.run.smithi161.stdout:3329 write 0x15b2c1e thru 0x15b4303 (0x16e6 bytes) 2024-09-21T15:09:11.425 INFO:teuthology.orchestra.run.smithi161.stdout:2839 trunc from 0xbbd5a72 to 0x8bb5975 2024-09-21T15:09:11.425 INFO:teuthology.orchestra.run.smithi161.stdout:3894 read 0xcb6bd23 thru 0xcb7023d (0x451b bytes) 2024-09-21T15:09:11.425 INFO:teuthology.orchestra.run.smithi161.stdout:3895 writesame 0x52657fe thru 0x5272496 data_size 0x4f(0xcc99 bytes) 2024-09-21T15:09:11.431 INFO:teuthology.orchestra.run.smithi161.stdout:3686 read 0x55fa1d5 thru 0x5600d4b (0x6b77 bytes) 2024-09-21T15:09:11.431 INFO:teuthology.orchestra.run.smithi161.stdout:3688 punch from 0x2a90d85 to 0x2a92037, (0x12b2 bytes) 2024-09-21T15:09:11.432 INFO:teuthology.orchestra.run.smithi161.stdout:3722 write 0xc9ad645 thru 0xc9b48b4 (0x7270 bytes) 2024-09-21T15:09:11.434 INFO:teuthology.orchestra.run.smithi161.stdout:3689 trunc from 0x759de81 to 0x60d1c8c 2024-09-21T15:09:11.461 INFO:teuthology.orchestra.run.smithi161.stdout:3332 punch from 0x566b872 to 0x567791f, (0xc0ad bytes) 2024-09-21T15:09:11.461 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.461 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.461 INFO:teuthology.orchestra.run.smithi161.stdout:3337 write 0xb9e1f56 thru 0xb9e61d1 (0x427c bytes) 2024-09-21T15:09:11.474 INFO:teuthology.orchestra.run.smithi161.stdout:3703 write 0x8971e59 thru 0x897a68f (0x8837 bytes) 2024-09-21T15:09:11.477 INFO:teuthology.orchestra.run.smithi161.stdout:3898 read 0xcbfbdf5 thru 0xcbfd193 (0x139f bytes) 2024-09-21T15:09:11.480 INFO:teuthology.orchestra.run.smithi161.stdout:3899 write 0x114583c thru 0x114cd71 (0x7536 bytes) 2024-09-21T15:09:11.484 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.485 INFO:teuthology.orchestra.run.smithi161.stdout:3691 trunc from 0x60d1c8c to 0x60071ec 2024-09-21T15:09:11.490 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.490 INFO:teuthology.orchestra.run.smithi161.stdout:3726 read 0x63148d1 thru 0x6318b82 (0x42b2 bytes) 2024-09-21T15:09:11.495 INFO:teuthology.orchestra.run.smithi161.stdout:3338 read 0x60878f6 thru 0x608f192 (0x789d bytes) 2024-09-21T15:09:11.496 INFO:teuthology.orchestra.run.smithi161.stdout:3339 writesame 0xb1be5c thru 0xb224e6 data_size 0x1(0x668b bytes) 2024-09-21T15:09:11.506 INFO:teuthology.orchestra.run.smithi161.stdout:3728 trunc from 0xc9b48b5 to 0x4ee9278 2024-09-21T15:09:11.529 INFO:teuthology.orchestra.run.smithi161.stdout:3704 write 0x5796749 thru 0x579ea57 (0x830f bytes) 2024-09-21T15:09:11.533 INFO:teuthology.orchestra.run.smithi161.stdout:3692 clone 22 order 23 su 32768 sc 7 2024-09-21T15:09:11.542 INFO:teuthology.orchestra.run.smithi161.stdout:3706 punch from 0x86bbd57 to 0x86c5db6, (0xa05f bytes) 2024-09-21T15:09:11.546 INFO:teuthology.orchestra.run.smithi161.stdout:3707 trunc from 0xc903424 to 0xab984e7 2024-09-21T15:09:11.559 INFO:teuthology.orchestra.run.smithi161.stdout:3340 trunc from 0xcc4ad8f to 0xc781676 2024-09-21T15:09:11.566 INFO:teuthology.orchestra.run.smithi161.stdout:3900 write 0x22fac00 thru 0x2307561 (0xc962 bytes) 2024-09-21T15:09:11.567 INFO:teuthology.orchestra.run.smithi161.stdout:2841 punch from 0x6d5a61b to 0x6d67e0e, (0xd7f3 bytes) 2024-09-21T15:09:11.567 INFO:teuthology.orchestra.run.smithi161.stdout:2842 write 0x57f61fe thru 0x57f9179 (0x2f7c bytes) 2024-09-21T15:09:11.599 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.604 INFO:teuthology.orchestra.run.smithi161.stdout:3901 write 0x4446416 thru 0x4453b37 (0xd722 bytes) 2024-09-21T15:09:11.606 INFO:teuthology.orchestra.run.smithi161.stdout:2848 trunc from 0x8bb5975 to 0x5f7ebb3 2024-09-21T15:09:11.629 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.624+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c888f70 2024-09-21T15:09:11.629 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.624+0000 7f1e9c77a700 -1 reset not still connected to 0x56287cb1c0d0 2024-09-21T15:09:11.629 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.624+0000 7f1e9c77a700 -1 reset not still connected to 0x56287ce70000 2024-09-21T15:09:11.630 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.624+0000 7f1e9c77a700 -1 reset not still connected to 0x562889a931e0 2024-09-21T15:09:11.630 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.624+0000 7f1e9c77a700 -1 reset not still connected to 0x56288edfc9c0 2024-09-21T15:09:11.630 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.624+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f3264e0 2024-09-21T15:09:11.630 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.624+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f959ba0 2024-09-21T15:09:11.630 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.624+0000 7f1e9c77a700 -1 reset not still connected to 0x562890035520 2024-09-21T15:09:11.630 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.624+0000 7f1e9c77a700 -1 reset not still connected to 0x5628908044e0 2024-09-21T15:09:11.630 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.624+0000 7f1e9c77a700 -1 reset not still connected to 0x56289097b110 2024-09-21T15:09:11.630 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.624+0000 7f1e9c77a700 -1 reset not still connected to 0x562890d15860 2024-09-21T15:09:11.633 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.628+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5930 2024-09-21T15:09:11.635 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.636+0000 7f1e9c77a700 -1 reset not still connected to 0x5628982891e0 2024-09-21T15:09:11.636 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:11.636+0000 7f1e9c77a700 -1 reset not still connected to 0x56289873cf70 2024-09-21T15:09:11.636 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.637 INFO:teuthology.orchestra.run.smithi161.stdout:3730 punch from 0x7b2a8 to 0x88dbb, (0xdb13 bytes) 2024-09-21T15:09:11.645 INFO:teuthology.orchestra.run.smithi161.stdout:3731 trunc from 0x4ee9278 to 0x111ca8d 2024-09-21T15:09:11.663 INFO:teuthology.orchestra.run.smithi161.stdout:3902 punch from 0x42dab93 to 0x42e4447, (0x98b4 bytes) 2024-09-21T15:09:11.663 INFO:teuthology.orchestra.run.smithi161.stdout:3903 punch from 0xb176086 to 0xb1859a2, (0xf91c bytes) 2024-09-21T15:09:11.663 INFO:teuthology.orchestra.run.smithi161.stdout:3905 trunc from 0xcf453fe to 0xcc12efe 2024-09-21T15:09:11.670 INFO:teuthology.orchestra.run.smithi161.stdout:3341 clone 28 order 21 su 1048576 sc 12 2024-09-21T15:09:11.677 INFO:teuthology.orchestra.run.smithi161.stdout:2849 write 0x1ba3991 thru 0x1bad70f (0x9d7f bytes) 2024-09-21T15:09:11.691 INFO:teuthology.orchestra.run.smithi161.stdout:2851 clone 34 order 19 su 131072 sc 11 2024-09-21T15:09:11.699 INFO:teuthology.orchestra.run.smithi161.stdout:3907 punch from 0xb8198d4 to 0xb828482, (0xebae bytes) 2024-09-21T15:09:11.699 INFO:teuthology.orchestra.run.smithi161.stdout:3908 punch from 0x1b42e87 to 0x1b4b50f, (0x8688 bytes) 2024-09-21T15:09:11.701 INFO:teuthology.orchestra.run.smithi161.stdout:3732 writesame 0x26cc49c thru 0x26d5b97 data_size 0x6(0x96fc bytes) 2024-09-21T15:09:11.713 INFO:teuthology.orchestra.run.smithi161.stdout:3733 trunc from 0x26d5b98 to 0x5a0ed57 2024-09-21T15:09:11.718 INFO:teuthology.orchestra.run.smithi161.stdout:3909 trunc from 0xcc12efe to 0x3cf34de 2024-09-21T15:09:11.750 INFO:teuthology.orchestra.run.smithi161.stdout:3734 writesame 0x131785e thru 0x131f937 data_size 0x1(0x80da bytes) 2024-09-21T15:09:11.793 INFO:teuthology.orchestra.run.smithi161.stdout:3911 read 0x3105f44 thru 0x310f154 (0x9211 bytes) 2024-09-21T15:09:11.794 INFO:teuthology.orchestra.run.smithi161.stdout:3912 punch from 0x2896a89 to 0x289ab36, (0x40ad bytes) 2024-09-21T15:09:11.794 INFO:teuthology.orchestra.run.smithi161.stdout:3913 read 0x8110c thru 0x8da76 (0xc96b bytes) 2024-09-21T15:09:11.811 INFO:teuthology.orchestra.run.smithi161.stdout:3915 trunc from 0x3cf34de to 0xa9abd10 2024-09-21T15:09:11.812 INFO:teuthology.orchestra.run.smithi161.stdout:3708 read 0x5725f3b thru 0x5732ed2 (0xcf98 bytes) 2024-09-21T15:09:11.812 INFO:teuthology.orchestra.run.smithi161.stdout:3709 write 0x2f6951 thru 0x3017b0 (0xae60 bytes) 2024-09-21T15:09:11.832 INFO:teuthology.orchestra.run.smithi161.stdout:3711 punch from 0x3f10c5f to 0x3f1908c, (0x842d bytes) 2024-09-21T15:09:11.832 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.832 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.832 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.832 INFO:teuthology.orchestra.run.smithi161.stdout:3720 write 0x88f0876 thru 0x88fa1fe (0x9989 bytes) 2024-09-21T15:09:11.833 INFO:teuthology.orchestra.run.smithi161.stdout:3735 writesame 0x7c828f3 thru 0x7c8fff1 data_size 0x1(0xd6ff bytes) 2024-09-21T15:09:11.837 INFO:teuthology.orchestra.run.smithi161.stdout:3736 read 0x1571639 thru 0x157db89 (0xc551 bytes) 2024-09-21T15:09:11.839 INFO:teuthology.orchestra.run.smithi161.stdout:3738 trunc from 0x7c8fff2 to 0x6fde3db 2024-09-21T15:09:11.848 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.848 INFO:teuthology.orchestra.run.smithi161.stdout:3918 read 0xa73f48a thru 0xa74591c (0x6493 bytes) 2024-09-21T15:09:11.848 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.848 INFO:teuthology.orchestra.run.smithi161.stdout:3920 read 0x96eaec9 thru 0x96ef426 (0x455e bytes) 2024-09-21T15:09:11.849 INFO:teuthology.orchestra.run.smithi161.stdout:3922 read 0x1aa7d2f thru 0x1ab4f75 (0xd247 bytes) 2024-09-21T15:09:11.885 INFO:teuthology.orchestra.run.smithi161.stdout:3923 write 0xce1b8ff thru 0xce21931 (0x6033 bytes) 2024-09-21T15:09:11.889 INFO:teuthology.orchestra.run.smithi161.stdout:3721 write 0xce94c09 thru 0xcea41b8 (0xf5b0 bytes) 2024-09-21T15:09:11.905 INFO:teuthology.orchestra.run.smithi161.stdout:3722 read 0xa6e34a5 thru 0xa6efba0 (0xc6fc bytes) 2024-09-21T15:09:11.915 INFO:teuthology.orchestra.run.smithi161.stdout:3739 write 0xde9797f thru 0xde99163 (0x17e5 bytes) 2024-09-21T15:09:11.934 INFO:teuthology.orchestra.run.smithi161.stdout:3740 read 0xb9b61f6 thru 0xb9c04be (0xa2c9 bytes) 2024-09-21T15:09:11.934 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.934 INFO:teuthology.orchestra.run.smithi161.stdout:3742 punch from 0xc58f583 to 0xc59823e, (0x8cbb bytes) 2024-09-21T15:09:11.934 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:11.934 INFO:teuthology.orchestra.run.smithi161.stdout:3745 punch from 0x91b89a2 to 0x91bb994, (0x2ff2 bytes) 2024-09-21T15:09:11.934 INFO:teuthology.orchestra.run.smithi161.stdout:3746 writesame 0x16a5947 thru 0x16ad6c6 data_size 0x40(0x7d80 bytes) 2024-09-21T15:09:11.937 INFO:teuthology.orchestra.run.smithi161.stdout:3924 write 0xed7f875 thru 0xed85380 (0x5b0c bytes) 2024-09-21T15:09:11.953 INFO:teuthology.orchestra.run.smithi161.stdout:3723 write 0xee56ec2 thru 0xee5f6cc (0x880b bytes) 2024-09-21T15:09:11.958 INFO:teuthology.orchestra.run.smithi161.stdout:3747 read 0xaa9251c thru 0xaa993e8 (0x6ecd bytes) 2024-09-21T15:09:11.958 INFO:teuthology.orchestra.run.smithi161.stdout:3925 read 0x9832a16 thru 0x9837c53 (0x523e bytes) 2024-09-21T15:09:11.958 INFO:teuthology.orchestra.run.smithi161.stdout:3926 write 0x97533f6 thru 0x9758be0 (0x57eb bytes) 2024-09-21T15:09:11.964 INFO:teuthology.orchestra.run.smithi161.stdout:3748 trunc from 0xde99164 to 0xb610cb2 2024-09-21T15:09:11.973 INFO:teuthology.orchestra.run.smithi161.stdout:3726 read 0x7014284 thru 0x701e1ac (0x9f29 bytes) 2024-09-21T15:09:11.973 INFO:teuthology.orchestra.run.smithi161.stdout:3727 punch from 0xb799340 to 0xb7a902c, (0xfcec bytes) 2024-09-21T15:09:11.973 INFO:teuthology.orchestra.run.smithi161.stdout:3728 write 0x120cca6 thru 0x12166a2 (0x99fd bytes) 2024-09-21T15:09:11.993 INFO:teuthology.orchestra.run.smithi161.stdout:3729 punch from 0xec5ec96 to 0xec69b94, (0xaefe bytes) 2024-09-21T15:09:12.019 INFO:teuthology.orchestra.run.smithi161.stdout:3928 trunc from 0xed85381 to 0x1cc5d7b 2024-09-21T15:09:12.022 INFO:teuthology.orchestra.run.smithi161.stdout:3749 writesame 0x8a94491 thru 0x8a9fc11 data_size 0x7(0xb781 bytes) 2024-09-21T15:09:12.026 INFO:teuthology.orchestra.run.smithi161.stdout:3730 trunc from 0xee5f6cd to 0x1f5de47 2024-09-21T15:09:12.046 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:12.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562890034680 2024-09-21T15:09:12.047 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:12.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562890035520 2024-09-21T15:09:12.047 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:12.040+0000 7f1e9c77a700 -1 reset not still connected to 0x5628908044e0 2024-09-21T15:09:12.047 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:12.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562890805d40 2024-09-21T15:09:12.047 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:12.040+0000 7f1e9c77a700 -1 reset not still connected to 0x56289097b110 2024-09-21T15:09:12.047 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:12.040+0000 7f1e9c77a700 -1 reset not still connected to 0x562890d15860 2024-09-21T15:09:12.048 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:12.048+0000 7f1e9c77a700 -1 reset not still connected to 0x562893ff1040 2024-09-21T15:09:12.048 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:12.048+0000 7f1e9c77a700 -1 reset not still connected to 0x5628944b1450 2024-09-21T15:09:12.048 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:12.048+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5930 2024-09-21T15:09:12.048 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:12.048+0000 7f1e9c77a700 -1 reset not still connected to 0x562897c70ea0 2024-09-21T15:09:12.049 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:12.048+0000 7f1e9c77a700 -1 reset not still connected to 0x562897c71040 2024-09-21T15:09:12.050 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:12.048+0000 7f1e9c77a700 -1 reset not still connected to 0x5628982891e0 2024-09-21T15:09:12.050 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:12.048+0000 7f1e9c77a700 -1 reset not still connected to 0x56289873cf70 2024-09-21T15:09:12.064 INFO:teuthology.orchestra.run.smithi161.stdout:3751 read 0x7aadfa4 thru 0x7ab80ec (0xa149 bytes) 2024-09-21T15:09:12.064 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.064 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.064 INFO:teuthology.orchestra.run.smithi161.stdout:3760 write 0x378d5cb thru 0x379d59d (0xffd3 bytes) 2024-09-21T15:09:12.093 INFO:teuthology.orchestra.run.smithi161.stdout:3761 read 0x1ffd451 thru 0x200b16c (0xdd1c bytes) 2024-09-21T15:09:12.094 INFO:teuthology.orchestra.run.smithi161.stdout:3762 writesame 0x2edda91 thru 0x2eea667 data_size 0x1(0xcbd7 bytes) 2024-09-21T15:09:12.141 INFO:teuthology.orchestra.run.smithi161.stdout:3763 read 0xe16169 thru 0xe16fec (0xe84 bytes) 2024-09-21T15:09:12.143 INFO:teuthology.orchestra.run.smithi161.stdout:3764 trunc from 0xb610cb2 to 0xa1c5ab1 2024-09-21T15:09:12.158 INFO:teuthology.orchestra.run.smithi161.stdout:3731 trunc from 0x1f5de47 to 0xaad55a7 2024-09-21T15:09:12.172 INFO:teuthology.orchestra.run.smithi161.stdout:3929 write 0x3e7f51 thru 0x3e80a9 (0x159 bytes) 2024-09-21T15:09:12.184 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.185 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.215 INFO:teuthology.orchestra.run.smithi161.stdout:3732 trunc from 0xaad55a7 to 0x6236d96 2024-09-21T15:09:12.224 INFO:teuthology.orchestra.run.smithi161.stdout:3767 write 0xa4ab755 thru 0xa4aee51 (0x36fd bytes) 2024-09-21T15:09:12.247 INFO:teuthology.orchestra.run.smithi161.stdout:3733 punch from 0xf37b70 to 0xf3e9ca, (0x6e5a bytes) 2024-09-21T15:09:12.247 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.249 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.249 INFO:teuthology.orchestra.run.smithi161.stdout:3931 writesame 0x3cd7ec thru 0x3db84c data_size 0x29(0xe061 bytes) 2024-09-21T15:09:12.281 INFO:teuthology.orchestra.run.smithi161.stdout:3736 writesame 0x765ecf1 thru 0x766b38d data_size 0x1(0xc69d bytes) 2024-09-21T15:09:12.306 INFO:teuthology.orchestra.run.smithi161.stdout:3769 write 0xe7f60e7 thru 0xe7fc33c (0x6256 bytes) 2024-09-21T15:09:12.326 INFO:teuthology.orchestra.run.smithi161.stdout:3737 write 0x9e47411 thru 0x9e4fd7e (0x896e bytes) 2024-09-21T15:09:12.329 INFO:teuthology.orchestra.run.smithi161.stdout:3770 read 0x9b3816b thru 0x9b43255 (0xb0eb bytes) 2024-09-21T15:09:12.329 INFO:teuthology.orchestra.run.smithi161.stdout:3772 read 0xa323a6 thru 0xa380f8 (0x5d53 bytes) 2024-09-21T15:09:12.330 INFO:teuthology.orchestra.run.smithi161.stdout:3774 read 0x9a04da6 thru 0x9a0881d (0x3a78 bytes) 2024-09-21T15:09:12.340 INFO:teuthology.orchestra.run.smithi161.stdout:3776 trunc from 0xe7fc33d to 0xa7ac1be 2024-09-21T15:09:12.345 INFO:teuthology.orchestra.run.smithi161.stdout:3738 writesame 0x7b11c17 thru 0x7b17e1a data_size 0x44(0x6204 bytes) 2024-09-21T15:09:12.362 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.362 INFO:teuthology.orchestra.run.smithi161.stdout:3740 read 0x6fc5b09 thru 0x6fc7e32 (0x232a bytes) 2024-09-21T15:09:12.362 INFO:teuthology.orchestra.run.smithi161.stdout:3742 read 0x74be8b thru 0x7589c7 (0xcb3d bytes) 2024-09-21T15:09:12.362 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.362 INFO:teuthology.orchestra.run.smithi161.stdout:3744 writesame 0x8933508 thru 0x89367e2 data_size 0x1(0x32db bytes) 2024-09-21T15:09:12.370 INFO:teuthology.orchestra.run.smithi161.stdout:3932 writesame 0x8ea02ea thru 0x8ea5758 data_size 0xf(0x546f bytes) 2024-09-21T15:09:12.374 INFO:teuthology.orchestra.run.smithi161.stdout:3933 write 0x2a60774 thru 0x2a62b47 (0x23d4 bytes) 2024-09-21T15:09:12.384 INFO:teuthology.orchestra.run.smithi161.stdout:3745 write 0x37c6f5e thru 0x37ca91f (0x39c2 bytes) 2024-09-21T15:09:12.388 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.395 INFO:teuthology.orchestra.run.smithi161.stdout:3746 write 0x64c34d6 thru 0x64c8937 (0x5462 bytes) 2024-09-21T15:09:12.400 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.400 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.400 INFO:teuthology.orchestra.run.smithi161.stdout:3779 read 0x6a8be7e thru 0x6a8c04e (0x1d1 bytes) 2024-09-21T15:09:12.400 INFO:teuthology.orchestra.run.smithi161.stdout:3780 read 0x717c202 thru 0x7186b64 (0xa963 bytes) 2024-09-21T15:09:12.401 INFO:teuthology.orchestra.run.smithi161.stdout:3781 read 0x2c10221 thru 0x2c16194 (0x5f74 bytes) 2024-09-21T15:09:12.401 INFO:teuthology.orchestra.run.smithi161.stdout:3783 write 0x52cb7ec thru 0x52ce94b (0x3160 bytes) 2024-09-21T15:09:12.412 INFO:teuthology.orchestra.run.smithi161.stdout:3784 writesame 0x1e0f8b2 thru 0x1e116e0 data_size 0x1(0x1e2f bytes) 2024-09-21T15:09:12.428 INFO:teuthology.orchestra.run.smithi161.stdout:3785 read 0x824e08c thru 0x825843e (0xa3b3 bytes) 2024-09-21T15:09:12.428 INFO:teuthology.orchestra.run.smithi161.stdout:3788 punch from 0x592947 to 0x59946f, (0x6b28 bytes) 2024-09-21T15:09:12.433 INFO:teuthology.orchestra.run.smithi161.stdout:3935 writesame 0xda28a75 thru 0xda353b6 data_size 0x5d(0xc942 bytes) 2024-09-21T15:09:12.436 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.436 INFO:teuthology.orchestra.run.smithi161.stdout:3937 writesame 0xc99c207 thru 0xc9a3bba data_size 0x2(0x79b4 bytes) 2024-09-21T15:09:12.439 INFO:teuthology.orchestra.run.smithi161.stdout:3790 trunc from 0xa7ac1be to 0x616702c 2024-09-21T15:09:12.443 INFO:teuthology.orchestra.run.smithi161.stdout:3747 writesame 0xd2e185c thru 0xd2ef38a data_size 0x1(0xdb2f bytes) 2024-09-21T15:09:12.459 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.460 INFO:teuthology.orchestra.run.smithi161.stdout:3941 flatten 2024-09-21T15:09:12.487 INFO:teuthology.orchestra.run.smithi161.stdout:3748 write 0xdbd1e5e thru 0xdbd6e65 (0x5008 bytes) 2024-09-21T15:09:12.495 INFO:teuthology.orchestra.run.smithi161.stdout:3791 read 0xd3fcef thru 0xd4eaf8 (0xee0a bytes) 2024-09-21T15:09:12.502 INFO:teuthology.orchestra.run.smithi161.stdout:3792 trunc from 0x616702c to 0x8859e67 2024-09-21T15:09:12.531 INFO:teuthology.orchestra.run.smithi161.stdout:3749 write 0x54d925a thru 0x54de4b0 (0x5257 bytes) 2024-09-21T15:09:12.532 INFO:teuthology.orchestra.run.smithi161.stdout:3942 read 0xa4abf44 thru 0xa4bbc9b (0xfd58 bytes) 2024-09-21T15:09:12.532 INFO:teuthology.orchestra.run.smithi161.stdout:3944 write 0x7bdfba5 thru 0x7be3a15 (0x3e71 bytes) 2024-09-21T15:09:12.573 INFO:teuthology.orchestra.run.smithi161.stdout:3750 writesame 0x5c80283 thru 0x5c8de4e data_size 0x36(0xdbcc bytes) 2024-09-21T15:09:12.583 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.583 INFO:teuthology.orchestra.run.smithi161.stdout:3946 write 0x15407fb thru 0x154c78d (0xbf93 bytes) 2024-09-21T15:09:12.598 INFO:teuthology.orchestra.run.smithi161.stdout:3793 write 0x27b8546 thru 0x27b8c20 (0x6db bytes) 2024-09-21T15:09:12.603 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.603 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.603 INFO:teuthology.orchestra.run.smithi161.stdout:3753 write 0x2aee432 thru 0x2afa852 (0xc421 bytes) 2024-09-21T15:09:12.603 INFO:teuthology.orchestra.run.smithi161.stdout:3947 write 0x9c32478 thru 0x9c341b2 (0x1d3b bytes) 2024-09-21T15:09:12.635 INFO:teuthology.orchestra.run.smithi161.stdout:3756 punch from 0x8bad174 to 0x8bb321d, (0x60a9 bytes) 2024-09-21T15:09:12.635 INFO:teuthology.orchestra.run.smithi161.stdout:3760 writesame 0xadcc96d thru 0xadd0850 data_size 0x4(0x3ee4 bytes) 2024-09-21T15:09:12.642 INFO:teuthology.orchestra.run.smithi161.stdout:3794 trunc from 0x8859e67 to 0x4e9671f 2024-09-21T15:09:12.644 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.644 INFO:teuthology.orchestra.run.smithi161.stdout:3949 write 0x1aa3f03 thru 0x1aacab0 (0x8bae bytes) 2024-09-21T15:09:12.664 INFO:teuthology.orchestra.run.smithi161.stdout:3761 punch from 0xd6209cb to 0xd625273, (0x48a8 bytes) 2024-09-21T15:09:12.664 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.664 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.664 INFO:teuthology.orchestra.run.smithi161.stdout:3766 read 0x955fb83 thru 0x956651b (0x6999 bytes) 2024-09-21T15:09:12.668 INFO:teuthology.orchestra.run.smithi161.stdout:3950 punch from 0x8c72017 to 0x8c785f0, (0x65d9 bytes) 2024-09-21T15:09:12.668 INFO:teuthology.orchestra.run.smithi161.stdout:3953 punch from 0x33bc3a5 to 0x33cae7e, (0xead9 bytes) 2024-09-21T15:09:12.668 INFO:teuthology.orchestra.run.smithi161.stdout:3954 write 0x1fce750 thru 0x1fda3f1 (0xbca2 bytes) 2024-09-21T15:09:12.681 INFO:teuthology.orchestra.run.smithi161.stdout:3767 trunc from 0xdbd6e66 to 0x66b2a8b 2024-09-21T15:09:12.701 INFO:teuthology.orchestra.run.smithi161.stdout:3955 trunc from 0xda353b7 to 0x54fd11c 2024-09-21T15:09:12.754 INFO:teuthology.orchestra.run.smithi161.stdout:3956 write 0x1472523 thru 0x147d344 (0xae22 bytes) 2024-09-21T15:09:12.754 INFO:teuthology.orchestra.run.smithi161.stdout:3795 write 0xd09016f thru 0xd09ad6f (0xac01 bytes) 2024-09-21T15:09:12.776 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone21 from 0x60071ec (overlap 0x26b34c) to 0x1359a6 2024-09-21T15:09:12.778 INFO:teuthology.orchestra.run.smithi161.stdout:3958 trunc from 0x54fd11c to 0xa61a3d3 2024-09-21T15:09:12.782 INFO:teuthology.orchestra.run.smithi161.stdout:3796 punch from 0x85b7d06 to 0x85c05dd, (0x88d7 bytes) 2024-09-21T15:09:12.782 INFO:teuthology.orchestra.run.smithi161.stdout:3797 read 0x798546 thru 0x79eb72 (0x662d bytes) 2024-09-21T15:09:12.796 INFO:teuthology.orchestra.run.smithi161.stdout:3768 write 0xe53273e thru 0xe53e18c (0xba4f bytes) 2024-09-21T15:09:12.825 INFO:teuthology.orchestra.run.smithi161.stdout:3769 read 0x26c487e thru 0x26c9bc5 (0x5348 bytes) 2024-09-21T15:09:12.825 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.825 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:12.825 INFO:teuthology.orchestra.run.smithi161.stdout:3775 write 0x167d940 thru 0x1681820 (0x3ee1 bytes) 2024-09-21T15:09:12.833 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone27 from 0xc781676 (overlap 0xc781676) to 0xb38e103 2024-09-21T15:09:12.860 INFO:teuthology.orchestra.run.smithi161.stdout:3776 trunc from 0xe53e18d to 0x65cccf3 2024-09-21T15:09:12.866 INFO:teuthology.orchestra.run.smithi161.stdout:3798 writesame 0xe4864c4 thru 0xe495531 data_size 0x19(0xf06e bytes) 2024-09-21T15:09:12.875 INFO:teuthology.orchestra.run.smithi161.stdout:3799 writesame 0x9008323 thru 0x9009d1e data_size 0x2(0x19fc bytes) 2024-09-21T15:09:12.929 INFO:teuthology.orchestra.run.smithi161.stdout:3803 clone 25 order 22 su 32768 sc 5 2024-09-21T15:09:12.964 INFO:teuthology.orchestra.run.smithi161.stdout:3959 write 0xc2bc328 thru 0xc2c49ae (0x8687 bytes) 2024-09-21T15:09:12.976 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone33 from 0x5f7ebb3 (overlap 0xbec8b1) to 0x72786a 2024-09-21T15:09:12.985 INFO:teuthology.orchestra.run.smithi161.stdout:3777 read 0x221c5a9 thru 0x221e15b (0x1bb3 bytes) 2024-09-21T15:09:12.986 INFO:teuthology.orchestra.run.smithi161.stdout:3778 punch from 0x292d0b to 0x2959f4, (0x2ce9 bytes) 2024-09-21T15:09:13.027 INFO:teuthology.orchestra.run.smithi161.stdout:3779 writesame 0x731282c thru 0x7313bec data_size 0x1(0x13c1 bytes) 2024-09-21T15:09:13.032 INFO:teuthology.orchestra.run.smithi161.stdout:3960 trunc from 0xc2c49af to 0x1a21f39 2024-09-21T15:09:13.082 INFO:teuthology.orchestra.run.smithi161.stdout:3780 write 0xdfb2330 thru 0xdfba2c9 (0x7f9a bytes) 2024-09-21T15:09:13.095 INFO:teuthology.orchestra.run.smithi161.stdout:3781 write 0x2d38df4 thru 0x2d456f5 (0xc902 bytes) 2024-09-21T15:09:13.108 INFO:teuthology.orchestra.run.smithi161.stdout:3782 write 0x44eb756 thru 0x44ee49e (0x2d49 bytes) 2024-09-21T15:09:13.119 INFO:teuthology.orchestra.run.smithi161.stdout:3783 write 0x28f3a6c thru 0x28fbf8d (0x8522 bytes) 2024-09-21T15:09:13.134 INFO:teuthology.orchestra.run.smithi161.stdout:3784 punch from 0x54126d5 to 0x541bc01, (0x952c bytes) 2024-09-21T15:09:13.134 INFO:teuthology.orchestra.run.smithi161.stdout:3785 read 0x4e086c2 thru 0x4e17b9e (0xf4dd bytes) 2024-09-21T15:09:13.134 INFO:teuthology.orchestra.run.smithi161.stdout:3786 write 0x63f2c0c thru 0x63fd46b (0xa860 bytes) 2024-09-21T15:09:13.144 INFO:teuthology.orchestra.run.smithi161.stdout:3961 writesame 0xe682d56 thru 0xe687d76 data_size 0x1(0x5021 bytes) 2024-09-21T15:09:13.152 INFO:teuthology.orchestra.run.smithi161.stdout:3962 punch from 0x4e4768c to 0x4e54662, (0xcfd6 bytes) 2024-09-21T15:09:13.152 INFO:teuthology.orchestra.run.smithi161.stdout:3963 punch from 0xbe25b95 to 0xbe2f3f9, (0x9864 bytes) 2024-09-21T15:09:13.152 INFO:teuthology.orchestra.run.smithi161.stdout:3964 writesame 0xa7b2920 thru 0xa7b357b data_size 0xe(0xc5c bytes) 2024-09-21T15:09:13.155 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.155 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.155 INFO:teuthology.orchestra.run.smithi161.stdout:3793 write 0xbe79fd4 thru 0xbe7f942 (0x596f bytes) 2024-09-21T15:09:13.165 INFO:teuthology.orchestra.run.smithi161.stdout:3965 write 0x19b8ba2 thru 0x19c2685 (0x9ae4 bytes) 2024-09-21T15:09:13.167 INFO:teuthology.orchestra.run.smithi161.stdout:3796 writesame 0x5f983a8 thru 0x5f9c1f6 data_size 0xd(0x3e4f bytes) 2024-09-21T15:09:13.178 INFO:teuthology.orchestra.run.smithi161.stdout:3966 read 0x2a22ae8 thru 0x2a28cf5 (0x620e bytes) 2024-09-21T15:09:13.179 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #20, image image_cluster1.client.mirror.5-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent21 2024-09-21T15:09:13.181 INFO:teuthology.orchestra.run.smithi161.stdout:3797 read 0x65e1000 thru 0x65ea40b (0x940c bytes) 2024-09-21T15:09:13.224 INFO:teuthology.orchestra.run.smithi161.stdout:3798 trunc from 0xdfba2ca to 0x1f7a879 2024-09-21T15:09:13.225 INFO:teuthology.orchestra.run.smithi161.stdout:3968 trunc from 0xe687d77 to 0x69a97 2024-09-21T15:09:13.251 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #26, image image_cluster1.client.mirror.4-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent27 2024-09-21T15:09:13.294 INFO:teuthology.orchestra.run.smithi161.stdout:3970 punch from 0x31fbb to 0x3730d, (0x5352 bytes) 2024-09-21T15:09:13.299 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #32, image image_cluster1.client.mirror.3-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent33 2024-09-21T15:09:13.319 INFO:teuthology.orchestra.run.smithi161.stdout:3971 trunc from 0x69a97 to 0xcd13d25 2024-09-21T15:09:13.334 INFO:teuthology.orchestra.run.smithi161.stdout:3799 write 0xdf7da6d thru 0xdf85443 (0x79d7 bytes) 2024-09-21T15:09:13.353 INFO:teuthology.orchestra.run.smithi161.stdout:3800 write 0x1573c4 thru 0x15e594 (0x71d1 bytes) 2024-09-21T15:09:13.353 INFO:teuthology.orchestra.run.smithi161.stdout:3973 punch from 0x7cacce0 to 0x7cae01c, (0x133c bytes) 2024-09-21T15:09:13.353 INFO:teuthology.orchestra.run.smithi161.stdout:3974 write 0x4ed21d8 thru 0x4ede576 (0xc39f bytes) 2024-09-21T15:09:13.370 INFO:teuthology.orchestra.run.smithi161.stdout:2852 read 0x20b5a thru 0x27a51 (0x6ef8 bytes) 2024-09-21T15:09:13.376 INFO:teuthology.orchestra.run.smithi161.stdout:3801 read 0x80723d9 thru 0x8076a53 (0x467b bytes) 2024-09-21T15:09:13.376 INFO:teuthology.orchestra.run.smithi161.stdout:3802 read 0x84901be thru 0x849a161 (0x9fa4 bytes) 2024-09-21T15:09:13.377 INFO:teuthology.orchestra.run.smithi161.stdout:3803 read 0x4c9e875 thru 0x4ca6e1c (0x85a8 bytes) 2024-09-21T15:09:13.377 INFO:teuthology.orchestra.run.smithi161.stdout:3805 writesame 0x1c8faa4 thru 0x1c93ac3 data_size 0x6c(0x4020 bytes) 2024-09-21T15:09:13.380 INFO:teuthology.orchestra.run.smithi161.stdout:3342 write 0xe527d27 thru 0xe53006f (0x8349 bytes) 2024-09-21T15:09:13.391 INFO:teuthology.orchestra.run.smithi161.stdout:3806 write 0xe47ce4 thru 0xe51f3a (0xa257 bytes) 2024-09-21T15:09:13.392 INFO:teuthology.orchestra.run.smithi161.stdout:3975 trunc from 0xcd13d25 to 0x4140b37 2024-09-21T15:09:13.396 INFO:teuthology.orchestra.run.smithi161.stdout:2853 read 0x4bcc157 thru 0x4bd2570 (0x641a bytes) 2024-09-21T15:09:13.408 INFO:teuthology.orchestra.run.smithi161.stdout:3807 write 0x69f465c thru 0x69fe43d (0x9de2 bytes) 2024-09-21T15:09:13.423 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.425 INFO:teuthology.orchestra.run.smithi161.stdout:3343 trunc from 0xe530070 to 0x22f207a 2024-09-21T15:09:13.432 INFO:teuthology.orchestra.run.smithi161.stdout:3977 write 0x14f4446 thru 0x15009d4 (0xc58f bytes) 2024-09-21T15:09:13.437 INFO:teuthology.orchestra.run.smithi161.stdout:2854 writesame 0xb346c9a thru 0xb34e1c8 data_size 0x1(0x752f bytes) 2024-09-21T15:09:13.441 INFO:teuthology.orchestra.run.smithi161.stdout:2855 punch from 0x98f8bcd to 0x98f9951, (0xd84 bytes) 2024-09-21T15:09:13.441 INFO:teuthology.orchestra.run.smithi161.stdout:2856 write 0xa1371bd thru 0xa141715 (0xa559 bytes) 2024-09-21T15:09:13.474 INFO:teuthology.orchestra.run.smithi161.stdout:3810 writesame 0xe3e456b thru 0xe3f121c data_size 0x26(0xccb2 bytes) 2024-09-21T15:09:13.475 INFO:teuthology.orchestra.run.smithi161.stdout:2857 read 0x1309e52 thru 0x130b40e (0x15bd bytes) 2024-09-21T15:09:13.475 INFO:teuthology.orchestra.run.smithi161.stdout:2858 punch from 0x7ac86b to 0x7b4053, (0x77e8 bytes) 2024-09-21T15:09:13.475 INFO:teuthology.orchestra.run.smithi161.stdout:2859 read 0xa8166b0 thru 0xa81cc4d (0x659e bytes) 2024-09-21T15:09:13.475 INFO:teuthology.orchestra.run.smithi161.stdout:2860 read 0x48719ec thru 0x487e5d7 (0xcbec bytes) 2024-09-21T15:09:13.475 INFO:teuthology.orchestra.run.smithi161.stdout:2861 write 0x36083b thru 0x36cd05 (0xc4cb bytes) 2024-09-21T15:09:13.495 INFO:teuthology.orchestra.run.smithi161.stdout:3811 trunc from 0xe3f121d to 0x4d7c83d 2024-09-21T15:09:13.501 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.507 INFO:teuthology.orchestra.run.smithi161.stdout:2862 writesame 0x1f3aea3 thru 0x1f3fd4b data_size 0x1(0x4ea9 bytes) 2024-09-21T15:09:13.519 INFO:teuthology.orchestra.run.smithi161.stdout:3978 write 0x768e151 thru 0x76988ae (0xa75e bytes) 2024-09-21T15:09:13.545 INFO:teuthology.orchestra.run.smithi161.stdout:2863 write 0x7479da5 thru 0x747e334 (0x4590 bytes) 2024-09-21T15:09:13.562 INFO:teuthology.orchestra.run.smithi161.stdout:3813 read 0x3932e09 thru 0x393cc65 (0x9e5d bytes) 2024-09-21T15:09:13.562 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.562 INFO:teuthology.orchestra.run.smithi161.stdout:3816 read 0x1099911 thru 0x10a29fe (0x90ee bytes) 2024-09-21T15:09:13.562 INFO:teuthology.orchestra.run.smithi161.stdout:2864 clone 35 order 22 su 16384 sc 3 2024-09-21T15:09:13.563 INFO:teuthology.orchestra.run.smithi161.stdout:3345 write 0x242a8c0 thru 0x2439022 (0xe763 bytes) 2024-09-21T15:09:13.573 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.574 INFO:teuthology.orchestra.run.smithi161.stdout:3695 trunc from 0x60071ec to 0x6ee89fb 2024-09-21T15:09:13.592 INFO:teuthology.orchestra.run.smithi161.stdout:3980 write 0xb756e82 thru 0xb763563 (0xc6e2 bytes) 2024-09-21T15:09:13.601 INFO:teuthology.orchestra.run.smithi161.stdout:3818 write 0xe3d57a1 thru 0xe3dc34c (0x6bac bytes) 2024-09-21T15:09:13.617 INFO:teuthology.orchestra.run.smithi161.stdout:3981 read 0x3dd3778 thru 0x3ddc90d (0x9196 bytes) 2024-09-21T15:09:13.617 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.617 INFO:teuthology.orchestra.run.smithi161.stdout:3983 write 0xaf49353 thru 0xaf52897 (0x9545 bytes) 2024-09-21T15:09:13.627 INFO:teuthology.orchestra.run.smithi161.stdout:3698 read 0x3749640 thru 0x3749e23 (0x7e4 bytes) 2024-09-21T15:09:13.628 INFO:teuthology.orchestra.run.smithi161.stdout:3699 punch from 0x48d5768 to 0x48db959, (0x61f1 bytes) 2024-09-21T15:09:13.628 INFO:teuthology.orchestra.run.smithi161.stdout:3700 read 0x26397d3 thru 0x26471ab (0xd9d9 bytes) 2024-09-21T15:09:13.628 INFO:teuthology.orchestra.run.smithi161.stdout:3819 read 0x66a8656 thru 0x66b0ddd (0x8788 bytes) 2024-09-21T15:09:13.629 INFO:teuthology.orchestra.run.smithi161.stdout:3820 read 0x2feb8b4 thru 0x2ff8c9f (0xd3ec bytes) 2024-09-21T15:09:13.629 INFO:teuthology.orchestra.run.smithi161.stdout:3701 writesame 0x294549e thru 0x294bfcb data_size 0x6(0x6b2e bytes) 2024-09-21T15:09:13.629 INFO:teuthology.orchestra.run.smithi161.stdout:3821 read 0xf3a55f thru 0xf4511f (0xabc1 bytes) 2024-09-21T15:09:13.629 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.629 INFO:teuthology.orchestra.run.smithi161.stdout:3823 write 0x4c9c477 thru 0x4ca9bad (0xd737 bytes) 2024-09-21T15:09:13.634 INFO:teuthology.orchestra.run.smithi161.stdout:3347 write 0xd1f5192 thru 0xd1f5552 (0x3c1 bytes) 2024-09-21T15:09:13.649 INFO:teuthology.orchestra.run.smithi161.stdout:3987 read 0x4e9c4f6 thru 0x4ea931a (0xce25 bytes) 2024-09-21T15:09:13.650 INFO:teuthology.orchestra.run.smithi161.stdout:3988 read 0x5baa5f6 thru 0x5baef69 (0x4974 bytes) 2024-09-21T15:09:13.651 INFO:teuthology.orchestra.run.smithi161.stdout:3990 writesame 0x1f85a66 thru 0x1f8cbe0 data_size 0x13(0x717b bytes) 2024-09-21T15:09:13.670 INFO:teuthology.orchestra.run.smithi161.stdout:3348 writesame 0x19daef7 thru 0x19e4c84 data_size 0x56(0x9d8e bytes) 2024-09-21T15:09:13.681 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.681 INFO:teuthology.orchestra.run.smithi161.stdout:3992 read 0x9348e6 thru 0x944059 (0xf774 bytes) 2024-09-21T15:09:13.692 INFO:teuthology.orchestra.run.smithi161.stdout:3702 write 0x3269dad thru 0x326d916 (0x3b6a bytes) 2024-09-21T15:09:13.694 INFO:teuthology.orchestra.run.smithi161.stdout:3353 trunc from 0xd1f5553 to 0x7dda8fe 2024-09-21T15:09:13.695 INFO:teuthology.orchestra.run.smithi161.stdout:3995 trunc from 0xb763564 to 0x4b71bdd 2024-09-21T15:09:13.705 INFO:teuthology.orchestra.run.smithi161.stdout:3824 write 0xe812b0b thru 0xe817821 (0x4d17 bytes) 2024-09-21T15:09:13.720 INFO:teuthology.orchestra.run.smithi161.stdout:3826 read 0x1dabdf thru 0x1e46da (0x9afc bytes) 2024-09-21T15:09:13.723 INFO:teuthology.orchestra.run.smithi161.stdout:3828 punch from 0x9c463de to 0x9c49886, (0x34a8 bytes) 2024-09-21T15:09:13.723 INFO:teuthology.orchestra.run.smithi161.stdout:3829 read 0x7dd389b thru 0x7de2959 (0xf0bf bytes) 2024-09-21T15:09:13.723 INFO:teuthology.orchestra.run.smithi161.stdout:3830 read 0x866b8cf thru 0x866d1ed (0x191f bytes) 2024-09-21T15:09:13.723 INFO:teuthology.orchestra.run.smithi161.stdout:3834 write 0xc65ef09 thru 0xc66cbe0 (0xdcd8 bytes) 2024-09-21T15:09:13.724 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.725 INFO:teuthology.orchestra.run.smithi161.stdout:3704 read 0xe6f40 thru 0xf0996 (0x9a57 bytes) 2024-09-21T15:09:13.726 INFO:teuthology.orchestra.run.smithi161.stdout:3706 write 0x58f254b thru 0x58f7ef9 (0x59af bytes) 2024-09-21T15:09:13.740 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.0-clone24 2024-09-21T15:09:13.741 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.741 INFO:teuthology.orchestra.run.smithi161.stdout:3837 write 0xcb69068 thru 0xcb73f73 (0xaf0c bytes) 2024-09-21T15:09:13.745 INFO:teuthology.orchestra.run.smithi161.stdout:3355 read 0x5d40a5 thru 0x5e17bb (0xd717 bytes) 2024-09-21T15:09:13.745 INFO:teuthology.orchestra.run.smithi161.stdout:3356 read 0x95198e thru 0x9541f2 (0x2865 bytes) 2024-09-21T15:09:13.753 INFO:teuthology.orchestra.run.smithi161.stdout:3839 read 0x260fd0e thru 0x261df04 (0xe1f7 bytes) 2024-09-21T15:09:13.754 INFO:teuthology.orchestra.run.smithi161.stdout:3840 write 0xd66ea18 thru 0xd66ef9d (0x586 bytes) 2024-09-21T15:09:13.781 INFO:teuthology.orchestra.run.smithi161.stdout:3357 write 0x87e73de thru 0x87f1c6b (0xa88e bytes) 2024-09-21T15:09:13.795 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.796 INFO:teuthology.orchestra.run.smithi161.stdout:3360 read 0x46fbefb thru 0x4706388 (0xa48e bytes) 2024-09-21T15:09:13.796 INFO:teuthology.orchestra.run.smithi161.stdout:3362 write 0x3edba5f thru 0x3ede140 (0x26e2 bytes) 2024-09-21T15:09:13.799 INFO:teuthology.orchestra.run.smithi161.stdout:3707 writesame 0x786b250 thru 0x786ccad data_size 0xf(0x1a5e bytes) 2024-09-21T15:09:13.800 INFO:teuthology.orchestra.run.smithi161.stdout:3997 write 0x8c4667e thru 0x8c47a8d (0x1410 bytes) 2024-09-21T15:09:13.804 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.804 INFO:teuthology.orchestra.run.smithi161.stdout:3709 read 0x271b989 thru 0x271ee58 (0x34d0 bytes) 2024-09-21T15:09:13.805 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.805 INFO:teuthology.orchestra.run.smithi161.stdout:3714 write 0x27669e thru 0x27c37a (0x5cdd bytes) 2024-09-21T15:09:13.806 INFO:teuthology.orchestra.run.smithi161.stdout:3363 write 0x7a8caef thru 0x7a91603 (0x4b15 bytes) 2024-09-21T15:09:13.812 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.812 INFO:teuthology.orchestra.run.smithi161.stdout:4001 writesame 0x77ef6c9 thru 0x77fc7bf data_size 0xd(0xd0f7 bytes) 2024-09-21T15:09:13.842 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.842 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.842 INFO:teuthology.orchestra.run.smithi161.stdout:3366 clone 29 order 20 su 524288 sc 7 2024-09-21T15:09:13.850 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.850 INFO:teuthology.orchestra.run.smithi161.stdout:3843 read 0xb41c845 thru 0xb421510 (0x4ccc bytes) 2024-09-21T15:09:13.850 INFO:teuthology.orchestra.run.smithi161.stdout:4005 read 0x704327 thru 0x708bef (0x48c9 bytes) 2024-09-21T15:09:13.857 INFO:teuthology.orchestra.run.smithi161.stdout:4006 punch from 0x67c441d to 0x67c7605, (0x31e8 bytes) 2024-09-21T15:09:13.857 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.857 INFO:teuthology.orchestra.run.smithi161.stdout:4008 read 0x638f88c thru 0x639e056 (0xe7cb bytes) 2024-09-21T15:09:13.858 INFO:teuthology.orchestra.run.smithi161.stdout:4009 read 0x1aa831a thru 0x1aacaee (0x47d5 bytes) 2024-09-21T15:09:13.859 INFO:teuthology.orchestra.run.smithi161.stdout:4010 punch from 0x79170b0 to 0x79261e6, (0xf136 bytes) 2024-09-21T15:09:13.859 INFO:teuthology.orchestra.run.smithi161.stdout:3845 trunc from 0xe817822 to 0x989ecd6 2024-09-21T15:09:13.884 INFO:teuthology.orchestra.run.smithi161.stdout:3715 punch from 0x7155bf4 to 0x7165179, (0xf585 bytes) 2024-09-21T15:09:13.884 INFO:teuthology.orchestra.run.smithi161.stdout:3716 read 0x129f4e7 thru 0x12aceda (0xd9f4 bytes) 2024-09-21T15:09:13.885 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:13.893 INFO:teuthology.orchestra.run.smithi161.stdout:4011 write 0x981825c thru 0x98213c3 (0x9168 bytes) 2024-09-21T15:09:13.910 INFO:teuthology.orchestra.run.smithi161.stdout:4012 read 0x4766a1b thru 0x476867e (0x1c64 bytes) 2024-09-21T15:09:13.911 INFO:teuthology.orchestra.run.smithi161.stdout:4013 write 0x7d4c1bb thru 0x7d566a9 (0xa4ef bytes) 2024-09-21T15:09:13.920 INFO:teuthology.orchestra.run.smithi161.stdout:4014 read 0x259682 thru 0x25f6eb (0x606a bytes) 2024-09-21T15:09:13.931 INFO:teuthology.orchestra.run.smithi161.stdout:3719 write 0xa55ffd7 thru 0xa56a627 (0xa651 bytes) 2024-09-21T15:09:13.952 INFO:teuthology.orchestra.run.smithi161.stdout:3846 flatten 2024-09-21T15:09:13.976 INFO:teuthology.orchestra.run.smithi161.stdout:3720 write 0x3c73d74 thru 0x3c7faf1 (0xbd7e bytes) 2024-09-21T15:09:13.987 INFO:teuthology.orchestra.run.smithi161.stdout:4015 write 0xbe8ad3f thru 0xbe94fac (0xa26e bytes) 2024-09-21T15:09:14.000 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:14.000 INFO:teuthology.orchestra.run.smithi161.stdout:4018 write 0x6f1c3c7 thru 0x6f286d2 (0xc30c bytes) 2024-09-21T15:09:14.020 INFO:teuthology.orchestra.run.smithi161.stdout:3721 clone 23 order 19 su 262144 sc 14 2024-09-21T15:09:14.021 INFO:teuthology.orchestra.run.smithi161.stdout:4019 read 0xa0cdc06 thru 0xa0d6cdf (0x90da bytes) 2024-09-21T15:09:14.021 INFO:teuthology.orchestra.run.smithi161.stdout:4021 write 0x1f5cb5a thru 0x1f64599 (0x7a40 bytes) 2024-09-21T15:09:14.024 INFO:teuthology.orchestra.run.smithi161.stdout:3847 write 0x72833c7 thru 0x7287923 (0x455d bytes) 2024-09-21T15:09:14.030 INFO:teuthology.orchestra.run.smithi161.stdout:4022 punch from 0x6de543b to 0x6df4039, (0xebfe bytes) 2024-09-21T15:09:14.030 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:14.030 INFO:teuthology.orchestra.run.smithi161.stdout:4025 write 0xa6ce40b thru 0xa6d460a (0x6200 bytes) 2024-09-21T15:09:14.063 INFO:teuthology.orchestra.run.smithi161.stdout:4026 trunc from 0xbe94fad to 0x2fe99ce 2024-09-21T15:09:14.085 INFO:teuthology.orchestra.run.smithi161.stdout:3848 writesame 0xe19b5dd thru 0xe1a36d3 data_size 0x47(0x80f7 bytes) 2024-09-21T15:09:14.087 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:14.084+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5a00 2024-09-21T15:09:14.088 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:14.084+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5d40 2024-09-21T15:09:14.088 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:14.084+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810dd0 2024-09-21T15:09:14.090 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:14.088+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac04e0 2024-09-21T15:09:14.094 INFO:teuthology.orchestra.run.smithi161.stdout:3849 write 0x6f831f1 thru 0x6f86cb6 (0x3ac6 bytes) 2024-09-21T15:09:14.110 INFO:teuthology.orchestra.run.smithi161.stdout:3850 clone 20 order 25 su 2097152 sc 14 2024-09-21T15:09:14.118 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:14.170 INFO:teuthology.orchestra.run.smithi161.stdout:4030 write 0xe02c09c thru 0xe031bf5 (0x5b5a bytes) 2024-09-21T15:09:14.189 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:14.189 INFO:teuthology.orchestra.run.smithi161.stdout:4034 write 0xc85a060 thru 0xc85de41 (0x3de2 bytes) 2024-09-21T15:09:14.203 INFO:teuthology.orchestra.run.smithi161.stdout:4035 write 0xc24d01f thru 0xc2519b1 (0x4993 bytes) 2024-09-21T15:09:14.225 INFO:teuthology.orchestra.run.smithi161.stdout:4036 writesame 0x6ed32d thru 0x6fc321 data_size 0x1(0xeff5 bytes) 2024-09-21T15:09:14.273 INFO:teuthology.orchestra.run.smithi161.stdout:4038 punch from 0xb9dd571 to 0xb9e481f, (0x72ae bytes) 2024-09-21T15:09:14.273 INFO:teuthology.orchestra.run.smithi161.stdout:4040 read 0xd1cd861 thru 0xd1ce2c1 (0xa61 bytes) 2024-09-21T15:09:14.273 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:14.273 INFO:teuthology.orchestra.run.smithi161.stdout:4042 write 0x35c8812 thru 0x35ce23b (0x5a2a bytes) 2024-09-21T15:09:14.285 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:14.285 INFO:teuthology.orchestra.run.smithi161.stdout:4044 read 0xc4a35ab thru 0xc4ade91 (0xa8e7 bytes) 2024-09-21T15:09:14.286 INFO:teuthology.orchestra.run.smithi161.stdout:4045 write 0x56a4aa3 thru 0x56affee (0xb54c bytes) 2024-09-21T15:09:14.303 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #23, image image_cluster1.client.mirror.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent24 2024-09-21T15:09:14.304 INFO:teuthology.orchestra.run.smithi161.stdout:4046 trunc from 0xe031bf6 to 0xcce390c 2024-09-21T15:09:14.350 INFO:teuthology.orchestra.run.smithi161.stdout:4047 writesame 0x8a6de0a thru 0x8a6f634 data_size 0x1(0x182b bytes) 2024-09-21T15:09:14.368 INFO:teuthology.orchestra.run.smithi161.stdout:4048 write 0xc6424a2 thru 0xc642699 (0x1f8 bytes) 2024-09-21T15:09:14.381 INFO:teuthology.orchestra.run.smithi161.stdout:4050 punch from 0x66deb95 to 0x66e690c, (0x7d77 bytes) 2024-09-21T15:09:14.381 INFO:teuthology.orchestra.run.smithi161.stdout:4051 write 0x6db98a thru 0x6e0ff0 (0x5667 bytes) 2024-09-21T15:09:14.391 INFO:teuthology.orchestra.run.smithi161.stdout:4052 punch from 0x2f778c3 to 0x2f7c917, (0x5054 bytes) 2024-09-21T15:09:14.392 INFO:teuthology.orchestra.run.smithi161.stdout:4053 read 0xcb27942 thru 0xcb31627 (0x9ce6 bytes) 2024-09-21T15:09:14.410 INFO:teuthology.orchestra.run.smithi161.stdout:4054 trunc from 0xcce390c to 0x424a6a2 2024-09-21T15:09:14.464 INFO:teuthology.orchestra.run.smithi161.stdout:4056 read 0x153d248 thru 0x154c6df (0xf498 bytes) 2024-09-21T15:09:14.536 INFO:teuthology.orchestra.run.smithi161.stdout:4057 writesame 0xc24027e thru 0xc24ced0 data_size 0x1(0xcc53 bytes) 2024-09-21T15:09:14.541 INFO:teuthology.orchestra.run.smithi161.stdout:4058 punch from 0x5327d2b to 0x532d8f8, (0x5bcd bytes) 2024-09-21T15:09:14.541 INFO:teuthology.orchestra.run.smithi161.stdout:4059 read 0x3c44aaa thru 0x3c481b3 (0x370a bytes) 2024-09-21T15:09:14.541 INFO:teuthology.orchestra.run.smithi161.stdout:4060 writesame 0x2395c16 thru 0x239abb5 data_size 0x68(0x4fa0 bytes) 2024-09-21T15:09:14.576 INFO:teuthology.orchestra.run.smithi161.stdout:4061 trunc from 0xc24ced1 to 0x56d9268 2024-09-21T15:09:14.606 INFO:teuthology.orchestra.run.smithi161.stdout:4062 read 0x52559d9 thru 0x525df2f (0x8557 bytes) 2024-09-21T15:09:14.606 INFO:teuthology.orchestra.run.smithi161.stdout:4063 read 0x34cfdf6 thru 0x34d0f3a (0x1145 bytes) 2024-09-21T15:09:14.606 INFO:teuthology.orchestra.run.smithi161.stdout:4064 write 0x3cba1c2 thru 0x3cbbc1a (0x1a59 bytes) 2024-09-21T15:09:14.708 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone22 from 0xa56a628 (overlap 0x60071ec) to 0x1cceefa 2024-09-21T15:09:14.730 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone28 from 0x87f1c6c (overlap 0x22f207a) to 0x14f79e2 2024-09-21T15:09:14.777 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone34 from 0xb34e1c9 (overlap 0x5f7ebb3) to 0x2632b14 2024-09-21T15:09:14.812 INFO:teuthology.orchestra.run.smithi161.stdout:3804 trunc from 0xe495532 to 0x6d14204 2024-09-21T15:09:14.955 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #18, image image_cluster1.client.mirror.1-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent19 2024-09-21T15:09:15.060 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:15.052+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c23d6c0 2024-09-21T15:09:15.060 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:15.052+0000 7f1e9c77a700 -1 reset not still connected to 0x56287ce70000 2024-09-21T15:09:15.061 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:15.056+0000 7f1e9c77a700 -1 reset not still connected to 0x5628828a7ba0 2024-09-21T15:09:15.062 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:15.056+0000 7f1e9c77a700 -1 reset not still connected to 0x56288c584340 2024-09-21T15:09:15.070 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:15.064+0000 7f1e9c77a700 -1 reset not still connected to 0x5628908044e0 2024-09-21T15:09:15.070 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:15.064+0000 7f1e9c77a700 -1 reset not still connected to 0x562890805d40 2024-09-21T15:09:15.070 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:15.064+0000 7f1e9c77a700 -1 reset not still connected to 0x56289097b110 2024-09-21T15:09:15.071 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:15.064+0000 7f1e9c77a700 -1 reset not still connected to 0x562890d15860 2024-09-21T15:09:15.071 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:15.064+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5930 2024-09-21T15:09:15.071 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:15.064+0000 7f1e9c77a700 -1 reset not still connected to 0x562897c70ea0 2024-09-21T15:09:15.071 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:15.064+0000 7f1e9c77a700 -1 reset not still connected to 0x562897c71040 2024-09-21T15:09:15.073 INFO:teuthology.orchestra.run.smithi161.stdout:3805 writesame 0x9770f35 thru 0x977f61c data_size 0x24(0xe6e8 bytes) 2024-09-21T15:09:15.088 INFO:teuthology.orchestra.run.smithi161.stdout:3807 punch from 0x4425d90 to 0x4433095, (0xd305 bytes) 2024-09-21T15:09:15.088 INFO:teuthology.orchestra.run.smithi161.stdout:3808 punch from 0x2b6e71d to 0x2b78b58, (0xa43b bytes) 2024-09-21T15:09:15.088 INFO:teuthology.orchestra.run.smithi161.stdout:3809 writesame 0x941da8 thru 0x94f169 data_size 0x8b(0xd3c2 bytes) 2024-09-21T15:09:15.155 INFO:teuthology.orchestra.run.smithi161.stdout:3810 read 0x3764024 thru 0x376d81b (0x97f8 bytes) 2024-09-21T15:09:15.164 INFO:teuthology.orchestra.run.smithi161.stdout:3812 trunc from 0x977f61d to 0x54263b4 2024-09-21T15:09:15.180 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #21, image image_cluster1.client.mirror.5-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent22 2024-09-21T15:09:15.199 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #27, image image_cluster1.client.mirror.4-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent28 2024-09-21T15:09:15.248 INFO:teuthology.orchestra.run.smithi161.stdout:3722 punch from 0xac8b3e to 0xad387e, (0xad40 bytes) 2024-09-21T15:09:15.276 INFO:teuthology.orchestra.run.smithi161.stdout:3724 read 0x31f9bc9 thru 0x320004d (0x6485 bytes) 2024-09-21T15:09:15.276 INFO:teuthology.orchestra.run.smithi161.stdout:3725 write 0x55c802d thru 0x55d2c28 (0xabfc bytes) 2024-09-21T15:09:15.279 INFO:teuthology.orchestra.run.smithi161.stdout:3813 writesame 0x8b8087a thru 0x8b8c4f2 data_size 0x9(0xbc79 bytes) 2024-09-21T15:09:15.286 INFO:teuthology.orchestra.run.smithi161.stdout:3814 read 0x48016a thru 0x482b98 (0x2a2f bytes) 2024-09-21T15:09:15.301 INFO:teuthology.orchestra.run.smithi161.stdout:3726 read 0x874563 thru 0x87ee7a (0xa918 bytes) 2024-09-21T15:09:15.302 INFO:teuthology.orchestra.run.smithi161.stdout:3727 writesame 0x7200d6 thru 0x72fa81 data_size 0x4c(0xf9ac bytes) 2024-09-21T15:09:15.319 INFO:teuthology.orchestra.run.smithi161.stdout:3728 writesame 0x5058524 thru 0x5064e92 data_size 0x1(0xc96f bytes) 2024-09-21T15:09:15.328 INFO:teuthology.orchestra.run.smithi161.stdout:3815 write 0xba38196 thru 0xba41c5d (0x9ac8 bytes) 2024-09-21T15:09:15.342 INFO:teuthology.orchestra.run.smithi161.stdout:3817 punch from 0x4e7c331 to 0x4e86d2e, (0xa9fd bytes) 2024-09-21T15:09:15.342 INFO:teuthology.orchestra.run.smithi161.stdout:3818 writesame 0x96b362c thru 0x96b6285 data_size 0x7(0x2c5a bytes) 2024-09-21T15:09:15.368 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.368 INFO:teuthology.orchestra.run.smithi161.stdout:3731 read 0x76b3ae2 thru 0x76bea27 (0xaf46 bytes) 2024-09-21T15:09:15.372 INFO:teuthology.orchestra.run.smithi161.stdout:3732 trunc from 0xa56a628 to 0xca285e9 2024-09-21T15:09:15.373 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.373 INFO:teuthology.orchestra.run.smithi161.stdout:3820 write 0x2b5fa89 thru 0x2b63199 (0x3711 bytes) 2024-09-21T15:09:15.403 INFO:teuthology.orchestra.run.smithi161.stdout:3821 trunc from 0xba41c5e to 0x976424d 2024-09-21T15:09:15.420 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.431 INFO:teuthology.orchestra.run.smithi161.stdout:3734 trunc from 0xca285e9 to 0x56d576c 2024-09-21T15:09:15.435 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #33, image image_cluster1.client.mirror.3-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent34 2024-09-21T15:09:15.466 INFO:teuthology.orchestra.run.smithi161.stdout:3822 write 0x1630ff8 thru 0x163ca8c (0xba95 bytes) 2024-09-21T15:09:15.504 INFO:teuthology.orchestra.run.smithi161.stdout:3735 trunc from 0x56d576c to 0x5d7f728 2024-09-21T15:09:15.535 INFO:teuthology.orchestra.run.smithi161.stdout:2866 writesame 0x26cd94c thru 0x26d4929 data_size 0x12(0x6fde bytes) 2024-09-21T15:09:15.558 INFO:teuthology.orchestra.run.smithi161.stdout:3823 write 0x9904dd7 thru 0x9914ae4 (0xfd0e bytes) 2024-09-21T15:09:15.584 INFO:teuthology.orchestra.run.smithi161.stdout:3824 punch from 0x600ee2f to 0x601e277, (0xf448 bytes) 2024-09-21T15:09:15.588 INFO:teuthology.orchestra.run.smithi161.stdout:4066 read 0x3017487 thru 0x302445a (0xcfd4 bytes) 2024-09-21T15:09:15.599 INFO:teuthology.orchestra.run.smithi161.stdout:3736 write 0x82a2743 thru 0x82b0f57 (0xe815 bytes) 2024-09-21T15:09:15.614 INFO:teuthology.orchestra.run.smithi161.stdout:3851 read 0x84e005 thru 0x85120d (0x3209 bytes) 2024-09-21T15:09:15.638 INFO:teuthology.orchestra.run.smithi161.stdout:3825 writesame 0xd21c96e thru 0xd227972 data_size 0x1(0xb005 bytes) 2024-09-21T15:09:15.641 INFO:teuthology.orchestra.run.smithi161.stdout:3737 read 0x136c071 thru 0x136e40e (0x239e bytes) 2024-09-21T15:09:15.642 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.642 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.642 INFO:teuthology.orchestra.run.smithi161.stdout:2870 write 0x1880e42 thru 0x188edbf (0xdf7e bytes) 2024-09-21T15:09:15.646 INFO:teuthology.orchestra.run.smithi161.stdout:3827 read 0x2e7485a thru 0x2e7f326 (0xaacd bytes) 2024-09-21T15:09:15.649 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.649 INFO:teuthology.orchestra.run.smithi161.stdout:3830 write 0xab03de8 thru 0xab05534 (0x174d bytes) 2024-09-21T15:09:15.670 INFO:teuthology.orchestra.run.smithi161.stdout:4069 write 0xc42cb14 thru 0xc4398de (0xcdcb bytes) 2024-09-21T15:09:15.688 INFO:teuthology.orchestra.run.smithi161.stdout:3367 read 0x7d8876b thru 0x7d8d73a (0x4fd0 bytes) 2024-09-21T15:09:15.691 INFO:teuthology.orchestra.run.smithi161.stdout:3831 read 0x6106388 thru 0x610fb3e (0x97b7 bytes) 2024-09-21T15:09:15.694 INFO:teuthology.orchestra.run.smithi161.stdout:3853 punch from 0xdbfc043 to 0xdbfeb51, (0x2b0e bytes) 2024-09-21T15:09:15.694 INFO:teuthology.orchestra.run.smithi161.stdout:3854 write 0x80e4c36 thru 0x80f2adc (0xdea7 bytes) 2024-09-21T15:09:15.705 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.711 INFO:teuthology.orchestra.run.smithi161.stdout:4070 write 0x6492638 thru 0x6498a51 (0x641a bytes) 2024-09-21T15:09:15.718 INFO:teuthology.orchestra.run.smithi161.stdout:3833 trunc from 0xd227973 to 0x69f3a91 2024-09-21T15:09:15.726 INFO:teuthology.orchestra.run.smithi161.stdout:3738 write 0xd5b7fc5 thru 0xd5c0f26 (0x8f62 bytes) 2024-09-21T15:09:15.729 INFO:teuthology.orchestra.run.smithi161.stdout:2871 read 0x9f109d3 thru 0x9f1b273 (0xa8a1 bytes) 2024-09-21T15:09:15.729 INFO:teuthology.orchestra.run.smithi161.stdout:2872 write 0x1571451 thru 0x15762a2 (0x4e52 bytes) 2024-09-21T15:09:15.735 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.735 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.735 INFO:teuthology.orchestra.run.smithi161.stdout:3858 read 0x19c604d thru 0x19d3a03 (0xd9b7 bytes) 2024-09-21T15:09:15.736 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.736 INFO:teuthology.orchestra.run.smithi161.stdout:3860 punch from 0xdd8c9f2 to 0xdd8f192, (0x27a0 bytes) 2024-09-21T15:09:15.736 INFO:teuthology.orchestra.run.smithi161.stdout:3861 read 0xadf6b50 thru 0xadf93ec (0x289d bytes) 2024-09-21T15:09:15.736 INFO:teuthology.orchestra.run.smithi161.stdout:3862 punch from 0x55948e6 to 0x559b712, (0x6e2c bytes) 2024-09-21T15:09:15.736 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.736 INFO:teuthology.orchestra.run.smithi161.stdout:3864 write 0xbc5c5e1 thru 0xbc69d9f (0xd7bf bytes) 2024-09-21T15:09:15.743 INFO:teuthology.orchestra.run.smithi161.stdout:4071 write 0x6b9f7e6 thru 0x6ba44d0 (0x4ceb bytes) 2024-09-21T15:09:15.752 INFO:teuthology.orchestra.run.smithi161.stdout:3740 punch from 0x35eb36c to 0x35ee858, (0x34ec bytes) 2024-09-21T15:09:15.757 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.758 INFO:teuthology.orchestra.run.smithi161.stdout:3867 read 0xb6d57dd thru 0xb6dbbf2 (0x6416 bytes) 2024-09-21T15:09:15.758 INFO:teuthology.orchestra.run.smithi161.stdout:3868 write 0x6f9b1de thru 0x6fa6af5 (0xb918 bytes) 2024-09-21T15:09:15.759 INFO:teuthology.orchestra.run.smithi161.stdout:4072 read 0xa2e54b thru 0xa39fd4 (0xba8a bytes) 2024-09-21T15:09:15.760 INFO:teuthology.orchestra.run.smithi161.stdout:4073 punch from 0x9aa7b3b to 0x9aa998a, (0x1e4f bytes) 2024-09-21T15:09:15.760 INFO:teuthology.orchestra.run.smithi161.stdout:4074 write 0x22aa3df thru 0x22ad9e8 (0x360a bytes) 2024-09-21T15:09:15.771 INFO:teuthology.orchestra.run.smithi161.stdout:3741 trunc from 0xd5c0f27 to 0x2c7993d 2024-09-21T15:09:15.775 INFO:teuthology.orchestra.run.smithi161.stdout:2873 read 0x5f55de5 thru 0x5f62dcf (0xcfeb bytes) 2024-09-21T15:09:15.775 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.776 INFO:teuthology.orchestra.run.smithi161.stdout:2874 writesame 0x6842d29 thru 0x68440bd data_size 0x3(0x1395 bytes) 2024-09-21T15:09:15.788 INFO:teuthology.orchestra.run.smithi161.stdout:3834 punch from 0x3f1a479 to 0x3f212e7, (0x6e6e bytes) 2024-09-21T15:09:15.788 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:15.790 INFO:teuthology.orchestra.run.smithi161.stdout:3369 write 0xe3d315c thru 0xe3e15c9 (0xe46e bytes) 2024-09-21T15:09:15.796 INFO:teuthology.orchestra.run.smithi161.stdout:3836 flatten 2024-09-21T15:09:15.804 INFO:teuthology.orchestra.run.smithi161.stdout:2875 write 0x4666d2 thru 0x4707e4 (0xa113 bytes) 2024-09-21T15:09:15.853 INFO:teuthology.orchestra.run.smithi161.stdout:3371 punch from 0xac6a908 to 0xac74247, (0x993f bytes) 2024-09-21T15:09:15.853 INFO:teuthology.orchestra.run.smithi161.stdout:3373 writesame 0x51d0109 thru 0x51dc3ca data_size 0x61(0xc2c2 bytes) 2024-09-21T15:09:15.900 INFO:teuthology.orchestra.run.smithi161.stdout:4076 write 0xd54eba1 thru 0xd55515c (0x65bc bytes) 2024-09-21T15:09:15.929 INFO:teuthology.orchestra.run.smithi161.stdout:3869 write 0xe3207e8 thru 0xe326a3e (0x6257 bytes) 2024-09-21T15:09:15.932 INFO:teuthology.orchestra.run.smithi161.stdout:3374 punch from 0xce7b0a to 0xced564, (0x5a5a bytes) 2024-09-21T15:09:15.933 INFO:teuthology.orchestra.run.smithi161.stdout:3375 write 0x777a276 thru 0x7787293 (0xd01e bytes) 2024-09-21T15:09:15.950 INFO:teuthology.orchestra.run.smithi161.stdout:4077 read 0x5ee2aed thru 0x5ee7a70 (0x4f84 bytes) 2024-09-21T15:09:15.950 INFO:teuthology.orchestra.run.smithi161.stdout:4078 read 0x49514c4 thru 0x4960293 (0xedd0 bytes) 2024-09-21T15:09:15.950 INFO:teuthology.orchestra.run.smithi161.stdout:4079 write 0x97be90a thru 0x97bfde1 (0x14d8 bytes) 2024-09-21T15:09:15.966 INFO:teuthology.orchestra.run.smithi161.stdout:2876 trunc from 0xb34e1c9 to 0x3ae8b84 2024-09-21T15:09:15.972 INFO:teuthology.orchestra.run.smithi161.stdout:4080 write 0x62bc0cd thru 0x62bf1f2 (0x3126 bytes) 2024-09-21T15:09:15.972 INFO:teuthology.orchestra.run.smithi161.stdout:3376 write 0x22a9d69 thru 0x22ab64c (0x18e4 bytes) 2024-09-21T15:09:15.972 INFO:teuthology.orchestra.run.smithi161.stdout:3872 read 0xbf9bbf8 thru 0xbf9dc3e (0x2047 bytes) 2024-09-21T15:09:15.976 INFO:teuthology.orchestra.run.smithi161.stdout:3874 writesame 0x2e056e5 thru 0x2e0a660 data_size 0x2(0x4f7c bytes) 2024-09-21T15:09:15.980 INFO:teuthology.orchestra.run.smithi161.stdout:4081 punch from 0x30bf8e3 to 0x30cbe8d, (0xc5aa bytes) 2024-09-21T15:09:15.980 INFO:teuthology.orchestra.run.smithi161.stdout:4082 write 0xd33e98d thru 0xd34d41d (0xea91 bytes) 2024-09-21T15:09:16.004 INFO:teuthology.orchestra.run.smithi161.stdout:3875 write 0x1b6a4da thru 0x1b749a9 (0xa4d0 bytes) 2024-09-21T15:09:16.007 INFO:teuthology.orchestra.run.smithi161.stdout:4083 writesame 0x2d33f0 thru 0x2e1b5e data_size 0x1d(0xe76f bytes) 2024-09-21T15:09:16.011 INFO:teuthology.orchestra.run.smithi161.stdout:3377 trunc from 0xe3e15ca to 0x774539a 2024-09-21T15:09:16.017 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.017 INFO:teuthology.orchestra.run.smithi161.stdout:3878 write 0xa5dedd2 thru 0xa5e4845 (0x5a74 bytes) 2024-09-21T15:09:16.033 INFO:teuthology.orchestra.run.smithi161.stdout:4084 write 0x12f963e thru 0x12fba4e (0x2411 bytes) 2024-09-21T15:09:16.034 INFO:teuthology.orchestra.run.smithi161.stdout:3743 write 0xa018278 thru 0xa01970a (0x1493 bytes) 2024-09-21T15:09:16.037 INFO:teuthology.orchestra.run.smithi161.stdout:3838 write 0xa5637ae thru 0xa56f44b (0xbc9e bytes) 2024-09-21T15:09:16.044 INFO:teuthology.orchestra.run.smithi161.stdout:3879 punch from 0x9cb10b0 to 0x9cbb11b, (0xa06b bytes) 2024-09-21T15:09:16.045 INFO:teuthology.orchestra.run.smithi161.stdout:3880 writesame 0x695015b thru 0x6950b29 data_size 0x1(0x9cf bytes) 2024-09-21T15:09:16.055 INFO:teuthology.orchestra.run.smithi161.stdout:3744 punch from 0x6e99b31 to 0x6ea87d9, (0xeca8 bytes) 2024-09-21T15:09:16.055 INFO:teuthology.orchestra.run.smithi161.stdout:3746 write 0x5f95520 thru 0x5f9ea5b (0x953c bytes) 2024-09-21T15:09:16.060 INFO:teuthology.orchestra.run.smithi161.stdout:3881 writesame 0xabcbbba thru 0xabcfefe data_size 0x1(0x4345 bytes) 2024-09-21T15:09:16.064 INFO:teuthology.orchestra.run.smithi161.stdout:3839 punch from 0x2e87a44 to 0x2e914b3, (0x9a6f bytes) 2024-09-21T15:09:16.065 INFO:teuthology.orchestra.run.smithi161.stdout:4087 write 0xc71c9a7 thru 0xc72b5d0 (0xec2a bytes) 2024-09-21T15:09:16.065 INFO:teuthology.orchestra.run.smithi161.stdout:3840 read 0x5f5cc09 thru 0x5f60734 (0x3b2c bytes) 2024-09-21T15:09:16.081 INFO:teuthology.orchestra.run.smithi161.stdout:3884 read 0xa9f8c9b thru 0xaa00943 (0x7ca9 bytes) 2024-09-21T15:09:16.082 INFO:teuthology.orchestra.run.smithi161.stdout:3749 punch from 0x9fb2ced to 0x9fb7a45, (0x4d58 bytes) 2024-09-21T15:09:16.082 INFO:teuthology.orchestra.run.smithi161.stdout:3751 clone 24 order 24 su 2097152 sc 5 2024-09-21T15:09:16.082 INFO:teuthology.orchestra.run.smithi161.stdout:3885 read 0xf82bcd thru 0xf91f92 (0xf3c6 bytes) 2024-09-21T15:09:16.096 INFO:teuthology.orchestra.run.smithi161.stdout:4088 writesame 0xc17cc4b thru 0xc184857 data_size 0x1(0x7c0d bytes) 2024-09-21T15:09:16.102 INFO:teuthology.orchestra.run.smithi161.stdout:3887 trunc from 0xe326a3f to 0x249b1ac 2024-09-21T15:09:16.119 INFO:teuthology.orchestra.run.smithi161.stdout:2877 read 0x249f2da thru 0x24aee89 (0xfbb0 bytes) 2024-09-21T15:09:16.123 INFO:teuthology.orchestra.run.smithi161.stdout:4091 write 0xc071c7c thru 0xc080b83 (0xef08 bytes) 2024-09-21T15:09:16.123 INFO:teuthology.orchestra.run.smithi161.stdout:3842 writesame 0xd3dafa4 thru 0xd3e712b data_size 0x2c(0xc188 bytes) 2024-09-21T15:09:16.124 INFO:teuthology.orchestra.run.smithi161.stdout:2878 punch from 0x430331 to 0x4313d6, (0x10a5 bytes) 2024-09-21T15:09:16.127 INFO:teuthology.orchestra.run.smithi161.stdout:3379 clone 30 order 25 su 4194304 sc 8 2024-09-21T15:09:16.129 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.129 INFO:teuthology.orchestra.run.smithi161.stdout:2880 punch from 0x251ac0f to 0x25221ac, (0x759d bytes) 2024-09-21T15:09:16.132 INFO:teuthology.orchestra.run.smithi161.stdout:3843 read 0x12a4ebe thru 0x12b1aaa (0xcbed bytes) 2024-09-21T15:09:16.133 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.133 INFO:teuthology.orchestra.run.smithi161.stdout:3848 read 0x66d2faa thru 0x66d62bc (0x3313 bytes) 2024-09-21T15:09:16.133 INFO:teuthology.orchestra.run.smithi161.stdout:3849 read 0x5ab53d0 thru 0x5ab5cef (0x920 bytes) 2024-09-21T15:09:16.133 INFO:teuthology.orchestra.run.smithi161.stdout:3850 read 0xaa86241 thru 0xaa926ab (0xc46b bytes) 2024-09-21T15:09:16.134 INFO:teuthology.orchestra.run.smithi161.stdout:3852 writesame 0x880b09d thru 0x881817b data_size 0x1(0xd0df bytes) 2024-09-21T15:09:16.151 INFO:teuthology.orchestra.run.smithi161.stdout:4092 read 0xc22f9ac thru 0xc232bd6 (0x322b bytes) 2024-09-21T15:09:16.152 INFO:teuthology.orchestra.run.smithi161.stdout:4093 write 0x274fc8 thru 0x27f545 (0xa57e bytes) 2024-09-21T15:09:16.177 INFO:teuthology.orchestra.run.smithi161.stdout:4096 writesame 0x1500e58 thru 0x150fecb data_size 0x16(0xf074 bytes) 2024-09-21T15:09:16.182 INFO:teuthology.orchestra.run.smithi161.stdout:3853 punch from 0xa6f2dc9 to 0xa6fe62a, (0xb861 bytes) 2024-09-21T15:09:16.183 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.189 INFO:teuthology.orchestra.run.smithi161.stdout:4097 punch from 0x8130eea to 0x8140012, (0xf128 bytes) 2024-09-21T15:09:16.196 INFO:teuthology.orchestra.run.smithi161.stdout:3855 trunc from 0xd3e712c to 0x55d2f17 2024-09-21T15:09:16.199 INFO:teuthology.orchestra.run.smithi161.stdout:2881 write 0xc7337f4 thru 0xc741d4f (0xe55c bytes) 2024-09-21T15:09:16.206 INFO:teuthology.orchestra.run.smithi161.stdout:3890 trunc from 0x249b1ac to 0x990c5ef 2024-09-21T15:09:16.221 INFO:teuthology.orchestra.run.smithi161.stdout:4099 writesame 0xd632081 thru 0xd6322d6 data_size 0x1(0x256 bytes) 2024-09-21T15:09:16.229 INFO:teuthology.orchestra.run.smithi161.stdout:2884 writesame 0x103b150 thru 0x1049441 data_size 0x6(0xe2f2 bytes) 2024-09-21T15:09:16.238 INFO:teuthology.orchestra.run.smithi161.stdout:4100 read 0xc437789 thru 0xc43a410 (0x2c88 bytes) 2024-09-21T15:09:16.246 INFO:teuthology.orchestra.run.smithi161.stdout:4101 read 0x815af89 thru 0x815feab (0x4f23 bytes) 2024-09-21T15:09:16.246 INFO:teuthology.orchestra.run.smithi161.stdout:4102 punch from 0x17b187c to 0x17b80d7, (0x685b bytes) 2024-09-21T15:09:16.250 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.250 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.256 INFO:teuthology.orchestra.run.smithi161.stdout:2885 read 0x79621c thru 0x79d695 (0x747a bytes) 2024-09-21T15:09:16.264 INFO:teuthology.orchestra.run.smithi161.stdout:4103 trunc from 0xd6322d7 to 0x3318d02 2024-09-21T15:09:16.273 INFO:teuthology.orchestra.run.smithi161.stdout:3857 read 0x33ab991 thru 0x33ad320 (0x1990 bytes) 2024-09-21T15:09:16.286 INFO:teuthology.orchestra.run.smithi161.stdout:3893 writesame 0xc28faea thru 0xc2959b2 data_size 0x17(0x5ec9 bytes) 2024-09-21T15:09:16.303 INFO:teuthology.orchestra.run.smithi161.stdout:3894 read 0xa97d81a thru 0xa97df8a (0x771 bytes) 2024-09-21T15:09:16.303 INFO:teuthology.orchestra.run.smithi161.stdout:2886 writesame 0xcae1481 thru 0xcaf05f8 data_size 0x4(0xf178 bytes) 2024-09-21T15:09:16.317 INFO:teuthology.orchestra.run.smithi161.stdout:2887 write 0x950e6e5 thru 0x9510db0 (0x26cc bytes) 2024-09-21T15:09:16.322 INFO:teuthology.orchestra.run.smithi161.stdout:3860 writesame 0x9f1f789 thru 0x9f28a6f data_size 0x1(0x92e7 bytes) 2024-09-21T15:09:16.331 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.335 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.335 INFO:teuthology.orchestra.run.smithi161.stdout:2889 write 0x90b85b5 thru 0x90c284a (0xa296 bytes) 2024-09-21T15:09:16.340 INFO:teuthology.orchestra.run.smithi161.stdout:4104 read 0x686f86 thru 0x687cec (0xd67 bytes) 2024-09-21T15:09:16.349 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.350 INFO:teuthology.orchestra.run.smithi161.stdout:2893 trunc from 0xcaf05f9 to 0xd5d461a 2024-09-21T15:09:16.351 INFO:teuthology.orchestra.run.smithi161.stdout:3897 writesame 0xdd990c2 thru 0xdd9c02c data_size 0x1(0x2f6b bytes) 2024-09-21T15:09:16.358 INFO:teuthology.orchestra.run.smithi161.stdout:3899 read 0xa9e16ea thru 0xa9efad8 (0xe3ef bytes) 2024-09-21T15:09:16.363 INFO:teuthology.orchestra.run.smithi161.stdout:3862 write 0xadca717 thru 0xadd9b68 (0xf452 bytes) 2024-09-21T15:09:16.378 INFO:teuthology.orchestra.run.smithi161.stdout:3902 trunc from 0xdd9c02d to 0x208d771 2024-09-21T15:09:16.383 INFO:teuthology.orchestra.run.smithi161.stdout:4106 write 0xcb48fa0 thru 0xcb4dfa1 (0x5002 bytes) 2024-09-21T15:09:16.384 INFO:teuthology.orchestra.run.smithi161.stdout:2895 read 0x3333774 thru 0x3342cb1 (0xf53e bytes) 2024-09-21T15:09:16.385 INFO:teuthology.orchestra.run.smithi161.stdout:2897 write 0xa12f50e thru 0xa135521 (0x6014 bytes) 2024-09-21T15:09:16.391 INFO:teuthology.orchestra.run.smithi161.stdout:3864 read 0x8c8358e thru 0x8c872ca (0x3d3d bytes) 2024-09-21T15:09:16.391 INFO:teuthology.orchestra.run.smithi161.stdout:3865 write 0x8249602 thru 0x8251b86 (0x8585 bytes) 2024-09-21T15:09:16.415 INFO:teuthology.orchestra.run.smithi161.stdout:2898 read 0x114437a thru 0x114e46f (0xa0f6 bytes) 2024-09-21T15:09:16.415 INFO:teuthology.orchestra.run.smithi161.stdout:2899 write 0x3e22250 thru 0x3e2c9b0 (0xa761 bytes) 2024-09-21T15:09:16.418 INFO:teuthology.orchestra.run.smithi161.stdout:3866 read 0x95213e2 thru 0x9529b57 (0x8776 bytes) 2024-09-21T15:09:16.418 INFO:teuthology.orchestra.run.smithi161.stdout:3867 write 0x634bfef thru 0x6351a7c (0x5a8e bytes) 2024-09-21T15:09:16.440 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.440 INFO:teuthology.orchestra.run.smithi161.stdout:2903 read 0x2302569 thru 0x230b94b (0x93e3 bytes) 2024-09-21T15:09:16.442 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.442 INFO:teuthology.orchestra.run.smithi161.stdout:2905 read 0x87f5edc thru 0x87faf9a (0x50bf bytes) 2024-09-21T15:09:16.442 INFO:teuthology.orchestra.run.smithi161.stdout:2906 read 0xba1808a thru 0xba2317b (0xb0f2 bytes) 2024-09-21T15:09:16.443 INFO:teuthology.orchestra.run.smithi161.stdout:2907 read 0xbb57800 thru 0xbb6671d (0xef1e bytes) 2024-09-21T15:09:16.443 INFO:teuthology.orchestra.run.smithi161.stdout:2908 read 0x4c47edc thru 0x4c54e0d (0xcf32 bytes) 2024-09-21T15:09:16.443 INFO:teuthology.orchestra.run.smithi161.stdout:2909 read 0x8ec152e thru 0x8ec2486 (0xf59 bytes) 2024-09-21T15:09:16.443 INFO:teuthology.orchestra.run.smithi161.stdout:2911 write 0xa2c39d6 thru 0xa2c95d6 (0x5c01 bytes) 2024-09-21T15:09:16.445 INFO:teuthology.orchestra.run.smithi161.stdout:4107 writesame 0xdf2e080 thru 0xdf3bb5d data_size 0x41(0xdade bytes) 2024-09-21T15:09:16.454 INFO:teuthology.orchestra.run.smithi161.stdout:4108 read 0xdb80338 thru 0xdb87c5b (0x7924 bytes) 2024-09-21T15:09:16.454 INFO:teuthology.orchestra.run.smithi161.stdout:4109 punch from 0x114aa09 to 0x114db88, (0x317f bytes) 2024-09-21T15:09:16.457 INFO:teuthology.orchestra.run.smithi161.stdout:2912 read 0x540efd6 thru 0x541104b (0x2076 bytes) 2024-09-21T15:09:16.458 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.458 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.458 INFO:teuthology.orchestra.run.smithi161.stdout:2916 write 0xbcdbb9 thru 0xbd7377 (0x97bf bytes) 2024-09-21T15:09:16.461 INFO:teuthology.orchestra.run.smithi161.stdout:4110 trunc from 0xdf3bb5e to 0xa00fc40 2024-09-21T15:09:16.505 INFO:teuthology.orchestra.run.smithi161.stdout:2918 trunc from 0xd5d461a to 0x8db6771 2024-09-21T15:09:16.512 INFO:teuthology.orchestra.run.smithi161.stdout:3903 write 0x28f4216 thru 0x28fdd5d (0x9b48 bytes) 2024-09-21T15:09:16.516 INFO:teuthology.orchestra.run.smithi161.stdout:3868 writesame 0xbdb235e thru 0xbdbaef4 data_size 0x7(0x8b97 bytes) 2024-09-21T15:09:16.525 INFO:teuthology.orchestra.run.smithi161.stdout:3869 read 0x222279b thru 0x22227e5 (0x4b bytes) 2024-09-21T15:09:16.525 INFO:teuthology.orchestra.run.smithi161.stdout:3873 write 0x806a282 thru 0x8075532 (0xb2b1 bytes) 2024-09-21T15:09:16.545 INFO:teuthology.orchestra.run.smithi161.stdout:3875 write 0x3d61e44 thru 0x3d646e4 (0x28a1 bytes) 2024-09-21T15:09:16.568 INFO:teuthology.orchestra.run.smithi161.stdout:3876 read 0x37e07d9 thru 0x37e4175 (0x399d bytes) 2024-09-21T15:09:16.568 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.568 INFO:teuthology.orchestra.run.smithi161.stdout:3879 read 0x37a5f55 thru 0x37b0394 (0xa440 bytes) 2024-09-21T15:09:16.569 INFO:teuthology.orchestra.run.smithi161.stdout:3880 punch from 0x7becf0f to 0x7bf4326, (0x7417 bytes) 2024-09-21T15:09:16.569 INFO:teuthology.orchestra.run.smithi161.stdout:3881 write 0x9182867 thru 0x918827b (0x5a15 bytes) 2024-09-21T15:09:16.594 INFO:teuthology.orchestra.run.smithi161.stdout:3882 read 0x42bf327 thru 0x42ce9e6 (0xf6c0 bytes) 2024-09-21T15:09:16.595 INFO:teuthology.orchestra.run.smithi161.stdout:3883 read 0x2b23e87 thru 0x2b2fd06 (0xbe80 bytes) 2024-09-21T15:09:16.595 INFO:teuthology.orchestra.run.smithi161.stdout:3884 write 0x38cb36 thru 0x39bf85 (0xf450 bytes) 2024-09-21T15:09:16.599 INFO:teuthology.orchestra.run.smithi161.stdout:4111 writesame 0xaae0842 thru 0xaaeb620 data_size 0x25(0xaddf bytes) 2024-09-21T15:09:16.601 INFO:teuthology.orchestra.run.smithi161.stdout:3905 writesame 0x7e4c8e5 thru 0x7e53d25 data_size 0x1(0x7441 bytes) 2024-09-21T15:09:16.610 INFO:teuthology.orchestra.run.smithi161.stdout:4113 trunc from 0xaaeb621 to 0x963e18c 2024-09-21T15:09:16.612 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.612 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.612 INFO:teuthology.orchestra.run.smithi161.stdout:3887 read 0x4b58563 thru 0x4b617c1 (0x925f bytes) 2024-09-21T15:09:16.613 INFO:teuthology.orchestra.run.smithi161.stdout:3906 write 0x1d6ebe3 thru 0x1d74586 (0x59a4 bytes) 2024-09-21T15:09:16.613 INFO:teuthology.orchestra.run.smithi161.stdout:3889 read 0x8cb923e thru 0x8cbdfb2 (0x4d75 bytes) 2024-09-21T15:09:16.613 INFO:teuthology.orchestra.run.smithi161.stdout:3890 read 0x8b2c8ee thru 0x8b2edd5 (0x24e8 bytes) 2024-09-21T15:09:16.621 INFO:teuthology.orchestra.run.smithi161.stdout:2919 writesame 0xac84160 thru 0xac92657 data_size 0x22(0xe4f8 bytes) 2024-09-21T15:09:16.621 INFO:teuthology.orchestra.run.smithi161.stdout:3907 punch from 0x15a09d8 to 0x15b0442, (0xfa6a bytes) 2024-09-21T15:09:16.647 INFO:teuthology.orchestra.run.smithi161.stdout:3891 write 0xd32d533 thru 0xd33d29a (0xfd68 bytes) 2024-09-21T15:09:16.647 INFO:teuthology.orchestra.run.smithi161.stdout:4114 punch from 0x52fa388 to 0x530a111, (0xfd89 bytes) 2024-09-21T15:09:16.648 INFO:teuthology.orchestra.run.smithi161.stdout:4116 read 0x6eaf39e thru 0x6ebb53e (0xc1a1 bytes) 2024-09-21T15:09:16.648 INFO:teuthology.orchestra.run.smithi161.stdout:4118 read 0xe85605 thru 0xe881bb (0x2bb7 bytes) 2024-09-21T15:09:16.652 INFO:teuthology.orchestra.run.smithi161.stdout:4119 trunc from 0x963e18c to 0xa816722 2024-09-21T15:09:16.659 INFO:teuthology.orchestra.run.smithi161.stdout:3908 write 0x9c46922 thru 0x9c56220 (0xf8ff bytes) 2024-09-21T15:09:16.663 INFO:teuthology.orchestra.run.smithi161.stdout:2920 write 0xecea692 thru 0xececfe6 (0x2955 bytes) 2024-09-21T15:09:16.672 INFO:teuthology.orchestra.run.smithi161.stdout:3892 write 0x3465db9 thru 0x346d13f (0x7387 bytes) 2024-09-21T15:09:16.689 INFO:teuthology.orchestra.run.smithi161.stdout:3896 read 0x6934d7 thru 0x69d26f (0x9d99 bytes) 2024-09-21T15:09:16.695 INFO:teuthology.orchestra.run.smithi161.stdout:2921 write 0x463d042 thru 0x4645cad (0x8c6c bytes) 2024-09-21T15:09:16.700 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.704 INFO:teuthology.orchestra.run.smithi161.stdout:4121 trunc from 0xa816722 to 0x838c695 2024-09-21T15:09:16.708 INFO:teuthology.orchestra.run.smithi161.stdout:2922 write 0x13d07cd thru 0x13df7d2 (0xf006 bytes) 2024-09-21T15:09:16.728 INFO:teuthology.orchestra.run.smithi161.stdout:2925 punch from 0x45b3ee0 to 0x45b82f9, (0x4419 bytes) 2024-09-21T15:09:16.728 INFO:teuthology.orchestra.run.smithi161.stdout:2926 write 0x17ee4fb thru 0x17f908b (0xab91 bytes) 2024-09-21T15:09:16.730 INFO:teuthology.orchestra.run.smithi161.stdout:3910 write 0xe5b26cb thru 0xe5b98de (0x7214 bytes) 2024-09-21T15:09:16.733 INFO:teuthology.orchestra.run.smithi161.stdout:3897 write 0xd654a9b thru 0xd660bf4 (0xc15a bytes) 2024-09-21T15:09:16.738 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.740 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone23 from 0xa01970b (overlap 0x2c7993d) to 0x4728ec 2024-09-21T15:09:16.751 INFO:teuthology.orchestra.run.smithi161.stdout:3911 write 0xbe0fb thru 0xc0a60 (0x2966 bytes) 2024-09-21T15:09:16.752 INFO:teuthology.orchestra.run.smithi161.stdout:2927 writesame 0xb0a876c thru 0xb0b7b7a data_size 0x1(0xf40f bytes) 2024-09-21T15:09:16.763 INFO:teuthology.orchestra.run.smithi161.stdout:3898 writesame 0x32612db thru 0x327107f data_size 0x1(0xfda5 bytes) 2024-09-21T15:09:16.774 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.4-clone29 2024-09-21T15:09:16.779 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.779 INFO:teuthology.orchestra.run.smithi161.stdout:3913 read 0x77c2017 thru 0x77c2305 (0x2ef bytes) 2024-09-21T15:09:16.780 INFO:teuthology.orchestra.run.smithi161.stdout:3914 read 0x3a2b361 thru 0x3a34e2a (0x9aca bytes) 2024-09-21T15:09:16.781 INFO:teuthology.orchestra.run.smithi161.stdout:3915 read 0x2e177e2 thru 0x2e1b00e (0x382d bytes) 2024-09-21T15:09:16.786 INFO:teuthology.orchestra.run.smithi161.stdout:3916 trunc from 0xe5b98df to 0xbfb74f1 2024-09-21T15:09:16.834 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.834 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.834 INFO:teuthology.orchestra.run.smithi161.stdout:2930 read 0x752f32a thru 0x753df57 (0xec2e bytes) 2024-09-21T15:09:16.834 INFO:teuthology.orchestra.run.smithi161.stdout:2933 read 0x4e4ab2 thru 0x4ee394 (0x98e3 bytes) 2024-09-21T15:09:16.835 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:16.835 INFO:teuthology.orchestra.run.smithi161.stdout:2935 writesame 0x3ef4bd3 thru 0x3f01de3 data_size 0x1(0xd211 bytes) 2024-09-21T15:09:16.836 INFO:teuthology.orchestra.run.smithi161.stdout:3899 read 0x588f59c thru 0x58938f6 (0x435b bytes) 2024-09-21T15:09:16.877 INFO:teuthology.orchestra.run.smithi161.stdout:4125 write 0xc0ea152 thru 0xc0f6475 (0xc324 bytes) 2024-09-21T15:09:16.891 INFO:teuthology.orchestra.run.smithi161.stdout:2936 read 0xb572274 thru 0xb572457 (0x1e4 bytes) 2024-09-21T15:09:16.891 INFO:teuthology.orchestra.run.smithi161.stdout:2937 read 0x1bffab0 thru 0x1c0bb3a (0xc08b bytes) 2024-09-21T15:09:16.893 INFO:teuthology.orchestra.run.smithi161.stdout:2938 read 0x16258ab thru 0x16310ea (0xb840 bytes) 2024-09-21T15:09:16.894 INFO:teuthology.orchestra.run.smithi161.stdout:3900 punch from 0x5c0a2e4 to 0x5c0adca, (0xae6 bytes) 2024-09-21T15:09:16.894 INFO:teuthology.orchestra.run.smithi161.stdout:3902 writesame 0x1aad871 thru 0x1aaf969 data_size 0x1(0x20f9 bytes) 2024-09-21T15:09:16.919 INFO:teuthology.orchestra.run.smithi161.stdout:3903 read 0x28fa974 thru 0x28fdbba (0x3247 bytes) 2024-09-21T15:09:16.931 INFO:teuthology.orchestra.run.smithi161.stdout:3917 writesame 0xc9ad1d2 thru 0xc9ae9f0 data_size 0x19(0x181f bytes) 2024-09-21T15:09:16.938 INFO:teuthology.orchestra.run.smithi161.stdout:3918 write 0x46989cf thru 0x46998cc (0xefe bytes) 2024-09-21T15:09:16.947 INFO:teuthology.orchestra.run.smithi161.stdout:3919 write 0xbd0a709 thru 0xbd1159b (0x6e93 bytes) 2024-09-21T15:09:16.961 INFO:teuthology.orchestra.run.smithi161.stdout:2940 read 0x1041e88 thru 0x10466ba (0x4833 bytes) 2024-09-21T15:09:16.987 INFO:teuthology.orchestra.run.smithi161.stdout:3904 trunc from 0xd660bf5 to 0x845e96d 2024-09-21T15:09:16.992 INFO:teuthology.orchestra.run.smithi161.stdout:4126 trunc from 0xc0f6476 to 0xea5a9a 2024-09-21T15:09:17.019 INFO:teuthology.orchestra.run.smithi161.stdout:2943 trunc from 0xececfe7 to 0x729864 2024-09-21T15:09:17.025 INFO:teuthology.orchestra.run.smithi161.stdout:3920 write 0xe05a1c9 thru 0xe05d377 (0x31af bytes) 2024-09-21T15:09:17.053 INFO:teuthology.orchestra.run.smithi161.stdout:3921 read 0xcb1e2c4 thru 0xcb2c807 (0xe544 bytes) 2024-09-21T15:09:17.107 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.107 INFO:teuthology.orchestra.run.smithi161.stdout:4131 punch from 0xe6c03b to 0xe6f40b, (0x33d0 bytes) 2024-09-21T15:09:17.119 INFO:teuthology.orchestra.run.smithi161.stdout:3922 writesame 0xe9cd1f9 thru 0xe9d1b1e data_size 0x3(0x4926 bytes) 2024-09-21T15:09:17.123 INFO:teuthology.orchestra.run.smithi161.stdout:3906 read 0x661618 thru 0x670232 (0xec1b bytes) 2024-09-21T15:09:17.124 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.124 INFO:teuthology.orchestra.run.smithi161.stdout:2945 read 0x1098c0 thru 0x112f47 (0x9688 bytes) 2024-09-21T15:09:17.137 INFO:teuthology.orchestra.run.smithi161.stdout:3923 read 0xc21fe0a thru 0xc228064 (0x825b bytes) 2024-09-21T15:09:17.137 INFO:teuthology.orchestra.run.smithi161.stdout:4134 trunc from 0xea5a9a to 0xe9f884b 2024-09-21T15:09:17.138 INFO:teuthology.orchestra.run.smithi161.stdout:3924 write 0xe782e4b thru 0xe78a49b (0x7651 bytes) 2024-09-21T15:09:17.141 INFO:teuthology.orchestra.run.smithi161.stdout:3907 trunc from 0x845e96d to 0x492d93a 2024-09-21T15:09:17.149 INFO:teuthology.orchestra.run.smithi161.stdout:2948 trunc from 0x729864 to 0xa0434d5 2024-09-21T15:09:17.166 INFO:teuthology.orchestra.run.smithi161.stdout:3926 trunc from 0xe9d1b1f to 0x75d25c7 2024-09-21T15:09:17.177 INFO:teuthology.orchestra.run.smithi161.stdout:4135 write 0x1649382 thru 0x164ccdf (0x395e bytes) 2024-09-21T15:09:17.181 INFO:teuthology.orchestra.run.smithi161.stdout:2949 writesame 0x6747610 thru 0x6754343 data_size 0x2e(0xcd34 bytes) 2024-09-21T15:09:17.197 INFO:teuthology.orchestra.run.smithi161.stdout:4136 write 0xd8ba1b thru 0xd90f71 (0x5557 bytes) 2024-09-21T15:09:17.216 INFO:teuthology.orchestra.run.smithi161.stdout:4137 read 0x855db2e thru 0x856ca05 (0xeed8 bytes) 2024-09-21T15:09:17.216 INFO:teuthology.orchestra.run.smithi161.stdout:4138 writesame 0xe23a449 thru 0xe23c7aa data_size 0x7(0x2362 bytes) 2024-09-21T15:09:17.217 INFO:teuthology.orchestra.run.smithi161.stdout:3908 read 0x2cc67a0 thru 0x2ccfbe3 (0x9444 bytes) 2024-09-21T15:09:17.218 INFO:teuthology.orchestra.run.smithi161.stdout:3909 punch from 0x3e701fe to 0x3e7a554, (0xa356 bytes) 2024-09-21T15:09:17.218 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.218 INFO:teuthology.orchestra.run.smithi161.stdout:3911 read 0xb18122 thru 0xb1ba9d (0x397c bytes) 2024-09-21T15:09:17.224 INFO:teuthology.orchestra.run.smithi161.stdout:2950 trunc from 0xa0434d5 to 0x2aa4f0c 2024-09-21T15:09:17.239 INFO:teuthology.orchestra.run.smithi161.stdout:4141 punch from 0x825e145 to 0x826a515, (0xc3d0 bytes) 2024-09-21T15:09:17.243 INFO:teuthology.orchestra.run.smithi161.stdout:3928 read 0x5d95810 thru 0x5d9cce2 (0x74d3 bytes) 2024-09-21T15:09:17.243 INFO:teuthology.orchestra.run.smithi161.stdout:3929 punch from 0x6177fea to 0x6181b47, (0x9b5d bytes) 2024-09-21T15:09:17.244 INFO:teuthology.orchestra.run.smithi161.stdout:3930 read 0x798fa thru 0x7fe13 (0x651a bytes) 2024-09-21T15:09:17.254 INFO:teuthology.orchestra.run.smithi161.stdout:4143 trunc from 0xe9f884b to 0x6580695 2024-09-21T15:09:17.284 INFO:teuthology.orchestra.run.smithi161.stdout:3915 write 0xc5921f0 thru 0xc59230c (0x11d bytes) 2024-09-21T15:09:17.287 INFO:teuthology.orchestra.run.smithi161.stdout:3932 writesame 0xa3fe32a thru 0xa40190e data_size 0x3(0x35e5 bytes) 2024-09-21T15:09:17.293 INFO:teuthology.orchestra.run.smithi161.stdout:2951 writesame 0x2964ec5 thru 0x2973560 data_size 0x4(0xe69c bytes) 2024-09-21T15:09:17.295 INFO:teuthology.orchestra.run.smithi161.stdout:3934 read 0x20716b9 thru 0x207981b (0x8163 bytes) 2024-09-21T15:09:17.296 INFO:teuthology.orchestra.run.smithi161.stdout:3935 writesame 0x26d8eaf thru 0x26e618d data_size 0x1(0xd2df bytes) 2024-09-21T15:09:17.297 INFO:teuthology.orchestra.run.smithi161.stdout:3917 write 0xcb49da thru 0xcbb45f (0x6a86 bytes) 2024-09-21T15:09:17.311 INFO:teuthology.orchestra.run.smithi161.stdout:4145 read 0x5bf4200 thru 0x5bf7f90 (0x3d91 bytes) 2024-09-21T15:09:17.311 INFO:teuthology.orchestra.run.smithi161.stdout:4147 writesame 0x143cb71 thru 0x144ab25 data_size 0x1(0xdfb5 bytes) 2024-09-21T15:09:17.317 INFO:teuthology.orchestra.run.smithi161.stdout:3918 read 0x8bc33ad thru 0x8bd0660 (0xd2b4 bytes) 2024-09-21T15:09:17.317 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.317 INFO:teuthology.orchestra.run.smithi161.stdout:3921 writesame 0x7c8ea39 thru 0x7c9913f data_size 0x3(0xa707 bytes) 2024-09-21T15:09:17.331 INFO:teuthology.orchestra.run.smithi161.stdout:2952 read 0x27d4104 thru 0x27d7900 (0x37fd bytes) 2024-09-21T15:09:17.332 INFO:teuthology.orchestra.run.smithi161.stdout:2953 read 0x16869fb thru 0x168b183 (0x4789 bytes) 2024-09-21T15:09:17.332 INFO:teuthology.orchestra.run.smithi161.stdout:2954 read 0x26ceada thru 0x26d0e49 (0x2370 bytes) 2024-09-21T15:09:17.334 INFO:teuthology.orchestra.run.smithi161.stdout:2955 write 0x270e375 thru 0x2714916 (0x65a2 bytes) 2024-09-21T15:09:17.349 INFO:teuthology.orchestra.run.smithi161.stdout:3922 write 0x7465295 thru 0x746ba99 (0x6805 bytes) 2024-09-21T15:09:17.358 INFO:teuthology.orchestra.run.smithi161.stdout:4148 write 0x37267fb thru 0x3732bfa (0xc400 bytes) 2024-09-21T15:09:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #28, image image_cluster1.client.mirror.4-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent29 2024-09-21T15:09:17.367 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.367 INFO:teuthology.orchestra.run.smithi161.stdout:3924 punch from 0x25559db to 0x25584de, (0x2b03 bytes) 2024-09-21T15:09:17.368 INFO:teuthology.orchestra.run.smithi161.stdout:3925 punch from 0x19d2667 to 0x19d5a99, (0x3432 bytes) 2024-09-21T15:09:17.368 INFO:teuthology.orchestra.run.smithi161.stdout:3926 read 0x7faca75 thru 0x7fbc777 (0xfd03 bytes) 2024-09-21T15:09:17.371 INFO:teuthology.orchestra.run.smithi161.stdout:3927 trunc from 0xc59230d to 0xca83813 2024-09-21T15:09:17.382 INFO:teuthology.orchestra.run.smithi161.stdout:4149 read 0x14c8d49 thru 0x14d0727 (0x79df bytes) 2024-09-21T15:09:17.392 INFO:teuthology.orchestra.run.smithi161.stdout:3936 write 0xc60e55d thru 0xc612e95 (0x4939 bytes) 2024-09-21T15:09:17.395 INFO:teuthology.orchestra.run.smithi161.stdout:4150 trunc from 0x6580695 to 0xc833b4d 2024-09-21T15:09:17.397 INFO:teuthology.orchestra.run.smithi161.stdout:2960 writesame 0x6904231 thru 0x6910df9 data_size 0x1(0xcbc9 bytes) 2024-09-21T15:09:17.401 INFO:teuthology.orchestra.run.smithi161.stdout:2961 read 0x9cde1d thru 0x9dc9e4 (0xebc8 bytes) 2024-09-21T15:09:17.402 INFO:teuthology.orchestra.run.smithi161.stdout:2962 write 0x688af77 thru 0x6890fe3 (0x606d bytes) 2024-09-21T15:09:17.405 INFO:teuthology.orchestra.run.smithi161.stdout:3938 read 0xbd20dd2 thru 0xbd24b48 (0x3d77 bytes) 2024-09-21T15:09:17.405 INFO:teuthology.orchestra.run.smithi161.stdout:3939 read 0x201357e thru 0x201ba91 (0x8514 bytes) 2024-09-21T15:09:17.406 INFO:teuthology.orchestra.run.smithi161.stdout:3940 writesame 0x33f21e5 thru 0x33f375f data_size 0x1(0x157b bytes) 2024-09-21T15:09:17.417 INFO:teuthology.orchestra.run.smithi161.stdout:3928 trunc from 0xca83813 to 0xb37e1aa 2024-09-21T15:09:17.421 INFO:teuthology.orchestra.run.smithi161.stdout:3941 write 0x45b59b6 thru 0x45ba533 (0x4b7e bytes) 2024-09-21T15:09:17.425 INFO:teuthology.orchestra.run.smithi161.stdout:2963 read 0x23bc09c thru 0x23bd051 (0xfb6 bytes) 2024-09-21T15:09:17.426 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.426 INFO:teuthology.orchestra.run.smithi161.stdout:2965 punch from 0x2a5f5a to 0x2aac4f, (0x4cf5 bytes) 2024-09-21T15:09:17.439 INFO:teuthology.orchestra.run.smithi161.stdout:4151 punch from 0xf52ff6 to 0xf5b7e1, (0x87eb bytes) 2024-09-21T15:09:17.439 INFO:teuthology.orchestra.run.smithi161.stdout:4154 read 0xa88b484 thru 0xa8917e6 (0x6363 bytes) 2024-09-21T15:09:17.439 INFO:teuthology.orchestra.run.smithi161.stdout:4155 read 0x7dc332c thru 0x7dcb2ea (0x7fbf bytes) 2024-09-21T15:09:17.439 INFO:teuthology.orchestra.run.smithi161.stdout:4159 write 0x44a9766 thru 0x44af465 (0x5d00 bytes) 2024-09-21T15:09:17.457 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #22, image image_cluster1.client.mirror.5-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent23 2024-09-21T15:09:17.461 INFO:teuthology.orchestra.run.smithi161.stdout:4160 read 0x1cfcb66 thru 0x1d0bab9 (0xef54 bytes) 2024-09-21T15:09:17.462 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.470 INFO:teuthology.orchestra.run.smithi161.stdout:3380 writesame 0x267b45a thru 0x267f9fd data_size 0x2(0x45a4 bytes) 2024-09-21T15:09:17.473 INFO:teuthology.orchestra.run.smithi161.stdout:3930 trunc from 0xb37e1aa to 0xc7e4a03 2024-09-21T15:09:17.477 INFO:teuthology.orchestra.run.smithi161.stdout:2966 write 0xbf7d546 thru 0xbf7e1c0 (0xc7b bytes) 2024-09-21T15:09:17.479 INFO:teuthology.orchestra.run.smithi161.stdout:4162 trunc from 0xc833b4d to 0x5724e16 2024-09-21T15:09:17.481 INFO:teuthology.orchestra.run.smithi161.stdout:3943 write 0xe33ce92 thru 0xe33ffba (0x3129 bytes) 2024-09-21T15:09:17.493 INFO:teuthology.orchestra.run.smithi161.stdout:3945 read 0x383979a thru 0x38489c9 (0xf230 bytes) 2024-09-21T15:09:17.494 INFO:teuthology.orchestra.run.smithi161.stdout:3946 read 0xa6d6790 thru 0xa6e3aa2 (0xd313 bytes) 2024-09-21T15:09:17.494 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.494 INFO:teuthology.orchestra.run.smithi161.stdout:3948 read 0x8794239 thru 0x8799b39 (0x5901 bytes) 2024-09-21T15:09:17.495 INFO:teuthology.orchestra.run.smithi161.stdout:3949 write 0x970edce thru 0x9719653 (0xa886 bytes) 2024-09-21T15:09:17.511 INFO:teuthology.orchestra.run.smithi161.stdout:3950 writesame 0x11cf029 thru 0x11dda4a data_size 0x2(0xea22 bytes) 2024-09-21T15:09:17.522 INFO:teuthology.orchestra.run.smithi161.stdout:3932 trunc from 0xc7e4a03 to 0x3b5b69b 2024-09-21T15:09:17.546 INFO:teuthology.orchestra.run.smithi161.stdout:2969 writesame 0xe982315 thru 0xe98e93d data_size 0x1(0xc629 bytes) 2024-09-21T15:09:17.551 INFO:teuthology.orchestra.run.smithi161.stdout:3382 punch from 0x726edca to 0x727a03c, (0xb272 bytes) 2024-09-21T15:09:17.551 INFO:teuthology.orchestra.run.smithi161.stdout:3384 writesame 0x5fd024b thru 0x5fde8b9 data_size 0x1(0xe66f bytes) 2024-09-21T15:09:17.559 INFO:teuthology.orchestra.run.smithi161.stdout:3951 write 0xdb94d1c thru 0xdb94e9a (0x17f bytes) 2024-09-21T15:09:17.560 INFO:teuthology.orchestra.run.smithi161.stdout:2970 read 0x79a99e1 thru 0x79b7249 (0xd869 bytes) 2024-09-21T15:09:17.560 INFO:teuthology.orchestra.run.smithi161.stdout:2971 writesame 0x68b9f5f thru 0x68c978b data_size 0x1(0xf82d bytes) 2024-09-21T15:09:17.572 INFO:teuthology.orchestra.run.smithi161.stdout:4163 writesame 0x75cd087 thru 0x75d6af1 data_size 0x1(0x9a6b bytes) 2024-09-21T15:09:17.576 INFO:teuthology.orchestra.run.smithi161.stdout:4166 punch from 0x16e31b1 to 0x16ec95a, (0x97a9 bytes) 2024-09-21T15:09:17.576 INFO:teuthology.orchestra.run.smithi161.stdout:4167 clone 26 order 19 su 262144 sc 14 2024-09-21T15:09:17.577 INFO:teuthology.orchestra.run.smithi161.stdout:3952 punch from 0xc7cd7d2 to 0xc7dbec4, (0xe6f2 bytes) 2024-09-21T15:09:17.577 INFO:teuthology.orchestra.run.smithi161.stdout:3953 writesame 0x7a0ce93 thru 0x7a0fd8d data_size 0x13(0x2efb bytes) 2024-09-21T15:09:17.605 INFO:teuthology.orchestra.run.smithi161.stdout:3954 read 0x4c296df thru 0x4c2d6b2 (0x3fd4 bytes) 2024-09-21T15:09:17.606 INFO:teuthology.orchestra.run.smithi161.stdout:2972 read 0x6e04f4a thru 0x6e06e41 (0x1ef8 bytes) 2024-09-21T15:09:17.606 INFO:teuthology.orchestra.run.smithi161.stdout:2973 read 0x7a0eea5 thru 0x7a1dd66 (0xeec2 bytes) 2024-09-21T15:09:17.606 INFO:teuthology.orchestra.run.smithi161.stdout:3955 write 0xd018b44 thru 0xd01b5ec (0x2aa9 bytes) 2024-09-21T15:09:17.607 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.607 INFO:teuthology.orchestra.run.smithi161.stdout:2976 read 0xce43a7e thru 0xce4c193 (0x8716 bytes) 2024-09-21T15:09:17.607 INFO:teuthology.orchestra.run.smithi161.stdout:2977 write 0xa3f35eb thru 0xa401353 (0xdd69 bytes) 2024-09-21T15:09:17.619 INFO:teuthology.orchestra.run.smithi161.stdout:3957 punch from 0xc5796c0 to 0xc57cfdd, (0x391d bytes) 2024-09-21T15:09:17.619 INFO:teuthology.orchestra.run.smithi161.stdout:3958 read 0x9dab9b8 thru 0x9db91f6 (0xd83f bytes) 2024-09-21T15:09:17.620 INFO:teuthology.orchestra.run.smithi161.stdout:3387 trunc from 0x774539a to 0x625668c 2024-09-21T15:09:17.638 INFO:teuthology.orchestra.run.smithi161.stdout:2978 write 0x69ec03e thru 0x69ef40c (0x33cf bytes) 2024-09-21T15:09:17.639 INFO:teuthology.orchestra.run.smithi161.stdout:3752 read 0x2d44c3a thru 0x2d4a1e4 (0x55ab bytes) 2024-09-21T15:09:17.644 INFO:teuthology.orchestra.run.smithi161.stdout:3959 trunc from 0xe33ffbb to 0x4469f02 2024-09-21T15:09:17.645 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.650 INFO:teuthology.orchestra.run.smithi161.stdout:2980 read 0xa3c01e5 thru 0xa3c83b2 (0x81ce bytes) 2024-09-21T15:09:17.651 INFO:teuthology.orchestra.run.smithi161.stdout:2981 punch from 0x91f1c90 to 0x91fb9bf, (0x9d2f bytes) 2024-09-21T15:09:17.651 INFO:teuthology.orchestra.run.smithi161.stdout:2982 punch from 0x3517a20 to 0x352611b, (0xe6fb bytes) 2024-09-21T15:09:17.659 INFO:teuthology.orchestra.run.smithi161.stdout:2983 trunc from 0xe98e93e to 0xa409d1d 2024-09-21T15:09:17.674 INFO:teuthology.orchestra.run.smithi161.stdout:3754 read 0xb31fc0 thru 0xb3a3df (0x8420 bytes) 2024-09-21T15:09:17.701 INFO:teuthology.orchestra.run.smithi161.stdout:3389 punch from 0x2486cbe to 0x248da86, (0x6dc8 bytes) 2024-09-21T15:09:17.701 INFO:teuthology.orchestra.run.smithi161.stdout:3390 read 0x4755318 thru 0x4760ebe (0xbba7 bytes) 2024-09-21T15:09:17.701 INFO:teuthology.orchestra.run.smithi161.stdout:3391 write 0x3fa8a6a thru 0x3fb7fc0 (0xf557 bytes) 2024-09-21T15:09:17.711 INFO:teuthology.orchestra.run.smithi161.stdout:3935 write 0xb34d239 thru 0xb351df7 (0x4bbf bytes) 2024-09-21T15:09:17.720 INFO:teuthology.orchestra.run.smithi161.stdout:3392 trunc from 0x625668c to 0x49fcfa7 2024-09-21T15:09:17.721 INFO:teuthology.orchestra.run.smithi161.stdout:3756 write 0xb80882e thru 0xb80b4be (0x2c91 bytes) 2024-09-21T15:09:17.726 INFO:teuthology.orchestra.run.smithi161.stdout:3960 trunc from 0x4469f02 to 0x84bec02 2024-09-21T15:09:17.726 INFO:teuthology.orchestra.run.smithi161.stdout:2984 write 0x3e09127 thru 0x3e11842 (0x871c bytes) 2024-09-21T15:09:17.738 INFO:teuthology.orchestra.run.smithi161.stdout:3936 trunc from 0xb351df8 to 0x67b401b 2024-09-21T15:09:17.748 INFO:teuthology.orchestra.run.smithi161.stdout:2985 read 0x55c15cb thru 0x55c65ae (0x4fe4 bytes) 2024-09-21T15:09:17.748 INFO:teuthology.orchestra.run.smithi161.stdout:2986 write 0x8d7077f thru 0x8d7b580 (0xae02 bytes) 2024-09-21T15:09:17.756 INFO:teuthology.orchestra.run.smithi161.stdout:3961 read 0x83c5bd9 thru 0x83d24cd (0xc8f5 bytes) 2024-09-21T15:09:17.757 INFO:teuthology.orchestra.run.smithi161.stdout:3963 read 0xbda74b thru 0xbe7cce (0xd584 bytes) 2024-09-21T15:09:17.758 INFO:teuthology.orchestra.run.smithi161.stdout:3964 punch from 0x5eec2fb to 0x5ef27f4, (0x64f9 bytes) 2024-09-21T15:09:17.759 INFO:teuthology.orchestra.run.smithi161.stdout:3965 read 0x22819f8 thru 0x2290aab (0xf0b4 bytes) 2024-09-21T15:09:17.764 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.772 INFO:teuthology.orchestra.run.smithi161.stdout:3968 trunc from 0x84bec02 to 0xd11b59b 2024-09-21T15:09:17.776 INFO:teuthology.orchestra.run.smithi161.stdout:2987 punch from 0x447793 to 0x44d746, (0x5fb3 bytes) 2024-09-21T15:09:17.776 INFO:teuthology.orchestra.run.smithi161.stdout:2988 read 0x849794 thru 0x857f0c (0xe779 bytes) 2024-09-21T15:09:17.777 INFO:teuthology.orchestra.run.smithi161.stdout:2989 writesame 0x7540f4a thru 0x754e90f data_size 0x7d(0xd9c6 bytes) 2024-09-21T15:09:17.779 INFO:teuthology.orchestra.run.smithi161.stdout:3393 read 0x2d51011 thru 0x2d53fdb (0x2fcb bytes) 2024-09-21T15:09:17.780 INFO:teuthology.orchestra.run.smithi161.stdout:3395 read 0x264271c thru 0x2649d33 (0x7618 bytes) 2024-09-21T15:09:17.780 INFO:teuthology.orchestra.run.smithi161.stdout:3396 read 0x11ef1e4 thru 0x11fa295 (0xb0b2 bytes) 2024-09-21T15:09:17.783 INFO:teuthology.orchestra.run.smithi161.stdout:3397 trunc from 0x49fcfa7 to 0x3ce3762 2024-09-21T15:09:17.793 INFO:teuthology.orchestra.run.smithi161.stdout:3758 write 0xebfdf9f thru 0xec09f52 (0xbfb4 bytes) 2024-09-21T15:09:17.800 INFO:teuthology.orchestra.run.smithi161.stdout:3937 read 0x5c4f371 thru 0x5c59501 (0xa191 bytes) 2024-09-21T15:09:17.800 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.800 INFO:teuthology.orchestra.run.smithi161.stdout:3939 clone 26 order 23 su 524288 sc 8 2024-09-21T15:09:17.804 INFO:teuthology.orchestra.run.smithi161.stdout:2990 writesame 0x64a87d0 thru 0x64b24a3 data_size 0x2(0x9cd4 bytes) 2024-09-21T15:09:17.804 INFO:teuthology.orchestra.run.smithi161.stdout:3969 writesame 0x358f386 thru 0x3599eda data_size 0x1(0xab55 bytes) 2024-09-21T15:09:17.808 INFO:teuthology.orchestra.run.smithi161.stdout:3760 read 0x5dee69c thru 0x5df465b (0x5fc0 bytes) 2024-09-21T15:09:17.809 INFO:teuthology.orchestra.run.smithi161.stdout:3761 read 0x73d4846 thru 0x73e0876 (0xc031 bytes) 2024-09-21T15:09:17.809 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.814 INFO:teuthology.orchestra.run.smithi161.stdout:3763 trunc from 0xec09f53 to 0xbf0031e 2024-09-21T15:09:17.840 INFO:teuthology.orchestra.run.smithi161.stdout:2991 trunc from 0xa409d1d to 0x976b3df 2024-09-21T15:09:17.850 INFO:teuthology.orchestra.run.smithi161.stdout:3970 read 0x7cd9bc0 thru 0x7cdbb11 (0x1f52 bytes) 2024-09-21T15:09:17.851 INFO:teuthology.orchestra.run.smithi161.stdout:3971 punch from 0x735aaa5 to 0x73610cd, (0x6628 bytes) 2024-09-21T15:09:17.851 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.851 INFO:teuthology.orchestra.run.smithi161.stdout:3973 punch from 0x86e86f5 to 0x86e9dcf, (0x16da bytes) 2024-09-21T15:09:17.851 INFO:teuthology.orchestra.run.smithi161.stdout:3976 read 0x9af6e08 thru 0x9afb142 (0x433b bytes) 2024-09-21T15:09:17.853 INFO:teuthology.orchestra.run.smithi161.stdout:3979 trunc from 0xd11b59b to 0xc3f2c60 2024-09-21T15:09:17.857 INFO:teuthology.orchestra.run.smithi161.stdout:3399 write 0x85091b thru 0x858d39 (0x841f bytes) 2024-09-21T15:09:17.869 INFO:teuthology.orchestra.run.smithi161.stdout:3402 read 0x75e4ce thru 0x761480 (0x2fb3 bytes) 2024-09-21T15:09:17.870 INFO:teuthology.orchestra.run.smithi161.stdout:3403 punch from 0x34356cf to 0x3441d53, (0xc684 bytes) 2024-09-21T15:09:17.870 INFO:teuthology.orchestra.run.smithi161.stdout:3404 write 0x1def767 thru 0x1df51a2 (0x5a3c bytes) 2024-09-21T15:09:17.885 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.885 INFO:teuthology.orchestra.run.smithi161.stdout:3406 punch from 0x12a5ae4 to 0x12b02ce, (0xa7ea bytes) 2024-09-21T15:09:17.891 INFO:teuthology.orchestra.run.smithi161.stdout:3407 trunc from 0x3ce3762 to 0x71f2b02 2024-09-21T15:09:17.895 INFO:teuthology.orchestra.run.smithi161.stdout:2992 writesame 0x516abb3 thru 0x51759b1 data_size 0x1(0xadff bytes) 2024-09-21T15:09:17.902 INFO:teuthology.orchestra.run.smithi161.stdout:3980 read 0x759d95b thru 0x75a1bee (0x4294 bytes) 2024-09-21T15:09:17.903 INFO:teuthology.orchestra.run.smithi161.stdout:3981 read 0xc138c thru 0xc7d9d (0x6a12 bytes) 2024-09-21T15:09:17.904 INFO:teuthology.orchestra.run.smithi161.stdout:3983 read 0x60df4ab thru 0x60ead8b (0xb8e1 bytes) 2024-09-21T15:09:17.907 INFO:teuthology.orchestra.run.smithi161.stdout:3764 write 0xedaf9e6 thru 0xedb5d99 (0x63b4 bytes) 2024-09-21T15:09:17.924 INFO:teuthology.orchestra.run.smithi161.stdout:3984 trunc from 0xc3f2c60 to 0x234d324 2024-09-21T15:09:17.925 INFO:teuthology.orchestra.run.smithi161.stdout:2993 writesame 0x216eece thru 0x2171b94 data_size 0x1(0x2cc7 bytes) 2024-09-21T15:09:17.926 INFO:teuthology.orchestra.run.smithi161.stdout:3765 write 0x166fb00 thru 0x1671199 (0x169a bytes) 2024-09-21T15:09:17.928 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:17.927+0000 7f1e9c77a700 -1 reset not still connected to 0x56289d07a410 2024-09-21T15:09:17.935 INFO:teuthology.orchestra.run.smithi161.stdout:3408 punch from 0x29915bd to 0x299ea3c, (0xd47f bytes) 2024-09-21T15:09:17.961 INFO:teuthology.orchestra.run.smithi161.stdout:2994 punch from 0x80f0fee to 0x81006e5, (0xf6f7 bytes) 2024-09-21T15:09:17.961 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:17.968 INFO:teuthology.orchestra.run.smithi161.stdout:2996 trunc from 0x976b3df to 0x555140d 2024-09-21T15:09:17.976 INFO:teuthology.orchestra.run.smithi161.stdout:3985 read 0x9c25c7 thru 0x9c8253 (0x5c8d bytes) 2024-09-21T15:09:17.978 INFO:teuthology.orchestra.run.smithi161.stdout:3409 write 0x8bd1ffd thru 0x8bd7334 (0x5338 bytes) 2024-09-21T15:09:17.999 INFO:teuthology.orchestra.run.smithi161.stdout:3766 write 0xd030854 thru 0xd03c482 (0xbc2f bytes) 2024-09-21T15:09:18.018 INFO:teuthology.orchestra.run.smithi161.stdout:3767 write 0x4bbb60d thru 0x4bc7813 (0xc207 bytes) 2024-09-21T15:09:18.030 INFO:teuthology.orchestra.run.smithi161.stdout:3989 write 0xa40acaa thru 0xa410b01 (0x5e58 bytes) 2024-09-21T15:09:18.041 INFO:teuthology.orchestra.run.smithi161.stdout:2997 writesame 0x3e61af4 thru 0x3e67e32 data_size 0x9(0x633f bytes) 2024-09-21T15:09:18.078 INFO:teuthology.orchestra.run.smithi161.stdout:3990 read 0x1f578a1 thru 0x1f5e16a (0x68ca bytes) 2024-09-21T15:09:18.084 INFO:teuthology.orchestra.run.smithi161.stdout:3768 punch from 0x73ecb09 to 0x73ece16, (0x30d bytes) 2024-09-21T15:09:18.084 INFO:teuthology.orchestra.run.smithi161.stdout:3770 read 0x16d113f thru 0x16d9710 (0x85d2 bytes) 2024-09-21T15:09:18.087 INFO:teuthology.orchestra.run.smithi161.stdout:3771 read 0xe5cfb6 thru 0xe62f52 (0x5f9d bytes) 2024-09-21T15:09:18.091 INFO:teuthology.orchestra.run.smithi161.stdout:3991 trunc from 0xa410b02 to 0x42154c1 2024-09-21T15:09:18.091 INFO:teuthology.orchestra.run.smithi161.stdout:3411 writesame 0xdbf7495 thru 0xdbf82cc data_size 0x23(0xe38 bytes) 2024-09-21T15:09:18.099 INFO:teuthology.orchestra.run.smithi161.stdout:3412 read 0x1ff837b thru 0x20012e7 (0x8f6d bytes) 2024-09-21T15:09:18.099 INFO:teuthology.orchestra.run.smithi161.stdout:3772 trunc from 0xedb5d9a to 0x83cf772 2024-09-21T15:09:18.100 INFO:teuthology.orchestra.run.smithi161.stdout:3414 punch from 0x3ccd4d8 to 0x3cdc2cd, (0xedf5 bytes) 2024-09-21T15:09:18.100 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.100 INFO:teuthology.orchestra.run.smithi161.stdout:3416 write 0x45c000f thru 0x45c4963 (0x4955 bytes) 2024-09-21T15:09:18.127 INFO:teuthology.orchestra.run.smithi161.stdout:2998 writesame 0x717c743 thru 0x718af1c data_size 0x3b(0xe7da bytes) 2024-09-21T15:09:18.136 INFO:teuthology.orchestra.run.smithi161.stdout:3000 trunc from 0x718af1d to 0x827b55e 2024-09-21T15:09:18.140 INFO:teuthology.orchestra.run.smithi161.stdout:3417 trunc from 0xdbf82cd to 0x275e63a 2024-09-21T15:09:18.158 INFO:teuthology.orchestra.run.smithi161.stdout:3994 read 0x9e0377 thru 0x9e3a6c (0x36f6 bytes) 2024-09-21T15:09:18.186 INFO:teuthology.orchestra.run.smithi161.stdout:3002 read 0x18a0ee5 thru 0x18ae60b (0xd727 bytes) 2024-09-21T15:09:18.187 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.195 INFO:teuthology.orchestra.run.smithi161.stdout:3773 punch from 0x1d4b925 to 0x1d584ef, (0xcbca bytes) 2024-09-21T15:09:18.195 INFO:teuthology.orchestra.run.smithi161.stdout:3775 read 0x7b4af2b thru 0x7b4f773 (0x4849 bytes) 2024-09-21T15:09:18.196 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.196 INFO:teuthology.orchestra.run.smithi161.stdout:3777 read 0x10c4a0e thru 0x10c7ff8 (0x35eb bytes) 2024-09-21T15:09:18.196 INFO:teuthology.orchestra.run.smithi161.stdout:3779 read 0x38e03ac thru 0x38e6dee (0x6a43 bytes) 2024-09-21T15:09:18.197 INFO:teuthology.orchestra.run.smithi161.stdout:3780 read 0x813ba2e thru 0x813cf28 (0x14fb bytes) 2024-09-21T15:09:18.197 INFO:teuthology.orchestra.run.smithi161.stdout:3781 write 0x710f07d thru 0x71198a5 (0xa829 bytes) 2024-09-21T15:09:18.204 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.204 INFO:teuthology.orchestra.run.smithi161.stdout:3419 punch from 0x64d998 to 0x659d09, (0xc371 bytes) 2024-09-21T15:09:18.204 INFO:teuthology.orchestra.run.smithi161.stdout:3420 punch from 0x1a8fec4 to 0x1a97b96, (0x7cd2 bytes) 2024-09-21T15:09:18.204 INFO:teuthology.orchestra.run.smithi161.stdout:3421 write 0x234c5f6 thru 0x2351dd9 (0x57e4 bytes) 2024-09-21T15:09:18.206 INFO:teuthology.orchestra.run.smithi161.stdout:3783 write 0x5a9b871 thru 0x5aa3aa3 (0x8233 bytes) 2024-09-21T15:09:18.212 INFO:teuthology.orchestra.run.smithi161.stdout:3995 writesame 0xaacb9ef thru 0xaad6844 data_size 0x5(0xae56 bytes) 2024-09-21T15:09:18.215 INFO:teuthology.orchestra.run.smithi161.stdout:3784 read 0x6b1458 thru 0x6b6cf3 (0x589c bytes) 2024-09-21T15:09:18.216 INFO:teuthology.orchestra.run.smithi161.stdout:3786 read 0x3efd7cf thru 0x3f00990 (0x31c2 bytes) 2024-09-21T15:09:18.217 INFO:teuthology.orchestra.run.smithi161.stdout:3996 punch from 0x39f2b16 to 0x39fced5, (0xa3bf bytes) 2024-09-21T15:09:18.218 INFO:teuthology.orchestra.run.smithi161.stdout:4000 writesame 0x42b04c4 thru 0x42bb2b2 data_size 0x1(0xadef bytes) 2024-09-21T15:09:18.222 INFO:teuthology.orchestra.run.smithi161.stdout:3007 writesame 0xbd548aa thru 0xbd5814f data_size 0x3(0x38a6 bytes) 2024-09-21T15:09:18.225 INFO:teuthology.orchestra.run.smithi161.stdout:3009 punch from 0x3e1d295 to 0x3e1f0f0, (0x1e5b bytes) 2024-09-21T15:09:18.225 INFO:teuthology.orchestra.run.smithi161.stdout:3011 write 0xb043419 thru 0xb04c084 (0x8c6c bytes) 2024-09-21T15:09:18.243 INFO:teuthology.orchestra.run.smithi161.stdout:3013 read 0x2284795 thru 0x22905bb (0xbe27 bytes) 2024-09-21T15:09:18.243 INFO:teuthology.orchestra.run.smithi161.stdout:3015 writesame 0x94594f6 thru 0x9460823 data_size 0x17(0x732e bytes) 2024-09-21T15:09:18.258 INFO:teuthology.orchestra.run.smithi161.stdout:3016 write 0x1284ca3 thru 0x128ede9 (0xa147 bytes) 2024-09-21T15:09:18.261 INFO:teuthology.orchestra.run.smithi161.stdout:4001 trunc from 0xaad6845 to 0x7833d3d 2024-09-21T15:09:18.273 INFO:teuthology.orchestra.run.smithi161.stdout:3787 writesame 0xa45b2ef thru 0xa46972b data_size 0x11(0xe43d bytes) 2024-09-21T15:09:18.274 INFO:teuthology.orchestra.run.smithi161.stdout:3422 write 0xdfe2fa0 thru 0xdff2c44 (0xfca5 bytes) 2024-09-21T15:09:18.283 INFO:teuthology.orchestra.run.smithi161.stdout:3018 punch from 0xf5c635 to 0xf5f393, (0x2d5e bytes) 2024-09-21T15:09:18.283 INFO:teuthology.orchestra.run.smithi161.stdout:3019 write 0x8d6b583 thru 0x8d6de57 (0x28d5 bytes) 2024-09-21T15:09:18.283 INFO:teuthology.orchestra.run.smithi161.stdout:3789 write 0x90e504b thru 0x90f42ec (0xf2a2 bytes) 2024-09-21T15:09:18.288 INFO:teuthology.orchestra.run.smithi161.stdout:3423 read 0xa2b7b18 thru 0xa2b979c (0x1c85 bytes) 2024-09-21T15:09:18.289 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.289 INFO:teuthology.orchestra.run.smithi161.stdout:3427 read 0xcb99948 thru 0xcba5619 (0xbcd2 bytes) 2024-09-21T15:09:18.290 INFO:teuthology.orchestra.run.smithi161.stdout:3429 write 0x36e14f6 thru 0x36e832d (0x6e38 bytes) 2024-09-21T15:09:18.299 INFO:teuthology.orchestra.run.smithi161.stdout:3790 punch from 0x8082c3d to 0x808c88f, (0x9c52 bytes) 2024-09-21T15:09:18.299 INFO:teuthology.orchestra.run.smithi161.stdout:3792 writesame 0x905ce1e thru 0x905f6e3 data_size 0x11(0x28c6 bytes) 2024-09-21T15:09:18.307 INFO:teuthology.orchestra.run.smithi161.stdout:3020 read 0x244948d thru 0x244e315 (0x4e89 bytes) 2024-09-21T15:09:18.307 INFO:teuthology.orchestra.run.smithi161.stdout:3431 write 0x5bd0834 thru 0x5bdf65a (0xee27 bytes) 2024-09-21T15:09:18.307 INFO:teuthology.orchestra.run.smithi161.stdout:3021 write 0xce0971 thru 0xce7bb5 (0x7245 bytes) 2024-09-21T15:09:18.313 INFO:teuthology.orchestra.run.smithi161.stdout:3793 read 0x8ec3320 thru 0x8ec942c (0x610d bytes) 2024-09-21T15:09:18.324 INFO:teuthology.orchestra.run.smithi161.stdout:3022 read 0x36e547 thru 0x3771cb (0x8c85 bytes) 2024-09-21T15:09:18.327 INFO:teuthology.orchestra.run.smithi161.stdout:3433 write 0xa4576dd thru 0xa4605e4 (0x8f08 bytes) 2024-09-21T15:09:18.327 INFO:teuthology.orchestra.run.smithi161.stdout:3794 trunc from 0xa46972c to 0x4b93003 2024-09-21T15:09:18.334 INFO:teuthology.orchestra.run.smithi161.stdout:3023 trunc from 0xbd58150 to 0x86a126b 2024-09-21T15:09:18.339 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.340 INFO:teuthology.orchestra.run.smithi161.stdout:3436 read 0x5a5bc85 thru 0x5a641c9 (0x8545 bytes) 2024-09-21T15:09:18.341 INFO:teuthology.orchestra.run.smithi161.stdout:3438 write 0xad24685 thru 0xad32aec (0xe468 bytes) 2024-09-21T15:09:18.354 INFO:teuthology.orchestra.run.smithi161.stdout:3439 write 0x40175de thru 0x40182ce (0xcf1 bytes) 2024-09-21T15:09:18.362 INFO:teuthology.orchestra.run.smithi161.stdout:3440 punch from 0xbdc895 to 0xbe7ce6, (0xb451 bytes) 2024-09-21T15:09:18.362 INFO:teuthology.orchestra.run.smithi161.stdout:3442 read 0x4e50c73 thru 0x4e5d7e6 (0xcb74 bytes) 2024-09-21T15:09:18.363 INFO:teuthology.orchestra.run.smithi161.stdout:3443 write 0x527f544 thru 0x528709b (0x7b58 bytes) 2024-09-21T15:09:18.364 INFO:teuthology.orchestra.run.smithi161.stdout:4003 write 0xbacee3c thru 0xbadc799 (0xd95e bytes) 2024-09-21T15:09:18.395 INFO:teuthology.orchestra.run.smithi161.stdout:3445 write 0x299dfbd thru 0x29a97d7 (0xb81b bytes) 2024-09-21T15:09:18.397 INFO:teuthology.orchestra.run.smithi161.stdout:4004 punch from 0x185d870 to 0x1862a5e, (0x51ee bytes) 2024-09-21T15:09:18.397 INFO:teuthology.orchestra.run.smithi161.stdout:4005 read 0xb54b715 thru 0xb550b75 (0x5461 bytes) 2024-09-21T15:09:18.398 INFO:teuthology.orchestra.run.smithi161.stdout:4006 read 0x10741df thru 0x1078513 (0x4335 bytes) 2024-09-21T15:09:18.403 INFO:teuthology.orchestra.run.smithi161.stdout:3446 punch from 0xb226aa2 to 0xb227db2, (0x1310 bytes) 2024-09-21T15:09:18.403 INFO:teuthology.orchestra.run.smithi161.stdout:3447 read 0x273adb5 thru 0x2748e54 (0xe0a0 bytes) 2024-09-21T15:09:18.404 INFO:teuthology.orchestra.run.smithi161.stdout:3448 read 0x965e4d6 thru 0x9668cd8 (0xa803 bytes) 2024-09-21T15:09:18.405 INFO:teuthology.orchestra.run.smithi161.stdout:3449 write 0xc9de9f thru 0xca78f4 (0x9a56 bytes) 2024-09-21T15:09:18.421 INFO:teuthology.orchestra.run.smithi161.stdout:3451 read 0x8f2663f thru 0x8f326d3 (0xc095 bytes) 2024-09-21T15:09:18.421 INFO:teuthology.orchestra.run.smithi161.stdout:3453 write 0x20c7d57 thru 0x20ca325 (0x25cf bytes) 2024-09-21T15:09:18.424 INFO:teuthology.orchestra.run.smithi161.stdout:3024 trunc from 0x86a126b to 0x517dcd 2024-09-21T15:09:18.429 INFO:teuthology.orchestra.run.smithi161.stdout:3454 read 0x274d261 thru 0x27517a8 (0x4548 bytes) 2024-09-21T15:09:18.430 INFO:teuthology.orchestra.run.smithi161.stdout:3455 write 0xc5ded10 thru 0xc5eb4cf (0xc7c0 bytes) 2024-09-21T15:09:18.447 INFO:teuthology.orchestra.run.smithi161.stdout:3456 read 0x7f1107d thru 0x7f208b6 (0xf83a bytes) 2024-09-21T15:09:18.448 INFO:teuthology.orchestra.run.smithi161.stdout:3459 write 0x626a966 thru 0x6276aa3 (0xc13e bytes) 2024-09-21T15:09:18.454 INFO:teuthology.orchestra.run.smithi161.stdout:3795 read 0x2e7991a thru 0x2e7e8de (0x4fc5 bytes) 2024-09-21T15:09:18.455 INFO:teuthology.orchestra.run.smithi161.stdout:3796 read 0x138b9c9 thru 0x138e032 (0x266a bytes) 2024-09-21T15:09:18.455 INFO:teuthology.orchestra.run.smithi161.stdout:4008 writesame 0xe945509 thru 0xe95281b data_size 0x65(0xd313 bytes) 2024-09-21T15:09:18.459 INFO:teuthology.orchestra.run.smithi161.stdout:3460 write 0x2372cc9 thru 0x2373d99 (0x10d1 bytes) 2024-09-21T15:09:18.463 INFO:teuthology.orchestra.run.smithi161.stdout:3797 trunc from 0x4b93003 to 0x21c0ad2 2024-09-21T15:09:18.463 INFO:teuthology.orchestra.run.smithi161.stdout:4010 writesame 0x7fbafa3 thru 0x7fc14d9 data_size 0x3(0x6537 bytes) 2024-09-21T15:09:18.466 INFO:teuthology.orchestra.run.smithi161.stdout:3462 write 0x7bf25e8 thru 0x7bf6472 (0x3e8b bytes) 2024-09-21T15:09:18.481 INFO:teuthology.orchestra.run.smithi161.stdout:3463 write 0xd973e34 thru 0xd97d004 (0x91d1 bytes) 2024-09-21T15:09:18.482 INFO:teuthology.orchestra.run.smithi161.stdout:4011 punch from 0xd3d33ff to 0xd3e0ac6, (0xd6c7 bytes) 2024-09-21T15:09:18.482 INFO:teuthology.orchestra.run.smithi161.stdout:4012 write 0x1f3f05d thru 0x1f4bdd1 (0xcd75 bytes) 2024-09-21T15:09:18.498 INFO:teuthology.orchestra.run.smithi161.stdout:3464 punch from 0x711c764 to 0x711c986, (0x222 bytes) 2024-09-21T15:09:18.498 INFO:teuthology.orchestra.run.smithi161.stdout:3465 read 0xb33b4ac thru 0xb3410fc (0x5c51 bytes) 2024-09-21T15:09:18.498 INFO:teuthology.orchestra.run.smithi161.stdout:3466 write 0xaf5826f thru 0xaf5ea0b (0x679d bytes) 2024-09-21T15:09:18.499 INFO:teuthology.orchestra.run.smithi161.stdout:4013 punch from 0x5baff2a to 0x5bb6559, (0x662f bytes) 2024-09-21T15:09:18.499 INFO:teuthology.orchestra.run.smithi161.stdout:4014 writesame 0x2463820 thru 0x246b37f data_size 0x8d(0x7b60 bytes) 2024-09-21T15:09:18.508 INFO:teuthology.orchestra.run.smithi161.stdout:3468 read 0x8348847 thru 0x8356c01 (0xe3bb bytes) 2024-09-21T15:09:18.508 INFO:teuthology.orchestra.run.smithi161.stdout:3469 punch from 0x7ebf272 to 0x7ec6e8d, (0x7c1b bytes) 2024-09-21T15:09:18.509 INFO:teuthology.orchestra.run.smithi161.stdout:4015 writesame 0xd0814d9 thru 0xd08af7c data_size 0x6(0x9aa4 bytes) 2024-09-21T15:09:18.509 INFO:teuthology.orchestra.run.smithi161.stdout:3470 write 0x52e3682 thru 0x52f1670 (0xdfef bytes) 2024-09-21T15:09:18.524 INFO:teuthology.orchestra.run.smithi161.stdout:4016 read 0xa0855e1 thru 0xa086092 (0xab2 bytes) 2024-09-21T15:09:18.541 INFO:teuthology.orchestra.run.smithi161.stdout:4017 trunc from 0xe95281c to 0x7e74f0b 2024-09-21T15:09:18.545 INFO:teuthology.orchestra.run.smithi161.stdout:3025 write 0x55d8ab3 thru 0x55e6f33 (0xe481 bytes) 2024-09-21T15:09:18.564 INFO:teuthology.orchestra.run.smithi161.stdout:3471 write 0xe7564a0 thru 0xe75cc46 (0x67a7 bytes) 2024-09-21T15:09:18.575 INFO:teuthology.orchestra.run.smithi161.stdout:3029 read 0x4802915 thru 0x480a175 (0x7861 bytes) 2024-09-21T15:09:18.576 INFO:teuthology.orchestra.run.smithi161.stdout:3030 write 0x1332ec8 thru 0x133d53e (0xa677 bytes) 2024-09-21T15:09:18.583 INFO:teuthology.orchestra.run.smithi161.stdout:3472 trunc from 0xe75cc47 to 0xe3ea813 2024-09-21T15:09:18.611 INFO:teuthology.orchestra.run.smithi161.stdout:3798 write 0x242220c thru 0x2431c93 (0xfa88 bytes) 2024-09-21T15:09:18.625 INFO:teuthology.orchestra.run.smithi161.stdout:3799 punch from 0x20d1f10 to 0x20df92c, (0xda1c bytes) 2024-09-21T15:09:18.625 INFO:teuthology.orchestra.run.smithi161.stdout:3800 read 0x4db5cb thru 0x4df04a (0x3a80 bytes) 2024-09-21T15:09:18.626 INFO:teuthology.orchestra.run.smithi161.stdout:3801 punch from 0x48d333 to 0x4979f3, (0xa6c0 bytes) 2024-09-21T15:09:18.626 INFO:teuthology.orchestra.run.smithi161.stdout:3802 punch from 0x9c9b5c to 0x9d4c3f, (0xb0e3 bytes) 2024-09-21T15:09:18.626 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.628 INFO:teuthology.orchestra.run.smithi161.stdout:3474 punch from 0x5d3741d to 0x5d41d59, (0xa93c bytes) 2024-09-21T15:09:18.636 INFO:teuthology.orchestra.run.smithi161.stdout:3804 trunc from 0x2431c94 to 0x7e4224e 2024-09-21T15:09:18.641 INFO:teuthology.orchestra.run.smithi161.stdout:3475 trunc from 0xe3ea813 to 0x72d1b52 2024-09-21T15:09:18.657 INFO:teuthology.orchestra.run.smithi161.stdout:4018 writesame 0xcde6928 thru 0xcdeb82a data_size 0x1(0x4f03 bytes) 2024-09-21T15:09:18.666 INFO:teuthology.orchestra.run.smithi161.stdout:3031 write 0xee41caa thru 0xee4ea11 (0xcd68 bytes) 2024-09-21T15:09:18.686 INFO:teuthology.orchestra.run.smithi161.stdout:3805 read 0x1e50bf3 thru 0x1e53a87 (0x2e95 bytes) 2024-09-21T15:09:18.686 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.686 INFO:teuthology.orchestra.run.smithi161.stdout:3033 write 0xbb4f52a thru 0xbb52b7e (0x3655 bytes) 2024-09-21T15:09:18.687 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.687 INFO:teuthology.orchestra.run.smithi161.stdout:3477 read 0x2e47530 thru 0x2e506c4 (0x9195 bytes) 2024-09-21T15:09:18.687 INFO:teuthology.orchestra.run.smithi161.stdout:4019 trunc from 0xcdeb82b to 0x43e6adc 2024-09-21T15:09:18.687 INFO:teuthology.orchestra.run.smithi161.stdout:3806 writesame 0x5214f8a thru 0x521596d data_size 0x3(0x9e4 bytes) 2024-09-21T15:09:18.707 INFO:teuthology.orchestra.run.smithi161.stdout:3034 write 0x8ee066a thru 0x8ee91ec (0x8b83 bytes) 2024-09-21T15:09:18.720 INFO:teuthology.orchestra.run.smithi161.stdout:3478 write 0x80be941 thru 0x80bfb25 (0x11e5 bytes) 2024-09-21T15:09:18.729 INFO:teuthology.orchestra.run.smithi161.stdout:3035 write 0x535181a thru 0x535e727 (0xcf0e bytes) 2024-09-21T15:09:18.751 INFO:teuthology.orchestra.run.smithi161.stdout:3036 punch from 0x11dba6a to 0x11e645a, (0xa9f0 bytes) 2024-09-21T15:09:18.751 INFO:teuthology.orchestra.run.smithi161.stdout:3037 read 0xa56f02c thru 0xa574ba1 (0x5b76 bytes) 2024-09-21T15:09:18.751 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.752 INFO:teuthology.orchestra.run.smithi161.stdout:3040 punch from 0xd159f20 to 0xd1663f8, (0xc4d8 bytes) 2024-09-21T15:09:18.752 INFO:teuthology.orchestra.run.smithi161.stdout:3042 write 0xb01bd08 thru 0xb022996 (0x6c8f bytes) 2024-09-21T15:09:18.775 INFO:teuthology.orchestra.run.smithi161.stdout:3808 writesame 0xcee8811 thru 0xcef2db4 data_size 0x2(0xa5a4 bytes) 2024-09-21T15:09:18.782 INFO:teuthology.orchestra.run.smithi161.stdout:3043 write 0xb74c7fb thru 0xb75033b (0x3b41 bytes) 2024-09-21T15:09:18.782 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.783 INFO:teuthology.orchestra.run.smithi161.stdout:3480 write 0xc4fac0e thru 0xc4fd3a2 (0x2795 bytes) 2024-09-21T15:09:18.792 INFO:teuthology.orchestra.run.smithi161.stdout:3482 writesame 0x7e3467f thru 0x7e3a5dd data_size 0x13(0x5f5f bytes) 2024-09-21T15:09:18.795 INFO:teuthology.orchestra.run.smithi161.stdout:3044 read 0x1b8fb13 thru 0x1b9cda9 (0xd297 bytes) 2024-09-21T15:09:18.795 INFO:teuthology.orchestra.run.smithi161.stdout:3046 punch from 0x5904b25 to 0x591498b, (0xfe66 bytes) 2024-09-21T15:09:18.795 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.795 INFO:teuthology.orchestra.run.smithi161.stdout:3048 writesame 0x34a8e87 thru 0x34b478e data_size 0x1f(0xb908 bytes) 2024-09-21T15:09:18.800 INFO:teuthology.orchestra.run.smithi161.stdout:3810 trunc from 0xcef2db5 to 0x3875cec 2024-09-21T15:09:18.801 INFO:teuthology.orchestra.run.smithi161.stdout:3483 writesame 0xbf46e63 thru 0xbf567bc data_size 0x3(0xf95a bytes) 2024-09-21T15:09:18.818 INFO:teuthology.orchestra.run.smithi161.stdout:3050 read 0xb2a8131 thru 0xb2b6991 (0xe861 bytes) 2024-09-21T15:09:18.819 INFO:teuthology.orchestra.run.smithi161.stdout:3051 punch from 0xcd462bd to 0xcd46604, (0x347 bytes) 2024-09-21T15:09:18.821 INFO:teuthology.orchestra.run.smithi161.stdout:3052 trunc from 0xee4ea12 to 0xde9d777 2024-09-21T15:09:18.826 INFO:teuthology.orchestra.run.smithi161.stdout:3485 punch from 0xa62fbcd to 0xa63b560, (0xb993 bytes) 2024-09-21T15:09:18.826 INFO:teuthology.orchestra.run.smithi161.stdout:3486 write 0x57f05a6 thru 0x57f507b (0x4ad6 bytes) 2024-09-21T15:09:18.873 INFO:teuthology.orchestra.run.smithi161.stdout:3487 write 0xc7d596d thru 0xc7e1b1d (0xc1b1 bytes) 2024-09-21T15:09:18.874 INFO:teuthology.orchestra.run.smithi161.stdout:3811 read 0x22f047 thru 0x237203 (0x81bd bytes) 2024-09-21T15:09:18.876 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.876 INFO:teuthology.orchestra.run.smithi161.stdout:3814 punch from 0x666aff to 0x66e9f6, (0x7ef7 bytes) 2024-09-21T15:09:18.877 INFO:teuthology.orchestra.run.smithi161.stdout:3815 read 0x226e24e thru 0x22749d5 (0x6788 bytes) 2024-09-21T15:09:18.877 INFO:teuthology.orchestra.run.smithi161.stdout:3816 punch from 0x327b3f3 to 0x328103f, (0x5c4c bytes) 2024-09-21T15:09:18.877 INFO:teuthology.orchestra.run.smithi161.stdout:3817 read 0x214a406 thru 0x214a860 (0x45b bytes) 2024-09-21T15:09:18.886 INFO:teuthology.orchestra.run.smithi161.stdout:3053 trunc from 0xde9d777 to 0x9046408 2024-09-21T15:09:18.889 INFO:teuthology.orchestra.run.smithi161.stdout:3489 trunc from 0xc7e1b1e to 0xb6a1b16 2024-09-21T15:09:18.930 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #24, image image_cluster1.client.mirror.2-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent25 2024-09-21T15:09:18.932 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #24, image image_cluster1.client.mirror.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent25 2024-09-21T15:09:18.936 INFO:teuthology.orchestra.run.smithi161.stdout:3818 write 0xbd05fa9 thru 0xbd0dcc6 (0x7d1e bytes) 2024-09-21T15:09:18.942 INFO:teuthology.orchestra.run.smithi161.stdout:3490 writesame 0x57f459 thru 0x584632 data_size 0x1(0x51da bytes) 2024-09-21T15:09:18.947 INFO:teuthology.orchestra.run.smithi161.stdout:4021 read 0x4027f26 thru 0x402d529 (0x5604 bytes) 2024-09-21T15:09:18.948 INFO:teuthology.orchestra.run.smithi161.stdout:3819 punch from 0x2ba1b82 to 0x2ba92ca, (0x7748 bytes) 2024-09-21T15:09:18.948 INFO:teuthology.orchestra.run.smithi161.stdout:4023 write 0x2217319 thru 0x2217e74 (0xb5c bytes) 2024-09-21T15:09:18.966 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:18.966 INFO:teuthology.orchestra.run.smithi161.stdout:3492 writesame 0x3ee49f9 thru 0x3ef1034 data_size 0x6(0xc63c bytes) 2024-09-21T15:09:18.987 INFO:teuthology.orchestra.run.smithi161.stdout:3493 punch from 0x1219502 to 0x1220aa8, (0x75a6 bytes) 2024-09-21T15:09:18.994 INFO:teuthology.orchestra.run.smithi161.stdout:3054 writesame 0xd09d496 thru 0xd09e10e data_size 0x1(0xc79 bytes) 2024-09-21T15:09:18.996 INFO:teuthology.orchestra.run.smithi161.stdout:3820 writesame 0xcc38267 thru 0xcc419d5 data_size 0x1(0x976f bytes) 2024-09-21T15:09:18.998 INFO:teuthology.orchestra.run.smithi161.stdout:3057 writesame 0xabb9cb4 thru 0xabbe67d data_size 0x5(0x49ca bytes) 2024-09-21T15:09:19.002 INFO:teuthology.orchestra.run.smithi161.stdout:3821 write 0xcae527c thru 0xcaf364f (0xe3d4 bytes) 2024-09-21T15:09:19.004 INFO:teuthology.orchestra.run.smithi161.stdout:3494 trunc from 0xb6a1b16 to 0x26d1140 2024-09-21T15:09:19.025 INFO:teuthology.orchestra.run.smithi161.stdout:4024 write 0x95c6d50 thru 0x95d0053 (0x9304 bytes) 2024-09-21T15:09:19.028 INFO:teuthology.orchestra.run.smithi161.stdout:3058 read 0x58acc5f thru 0x58ad5f9 (0x99b bytes) 2024-09-21T15:09:19.029 INFO:teuthology.orchestra.run.smithi161.stdout:3060 punch from 0x8777601 to 0x877b935, (0x4334 bytes) 2024-09-21T15:09:19.029 INFO:teuthology.orchestra.run.smithi161.stdout:3061 punch from 0x947159a to 0x947ab90, (0x95f6 bytes) 2024-09-21T15:09:19.029 INFO:teuthology.orchestra.run.smithi161.stdout:3062 write 0x6b83a85 thru 0x6b860b5 (0x2631 bytes) 2024-09-21T15:09:19.038 INFO:teuthology.orchestra.run.smithi161.stdout:4025 trunc from 0x95d0054 to 0xa7b3415 2024-09-21T15:09:19.043 INFO:teuthology.orchestra.run.smithi161.stdout:3822 trunc from 0xcc419d6 to 0x4550f12 2024-09-21T15:09:19.051 INFO:teuthology.orchestra.run.smithi161.stdout:3063 clone 36 order 22 su 262144 sc 10 2024-09-21T15:09:19.058 INFO:teuthology.orchestra.run.smithi161.stdout:3495 read 0xa7716f thru 0xa7f28e (0x8120 bytes) 2024-09-21T15:09:19.069 INFO:teuthology.orchestra.run.smithi161.stdout:4026 read 0x69be8d2 thru 0x69cdc3f (0xf36e bytes) 2024-09-21T15:09:19.070 INFO:teuthology.orchestra.run.smithi161.stdout:4027 trunc from 0xa7b3415 to 0xac33aac 2024-09-21T15:09:19.090 INFO:teuthology.orchestra.run.smithi161.stdout:3823 trunc from 0x4550f12 to 0x4b59304 2024-09-21T15:09:19.095 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:19.096 INFO:teuthology.orchestra.run.smithi161.stdout:4029 writesame 0x286b706 thru 0x287aacd data_size 0x74(0xf3c8 bytes) 2024-09-21T15:09:19.102 INFO:teuthology.orchestra.run.smithi161.stdout:4030 write 0x76cc7bb thru 0x76d647d (0x9cc3 bytes) 2024-09-21T15:09:19.103 INFO:teuthology.orchestra.run.smithi161.stdout:3496 write 0xbf7a9a2 thru 0xbf85df7 (0xb456 bytes) 2024-09-21T15:09:19.117 INFO:teuthology.orchestra.run.smithi161.stdout:3497 read 0xbded208 thru 0xbdeef7b (0x1d74 bytes) 2024-09-21T15:09:19.118 INFO:teuthology.orchestra.run.smithi161.stdout:3498 read 0x143d630 thru 0x144015a (0x2b2b bytes) 2024-09-21T15:09:19.118 INFO:teuthology.orchestra.run.smithi161.stdout:3499 clone 31 order 25 su 1048576 sc 5 2024-09-21T15:09:19.119 INFO:teuthology.orchestra.run.smithi161.stdout:4032 trunc from 0xac33aac to 0x8a3f70d 2024-09-21T15:09:19.123 INFO:teuthology.orchestra.run.smithi161.stdout:3825 read 0x374ce5b thru 0x375ac9f (0xde45 bytes) 2024-09-21T15:09:19.123 INFO:teuthology.orchestra.run.smithi161.stdout:3827 read 0x48e452a thru 0x48eb297 (0x6d6e bytes) 2024-09-21T15:09:19.124 INFO:teuthology.orchestra.run.smithi161.stdout:3828 read 0xff544e thru 0xff7605 (0x21b8 bytes) 2024-09-21T15:09:19.124 INFO:teuthology.orchestra.run.smithi161.stdout:3829 punch from 0x2fd7a2a to 0x2fd8bcb, (0x11a1 bytes) 2024-09-21T15:09:19.125 INFO:teuthology.orchestra.run.smithi161.stdout:3831 read 0x14c91fe thru 0x14d0cf5 (0x7af8 bytes) 2024-09-21T15:09:19.126 INFO:teuthology.orchestra.run.smithi161.stdout:3832 read 0x10b9d31 thru 0x10c106f (0x733f bytes) 2024-09-21T15:09:19.127 INFO:teuthology.orchestra.run.smithi161.stdout:3833 punch from 0x2438bf9 to 0x244286c, (0x9c73 bytes) 2024-09-21T15:09:19.127 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:19.160 INFO:teuthology.orchestra.run.smithi161.stdout:3835 writesame 0x6575a7c thru 0x6579d71 data_size 0x3(0x42f6 bytes) 2024-09-21T15:09:19.165 INFO:teuthology.orchestra.run.smithi161.stdout:3837 writesame 0x418db8a thru 0x419cdef data_size 0x47(0xf266 bytes) 2024-09-21T15:09:19.195 INFO:teuthology.orchestra.run.smithi161.stdout:4033 write 0xcc7926d thru 0xcc7f70f (0x64a3 bytes) 2024-09-21T15:09:19.203 INFO:teuthology.orchestra.run.smithi161.stdout:4034 write 0xa88a093 thru 0xa88a119 (0x87 bytes) 2024-09-21T15:09:19.208 INFO:teuthology.orchestra.run.smithi161.stdout:3838 write 0x7cd360c thru 0x7cd995b (0x6350 bytes) 2024-09-21T15:09:19.209 INFO:teuthology.orchestra.run.smithi161.stdout:4035 write 0x2dfed94 thru 0x2e03372 (0x45df bytes) 2024-09-21T15:09:19.219 INFO:teuthology.orchestra.run.smithi161.stdout:4168 read 0x42157e9 thru 0x4224e39 (0xf651 bytes) 2024-09-21T15:09:19.219 INFO:teuthology.orchestra.run.smithi161.stdout:4036 writesame 0xa231fe8 thru 0xa2391e8 data_size 0xd(0x7201 bytes) 2024-09-21T15:09:19.219 INFO:teuthology.orchestra.run.smithi161.stdout:3839 read 0x3aede01 thru 0x3af4c6c (0x6e6c bytes) 2024-09-21T15:09:19.220 INFO:teuthology.orchestra.run.smithi161.stdout:3840 clone 25 order 23 su 65536 sc 7 2024-09-21T15:09:19.226 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:19.228 INFO:teuthology.orchestra.run.smithi161.stdout:4041 trunc from 0xcc7f710 to 0xdd0a724 2024-09-21T15:09:19.242 INFO:teuthology.orchestra.run.smithi161.stdout:4171 trunc from 0x75d6af2 to 0x357b04d 2024-09-21T15:09:19.255 INFO:teuthology.orchestra.run.smithi161.stdout:4043 read 0xd7fc32e thru 0xd80b964 (0xf637 bytes) 2024-09-21T15:09:19.268 INFO:teuthology.orchestra.run.smithi161.stdout:4045 read 0x913528a thru 0x914308c (0xde03 bytes) 2024-09-21T15:09:19.268 INFO:teuthology.orchestra.run.smithi161.stdout:4046 writesame 0x1b7bb5d thru 0x1b7bcc3 data_size 0x1(0x167 bytes) 2024-09-21T15:09:19.282 INFO:teuthology.orchestra.run.smithi161.stdout:4047 write 0x364fe6e thru 0x365f5f5 (0xf788 bytes) 2024-09-21T15:09:19.292 INFO:teuthology.orchestra.run.smithi161.stdout:4048 writesame 0x1a6bcbb thru 0x1a70510 data_size 0x1(0x4856 bytes) 2024-09-21T15:09:19.299 INFO:teuthology.orchestra.run.smithi161.stdout:4172 punch from 0x6eb913 to 0x6ecdc0, (0x14ad bytes) 2024-09-21T15:09:19.299 INFO:teuthology.orchestra.run.smithi161.stdout:4173 read 0x2197418 thru 0x2198aeb (0x16d4 bytes) 2024-09-21T15:09:19.308 INFO:teuthology.orchestra.run.smithi161.stdout:4049 read 0x26ccfad thru 0x26cf1e0 (0x2234 bytes) 2024-09-21T15:09:19.309 INFO:teuthology.orchestra.run.smithi161.stdout:4053 punch from 0xd4558a6 to 0xd45f799, (0x9ef3 bytes) 2024-09-21T15:09:19.309 INFO:teuthology.orchestra.run.smithi161.stdout:4054 read 0xa0e378 thru 0xa129aa (0x4633 bytes) 2024-09-21T15:09:19.311 INFO:teuthology.orchestra.run.smithi161.stdout:4174 trunc from 0x357b04d to 0x94239b0 2024-09-21T15:09:19.330 INFO:teuthology.orchestra.run.smithi161.stdout:4055 trunc from 0xdd0a724 to 0x32758d6 2024-09-21T15:09:19.337 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:19.346 INFO:teuthology.orchestra.run.smithi161.stdout:4177 trunc from 0x94239b0 to 0x482afe9 2024-09-21T15:09:19.377 INFO:teuthology.orchestra.run.smithi161.stdout:4056 punch from 0x2eeef2a to 0x2ef8c8d, (0x9d63 bytes) 2024-09-21T15:09:19.377 INFO:teuthology.orchestra.run.smithi161.stdout:4057 clone 21 order 22 su 65536 sc 14 2024-09-21T15:09:19.379 INFO:teuthology.orchestra.run.smithi161.stdout:4178 write 0x2a126c6 thru 0x2a1b947 (0x9282 bytes) 2024-09-21T15:09:19.440 INFO:teuthology.orchestra.run.smithi161.stdout:3940 read 0x135288a thru 0x13569d1 (0x4148 bytes) 2024-09-21T15:09:19.445 INFO:teuthology.orchestra.run.smithi161.stdout:4183 writesame 0xb93d809 thru 0xb941322 data_size 0x5(0x3b1a bytes) 2024-09-21T15:09:19.450 INFO:teuthology.orchestra.run.smithi161.stdout:4184 write 0xcd9cfa thru 0xcdf55c (0x5863 bytes) 2024-09-21T15:09:19.464 INFO:teuthology.orchestra.run.smithi161.stdout:4185 read 0x858ca91 thru 0x8593206 (0x6776 bytes) 2024-09-21T15:09:19.464 INFO:teuthology.orchestra.run.smithi161.stdout:4187 punch from 0x6207d9b to 0x620d125, (0x538a bytes) 2024-09-21T15:09:19.464 INFO:teuthology.orchestra.run.smithi161.stdout:4188 write 0x5ae0f46 thru 0x5aecbc6 (0xbc81 bytes) 2024-09-21T15:09:19.464 INFO:teuthology.orchestra.run.smithi161.stdout:3941 read 0x13fbdc8 thru 0x140821b (0xc454 bytes) 2024-09-21T15:09:19.467 INFO:teuthology.orchestra.run.smithi161.stdout:3942 write 0x4ee70c3 thru 0x4eeb102 (0x4040 bytes) 2024-09-21T15:09:19.478 INFO:teuthology.orchestra.run.smithi161.stdout:4189 writesame 0x126ada4 thru 0x1275aef data_size 0x6(0xad4c bytes) 2024-09-21T15:09:19.480 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:19.480 INFO:teuthology.orchestra.run.smithi161.stdout:3948 read 0x61a17ee thru 0x61afb21 (0xe334 bytes) 2024-09-21T15:09:19.481 INFO:teuthology.orchestra.run.smithi161.stdout:3949 read 0x39e7a7 thru 0x39f56e (0xdc8 bytes) 2024-09-21T15:09:19.482 INFO:teuthology.orchestra.run.smithi161.stdout:3950 write 0xaf1ea2 thru 0xafe57a (0xc6d9 bytes) 2024-09-21T15:09:19.499 INFO:teuthology.orchestra.run.smithi161.stdout:4190 punch from 0x2c1c88a to 0x2c1ec4b, (0x23c1 bytes) 2024-09-21T15:09:19.500 INFO:teuthology.orchestra.run.smithi161.stdout:4192 punch from 0x7943c32 to 0x7953be5, (0xffb3 bytes) 2024-09-21T15:09:19.514 INFO:teuthology.orchestra.run.smithi161.stdout:3951 write 0x4383195 thru 0x438a895 (0x7701 bytes) 2024-09-21T15:09:19.527 INFO:teuthology.orchestra.run.smithi161.stdout:3953 punch from 0x53c2445 to 0x53cc091, (0x9c4c bytes) 2024-09-21T15:09:19.527 INFO:teuthology.orchestra.run.smithi161.stdout:3954 punch from 0x2cf91bd to 0x2d01309, (0x814c bytes) 2024-09-21T15:09:19.527 INFO:teuthology.orchestra.run.smithi161.stdout:3955 read 0x20f171a thru 0x20f7fed (0x68d4 bytes) 2024-09-21T15:09:19.544 INFO:teuthology.orchestra.run.smithi161.stdout:3956 trunc from 0x67b401b to 0xdc458a3 2024-09-21T15:09:19.545 INFO:teuthology.orchestra.run.smithi161.stdout:4193 write 0xe9935d0 thru 0xe99a96d (0x739e bytes) 2024-09-21T15:09:19.568 INFO:teuthology.orchestra.run.smithi161.stdout:4194 punch from 0x4d24744 to 0x4d306bc, (0xbf78 bytes) 2024-09-21T15:09:19.568 INFO:teuthology.orchestra.run.smithi161.stdout:4195 read 0x3572930 thru 0x3574d5d (0x242e bytes) 2024-09-21T15:09:19.569 INFO:teuthology.orchestra.run.smithi161.stdout:4196 read 0x50582c6 thru 0x5064bee (0xc929 bytes) 2024-09-21T15:09:19.569 INFO:teuthology.orchestra.run.smithi161.stdout:4197 read 0xca9670f thru 0xca9f4ff (0x8df1 bytes) 2024-09-21T15:09:19.569 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:19.569 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:19.570 INFO:teuthology.orchestra.run.smithi161.stdout:4202 write 0x738bffa thru 0x738cb55 (0xb5c bytes) 2024-09-21T15:09:19.592 INFO:teuthology.orchestra.run.smithi161.stdout:4203 write 0x9b523f0 thru 0x9b54429 (0x203a bytes) 2024-09-21T15:09:19.592 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:19.592 INFO:teuthology.orchestra.run.smithi161.stdout:3958 read 0x9869d6f thru 0x986dadb (0x3d6d bytes) 2024-09-21T15:09:19.592 INFO:teuthology.orchestra.run.smithi161.stdout:3959 read 0x73fa98c thru 0x74025e7 (0x7c5c bytes) 2024-09-21T15:09:19.594 INFO:teuthology.orchestra.run.smithi161.stdout:3961 punch from 0x96f8f1 to 0x97b20e, (0xb91d bytes) 2024-09-21T15:09:19.594 INFO:teuthology.orchestra.run.smithi161.stdout:3963 read 0x229634c thru 0x229db73 (0x7828 bytes) 2024-09-21T15:09:19.595 INFO:teuthology.orchestra.run.smithi161.stdout:3964 writesame 0x1d20f78 thru 0x1d2e678 data_size 0x7(0xd701 bytes) 2024-09-21T15:09:19.617 INFO:teuthology.orchestra.run.smithi161.stdout:4204 read 0x42d6c66 thru 0x42e59ec (0xed87 bytes) 2024-09-21T15:09:19.618 INFO:teuthology.orchestra.run.smithi161.stdout:4206 writesame 0xba201bf thru 0xba2d6ea data_size 0xe(0xd52c bytes) 2024-09-21T15:09:19.632 INFO:teuthology.orchestra.run.smithi161.stdout:3968 write 0xe747ed thru 0xe7dde7 (0x95fb bytes) 2024-09-21T15:09:19.641 INFO:teuthology.orchestra.run.smithi161.stdout:4207 trunc from 0xe99a96e to 0x9b818d2 2024-09-21T15:09:19.661 INFO:teuthology.orchestra.run.smithi161.stdout:3969 read 0xba3cb80 thru 0xba41ba4 (0x5025 bytes) 2024-09-21T15:09:19.661 INFO:teuthology.orchestra.run.smithi161.stdout:3970 writesame 0x571254 thru 0x579fd8 data_size 0x1(0x8d85 bytes) 2024-09-21T15:09:19.698 INFO:teuthology.orchestra.run.smithi161.stdout:3971 read 0x3f7dd8f thru 0x3f8caf3 (0xed65 bytes) 2024-09-21T15:09:19.699 INFO:teuthology.orchestra.run.smithi161.stdout:3972 punch from 0x5d8c82 to 0x5e5250, (0xc5ce bytes) 2024-09-21T15:09:19.699 INFO:teuthology.orchestra.run.smithi161.stdout:3973 writesame 0x471232e thru 0x4713946 data_size 0x1(0x1619 bytes) 2024-09-21T15:09:19.707 INFO:teuthology.orchestra.run.smithi161.stdout:4209 read 0x8384014 thru 0x8391038 (0xd025 bytes) 2024-09-21T15:09:19.708 INFO:teuthology.orchestra.run.smithi161.stdout:4210 write 0x7160cd7 thru 0x716520e (0x4538 bytes) 2024-09-21T15:09:19.714 INFO:teuthology.orchestra.run.smithi161.stdout:3974 trunc from 0xdc458a3 to 0xdbe8959 2024-09-21T15:09:19.722 INFO:teuthology.orchestra.run.smithi161.stdout:4211 punch from 0x44df168 to 0x44eb42e, (0xc2c6 bytes) 2024-09-21T15:09:19.722 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:19.722 INFO:teuthology.orchestra.run.smithi161.stdout:4213 read 0x3307507 thru 0x3312530 (0xb02a bytes) 2024-09-21T15:09:19.723 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:19.723 INFO:teuthology.orchestra.run.smithi161.stdout:4217 write 0x63ef248 thru 0x63f2f6b (0x3d24 bytes) 2024-09-21T15:09:19.754 INFO:teuthology.orchestra.run.smithi161.stdout:3975 write 0xc8227d8 thru 0xc82790b (0x5134 bytes) 2024-09-21T15:09:19.759 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone20 from 0x32758d6 (overlap 0x208d771) to 0x0 2024-09-21T15:09:19.765 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.4-clone30 2024-09-21T15:09:19.772 INFO:teuthology.orchestra.run.smithi161.stdout:3977 read 0x80251bc thru 0x802748d (0x22d2 bytes) 2024-09-21T15:09:19.772 INFO:teuthology.orchestra.run.smithi161.stdout:3980 punch from 0xa47b9fa to 0xa485462, (0x9a68 bytes) 2024-09-21T15:09:19.772 INFO:teuthology.orchestra.run.smithi161.stdout:3983 read 0x2fc264 thru 0x309fe5 (0xdd82 bytes) 2024-09-21T15:09:19.777 INFO:teuthology.orchestra.run.smithi161.stdout:3985 read 0x5b772ef thru 0x5b77f8a (0xc9c bytes) 2024-09-21T15:09:19.777 INFO:teuthology.orchestra.run.smithi161.stdout:3986 read 0xbf3d8d2 thru 0xbf4a435 (0xcb64 bytes) 2024-09-21T15:09:19.777 INFO:teuthology.orchestra.run.smithi161.stdout:3987 writesame 0xad490f4 thru 0xad4adf2 data_size 0x1(0x1cff bytes) 2024-09-21T15:09:19.792 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone24 from 0x7cd995c (overlap 0x21c0ad2) to 0x17a0793 2024-09-21T15:09:19.792 INFO:teuthology.orchestra.run.smithi161.stdout:4218 write 0xd95eb21 thru 0xd966373 (0x7853 bytes) 2024-09-21T15:09:19.804 INFO:teuthology.orchestra.run.smithi161.stdout:3988 write 0x3825dbb thru 0x383453b (0xe781 bytes) 2024-09-21T15:09:19.810 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone35 from 0xd09e10f (overlap 0x517dcd) to 0x0 2024-09-21T15:09:19.837 INFO:teuthology.orchestra.run.smithi161.stdout:4219 trunc from 0xd966374 to 0x2529516 2024-09-21T15:09:19.853 INFO:teuthology.orchestra.run.smithi161.stdout:3989 clone 27 order 25 su 262144 sc 9 2024-09-21T15:09:19.930 INFO:teuthology.orchestra.run.smithi161.stdout:4220 read 0xa5e567 thru 0xa6b946 (0xd3e0 bytes) 2024-09-21T15:09:19.931 INFO:teuthology.orchestra.run.smithi161.stdout:4221 read 0x1471bc thru 0x14abe7 (0x3a2c bytes) 2024-09-21T15:09:19.943 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #19, image image_cluster1.client.mirror.1-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent20 2024-09-21T15:09:19.959 INFO:teuthology.orchestra.run.smithi161.stdout:4223 write 0x402b397 thru 0x403720e (0xbe78 bytes) 2024-09-21T15:09:20.005 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #29, image image_cluster1.client.mirror.4-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent30 2024-09-21T15:09:20.019 INFO:teuthology.orchestra.run.smithi161.stdout:4224 write 0xd3e6a46 thru 0xd3f3559 (0xcb14 bytes) 2024-09-21T15:09:20.031 INFO:teuthology.orchestra.run.smithi161.stdout:4225 writesame 0x23dac87 thru 0x23dae1c data_size 0x2(0x196 bytes) 2024-09-21T15:09:20.036 INFO:teuthology.orchestra.run.smithi161.stdout:4227 write 0x7777f33 thru 0x777c1fb (0x42c9 bytes) 2024-09-21T15:09:20.068 INFO:teuthology.orchestra.run.smithi161.stdout:4228 trunc from 0xd3f355a to 0x4d0e97d 2024-09-21T15:09:20.073 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #23, image image_cluster1.client.mirror.5-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent24 2024-09-21T15:09:20.094 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #34, image image_cluster1.client.mirror.3-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent35 2024-09-21T15:09:20.118 INFO:teuthology.orchestra.run.smithi161.stdout:4229 read 0x2c7b4ab thru 0x2c7f355 (0x3eab bytes) 2024-09-21T15:09:20.131 INFO:teuthology.orchestra.run.smithi161.stdout:3843 clone 26 order 23 su 1048576 sc 14 2024-09-21T15:09:20.170 INFO:teuthology.orchestra.run.smithi161.stdout:4230 write 0xc6da299 thru 0xc6dc53f (0x22a7 bytes) 2024-09-21T15:09:20.184 INFO:teuthology.orchestra.run.smithi161.stdout:4231 writesame 0x2163013 thru 0x216906e data_size 0x4(0x605c bytes) 2024-09-21T15:09:20.200 INFO:teuthology.orchestra.run.smithi161.stdout:4232 writesame 0x69eda6b thru 0x69eef65 data_size 0x1(0x14fb bytes) 2024-09-21T15:09:20.213 INFO:teuthology.orchestra.run.smithi161.stdout:4233 read 0x743237a thru 0x743f960 (0xd5e7 bytes) 2024-09-21T15:09:20.228 INFO:teuthology.orchestra.run.smithi161.stdout:3064 write 0x20fb0f3 thru 0x2109999 (0xe8a7 bytes) 2024-09-21T15:09:20.232 INFO:teuthology.orchestra.run.smithi161.stdout:4234 trunc from 0xc6dc540 to 0x2d09a37 2024-09-21T15:09:20.277 INFO:teuthology.orchestra.run.smithi161.stdout:3500 punch from 0xb56ae43 to 0xb56bf8c, (0x1149 bytes) 2024-09-21T15:09:20.285 INFO:teuthology.orchestra.run.smithi161.stdout:4236 read 0x1abe9f9 thru 0x1ac2a5e (0x4066 bytes) 2024-09-21T15:09:20.288 INFO:teuthology.orchestra.run.smithi161.stdout:3066 trunc from 0xd09e10f to 0xd32c0b5 2024-09-21T15:09:20.298 INFO:teuthology.orchestra.run.smithi161.stdout:3501 punch from 0xbbd1b9 to 0xbcccb2, (0xfaf9 bytes) 2024-09-21T15:09:20.316 INFO:teuthology.orchestra.run.smithi161.stdout:4237 writesame 0x8d137fb thru 0x8d1a26f data_size 0x1(0x6a75 bytes) 2024-09-21T15:09:20.317 INFO:teuthology.orchestra.run.smithi161.stdout:3068 write 0x385d971 thru 0x38627bb (0x4e4b bytes) 2024-09-21T15:09:20.320 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.320 INFO:teuthology.orchestra.run.smithi161.stdout:4239 writesame 0x22a17b1 thru 0x22a86a2 data_size 0xb(0x6ef2 bytes) 2024-09-21T15:09:20.327 INFO:teuthology.orchestra.run.smithi161.stdout:3505 writesame 0xdec93d4 thru 0xdecab97 data_size 0x3(0x17c4 bytes) 2024-09-21T15:09:20.333 INFO:teuthology.orchestra.run.smithi161.stdout:4241 read 0x49f3545 thru 0x49f6524 (0x2fe0 bytes) 2024-09-21T15:09:20.333 INFO:teuthology.orchestra.run.smithi161.stdout:3069 punch from 0x34a9c14 to 0x34ad8fd, (0x3ce9 bytes) 2024-09-21T15:09:20.334 INFO:teuthology.orchestra.run.smithi161.stdout:3070 punch from 0x968dd27 to 0x96999cb, (0xbca4 bytes) 2024-09-21T15:09:20.334 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.334 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.334 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.334 INFO:teuthology.orchestra.run.smithi161.stdout:3072 read 0xc820273 thru 0xc82d6d6 (0xd464 bytes) 2024-09-21T15:09:20.334 INFO:teuthology.orchestra.run.smithi161.stdout:3074 write 0x2659cc1 thru 0x265e161 (0x44a1 bytes) 2024-09-21T15:09:20.337 INFO:teuthology.orchestra.run.smithi161.stdout:3506 read 0x11e4303 thru 0x11e8267 (0x3f65 bytes) 2024-09-21T15:09:20.338 INFO:teuthology.orchestra.run.smithi161.stdout:3507 writesame 0x21fd685 thru 0x2203b83 data_size 0x1(0x64ff bytes) 2024-09-21T15:09:20.354 INFO:teuthology.orchestra.run.smithi161.stdout:3075 write 0x37534fd thru 0x375b858 (0x835c bytes) 2024-09-21T15:09:20.373 INFO:teuthology.orchestra.run.smithi161.stdout:3508 write 0x9bc5293 thru 0x9bd0e62 (0xbbd0 bytes) 2024-09-21T15:09:20.373 INFO:teuthology.orchestra.run.smithi161.stdout:3076 writesame 0x4465831 thru 0x446ed63 data_size 0x1(0x9533 bytes) 2024-09-21T15:09:20.381 INFO:teuthology.orchestra.run.smithi161.stdout:4244 write 0xcd9a2a8 thru 0xcda3678 (0x93d1 bytes) 2024-09-21T15:09:20.394 INFO:teuthology.orchestra.run.smithi161.stdout:3510 read 0xab46bcb thru 0xab4afd3 (0x4409 bytes) 2024-09-21T15:09:20.395 INFO:teuthology.orchestra.run.smithi161.stdout:3511 punch from 0xce6d8b4 to 0xce71b7a, (0x42c6 bytes) 2024-09-21T15:09:20.396 INFO:teuthology.orchestra.run.smithi161.stdout:3512 read 0xdb930f4 thru 0xdba0a80 (0xd98d bytes) 2024-09-21T15:09:20.396 INFO:teuthology.orchestra.run.smithi161.stdout:3513 write 0xae381d4 thru 0xae3ea4a (0x6877 bytes) 2024-09-21T15:09:20.397 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.397 INFO:teuthology.orchestra.run.smithi161.stdout:4246 punch from 0x303ae88 to 0x303f8fc, (0x4a74 bytes) 2024-09-21T15:09:20.397 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.397 INFO:teuthology.orchestra.run.smithi161.stdout:4250 writesame 0x4fb6e09 thru 0x4fc027a data_size 0x1(0x9472 bytes) 2024-09-21T15:09:20.414 INFO:teuthology.orchestra.run.smithi161.stdout:4058 writesame 0x1856e21 thru 0x1865a69 data_size 0x2f(0xec49 bytes) 2024-09-21T15:09:20.433 INFO:teuthology.orchestra.run.smithi161.stdout:3514 writesame 0xd86595c thru 0xd8666f4 data_size 0x1(0xd99 bytes) 2024-09-21T15:09:20.444 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:4252 read 0x9ef4fc6 thru 0x9ef8b08 (0x3b43 bytes) 2024-09-21T15:09:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:4254 punch from 0x1f2fbd to 0x1f4adb, (0x1b1e bytes) 2024-09-21T15:09:20.445 INFO:teuthology.orchestra.run.smithi161.stdout:4255 write 0xaa70b5d thru 0xaa7ddf2 (0xd296 bytes) 2024-09-21T15:09:20.449 INFO:teuthology.orchestra.run.smithi161.stdout:3515 read 0x8ed591f thru 0x8ee347c (0xdb5e bytes) 2024-09-21T15:09:20.451 INFO:teuthology.orchestra.run.smithi161.stdout:3516 punch from 0x82520fd to 0x82543e6, (0x22e9 bytes) 2024-09-21T15:09:20.451 INFO:teuthology.orchestra.run.smithi161.stdout:3517 punch from 0xaf2e0af to 0xaf351e5, (0x7136 bytes) 2024-09-21T15:09:20.451 INFO:teuthology.orchestra.run.smithi161.stdout:3518 read 0x4e9f3ef thru 0x4ea772d (0x833f bytes) 2024-09-21T15:09:20.452 INFO:teuthology.orchestra.run.smithi161.stdout:3519 read 0x9431881 thru 0x943bd98 (0xa518 bytes) 2024-09-21T15:09:20.453 INFO:teuthology.orchestra.run.smithi161.stdout:3521 writesame 0xb9623be thru 0xb96859c data_size 0x1(0x61df bytes) 2024-09-21T15:09:20.466 INFO:teuthology.orchestra.run.smithi161.stdout:3077 writesame 0xea55e54 thru 0xea602f3 data_size 0x30(0xa4a0 bytes) 2024-09-21T15:09:20.478 INFO:teuthology.orchestra.run.smithi161.stdout:4256 trunc from 0xcda3679 to 0x3955062 2024-09-21T15:09:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:3080 writesame 0xd301610 thru 0xd308076 data_size 0x1(0x6a67 bytes) 2024-09-21T15:09:20.482 INFO:teuthology.orchestra.run.smithi161.stdout:3523 write 0x83d5b35 thru 0x83e23a3 (0xc86f bytes) 2024-09-21T15:09:20.494 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.511 INFO:teuthology.orchestra.run.smithi161.stdout:3524 write 0x855c2c7 thru 0x855ecd0 (0x2a0a bytes) 2024-09-21T15:09:20.515 INFO:teuthology.orchestra.run.smithi161.stdout:3081 write 0xc31ef06 thru 0xc32b448 (0xc543 bytes) 2024-09-21T15:09:20.520 INFO:teuthology.orchestra.run.smithi161.stdout:3525 write 0x8eab0a1 thru 0x8eb64e9 (0xb449 bytes) 2024-09-21T15:09:20.533 INFO:teuthology.orchestra.run.smithi161.stdout:3083 write 0x7eb99ab thru 0x7ebb010 (0x1666 bytes) 2024-09-21T15:09:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:4257 write 0x1659b95 thru 0x16660dc (0xc548 bytes) 2024-09-21T15:09:20.551 INFO:teuthology.orchestra.run.smithi161.stdout:3528 writesame 0x6a941be thru 0x6a9e904 data_size 0x11(0xa747 bytes) 2024-09-21T15:09:20.555 INFO:teuthology.orchestra.run.smithi161.stdout:4061 write 0x627eb36 thru 0x628e8b8 (0xfd83 bytes) 2024-09-21T15:09:20.568 INFO:teuthology.orchestra.run.smithi161.stdout:3529 read 0x59b3edd thru 0x59bfb51 (0xbc75 bytes) 2024-09-21T15:09:20.569 INFO:teuthology.orchestra.run.smithi161.stdout:3530 read 0x6209f8a thru 0x6214a86 (0xaafd bytes) 2024-09-21T15:09:20.570 INFO:teuthology.orchestra.run.smithi161.stdout:3531 read 0x1b37d6a thru 0x1b3e26a (0x6501 bytes) 2024-09-21T15:09:20.571 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:3533 read 0xcb6d72e thru 0xcb71d27 (0x45fa bytes) 2024-09-21T15:09:20.572 INFO:teuthology.orchestra.run.smithi161.stdout:3534 write 0x39ae27c thru 0x39be0f1 (0xfe76 bytes) 2024-09-21T15:09:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:4258 read 0x25faa9f thru 0x25fd669 (0x2bcb bytes) 2024-09-21T15:09:20.574 INFO:teuthology.orchestra.run.smithi161.stdout:4260 read 0x379fe76 thru 0x37a8cb1 (0x8e3c bytes) 2024-09-21T15:09:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:4261 read 0x337637f thru 0x337a760 (0x43e2 bytes) 2024-09-21T15:09:20.575 INFO:teuthology.orchestra.run.smithi161.stdout:4262 read 0x1b27e25 thru 0x1b2c032 (0x420e bytes) 2024-09-21T15:09:20.576 INFO:teuthology.orchestra.run.smithi161.stdout:4264 read 0x22f6796 thru 0x2302ba5 (0xc410 bytes) 2024-09-21T15:09:20.579 INFO:teuthology.orchestra.run.smithi161.stdout:4265 punch from 0x701dd0 to 0x70dedb, (0xc10b bytes) 2024-09-21T15:09:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:4062 trunc from 0x628e8b9 to 0x5b72efa 2024-09-21T15:09:20.602 INFO:teuthology.orchestra.run.smithi161.stdout:3535 trunc from 0xdecab98 to 0x3230557 2024-09-21T15:09:20.603 INFO:teuthology.orchestra.run.smithi161.stdout:3084 write 0xed23562 thru 0xed33053 (0xfaf2 bytes) 2024-09-21T15:09:20.622 INFO:teuthology.orchestra.run.smithi161.stdout:4063 read 0x13d8d7c thru 0x13dff75 (0x71fa bytes) 2024-09-21T15:09:20.623 INFO:teuthology.orchestra.run.smithi161.stdout:4065 read 0x66e60 thru 0x731e4 (0xc385 bytes) 2024-09-21T15:09:20.634 INFO:teuthology.orchestra.run.smithi161.stdout:4266 write 0xeb9225b thru 0xeb97c02 (0x59a8 bytes) 2024-09-21T15:09:20.638 INFO:teuthology.orchestra.run.smithi161.stdout:4066 trunc from 0x5b72efa to 0xc4bebe3 2024-09-21T15:09:20.647 INFO:teuthology.orchestra.run.smithi161.stdout:4267 writesame 0x8c5c6ee thru 0x8c5daa1 data_size 0x1(0x13b4 bytes) 2024-09-21T15:09:20.648 INFO:teuthology.orchestra.run.smithi161.stdout:3085 trunc from 0xed33054 to 0x347925 2024-09-21T15:09:20.662 INFO:teuthology.orchestra.run.smithi161.stdout:3536 punch from 0x12e293f to 0x12f242a, (0xfaeb bytes) 2024-09-21T15:09:20.663 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.663 INFO:teuthology.orchestra.run.smithi161.stdout:4269 read 0x3c20ad6 thru 0x3c2642f (0x595a bytes) 2024-09-21T15:09:20.663 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.663 INFO:teuthology.orchestra.run.smithi161.stdout:4271 write 0x2182dd9 thru 0x21914fd (0xe725 bytes) 2024-09-21T15:09:20.694 INFO:teuthology.orchestra.run.smithi161.stdout:4274 write 0x53337ec thru 0x533f52e (0xbd43 bytes) 2024-09-21T15:09:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:3537 write 0x9c21ffe thru 0x9c2952b (0x752e bytes) 2024-09-21T15:09:20.721 INFO:teuthology.orchestra.run.smithi161.stdout:4067 write 0xd9cbf29 thru 0xd9d3ed9 (0x7fb1 bytes) 2024-09-21T15:09:20.729 INFO:teuthology.orchestra.run.smithi161.stdout:4276 read 0x799f98a thru 0x79ade5f (0xe4d6 bytes) 2024-09-21T15:09:20.730 INFO:teuthology.orchestra.run.smithi161.stdout:4277 write 0xb05d1d9 thru 0xb05dab9 (0x8e1 bytes) 2024-09-21T15:09:20.737 INFO:teuthology.orchestra.run.smithi161.stdout:3538 read 0x1d509e2 thru 0x1d5b883 (0xaea2 bytes) 2024-09-21T15:09:20.738 INFO:teuthology.orchestra.run.smithi161.stdout:3540 write 0x6fd2bda thru 0x6fe1ba3 (0xefca bytes) 2024-09-21T15:09:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:4068 write 0x2f49222 thru 0x2f52ab4 (0x9893 bytes) 2024-09-21T15:09:20.753 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.753 INFO:teuthology.orchestra.run.smithi161.stdout:4281 write 0x1ebbb7e thru 0x1ec9bb7 (0xe03a bytes) 2024-09-21T15:09:20.753 INFO:teuthology.orchestra.run.smithi161.stdout:3541 punch from 0x600eef3 to 0x60143f8, (0x5505 bytes) 2024-09-21T15:09:20.753 INFO:teuthology.orchestra.run.smithi161.stdout:3542 read 0x7f61248 thru 0x7f67773 (0x652c bytes) 2024-09-21T15:09:20.756 INFO:teuthology.orchestra.run.smithi161.stdout:3543 writesame 0x9bf4980 thru 0x9bf8238 data_size 0x1(0x38b9 bytes) 2024-09-21T15:09:20.767 INFO:teuthology.orchestra.run.smithi161.stdout:3086 punch from 0x232697 to 0x2364e6, (0x3e4f bytes) 2024-09-21T15:09:20.779 INFO:teuthology.orchestra.run.smithi161.stdout:3544 trunc from 0x9c2952c to 0xa922045 2024-09-21T15:09:20.782 INFO:teuthology.orchestra.run.smithi161.stdout:4282 read 0x14706f3 thru 0x147b5b1 (0xaebf bytes) 2024-09-21T15:09:20.783 INFO:teuthology.orchestra.run.smithi161.stdout:4283 read 0xafb12c7 thru 0xafb6db3 (0x5aed bytes) 2024-09-21T15:09:20.783 INFO:teuthology.orchestra.run.smithi161.stdout:4284 writesame 0x9e92d6f thru 0x9ea1f2c data_size 0x61(0xf1be bytes) 2024-09-21T15:09:20.785 INFO:teuthology.orchestra.run.smithi161.stdout:4069 read 0xcdc980c thru 0xcdccc17 (0x340c bytes) 2024-09-21T15:09:20.794 INFO:teuthology.orchestra.run.smithi161.stdout:4070 trunc from 0xd9d3eda to 0xa241717 2024-09-21T15:09:20.798 INFO:teuthology.orchestra.run.smithi161.stdout:4286 write 0xb9b21e0 thru 0xb9bdd31 (0xbb52 bytes) 2024-09-21T15:09:20.801 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone26 from 0xdbe8959 (overlap 0x67b401b) to 0x297b33e 2024-09-21T15:09:20.812 INFO:teuthology.orchestra.run.smithi161.stdout:3087 write 0x35547d4 thru 0x3563000 (0xe82d bytes) 2024-09-21T15:09:20.829 INFO:teuthology.orchestra.run.smithi161.stdout:4287 read 0x59b5957 thru 0x59bdf7b (0x8625 bytes) 2024-09-21T15:09:20.850 INFO:teuthology.orchestra.run.smithi161.stdout:3089 trunc from 0x3563001 to 0xa03ce0b 2024-09-21T15:09:20.851 INFO:teuthology.orchestra.run.smithi161.stdout:3545 trunc from 0xa922045 to 0x23ed33b 2024-09-21T15:09:20.887 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone25 from 0x7cd995c (overlap 0x7cd995c) to 0x0 2024-09-21T15:09:20.887 INFO:teuthology.orchestra.run.smithi161.stdout:4071 write 0x7c904ae thru 0x7c987be (0x8311 bytes) 2024-09-21T15:09:20.900 INFO:teuthology.orchestra.run.smithi161.stdout:4289 writesame 0xee50783 thru 0xee576f8 data_size 0xb(0x6f76 bytes) 2024-09-21T15:09:20.912 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:20.912 INFO:teuthology.orchestra.run.smithi161.stdout:4291 punch from 0xb46b46b to 0xb474cad, (0x9842 bytes) 2024-09-21T15:09:20.912 INFO:teuthology.orchestra.run.smithi161.stdout:4294 punch from 0x44b3c60 to 0x44b5bbb, (0x1f5b bytes) 2024-09-21T15:09:20.912 INFO:teuthology.orchestra.run.smithi161.stdout:4296 punch from 0xe873d40 to 0xe87985d, (0x5b1d bytes) 2024-09-21T15:09:20.912 INFO:teuthology.orchestra.run.smithi161.stdout:4298 punch from 0x76c4e9d to 0x76d0b6d, (0xbcd0 bytes) 2024-09-21T15:09:20.912 INFO:teuthology.orchestra.run.smithi161.stdout:4299 punch from 0xaaecb99 to 0xaaf802a, (0xb491 bytes) 2024-09-21T15:09:20.913 INFO:teuthology.orchestra.run.smithi161.stdout:4300 write 0x285bfc6 thru 0x285ca4c (0xa87 bytes) 2024-09-21T15:09:20.925 INFO:teuthology.orchestra.run.smithi161.stdout:4303 read 0x528a263 thru 0x5299338 (0xf0d6 bytes) 2024-09-21T15:09:20.926 INFO:teuthology.orchestra.run.smithi161.stdout:4304 write 0xb5c7104 thru 0xb5cd19a (0x6097 bytes) 2024-09-21T15:09:20.946 INFO:teuthology.orchestra.run.smithi161.stdout:4073 read 0x5f093af thru 0x5f16f8a (0xdbdc bytes) 2024-09-21T15:09:20.993 INFO:teuthology.orchestra.run.smithi161.stdout:4305 trunc from 0xee576f9 to 0x51c87ab 2024-09-21T15:09:21.007 INFO:teuthology.orchestra.run.smithi161.stdout:3546 writesame 0xc44995e thru 0xc452f28 data_size 0x1(0x95cb bytes) 2024-09-21T15:09:21.015 INFO:teuthology.orchestra.run.smithi161.stdout:3547 writesame 0x8e66ec6 thru 0x8e76609 data_size 0x4b(0xf744 bytes) 2024-09-21T15:09:21.027 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.027 INFO:teuthology.orchestra.run.smithi161.stdout:4075 punch from 0x6773f34 to 0x677af4b, (0x7017 bytes) 2024-09-21T15:09:21.076 INFO:teuthology.orchestra.run.smithi161.stdout:3548 write 0x7717790 thru 0x7720346 (0x8bb7 bytes) 2024-09-21T15:09:21.082 INFO:teuthology.orchestra.run.smithi161.stdout:3090 trunc from 0xa03ce0b to 0xa149668 2024-09-21T15:09:21.102 INFO:teuthology.orchestra.run.smithi161.stdout:4076 writesame 0xa8adda7 thru 0xa8b1712 data_size 0x2(0x396c bytes) 2024-09-21T15:09:21.104 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.104 INFO:teuthology.orchestra.run.smithi161.stdout:4310 read 0x64aea8 thru 0x65131b (0x6474 bytes) 2024-09-21T15:09:21.106 INFO:teuthology.orchestra.run.smithi161.stdout:4077 read 0x527bfa thru 0x527d95 (0x19c bytes) 2024-09-21T15:09:21.106 INFO:teuthology.orchestra.run.smithi161.stdout:4311 write 0x4844f85 thru 0x4854697 (0xf713 bytes) 2024-09-21T15:09:21.106 INFO:teuthology.orchestra.run.smithi161.stdout:4078 write 0x949c4fe thru 0x94a2596 (0x6099 bytes) 2024-09-21T15:09:21.109 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.109 INFO:teuthology.orchestra.run.smithi161.stdout:3093 read 0x22ccb05 thru 0x22d8afe (0xbffa bytes) 2024-09-21T15:09:21.112 INFO:teuthology.orchestra.run.smithi161.stdout:3549 trunc from 0xc452f29 to 0x2723a6f 2024-09-21T15:09:21.120 INFO:teuthology.orchestra.run.smithi161.stdout:3094 trunc from 0xa149668 to 0x3c9dec3 2024-09-21T15:09:21.124 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #25, image image_cluster1.client.mirror.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent26 2024-09-21T15:09:21.160 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.170 INFO:teuthology.orchestra.run.smithi161.stdout:4079 writesame 0xc22968d thru 0xc237d9e data_size 0x3(0xe712 bytes) 2024-09-21T15:09:21.174 INFO:teuthology.orchestra.run.smithi161.stdout:4080 writesame 0x7cd0829 thru 0x7cdcaae data_size 0x2(0xc286 bytes) 2024-09-21T15:09:21.174 INFO:teuthology.orchestra.run.smithi161.stdout:3551 trunc from 0x2723a6f to 0x8eb21ef 2024-09-21T15:09:21.213 INFO:teuthology.orchestra.run.smithi161.stdout:3552 writesame 0x44bc0db thru 0x44c0d7d data_size 0x1(0x4ca3 bytes) 2024-09-21T15:09:21.225 INFO:teuthology.orchestra.run.smithi161.stdout:4081 trunc from 0xc237d9f to 0x65a802c 2024-09-21T15:09:21.233 INFO:teuthology.orchestra.run.smithi161.stdout:3095 write 0xe372308 thru 0xe37e7da (0xc4d3 bytes) 2024-09-21T15:09:21.238 INFO:teuthology.orchestra.run.smithi161.stdout:3554 write 0x1707aba thru 0x17109b9 (0x8f00 bytes) 2024-09-21T15:09:21.246 INFO:teuthology.orchestra.run.smithi161.stdout:3096 write 0x9185d9a thru 0x919438a (0xe5f1 bytes) 2024-09-21T15:09:21.249 INFO:teuthology.orchestra.run.smithi161.stdout:3556 read 0x66cf5a9 thru 0x66d418e (0x4be6 bytes) 2024-09-21T15:09:21.277 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.277 INFO:teuthology.orchestra.run.smithi161.stdout:4084 read 0x3ba36e1 thru 0x3ba3fa1 (0x8c1 bytes) 2024-09-21T15:09:21.277 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.277 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.284 INFO:teuthology.orchestra.run.smithi161.stdout:3557 writesame 0xb603d5c thru 0xb6126fa data_size 0x1(0xe99f bytes) 2024-09-21T15:09:21.284 INFO:teuthology.orchestra.run.smithi161.stdout:3098 trunc from 0xe37e7db to 0xfade7c 2024-09-21T15:09:21.287 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.287 INFO:teuthology.orchestra.run.smithi161.stdout:3560 read 0x41e0e2f thru 0x41e399d (0x2b6f bytes) 2024-09-21T15:09:21.288 INFO:teuthology.orchestra.run.smithi161.stdout:3561 write 0x3d2a204 thru 0x3d38231 (0xe02e bytes) 2024-09-21T15:09:21.319 INFO:teuthology.orchestra.run.smithi161.stdout:4089 write 0xa2e9e04 thru 0xa2f533d (0xb53a bytes) 2024-09-21T15:09:21.339 INFO:teuthology.orchestra.run.smithi161.stdout:4090 punch from 0x27d9e8d to 0x27e5e78, (0xbfeb bytes) 2024-09-21T15:09:21.339 INFO:teuthology.orchestra.run.smithi161.stdout:4092 punch from 0x6ffa0fb to 0x6ffb1c7, (0x10cc bytes) 2024-09-21T15:09:21.339 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.343 INFO:teuthology.orchestra.run.smithi161.stdout:4094 trunc from 0xa2f533e to 0xc02f07a 2024-09-21T15:09:21.344 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #24, image image_cluster1.client.mirror.5-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent25 2024-09-21T15:09:21.348 INFO:teuthology.orchestra.run.smithi161.stdout:3564 write 0xcf34969 thru 0xcf4432e (0xf9c6 bytes) 2024-09-21T15:09:21.375 INFO:teuthology.orchestra.run.smithi161.stdout:3565 write 0x2690b67 thru 0x2698e92 (0x832c bytes) 2024-09-21T15:09:21.390 INFO:teuthology.orchestra.run.smithi161.stdout:3566 punch from 0xe41172 to 0xe4157f, (0x40d bytes) 2024-09-21T15:09:21.390 INFO:teuthology.orchestra.run.smithi161.stdout:3567 write 0x9e7a5f0 thru 0x9e843d0 (0x9de1 bytes) 2024-09-21T15:09:21.391 INFO:teuthology.orchestra.run.smithi161.stdout:4095 punch from 0x5b83216 to 0x5b90139, (0xcf23 bytes) 2024-09-21T15:09:21.391 INFO:teuthology.orchestra.run.smithi161.stdout:4096 read 0x411afc7 thru 0x41248b4 (0x98ee bytes) 2024-09-21T15:09:21.391 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.391 INFO:teuthology.orchestra.run.smithi161.stdout:4099 read 0x1648793 thru 0x1650be4 (0x8452 bytes) 2024-09-21T15:09:21.394 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.394 INFO:teuthology.orchestra.run.smithi161.stdout:4103 punch from 0x920c2c7 to 0x920c791, (0x4ca bytes) 2024-09-21T15:09:21.394 INFO:teuthology.orchestra.run.smithi161.stdout:4104 read 0x156a741 thru 0x156fdd6 (0x5696 bytes) 2024-09-21T15:09:21.395 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.395 INFO:teuthology.orchestra.run.smithi161.stdout:4107 writesame 0x88ca2dd thru 0x88caf30 data_size 0x6(0xc54 bytes) 2024-09-21T15:09:21.397 INFO:teuthology.orchestra.run.smithi161.stdout:3100 write 0x5dbfc09 thru 0x5dc9748 (0x9b40 bytes) 2024-09-21T15:09:21.400 INFO:teuthology.orchestra.run.smithi161.stdout:3991 flatten 2024-09-21T15:09:21.405 INFO:teuthology.orchestra.run.smithi161.stdout:3568 write 0xa70ad08 thru 0xa7186c7 (0xd9c0 bytes) 2024-09-21T15:09:21.415 INFO:teuthology.orchestra.run.smithi161.stdout:4108 clone 22 order 23 su 65536 sc 4 2024-09-21T15:09:21.420 INFO:teuthology.orchestra.run.smithi161.stdout:3570 read 0x6d87343 thru 0x6d938b7 (0xc575 bytes) 2024-09-21T15:09:21.421 INFO:teuthology.orchestra.run.smithi161.stdout:3572 write 0x3a44c83 thru 0x3a4faf5 (0xae73 bytes) 2024-09-21T15:09:21.422 INFO:teuthology.orchestra.run.smithi161.stdout:3101 read 0x909535 thru 0x912bae (0x967a bytes) 2024-09-21T15:09:21.430 INFO:teuthology.orchestra.run.smithi161.stdout:3102 trunc from 0x5dc9749 to 0xa6e180c 2024-09-21T15:09:21.454 INFO:teuthology.orchestra.run.smithi161.stdout:3576 trunc from 0xcf4432f to 0x75a04f 2024-09-21T15:09:21.469 INFO:teuthology.orchestra.run.smithi161.stdout:3845 trunc from 0x7cd995c to 0x536fc6d 2024-09-21T15:09:21.488 INFO:teuthology.orchestra.run.smithi161.stdout:3103 read 0x9ae4ae1 thru 0x9aec504 (0x7a24 bytes) 2024-09-21T15:09:21.488 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.488 INFO:teuthology.orchestra.run.smithi161.stdout:3105 read 0x5bc91d thru 0x5c5243 (0x8927 bytes) 2024-09-21T15:09:21.490 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.490 INFO:teuthology.orchestra.run.smithi161.stdout:3108 writesame 0x72c0b9b thru 0x72c22d0 data_size 0x1(0x1736 bytes) 2024-09-21T15:09:21.646 INFO:teuthology.orchestra.run.smithi161.stdout:3109 writesame 0xb25d8e5 thru 0xb2699a3 data_size 0x35(0xc0bf bytes) 2024-09-21T15:09:21.658 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.658 INFO:teuthology.orchestra.run.smithi161.stdout:3113 read 0x4f01c9 thru 0x4f2df0 (0x2c28 bytes) 2024-09-21T15:09:21.659 INFO:teuthology.orchestra.run.smithi161.stdout:3114 write 0xc3b56a thru 0xc491c1 (0xdc58 bytes) 2024-09-21T15:09:21.670 INFO:teuthology.orchestra.run.smithi161.stdout:3992 writesame 0x41a6b3 thru 0x423cc3 data_size 0x1(0x9611 bytes) 2024-09-21T15:09:21.678 INFO:teuthology.orchestra.run.smithi161.stdout:3117 write 0xa574783 thru 0xa57e111 (0x998f bytes) 2024-09-21T15:09:21.682 INFO:teuthology.orchestra.run.smithi161.stdout:4312 read 0x4dfe6c8 thru 0x4e0284d (0x4186 bytes) 2024-09-21T15:09:21.682 INFO:teuthology.orchestra.run.smithi161.stdout:4313 read 0x27dc39f thru 0x27e0cfb (0x495d bytes) 2024-09-21T15:09:21.683 INFO:teuthology.orchestra.run.smithi161.stdout:4314 punch from 0x1ac6dc5 to 0x1ad4f9c, (0xe1d7 bytes) 2024-09-21T15:09:21.683 INFO:teuthology.orchestra.run.smithi161.stdout:4315 read 0xc72b8e thru 0xc7becb (0x933e bytes) 2024-09-21T15:09:21.700 INFO:teuthology.orchestra.run.smithi161.stdout:3118 writesame 0x56346dc thru 0x5640ba5 data_size 0x1(0xc4ca bytes) 2024-09-21T15:09:21.708 INFO:teuthology.orchestra.run.smithi161.stdout:3993 write 0xd075ff4 thru 0xd079902 (0x390f bytes) 2024-09-21T15:09:21.709 INFO:teuthology.orchestra.run.smithi161.stdout:4316 writesame 0x386cf08 thru 0x3875ad4 data_size 0x1(0x8bcd bytes) 2024-09-21T15:09:21.719 INFO:teuthology.orchestra.run.smithi161.stdout:3995 read 0x83ae9dc thru 0x83ba96d (0xbf92 bytes) 2024-09-21T15:09:21.723 INFO:teuthology.orchestra.run.smithi161.stdout:3577 write 0x73d3091 thru 0x73d8f11 (0x5e81 bytes) 2024-09-21T15:09:21.730 INFO:teuthology.orchestra.run.smithi161.stdout:3579 read 0x66fa8e8 thru 0x670693f (0xc058 bytes) 2024-09-21T15:09:21.731 INFO:teuthology.orchestra.run.smithi161.stdout:3580 read 0x5502a4 thru 0x5525f9 (0x2356 bytes) 2024-09-21T15:09:21.732 INFO:teuthology.orchestra.run.smithi161.stdout:3581 punch from 0x5cec0ee to 0x5cf4591, (0x84a3 bytes) 2024-09-21T15:09:21.732 INFO:teuthology.orchestra.run.smithi161.stdout:3583 writesame 0x2f2e557 thru 0x2f33917 data_size 0x7(0x53c1 bytes) 2024-09-21T15:09:21.745 INFO:teuthology.orchestra.run.smithi161.stdout:3996 trunc from 0xdbe8959 to 0x5fd27e 2024-09-21T15:09:21.746 INFO:teuthology.orchestra.run.smithi161.stdout:3846 punch from 0x3c739f3 to 0x3c7d5fa, (0x9c07 bytes) 2024-09-21T15:09:21.746 INFO:teuthology.orchestra.run.smithi161.stdout:4317 read 0x3a01233 thru 0x3a103c5 (0xf193 bytes) 2024-09-21T15:09:21.746 INFO:teuthology.orchestra.run.smithi161.stdout:4318 write 0x1aa0b01 thru 0x1aa8cfb (0x81fb bytes) 2024-09-21T15:09:21.749 INFO:teuthology.orchestra.run.smithi161.stdout:3584 read 0x5080d35 thru 0x508b10b (0xa3d7 bytes) 2024-09-21T15:09:21.750 INFO:teuthology.orchestra.run.smithi161.stdout:3585 read 0x6816fc5 thru 0x681d8b0 (0x68ec bytes) 2024-09-21T15:09:21.751 INFO:teuthology.orchestra.run.smithi161.stdout:3119 write 0x60f687c thru 0x60ffe96 (0x961b bytes) 2024-09-21T15:09:21.809 INFO:teuthology.orchestra.run.smithi161.stdout:3847 write 0xba822b5 thru 0xba8be3e (0x9b8a bytes) 2024-09-21T15:09:21.824 INFO:teuthology.orchestra.run.smithi161.stdout:3586 writesame 0xa063ac9 thru 0xa072127 data_size 0x23(0xe65f bytes) 2024-09-21T15:09:21.844 INFO:teuthology.orchestra.run.smithi161.stdout:4319 write 0x5fa2f1c thru 0x5facea1 (0x9f86 bytes) 2024-09-21T15:09:21.846 INFO:teuthology.orchestra.run.smithi161.stdout:3850 write 0x1d8713c thru 0x1d8f789 (0x864e bytes) 2024-09-21T15:09:21.846 INFO:teuthology.orchestra.run.smithi161.stdout:3120 write 0xce0b6f0 thru 0xce16f2c (0xb83d bytes) 2024-09-21T15:09:21.863 INFO:teuthology.orchestra.run.smithi161.stdout:3852 writesame 0x840f37a thru 0x8413cb7 data_size 0x4b(0x493e bytes) 2024-09-21T15:09:21.865 INFO:teuthology.orchestra.run.smithi161.stdout:4320 punch from 0x30fb1c0 to 0x30fd7c9, (0x2609 bytes) 2024-09-21T15:09:21.865 INFO:teuthology.orchestra.run.smithi161.stdout:4321 write 0x302c40b thru 0x3036b93 (0xa789 bytes) 2024-09-21T15:09:21.871 INFO:teuthology.orchestra.run.smithi161.stdout:3121 write 0x7e58455 thru 0x7e5d3a3 (0x4f4f bytes) 2024-09-21T15:09:21.877 INFO:teuthology.orchestra.run.smithi161.stdout:4000 write 0x74b5713 thru 0x74be1c4 (0x8ab2 bytes) 2024-09-21T15:09:21.881 INFO:teuthology.orchestra.run.smithi161.stdout:3587 write 0xadfc41f thru 0xadfe36f (0x1f51 bytes) 2024-09-21T15:09:21.882 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.882 INFO:teuthology.orchestra.run.smithi161.stdout:3859 write 0x7383936 thru 0x73879ef (0x40ba bytes) 2024-09-21T15:09:21.887 INFO:teuthology.orchestra.run.smithi161.stdout:4322 read 0x58a0870 thru 0x58b050e (0xfc9f bytes) 2024-09-21T15:09:21.887 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:21.887 INFO:teuthology.orchestra.run.smithi161.stdout:4324 writesame 0x4992ebc thru 0x4994502 data_size 0x1(0x1647 bytes) 2024-09-21T15:09:21.899 INFO:teuthology.orchestra.run.smithi161.stdout:4001 read 0x121bf38 thru 0x1224fa1 (0x906a bytes) 2024-09-21T15:09:21.913 INFO:teuthology.orchestra.run.smithi161.stdout:3860 read 0x810479b thru 0x810f97a (0xb1e0 bytes) 2024-09-21T15:09:21.914 INFO:teuthology.orchestra.run.smithi161.stdout:3861 read 0x3ad9fac thru 0x3ae50b6 (0xb10b bytes) 2024-09-21T15:09:21.915 INFO:teuthology.orchestra.run.smithi161.stdout:3588 trunc from 0xadfe370 to 0xcb2b353 2024-09-21T15:09:21.920 INFO:teuthology.orchestra.run.smithi161.stdout:3862 read 0x7c4c84 thru 0x7d4ade (0xfe5b bytes) 2024-09-21T15:09:21.921 INFO:teuthology.orchestra.run.smithi161.stdout:3863 write 0x40ee19 thru 0x410347 (0x152f bytes) 2024-09-21T15:09:21.928 INFO:teuthology.orchestra.run.smithi161.stdout:4325 trunc from 0x5facea2 to 0x2cb0231 2024-09-21T15:09:21.943 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone21 from 0xc02f07a (overlap 0x32758d6) to 0x2352495 2024-09-21T15:09:21.945 INFO:teuthology.orchestra.run.smithi161.stdout:3864 punch from 0x58943a2 to 0x589632f, (0x1f8d bytes) 2024-09-21T15:09:21.957 INFO:teuthology.orchestra.run.smithi161.stdout:3866 trunc from 0xba8be3f to 0x728d6ab 2024-09-21T15:09:21.963 INFO:teuthology.orchestra.run.smithi161.stdout:3122 write 0xd963358 thru 0xd96582d (0x24d6 bytes) 2024-09-21T15:09:21.971 INFO:teuthology.orchestra.run.smithi161.stdout:3589 punch from 0x6bbc41e to 0x6bc5064, (0x8c46 bytes) 2024-09-21T15:09:21.971 INFO:teuthology.orchestra.run.smithi161.stdout:3590 write 0x7b5d530 thru 0x7b62738 (0x5209 bytes) 2024-09-21T15:09:21.972 INFO:teuthology.orchestra.run.smithi161.stdout:4002 write 0x935fb92 thru 0x936dcb7 (0xe126 bytes) 2024-09-21T15:09:22.004 INFO:teuthology.orchestra.run.smithi161.stdout:3594 read 0x177be2d thru 0x1780a76 (0x4c4a bytes) 2024-09-21T15:09:22.014 INFO:teuthology.orchestra.run.smithi161.stdout:3595 write 0x785e43b thru 0x786c2c1 (0xde87 bytes) 2024-09-21T15:09:22.015 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.015 INFO:teuthology.orchestra.run.smithi161.stdout:3126 write 0x1e3700a thru 0x1e3a0d1 (0x30c8 bytes) 2024-09-21T15:09:22.032 INFO:teuthology.orchestra.run.smithi161.stdout:3127 write 0x80a146c thru 0x80a362f (0x21c4 bytes) 2024-09-21T15:09:22.039 INFO:teuthology.orchestra.run.smithi161.stdout:3596 read 0xae37436 thru 0xae44273 (0xce3e bytes) 2024-09-21T15:09:22.040 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.040 INFO:teuthology.orchestra.run.smithi161.stdout:3598 read 0x38322ce thru 0x383299e (0x6d1 bytes) 2024-09-21T15:09:22.041 INFO:teuthology.orchestra.run.smithi161.stdout:3600 write 0x56a0ebb thru 0x56a76d0 (0x6816 bytes) 2024-09-21T15:09:22.058 INFO:teuthology.orchestra.run.smithi161.stdout:3601 write 0x696975f thru 0x6974e39 (0xb6db bytes) 2024-09-21T15:09:22.087 INFO:teuthology.orchestra.run.smithi161.stdout:3128 read 0xb9038aa thru 0xb9078b2 (0x4009 bytes) 2024-09-21T15:09:22.087 INFO:teuthology.orchestra.run.smithi161.stdout:3129 write 0x6c226f8 thru 0x6c2a8b9 (0x81c2 bytes) 2024-09-21T15:09:22.091 INFO:teuthology.orchestra.run.smithi161.stdout:3867 write 0x18dfc85 thru 0x18e5f2e (0x62aa bytes) 2024-09-21T15:09:22.095 INFO:teuthology.orchestra.run.smithi161.stdout:3604 trunc from 0xcb2b353 to 0x54dd252 2024-09-21T15:09:22.100 INFO:teuthology.orchestra.run.smithi161.stdout:4003 writesame 0xbc92100 thru 0xbca1504 data_size 0x21(0xf405 bytes) 2024-09-21T15:09:22.100 INFO:teuthology.orchestra.run.smithi161.stdout:3130 read 0x5a53601 thru 0x5a5cff6 (0x99f6 bytes) 2024-09-21T15:09:22.100 INFO:teuthology.orchestra.run.smithi161.stdout:3131 read 0x807368e thru 0x807f1fb (0xbb6e bytes) 2024-09-21T15:09:22.100 INFO:teuthology.orchestra.run.smithi161.stdout:3132 write 0x4da98d thru 0x4e016c (0x57e0 bytes) 2024-09-21T15:09:22.108 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.111 INFO:teuthology.orchestra.run.smithi161.stdout:3133 punch from 0x544c6a5 to 0x5454fd1, (0x892c bytes) 2024-09-21T15:09:22.111 INFO:teuthology.orchestra.run.smithi161.stdout:3135 read 0xe76535 thru 0xe8397a (0xd446 bytes) 2024-09-21T15:09:22.111 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.116 INFO:teuthology.orchestra.run.smithi161.stdout:4006 trunc from 0xbca1505 to 0x7e5af48 2024-09-21T15:09:22.123 INFO:teuthology.orchestra.run.smithi161.stdout:3139 trunc from 0xd96582e to 0x76110c3 2024-09-21T15:09:22.127 INFO:teuthology.orchestra.run.smithi161.stdout:4326 write 0x87834fb thru 0x878c4a7 (0x8fad bytes) 2024-09-21T15:09:22.148 INFO:teuthology.orchestra.run.smithi161.stdout:3606 read 0xc4c531 thru 0xc53bcf (0x769f bytes) 2024-09-21T15:09:22.151 INFO:teuthology.orchestra.run.smithi161.stdout:4331 read 0x735841a thru 0x735a258 (0x1e3f bytes) 2024-09-21T15:09:22.164 INFO:teuthology.orchestra.run.smithi161.stdout:3868 write 0xd9230a9 thru 0xd92e842 (0xb79a bytes) 2024-09-21T15:09:22.173 INFO:teuthology.orchestra.run.smithi161.stdout:4007 punch from 0x422ebb4 to 0x423af3d, (0xc389 bytes) 2024-09-21T15:09:22.173 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.173 INFO:teuthology.orchestra.run.smithi161.stdout:4009 read 0x13e9899 thru 0x13ebab2 (0x221a bytes) 2024-09-21T15:09:22.183 INFO:teuthology.orchestra.run.smithi161.stdout:4010 trunc from 0x7e5af48 to 0xdebafeb 2024-09-21T15:09:22.190 INFO:teuthology.orchestra.run.smithi161.stdout:3869 read 0x70e72e0 thru 0x70eeb5c (0x787d bytes) 2024-09-21T15:09:22.190 INFO:teuthology.orchestra.run.smithi161.stdout:3876 punch from 0x616fa7d to 0x617d05e, (0xd5e1 bytes) 2024-09-21T15:09:22.194 INFO:teuthology.orchestra.run.smithi161.stdout:3607 writesame 0xa29d01a thru 0xa29d542 data_size 0x1(0x529 bytes) 2024-09-21T15:09:22.197 INFO:teuthology.orchestra.run.smithi161.stdout:4332 writesame 0xe6fc346 thru 0xe7005d1 data_size 0x2(0x428c bytes) 2024-09-21T15:09:22.199 INFO:teuthology.orchestra.run.smithi161.stdout:3608 read 0x2d58370 thru 0x2d65349 (0xcfda bytes) 2024-09-21T15:09:22.201 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.201 INFO:teuthology.orchestra.run.smithi161.stdout:4334 write 0x9b2a29e thru 0x9b357b0 (0xb513 bytes) 2024-09-21T15:09:22.212 INFO:teuthology.orchestra.run.smithi161.stdout:4335 punch from 0x9f14e58 to 0x9f1831a, (0x34c2 bytes) 2024-09-21T15:09:22.212 INFO:teuthology.orchestra.run.smithi161.stdout:4336 read 0x2a2a38d thru 0x2a2c12c (0x1da0 bytes) 2024-09-21T15:09:22.212 INFO:teuthology.orchestra.run.smithi161.stdout:4011 write 0x30b7181 thru 0x30c3ed7 (0xcd57 bytes) 2024-09-21T15:09:22.217 INFO:teuthology.orchestra.run.smithi161.stdout:4337 trunc from 0xe7005d2 to 0xd05a1f1 2024-09-21T15:09:22.220 INFO:teuthology.orchestra.run.smithi161.stdout:3140 trunc from 0x76110c3 to 0xeac7d88 2024-09-21T15:09:22.223 INFO:teuthology.orchestra.run.smithi161.stdout:3879 trunc from 0xd92e843 to 0x2a91136 2024-09-21T15:09:22.223 INFO:teuthology.orchestra.run.smithi161.stdout:4012 read 0x7d9b79f thru 0x7da030d (0x4b6f bytes) 2024-09-21T15:09:22.224 INFO:teuthology.orchestra.run.smithi161.stdout:4015 writesame 0x54c2285 thru 0x54caf5d data_size 0x65(0x8cd9 bytes) 2024-09-21T15:09:22.225 INFO:teuthology.orchestra.run.smithi161.stdout:3609 trunc from 0xa29d543 to 0x24f6954 2024-09-21T15:09:22.236 INFO:teuthology.orchestra.run.smithi161.stdout:4016 write 0x1f67194 thru 0x1f6c550 (0x53bd bytes) 2024-09-21T15:09:22.242 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #20, image image_cluster1.client.mirror.1-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent21 2024-09-21T15:09:22.261 INFO:teuthology.orchestra.run.smithi161.stdout:3141 read 0x3cc8742 thru 0x3ccc4a5 (0x3d64 bytes) 2024-09-21T15:09:22.261 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.262 INFO:teuthology.orchestra.run.smithi161.stdout:3145 write 0xc657323 thru 0xc65e270 (0x6f4e bytes) 2024-09-21T15:09:22.265 INFO:teuthology.orchestra.run.smithi161.stdout:4338 writesame 0xd0461ee thru 0xd052477 data_size 0x25(0xc28a bytes) 2024-09-21T15:09:22.271 INFO:teuthology.orchestra.run.smithi161.stdout:4017 trunc from 0xdebafeb to 0x36f55d3 2024-09-21T15:09:22.294 INFO:teuthology.orchestra.run.smithi161.stdout:3146 read 0x8d67dea thru 0x8d6805e (0x275 bytes) 2024-09-21T15:09:22.294 INFO:teuthology.orchestra.run.smithi161.stdout:4341 write 0xb537337 thru 0xb53a9c3 (0x368d bytes) 2024-09-21T15:09:22.294 INFO:teuthology.orchestra.run.smithi161.stdout:3147 write 0x2a249fd thru 0x2a34152 (0xf756 bytes) 2024-09-21T15:09:22.313 INFO:teuthology.orchestra.run.smithi161.stdout:3610 trunc from 0x24f6954 to 0xa87030c 2024-09-21T15:09:22.314 INFO:teuthology.orchestra.run.smithi161.stdout:4109 write 0x3ecb40c thru 0x3eda756 (0xf34b bytes) 2024-09-21T15:09:22.316 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.316 INFO:teuthology.orchestra.run.smithi161.stdout:3149 read 0xd18edb1 thru 0xd1993e3 (0xa633 bytes) 2024-09-21T15:09:22.317 INFO:teuthology.orchestra.run.smithi161.stdout:4342 punch from 0x894579b to 0x8948174, (0x29d9 bytes) 2024-09-21T15:09:22.317 INFO:teuthology.orchestra.run.smithi161.stdout:3150 flatten 2024-09-21T15:09:22.318 INFO:teuthology.orchestra.run.smithi161.stdout:4343 read 0x5a5b5ed thru 0x5a5faa9 (0x44bd bytes) 2024-09-21T15:09:22.318 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.318 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.320 INFO:teuthology.orchestra.run.smithi161.stdout:3880 read 0x18eb9f3 thru 0x18f3a03 (0x8011 bytes) 2024-09-21T15:09:22.321 INFO:teuthology.orchestra.run.smithi161.stdout:3881 clone 27 order 20 su 65536 sc 5 2024-09-21T15:09:22.338 INFO:teuthology.orchestra.run.smithi161.stdout:4346 trunc from 0xd05a1f1 to 0x16faf31 2024-09-21T15:09:22.361 INFO:teuthology.orchestra.run.smithi161.stdout:3611 write 0x17a13da thru 0x17a9af0 (0x8717 bytes) 2024-09-21T15:09:22.377 INFO:teuthology.orchestra.run.smithi161.stdout:3151 write 0xa733f5d thru 0xa73df03 (0x9fa7 bytes) 2024-09-21T15:09:22.395 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.395 INFO:teuthology.orchestra.run.smithi161.stdout:3614 write 0x59f9aea thru 0x5a03527 (0x9a3e bytes) 2024-09-21T15:09:22.397 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.397 INFO:teuthology.orchestra.run.smithi161.stdout:4111 read 0x8cd77a5 thru 0x8ce2260 (0xaabc bytes) 2024-09-21T15:09:22.398 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.398 INFO:teuthology.orchestra.run.smithi161.stdout:4113 write 0x552419d thru 0x552853a (0x439e bytes) 2024-09-21T15:09:22.405 INFO:teuthology.orchestra.run.smithi161.stdout:3153 read 0xad20b6 thru 0xadd9fc (0xb947 bytes) 2024-09-21T15:09:22.406 INFO:teuthology.orchestra.run.smithi161.stdout:3156 write 0x22b56d7 thru 0x22b5ca4 (0x5ce bytes) 2024-09-21T15:09:22.407 INFO:teuthology.orchestra.run.smithi161.stdout:4018 write 0x7aec109 thru 0x7af7c5f (0xbb57 bytes) 2024-09-21T15:09:22.408 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.417 INFO:teuthology.orchestra.run.smithi161.stdout:3157 write 0x9129246 thru 0x91365b4 (0xd36f bytes) 2024-09-21T15:09:22.427 INFO:teuthology.orchestra.run.smithi161.stdout:4019 trunc from 0x7af7c60 to 0x8c4f0a7 2024-09-21T15:09:22.444 INFO:teuthology.orchestra.run.smithi161.stdout:4114 punch from 0x5edd969 to 0x5eea21d, (0xc8b4 bytes) 2024-09-21T15:09:22.444 INFO:teuthology.orchestra.run.smithi161.stdout:4115 read 0x40c44a3 thru 0x40cef60 (0xaabe bytes) 2024-09-21T15:09:22.445 INFO:teuthology.orchestra.run.smithi161.stdout:4117 read 0xb12bc thru 0xb4be5 (0x392a bytes) 2024-09-21T15:09:22.446 INFO:teuthology.orchestra.run.smithi161.stdout:3159 read 0xa538ae7 thru 0xa54587a (0xcd94 bytes) 2024-09-21T15:09:22.446 INFO:teuthology.orchestra.run.smithi161.stdout:4118 writesame 0xbc5d3f6 thru 0xbc61862 data_size 0x1(0x446d bytes) 2024-09-21T15:09:22.446 INFO:teuthology.orchestra.run.smithi161.stdout:3160 read 0x2830c2b thru 0x2833830 (0x2c06 bytes) 2024-09-21T15:09:22.447 INFO:teuthology.orchestra.run.smithi161.stdout:3161 read 0xb6a085c thru 0xb6a760b (0x6db0 bytes) 2024-09-21T15:09:22.447 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.447 INFO:teuthology.orchestra.run.smithi161.stdout:3164 write 0x8364a53 thru 0x836acab (0x6259 bytes) 2024-09-21T15:09:22.452 INFO:teuthology.orchestra.run.smithi161.stdout:3617 write 0xaa9f215 thru 0xaaa7cce (0x8aba bytes) 2024-09-21T15:09:22.464 INFO:teuthology.orchestra.run.smithi161.stdout:3167 write 0x85643c3 thru 0x85722d1 (0xdf0f bytes) 2024-09-21T15:09:22.476 INFO:teuthology.orchestra.run.smithi161.stdout:4347 read 0x113b0f2 thru 0x1141af9 (0x6a08 bytes) 2024-09-21T15:09:22.478 INFO:teuthology.orchestra.run.smithi161.stdout:3618 punch from 0x891ebc7 to 0x892c28a, (0xd6c3 bytes) 2024-09-21T15:09:22.479 INFO:teuthology.orchestra.run.smithi161.stdout:3619 read 0x5fd4fd5 thru 0x5fe44fc (0xf528 bytes) 2024-09-21T15:09:22.480 INFO:teuthology.orchestra.run.smithi161.stdout:3620 writesame 0x6dffe04 thru 0x6e00b61 data_size 0x1d(0xd5e bytes) 2024-09-21T15:09:22.486 INFO:teuthology.orchestra.run.smithi161.stdout:3168 write 0xa57d6e5 thru 0xa584028 (0x6944 bytes) 2024-09-21T15:09:22.488 INFO:teuthology.orchestra.run.smithi161.stdout:4021 trunc from 0x8c4f0a7 to 0x4ad322c 2024-09-21T15:09:22.493 INFO:teuthology.orchestra.run.smithi161.stdout:3621 writesame 0x6b7e019 thru 0x6b8d625 data_size 0x1(0xf60d bytes) 2024-09-21T15:09:22.506 INFO:teuthology.orchestra.run.smithi161.stdout:4119 trunc from 0xc02f07a to 0x3165053 2024-09-21T15:09:22.527 INFO:teuthology.orchestra.run.smithi161.stdout:3171 writesame 0x9323f7a thru 0x93306e1 data_size 0x24(0xc768 bytes) 2024-09-21T15:09:22.536 INFO:teuthology.orchestra.run.smithi161.stdout:4348 write 0x294dd47 thru 0x295d174 (0xf42e bytes) 2024-09-21T15:09:22.546 INFO:teuthology.orchestra.run.smithi161.stdout:4022 read 0xe422c2 thru 0xe4c3d9 (0xa118 bytes) 2024-09-21T15:09:22.546 INFO:teuthology.orchestra.run.smithi161.stdout:3622 write 0x8a2371a thru 0x8a26f1a (0x3801 bytes) 2024-09-21T15:09:22.551 INFO:teuthology.orchestra.run.smithi161.stdout:3172 writesame 0x5698927 thru 0x56a3932 data_size 0x26(0xb00c bytes) 2024-09-21T15:09:22.581 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.581 INFO:teuthology.orchestra.run.smithi161.stdout:3624 punch from 0x4ebe4f5 to 0x4eccbac, (0xe6b7 bytes) 2024-09-21T15:09:22.585 INFO:teuthology.orchestra.run.smithi161.stdout:3626 trunc from 0xaaa7ccf to 0xca2ec46 2024-09-21T15:09:22.595 INFO:teuthology.orchestra.run.smithi161.stdout:4349 trunc from 0x295d175 to 0xbf21268 2024-09-21T15:09:22.601 INFO:teuthology.orchestra.run.smithi161.stdout:3173 clone 37 order 23 su 32768 sc 8 2024-09-21T15:09:22.629 INFO:teuthology.orchestra.run.smithi161.stdout:4023 write 0x8373814 thru 0x8379619 (0x5e06 bytes) 2024-09-21T15:09:22.640 INFO:teuthology.orchestra.run.smithi161.stdout:4350 writesame 0x54044b8 thru 0x54121cc data_size 0x1(0xdd15 bytes) 2024-09-21T15:09:22.641 INFO:teuthology.orchestra.run.smithi161.stdout:3627 read 0x103bcc0 thru 0x1044e69 (0x91aa bytes) 2024-09-21T15:09:22.642 INFO:teuthology.orchestra.run.smithi161.stdout:3628 read 0x51d07ab thru 0x51db515 (0xad6b bytes) 2024-09-21T15:09:22.642 INFO:teuthology.orchestra.run.smithi161.stdout:4024 read 0x58223cd thru 0x582a02d (0x7c61 bytes) 2024-09-21T15:09:22.642 INFO:teuthology.orchestra.run.smithi161.stdout:3629 read 0xa04a32b thru 0xa0511f5 (0x6ecb bytes) 2024-09-21T15:09:22.670 INFO:teuthology.orchestra.run.smithi161.stdout:4120 writesame 0x4cbfc49 thru 0x4cc2383 data_size 0xb(0x273b bytes) 2024-09-21T15:09:22.674 INFO:teuthology.orchestra.run.smithi161.stdout:4121 read 0x269c98f thru 0x26a4bef (0x8261 bytes) 2024-09-21T15:09:22.681 INFO:teuthology.orchestra.run.smithi161.stdout:3630 write 0xcf5e613 thru 0xcf648e2 (0x62d0 bytes) 2024-09-21T15:09:22.693 INFO:teuthology.orchestra.run.smithi161.stdout:4352 writesame 0x4e15011 thru 0x4e15c71 data_size 0x1(0xc61 bytes) 2024-09-21T15:09:22.700 INFO:teuthology.orchestra.run.smithi161.stdout:3631 trunc from 0xcf648e3 to 0x9950f36 2024-09-21T15:09:22.705 INFO:teuthology.orchestra.run.smithi161.stdout:4025 writesame 0xd61cd4d thru 0xd62ad1b data_size 0x7(0xdfcf bytes) 2024-09-21T15:09:22.707 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.707 INFO:teuthology.orchestra.run.smithi161.stdout:4354 write 0x87e4330 thru 0x87f2713 (0xe3e4 bytes) 2024-09-21T15:09:22.717 INFO:teuthology.orchestra.run.smithi161.stdout:4026 write 0x7e63d90 thru 0x7e7208d (0xe2fe bytes) 2024-09-21T15:09:22.726 INFO:teuthology.orchestra.run.smithi161.stdout:4355 read 0x3f77316 thru 0x3f7b5a1 (0x428c bytes) 2024-09-21T15:09:22.726 INFO:teuthology.orchestra.run.smithi161.stdout:4356 writesame 0x6d6f974 thru 0x6d7a4d8 data_size 0x1d(0xab65 bytes) 2024-09-21T15:09:22.730 INFO:teuthology.orchestra.run.smithi161.stdout:4027 writesame 0x3264ae0 thru 0x32665b7 data_size 0x4(0x1ad8 bytes) 2024-09-21T15:09:22.733 INFO:teuthology.orchestra.run.smithi161.stdout:4123 write 0xe9604c6 thru 0xe9613f6 (0xf31 bytes) 2024-09-21T15:09:22.740 INFO:teuthology.orchestra.run.smithi161.stdout:4030 writesame 0x6de0aa8 thru 0x6debb56 data_size 0x1(0xb0af bytes) 2024-09-21T15:09:22.745 INFO:teuthology.orchestra.run.smithi161.stdout:4357 writesame 0x82b8cb0 thru 0x82c184b data_size 0xa(0x8b9c bytes) 2024-09-21T15:09:22.750 INFO:teuthology.orchestra.run.smithi161.stdout:4124 writesame 0x701d068 thru 0x701fcd4 data_size 0x3(0x2c6d bytes) 2024-09-21T15:09:22.762 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.763 INFO:teuthology.orchestra.run.smithi161.stdout:3633 punch from 0x6a3ff89 to 0x6a42e49, (0x2ec0 bytes) 2024-09-21T15:09:22.763 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.763 INFO:teuthology.orchestra.run.smithi161.stdout:3636 writesame 0xc6c85b thru 0xc72e0e data_size 0x2e(0x65b4 bytes) 2024-09-21T15:09:22.779 INFO:teuthology.orchestra.run.smithi161.stdout:4125 punch from 0xb6b91e0 to 0xb6be72c, (0x554c bytes) 2024-09-21T15:09:22.780 INFO:teuthology.orchestra.run.smithi161.stdout:4127 write 0x24977c8 thru 0x24a5be2 (0xe41b bytes) 2024-09-21T15:09:22.780 INFO:teuthology.orchestra.run.smithi161.stdout:4358 punch from 0x1b412d2 to 0x1b50ce2, (0xfa10 bytes) 2024-09-21T15:09:22.797 INFO:teuthology.orchestra.run.smithi161.stdout:4031 trunc from 0xd62ad1c to 0x9744dfe 2024-09-21T15:09:22.799 INFO:teuthology.orchestra.run.smithi161.stdout:4359 trunc from 0xbf21268 to 0x27d8a3c 2024-09-21T15:09:22.800 INFO:teuthology.orchestra.run.smithi161.stdout:4130 clone 23 order 24 su 2097152 sc 13 2024-09-21T15:09:22.829 INFO:teuthology.orchestra.run.smithi161.stdout:3637 writesame 0xac02277 thru 0xac11fd5 data_size 0x3(0xfd5f bytes) 2024-09-21T15:09:22.833 INFO:teuthology.orchestra.run.smithi161.stdout:3638 write 0x1b8874 thru 0x1c56c4 (0xce51 bytes) 2024-09-21T15:09:22.844 INFO:teuthology.orchestra.run.smithi161.stdout:3639 writesame 0x959d123 thru 0x95a4f20 data_size 0x1(0x7dfe bytes) 2024-09-21T15:09:22.875 INFO:teuthology.orchestra.run.smithi161.stdout:3640 read 0x420e854 thru 0x42194b6 (0xac63 bytes) 2024-09-21T15:09:22.876 INFO:teuthology.orchestra.run.smithi161.stdout:3641 read 0x915d9aa thru 0x915eeff (0x1556 bytes) 2024-09-21T15:09:22.876 INFO:teuthology.orchestra.run.smithi161.stdout:3643 read 0x8ea189a thru 0x8eb05b7 (0xed1e bytes) 2024-09-21T15:09:22.877 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.883 INFO:teuthology.orchestra.run.smithi161.stdout:3646 trunc from 0xac11fd6 to 0x8415749 2024-09-21T15:09:22.895 INFO:teuthology.orchestra.run.smithi161.stdout:4033 write 0xa6698ef thru 0xa66dc1d (0x432f bytes) 2024-09-21T15:09:22.901 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone26 from 0x2a91136 (overlap 0x2a91136) to 0x0 2024-09-21T15:09:22.916 INFO:teuthology.orchestra.run.smithi161.stdout:4360 write 0x5419ec0 thru 0x54278cc (0xda0d bytes) 2024-09-21T15:09:22.929 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:22.931 INFO:teuthology.orchestra.run.smithi161.stdout:4361 read 0x279c8bf thru 0x27a7351 (0xaa93 bytes) 2024-09-21T15:09:22.931 INFO:teuthology.orchestra.run.smithi161.stdout:4362 read 0x2346136 thru 0x2353d57 (0xdc22 bytes) 2024-09-21T15:09:22.963 INFO:teuthology.orchestra.run.smithi161.stdout:3648 write 0xc9fe3f5 thru 0xca0c1a0 (0xddac bytes) 2024-09-21T15:09:22.981 INFO:teuthology.orchestra.run.smithi161.stdout:3650 read 0x78a4689 thru 0x78a5a7d (0x13f5 bytes) 2024-09-21T15:09:22.982 INFO:teuthology.orchestra.run.smithi161.stdout:3653 trunc from 0xca0c1a1 to 0xcc714f4 2024-09-21T15:09:22.984 INFO:teuthology.orchestra.run.smithi161.stdout:4363 write 0xe2b384b thru 0xe2b4811 (0xfc7 bytes) 2024-09-21T15:09:22.995 INFO:teuthology.orchestra.run.smithi161.stdout:4364 write 0xdc3c8c9 thru 0xdc3e9dd (0x2115 bytes) 2024-09-21T15:09:23.005 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:23.005 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:23.005 INFO:teuthology.orchestra.run.smithi161.stdout:4371 read 0x7832a7c thru 0x7836770 (0x3cf5 bytes) 2024-09-21T15:09:23.005 INFO:teuthology.orchestra.run.smithi161.stdout:4372 write 0x5042b81 thru 0x504446d (0x18ed bytes) 2024-09-21T15:09:23.017 INFO:teuthology.orchestra.run.smithi161.stdout:3654 punch from 0x3825899 to 0x38348b9, (0xf020 bytes) 2024-09-21T15:09:23.041 INFO:teuthology.orchestra.run.smithi161.stdout:4374 trunc from 0xe2b4812 to 0xbb6d0a 2024-09-21T15:09:23.042 INFO:teuthology.orchestra.run.smithi161.stdout:3656 write 0xd67a1ec thru 0xd67d911 (0x3726 bytes) 2024-09-21T15:09:23.068 INFO:teuthology.orchestra.run.smithi161.stdout:3657 read 0x6ea60b0 thru 0x6eb54e0 (0xf431 bytes) 2024-09-21T15:09:23.070 INFO:teuthology.orchestra.run.smithi161.stdout:3658 read 0x6fec44b thru 0x6ff5ca4 (0x985a bytes) 2024-09-21T15:09:23.071 INFO:teuthology.orchestra.run.smithi161.stdout:3659 write 0x7534254 thru 0x753b78a (0x7537 bytes) 2024-09-21T15:09:23.083 INFO:teuthology.orchestra.run.smithi161.stdout:3660 writesame 0x7fcdc1c thru 0x7fdca3f data_size 0x2(0xee24 bytes) 2024-09-21T15:09:23.109 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #25, image image_cluster1.client.mirror.5-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent26 2024-09-21T15:09:23.118 INFO:teuthology.orchestra.run.smithi161.stdout:3661 writesame 0x295271c thru 0x295fd78 data_size 0x1(0xd65d bytes) 2024-09-21T15:09:23.138 INFO:teuthology.orchestra.run.smithi161.stdout:4375 read 0x922a00 thru 0x9310bb (0xe6bc bytes) 2024-09-21T15:09:23.165 INFO:teuthology.orchestra.run.smithi161.stdout:3662 read 0x7a76285 thru 0x7a84f94 (0xed10 bytes) 2024-09-21T15:09:23.166 INFO:teuthology.orchestra.run.smithi161.stdout:3663 read 0x28ae628 thru 0x28b742f (0x8e08 bytes) 2024-09-21T15:09:23.176 INFO:teuthology.orchestra.run.smithi161.stdout:4376 write 0x18df429 thru 0x18e822c (0x8e04 bytes) 2024-09-21T15:09:23.190 INFO:teuthology.orchestra.run.smithi161.stdout:4378 punch from 0x1201d3e to 0x1208be0, (0x6ea2 bytes) 2024-09-21T15:09:23.190 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:23.200 INFO:teuthology.orchestra.run.smithi161.stdout:3664 trunc from 0xd67d912 to 0x25b54c6 2024-09-21T15:09:23.208 INFO:teuthology.orchestra.run.smithi161.stdout:4382 trunc from 0x18e822d to 0xbe9024d 2024-09-21T15:09:23.244 INFO:teuthology.orchestra.run.smithi161.stdout:4383 write 0x238e2ae thru 0x239d5eb (0xf33e bytes) 2024-09-21T15:09:23.250 INFO:teuthology.orchestra.run.smithi161.stdout:3665 clone 32 order 20 su 524288 sc 8 2024-09-21T15:09:23.259 INFO:teuthology.orchestra.run.smithi161.stdout:3882 writesame 0xb5868b1 thru 0xb58e4a8 data_size 0x4(0x7bf8 bytes) 2024-09-21T15:09:23.261 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:23.263 INFO:teuthology.orchestra.run.smithi161.stdout:3883 read 0xa081d63 thru 0xa08b1b6 (0x9454 bytes) 2024-09-21T15:09:23.264 INFO:teuthology.orchestra.run.smithi161.stdout:3885 punch from 0x7ee4550 to 0x7eef938, (0xb3e8 bytes) 2024-09-21T15:09:23.266 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:23.298 INFO:teuthology.orchestra.run.smithi161.stdout:4385 write 0xd03f1bc thru 0xd03f1f2 (0x37 bytes) 2024-09-21T15:09:23.298 INFO:teuthology.orchestra.run.smithi161.stdout:3889 writesame 0xd62610e thru 0xd62b78c data_size 0xb(0x567f bytes) 2024-09-21T15:09:23.304 INFO:teuthology.orchestra.run.smithi161.stdout:3890 write 0xb834044 thru 0xb843d82 (0xfd3f bytes) 2024-09-21T15:09:23.311 INFO:teuthology.orchestra.run.smithi161.stdout:4386 write 0x81a41a1 thru 0x81a8770 (0x45d0 bytes) 2024-09-21T15:09:23.320 INFO:teuthology.orchestra.run.smithi161.stdout:3891 read 0x1b3b003 thru 0x1b44b27 (0x9b25 bytes) 2024-09-21T15:09:23.325 INFO:teuthology.orchestra.run.smithi161.stdout:4387 punch from 0x6f2bc94 to 0x6f348fe, (0x8c6a bytes) 2024-09-21T15:09:23.325 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:23.325 INFO:teuthology.orchestra.run.smithi161.stdout:4389 write 0x5d0b294 thru 0x5d14b8c (0x98f9 bytes) 2024-09-21T15:09:23.339 INFO:teuthology.orchestra.run.smithi161.stdout:3892 trunc from 0xd62b78d to 0x41740e5 2024-09-21T15:09:23.343 INFO:teuthology.orchestra.run.smithi161.stdout:4390 punch from 0x49c9dc6 to 0x49ca653, (0x88d bytes) 2024-09-21T15:09:23.343 INFO:teuthology.orchestra.run.smithi161.stdout:4392 write 0x85bfd13 thru 0x85cd73f (0xda2d bytes) 2024-09-21T15:09:23.361 INFO:teuthology.orchestra.run.smithi161.stdout:4393 read 0x58fff55 thru 0x5907239 (0x72e5 bytes) 2024-09-21T15:09:23.361 INFO:teuthology.orchestra.run.smithi161.stdout:4394 writesame 0x235462f thru 0x2359b2c data_size 0x1(0x54fe bytes) 2024-09-21T15:09:23.383 INFO:teuthology.orchestra.run.smithi161.stdout:3893 write 0x25ebaa8 thru 0x25f7776 (0xbccf bytes) 2024-09-21T15:09:23.386 INFO:teuthology.orchestra.run.smithi161.stdout:4395 read 0x7f73c32 thru 0x7f753f7 (0x17c6 bytes) 2024-09-21T15:09:23.387 INFO:teuthology.orchestra.run.smithi161.stdout:4396 read 0x743e980 thru 0x7442bcc (0x424d bytes) 2024-09-21T15:09:23.387 INFO:teuthology.orchestra.run.smithi161.stdout:4397 writesame 0x491d534 thru 0x491f931 data_size 0x11(0x23fe bytes) 2024-09-21T15:09:23.399 INFO:teuthology.orchestra.run.smithi161.stdout:4398 writesame 0x1292075 thru 0x1299a98 data_size 0x2(0x7a24 bytes) 2024-09-21T15:09:23.401 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:23.419 INFO:teuthology.orchestra.run.smithi161.stdout:4399 read 0xb1292ef thru 0xb1350df (0xbdf1 bytes) 2024-09-21T15:09:23.419 INFO:teuthology.orchestra.run.smithi161.stdout:4400 read 0x5df5dfa thru 0x5dfadc1 (0x4fc8 bytes) 2024-09-21T15:09:23.437 INFO:teuthology.orchestra.run.smithi161.stdout:4401 trunc from 0xd03f1f3 to 0x5ace1e9 2024-09-21T15:09:23.448 INFO:teuthology.orchestra.run.smithi161.stdout:3895 write 0x852fcbb thru 0x8530906 (0xc4c bytes) 2024-09-21T15:09:23.465 INFO:teuthology.orchestra.run.smithi161.stdout:3897 read 0x3fc24fd thru 0x3fcee0f (0xc913 bytes) 2024-09-21T15:09:23.465 INFO:teuthology.orchestra.run.smithi161.stdout:3898 punch from 0x1fc6d15 to 0x1fcc085, (0x5370 bytes) 2024-09-21T15:09:23.469 INFO:teuthology.orchestra.run.smithi161.stdout:3899 trunc from 0x8530907 to 0x9901aa0 2024-09-21T15:09:23.485 INFO:teuthology.orchestra.run.smithi161.stdout:4404 read 0x3cc5e1b thru 0x3cc6942 (0xb28 bytes) 2024-09-21T15:09:23.485 INFO:teuthology.orchestra.run.smithi161.stdout:4405 write 0x14ca6f1 thru 0x14d96a4 (0xefb4 bytes) 2024-09-21T15:09:23.500 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:23.500 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:23.502 INFO:teuthology.orchestra.run.smithi161.stdout:3900 write 0x6aface3 thru 0x6aff5df (0x48fd bytes) 2024-09-21T15:09:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:3902 punch from 0x6e5352 to 0x6f0aa3, (0xb751 bytes) 2024-09-21T15:09:23.516 INFO:teuthology.orchestra.run.smithi161.stdout:3903 read 0x30e54a0 thru 0x30f2e05 (0xd966 bytes) 2024-09-21T15:09:23.519 INFO:teuthology.orchestra.run.smithi161.stdout:3904 trunc from 0x9901aa0 to 0x80b86ed 2024-09-21T15:09:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:4409 write 0xdb547be thru 0xdb56459 (0x1c9c bytes) 2024-09-21T15:09:23.570 INFO:teuthology.orchestra.run.smithi161.stdout:4410 write 0x4dc9358 thru 0x4dcffe3 (0x6c8c bytes) 2024-09-21T15:09:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:3905 read 0x3eacb83 thru 0x3ebc951 (0xfdcf bytes) 2024-09-21T15:09:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:3906 punch from 0x68fa525 to 0x6900db8, (0x6893 bytes) 2024-09-21T15:09:23.581 INFO:teuthology.orchestra.run.smithi161.stdout:3907 read 0x1467f9e thru 0x1468167 (0x1ca bytes) 2024-09-21T15:09:23.582 INFO:teuthology.orchestra.run.smithi161.stdout:3908 read 0x1d9f93d thru 0x1da7556 (0x7c1a bytes) 2024-09-21T15:09:23.590 INFO:teuthology.orchestra.run.smithi161.stdout:4411 read 0x4d47138 thru 0x4d4cff6 (0x5ebf bytes) 2024-09-21T15:09:23.590 INFO:teuthology.orchestra.run.smithi161.stdout:4412 writesame 0x8d50952 thru 0x8d5a3a7 data_size 0x2d(0x9a56 bytes) 2024-09-21T15:09:23.593 INFO:teuthology.orchestra.run.smithi161.stdout:3909 trunc from 0x80b86ed to 0xb7b395b 2024-09-21T15:09:23.612 INFO:teuthology.orchestra.run.smithi161.stdout:4413 trunc from 0xdb5645a to 0xb3c6934 2024-09-21T15:09:23.615 INFO:teuthology.orchestra.run.smithi161.stdout:4035 write 0x41d7220 thru 0x41de4a4 (0x7285 bytes) 2024-09-21T15:09:23.622 INFO:teuthology.orchestra.run.smithi161.stdout:3910 writesame 0x373f06e thru 0x374d561 data_size 0x2(0xe4f4 bytes) 2024-09-21T15:09:23.633 INFO:teuthology.orchestra.run.smithi161.stdout:4036 read 0x48b1f40 thru 0x48b9c6b (0x7d2c bytes) 2024-09-21T15:09:23.634 INFO:teuthology.orchestra.run.smithi161.stdout:4037 punch from 0x823c24e to 0x82420b0, (0x5e62 bytes) 2024-09-21T15:09:23.634 INFO:teuthology.orchestra.run.smithi161.stdout:4038 write 0x242354f thru 0x24260bc (0x2b6e bytes) 2024-09-21T15:09:23.656 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:23.656 INFO:teuthology.orchestra.run.smithi161.stdout:3913 punch from 0x1ba282f to 0x1ba58be, (0x308f bytes) 2024-09-21T15:09:23.662 INFO:teuthology.orchestra.run.smithi161.stdout:4039 trunc from 0xa66dc1e to 0x55ff3e6 2024-09-21T15:09:23.662 INFO:teuthology.orchestra.run.smithi161.stdout:3914 trunc from 0xb7b395b to 0xe47ba03 2024-09-21T15:09:23.677 INFO:teuthology.orchestra.run.smithi161.stdout:4418 trunc from 0xb3c6934 to 0xd7c3d6e 2024-09-21T15:09:23.701 INFO:teuthology.orchestra.run.smithi161.stdout:3915 write 0x6988e8b thru 0x6996d96 (0xdf0c bytes) 2024-09-21T15:09:23.712 INFO:teuthology.orchestra.run.smithi161.stdout:4420 write 0x5623176 thru 0x562ca37 (0x98c2 bytes) 2024-09-21T15:09:23.723 INFO:teuthology.orchestra.run.smithi161.stdout:3916 write 0x4896a3a thru 0x48a24ac (0xba73 bytes) 2024-09-21T15:09:23.732 INFO:teuthology.orchestra.run.smithi161.stdout:4040 writesame 0x2cc96b8 thru 0x2ccae95 data_size 0xd(0x17de bytes) 2024-09-21T15:09:23.739 INFO:teuthology.orchestra.run.smithi161.stdout:4421 write 0x36fc062 thru 0x370bf09 (0xfea8 bytes) 2024-09-21T15:09:23.750 INFO:teuthology.orchestra.run.smithi161.stdout:4041 punch from 0x46c6907 to 0x46cc75a, (0x5e53 bytes) 2024-09-21T15:09:23.753 INFO:teuthology.orchestra.run.smithi161.stdout:3918 write 0x26a2f85 thru 0x26adc87 (0xad03 bytes) 2024-09-21T15:09:23.764 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:23.765 INFO:teuthology.orchestra.run.smithi161.stdout:4424 read 0x6af262 thru 0x6bb72f (0xc4ce bytes) 2024-09-21T15:09:23.771 INFO:teuthology.orchestra.run.smithi161.stdout:3919 write 0x95b7945 thru 0x95b88f6 (0xfb2 bytes) 2024-09-21T15:09:23.786 INFO:teuthology.orchestra.run.smithi161.stdout:3920 read 0x6a5148e thru 0x6a57e76 (0x69e9 bytes) 2024-09-21T15:09:23.791 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone31 from 0x25b54c6 (overlap 0x75a04f) to 0x3ad027 2024-09-21T15:09:23.802 INFO:teuthology.orchestra.run.smithi161.stdout:4042 write 0xd942d8f thru 0xd948c1a (0x5e8c bytes) 2024-09-21T15:09:23.802 INFO:teuthology.orchestra.run.smithi161.stdout:4425 write 0xdfaa8ad thru 0xdfaaa8f (0x1e3 bytes) 2024-09-21T15:09:23.803 INFO:teuthology.orchestra.run.smithi161.stdout:3921 trunc from 0xe47ba03 to 0x5179e03 2024-09-21T15:09:23.808 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone22 from 0xe9613f7 (overlap 0x3165053) to 0x0 2024-09-21T15:09:23.822 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xed02c2d 2024-09-21T15:09:23.823 INFO:teuthology.orchestra.run.smithi161.stdout:4426 trunc from 0xdfaaa90 to 0xed02c2d 2024-09-21T15:09:23.841 INFO:teuthology.orchestra.run.smithi161.stdout:4043 trunc from 0xd948c1b to 0x26c332e 2024-09-21T15:09:23.917 INFO:teuthology.orchestra.run.smithi161.stdout:3923 trunc from 0x5179e03 to 0x9628e4e 2024-09-21T15:09:23.917 INFO:teuthology.orchestra.run.smithi161.stdout:4427 write 0xc4830a4 thru 0xc48b2e9 (0x8246 bytes) 2024-09-21T15:09:23.929 INFO:teuthology.orchestra.run.smithi161.stdout:4046 trunc from 0x26c332e to 0x23e34f 2024-09-21T15:09:23.948 INFO:teuthology.orchestra.run.smithi161.stdout:4429 trunc from 0xed02c2d to 0x8acebf7 2024-09-21T15:09:23.953 INFO:teuthology.orchestra.run.smithi161.stdout:3925 read 0x69a9284 thru 0x69b39bd (0xa73a bytes) 2024-09-21T15:09:23.953 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:23.953 INFO:teuthology.orchestra.run.smithi161.stdout:3928 read 0x2f1c431 thru 0x2f1c941 (0x511 bytes) 2024-09-21T15:09:23.953 INFO:teuthology.orchestra.run.smithi161.stdout:3929 writesame 0x2239306 thru 0x2239676 data_size 0x1(0x371 bytes) 2024-09-21T15:09:23.968 INFO:teuthology.orchestra.run.smithi161.stdout:3930 write 0x21df95e thru 0x21e029b (0x93e bytes) 2024-09-21T15:09:23.973 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #30, image image_cluster1.client.mirror.4-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent31 2024-09-21T15:09:23.984 INFO:teuthology.orchestra.run.smithi161.stdout:3931 punch from 0x4c67b66 to 0x4c6c772, (0x4c0c bytes) 2024-09-21T15:09:23.987 INFO:teuthology.orchestra.run.smithi161.stdout:4047 trunc from 0x23e34f to 0x59f8bf0 2024-09-21T15:09:23.991 INFO:teuthology.orchestra.run.smithi161.stdout:3932 trunc from 0x9628e4e to 0xce430e3 2024-09-21T15:09:23.996 INFO:teuthology.orchestra.run.smithi161.stdout:4430 writesame 0x98a7bc thru 0x993964 data_size 0x1(0x91a9 bytes) 2024-09-21T15:09:24.000 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #35, image image_cluster1.client.mirror.3-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent36 2024-09-21T15:09:24.037 INFO:teuthology.orchestra.run.smithi161.stdout:4431 read 0x4c442e8 thru 0x4c4dd92 (0x9aab bytes) 2024-09-21T15:09:24.038 INFO:teuthology.orchestra.run.smithi161.stdout:3933 punch from 0x6fe3f47 to 0x6ff3608, (0xf6c1 bytes) 2024-09-21T15:09:24.038 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.038 INFO:teuthology.orchestra.run.smithi161.stdout:3937 write 0x488b2b2 thru 0x489a32c (0xf07b bytes) 2024-09-21T15:09:24.039 INFO:teuthology.orchestra.run.smithi161.stdout:4048 writesame 0x1ee7778 thru 0x1eef010 data_size 0x29(0x7899 bytes) 2024-09-21T15:09:24.046 INFO:teuthology.orchestra.run.smithi161.stdout:4432 trunc from 0x8acebf7 to 0xc45a409 2024-09-21T15:09:24.050 INFO:teuthology.orchestra.run.smithi161.stdout:4049 read 0x5673dc5 thru 0x5680753 (0xc98f bytes) 2024-09-21T15:09:24.050 INFO:teuthology.orchestra.run.smithi161.stdout:4050 punch from 0x20bc316 to 0x20c93a7, (0xd091 bytes) 2024-09-21T15:09:24.066 INFO:teuthology.orchestra.run.smithi161.stdout:3174 read 0x1a972d9 thru 0x1aa4352 (0xd07a bytes) 2024-09-21T15:09:24.067 INFO:teuthology.orchestra.run.smithi161.stdout:3939 read 0x7d2b3de thru 0x7d2f5a7 (0x41ca bytes) 2024-09-21T15:09:24.067 INFO:teuthology.orchestra.run.smithi161.stdout:3942 punch from 0x898fa29 to 0x8999704, (0x9cdb bytes) 2024-09-21T15:09:24.067 INFO:teuthology.orchestra.run.smithi161.stdout:3944 read 0x3c1e324 thru 0x3c2196a (0x3647 bytes) 2024-09-21T15:09:24.068 INFO:teuthology.orchestra.run.smithi161.stdout:3945 punch from 0x500e159 to 0x501b8b0, (0xd757 bytes) 2024-09-21T15:09:24.068 INFO:teuthology.orchestra.run.smithi161.stdout:3946 read 0x312534e thru 0x3132385 (0xd038 bytes) 2024-09-21T15:09:24.068 INFO:teuthology.orchestra.run.smithi161.stdout:3947 punch from 0x56d0c45 to 0x56e0658, (0xfa13 bytes) 2024-09-21T15:09:24.068 INFO:teuthology.orchestra.run.smithi161.stdout:3948 writesame 0x6e54b63 thru 0x6e5f73e data_size 0x22(0xabdc bytes) 2024-09-21T15:09:24.086 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.086 INFO:teuthology.orchestra.run.smithi161.stdout:3951 write 0xa57fa7b thru 0xa57fec3 (0x449 bytes) 2024-09-21T15:09:24.089 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #21, image image_cluster1.client.mirror.1-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent22 2024-09-21T15:09:24.100 INFO:teuthology.orchestra.run.smithi161.stdout:3176 write 0x85fc4d7 thru 0x85fc711 (0x23b bytes) 2024-09-21T15:09:24.101 INFO:teuthology.orchestra.run.smithi161.stdout:4435 read 0x57d583d thru 0x57de6f6 (0x8eba bytes) 2024-09-21T15:09:24.101 INFO:teuthology.orchestra.run.smithi161.stdout:4436 punch from 0x475553 to 0x4835b1, (0xe05e bytes) 2024-09-21T15:09:24.108 INFO:teuthology.orchestra.run.smithi161.stdout:4051 writesame 0x6e27b35 thru 0x6e2f0b8 data_size 0x6d(0x7584 bytes) 2024-09-21T15:09:24.109 INFO:teuthology.orchestra.run.smithi161.stdout:3952 read 0x2b5b6d6 thru 0x2b5c13b (0xa66 bytes) 2024-09-21T15:09:24.109 INFO:teuthology.orchestra.run.smithi161.stdout:3953 write 0x83e205d thru 0x83edb0b (0xbaaf bytes) 2024-09-21T15:09:24.124 INFO:teuthology.orchestra.run.smithi161.stdout:4053 punch from 0xed5042 to 0xedd2ab, (0x8269 bytes) 2024-09-21T15:09:24.124 INFO:teuthology.orchestra.run.smithi161.stdout:4054 writesame 0x2cebb69 thru 0x2cf20ac data_size 0x2(0x6544 bytes) 2024-09-21T15:09:24.131 INFO:teuthology.orchestra.run.smithi161.stdout:3955 write 0x26d07a5 thru 0x26dc28a (0xbae6 bytes) 2024-09-21T15:09:24.140 INFO:teuthology.orchestra.run.smithi161.stdout:4437 write 0xc76346f thru 0xc769f16 (0x6aa8 bytes) 2024-09-21T15:09:24.140 INFO:teuthology.orchestra.run.smithi161.stdout:3177 read 0x28557bb thru 0x2861307 (0xbb4d bytes) 2024-09-21T15:09:24.140 INFO:teuthology.orchestra.run.smithi161.stdout:3179 writesame 0x3c46000 thru 0x3c4952b data_size 0x4(0x352c bytes) 2024-09-21T15:09:24.144 INFO:teuthology.orchestra.run.smithi161.stdout:4055 read 0x4eebd15 thru 0x4ef54b2 (0x979e bytes) 2024-09-21T15:09:24.146 INFO:teuthology.orchestra.run.smithi161.stdout:3957 write 0x8d0c9ae thru 0x8d12f3c (0x658f bytes) 2024-09-21T15:09:24.166 INFO:teuthology.orchestra.run.smithi161.stdout:4438 read 0x4b36e95 thru 0x4b4238e (0xb4fa bytes) 2024-09-21T15:09:24.166 INFO:teuthology.orchestra.run.smithi161.stdout:4440 write 0xe76296 thru 0xe79ecd (0x3c38 bytes) 2024-09-21T15:09:24.170 INFO:teuthology.orchestra.run.smithi161.stdout:3958 read 0x32ea6c9 thru 0x32ed957 (0x328f bytes) 2024-09-21T15:09:24.171 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.171 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.171 INFO:teuthology.orchestra.run.smithi161.stdout:3962 write 0x38654f9 thru 0x386d42b (0x7f33 bytes) 2024-09-21T15:09:24.178 INFO:teuthology.orchestra.run.smithi161.stdout:4442 read 0xbce8fd8 thru 0xbcf6ab6 (0xdadf bytes) 2024-09-21T15:09:24.179 INFO:teuthology.orchestra.run.smithi161.stdout:4444 punch from 0x4863a85 to 0x486a379, (0x68f4 bytes) 2024-09-21T15:09:24.179 INFO:teuthology.orchestra.run.smithi161.stdout:4445 clone 27 order 18 su 2048 sc 8 2024-09-21T15:09:24.189 INFO:teuthology.orchestra.run.smithi161.stdout:3963 read 0x3018482 thru 0x302780c (0xf38b bytes) 2024-09-21T15:09:24.198 INFO:teuthology.orchestra.run.smithi161.stdout:3180 writesame 0x987e37 thru 0x98be71 data_size 0x51(0x403b bytes) 2024-09-21T15:09:24.200 INFO:teuthology.orchestra.run.smithi161.stdout:4056 write 0x7a3a2d3 thru 0x7a3aa6a (0x798 bytes) 2024-09-21T15:09:24.210 INFO:teuthology.orchestra.run.smithi161.stdout:3181 write 0x7213dd4 thru 0x7220d20 (0xcf4d bytes) 2024-09-21T15:09:24.211 INFO:teuthology.orchestra.run.smithi161.stdout:4057 trunc from 0x7a3aa6b to 0x543cb8e 2024-09-21T15:09:24.235 INFO:teuthology.orchestra.run.smithi161.stdout:4132 writesame 0x589f302 thru 0x58a2c3a data_size 0x13(0x3939 bytes) 2024-09-21T15:09:24.243 INFO:teuthology.orchestra.run.smithi161.stdout:3964 write 0xde440ca thru 0xde4b1fe (0x7135 bytes) 2024-09-21T15:09:24.263 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.263 INFO:teuthology.orchestra.run.smithi161.stdout:3966 read 0x5514232 thru 0x5520c07 (0xc9d6 bytes) 2024-09-21T15:09:24.264 INFO:teuthology.orchestra.run.smithi161.stdout:3967 writesame 0x704f1a4 thru 0x7057f7a data_size 0x1(0x8dd7 bytes) 2024-09-21T15:09:24.265 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.265 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.277 INFO:teuthology.orchestra.run.smithi161.stdout:4060 trunc from 0x543cb8e to 0xc4eb2ff 2024-09-21T15:09:24.287 INFO:teuthology.orchestra.run.smithi161.stdout:3182 write 0xeaa9cb6 thru 0xeaaf7f2 (0x5b3d bytes) 2024-09-21T15:09:24.288 INFO:teuthology.orchestra.run.smithi161.stdout:4133 read 0x89a9bbe thru 0x89b3e4e (0xa291 bytes) 2024-09-21T15:09:24.288 INFO:teuthology.orchestra.run.smithi161.stdout:4134 writesame 0x5c3a14c thru 0x5c46935 data_size 0x1(0xc7ea bytes) 2024-09-21T15:09:24.303 INFO:teuthology.orchestra.run.smithi161.stdout:4061 read 0x42d17d9 thru 0x42dde04 (0xc62c bytes) 2024-09-21T15:09:24.304 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.304 INFO:teuthology.orchestra.run.smithi161.stdout:4064 write 0x31e3351 thru 0x31e7c91 (0x4941 bytes) 2024-09-21T15:09:24.305 INFO:teuthology.orchestra.run.smithi161.stdout:3968 writesame 0x3c3f7b8 thru 0x3c489c3 data_size 0x1a(0x920c bytes) 2024-09-21T15:09:24.314 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.314 INFO:teuthology.orchestra.run.smithi161.stdout:4066 read 0xb58599f thru 0xb58ab8b (0x51ed bytes) 2024-09-21T15:09:24.315 INFO:teuthology.orchestra.run.smithi161.stdout:4067 read 0x754a163 thru 0x754e641 (0x44df bytes) 2024-09-21T15:09:24.315 INFO:teuthology.orchestra.run.smithi161.stdout:4068 writesame 0xacd04b1 thru 0xacd7b94 data_size 0xe(0x76e4 bytes) 2024-09-21T15:09:24.320 INFO:teuthology.orchestra.run.smithi161.stdout:3969 read 0x984b3ab thru 0x9852220 (0x6e76 bytes) 2024-09-21T15:09:24.320 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.321 INFO:teuthology.orchestra.run.smithi161.stdout:3183 read 0xb5af17f thru 0xb5b1e89 (0x2d0b bytes) 2024-09-21T15:09:24.321 INFO:teuthology.orchestra.run.smithi161.stdout:3185 writesame 0x1102731 thru 0x110bd6a data_size 0x29(0x963a bytes) 2024-09-21T15:09:24.324 INFO:teuthology.orchestra.run.smithi161.stdout:4070 write 0x79706c5 thru 0x797abf4 (0xa530 bytes) 2024-09-21T15:09:24.337 INFO:teuthology.orchestra.run.smithi161.stdout:3186 read 0x6d982bc thru 0x6da0c31 (0x8976 bytes) 2024-09-21T15:09:24.338 INFO:teuthology.orchestra.run.smithi161.stdout:3188 write 0x1cc8438 thru 0x1cd7a4e (0xf617 bytes) 2024-09-21T15:09:24.344 INFO:teuthology.orchestra.run.smithi161.stdout:4071 punch from 0x2f8fa99 to 0x2f90b60, (0x10c7 bytes) 2024-09-21T15:09:24.362 INFO:teuthology.orchestra.run.smithi161.stdout:4135 trunc from 0xe9613f7 to 0xb329a44 2024-09-21T15:09:24.364 INFO:teuthology.orchestra.run.smithi161.stdout:4073 trunc from 0xc4eb2ff to 0x1d88dc2 2024-09-21T15:09:24.368 INFO:teuthology.orchestra.run.smithi161.stdout:3973 writesame 0xdf776bf thru 0xdf80157 data_size 0x1(0x8a99 bytes) 2024-09-21T15:09:24.389 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.389 INFO:teuthology.orchestra.run.smithi161.stdout:3190 writesame 0xb2663e3 thru 0xb274919 data_size 0x1(0xe537 bytes) 2024-09-21T15:09:24.403 INFO:teuthology.orchestra.run.smithi161.stdout:3974 write 0x7abc43a thru 0x7ac3ea6 (0x7a6d bytes) 2024-09-21T15:09:24.439 INFO:teuthology.orchestra.run.smithi161.stdout:3666 punch from 0x23896fb to 0x2395bff, (0xc504 bytes) 2024-09-21T15:09:24.457 INFO:teuthology.orchestra.run.smithi161.stdout:3975 write 0x89ac525 thru 0x89b2dac (0x6888 bytes) 2024-09-21T15:09:24.466 INFO:teuthology.orchestra.run.smithi161.stdout:3191 write 0xd84ba97 thru 0xd85867e (0xcbe8 bytes) 2024-09-21T15:09:24.479 INFO:teuthology.orchestra.run.smithi161.stdout:4075 writesame 0x6747c36 thru 0x674e619 data_size 0x36(0x69e4 bytes) 2024-09-21T15:09:24.481 INFO:teuthology.orchestra.run.smithi161.stdout:3667 writesame 0x1f70f7b thru 0x1f76578 data_size 0x9(0x55fe bytes) 2024-09-21T15:09:24.482 INFO:teuthology.orchestra.run.smithi161.stdout:4136 read 0x1c6190d thru 0x1c6920e (0x7902 bytes) 2024-09-21T15:09:24.484 INFO:teuthology.orchestra.run.smithi161.stdout:4137 punch from 0x1a13915 to 0x1a19944, (0x602f bytes) 2024-09-21T15:09:24.484 INFO:teuthology.orchestra.run.smithi161.stdout:4138 writesame 0x4c501bd thru 0x4c5e78c data_size 0x8(0xe5d0 bytes) 2024-09-21T15:09:24.487 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.487 INFO:teuthology.orchestra.run.smithi161.stdout:3978 writesame 0xcb579e3 thru 0xcb62b07 data_size 0x1(0xb125 bytes) 2024-09-21T15:09:24.487 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.487 INFO:teuthology.orchestra.run.smithi161.stdout:4078 read 0x5867bbf thru 0x5876fdf (0xf421 bytes) 2024-09-21T15:09:24.494 INFO:teuthology.orchestra.run.smithi161.stdout:4079 trunc from 0x674e61a to 0x99fb7c9 2024-09-21T15:09:24.499 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.499 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.499 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.499 INFO:teuthology.orchestra.run.smithi161.stdout:3199 write 0xc2a53d7 thru 0xc2aefc5 (0x9bef bytes) 2024-09-21T15:09:24.499 INFO:teuthology.orchestra.run.smithi161.stdout:3669 write 0x22570ae thru 0x22595c3 (0x2516 bytes) 2024-09-21T15:09:24.506 INFO:teuthology.orchestra.run.smithi161.stdout:4140 trunc from 0xb329a44 to 0x6c44a0d 2024-09-21T15:09:24.528 INFO:teuthology.orchestra.run.smithi161.stdout:3200 punch from 0x44302fc to 0x4436687, (0x638b bytes) 2024-09-21T15:09:24.528 INFO:teuthology.orchestra.run.smithi161.stdout:3201 write 0x1e7addb thru 0x1e8185c (0x6a82 bytes) 2024-09-21T15:09:24.528 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.528 INFO:teuthology.orchestra.run.smithi161.stdout:3671 read 0x5d1a39 thru 0x5d5c2b (0x41f3 bytes) 2024-09-21T15:09:24.537 INFO:teuthology.orchestra.run.smithi161.stdout:4080 writesame 0x52013e8 thru 0x52069b0 data_size 0x1(0x55c9 bytes) 2024-09-21T15:09:24.549 INFO:teuthology.orchestra.run.smithi161.stdout:3673 trunc from 0x25b54c6 to 0x9a05480 2024-09-21T15:09:24.557 INFO:teuthology.orchestra.run.smithi161.stdout:3979 trunc from 0xdf80158 to 0x53484a3 2024-09-21T15:09:24.595 INFO:teuthology.orchestra.run.smithi161.stdout:3202 read 0x3e6c7d3 thru 0x3e6ef4d (0x277b bytes) 2024-09-21T15:09:24.595 INFO:teuthology.orchestra.run.smithi161.stdout:3203 write 0xbb266b9 thru 0xbb2f293 (0x8bdb bytes) 2024-09-21T15:09:24.615 INFO:teuthology.orchestra.run.smithi161.stdout:3204 punch from 0x917e098 to 0x918315c, (0x50c4 bytes) 2024-09-21T15:09:24.615 INFO:teuthology.orchestra.run.smithi161.stdout:3206 read 0xc9c19a3 thru 0xc9c550a (0x3b68 bytes) 2024-09-21T15:09:24.615 INFO:teuthology.orchestra.run.smithi161.stdout:3207 write 0x4dcf1fa thru 0x4dd773e (0x8545 bytes) 2024-09-21T15:09:24.619 INFO:teuthology.orchestra.run.smithi161.stdout:4141 read 0x329f9cd thru 0x32a62d3 (0x6907 bytes) 2024-09-21T15:09:24.619 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.619 INFO:teuthology.orchestra.run.smithi161.stdout:3675 clone 33 order 20 su 4096 sc 7 2024-09-21T15:09:24.620 INFO:teuthology.orchestra.run.smithi161.stdout:4143 trunc from 0x6c44a0d to 0x665ec5f 2024-09-21T15:09:24.639 INFO:teuthology.orchestra.run.smithi161.stdout:4081 write 0xbce724a thru 0xbcee0ac (0x6e63 bytes) 2024-09-21T15:09:24.651 INFO:teuthology.orchestra.run.smithi161.stdout:4082 read 0x8bde66d thru 0x8bdf069 (0x9fd bytes) 2024-09-21T15:09:24.669 INFO:teuthology.orchestra.run.smithi161.stdout:4083 trunc from 0xbcee0ad to 0x7e03362 2024-09-21T15:09:24.671 INFO:teuthology.orchestra.run.smithi161.stdout:3208 trunc from 0xeac7d88 to 0x39f37a2 2024-09-21T15:09:24.714 INFO:teuthology.orchestra.run.smithi161.stdout:4144 write 0xb1287e9 thru 0xb13227b (0x9a93 bytes) 2024-09-21T15:09:24.736 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.736 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.736 INFO:teuthology.orchestra.run.smithi161.stdout:4087 read 0x265f9e9 thru 0x266e293 (0xe8ab bytes) 2024-09-21T15:09:24.750 INFO:teuthology.orchestra.run.smithi161.stdout:4088 trunc from 0x7e03362 to 0x463f0d 2024-09-21T15:09:24.764 INFO:teuthology.orchestra.run.smithi161.stdout:3981 write 0xd3d0832 thru 0xd3dd7e2 (0xcfb1 bytes) 2024-09-21T15:09:24.785 INFO:teuthology.orchestra.run.smithi161.stdout:3982 read 0xafb45fc thru 0xafbc62a (0x802f bytes) 2024-09-21T15:09:24.785 INFO:teuthology.orchestra.run.smithi161.stdout:3985 punch from 0x216b79a to 0x21745eb, (0x8e51 bytes) 2024-09-21T15:09:24.785 INFO:teuthology.orchestra.run.smithi161.stdout:3986 punch from 0x302acdc to 0x3032e84, (0x81a8 bytes) 2024-09-21T15:09:24.785 INFO:teuthology.orchestra.run.smithi161.stdout:3989 read 0x62b85e7 thru 0x62c078d (0x81a7 bytes) 2024-09-21T15:09:24.785 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.785 INFO:teuthology.orchestra.run.smithi161.stdout:3992 writesame 0xeb3af4 thru 0xebef04 data_size 0x1(0xb411 bytes) 2024-09-21T15:09:24.796 INFO:teuthology.orchestra.run.smithi161.stdout:4145 write 0xc4bac66 thru 0xc4c3ea8 (0x9243 bytes) 2024-09-21T15:09:24.812 INFO:teuthology.orchestra.run.smithi161.stdout:4147 read 0x6881cd0 thru 0x6884f03 (0x3234 bytes) 2024-09-21T15:09:24.812 INFO:teuthology.orchestra.run.smithi161.stdout:4149 writesame 0x8b9c54c thru 0x8ba8b12 data_size 0x7(0xc5c7 bytes) 2024-09-21T15:09:24.826 INFO:teuthology.orchestra.run.smithi161.stdout:4150 punch from 0x2fefc17 to 0x2ff5afd, (0x5ee6 bytes) 2024-09-21T15:09:24.826 INFO:teuthology.orchestra.run.smithi161.stdout:4151 write 0x5069d19 thru 0x506b09e (0x1386 bytes) 2024-09-21T15:09:24.827 INFO:teuthology.orchestra.run.smithi161.stdout:4089 punch from 0x1a360a to 0x1a9278, (0x5c6e bytes) 2024-09-21T15:09:24.835 INFO:teuthology.orchestra.run.smithi161.stdout:3993 write 0x6ed9c0a thru 0x6edbcdf (0x20d6 bytes) 2024-09-21T15:09:24.835 INFO:teuthology.orchestra.run.smithi161.stdout:4152 punch from 0x135d39b to 0x136bfbf, (0xec24 bytes) 2024-09-21T15:09:24.836 INFO:teuthology.orchestra.run.smithi161.stdout:4153 read 0x33ab83 thru 0x34472f (0x9bad bytes) 2024-09-21T15:09:24.837 INFO:teuthology.orchestra.run.smithi161.stdout:4154 write 0x6ed8a30 thru 0x6ee055b (0x7b2c bytes) 2024-09-21T15:09:24.847 INFO:teuthology.orchestra.run.smithi161.stdout:4090 trunc from 0x463f0d to 0xa4b57d6 2024-09-21T15:09:24.850 INFO:teuthology.orchestra.run.smithi161.stdout:4155 read 0x53d8c15 thru 0x53daf78 (0x2364 bytes) 2024-09-21T15:09:24.851 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.856 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.856 INFO:teuthology.orchestra.run.smithi161.stdout:3997 write 0x18b3fa7 thru 0x18ba815 (0x686f bytes) 2024-09-21T15:09:24.866 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone26 from 0xc769f17 (overlap 0xbb6d0a) to 0x383a4f 2024-09-21T15:09:24.873 INFO:teuthology.orchestra.run.smithi161.stdout:3210 trunc from 0x39f37a2 to 0x1b551d4 2024-09-21T15:09:24.888 INFO:teuthology.orchestra.run.smithi161.stdout:4091 write 0x73d26a5 thru 0x73da11c (0x7a78 bytes) 2024-09-21T15:09:24.893 INFO:teuthology.orchestra.run.smithi161.stdout:3999 punch from 0xc23594 to 0xc25542, (0x1fae bytes) 2024-09-21T15:09:24.893 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.893 INFO:teuthology.orchestra.run.smithi161.stdout:4001 write 0x3493d97 thru 0x34a16a1 (0xd90b bytes) 2024-09-21T15:09:24.908 INFO:teuthology.orchestra.run.smithi161.stdout:4092 write 0x1c099 thru 0x1c2ee (0x256 bytes) 2024-09-21T15:09:24.909 INFO:teuthology.orchestra.run.smithi161.stdout:4157 write 0xda96770 thru 0xda98abb (0x234c bytes) 2024-09-21T15:09:24.919 INFO:teuthology.orchestra.run.smithi161.stdout:4002 punch from 0xbb24b57 to 0xbb2f132, (0xa5db bytes) 2024-09-21T15:09:24.919 INFO:teuthology.orchestra.run.smithi161.stdout:4003 read 0x390b475 thru 0x39198c0 (0xe44c bytes) 2024-09-21T15:09:24.920 INFO:teuthology.orchestra.run.smithi161.stdout:4005 writesame 0x57087db thru 0x57106ba data_size 0x3a(0x7ee0 bytes) 2024-09-21T15:09:24.923 INFO:teuthology.orchestra.run.smithi161.stdout:4093 read 0x33c8cf0 thru 0x33ca89c (0x1bad bytes) 2024-09-21T15:09:24.929 INFO:teuthology.orchestra.run.smithi161.stdout:4158 read 0x8898c72 thru 0x88a210a (0x9499 bytes) 2024-09-21T15:09:24.930 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.930 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.930 INFO:teuthology.orchestra.run.smithi161.stdout:4162 write 0x80d13f0 thru 0x80dab52 (0x9763 bytes) 2024-09-21T15:09:24.938 INFO:teuthology.orchestra.run.smithi161.stdout:4006 write 0xb9e34f6 thru 0xb9e884d (0x5358 bytes) 2024-09-21T15:09:24.960 INFO:teuthology.orchestra.run.smithi161.stdout:4163 read 0x692d5da thru 0x69377c0 (0xa1e7 bytes) 2024-09-21T15:09:24.961 INFO:teuthology.orchestra.run.smithi161.stdout:4164 writesame 0x8f20bf2 thru 0x8f2b574 data_size 0x37(0xa983 bytes) 2024-09-21T15:09:24.971 INFO:teuthology.orchestra.run.smithi161.stdout:4007 punch from 0x4f3a2ba to 0x4f3d163, (0x2ea9 bytes) 2024-09-21T15:09:24.971 INFO:teuthology.orchestra.run.smithi161.stdout:4009 read 0xb51814c thru 0xb52036a (0x821f bytes) 2024-09-21T15:09:24.971 INFO:teuthology.orchestra.run.smithi161.stdout:4010 punch from 0x920e1ca to 0x920f260, (0x1096 bytes) 2024-09-21T15:09:24.971 INFO:teuthology.orchestra.run.smithi161.stdout:4011 punch from 0x4bb514d to 0x4bc3756, (0xe609 bytes) 2024-09-21T15:09:24.972 INFO:teuthology.orchestra.run.smithi161.stdout:4012 punch from 0xc2ae190 to 0xc2bc54a, (0xe3ba bytes) 2024-09-21T15:09:24.972 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.972 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:24.972 INFO:teuthology.orchestra.run.smithi161.stdout:4016 write 0x6aaa66a thru 0x6ab0cdf (0x6676 bytes) 2024-09-21T15:09:24.989 INFO:teuthology.orchestra.run.smithi161.stdout:4165 trunc from 0xda98abc to 0xa6625b9 2024-09-21T15:09:24.996 INFO:teuthology.orchestra.run.smithi161.stdout:4094 writesame 0xc685a07 thru 0xc68a532 data_size 0x11(0x4b2c bytes) 2024-09-21T15:09:24.999 INFO:teuthology.orchestra.run.smithi161.stdout:3212 write 0xba3fdfc thru 0xba42ea7 (0x30ac bytes) 2024-09-21T15:09:25.002 INFO:teuthology.orchestra.run.smithi161.stdout:4018 write 0x6b5b78d thru 0x6b6a512 (0xed86 bytes) 2024-09-21T15:09:25.013 INFO:teuthology.orchestra.run.smithi161.stdout:4095 write 0x8eb37e6 thru 0x8ec07e9 (0xd004 bytes) 2024-09-21T15:09:25.027 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:25.028 INFO:teuthology.orchestra.run.smithi161.stdout:3215 writesame 0x8040557 thru 0x8040f50 data_size 0x1(0x9fa bytes) 2024-09-21T15:09:25.030 INFO:teuthology.orchestra.run.smithi161.stdout:4097 write 0x6a0cfdc thru 0x6a1bbac (0xebd1 bytes) 2024-09-21T15:09:25.030 INFO:teuthology.orchestra.run.smithi161.stdout:4019 read 0x11ef09f thru 0x11f516a (0x60cc bytes) 2024-09-21T15:09:25.033 INFO:teuthology.orchestra.run.smithi161.stdout:4020 write 0x971a151 thru 0x971c688 (0x2538 bytes) 2024-09-21T15:09:25.047 INFO:teuthology.orchestra.run.smithi161.stdout:4098 read 0x54eca44 thru 0x54ee3f4 (0x19b1 bytes) 2024-09-21T15:09:25.047 INFO:teuthology.orchestra.run.smithi161.stdout:3217 read 0x74eaf32 thru 0x74f9dda (0xeea9 bytes) 2024-09-21T15:09:25.047 INFO:teuthology.orchestra.run.smithi161.stdout:3219 punch from 0x125ed8c to 0x1269e61, (0xb0d5 bytes) 2024-09-21T15:09:25.047 INFO:teuthology.orchestra.run.smithi161.stdout:3221 punch from 0x6240359 to 0x624262a, (0x22d1 bytes) 2024-09-21T15:09:25.048 INFO:teuthology.orchestra.run.smithi161.stdout:3222 write 0x6dbce96 thru 0x6dcaa12 (0xdb7d bytes) 2024-09-21T15:09:25.053 INFO:teuthology.orchestra.run.smithi161.stdout:4021 read 0x27caa3d thru 0x27d381f (0x8de3 bytes) 2024-09-21T15:09:25.056 INFO:teuthology.orchestra.run.smithi161.stdout:4022 write 0xce9dbb7 thru 0xcea52c8 (0x7712 bytes) 2024-09-21T15:09:25.066 INFO:teuthology.orchestra.run.smithi161.stdout:3223 write 0x1325612 thru 0x13292a3 (0x3c92 bytes) 2024-09-21T15:09:25.069 INFO:teuthology.orchestra.run.smithi161.stdout:4166 write 0x8b49094 thru 0x8b49caf (0xc1c bytes) 2024-09-21T15:09:25.072 INFO:teuthology.orchestra.run.smithi161.stdout:4023 read 0x5483007 thru 0x548a01e (0x7018 bytes) 2024-09-21T15:09:25.072 INFO:teuthology.orchestra.run.smithi161.stdout:4024 writesame 0xbf92064 thru 0xbf9575f data_size 0x33(0x36fc bytes) 2024-09-21T15:09:25.073 INFO:teuthology.orchestra.run.smithi161.stdout:3224 write 0x8899511 thru 0x889dff3 (0x4ae3 bytes) 2024-09-21T15:09:25.074 INFO:teuthology.orchestra.run.smithi161.stdout:4099 trunc from 0xc68a533 to 0x116cf8e 2024-09-21T15:09:25.079 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:25.085 INFO:teuthology.orchestra.run.smithi161.stdout:4027 trunc from 0xd3dd7e3 to 0xcf2bb7c 2024-09-21T15:09:25.087 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:25.087 INFO:teuthology.orchestra.run.smithi161.stdout:3228 read 0x7b18b75 thru 0x7b1d43d (0x48c9 bytes) 2024-09-21T15:09:25.087 INFO:teuthology.orchestra.run.smithi161.stdout:3229 writesame 0x85e0da0 thru 0x85f07f0 data_size 0x1(0xfa51 bytes) 2024-09-21T15:09:25.132 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #25, image image_cluster1.client.mirror.2-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent26 2024-09-21T15:09:25.139 INFO:teuthology.orchestra.run.smithi161.stdout:4100 read 0xce6c2c thru 0xcf25bd (0xb992 bytes) 2024-09-21T15:09:25.139 INFO:teuthology.orchestra.run.smithi161.stdout:3230 clone 38 order 21 su 131072 sc 10 2024-09-21T15:09:25.141 INFO:teuthology.orchestra.run.smithi161.stdout:4102 read 0x88e47 thru 0x8fcfa (0x6eb4 bytes) 2024-09-21T15:09:25.143 INFO:teuthology.orchestra.run.smithi161.stdout:4104 read 0x1911fc thru 0x198d8c (0x7b91 bytes) 2024-09-21T15:09:25.143 INFO:teuthology.orchestra.run.smithi161.stdout:4106 punch from 0x99d0f8 to 0x99ef9e, (0x1ea6 bytes) 2024-09-21T15:09:25.147 INFO:teuthology.orchestra.run.smithi161.stdout:4107 trunc from 0x116cf8e to 0x2d151d3 2024-09-21T15:09:25.150 INFO:teuthology.orchestra.run.smithi161.stdout:4169 write 0xc91b541 thru 0xc920dc4 (0x5884 bytes) 2024-09-21T15:09:25.157 INFO:teuthology.orchestra.run.smithi161.stdout:4030 write 0xa83d874 thru 0xa843b97 (0x6324 bytes) 2024-09-21T15:09:25.161 INFO:teuthology.orchestra.run.smithi161.stdout:4170 write 0x18a351b thru 0x18b1a17 (0xe4fd bytes) 2024-09-21T15:09:25.171 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:25.171 INFO:teuthology.orchestra.run.smithi161.stdout:4172 read 0x61af0b6 thru 0x61ba556 (0xb4a1 bytes) 2024-09-21T15:09:25.172 INFO:teuthology.orchestra.run.smithi161.stdout:4173 writesame 0x28abfb6 thru 0x28b5b24 data_size 0x1(0x9b6f bytes) 2024-09-21T15:09:25.175 INFO:teuthology.orchestra.run.smithi161.stdout:4031 write 0xc7d99f4 thru 0xc7e2115 (0x8722 bytes) 2024-09-21T15:09:25.179 INFO:teuthology.orchestra.run.smithi161.stdout:4108 read 0x1ee4654 thru 0x1ef2dad (0xe75a bytes) 2024-09-21T15:09:25.195 INFO:teuthology.orchestra.run.smithi161.stdout:4032 write 0x44059d2 thru 0x4411322 (0xb951 bytes) 2024-09-21T15:09:25.203 INFO:teuthology.orchestra.run.smithi161.stdout:4174 punch from 0x8fd6e6 to 0x9050f1, (0x7a0b bytes) 2024-09-21T15:09:25.203 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:25.203 INFO:teuthology.orchestra.run.smithi161.stdout:4179 write 0x71b4bd8 thru 0x71c2f84 (0xe3ad bytes) 2024-09-21T15:09:25.214 INFO:teuthology.orchestra.run.smithi161.stdout:4180 read 0x2bbcab1 thru 0x2bc9a90 (0xcfe0 bytes) 2024-09-21T15:09:25.215 INFO:teuthology.orchestra.run.smithi161.stdout:4181 punch from 0xa274677 to 0xa27c341, (0x7cca bytes) 2024-09-21T15:09:25.215 INFO:teuthology.orchestra.run.smithi161.stdout:4185 read 0x30e8ac6 thru 0x30f2bf7 (0xa132 bytes) 2024-09-21T15:09:25.215 INFO:teuthology.orchestra.run.smithi161.stdout:4033 writesame 0x57a0337 thru 0x57a6f24 data_size 0x2d(0x6bee bytes) 2024-09-21T15:09:25.215 INFO:teuthology.orchestra.run.smithi161.stdout:4186 write 0xafe2c8c thru 0xafeaea4 (0x8219 bytes) 2024-09-21T15:09:25.223 INFO:teuthology.orchestra.run.smithi161.stdout:4109 writesame 0xab5dd1c thru 0xab6952b data_size 0x9b(0xb810 bytes) 2024-09-21T15:09:25.223 INFO:teuthology.orchestra.run.smithi161.stdout:4034 read 0x834e5ea thru 0x8351d6a (0x3781 bytes) 2024-09-21T15:09:25.224 INFO:teuthology.orchestra.run.smithi161.stdout:4035 read 0x256b10b thru 0x256d0bb (0x1fb1 bytes) 2024-09-21T15:09:25.227 INFO:teuthology.orchestra.run.smithi161.stdout:4187 punch from 0xc811c15 to 0xc81c6b1, (0xaa9c bytes) 2024-09-21T15:09:25.227 INFO:teuthology.orchestra.run.smithi161.stdout:4188 punch from 0x7bedb2 to 0x7c6a1c, (0x7c6a bytes) 2024-09-21T15:09:25.230 INFO:teuthology.orchestra.run.smithi161.stdout:4110 write 0x142807f thru 0x143379b (0xb71d bytes) 2024-09-21T15:09:25.240 INFO:teuthology.orchestra.run.smithi161.stdout:4111 writesame 0x6252fea thru 0x625b967 data_size 0x1(0x897e bytes) 2024-09-21T15:09:25.248 INFO:teuthology.orchestra.run.smithi161.stdout:4189 trunc from 0xc920dc5 to 0xa52008 2024-09-21T15:09:25.255 INFO:teuthology.orchestra.run.smithi161.stdout:4036 write 0xe8ba49f thru 0xe8bc1a7 (0x1d09 bytes) 2024-09-21T15:09:25.272 INFO:teuthology.orchestra.run.smithi161.stdout:4113 clone 28 order 21 su 65536 sc 7 2024-09-21T15:09:25.281 INFO:teuthology.orchestra.run.smithi161.stdout:4037 read 0x798d4de thru 0x799449f (0x6fc2 bytes) 2024-09-21T15:09:25.281 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:25.281 INFO:teuthology.orchestra.run.smithi161.stdout:4040 read 0xd826943 thru 0xd82a7bd (0x3e7b bytes) 2024-09-21T15:09:25.281 INFO:teuthology.orchestra.run.smithi161.stdout:4041 punch from 0xa9acea8 to 0xa9b5e86, (0x8fde bytes) 2024-09-21T15:09:25.281 INFO:teuthology.orchestra.run.smithi161.stdout:4044 writesame 0x20b0479 thru 0x20b34a3 data_size 0xb(0x302b bytes) 2024-09-21T15:09:25.302 INFO:teuthology.orchestra.run.smithi161.stdout:4046 write 0xc87ca98 thru 0xc880e9e (0x4407 bytes) 2024-09-21T15:09:25.319 INFO:teuthology.orchestra.run.smithi161.stdout:4047 read 0xc353509 thru 0xc35760f (0x4107 bytes) 2024-09-21T15:09:25.321 INFO:teuthology.orchestra.run.smithi161.stdout:4190 read 0x7f7a21 thru 0x80478a (0xcd6a bytes) 2024-09-21T15:09:25.322 INFO:teuthology.orchestra.run.smithi161.stdout:4191 read 0x36fd25 thru 0x379a17 (0x9cf3 bytes) 2024-09-21T15:09:25.343 INFO:teuthology.orchestra.run.smithi161.stdout:4049 trunc from 0xe8bc1a8 to 0x28a4368 2024-09-21T15:09:25.374 INFO:teuthology.orchestra.run.smithi161.stdout:4192 write 0x6c75358 thru 0x6c78b6f (0x3818 bytes) 2024-09-21T15:09:25.383 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:25.383 INFO:teuthology.orchestra.run.smithi161.stdout:4195 write 0x2876497 thru 0x287ac97 (0x4801 bytes) 2024-09-21T15:09:25.421 INFO:teuthology.orchestra.run.smithi161.stdout:4050 punch from 0x13cba38 to 0x13d8f31, (0xd4f9 bytes) 2024-09-21T15:09:25.421 INFO:teuthology.orchestra.run.smithi161.stdout:4051 read 0x5fafe6 thru 0x607411 (0xc42c bytes) 2024-09-21T15:09:25.433 INFO:teuthology.orchestra.run.smithi161.stdout:4446 write 0xbe7a533 thru 0xbe8561d (0xb0eb bytes) 2024-09-21T15:09:25.435 INFO:teuthology.orchestra.run.smithi161.stdout:4052 trunc from 0x28a4368 to 0xa91dd23 2024-09-21T15:09:25.436 INFO:teuthology.orchestra.run.smithi161.stdout:4196 writesame 0xc62d662 thru 0xc631f6b data_size 0x1(0x490a bytes) 2024-09-21T15:09:25.443 INFO:teuthology.orchestra.run.smithi161.stdout:4197 write 0x80ae7c9 thru 0x80b5fa4 (0x77dc bytes) 2024-09-21T15:09:25.462 INFO:teuthology.orchestra.run.smithi161.stdout:4198 write 0xa37cf1b thru 0xa3802c5 (0x33ab bytes) 2024-09-21T15:09:25.478 INFO:teuthology.orchestra.run.smithi161.stdout:4200 writesame 0x9b7a16d thru 0x9b8572e data_size 0x6e(0xb5c2 bytes) 2024-09-21T15:09:25.493 INFO:teuthology.orchestra.run.smithi161.stdout:4201 write 0x9a84a36 thru 0x9a93737 (0xed02 bytes) 2024-09-21T15:09:25.512 INFO:teuthology.orchestra.run.smithi161.stdout:4202 writesame 0x995be45 thru 0x996329d data_size 0x73(0x7459 bytes) 2024-09-21T15:09:25.512 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:25.513 INFO:teuthology.orchestra.run.smithi161.stdout:4448 writesame 0x7a81c0a thru 0x7a8f792 data_size 0x1(0xdb89 bytes) 2024-09-21T15:09:25.519 INFO:teuthology.orchestra.run.smithi161.stdout:4053 write 0xde2bba8 thru 0xde2f795 (0x3bee bytes) 2024-09-21T15:09:25.530 INFO:teuthology.orchestra.run.smithi161.stdout:4203 read 0x1183203 thru 0x1186e96 (0x3c94 bytes) 2024-09-21T15:09:25.530 INFO:teuthology.orchestra.run.smithi161.stdout:4204 read 0x82a255c thru 0x82ac44c (0x9ef1 bytes) 2024-09-21T15:09:25.532 INFO:teuthology.orchestra.run.smithi161.stdout:4205 trunc from 0xc631f6c to 0xd1d3d32 2024-09-21T15:09:25.535 INFO:teuthology.orchestra.run.smithi161.stdout:4055 write 0xb9d61a9 thru 0xb9e464b (0xe4a3 bytes) 2024-09-21T15:09:25.563 INFO:teuthology.orchestra.run.smithi161.stdout:4450 punch from 0x43a0c5 to 0x43cd38, (0x2c73 bytes) 2024-09-21T15:09:25.571 INFO:teuthology.orchestra.run.smithi161.stdout:4057 writesame 0xa324885 thru 0xa324e80 data_size 0x2(0x5fc bytes) 2024-09-21T15:09:25.592 INFO:teuthology.orchestra.run.smithi161.stdout:4207 read 0x51056d8 thru 0x510fef3 (0xa81c bytes) 2024-09-21T15:09:25.593 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:25.593 INFO:teuthology.orchestra.run.smithi161.stdout:4209 read 0xd1123e0 thru 0xd114fc9 (0x2bea bytes) 2024-09-21T15:09:25.593 INFO:teuthology.orchestra.run.smithi161.stdout:4211 punch from 0x4c1265b to 0x4c13262, (0xc07 bytes) 2024-09-21T15:09:25.593 INFO:teuthology.orchestra.run.smithi161.stdout:4212 writesame 0x74140ce thru 0x7415b57 data_size 0x2(0x1a8a bytes) 2024-09-21T15:09:25.599 INFO:teuthology.orchestra.run.smithi161.stdout:4058 read 0x7acc43b thru 0x7ad1b25 (0x56eb bytes) 2024-09-21T15:09:25.599 INFO:teuthology.orchestra.run.smithi161.stdout:4059 write 0xc3cf633 thru 0xc3d6c79 (0x7647 bytes) 2024-09-21T15:09:25.611 INFO:teuthology.orchestra.run.smithi161.stdout:4451 writesame 0xe82941b thru 0xe837aff data_size 0x3(0xe6e5 bytes) 2024-09-21T15:09:25.613 INFO:teuthology.orchestra.run.smithi161.stdout:4215 read 0x8c3e6d5 thru 0x8c43b13 (0x543f bytes) 2024-09-21T15:09:25.616 INFO:teuthology.orchestra.run.smithi161.stdout:4217 write 0x6d2fdd2 thru 0x6d32928 (0x2b57 bytes) 2024-09-21T15:09:25.617 INFO:teuthology.orchestra.run.smithi161.stdout:4452 write 0x87a3e6d thru 0x87b3c83 (0xfe17 bytes) 2024-09-21T15:09:25.618 INFO:teuthology.orchestra.run.smithi161.stdout:4060 write 0xbba23a0 thru 0xbba9387 (0x6fe8 bytes) 2024-09-21T15:09:25.640 INFO:teuthology.orchestra.run.smithi161.stdout:4061 write 0x9e12b48 thru 0x9e1ccd7 (0xa190 bytes) 2024-09-21T15:09:25.644 INFO:teuthology.orchestra.run.smithi161.stdout:4218 trunc from 0xd1d3d32 to 0x506423e 2024-09-21T15:09:25.659 INFO:teuthology.orchestra.run.smithi161.stdout:4062 writesame 0x365f95f thru 0x36642fb data_size 0x1(0x499d bytes) 2024-09-21T15:09:25.661 INFO:teuthology.orchestra.run.smithi161.stdout:4453 read 0xa38a4b thru 0xa45940 (0xcef6 bytes) 2024-09-21T15:09:25.685 INFO:teuthology.orchestra.run.smithi161.stdout:4454 trunc from 0xe837b00 to 0x3d26822 2024-09-21T15:09:25.687 INFO:teuthology.orchestra.run.smithi161.stdout:4064 write 0x89bb157 thru 0x89c7379 (0xc223 bytes) 2024-09-21T15:09:25.707 INFO:teuthology.orchestra.run.smithi161.stdout:4220 read 0x44da641 thru 0x44db87c (0x123c bytes) 2024-09-21T15:09:25.721 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:25.721 INFO:teuthology.orchestra.run.smithi161.stdout:4066 write 0xc7fb4bd thru 0xc8083b5 (0xcef9 bytes) 2024-09-21T15:09:25.726 INFO:teuthology.orchestra.run.smithi161.stdout:4221 trunc from 0x506423e to 0xda0b71d 2024-09-21T15:09:25.742 INFO:teuthology.orchestra.run.smithi161.stdout:4067 read 0xb38620 thru 0xb39e38 (0x1819 bytes) 2024-09-21T15:09:25.743 INFO:teuthology.orchestra.run.smithi161.stdout:4068 punch from 0x1c93a96 to 0x1c9d77c, (0x9ce6 bytes) 2024-09-21T15:09:25.743 INFO:teuthology.orchestra.run.smithi161.stdout:4069 read 0xd5c948e thru 0xd5cf503 (0x6076 bytes) 2024-09-21T15:09:25.743 INFO:teuthology.orchestra.run.smithi161.stdout:4070 write 0x27ad6ab thru 0x27aeca4 (0x15fa bytes) 2024-09-21T15:09:25.763 INFO:teuthology.orchestra.run.smithi161.stdout:4222 read 0x759ef9c thru 0x75a5e97 (0x6efc bytes) 2024-09-21T15:09:25.763 INFO:teuthology.orchestra.run.smithi161.stdout:4224 read 0x5ba987c thru 0x5bad634 (0x3db9 bytes) 2024-09-21T15:09:25.771 INFO:teuthology.orchestra.run.smithi161.stdout:4071 write 0x2adff00 thru 0x2ae9397 (0x9498 bytes) 2024-09-21T15:09:25.781 INFO:teuthology.orchestra.run.smithi161.stdout:4225 trunc from 0xda0b71d to 0x5e5be82 2024-09-21T15:09:25.789 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone37 from 0xba42ea8 (overlap 0x1b551d4) to 0x5776c4 2024-09-21T15:09:25.789 INFO:teuthology.orchestra.run.smithi161.stdout:4072 read 0xbb5c2de thru 0xbb663de (0xa101 bytes) 2024-09-21T15:09:25.790 INFO:teuthology.orchestra.run.smithi161.stdout:4073 punch from 0xa6b067b to 0xa6b16cc, (0x1051 bytes) 2024-09-21T15:09:25.791 INFO:teuthology.orchestra.run.smithi161.stdout:4077 write 0x9c3b9a7 thru 0x9c4b99e (0xfff8 bytes) 2024-09-21T15:09:25.822 INFO:teuthology.orchestra.run.smithi161.stdout:4078 write 0x892e5d4 thru 0x8930a07 (0x2434 bytes) 2024-09-21T15:09:25.827 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone32 from 0x9a05480 (overlap 0x25b54c6) to 0x0 2024-09-21T15:09:25.852 INFO:teuthology.orchestra.run.smithi161.stdout:4079 trunc from 0xde2f796 to 0xced4511 2024-09-21T15:09:25.855 INFO:teuthology.orchestra.run.smithi161.stdout:4227 writesame 0x33db6b9 thru 0x33eb0cd data_size 0x1(0xfa15 bytes) 2024-09-21T15:09:25.884 INFO:teuthology.orchestra.run.smithi161.stdout:4455 write 0xa801603 thru 0xa8023cb (0xdc9 bytes) 2024-09-21T15:09:25.926 INFO:teuthology.orchestra.run.smithi161.stdout:4230 write 0x5a67748 thru 0x5a6f639 (0x7ef2 bytes) 2024-09-21T15:09:25.936 INFO:teuthology.orchestra.run.smithi161.stdout:4456 punch from 0x656c490 to 0x656f4a3, (0x3013 bytes) 2024-09-21T15:09:25.936 INFO:teuthology.orchestra.run.smithi161.stdout:4458 read 0x6f10e40 thru 0x6f15697 (0x4858 bytes) 2024-09-21T15:09:25.936 INFO:teuthology.orchestra.run.smithi161.stdout:4459 read 0x314888 thru 0x31f225 (0xa99e bytes) 2024-09-21T15:09:25.948 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:25.950 INFO:teuthology.orchestra.run.smithi161.stdout:4460 read 0x4b2a727 thru 0x4b2ac34 (0x50e bytes) 2024-09-21T15:09:25.950 INFO:teuthology.orchestra.run.smithi161.stdout:4461 write 0x518b96c thru 0x519aadf (0xf174 bytes) 2024-09-21T15:09:25.992 INFO:teuthology.orchestra.run.smithi161.stdout:4462 clone 28 order 20 su 16384 sc 4 2024-09-21T15:09:25.998 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.002 INFO:teuthology.orchestra.run.smithi161.stdout:4233 writesame 0x99b25fc thru 0x99b8809 data_size 0x16(0x620e bytes) 2024-09-21T15:09:26.008 INFO:teuthology.orchestra.run.smithi161.stdout:4234 write 0x8019e37 thru 0x802577c (0xb946 bytes) 2024-09-21T15:09:26.020 INFO:teuthology.orchestra.run.smithi161.stdout:4235 read 0x7f52726 thru 0x7f5c12a (0x9a05 bytes) 2024-09-21T15:09:26.029 INFO:teuthology.orchestra.run.smithi161.stdout:4082 writesame 0xea3d8df thru 0xea3e2ec data_size 0x21(0xa0e bytes) 2024-09-21T15:09:26.029 INFO:teuthology.orchestra.run.smithi161.stdout:4236 trunc from 0x99b880a to 0xcd685fc 2024-09-21T15:09:26.032 INFO:teuthology.orchestra.run.smithi161.stdout:4084 write 0x688efd thru 0x692067 (0x916b bytes) 2024-09-21T15:09:26.055 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #26, image image_cluster1.client.mirror.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent27 2024-09-21T15:09:26.058 INFO:teuthology.orchestra.run.smithi161.stdout:4086 write 0xaa77f5c thru 0xaa7f809 (0x78ae bytes) 2024-09-21T15:09:26.067 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #36, image image_cluster1.client.mirror.3-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent37 2024-09-21T15:09:26.074 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xec99b84 2024-09-21T15:09:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:4238 trunc from 0xcd685fc to 0xec99b84 2024-09-21T15:09:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:4089 punch from 0x1f579a8 to 0x1f5d341, (0x5999 bytes) 2024-09-21T15:09:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:4090 read 0x44e0f6a thru 0x44e51b9 (0x4250 bytes) 2024-09-21T15:09:26.079 INFO:teuthology.orchestra.run.smithi161.stdout:4091 read 0xc7e381b thru 0xc7f01e5 (0xc9cb bytes) 2024-09-21T15:09:26.081 INFO:teuthology.orchestra.run.smithi161.stdout:4092 write 0x8203582 thru 0x82069fc (0x347b bytes) 2024-09-21T15:09:26.095 INFO:teuthology.orchestra.run.smithi161.stdout:4094 write 0x2acf238 thru 0x2addc07 (0xe9d0 bytes) 2024-09-21T15:09:26.108 INFO:teuthology.orchestra.run.smithi161.stdout:4095 write 0x141e9af thru 0x142d2dc (0xe92e bytes) 2024-09-21T15:09:26.114 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.114 INFO:teuthology.orchestra.run.smithi161.stdout:4240 write 0x438bcf1 thru 0x4399838 (0xdb48 bytes) 2024-09-21T15:09:26.128 INFO:teuthology.orchestra.run.smithi161.stdout:4241 write 0xe4de7a5 thru 0xe4e674b (0x7fa7 bytes) 2024-09-21T15:09:26.139 INFO:teuthology.orchestra.run.smithi161.stdout:4096 write 0xd7e513f thru 0xd7efdd1 (0xac93 bytes) 2024-09-21T15:09:26.146 INFO:teuthology.orchestra.run.smithi161.stdout:4242 write 0x3a9fba7 thru 0x3aa1ee0 (0x233a bytes) 2024-09-21T15:09:26.147 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #31, image image_cluster1.client.mirror.4-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent32 2024-09-21T15:09:26.153 INFO:teuthology.orchestra.run.smithi161.stdout:4243 read 0xcf3df04 thru 0xcf42830 (0x492d bytes) 2024-09-21T15:09:26.156 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.156 INFO:teuthology.orchestra.run.smithi161.stdout:4098 write 0x6a6b94 thru 0x6b2a4f (0xbebc bytes) 2024-09-21T15:09:26.165 INFO:teuthology.orchestra.run.smithi161.stdout:4244 trunc from 0xec99b84 to 0x9056945 2024-09-21T15:09:26.179 INFO:teuthology.orchestra.run.smithi161.stdout:4100 read 0x9edbcd0 thru 0x9edcf79 (0x12aa bytes) 2024-09-21T15:09:26.179 INFO:teuthology.orchestra.run.smithi161.stdout:4101 write 0x8a8c6b6 thru 0x8a9101b (0x4966 bytes) 2024-09-21T15:09:26.200 INFO:teuthology.orchestra.run.smithi161.stdout:4103 read 0x47556 thru 0x567ce (0xf279 bytes) 2024-09-21T15:09:26.202 INFO:teuthology.orchestra.run.smithi161.stdout:4104 writesame 0x4098a3f thru 0x409db9c data_size 0x5(0x515e bytes) 2024-09-21T15:09:26.213 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.213 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.226 INFO:teuthology.orchestra.run.smithi161.stdout:4105 writesame 0x25978c thru 0x259b4e data_size 0x3(0x3c3 bytes) 2024-09-21T15:09:26.227 INFO:teuthology.orchestra.run.smithi161.stdout:4245 writesame 0x882d210 thru 0x883a567 data_size 0x4(0xd358 bytes) 2024-09-21T15:09:26.251 INFO:teuthology.orchestra.run.smithi161.stdout:4246 read 0x8c2af06 thru 0x8c37e9f (0xcf9a bytes) 2024-09-21T15:09:26.262 INFO:teuthology.orchestra.run.smithi161.stdout:4248 trunc from 0x9056945 to 0xdf57daa 2024-09-21T15:09:26.270 INFO:teuthology.orchestra.run.smithi161.stdout:3678 write 0xc185e62 thru 0xc194a76 (0xec15 bytes) 2024-09-21T15:09:26.275 INFO:teuthology.orchestra.run.smithi161.stdout:4106 trunc from 0xea3e2ed to 0x15c4eb6 2024-09-21T15:09:26.301 INFO:teuthology.orchestra.run.smithi161.stdout:3679 write 0xd9a68c thru 0xda27ff (0x8174 bytes) 2024-09-21T15:09:26.302 INFO:teuthology.orchestra.run.smithi161.stdout:4114 writesame 0xc55d6ce thru 0xc560b35 data_size 0x27(0x3468 bytes) 2024-09-21T15:09:26.311 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.311 INFO:teuthology.orchestra.run.smithi161.stdout:4251 read 0xb1d88c thru 0xb2278f (0x4f04 bytes) 2024-09-21T15:09:26.313 INFO:teuthology.orchestra.run.smithi161.stdout:4116 read 0x81b0805 thru 0x81b9156 (0x8952 bytes) 2024-09-21T15:09:26.314 INFO:teuthology.orchestra.run.smithi161.stdout:4252 read 0x9e7b46f thru 0x9e8228d (0x6e1f bytes) 2024-09-21T15:09:26.314 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.314 INFO:teuthology.orchestra.run.smithi161.stdout:4119 read 0x60ea57f thru 0x60f58f8 (0xb37a bytes) 2024-09-21T15:09:26.314 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.314 INFO:teuthology.orchestra.run.smithi161.stdout:4254 read 0x7e03130 thru 0x7e0820c (0x50dd bytes) 2024-09-21T15:09:26.315 INFO:teuthology.orchestra.run.smithi161.stdout:4120 read 0x8ad0de0 thru 0x8add78d (0xc9ae bytes) 2024-09-21T15:09:26.318 INFO:teuthology.orchestra.run.smithi161.stdout:4121 read 0x50df8d3 thru 0x50e49d4 (0x5102 bytes) 2024-09-21T15:09:26.320 INFO:teuthology.orchestra.run.smithi161.stdout:4255 trunc from 0xdf57daa to 0xc926b55 2024-09-21T15:09:26.330 INFO:teuthology.orchestra.run.smithi161.stdout:4123 trunc from 0xc560b36 to 0xeb7348f 2024-09-21T15:09:26.390 INFO:teuthology.orchestra.run.smithi161.stdout:4256 read 0x3270b18 thru 0x32786be (0x7ba7 bytes) 2024-09-21T15:09:26.391 INFO:teuthology.orchestra.run.smithi161.stdout:4257 write 0x885ab5f thru 0x885d26b (0x270d bytes) 2024-09-21T15:09:26.411 INFO:teuthology.orchestra.run.smithi161.stdout:4108 trunc from 0x15c4eb6 to 0x37b9906 2024-09-21T15:09:26.414 INFO:teuthology.orchestra.run.smithi161.stdout:4258 write 0xb23e37c thru 0xb24391c (0x55a1 bytes) 2024-09-21T15:09:26.424 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.424 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.438 INFO:teuthology.orchestra.run.smithi161.stdout:4128 trunc from 0xeb7348f to 0x84af586 2024-09-21T15:09:26.454 INFO:teuthology.orchestra.run.smithi161.stdout:4109 trunc from 0x37b9906 to 0x87a547c 2024-09-21T15:09:26.486 INFO:teuthology.orchestra.run.smithi161.stdout:4259 write 0x95a6ac4 thru 0x95abe33 (0x5370 bytes) 2024-09-21T15:09:26.491 INFO:teuthology.orchestra.run.smithi161.stdout:3681 punch from 0x54e081a to 0x54e31e0, (0x29c6 bytes) 2024-09-21T15:09:26.491 INFO:teuthology.orchestra.run.smithi161.stdout:3683 punch from 0x8fb347b to 0x8fb8c18, (0x579d bytes) 2024-09-21T15:09:26.491 INFO:teuthology.orchestra.run.smithi161.stdout:3684 write 0xb12389a thru 0xb12ea8e (0xb1f5 bytes) 2024-09-21T15:09:26.503 INFO:teuthology.orchestra.run.smithi161.stdout:4110 trunc from 0x87a547c to 0x92a896c 2024-09-21T15:09:26.504 INFO:teuthology.orchestra.run.smithi161.stdout:4260 write 0x288df51 thru 0x28942e9 (0x6399 bytes) 2024-09-21T15:09:26.518 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.518 INFO:teuthology.orchestra.run.smithi161.stdout:4262 punch from 0x6a4923b to 0x6a50993, (0x7758 bytes) 2024-09-21T15:09:26.518 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.518 INFO:teuthology.orchestra.run.smithi161.stdout:4267 write 0x38ebfcb thru 0x38ef857 (0x388d bytes) 2024-09-21T15:09:26.521 INFO:teuthology.orchestra.run.smithi161.stdout:3685 punch from 0x62a6ee1 to 0x62a77ee, (0x90d bytes) 2024-09-21T15:09:26.521 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.527 INFO:teuthology.orchestra.run.smithi161.stdout:3687 trunc from 0xc194a77 to 0x97934d2 2024-09-21T15:09:26.528 INFO:teuthology.orchestra.run.smithi161.stdout:4130 read 0x1ad12de thru 0x1ad6fff (0x5d22 bytes) 2024-09-21T15:09:26.533 INFO:teuthology.orchestra.run.smithi161.stdout:4111 punch from 0xf66954 to 0xf6be75, (0x5521 bytes) 2024-09-21T15:09:26.534 INFO:teuthology.orchestra.run.smithi161.stdout:4112 write 0x41f0619 thru 0x41fbb40 (0xb528 bytes) 2024-09-21T15:09:26.570 INFO:teuthology.orchestra.run.smithi161.stdout:4268 write 0xda5919c thru 0xda61719 (0x857e bytes) 2024-09-21T15:09:26.578 INFO:teuthology.orchestra.run.smithi161.stdout:4131 writesame 0xac4e4fd thru 0xac5aa3c data_size 0x60(0xc540 bytes) 2024-09-21T15:09:26.582 INFO:teuthology.orchestra.run.smithi161.stdout:4133 read 0x3e5f377 thru 0x3e68901 (0x958b bytes) 2024-09-21T15:09:26.583 INFO:teuthology.orchestra.run.smithi161.stdout:4270 read 0xb98aded thru 0xb98b777 (0x98b bytes) 2024-09-21T15:09:26.584 INFO:teuthology.orchestra.run.smithi161.stdout:4271 write 0x4b7db92 thru 0x4b8412c (0x659b bytes) 2024-09-21T15:09:26.598 INFO:teuthology.orchestra.run.smithi161.stdout:4272 read 0x1757917 thru 0x175e448 (0x6b32 bytes) 2024-09-21T15:09:26.599 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.604 INFO:teuthology.orchestra.run.smithi161.stdout:4113 writesame 0xaf1eeda thru 0xaf209d5 data_size 0x16(0x1afc bytes) 2024-09-21T15:09:26.612 INFO:teuthology.orchestra.run.smithi161.stdout:4114 read 0x41cf697 thru 0x41ddabb (0xe425 bytes) 2024-09-21T15:09:26.612 INFO:teuthology.orchestra.run.smithi161.stdout:4115 read 0x808bb95 thru 0x809287e (0x6cea bytes) 2024-09-21T15:09:26.612 INFO:teuthology.orchestra.run.smithi161.stdout:4116 write 0x7ccd517 thru 0x7cdd20a (0xfcf4 bytes) 2024-09-21T15:09:26.631 INFO:teuthology.orchestra.run.smithi161.stdout:3231 read 0x4e5d7cd thru 0x4e6a785 (0xcfb9 bytes) 2024-09-21T15:09:26.633 INFO:teuthology.orchestra.run.smithi161.stdout:4135 write 0xb1574a7 thru 0xb162e54 (0xb9ae bytes) 2024-09-21T15:09:26.638 INFO:teuthology.orchestra.run.smithi161.stdout:4117 write 0xa6beb0 thru 0xa6d302 (0x1453 bytes) 2024-09-21T15:09:26.644 INFO:teuthology.orchestra.run.smithi161.stdout:3691 read 0x79152e0 thru 0x791daca (0x87eb bytes) 2024-09-21T15:09:26.645 INFO:teuthology.orchestra.run.smithi161.stdout:3692 trunc from 0x97934d2 to 0x9bacfc5 2024-09-21T15:09:26.646 INFO:teuthology.orchestra.run.smithi161.stdout:4274 write 0xe0f88bb thru 0xe0fe51d (0x5c63 bytes) 2024-09-21T15:09:26.653 INFO:teuthology.orchestra.run.smithi161.stdout:4136 trunc from 0xb162e55 to 0xd972b0d 2024-09-21T15:09:26.658 INFO:teuthology.orchestra.run.smithi161.stdout:4118 read 0x8cf870c thru 0x8d0312d (0xaa22 bytes) 2024-09-21T15:09:26.659 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.659 INFO:teuthology.orchestra.run.smithi161.stdout:4120 writesame 0x42c8d24 thru 0x42cbc19 data_size 0x1(0x2ef6 bytes) 2024-09-21T15:09:26.666 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.666 INFO:teuthology.orchestra.run.smithi161.stdout:4276 read 0x6139bef thru 0x6148502 (0xe914 bytes) 2024-09-21T15:09:26.667 INFO:teuthology.orchestra.run.smithi161.stdout:4277 write 0xc55ea8d thru 0xc566086 (0x75fa bytes) 2024-09-21T15:09:26.688 INFO:teuthology.orchestra.run.smithi161.stdout:4278 write 0xb7f487e thru 0xb7ff47c (0xabff bytes) 2024-09-21T15:09:26.697 INFO:teuthology.orchestra.run.smithi161.stdout:3693 punch from 0x16ffecf to 0x170c180, (0xc2b1 bytes) 2024-09-21T15:09:26.700 INFO:teuthology.orchestra.run.smithi161.stdout:3232 write 0xbc50121 thru 0xbc5d117 (0xcff7 bytes) 2024-09-21T15:09:26.707 INFO:teuthology.orchestra.run.smithi161.stdout:4279 punch from 0xa099812 to 0xa09cf73, (0x3761 bytes) 2024-09-21T15:09:26.707 INFO:teuthology.orchestra.run.smithi161.stdout:4282 punch from 0x5f2fbab to 0x5f316d9, (0x1b2e bytes) 2024-09-21T15:09:26.708 INFO:teuthology.orchestra.run.smithi161.stdout:4284 write 0xa49a309 thru 0xa49ee77 (0x4b6f bytes) 2024-09-21T15:09:26.721 INFO:teuthology.orchestra.run.smithi161.stdout:4285 writesame 0xbe9f7e thru 0xbeeed9 data_size 0x6(0x4f5c bytes) 2024-09-21T15:09:26.726 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.726 INFO:teuthology.orchestra.run.smithi161.stdout:4138 read 0xce98af9 thru 0xce9f1fc (0x6704 bytes) 2024-09-21T15:09:26.726 INFO:teuthology.orchestra.run.smithi161.stdout:4139 read 0xcf72d02 thru 0xcf7976a (0x6a69 bytes) 2024-09-21T15:09:26.731 INFO:teuthology.orchestra.run.smithi161.stdout:3233 write 0xa0abd1e thru 0xa0b6b4e (0xae31 bytes) 2024-09-21T15:09:26.731 INFO:teuthology.orchestra.run.smithi161.stdout:4286 writesame 0x1daac21 thru 0x1db07f9 data_size 0x1(0x5bd9 bytes) 2024-09-21T15:09:26.732 INFO:teuthology.orchestra.run.smithi161.stdout:4121 write 0xc2b7c2c thru 0xc2bd28a (0x565f bytes) 2024-09-21T15:09:26.735 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone27 from 0xa8023cc (overlap 0x3d26822) to 0x1875cda 2024-09-21T15:09:26.739 INFO:teuthology.orchestra.run.smithi161.stdout:4140 trunc from 0xd972b0d to 0x8a60de7 2024-09-21T15:09:26.745 INFO:teuthology.orchestra.run.smithi161.stdout:3695 write 0xbd745da thru 0xbd77c4f (0x3676 bytes) 2024-09-21T15:09:26.754 INFO:teuthology.orchestra.run.smithi161.stdout:4123 writesame 0x970d2aa thru 0x97162c6 data_size 0x1(0x901d bytes) 2024-09-21T15:09:26.755 INFO:teuthology.orchestra.run.smithi161.stdout:3234 punch from 0x65c845 to 0x6632e6, (0x6aa1 bytes) 2024-09-21T15:09:26.756 INFO:teuthology.orchestra.run.smithi161.stdout:4287 write 0x3193586 thru 0x319d6dd (0xa158 bytes) 2024-09-21T15:09:26.759 INFO:teuthology.orchestra.run.smithi161.stdout:3235 trunc from 0xbc5d118 to 0xab0319b 2024-09-21T15:09:26.788 INFO:teuthology.orchestra.run.smithi161.stdout:4288 write 0x2f2854a thru 0x2f33d0a (0xb7c1 bytes) 2024-09-21T15:09:26.802 INFO:teuthology.orchestra.run.smithi161.stdout:3696 writesame 0xbae3edb thru 0xbaf1d62 data_size 0x4(0xde88 bytes) 2024-09-21T15:09:26.820 INFO:teuthology.orchestra.run.smithi161.stdout:4289 read 0x5f2bf9 thru 0x600eee (0xe2f6 bytes) 2024-09-21T15:09:26.823 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.823 INFO:teuthology.orchestra.run.smithi161.stdout:4291 write 0xb630f21 thru 0xb63bab4 (0xab94 bytes) 2024-09-21T15:09:26.856 INFO:teuthology.orchestra.run.smithi161.stdout:3697 trunc from 0xbd77c50 to 0xdaa3c5c 2024-09-21T15:09:26.859 INFO:teuthology.orchestra.run.smithi161.stdout:4292 read 0x7646df2 thru 0x764aa53 (0x3c62 bytes) 2024-09-21T15:09:26.874 INFO:teuthology.orchestra.run.smithi161.stdout:4295 punch from 0x9637612 to 0x963d076, (0x5a64 bytes) 2024-09-21T15:09:26.874 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.874 INFO:teuthology.orchestra.run.smithi161.stdout:4297 read 0x4522411 thru 0x452d1c1 (0xadb1 bytes) 2024-09-21T15:09:26.875 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:26.875 INFO:teuthology.orchestra.run.smithi161.stdout:4299 writesame 0x74fd506 thru 0x750a3ab data_size 0x9(0xcea6 bytes) 2024-09-21T15:09:26.885 INFO:teuthology.orchestra.run.smithi161.stdout:4124 write 0xed751bb thru 0xed80e6a (0xbcb0 bytes) 2024-09-21T15:09:26.894 INFO:teuthology.orchestra.run.smithi161.stdout:4300 punch from 0x1e7e76f to 0x1e81dee, (0x367f bytes) 2024-09-21T15:09:26.895 INFO:teuthology.orchestra.run.smithi161.stdout:4301 writesame 0x9c7845f thru 0x9c7cc56 data_size 0x1c(0x47f8 bytes) 2024-09-21T15:09:26.916 INFO:teuthology.orchestra.run.smithi161.stdout:4302 writesame 0x7d0ad03 thru 0x7d11ec6 data_size 0x12(0x71c4 bytes) 2024-09-21T15:09:26.926 INFO:teuthology.orchestra.run.smithi161.stdout:3698 read 0x375e826 thru 0x376234e (0x3b29 bytes) 2024-09-21T15:09:26.935 INFO:teuthology.orchestra.run.smithi161.stdout:4128 punch from 0x71647c4 to 0x716cd91, (0x85cd bytes) 2024-09-21T15:09:26.935 INFO:teuthology.orchestra.run.smithi161.stdout:4129 punch from 0xce23280 to 0xce31a1b, (0xe79b bytes) 2024-09-21T15:09:26.935 INFO:teuthology.orchestra.run.smithi161.stdout:3699 trunc from 0xdaa3c5c to 0x8c41f4c 2024-09-21T15:09:26.936 INFO:teuthology.orchestra.run.smithi161.stdout:4130 read 0x75a1d4a thru 0x75af605 (0xd8bc bytes) 2024-09-21T15:09:26.936 INFO:teuthology.orchestra.run.smithi161.stdout:4131 read 0x8b8de21 thru 0x8b9d03e (0xf21e bytes) 2024-09-21T15:09:26.936 INFO:teuthology.orchestra.run.smithi161.stdout:4304 write 0x356ec4c thru 0x3577223 (0x85d8 bytes) 2024-09-21T15:09:26.940 INFO:teuthology.orchestra.run.smithi161.stdout:3236 write 0x4f6882d thru 0x4f71330 (0x8b04 bytes) 2024-09-21T15:09:26.943 INFO:teuthology.orchestra.run.smithi161.stdout:4132 trunc from 0xed80e6b to 0xa76321b 2024-09-21T15:09:26.957 INFO:teuthology.orchestra.run.smithi161.stdout:4305 write 0x65639b3 thru 0x6570116 (0xc764 bytes) 2024-09-21T15:09:26.982 INFO:teuthology.orchestra.run.smithi161.stdout:4306 writesame 0x850de6 thru 0x85693e data_size 0x5(0x5b59 bytes) 2024-09-21T15:09:26.983 INFO:teuthology.orchestra.run.smithi161.stdout:3237 read 0x8092a81 thru 0x80a2623 (0xfba3 bytes) 2024-09-21T15:09:26.986 INFO:teuthology.orchestra.run.smithi161.stdout:3238 write 0x7fafdff thru 0x7fbe454 (0xe656 bytes) 2024-09-21T15:09:27.000 INFO:teuthology.orchestra.run.smithi161.stdout:4143 write 0xd6e77c3 thru 0xd6e7833 (0x71 bytes) 2024-09-21T15:09:27.003 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:27.003 INFO:teuthology.orchestra.run.smithi161.stdout:4308 read 0xc942ff7 thru 0xc951f02 (0xef0c bytes) 2024-09-21T15:09:27.004 INFO:teuthology.orchestra.run.smithi161.stdout:4309 read 0x70820ab thru 0x7088c78 (0x6bce bytes) 2024-09-21T15:09:27.004 INFO:teuthology.orchestra.run.smithi161.stdout:4311 write 0x2baea27 thru 0x2bb7a32 (0x900c bytes) 2024-09-21T15:09:27.022 INFO:teuthology.orchestra.run.smithi161.stdout:3239 read 0x3444bef thru 0x3452fcd (0xe3df bytes) 2024-09-21T15:09:27.023 INFO:teuthology.orchestra.run.smithi161.stdout:4144 writesame 0x3adcf39 thru 0x3ae4de0 data_size 0x1c(0x7ea8 bytes) 2024-09-21T15:09:27.024 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:27.025 INFO:teuthology.orchestra.run.smithi161.stdout:4314 trunc from 0xe0fe51e to 0xda68ac3 2024-09-21T15:09:27.025 INFO:teuthology.orchestra.run.smithi161.stdout:3240 trunc from 0xab0319b to 0x928e525 2024-09-21T15:09:27.049 INFO:teuthology.orchestra.run.smithi161.stdout:4133 write 0x98102c5 thru 0x9815961 (0x569d bytes) 2024-09-21T15:09:27.057 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:27.057 INFO:teuthology.orchestra.run.smithi161.stdout:4147 read 0x8585a05 thru 0x858890f (0x2f0b bytes) 2024-09-21T15:09:27.059 INFO:teuthology.orchestra.run.smithi161.stdout:4148 punch from 0xa5ceb5d to 0xa5dbf48, (0xd3eb bytes) 2024-09-21T15:09:27.059 INFO:teuthology.orchestra.run.smithi161.stdout:4149 read 0x7aa8766 thru 0x7ab3b62 (0xb3fd bytes) 2024-09-21T15:09:27.070 INFO:teuthology.orchestra.run.smithi161.stdout:4150 trunc from 0xd6e7834 to 0x8b02dca 2024-09-21T15:09:27.075 INFO:teuthology.orchestra.run.smithi161.stdout:4134 write 0x45a7ae6 thru 0x45b2604 (0xab1f bytes) 2024-09-21T15:09:27.116 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:27.116 INFO:teuthology.orchestra.run.smithi161.stdout:4136 writesame 0x4ef8c16 thru 0x4f032a8 data_size 0x1(0xa693 bytes) 2024-09-21T15:09:27.121 INFO:teuthology.orchestra.run.smithi161.stdout:3700 clone 34 order 23 su 4194304 sc 15 2024-09-21T15:09:27.177 INFO:teuthology.orchestra.run.smithi161.stdout:4138 writesame 0x314d65e thru 0x31517da data_size 0x7(0x417d bytes) 2024-09-21T15:09:27.204 INFO:teuthology.orchestra.run.smithi161.stdout:4139 read 0x81b16f9 thru 0x81b8ce3 (0x75eb bytes) 2024-09-21T15:09:27.212 INFO:teuthology.orchestra.run.smithi161.stdout:4141 trunc from 0xa76321b to 0xd6d2582 2024-09-21T15:09:27.218 INFO:teuthology.orchestra.run.smithi161.stdout:3243 trunc from 0x928e525 to 0x3fbf15d 2024-09-21T15:09:27.234 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:27.242 INFO:teuthology.orchestra.run.smithi161.stdout:4153 trunc from 0x8b02dca to 0x4f6c92d 2024-09-21T15:09:27.243 INFO:teuthology.orchestra.run.smithi161.stdout:4315 writesame 0xeb61d96 thru 0xeb65d6c data_size 0x1(0x3fd7 bytes) 2024-09-21T15:09:27.258 INFO:teuthology.orchestra.run.smithi161.stdout:4316 writesame 0x5f5fd8e thru 0x5f6c61d data_size 0x8(0xc890 bytes) 2024-09-21T15:09:27.288 INFO:teuthology.orchestra.run.smithi161.stdout:4317 write 0xcfc7585 thru 0xcfc9d50 (0x27cc bytes) 2024-09-21T15:09:27.297 INFO:teuthology.orchestra.run.smithi161.stdout:4142 write 0xcc608cb thru 0xcc619a6 (0x10dc bytes) 2024-09-21T15:09:27.326 INFO:teuthology.orchestra.run.smithi161.stdout:4318 write 0x2a22be4 thru 0x2a2b4e9 (0x8906 bytes) 2024-09-21T15:09:27.330 INFO:teuthology.orchestra.run.smithi161.stdout:4143 write 0x1f6bb99 thru 0x1f759e0 (0x9e48 bytes) 2024-09-21T15:09:27.338 INFO:teuthology.orchestra.run.smithi161.stdout:4319 write 0x66ac392 thru 0x66afe47 (0x3ab6 bytes) 2024-09-21T15:09:27.345 INFO:teuthology.orchestra.run.smithi161.stdout:3244 writesame 0x8e1750 thru 0x8e4dae data_size 0x1(0x365f bytes) 2024-09-21T15:09:27.352 INFO:teuthology.orchestra.run.smithi161.stdout:4320 read 0xb661cfe thru 0xb668e01 (0x7104 bytes) 2024-09-21T15:09:27.353 INFO:teuthology.orchestra.run.smithi161.stdout:4322 write 0xa07d597 thru 0xa083cae (0x6718 bytes) 2024-09-21T15:09:27.353 INFO:teuthology.orchestra.run.smithi161.stdout:4144 write 0xcff7255 thru 0xcffbad3 (0x487f bytes) 2024-09-21T15:09:27.377 INFO:teuthology.orchestra.run.smithi161.stdout:4154 punch from 0x21b1c70 to 0x21c0d32, (0xf0c2 bytes) 2024-09-21T15:09:27.377 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:27.377 INFO:teuthology.orchestra.run.smithi161.stdout:4156 read 0x1b1cf84 thru 0x1b2b8fd (0xe97a bytes) 2024-09-21T15:09:27.378 INFO:teuthology.orchestra.run.smithi161.stdout:4323 read 0x487d480 thru 0x4886cad (0x982e bytes) 2024-09-21T15:09:27.378 INFO:teuthology.orchestra.run.smithi161.stdout:4157 writesame 0xae545a thru 0xaead6d data_size 0x1(0x5914 bytes) 2024-09-21T15:09:27.379 INFO:teuthology.orchestra.run.smithi161.stdout:4326 read 0xc651259 thru 0xc660443 (0xf1eb bytes) 2024-09-21T15:09:27.384 INFO:teuthology.orchestra.run.smithi161.stdout:4146 read 0x20dc4a9 thru 0x20e72f9 (0xae51 bytes) 2024-09-21T15:09:27.401 INFO:teuthology.orchestra.run.smithi161.stdout:4327 trunc from 0xeb65d6d to 0x40f0a5a 2024-09-21T15:09:27.405 INFO:teuthology.orchestra.run.smithi161.stdout:3245 punch from 0x10b0414 to 0x10b7f12, (0x7afe bytes) 2024-09-21T15:09:27.422 INFO:teuthology.orchestra.run.smithi161.stdout:4158 punch from 0x35822bf to 0x35841dd, (0x1f1e bytes) 2024-09-21T15:09:27.438 INFO:teuthology.orchestra.run.smithi161.stdout:4147 write 0xe67f900 thru 0xe6891fb (0x98fc bytes) 2024-09-21T15:09:27.459 INFO:teuthology.orchestra.run.smithi161.stdout:3247 write 0xaa8b9ce thru 0xaa94bcf (0x9202 bytes) 2024-09-21T15:09:27.460 INFO:teuthology.orchestra.run.smithi161.stdout:4148 writesame 0x9728c6b thru 0x9733284 data_size 0x6(0xa61a bytes) 2024-09-21T15:09:27.473 INFO:teuthology.orchestra.run.smithi161.stdout:3248 writesame 0x757b2c4 thru 0x757d64a data_size 0x11(0x2387 bytes) 2024-09-21T15:09:27.474 INFO:teuthology.orchestra.run.smithi161.stdout:4160 write 0x87e1898 thru 0x87e3c3c (0x23a5 bytes) 2024-09-21T15:09:27.478 INFO:teuthology.orchestra.run.smithi161.stdout:4149 punch from 0x2b1c319 to 0x2b1e9a8, (0x268f bytes) 2024-09-21T15:09:27.478 INFO:teuthology.orchestra.run.smithi161.stdout:4152 read 0xd7fa85b thru 0xd805b57 (0xb2fd bytes) 2024-09-21T15:09:27.478 INFO:teuthology.orchestra.run.smithi161.stdout:4153 writesame 0xd5616b0 thru 0xd56390d data_size 0x2(0x225e bytes) 2024-09-21T15:09:27.484 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:27.484 INFO:teuthology.orchestra.run.smithi161.stdout:3249 read 0x60fd48f thru 0x6101d8b (0x48fd bytes) 2024-09-21T15:09:27.484 INFO:teuthology.orchestra.run.smithi161.stdout:3250 read 0x426e9b2 thru 0x427945a (0xaaa9 bytes) 2024-09-21T15:09:27.485 INFO:teuthology.orchestra.run.smithi161.stdout:3251 writesame 0xa558fe5 thru 0xa55beb8 data_size 0xc(0x2ed4 bytes) 2024-09-21T15:09:27.490 INFO:teuthology.orchestra.run.smithi161.stdout:4154 read 0x44ad367 thru 0x44afa6d (0x2707 bytes) 2024-09-21T15:09:27.491 INFO:teuthology.orchestra.run.smithi161.stdout:4155 punch from 0x1dffa5a to 0x1e09d39, (0xa2df bytes) 2024-09-21T15:09:27.494 INFO:teuthology.orchestra.run.smithi161.stdout:4156 trunc from 0xe6891fc to 0xd3794ca 2024-09-21T15:09:27.511 INFO:teuthology.orchestra.run.smithi161.stdout:4328 write 0x8087cbb thru 0x808da01 (0x5d47 bytes) 2024-09-21T15:09:27.527 INFO:teuthology.orchestra.run.smithi161.stdout:4329 read 0x47a6f21 thru 0x47b1a0e (0xaaee bytes) 2024-09-21T15:09:27.528 INFO:teuthology.orchestra.run.smithi161.stdout:4331 writesame 0x5f8744d thru 0x5f9217a data_size 0x1b(0xad2e bytes) 2024-09-21T15:09:27.537 INFO:teuthology.orchestra.run.smithi161.stdout:4332 read 0x59b2cfb thru 0x59c203e (0xf344 bytes) 2024-09-21T15:09:27.539 INFO:teuthology.orchestra.run.smithi161.stdout:4164 write 0xe93000a thru 0xe93b465 (0xb45c bytes) 2024-09-21T15:09:27.545 INFO:teuthology.orchestra.run.smithi161.stdout:3252 writesame 0xc3d8ba9 thru 0xc3d98b4 data_size 0x4(0xd0c bytes) 2024-09-21T15:09:27.553 INFO:teuthology.orchestra.run.smithi161.stdout:4165 write 0x60f4341 thru 0x6103063 (0xed23 bytes) 2024-09-21T15:09:27.567 INFO:teuthology.orchestra.run.smithi161.stdout:4157 trunc from 0xd3794ca to 0x7923f97 2024-09-21T15:09:27.576 INFO:teuthology.orchestra.run.smithi161.stdout:4166 punch from 0xb869bc to 0xb94eae, (0xe4f2 bytes) 2024-09-21T15:09:27.576 INFO:teuthology.orchestra.run.smithi161.stdout:4167 read 0x8973df1 thru 0x897cef5 (0x9105 bytes) 2024-09-21T15:09:27.576 INFO:teuthology.orchestra.run.smithi161.stdout:4171 punch from 0x2d1399d to 0x2d209f2, (0xd055 bytes) 2024-09-21T15:09:27.576 INFO:teuthology.orchestra.run.smithi161.stdout:4173 read 0x97c1b99 thru 0x97c5300 (0x3768 bytes) 2024-09-21T15:09:27.576 INFO:teuthology.orchestra.run.smithi161.stdout:4175 write 0x1aeaf1e thru 0x1aef86f (0x4952 bytes) 2024-09-21T15:09:27.613 INFO:teuthology.orchestra.run.smithi161.stdout:4333 writesame 0x9d901ba thru 0x9d985c5 data_size 0x36(0x840c bytes) 2024-09-21T15:09:27.644 INFO:teuthology.orchestra.run.smithi161.stdout:4176 writesame 0x5eb5f1e thru 0x5ebfc23 data_size 0x65(0x9d06 bytes) 2024-09-21T15:09:27.660 INFO:teuthology.orchestra.run.smithi161.stdout:4334 trunc from 0x9d985c6 to 0xe6ccd00 2024-09-21T15:09:27.679 INFO:teuthology.orchestra.run.smithi161.stdout:3254 write 0xe69427a thru 0xe6996d5 (0x545c bytes) 2024-09-21T15:09:27.688 INFO:teuthology.orchestra.run.smithi161.stdout:4178 writesame 0x5831e0 thru 0x587022 data_size 0x21(0x3e43 bytes) 2024-09-21T15:09:27.711 INFO:teuthology.orchestra.run.smithi161.stdout:3255 writesame 0x4e2fcbe thru 0x4e3212f data_size 0x1e(0x2472 bytes) 2024-09-21T15:09:27.716 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:27.721 INFO:teuthology.orchestra.run.smithi161.stdout:4179 read 0x3029147 thru 0x3037ffd (0xeeb7 bytes) 2024-09-21T15:09:27.721 INFO:teuthology.orchestra.run.smithi161.stdout:3257 write 0xd413212 thru 0xd4172c5 (0x40b4 bytes) 2024-09-21T15:09:27.722 INFO:teuthology.orchestra.run.smithi161.stdout:4180 read 0x2f32b72 thru 0x2f3d7a1 (0xac30 bytes) 2024-09-21T15:09:27.737 INFO:teuthology.orchestra.run.smithi161.stdout:3258 write 0xbbb9de thru 0xbcabd1 (0xf1f4 bytes) 2024-09-21T15:09:27.749 INFO:teuthology.orchestra.run.smithi161.stdout:4181 trunc from 0xe93b466 to 0x5a79c4 2024-09-21T15:09:27.756 INFO:teuthology.orchestra.run.smithi161.stdout:4335 writesame 0x54dc96d thru 0x54e04ac data_size 0x4f(0x3b40 bytes) 2024-09-21T15:09:27.763 INFO:teuthology.orchestra.run.smithi161.stdout:4159 write 0xa797f48 thru 0xa79aaa3 (0x2b5c bytes) 2024-09-21T15:09:27.783 INFO:teuthology.orchestra.run.smithi161.stdout:4336 write 0xb4a64be thru 0xb4abd29 (0x586c bytes) 2024-09-21T15:09:27.804 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.795+0000 7f1e9c77a700 -1 reset not still connected to 0x56288301b2b0 2024-09-21T15:09:27.804 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.795+0000 7f1e9c77a700 -1 reset not still connected to 0x562889a48750 2024-09-21T15:09:27.804 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.795+0000 7f1e9c77a700 -1 reset not still connected to 0x562889a931e0 2024-09-21T15:09:27.805 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.799+0000 7f1e9c77a700 -1 reset not still connected to 0x56288edfc9c0 2024-09-21T15:09:27.809 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.803+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f3264e0 2024-09-21T15:09:27.809 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.803+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f959ba0 2024-09-21T15:09:27.810 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.807+0000 7f1e9c77a700 -1 reset not still connected to 0x562890034680 2024-09-21T15:09:27.810 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.807+0000 7f1e9c77a700 -1 reset not still connected to 0x562890035520 2024-09-21T15:09:27.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.807+0000 7f1e9c77a700 -1 reset not still connected to 0x5628908044e0 2024-09-21T15:09:27.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.807+0000 7f1e9c77a700 -1 reset not still connected to 0x562890805d40 2024-09-21T15:09:27.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.807+0000 7f1e9c77a700 -1 reset not still connected to 0x56289097b110 2024-09-21T15:09:27.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.807+0000 7f1e9c77a700 -1 reset not still connected to 0x562890d15860 2024-09-21T15:09:27.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.807+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5930 2024-09-21T15:09:27.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.807+0000 7f1e9c77a700 -1 reset not still connected to 0x562897c70ea0 2024-09-21T15:09:27.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.807+0000 7f1e9c77a700 -1 reset not still connected to 0x56289cc5fe10 2024-09-21T15:09:27.811 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:27.814 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:27.811+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a1077790 2024-09-21T15:09:27.818 INFO:teuthology.orchestra.run.smithi161.stdout:3259 punch from 0xc6dce0f to 0xc6e9a54, (0xcc45 bytes) 2024-09-21T15:09:27.818 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:27.818 INFO:teuthology.orchestra.run.smithi161.stdout:3263 read 0x6c0c7a8 thru 0x6c1bf47 (0xf7a0 bytes) 2024-09-21T15:09:27.818 INFO:teuthology.orchestra.run.smithi161.stdout:3264 read 0xaf97d1e thru 0xafa485c (0xcb3f bytes) 2024-09-21T15:09:27.820 INFO:teuthology.orchestra.run.smithi161.stdout:3265 trunc from 0xe6996d6 to 0xec5c5bb 2024-09-21T15:09:27.837 INFO:teuthology.orchestra.run.smithi161.stdout:4338 writesame 0x3c0420c thru 0x3c13d66 data_size 0x59(0xfb5b bytes) 2024-09-21T15:09:27.877 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #26, image image_cluster1.client.mirror.2-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent27 2024-09-21T15:09:27.882 INFO:teuthology.orchestra.run.smithi161.stdout:4339 punch from 0x78b34e0 to 0x78b51c4, (0x1ce4 bytes) 2024-09-21T15:09:27.882 INFO:teuthology.orchestra.run.smithi161.stdout:4340 read 0x27c7b9 thru 0x282491 (0x5cd9 bytes) 2024-09-21T15:09:27.887 INFO:teuthology.orchestra.run.smithi161.stdout:4341 read 0xdff94f2 thru 0xdff9fa8 (0xab7 bytes) 2024-09-21T15:09:27.888 INFO:teuthology.orchestra.run.smithi161.stdout:4343 read 0xb2629a8 thru 0xb270acb (0xe124 bytes) 2024-09-21T15:09:27.888 INFO:teuthology.orchestra.run.smithi161.stdout:4345 write 0x9d90134 thru 0x9d9cdb0 (0xcc7d bytes) 2024-09-21T15:09:27.915 INFO:teuthology.orchestra.run.smithi161.stdout:3266 writesame 0x978107b thru 0x978bed3 data_size 0x1(0xae59 bytes) 2024-09-21T15:09:27.925 INFO:teuthology.orchestra.run.smithi161.stdout:4161 write 0xdbc09ee thru 0xdbc7bf1 (0x7204 bytes) 2024-09-21T15:09:27.931 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:27.951 INFO:teuthology.orchestra.run.smithi161.stdout:4347 trunc from 0xe6ccd00 to 0x38e1fe0 2024-09-21T15:09:27.991 INFO:teuthology.orchestra.run.smithi161.stdout:4162 trunc from 0xdbc7bf2 to 0x46a8cb 2024-09-21T15:09:28.013 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.013 INFO:teuthology.orchestra.run.smithi161.stdout:4464 read 0x29279f thru 0x298eff (0x6761 bytes) 2024-09-21T15:09:28.013 INFO:teuthology.orchestra.run.smithi161.stdout:3267 write 0xd7f1a5c thru 0xd8002aa (0xe84f bytes) 2024-09-21T15:09:28.099 INFO:teuthology.orchestra.run.smithi161.stdout:4465 write 0x9e90627 thru 0x9e9a844 (0xa21e bytes) 2024-09-21T15:09:28.124 INFO:teuthology.orchestra.run.smithi161.stdout:3269 write 0xa5c63eb thru 0xa5d1dc6 (0xb9dc bytes) 2024-09-21T15:09:28.138 INFO:teuthology.orchestra.run.smithi161.stdout:4182 write 0x2d3431d thru 0x2d3c5e2 (0x82c6 bytes) 2024-09-21T15:09:28.141 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:28.131+0000 7f7fd044c700 -1 reset not still connected to 0x5636aebddee0 2024-09-21T15:09:28.142 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:28.139+0000 7f7fd044c700 -1 reset not still connected to 0x5636b11416c0 2024-09-21T15:09:28.142 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:28.139+0000 7f7fd044c700 -1 reset not still connected to 0x5636b494ed00 2024-09-21T15:09:28.142 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:28.139+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7f66d00 2024-09-21T15:09:28.171 INFO:teuthology.orchestra.run.smithi161.stdout:4183 read 0x21b959b thru 0x21be402 (0x4e68 bytes) 2024-09-21T15:09:28.171 INFO:teuthology.orchestra.run.smithi161.stdout:4184 read 0x1ae476c thru 0x1aeef07 (0xa79c bytes) 2024-09-21T15:09:28.174 INFO:teuthology.orchestra.run.smithi161.stdout:4468 writesame 0x801bde5 thru 0x80265d8 data_size 0x6(0xa7f4 bytes) 2024-09-21T15:09:28.175 INFO:teuthology.orchestra.run.smithi161.stdout:3270 write 0xc16bfc thru 0xc25b15 (0xef1a bytes) 2024-09-21T15:09:28.204 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.4-clone33 intact 2024-09-21T15:09:28.213 INFO:teuthology.orchestra.run.smithi161.stdout:4348 writesame 0x5d2eb72 thru 0x5d307be data_size 0x17(0x1c4d bytes) 2024-09-21T15:09:28.216 INFO:teuthology.orchestra.run.smithi161.stdout:4163 trunc from 0x46a8cb to 0xeac956f 2024-09-21T15:09:28.219 INFO:teuthology.orchestra.run.smithi161.stdout:3271 punch from 0xc685882 to 0xc68ce8b, (0x7609 bytes) 2024-09-21T15:09:28.223 INFO:teuthology.orchestra.run.smithi161.stdout:4351 read 0x1078f03 thru 0x107e6d0 (0x57ce bytes) 2024-09-21T15:09:28.224 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.224 INFO:teuthology.orchestra.run.smithi161.stdout:4354 read 0x50d2cfd thru 0x50da7bf (0x7ac3 bytes) 2024-09-21T15:09:28.234 INFO:teuthology.orchestra.run.smithi161.stdout:4355 trunc from 0x5d307bf to 0xaf02bbf 2024-09-21T15:09:28.245 INFO:teuthology.orchestra.run.smithi161.stdout:3272 trunc from 0xec5c5bb to 0x21a6ec0 2024-09-21T15:09:28.246 INFO:teuthology.orchestra.run.smithi161.stdout:4185 writesame 0xebb74e4 thru 0xebb7f4a data_size 0x1(0xa67 bytes) 2024-09-21T15:09:28.247 INFO:teuthology.orchestra.run.smithi161.stdout:4164 punch from 0xdf05bd7 to 0xdf0ba35, (0x5e5e bytes) 2024-09-21T15:09:28.247 INFO:teuthology.orchestra.run.smithi161.stdout:4165 read 0xc18d5a3 thru 0xc19ba15 (0xe473 bytes) 2024-09-21T15:09:28.247 INFO:teuthology.orchestra.run.smithi161.stdout:4167 write 0x6e77607 thru 0x6e80d02 (0x96fc bytes) 2024-09-21T15:09:28.253 INFO:teuthology.orchestra.run.smithi161.stdout:4186 read 0x79c0869 thru 0x79cf24b (0xe9e3 bytes) 2024-09-21T15:09:28.253 INFO:teuthology.orchestra.run.smithi161.stdout:4189 writesame 0xe0990b7 thru 0xe0a3156 data_size 0x50(0xa0a0 bytes) 2024-09-21T15:09:28.276 INFO:teuthology.orchestra.run.smithi161.stdout:4190 punch from 0x1fa8937 to 0x1fac969, (0x4032 bytes) 2024-09-21T15:09:28.276 INFO:teuthology.orchestra.run.smithi161.stdout:4191 read 0xd908270 thru 0xd90fa77 (0x7808 bytes) 2024-09-21T15:09:28.277 INFO:teuthology.orchestra.run.smithi161.stdout:4192 punch from 0xd3aca41 to 0xd3b0591, (0x3b50 bytes) 2024-09-21T15:09:28.277 INFO:teuthology.orchestra.run.smithi161.stdout:4195 read 0x2590ce3 thru 0x259d42c (0xc74a bytes) 2024-09-21T15:09:28.277 INFO:teuthology.orchestra.run.smithi161.stdout:4198 read 0x65a6ed7 thru 0x65a80a4 (0x11ce bytes) 2024-09-21T15:09:28.277 INFO:teuthology.orchestra.run.smithi161.stdout:4199 writesame 0xbe88f56 thru 0xbe8f800 data_size 0x17(0x68ab bytes) 2024-09-21T15:09:28.280 INFO:teuthology.orchestra.run.smithi161.stdout:4169 writesame 0xca2a9d thru 0xca4ab1 data_size 0x1(0x2015 bytes) 2024-09-21T15:09:28.291 INFO:teuthology.orchestra.run.smithi161.stdout:4469 read 0x7ccb974 thru 0x7ccc3a8 (0xa35 bytes) 2024-09-21T15:09:28.291 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.291 INFO:teuthology.orchestra.run.smithi161.stdout:4471 punch from 0x50978fb to 0x50a73b4, (0xfab9 bytes) 2024-09-21T15:09:28.291 INFO:teuthology.orchestra.run.smithi161.stdout:4472 punch from 0x713be7c to 0x713f1b9, (0x333d bytes) 2024-09-21T15:09:28.292 INFO:teuthology.orchestra.run.smithi161.stdout:4473 read 0x7beb6 thru 0x8ad49 (0xee94 bytes) 2024-09-21T15:09:28.302 INFO:teuthology.orchestra.run.smithi161.stdout:4474 punch from 0x4083143 to 0x408932e, (0x61eb bytes) 2024-09-21T15:09:28.302 INFO:teuthology.orchestra.run.smithi161.stdout:4477 write 0x4279aa2 thru 0x4286489 (0xc9e8 bytes) 2024-09-21T15:09:28.303 INFO:teuthology.orchestra.run.smithi161.stdout:4201 punch from 0x7ca5760 to 0x7cad7d7, (0x8077 bytes) 2024-09-21T15:09:28.303 INFO:teuthology.orchestra.run.smithi161.stdout:4202 read 0xb3f6e18 thru 0xb3ff63c (0x8825 bytes) 2024-09-21T15:09:28.303 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.303 INFO:teuthology.orchestra.run.smithi161.stdout:4204 write 0x87eff2d thru 0x87f9b33 (0x9c07 bytes) 2024-09-21T15:09:28.305 INFO:teuthology.orchestra.run.smithi161.stdout:4356 punch from 0x91f74c4 to 0x9207393, (0xfecf bytes) 2024-09-21T15:09:28.305 INFO:teuthology.orchestra.run.smithi161.stdout:4357 write 0x46eb305 thru 0x46f80dd (0xcdd9 bytes) 2024-09-21T15:09:28.310 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:28.308+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cba86d20 handle_clone_image: failed to clone image mirror/10ae3a2ed6ab to image_cluster1.client.mirror.1-clone20 2024-09-21T15:09:28.322 INFO:teuthology.orchestra.run.smithi161.stdout:4170 trunc from 0xeac956f to 0xd928637 2024-09-21T15:09:28.344 INFO:teuthology.orchestra.run.smithi161.stdout:4358 writesame 0x2ae0a99 thru 0x2aeebef data_size 0x43(0xe157 bytes) 2024-09-21T15:09:28.354 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:28.348+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cc7ea1e0 handle_clone_image: failed to clone image mirror/10b68ac723a4 to image_cluster1.client.mirror.4-clone31 2024-09-21T15:09:28.357 INFO:teuthology.orchestra.run.smithi161.stdout:4205 trunc from 0xebb7f4b to 0xa425b64 2024-09-21T15:09:28.363 INFO:teuthology.orchestra.run.smithi161.stdout:4359 trunc from 0xaf02bbf to 0xd369d2c 2024-09-21T15:09:28.376 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:28.372+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581d4c4d0e0 handle_clone_image: failed to clone image mirror/10b4d4c68f7f to image_cluster1.client.mirror.3-clone23 2024-09-21T15:09:28.403 INFO:teuthology.orchestra.run.smithi161.stdout:4478 read 0x5722410 thru 0x5722c98 (0x889 bytes) 2024-09-21T15:09:28.403 INFO:teuthology.orchestra.run.smithi161.stdout:4480 writesame 0x7d006ce thru 0x7d0adf5 data_size 0xc(0xa728 bytes) 2024-09-21T15:09:28.409 INFO:teuthology.orchestra.run.smithi161.stdout:4171 punch from 0x637f12e to 0x6380ef3, (0x1dc5 bytes) 2024-09-21T15:09:28.409 INFO:teuthology.orchestra.run.smithi161.stdout:4172 writesame 0x553d96 thru 0x559b16 data_size 0x4f(0x5d81 bytes) 2024-09-21T15:09:28.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:28.420+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb90ef00 handle_clone_image: failed to clone image mirror/10b5bc5fd3b9 to image_cluster1.client.mirror.0-clone26 2024-09-21T15:09:28.437 INFO:teuthology.orchestra.run.smithi161.stdout:4173 punch from 0x53b7820 to 0x53baee1, (0x36c1 bytes) 2024-09-21T15:09:28.437 INFO:teuthology.orchestra.run.smithi161.stdout:4174 punch from 0x7282f7d to 0x728fbe9, (0xcc6c bytes) 2024-09-21T15:09:28.437 INFO:teuthology.orchestra.run.smithi161.stdout:4175 read 0xa8064b9 thru 0xa80f728 (0x9270 bytes) 2024-09-21T15:09:28.437 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.437 INFO:teuthology.orchestra.run.smithi161.stdout:4177 write 0xc818e92 thru 0xc81cb34 (0x3ca3 bytes) 2024-09-21T15:09:28.439 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.439 INFO:teuthology.orchestra.run.smithi161.stdout:3275 write 0x1ea9e89 thru 0x1eb30ae (0x9226 bytes) 2024-09-21T15:09:28.452 INFO:teuthology.orchestra.run.smithi161.stdout:4360 trunc from 0xd369d2c to 0x87c8c33 2024-09-21T15:09:28.457 INFO:teuthology.orchestra.run.smithi161.stdout:3276 write 0x6dce65 thru 0x6e0061 (0x31fd bytes) 2024-09-21T15:09:28.462 INFO:teuthology.orchestra.run.smithi161.stdout:4178 punch from 0xadb37e3 to 0xadbba7b, (0x8298 bytes) 2024-09-21T15:09:28.462 INFO:teuthology.orchestra.run.smithi161.stdout:4182 read 0x17830d7 thru 0x178ecef (0xbc19 bytes) 2024-09-21T15:09:28.462 INFO:teuthology.orchestra.run.smithi161.stdout:4183 read 0x8625ea8 thru 0x8626a83 (0xbdc bytes) 2024-09-21T15:09:28.462 INFO:teuthology.orchestra.run.smithi161.stdout:4185 write 0xa983940 thru 0xa983bbe (0x27f bytes) 2024-09-21T15:09:28.466 INFO:teuthology.orchestra.run.smithi161.stdout:4206 punch from 0x2e8b681 to 0x2e8e67b, (0x2ffa bytes) 2024-09-21T15:09:28.481 INFO:teuthology.orchestra.run.smithi161.stdout:4482 trunc from 0xa8023cc to 0x32b922e 2024-09-21T15:09:28.483 INFO:teuthology.orchestra.run.smithi161.stdout:4186 write 0xd580e18 thru 0xd58d809 (0xc9f2 bytes) 2024-09-21T15:09:28.513 INFO:teuthology.orchestra.run.smithi161.stdout:4187 read 0x5601e80 thru 0x560c2b9 (0xa43a bytes) 2024-09-21T15:09:28.513 INFO:teuthology.orchestra.run.smithi161.stdout:4188 read 0x210e746 thru 0x211773d (0x8ff8 bytes) 2024-09-21T15:09:28.513 INFO:teuthology.orchestra.run.smithi161.stdout:4190 punch from 0x2724259 to 0x273033d, (0xc0e4 bytes) 2024-09-21T15:09:28.515 INFO:teuthology.orchestra.run.smithi161.stdout:4191 read 0xa911a89 thru 0xa91af46 (0x94be bytes) 2024-09-21T15:09:28.515 INFO:teuthology.orchestra.run.smithi161.stdout:4192 read 0x7f1d987 thru 0x7f20e76 (0x34f0 bytes) 2024-09-21T15:09:28.515 INFO:teuthology.orchestra.run.smithi161.stdout:4193 read 0x8509968 thru 0x850b962 (0x1ffb bytes) 2024-09-21T15:09:28.515 INFO:teuthology.orchestra.run.smithi161.stdout:4194 punch from 0x1f20740 to 0x1f28451, (0x7d11 bytes) 2024-09-21T15:09:28.515 INFO:teuthology.orchestra.run.smithi161.stdout:4195 punch from 0xb734174 to 0xb7429c5, (0xe851 bytes) 2024-09-21T15:09:28.515 INFO:teuthology.orchestra.run.smithi161.stdout:4196 write 0xa92c01 thru 0xa937a2 (0xba2 bytes) 2024-09-21T15:09:28.531 INFO:teuthology.orchestra.run.smithi161.stdout:4361 write 0x654a5f4 thru 0x654e269 (0x3c76 bytes) 2024-09-21T15:09:28.542 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #32, image image_cluster1.client.mirror.4-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent33 2024-09-21T15:09:28.551 INFO:teuthology.orchestra.run.smithi161.stdout:4197 writesame 0x44fb0a1 thru 0x4504b54 data_size 0x2(0x9ab4 bytes) 2024-09-21T15:09:28.553 INFO:teuthology.orchestra.run.smithi161.stdout:4207 write 0xe52fb64 thru 0xe534842 (0x4cdf bytes) 2024-09-21T15:09:28.558 INFO:teuthology.orchestra.run.smithi161.stdout:4364 read 0x6ad08f thru 0x6b96b2 (0xc624 bytes) 2024-09-21T15:09:28.576 INFO:teuthology.orchestra.run.smithi161.stdout:4366 write 0x6f4a3fd thru 0x6f4e892 (0x4496 bytes) 2024-09-21T15:09:28.578 INFO:teuthology.orchestra.run.smithi161.stdout:3277 writesame 0xa1c8724 thru 0xa1c983c data_size 0x1(0x1119 bytes) 2024-09-21T15:09:28.582 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:28.576+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cd4eba40 handle_clone_image: failed to clone image mirror/10b55a89de27 to image_cluster1.client.mirror.0-clone22 2024-09-21T15:09:28.588 INFO:teuthology.orchestra.run.smithi161.stdout:4198 read 0x3b932d2 thru 0x3b94428 (0x1157 bytes) 2024-09-21T15:09:28.588 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.588 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.588 INFO:teuthology.orchestra.run.smithi161.stdout:4205 writesame 0x8f97397 thru 0x8f99f80 data_size 0x16(0x2bea bytes) 2024-09-21T15:09:28.599 INFO:teuthology.orchestra.run.smithi161.stdout:4367 write 0x75828f4 thru 0x758789e (0x4fab bytes) 2024-09-21T15:09:28.599 INFO:teuthology.orchestra.run.smithi161.stdout:3278 trunc from 0xa1c983d to 0x44ef160 2024-09-21T15:09:28.602 INFO:teuthology.orchestra.run.smithi161.stdout:4208 read 0x75a2c80 thru 0x75af6e0 (0xca61 bytes) 2024-09-21T15:09:28.602 INFO:teuthology.orchestra.run.smithi161.stdout:4210 read 0xd4a9fcb thru 0xd4b4681 (0xa6b7 bytes) 2024-09-21T15:09:28.602 INFO:teuthology.orchestra.run.smithi161.stdout:4214 read 0x3d4963c thru 0x3d55a35 (0xc3fa bytes) 2024-09-21T15:09:28.603 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.603 INFO:teuthology.orchestra.run.smithi161.stdout:4217 punch from 0x9ef765d to 0x9f01ee2, (0xa885 bytes) 2024-09-21T15:09:28.603 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.603 INFO:teuthology.orchestra.run.smithi161.stdout:4219 write 0x99c567e thru 0x99c96a7 (0x402a bytes) 2024-09-21T15:09:28.603 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:28.600+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581d0888d20 handle_clone_image: failed to clone image mirror/10b411eba396 to image_cluster1.client.mirror.3-clone37 2024-09-21T15:09:28.622 INFO:teuthology.orchestra.run.smithi161.stdout:4208 punch from 0x99898dd to 0x998b8c7, (0x1fea bytes) 2024-09-21T15:09:28.622 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.622 INFO:teuthology.orchestra.run.smithi161.stdout:4210 writesame 0xd345b06 thru 0xd34a82b data_size 0x32(0x4d26 bytes) 2024-09-21T15:09:28.625 INFO:teuthology.orchestra.run.smithi161.stdout:4368 trunc from 0x87c8c33 to 0xc1d1037 2024-09-21T15:09:28.628 INFO:teuthology.orchestra.run.smithi161.stdout:4221 writesame 0x6b1c10 thru 0x6be7eb data_size 0x6(0xcbdc bytes) 2024-09-21T15:09:28.629 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.8854636269723842) > weight (0.25) 2024-09-21T15:09:28.629 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.4776724115930827) > weight (0.25) 2024-09-21T15:09:28.629 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.7441498994874888) > weight (0.25) 2024-09-21T15:09:28.629 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.3 2024-09-21T15:09:28.630 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Sent signal 15 2024-09-21T15:09:28.630 INFO:tasks.rbd_mirror_thrash:waiting for 1 secs before reviving daemons 2024-09-21T15:09:28.631 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:09:28.628+0000 7fa0e3134700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.3 (PID: 24816) UID: 1000 2024-09-21T15:09:28.636 INFO:teuthology.orchestra.run.smithi161.stdout:3701 read 0x64dfe0e thru 0x64e2668 (0x285b bytes) 2024-09-21T15:09:28.646 INFO:teuthology.orchestra.run.smithi161.stdout:4211 write 0x7c37893 thru 0x7c47579 (0xfce7 bytes) 2024-09-21T15:09:28.651 INFO:teuthology.orchestra.run.smithi161.stdout:4223 write 0x76119ba thru 0x76201de (0xe825 bytes) 2024-09-21T15:09:28.677 INFO:teuthology.orchestra.run.smithi161.stdout:3703 write 0x60d317e thru 0x60e0b21 (0xd9a4 bytes) 2024-09-21T15:09:28.677 INFO:teuthology.orchestra.run.smithi161.stdout:4215 write 0x753c274 thru 0x75470e0 (0xae6d bytes) 2024-09-21T15:09:28.693 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.693 INFO:teuthology.orchestra.run.smithi161.stdout:4371 read 0x464c911 thru 0x4651399 (0x4a89 bytes) 2024-09-21T15:09:28.697 INFO:teuthology.orchestra.run.smithi161.stdout:4373 writesame 0x4b6372d thru 0x4b6cfe9 data_size 0x1(0x98bd bytes) 2024-09-21T15:09:28.704 INFO:teuthology.orchestra.run.smithi161.stdout:4225 trunc from 0xe534843 to 0x9f6f729 2024-09-21T15:09:28.718 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:28.716+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cd2b5860 handle_clone_image: failed to clone image mirror/10b61dfab12b to image_cluster1.client.mirror.4-clone26 2024-09-21T15:09:28.771 INFO:teuthology.orchestra.run.smithi161.stdout:4483 write 0x256f7bd thru 0x257afa7 (0xb7eb bytes) 2024-09-21T15:09:28.776 INFO:teuthology.orchestra.run.smithi161.stdout:4374 read 0x8fa5f7d thru 0x8fabe95 (0x5f19 bytes) 2024-09-21T15:09:28.777 INFO:teuthology.orchestra.run.smithi161.stdout:4375 punch from 0x355224a to 0x3552c6e, (0xa24 bytes) 2024-09-21T15:09:28.777 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.777 INFO:teuthology.orchestra.run.smithi161.stdout:4378 punch from 0x55547d2 to 0x5557050, (0x287e bytes) 2024-09-21T15:09:28.777 INFO:teuthology.orchestra.run.smithi161.stdout:3279 writesame 0xb6e5a84 thru 0xb6e5f14 data_size 0x1(0x491 bytes) 2024-09-21T15:09:28.778 INFO:teuthology.orchestra.run.smithi161.stdout:4379 read 0x57a4dd3 thru 0x57ae2e7 (0x9515 bytes) 2024-09-21T15:09:28.778 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.778 INFO:teuthology.orchestra.run.smithi161.stdout:4381 punch from 0x745f45c to 0x74654af, (0x6053 bytes) 2024-09-21T15:09:28.778 INFO:teuthology.orchestra.run.smithi161.stdout:4382 read 0x8346936 thru 0x8352664 (0xbd2f bytes) 2024-09-21T15:09:28.779 INFO:teuthology.orchestra.run.smithi161.stdout:4383 read 0x37fe93a thru 0x3805a23 (0x70ea bytes) 2024-09-21T15:09:28.780 INFO:teuthology.orchestra.run.smithi161.stdout:4384 read 0x407a41d thru 0x407c37e (0x1f62 bytes) 2024-09-21T15:09:28.780 INFO:teuthology.orchestra.run.smithi161.stdout:4385 read 0x5d8a9b5 thru 0x5d92a20 (0x806c bytes) 2024-09-21T15:09:28.781 INFO:teuthology.orchestra.run.smithi161.stdout:4386 read 0x7715e5c thru 0x771f041 (0x91e6 bytes) 2024-09-21T15:09:28.782 INFO:teuthology.orchestra.run.smithi161.stdout:4387 write 0x1c6f692 thru 0x1c79b52 (0xa4c1 bytes) 2024-09-21T15:09:28.788 INFO:teuthology.orchestra.run.smithi161.stdout:3280 punch from 0xb0f5910 to 0xb0fadf9, (0x54e9 bytes) 2024-09-21T15:09:28.788 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.788 INFO:teuthology.orchestra.run.smithi161.stdout:3282 read 0x563449c thru 0x5639c9e (0x5803 bytes) 2024-09-21T15:09:28.788 INFO:teuthology.orchestra.run.smithi161.stdout:3284 read 0x4d49030 thru 0x4d4d3fd (0x43ce bytes) 2024-09-21T15:09:28.788 INFO:teuthology.orchestra.run.smithi161.stdout:3285 read 0x7852c99 thru 0x7854540 (0x18a8 bytes) 2024-09-21T15:09:28.788 INFO:teuthology.orchestra.run.smithi161.stdout:3287 read 0x18bc945 thru 0x18c90bf (0xc77b bytes) 2024-09-21T15:09:28.789 INFO:teuthology.orchestra.run.smithi161.stdout:3288 write 0x273bca9 thru 0x274569c (0x99f4 bytes) 2024-09-21T15:09:28.789 INFO:teuthology.orchestra.run.smithi161.stdout:4216 read 0x7ae0c3c thru 0x7ae57af (0x4b74 bytes) 2024-09-21T15:09:28.804 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:28.804 INFO:teuthology.orchestra.run.smithi161.stdout:3290 writesame 0x4f29e5b thru 0x4f34c41 data_size 0x1(0xade7 bytes) 2024-09-21T15:09:28.806 INFO:teuthology.orchestra.run.smithi161.stdout:4388 read 0x5f8e2b0 thru 0x5f91ed8 (0x3c29 bytes) 2024-09-21T15:09:28.814 INFO:teuthology.orchestra.run.smithi161.stdout:4218 trunc from 0xd928637 to 0x139fb58 2024-09-21T15:09:28.854 INFO:teuthology.orchestra.run.smithi161.stdout:3292 write 0x8ad398 thru 0x8b25fd (0x5266 bytes) 2024-09-21T15:09:28.858 INFO:teuthology.orchestra.run.smithi161.stdout:3704 writesame 0xca4857 thru 0xca6253 data_size 0x1(0x19fd bytes) 2024-09-21T15:09:28.861 INFO:teuthology.orchestra.run.smithi161.stdout:4226 write 0x278550d thru 0x278f2b9 (0x9dad bytes) 2024-09-21T15:09:28.890 INFO:teuthology.orchestra.run.smithi161.stdout:4389 write 0xe423ddf thru 0xe42cce6 (0x8f08 bytes) 2024-09-21T15:09:28.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:28.888+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581d08894a0 handle_clone_image: failed to clone image mirror/10ae2bcfe0fc to image_cluster1.client.mirror.1-clone16 2024-09-21T15:09:28.900 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:28.891+0000 7f1e9c77a700 -1 reset not still connected to 0x56287ce70000 2024-09-21T15:09:28.903 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:28.895+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f959ba0 2024-09-21T15:09:28.904 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:28.899+0000 7f1e9c77a700 -1 reset not still connected to 0x5628908044e0 2024-09-21T15:09:28.904 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:28.899+0000 7f1e9c77a700 -1 reset not still connected to 0x56289097b110 2024-09-21T15:09:28.905 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:28.899+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5930 2024-09-21T15:09:28.906 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:28.903+0000 7f1e9c77a700 -1 reset not still connected to 0x56289cc5fe10 2024-09-21T15:09:28.942 INFO:teuthology.orchestra.run.smithi161.stdout:3293 trunc from 0xb6e5f15 to 0x4168067 2024-09-21T15:09:28.974 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.968+0000 7ff753f07700 -1 reset not still connected to 0x560167cc5380 2024-09-21T15:09:28.977 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.968+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:09:28.978 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.972+0000 7ff753f07700 -1 reset not still connected to 0x56016878a1a0 2024-09-21T15:09:28.978 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.972+0000 7ff753f07700 -1 reset not still connected to 0x56016878ab60 2024-09-21T15:09:28.978 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.972+0000 7ff753f07700 -1 reset not still connected to 0x56016878ac30 2024-09-21T15:09:28.978 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:28.975+0000 7f1e9c77a700 -1 reset not still connected to 0x56289e9f84e0 2024-09-21T15:09:28.981 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:28.975+0000 7f1e9c77a700 -1 reset not still connected to 0x56289e9f88f0 2024-09-21T15:09:28.981 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:28.975+0000 7f1e9c77a700 -1 reset not still connected to 0x56289e9f8ea0 2024-09-21T15:09:28.981 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:28.975+0000 7f1e9c77a700 -1 reset not still connected to 0x56289e9f9930 2024-09-21T15:09:28.985 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x56016878b1e0 2024-09-21T15:09:28.985 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x56016878b520 2024-09-21T15:09:28.985 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x56016878ba00 2024-09-21T15:09:28.985 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x560168802750 2024-09-21T15:09:28.985 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x5601688028f0 2024-09-21T15:09:28.985 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x560168803860 2024-09-21T15:09:28.985 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x560168803ee0 2024-09-21T15:09:28.985 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x560168d92340 2024-09-21T15:09:28.985 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x5601692225b0 2024-09-21T15:09:28.985 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x5601692b52b0 2024-09-21T15:09:28.985 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x560169400a90 2024-09-21T15:09:28.985 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x560169783c70 2024-09-21T15:09:28.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x560169e2eb60 2024-09-21T15:09:28.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x560169ec2dd0 2024-09-21T15:09:28.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x560169f100d0 2024-09-21T15:09:28.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.980+0000 7ff753f07700 -1 reset not still connected to 0x560169f10270 2024-09-21T15:09:28.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x560169f10680 2024-09-21T15:09:28.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9c70 2024-09-21T15:09:28.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a50a8f0 2024-09-21T15:09:28.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a50a9c0 2024-09-21T15:09:28.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a50ac30 2024-09-21T15:09:28.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a50aea0 2024-09-21T15:09:28.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a50b930 2024-09-21T15:09:28.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a5c6d00 2024-09-21T15:09:28.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a5c7860 2024-09-21T15:09:28.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a6df860 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a6dfa00 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a9c85b0 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6340 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e64e0 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6a90 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e72b0 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72d00 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72ea0 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f450 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016b24fee0 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016bff6000 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016c23a000 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ee0 2024-09-21T15:09:28.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016d18f450 2024-09-21T15:09:28.989 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016dd771e0 2024-09-21T15:09:28.989 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:28.984+0000 7ff753f07700 -1 reset not still connected to 0x56016dd772b0 2024-09-21T15:09:29.008 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.026 INFO:teuthology.orchestra.run.smithi161.stdout:4228 trunc from 0x9f6f729 to 0x3e4fc02 2024-09-21T15:09:29.033 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.033 INFO:teuthology.orchestra.run.smithi161.stdout:3297 read 0x2fb8f2a thru 0x2fc6905 (0xd9dc bytes) 2024-09-21T15:09:29.033 INFO:teuthology.orchestra.run.smithi161.stdout:3298 read 0x4119e3d thru 0x4129d11 (0xfed5 bytes) 2024-09-21T15:09:29.033 INFO:teuthology.orchestra.run.smithi161.stdout:3299 write 0x330ee4f thru 0x331a1c8 (0xb37a bytes) 2024-09-21T15:09:29.052 INFO:teuthology.orchestra.run.smithi161.stdout:4221 write 0x6920b90 thru 0x692f8d8 (0xed49 bytes) 2024-09-21T15:09:29.065 INFO:teuthology.orchestra.run.smithi161.stdout:4391 write 0xb0f1799 thru 0xb101147 (0xf9af bytes) 2024-09-21T15:09:29.074 INFO:teuthology.orchestra.run.smithi161.stdout:4223 write 0x2467aa thru 0x256795 (0xffec bytes) 2024-09-21T15:09:29.093 INFO:teuthology.orchestra.run.smithi161.stdout:4392 write 0xd0782f5 thru 0xd0805e5 (0x82f1 bytes) 2024-09-21T15:09:29.095 INFO:teuthology.orchestra.run.smithi161.stdout:4484 write 0x8a04ac8 thru 0x8a0b41e (0x6957 bytes) 2024-09-21T15:09:29.097 INFO:teuthology.orchestra.run.smithi161.stdout:4225 read 0xf01917 thru 0xf04cb4 (0x339e bytes) 2024-09-21T15:09:29.102 INFO:teuthology.orchestra.run.smithi161.stdout:4226 trunc from 0x692f8d9 to 0x8f158c9 2024-09-21T15:09:29.107 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.107 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.107 INFO:teuthology.orchestra.run.smithi161.stdout:4232 read 0xa0e803 thru 0xa1e4ab (0xfca9 bytes) 2024-09-21T15:09:29.109 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.110 INFO:teuthology.orchestra.run.smithi161.stdout:4235 punch from 0x1477bd7 to 0x148779c, (0xfbc5 bytes) 2024-09-21T15:09:29.110 INFO:teuthology.orchestra.run.smithi161.stdout:4238 write 0x176a77b thru 0x177043d (0x5cc3 bytes) 2024-09-21T15:09:29.117 INFO:teuthology.orchestra.run.smithi161.stdout:3300 write 0xcc74f38 thru 0xcc84193 (0xf25c bytes) 2024-09-21T15:09:29.120 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.121 INFO:teuthology.orchestra.run.smithi161.stdout:4395 writesame 0x2732bed thru 0x2742200 data_size 0x2(0xf614 bytes) 2024-09-21T15:09:29.123 INFO:teuthology.orchestra.run.smithi161.stdout:4485 writesame 0x4a21ef2 thru 0x4a2740e data_size 0x1b(0x551d bytes) 2024-09-21T15:09:29.140 INFO:teuthology.orchestra.run.smithi161.stdout:3705 trunc from 0x8c41f4c to 0x91546b0 2024-09-21T15:09:29.146 INFO:teuthology.orchestra.run.smithi161.stdout:3303 read 0x456d589 thru 0x456e15e (0xbd6 bytes) 2024-09-21T15:09:29.146 INFO:teuthology.orchestra.run.smithi161.stdout:3304 read 0x5bf65cf thru 0x5bf8bcd (0x25ff bytes) 2024-09-21T15:09:29.147 INFO:teuthology.orchestra.run.smithi161.stdout:4486 read 0x86ed274 thru 0x86f2299 (0x5026 bytes) 2024-09-21T15:09:29.147 INFO:teuthology.orchestra.run.smithi161.stdout:4488 write 0x32845c9 thru 0x3286834 (0x226c bytes) 2024-09-21T15:09:29.152 INFO:teuthology.orchestra.run.smithi161.stdout:3305 trunc from 0xcc84194 to 0x94f2379 2024-09-21T15:09:29.152 INFO:teuthology.orchestra.run.smithi161.stdout:4239 punch from 0x2a0e48a to 0x2a135ca, (0x5140 bytes) 2024-09-21T15:09:29.153 INFO:teuthology.orchestra.run.smithi161.stdout:4396 punch from 0x2303f4e to 0x230e3c1, (0xa473 bytes) 2024-09-21T15:09:29.153 INFO:teuthology.orchestra.run.smithi161.stdout:4397 write 0x8deffbe thru 0x8df3502 (0x3545 bytes) 2024-09-21T15:09:29.158 INFO:teuthology.orchestra.run.smithi161.stdout:4490 read 0x2a957a1 thru 0x2a9ed93 (0x95f3 bytes) 2024-09-21T15:09:29.159 INFO:teuthology.orchestra.run.smithi161.stdout:4492 write 0x460a1bc thru 0x4610315 (0x615a bytes) 2024-09-21T15:09:29.160 INFO:teuthology.orchestra.run.smithi161.stdout:4227 read 0x5560f0c thru 0x556e0b7 (0xd1ac bytes) 2024-09-21T15:09:29.161 INFO:teuthology.orchestra.run.smithi161.stdout:4228 read 0x71879a4 thru 0x718944e (0x1aab bytes) 2024-09-21T15:09:29.161 INFO:teuthology.orchestra.run.smithi161.stdout:4229 write 0x526f8a9 thru 0x5273a8f (0x41e7 bytes) 2024-09-21T15:09:29.182 INFO:teuthology.orchestra.run.smithi161.stdout:4230 punch from 0x2d86c00 to 0x2d93e76, (0xd276 bytes) 2024-09-21T15:09:29.182 INFO:teuthology.orchestra.run.smithi161.stdout:4231 punch from 0x55108b8 to 0x5514598, (0x3ce0 bytes) 2024-09-21T15:09:29.182 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.182 INFO:teuthology.orchestra.run.smithi161.stdout:4233 write 0x6d54588 thru 0x6d624e8 (0xdf61 bytes) 2024-09-21T15:09:29.189 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:29.184+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cbb2e5a0 handle_clone_image: failed to clone image mirror/10adbcda57fd to image_cluster1.client.mirror.2-clone16 2024-09-21T15:09:29.196 INFO:teuthology.orchestra.run.smithi161.stdout:4398 trunc from 0xe42cce7 to 0xa6ff72 2024-09-21T15:09:29.207 INFO:teuthology.orchestra.run.smithi161.stdout:4234 trunc from 0x8f158c9 to 0x344c491 2024-09-21T15:09:29.212 INFO:teuthology.orchestra.run.smithi161.stdout:4242 writesame 0x67ddf73 thru 0x67ec308 data_size 0x1(0xe396 bytes) 2024-09-21T15:09:29.217 INFO:teuthology.orchestra.run.smithi161.stdout:4494 write 0xadaf66c thru 0xadb5a38 (0x63cd bytes) 2024-09-21T15:09:29.218 INFO:teuthology.orchestra.run.smithi161.stdout:4243 read 0x2a50362 thru 0x2a5ca57 (0xc6f6 bytes) 2024-09-21T15:09:29.228 INFO:teuthology.orchestra.run.smithi161.stdout:4244 trunc from 0x67ec309 to 0x38ca50 2024-09-21T15:09:29.242 INFO:teuthology.orchestra.run.smithi161.stdout:3306 writesame 0x97e6dd6 thru 0x97e9c6d data_size 0x4(0x2e98 bytes) 2024-09-21T15:09:29.252 INFO:teuthology.orchestra.run.smithi161.stdout:3706 writesame 0xe43bbeb thru 0xe43d213 data_size 0x3(0x1629 bytes) 2024-09-21T15:09:29.255 INFO:teuthology.orchestra.run.smithi161.stdout:3307 trunc from 0x97e9c6e to 0x9fa4792 2024-09-21T15:09:29.261 INFO:teuthology.orchestra.run.smithi161.stdout:3707 write 0xa35c239 thru 0xa3654a1 (0x9269 bytes) 2024-09-21T15:09:29.262 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.260+0000 7ff753f07700 -1 reset not still connected to 0x560167cc49c0 2024-09-21T15:09:29.268 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.264+0000 7ff753f07700 -1 reset not still connected to 0x560167cc4dd0 2024-09-21T15:09:29.274 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.268+0000 7ff753f07700 -1 reset not still connected to 0x560167cc5380 2024-09-21T15:09:29.275 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.268+0000 7ff753f07700 -1 reset not still connected to 0x560167cc5860 2024-09-21T15:09:29.275 INFO:teuthology.orchestra.run.smithi161.stdout:3708 write 0x2568d65 thru 0x2576341 (0xd5dd bytes) 2024-09-21T15:09:29.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x5601687569c0 2024-09-21T15:09:29.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x560168756a90 2024-09-21T15:09:29.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016878a1a0 2024-09-21T15:09:29.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016878ab60 2024-09-21T15:09:29.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016878ac30 2024-09-21T15:09:29.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016878add0 2024-09-21T15:09:29.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016878b040 2024-09-21T15:09:29.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016878b110 2024-09-21T15:09:29.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016878b1e0 2024-09-21T15:09:29.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016878b520 2024-09-21T15:09:29.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016878ba00 2024-09-21T15:09:29.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016878bc70 2024-09-21T15:09:29.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x560168802750 2024-09-21T15:09:29.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x5601688028f0 2024-09-21T15:09:29.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x560168803860 2024-09-21T15:09:29.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x560168803ee0 2024-09-21T15:09:29.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x560168d92340 2024-09-21T15:09:29.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x560168ff6dd0 2024-09-21T15:09:29.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x5601692225b0 2024-09-21T15:09:29.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x5601692b52b0 2024-09-21T15:09:29.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x560169400a90 2024-09-21T15:09:29.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x560169783c70 2024-09-21T15:09:29.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x560169e2eb60 2024-09-21T15:09:29.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x560169ec2dd0 2024-09-21T15:09:29.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x560169f100d0 2024-09-21T15:09:29.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x560169f10270 2024-09-21T15:09:29.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x560169f10680 2024-09-21T15:09:29.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9c70 2024-09-21T15:09:29.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016a50a8f0 2024-09-21T15:09:29.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016a50a9c0 2024-09-21T15:09:29.282 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016a50ac30 2024-09-21T15:09:29.283 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016a50aea0 2024-09-21T15:09:29.283 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.272+0000 7ff753f07700 -1 reset not still connected to 0x56016a50b930 2024-09-21T15:09:29.283 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016a6df2b0 2024-09-21T15:09:29.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016a6df860 2024-09-21T15:09:29.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016a6dfa00 2024-09-21T15:09:29.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016a9c85b0 2024-09-21T15:09:29.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6340 2024-09-21T15:09:29.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e64e0 2024-09-21T15:09:29.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6a90 2024-09-21T15:09:29.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e72b0 2024-09-21T15:09:29.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72820 2024-09-21T15:09:29.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72d00 2024-09-21T15:09:29.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72dd0 2024-09-21T15:09:29.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72ea0 2024-09-21T15:09:29.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016ad41ee0 2024-09-21T15:09:29.285 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f450 2024-09-21T15:09:29.285 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016b24fee0 2024-09-21T15:09:29.285 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.276+0000 7ff753f07700 -1 reset not still connected to 0x56016bff6000 2024-09-21T15:09:29.286 INFO:teuthology.orchestra.run.smithi161.stdout:4236 write 0x164f028 thru 0x165698b (0x7964 bytes) 2024-09-21T15:09:29.286 INFO:teuthology.orchestra.run.smithi161.stdout:4495 trunc from 0xadb5a39 to 0x2a7c2f 2024-09-21T15:09:29.287 INFO:teuthology.orchestra.run.smithi161.stdout:3710 writesame 0xd20974c thru 0xd2110dc data_size 0x1(0x7991 bytes) 2024-09-21T15:09:29.289 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.280+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b5ee0 2024-09-21T15:09:29.289 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.280+0000 7ff753f07700 -1 reset not still connected to 0x56016c23a000 2024-09-21T15:09:29.289 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.280+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:09:29.289 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.280+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ee0 2024-09-21T15:09:29.290 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.280+0000 7ff753f07700 -1 reset not still connected to 0x56016d18f450 2024-09-21T15:09:29.290 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.280+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e410 2024-09-21T15:09:29.290 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.280+0000 7ff753f07700 -1 reset not still connected to 0x56016dd771e0 2024-09-21T15:09:29.290 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.280+0000 7ff753f07700 -1 reset not still connected to 0x56016dd772b0 2024-09-21T15:09:29.290 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.284+0000 7ff753f07700 -1 reset not still connected to 0x56016e3288f0 2024-09-21T15:09:29.290 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.284+0000 7ff753f07700 -1 reset not still connected to 0x56016e328b60 2024-09-21T15:09:29.290 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.284+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed1e0 2024-09-21T15:09:29.291 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.284+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:09:29.291 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:29.284+0000 7ff753f07700 -1 reset not still connected to 0x56016ebedee0 2024-09-21T15:09:29.302 INFO:teuthology.orchestra.run.smithi161.stdout:3308 write 0x45ce07 thru 0x469f43 (0xd13d bytes) 2024-09-21T15:09:29.311 INFO:teuthology.orchestra.run.smithi161.stdout:4399 trunc from 0xa6ff72 to 0x8855e5b 2024-09-21T15:09:29.322 INFO:teuthology.orchestra.run.smithi161.stdout:3711 write 0x758bda6 thru 0x7598a10 (0xcc6b bytes) 2024-09-21T15:09:29.352 INFO:teuthology.orchestra.run.smithi161.stdout:4245 read 0x4e9d9 thru 0x50100 (0x1728 bytes) 2024-09-21T15:09:29.352 INFO:teuthology.orchestra.run.smithi161.stdout:4246 read 0x373332 thru 0x377b87 (0x4856 bytes) 2024-09-21T15:09:29.369 INFO:teuthology.orchestra.run.smithi161.stdout:4400 read 0x2379eb1 thru 0x2387c7d (0xddcd bytes) 2024-09-21T15:09:29.370 INFO:teuthology.orchestra.run.smithi161.stdout:4401 read 0xc1d9ab thru 0xc1ef7c (0x15d2 bytes) 2024-09-21T15:09:29.370 INFO:teuthology.orchestra.run.smithi161.stdout:4403 writesame 0x4ff3368 thru 0x4ffe800 data_size 0x21(0xb499 bytes) 2024-09-21T15:09:29.375 INFO:teuthology.orchestra.run.smithi161.stdout:4248 trunc from 0x38ca50 to 0xcc0f94d 2024-09-21T15:09:29.380 INFO:teuthology.orchestra.run.smithi161.stdout:3309 write 0xdc8883e thru 0xdc92ca8 (0xa46b bytes) 2024-09-21T15:09:29.393 INFO:teuthology.orchestra.run.smithi161.stdout:4237 write 0x8d22196 thru 0x8d2ab39 (0x89a4 bytes) 2024-09-21T15:09:29.397 INFO:teuthology.orchestra.run.smithi161.stdout:3310 writesame 0xc16191c thru 0xc161fc4 data_size 0xb(0x6a9 bytes) 2024-09-21T15:09:29.409 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.409 INFO:teuthology.orchestra.run.smithi161.stdout:3312 writesame 0x9c1a97f thru 0x9c24250 data_size 0x1f(0x98d2 bytes) 2024-09-21T15:09:29.410 INFO:teuthology.orchestra.run.smithi161.stdout:4238 read 0x6dc5a7d thru 0x6dc8f16 (0x349a bytes) 2024-09-21T15:09:29.410 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.411 INFO:teuthology.orchestra.run.smithi161.stdout:4243 write 0x7f21169 thru 0x7f2a213 (0x90ab bytes) 2024-09-21T15:09:29.421 INFO:teuthology.orchestra.run.smithi161.stdout:4249 punch from 0x33ef29e to 0x33fc3a5, (0xd107 bytes) 2024-09-21T15:09:29.421 INFO:teuthology.orchestra.run.smithi161.stdout:4250 write 0x6d34f38 thru 0x6d35e47 (0xf10 bytes) 2024-09-21T15:09:29.424 INFO:teuthology.orchestra.run.smithi161.stdout:3712 writesame 0x6f454a4 thru 0x6f4cc1b data_size 0x4(0x7778 bytes) 2024-09-21T15:09:29.433 INFO:teuthology.orchestra.run.smithi161.stdout:3313 write 0xfe5805 thru 0xff1bcd (0xc3c9 bytes) 2024-09-21T15:09:29.433 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.433 INFO:teuthology.orchestra.run.smithi161.stdout:4246 punch from 0x258da85 to 0x2591091, (0x360c bytes) 2024-09-21T15:09:29.434 INFO:teuthology.orchestra.run.smithi161.stdout:4247 write 0x3e0c1a0 thru 0x3e17396 (0xb1f7 bytes) 2024-09-21T15:09:29.451 INFO:teuthology.orchestra.run.smithi161.stdout:4248 read 0x3eb5315 thru 0x3eb7c7d (0x2969 bytes) 2024-09-21T15:09:29.452 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.452 INFO:teuthology.orchestra.run.smithi161.stdout:4252 read 0x461fa4e thru 0x4622128 (0x26db bytes) 2024-09-21T15:09:29.452 INFO:teuthology.orchestra.run.smithi161.stdout:4250 write 0x8623c4 thru 0x8640bc (0x1cf9 bytes) 2024-09-21T15:09:29.452 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.453 INFO:teuthology.orchestra.run.smithi161.stdout:4254 read 0xaff7ac thru 0xb027fc (0x3051 bytes) 2024-09-21T15:09:29.458 INFO:teuthology.orchestra.run.smithi161.stdout:4404 write 0xd8d7b91 thru 0xd8d9b6a (0x1fda bytes) 2024-09-21T15:09:29.461 INFO:teuthology.orchestra.run.smithi161.stdout:3314 write 0x83fd43a thru 0x840388d (0x6454 bytes) 2024-09-21T15:09:29.466 INFO:teuthology.orchestra.run.smithi161.stdout:4251 clone 28 order 21 su 8192 sc 4 2024-09-21T15:09:29.479 INFO:teuthology.orchestra.run.smithi161.stdout:4405 read 0x29c5ee9 thru 0x29c7ec3 (0x1fdb bytes) 2024-09-21T15:09:29.479 INFO:teuthology.orchestra.run.smithi161.stdout:4406 punch from 0x1e48dc0 to 0x1e4ccad, (0x3eed bytes) 2024-09-21T15:09:29.479 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.479 INFO:teuthology.orchestra.run.smithi161.stdout:4409 write 0x1695e67 thru 0x169d569 (0x7703 bytes) 2024-09-21T15:09:29.483 INFO:teuthology.orchestra.run.smithi161.stdout:4255 trunc from 0xcc0f94d to 0x1d0bc7e 2024-09-21T15:09:29.487 INFO:teuthology.orchestra.run.smithi161.stdout:3315 write 0x9e242f7 thru 0x9e264be (0x21c8 bytes) 2024-09-21T15:09:29.502 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.502 INFO:teuthology.orchestra.run.smithi161.stdout:3317 trunc from 0xdc92ca9 to 0xce3a959 2024-09-21T15:09:29.509 INFO:teuthology.orchestra.run.smithi161.stdout:4410 write 0x48c0fe2 thru 0x48cf08e (0xe0ad bytes) 2024-09-21T15:09:29.544 INFO:teuthology.orchestra.run.smithi161.stdout:3318 punch from 0x53a994a to 0x53b6ad6, (0xd18c bytes) 2024-09-21T15:09:29.544 INFO:teuthology.orchestra.run.smithi161.stdout:3320 read 0x7f2c08d thru 0x7f31f62 (0x5ed6 bytes) 2024-09-21T15:09:29.544 INFO:teuthology.orchestra.run.smithi161.stdout:3321 read 0x8190791 thru 0x8196c73 (0x64e3 bytes) 2024-09-21T15:09:29.544 INFO:teuthology.orchestra.run.smithi161.stdout:3322 read 0xd13172 thru 0xd1cf28 (0x9db7 bytes) 2024-09-21T15:09:29.547 INFO:teuthology.orchestra.run.smithi161.stdout:3323 read 0x2c9d1a7 thru 0x2c9d812 (0x66c bytes) 2024-09-21T15:09:29.547 INFO:teuthology.orchestra.run.smithi161.stdout:3324 read 0x16129ff thru 0x161c6e8 (0x9cea bytes) 2024-09-21T15:09:29.547 INFO:teuthology.orchestra.run.smithi161.stdout:3325 writesame 0xa5b1bd8 thru 0xa5bc323 data_size 0xc(0xa74c bytes) 2024-09-21T15:09:29.553 INFO:teuthology.orchestra.run.smithi161.stdout:3713 writesame 0xbbe117b thru 0xbbe7cda data_size 0x10(0x6b60 bytes) 2024-09-21T15:09:29.565 INFO:teuthology.orchestra.run.smithi161.stdout:4411 punch from 0x88b3b2e to 0x88b84cd, (0x499f bytes) 2024-09-21T15:09:29.565 INFO:teuthology.orchestra.run.smithi161.stdout:3327 read 0x49f3523 thru 0x4a00a50 (0xd52e bytes) 2024-09-21T15:09:29.565 INFO:teuthology.orchestra.run.smithi161.stdout:3328 clone 39 order 18 su 2048 sc 9 2024-09-21T15:09:29.567 INFO:teuthology.orchestra.run.smithi161.stdout:4414 trunc from 0xd8d9b6b to 0x7d58cd3 2024-09-21T15:09:29.611 INFO:teuthology.orchestra.run.smithi161.stdout:3714 read 0xd006b4f thru 0xd011fe6 (0xb498 bytes) 2024-09-21T15:09:29.612 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.620 INFO:teuthology.orchestra.run.smithi161.stdout:3717 trunc from 0xe43d214 to 0x81745ac 2024-09-21T15:09:29.630 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.3 2024-09-21T15:09:29.630 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:09:29.631 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.3 2024-09-21T15:09:29.631 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Restarting daemon 2024-09-21T15:09:29.631 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.3 2024-09-21T15:09:29.633 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Started 2024-09-21T15:09:29.633 INFO:tasks.rbd_mirror_thrash:waiting for 93 secs before thrashing 2024-09-21T15:09:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:4496 writesame 0x2329ecf thru 0x233032d data_size 0xf(0x645f bytes) 2024-09-21T15:09:29.651 INFO:teuthology.orchestra.run.smithi161.stdout:4256 write 0x9a27d7d thru 0x9a3714e (0xf3d2 bytes) 2024-09-21T15:09:29.653 INFO:teuthology.orchestra.run.smithi161.stdout:4497 read 0xc0882b thru 0xc185d3 (0xfda9 bytes) 2024-09-21T15:09:29.653 INFO:teuthology.orchestra.run.smithi161.stdout:4500 punch from 0x2ddf77 to 0x2e2f46, (0x4fcf bytes) 2024-09-21T15:09:29.653 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:4415 read 0x1486136 thru 0x148e1a2 (0x806d bytes) 2024-09-21T15:09:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:4419 writesame 0x17349e6 thru 0x1742c20 data_size 0x8f(0xe23b bytes) 2024-09-21T15:09:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:4257 punch from 0x68d8af2 to 0x68e4f8d, (0xc49b bytes) 2024-09-21T15:09:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:4258 read 0x48dfbf thru 0x494aeb (0x6b2d bytes) 2024-09-21T15:09:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:4259 write 0x53d48b4 thru 0x53d8c13 (0x4360 bytes) 2024-09-21T15:09:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:4420 writesame 0x460dbd thru 0x46ec92 data_size 0xb(0xded6 bytes) 2024-09-21T15:09:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:4260 write 0x7b6ca71 thru 0x7b7a596 (0xdb26 bytes) 2024-09-21T15:09:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:4262 read 0x487119a thru 0x487ac1d (0x9a84 bytes) 2024-09-21T15:09:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:4263 trunc from 0x9a3714f to 0xa517179 2024-09-21T15:09:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:4503 writesame 0x5fd30b9 thru 0x5fde792 data_size 0x1f(0xb6da bytes) 2024-09-21T15:09:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:4422 write 0x8b05b5a thru 0x8b132c7 (0xd76e bytes) 2024-09-21T15:09:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:3718 writesame 0x99e2e5a thru 0x99eb04c data_size 0xd(0x81f3 bytes) 2024-09-21T15:09:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:4505 write 0xbc8c710 thru 0xbc94c48 (0x8539 bytes) 2024-09-21T15:09:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:4423 write 0xaac5800 thru 0xaace541 (0x8d42 bytes) 2024-09-21T15:09:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:4265 write 0xc89bd7b thru 0xc8ab5a0 (0xf826 bytes) 2024-09-21T15:09:29.801 INFO:teuthology.orchestra.run.smithi161.stdout:3720 writesame 0xade001a thru 0xade6fe4 data_size 0x1(0x6fcb bytes) 2024-09-21T15:09:29.806 INFO:teuthology.orchestra.run.smithi161.stdout:3722 write 0x781be64 thru 0x781c298 (0x435 bytes) 2024-09-21T15:09:29.809 INFO:teuthology.orchestra.run.smithi161.stdout:4270 write 0xa2e27e0 thru 0xa2e3797 (0xfb8 bytes) 2024-09-21T15:09:29.810 INFO:teuthology.orchestra.run.smithi161.stdout:4506 trunc from 0xbc94c49 to 0x27d2afe 2024-09-21T15:09:29.812 INFO:teuthology.orchestra.run.smithi161.stdout:3723 write 0x3c5b8ac thru 0x3c603a1 (0x4af6 bytes) 2024-09-21T15:09:29.821 INFO:teuthology.orchestra.run.smithi161.stdout:4271 read 0x942d50f thru 0x94332b0 (0x5da2 bytes) 2024-09-21T15:09:29.821 INFO:teuthology.orchestra.run.smithi161.stdout:4272 read 0xb44b4c8 thru 0xb44beae (0x9e7 bytes) 2024-09-21T15:09:29.821 INFO:teuthology.orchestra.run.smithi161.stdout:4274 read 0x8d3b7e2 thru 0x8d428ac (0x70cb bytes) 2024-09-21T15:09:29.821 INFO:teuthology.orchestra.run.smithi161.stdout:4277 read 0x6673520 thru 0x6676aa6 (0x3587 bytes) 2024-09-21T15:09:29.821 INFO:teuthology.orchestra.run.smithi161.stdout:4278 read 0x1693879 thru 0x169a04b (0x67d3 bytes) 2024-09-21T15:09:29.837 INFO:teuthology.orchestra.run.smithi161.stdout:4280 trunc from 0xc8ab5a1 to 0x2b2ea78 2024-09-21T15:09:29.851 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone38 from 0xce3a959 (overlap 0x21a6ec0) to 0x1aebf00 2024-09-21T15:09:29.875 INFO:teuthology.orchestra.run.smithi161.stdout:4425 write 0xe456b4b thru 0xe4641fa (0xd6b0 bytes) 2024-09-21T15:09:29.908 INFO:teuthology.orchestra.run.smithi161.stdout:4426 read 0xc24ed1e thru 0xc24fcdf (0xfc2 bytes) 2024-09-21T15:09:29.908 INFO:teuthology.orchestra.run.smithi161.stdout:4428 read 0xd5ab580 thru 0xd5ae8fc (0x337d bytes) 2024-09-21T15:09:29.908 INFO:teuthology.orchestra.run.smithi161.stdout:4429 read 0xab805c2 thru 0xab8bd9d (0xb7dc bytes) 2024-09-21T15:09:29.908 INFO:teuthology.orchestra.run.smithi161.stdout:4430 punch from 0x8e7b0fb to 0x8e87283, (0xc188 bytes) 2024-09-21T15:09:29.909 INFO:teuthology.orchestra.run.smithi161.stdout:4431 punch from 0xb44bb57 to 0xb44f6c3, (0x3b6c bytes) 2024-09-21T15:09:29.909 INFO:teuthology.orchestra.run.smithi161.stdout:4432 read 0x987b7c1 thru 0x9880563 (0x4da3 bytes) 2024-09-21T15:09:29.909 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.914 INFO:teuthology.orchestra.run.smithi161.stdout:4281 writesame 0x1c0a85d thru 0x1c1344c data_size 0x8(0x8bf0 bytes) 2024-09-21T15:09:29.924 INFO:teuthology.orchestra.run.smithi161.stdout:4435 trunc from 0xe4641fb to 0x5bb637a 2024-09-21T15:09:29.933 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:29.961 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone27 from 0x8d2ab3a (overlap 0x46a8cb) to 0x1c4384 2024-09-21T15:09:29.979 INFO:teuthology.orchestra.run.smithi161.stdout:3724 read 0x70f85ac thru 0x70fa5eb (0x2040 bytes) 2024-09-21T15:09:29.979 INFO:teuthology.orchestra.run.smithi161.stdout:3726 write 0x23b8396 thru 0x23bac33 (0x289e bytes) 2024-09-21T15:09:30.006 INFO:teuthology.orchestra.run.smithi161.stdout:4436 read 0x2ef3046 thru 0x2ef34ec (0x4a7 bytes) 2024-09-21T15:09:30.006 INFO:teuthology.orchestra.run.smithi161.stdout:4440 write 0x2192f5e thru 0x219dc31 (0xacd4 bytes) 2024-09-21T15:09:30.022 INFO:teuthology.orchestra.run.smithi161.stdout:4284 write 0xe9a2aaf thru 0xe9af8e7 (0xce39 bytes) 2024-09-21T15:09:30.036 INFO:teuthology.orchestra.run.smithi161.stdout:4286 write 0x46c4b96 thru 0x46d054b (0xb9b6 bytes) 2024-09-21T15:09:30.051 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.051 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.051 INFO:teuthology.orchestra.run.smithi161.stdout:4289 write 0x965baa thru 0x97372e (0xdb85 bytes) 2024-09-21T15:09:30.070 INFO:teuthology.orchestra.run.smithi161.stdout:4290 write 0x4c3ebf7 thru 0x4c44ba5 (0x5faf bytes) 2024-09-21T15:09:30.082 INFO:teuthology.orchestra.run.smithi161.stdout:4441 write 0xbb3fd2e thru 0xbb449a8 (0x4c7b bytes) 2024-09-21T15:09:30.082 INFO:teuthology.orchestra.run.smithi161.stdout:4508 write 0xeac727d thru 0xeace98c (0x7710 bytes) 2024-09-21T15:09:30.099 INFO:teuthology.orchestra.run.smithi161.stdout:4443 read 0x3d0ac64 thru 0x3d1415d (0x94fa bytes) 2024-09-21T15:09:30.100 INFO:teuthology.orchestra.run.smithi161.stdout:4445 write 0x2062b0 thru 0x2138b2 (0xd603 bytes) 2024-09-21T15:09:30.120 INFO:teuthology.orchestra.run.smithi161.stdout:4291 write 0x864d596 thru 0x86512b4 (0x3d1f bytes) 2024-09-21T15:09:30.123 INFO:teuthology.orchestra.run.smithi161.stdout:4446 read 0x664d077 thru 0x6658f64 (0xbeee bytes) 2024-09-21T15:09:30.123 INFO:teuthology.orchestra.run.smithi161.stdout:4447 read 0x73b9816 thru 0x73c879a (0xef85 bytes) 2024-09-21T15:09:30.125 INFO:teuthology.orchestra.run.smithi161.stdout:4449 write 0x95a8026 thru 0x95b3001 (0xafdc bytes) 2024-09-21T15:09:30.132 INFO:teuthology.orchestra.run.smithi161.stdout:4292 read 0x48e0319 thru 0x48eff23 (0xfc0b bytes) 2024-09-21T15:09:30.132 INFO:teuthology.orchestra.run.smithi161.stdout:4294 read 0x59a8b47 thru 0x59b00cd (0x7587 bytes) 2024-09-21T15:09:30.132 INFO:teuthology.orchestra.run.smithi161.stdout:4296 write 0xb86e527 thru 0xb87b106 (0xcbe0 bytes) 2024-09-21T15:09:30.135 INFO:teuthology.orchestra.run.smithi161.stdout:4509 write 0xedd81d5 thru 0xede1658 (0x9484 bytes) 2024-09-21T15:09:30.139 INFO:teuthology.orchestra.run.smithi161.stdout:4450 read 0xac6cdc4 thru 0xac7569e (0x88db bytes) 2024-09-21T15:09:30.139 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.140 INFO:teuthology.orchestra.run.smithi161.stdout:4452 read 0x1a9d2d0 thru 0x1aa2e82 (0x5bb3 bytes) 2024-09-21T15:09:30.149 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.149 INFO:teuthology.orchestra.run.smithi161.stdout:4299 writesame 0x5bbc182 thru 0x5bc79fa data_size 0x5(0xb879 bytes) 2024-09-21T15:09:30.151 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.151 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.161 INFO:teuthology.orchestra.run.smithi161.stdout:4453 trunc from 0xbb449a9 to 0x1e4061f 2024-09-21T15:09:30.161 INFO:teuthology.orchestra.run.smithi161.stdout:4301 trunc from 0xe9af8e8 to 0xe9b7178 2024-09-21T15:09:30.176 INFO:teuthology.orchestra.run.smithi161.stdout:4518 trunc from 0xede1659 to 0xb1aebe 2024-09-21T15:09:30.176 INFO:teuthology.orchestra.run.smithi161.stdout:3728 writesame 0x7f6009b thru 0x7f61a63 data_size 0x17(0x19c9 bytes) 2024-09-21T15:09:30.192 INFO:teuthology.orchestra.run.smithi161.stdout:3729 trunc from 0xade6fe5 to 0xe93fadc 2024-09-21T15:09:30.194 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #37, image image_cluster1.client.mirror.3-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent38 2024-09-21T15:09:30.215 INFO:teuthology.orchestra.run.smithi161.stdout:4302 read 0x40db5e4 thru 0x40e648b (0xaea8 bytes) 2024-09-21T15:09:30.215 INFO:teuthology.orchestra.run.smithi161.stdout:4303 read 0x7519d5f thru 0x751bd15 (0x1fb7 bytes) 2024-09-21T15:09:30.215 INFO:teuthology.orchestra.run.smithi161.stdout:4305 writesame 0x2ef6c5f thru 0x2ef9d58 data_size 0x1(0x30fa bytes) 2024-09-21T15:09:30.223 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #26, image image_cluster1.client.mirror.5-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent27 2024-09-21T15:09:30.236 INFO:teuthology.orchestra.run.smithi161.stdout:4455 trunc from 0x1e4061f to 0xb3e1713 2024-09-21T15:09:30.248 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.248 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.248 INFO:teuthology.orchestra.run.smithi161.stdout:4308 write 0xa6fc5b9 thru 0xa70a1f4 (0xdc3c bytes) 2024-09-21T15:09:30.254 INFO:teuthology.orchestra.run.smithi161.stdout:4519 read 0xab1b05 thru 0xabbe28 (0xa324 bytes) 2024-09-21T15:09:30.274 INFO:teuthology.orchestra.run.smithi161.stdout:4310 write 0xc8d1d64 thru 0xc8d9779 (0x7a16 bytes) 2024-09-21T15:09:30.277 INFO:teuthology.orchestra.run.smithi161.stdout:4521 trunc from 0xb1aebe to 0xd131c05 2024-09-21T15:09:30.279 INFO:teuthology.orchestra.run.smithi161.stdout:4456 write 0x45e00ed thru 0x45ec143 (0xc057 bytes) 2024-09-21T15:09:30.280 INFO:teuthology.orchestra.run.smithi161.stdout:3329 read 0x49d01f2 thru 0x49df8a4 (0xf6b3 bytes) 2024-09-21T15:09:30.285 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.293 INFO:teuthology.orchestra.run.smithi161.stdout:4253 trunc from 0x8d2ab3a to 0xd859d88 2024-09-21T15:09:30.294 INFO:teuthology.orchestra.run.smithi161.stdout:4457 write 0x828257e thru 0x828ddb9 (0xb83c bytes) 2024-09-21T15:09:30.297 INFO:teuthology.orchestra.run.smithi161.stdout:4311 write 0x72e9da9 thru 0x72f9194 (0xf3ec bytes) 2024-09-21T15:09:30.301 INFO:teuthology.orchestra.run.smithi161.stdout:3731 write 0xec0020c thru 0xec0ae05 (0xabfa bytes) 2024-09-21T15:09:30.309 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.309 INFO:teuthology.orchestra.run.smithi161.stdout:4523 write 0x8f92b4b thru 0x8f94f1a (0x23d0 bytes) 2024-09-21T15:09:30.311 INFO:teuthology.orchestra.run.smithi161.stdout:4458 read 0x6cf30e0 thru 0x6cf92f7 (0x6218 bytes) 2024-09-21T15:09:30.314 INFO:teuthology.orchestra.run.smithi161.stdout:3330 punch from 0xa99e97b to 0xa99f1a2, (0x827 bytes) 2024-09-21T15:09:30.315 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.315 INFO:teuthology.orchestra.run.smithi161.stdout:3333 read 0x73e5edd thru 0x73f320c (0xd330 bytes) 2024-09-21T15:09:30.315 INFO:teuthology.orchestra.run.smithi161.stdout:4459 trunc from 0xb3e1713 to 0xa429d6d 2024-09-21T15:09:30.316 INFO:teuthology.orchestra.run.smithi161.stdout:3334 clone 40 order 23 su 32768 sc 9 2024-09-21T15:09:30.318 INFO:teuthology.orchestra.run.smithi161.stdout:3732 writesame 0xbfd7cfd thru 0xbfddd95 data_size 0x1(0x6099 bytes) 2024-09-21T15:09:30.320 INFO:teuthology.orchestra.run.smithi161.stdout:4312 read 0x94d24a8 thru 0x94d31f5 (0xd4e bytes) 2024-09-21T15:09:30.320 INFO:teuthology.orchestra.run.smithi161.stdout:4313 write 0x21f88c thru 0x222b42 (0x32b7 bytes) 2024-09-21T15:09:30.331 INFO:teuthology.orchestra.run.smithi161.stdout:4524 read 0xba88f70 thru 0xba95cd0 (0xcd61 bytes) 2024-09-21T15:09:30.340 INFO:teuthology.orchestra.run.smithi161.stdout:4314 punch from 0x9c4857f to 0x9c496b3, (0x1134 bytes) 2024-09-21T15:09:30.340 INFO:teuthology.orchestra.run.smithi161.stdout:4315 read 0x765fdac thru 0x7660291 (0x4e6 bytes) 2024-09-21T15:09:30.341 INFO:teuthology.orchestra.run.smithi161.stdout:4317 writesame 0xc3f48a3 thru 0xc3f9ad7 data_size 0x45(0x5235 bytes) 2024-09-21T15:09:30.349 INFO:teuthology.orchestra.run.smithi161.stdout:3733 clone 35 order 19 su 32768 sc 5 2024-09-21T15:09:30.365 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:30.363+0000 7f1e9c77a700 -1 reset not still connected to 0x56289fa76340 2024-09-21T15:09:30.366 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.366 INFO:teuthology.orchestra.run.smithi161.stdout:4320 punch from 0xd3f6051 to 0xd3f8497, (0x2446 bytes) 2024-09-21T15:09:30.367 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.367 INFO:teuthology.orchestra.run.smithi161.stdout:4323 writesame 0x9899be4 thru 0x98a2340 data_size 0x1(0x875d bytes) 2024-09-21T15:09:30.376 INFO:teuthology.orchestra.run.smithi161.stdout:4462 read 0x718e5ff thru 0x719c554 (0xdf56 bytes) 2024-09-21T15:09:30.377 INFO:teuthology.orchestra.run.smithi161.stdout:4463 punch from 0x3b882bf to 0x3b91017, (0x8d58 bytes) 2024-09-21T15:09:30.377 INFO:teuthology.orchestra.run.smithi161.stdout:4464 read 0x4827522 thru 0x4831012 (0x9af1 bytes) 2024-09-21T15:09:30.381 INFO:teuthology.orchestra.run.smithi161.stdout:4526 write 0xe8cf0ea thru 0xe8d85ad (0x94c4 bytes) 2024-09-21T15:09:30.407 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.407 INFO:teuthology.orchestra.run.smithi161.stdout:4326 read 0x6056d04 thru 0x6060593 (0x9890 bytes) 2024-09-21T15:09:30.407 INFO:teuthology.orchestra.run.smithi161.stdout:4327 writesame 0x4d90682 thru 0x4d9ca1b data_size 0x1(0xc39a bytes) 2024-09-21T15:09:30.411 INFO:teuthology.orchestra.run.smithi161.stdout:4254 write 0xdbf6a27 thru 0xdbfd108 (0x66e2 bytes) 2024-09-21T15:09:30.417 INFO:teuthology.orchestra.run.smithi161.stdout:4465 writesame 0xb3d2acd thru 0xb3d3cde data_size 0x9(0x1212 bytes) 2024-09-21T15:09:30.437 INFO:teuthology.orchestra.run.smithi161.stdout:4466 read 0x1874cf7 thru 0x18840e2 (0xf3ec bytes) 2024-09-21T15:09:30.437 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.437 INFO:teuthology.orchestra.run.smithi161.stdout:4470 punch from 0x6610cf8 to 0x6615183, (0x448b bytes) 2024-09-21T15:09:30.437 INFO:teuthology.orchestra.run.smithi161.stdout:4471 punch from 0x94dfcc0 to 0x94ef676, (0xf9b6 bytes) 2024-09-21T15:09:30.438 INFO:teuthology.orchestra.run.smithi161.stdout:4472 write 0x1ad064e thru 0x1ad12df (0xc92 bytes) 2024-09-21T15:09:30.442 INFO:teuthology.orchestra.run.smithi161.stdout:4255 read 0x213fb7f thru 0x214220b (0x268d bytes) 2024-09-21T15:09:30.442 INFO:teuthology.orchestra.run.smithi161.stdout:4257 write 0x2031ff3 thru 0x2034e8f (0x2e9d bytes) 2024-09-21T15:09:30.447 INFO:teuthology.orchestra.run.smithi161.stdout:4473 write 0x42753e7 thru 0x427a0a4 (0x4cbe bytes) 2024-09-21T15:09:30.450 INFO:teuthology.orchestra.run.smithi161.stdout:4329 read 0x88d2e79 thru 0x88d6908 (0x3a90 bytes) 2024-09-21T15:09:30.450 INFO:teuthology.orchestra.run.smithi161.stdout:4331 writesame 0x3afe6db thru 0x3b09faf data_size 0x1(0xb8d5 bytes) 2024-09-21T15:09:30.475 INFO:teuthology.orchestra.run.smithi161.stdout:4527 write 0xed7ea9b thru 0xed86612 (0x7b78 bytes) 2024-09-21T15:09:30.477 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.477 INFO:teuthology.orchestra.run.smithi161.stdout:4259 writesame 0x5b50cc6 thru 0x5b58c46 data_size 0x1(0x7f81 bytes) 2024-09-21T15:09:30.491 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.491 INFO:teuthology.orchestra.run.smithi161.stdout:4336 read 0xd5f0bbd thru 0xd5f65b8 (0x59fc bytes) 2024-09-21T15:09:30.491 INFO:teuthology.orchestra.run.smithi161.stdout:4337 writesame 0xc6d02d7 thru 0xc6dc242 data_size 0x2(0xbf6c bytes) 2024-09-21T15:09:30.498 INFO:teuthology.orchestra.run.smithi161.stdout:4528 read 0x5bdc398 thru 0x5be1308 (0x4f71 bytes) 2024-09-21T15:09:30.498 INFO:teuthology.orchestra.run.smithi161.stdout:4529 read 0x4cb5cf5 thru 0x4cc42e2 (0xe5ee bytes) 2024-09-21T15:09:30.499 INFO:teuthology.orchestra.run.smithi161.stdout:4531 read 0x8f901b8 thru 0x8f9124d (0x1096 bytes) 2024-09-21T15:09:30.499 INFO:teuthology.orchestra.run.smithi161.stdout:4532 punch from 0xcac2ee4 to 0xcac311a, (0x236 bytes) 2024-09-21T15:09:30.499 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.502 INFO:teuthology.orchestra.run.smithi161.stdout:4474 write 0xd07e5f5 thru 0xd086549 (0x7f55 bytes) 2024-09-21T15:09:30.509 INFO:teuthology.orchestra.run.smithi161.stdout:4534 trunc from 0xed86613 to 0xa387179 2024-09-21T15:09:30.518 INFO:teuthology.orchestra.run.smithi161.stdout:4261 read 0xab0ffeb thru 0xab156ff (0x5715 bytes) 2024-09-21T15:09:30.519 INFO:teuthology.orchestra.run.smithi161.stdout:4262 read 0x6080006 thru 0x608291d (0x2918 bytes) 2024-09-21T15:09:30.519 INFO:teuthology.orchestra.run.smithi161.stdout:4263 writesame 0x3e863f7 thru 0x3e9577e data_size 0x4(0xf388 bytes) 2024-09-21T15:09:30.528 INFO:teuthology.orchestra.run.smithi161.stdout:4339 write 0x95ce522 thru 0x95d57af (0x728e bytes) 2024-09-21T15:09:30.533 INFO:teuthology.orchestra.run.smithi161.stdout:4475 trunc from 0xd08654a to 0xa6908e4 2024-09-21T15:09:30.556 INFO:teuthology.orchestra.run.smithi161.stdout:4340 write 0x4148f16 thru 0x4158bf8 (0xfce3 bytes) 2024-09-21T15:09:30.579 INFO:teuthology.orchestra.run.smithi161.stdout:4264 writesame 0x37b7957 thru 0x37bf6ed data_size 0x7(0x7d97 bytes) 2024-09-21T15:09:30.583 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.583 INFO:teuthology.orchestra.run.smithi161.stdout:4536 read 0x650eda1 thru 0x6514df4 (0x6054 bytes) 2024-09-21T15:09:30.583 INFO:teuthology.orchestra.run.smithi161.stdout:4537 punch from 0x501ec0a to 0x502c0d1, (0xd4c7 bytes) 2024-09-21T15:09:30.584 INFO:teuthology.orchestra.run.smithi161.stdout:4342 read 0x27d4558 thru 0x27e3949 (0xf3f2 bytes) 2024-09-21T15:09:30.584 INFO:teuthology.orchestra.run.smithi161.stdout:4540 flatten 2024-09-21T15:09:30.584 INFO:teuthology.orchestra.run.smithi161.stdout:4343 punch from 0x8f945b2 to 0x8fa0399, (0xbde7 bytes) 2024-09-21T15:09:30.584 INFO:teuthology.orchestra.run.smithi161.stdout:4344 read 0x398544a thru 0x39946b4 (0xf26b bytes) 2024-09-21T15:09:30.585 INFO:teuthology.orchestra.run.smithi161.stdout:4345 read 0x1ba577e thru 0x1bb20bf (0xc942 bytes) 2024-09-21T15:09:30.603 INFO:teuthology.orchestra.run.smithi161.stdout:4347 trunc from 0xe9b7178 to 0x6bde9b8 2024-09-21T15:09:30.620 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.628 INFO:teuthology.orchestra.run.smithi161.stdout:4265 trunc from 0xdbfd109 to 0xd2104db 2024-09-21T15:09:30.637 INFO:teuthology.orchestra.run.smithi161.stdout:4541 read 0x7c55b15 thru 0x7c57168 (0x1654 bytes) 2024-09-21T15:09:30.637 INFO:teuthology.orchestra.run.smithi161.stdout:4542 punch from 0x7a0579c to 0x7a0ea4d, (0x92b1 bytes) 2024-09-21T15:09:30.655 INFO:teuthology.orchestra.run.smithi161.stdout:4477 write 0xd43079b thru 0xd43ec99 (0xe4ff bytes) 2024-09-21T15:09:30.655 INFO:teuthology.orchestra.run.smithi161.stdout:4543 trunc from 0xa387179 to 0x24b5745 2024-09-21T15:09:30.672 INFO:teuthology.orchestra.run.smithi161.stdout:4349 write 0x2db5758 thru 0x2dbc486 (0x6d2f bytes) 2024-09-21T15:09:30.675 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.675 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.676 INFO:teuthology.orchestra.run.smithi161.stdout:4481 read 0x3234488 thru 0x323a431 (0x5faa bytes) 2024-09-21T15:09:30.676 INFO:teuthology.orchestra.run.smithi161.stdout:4484 write 0x36316a5 thru 0x3631826 (0x182 bytes) 2024-09-21T15:09:30.687 INFO:teuthology.orchestra.run.smithi161.stdout:4485 punch from 0x217d3a2 to 0x2189da0, (0xc9fe bytes) 2024-09-21T15:09:30.693 INFO:teuthology.orchestra.run.smithi161.stdout:4350 punch from 0x37c681a to 0x37c6ffa, (0x7e0 bytes) 2024-09-21T15:09:30.693 INFO:teuthology.orchestra.run.smithi161.stdout:4351 write 0x83a861 thru 0x847039 (0xc7d9 bytes) 2024-09-21T15:09:30.695 INFO:teuthology.orchestra.run.smithi161.stdout:4266 writesame 0x8c9e0f5 thru 0x8cab8ff data_size 0x1(0xd80b bytes) 2024-09-21T15:09:30.706 INFO:teuthology.orchestra.run.smithi161.stdout:4486 trunc from 0xd43ec9a to 0x406dc07 2024-09-21T15:09:30.709 INFO:teuthology.orchestra.run.smithi161.stdout:4352 writesame 0x3290b89 thru 0x329ef0f data_size 0x1(0xe387 bytes) 2024-09-21T15:09:30.755 INFO:teuthology.orchestra.run.smithi161.stdout:4268 punch from 0x587f1ce to 0x588b0be, (0xbef0 bytes) 2024-09-21T15:09:30.755 INFO:teuthology.orchestra.run.smithi161.stdout:4269 read 0xbccbe6 thru 0xbdb948 (0xed63 bytes) 2024-09-21T15:09:30.758 INFO:teuthology.orchestra.run.smithi161.stdout:4271 read 0xcea46fd thru 0xcea8e2c (0x4730 bytes) 2024-09-21T15:09:30.758 INFO:teuthology.orchestra.run.smithi161.stdout:4272 punch from 0x2b2e978 to 0x2b39731, (0xadb9 bytes) 2024-09-21T15:09:30.758 INFO:teuthology.orchestra.run.smithi161.stdout:4273 write 0x4076675 thru 0x4078470 (0x1dfc bytes) 2024-09-21T15:09:30.785 INFO:teuthology.orchestra.run.smithi161.stdout:4544 write 0x42cc362 thru 0x42d0c37 (0x48d6 bytes) 2024-09-21T15:09:30.796 INFO:teuthology.orchestra.run.smithi161.stdout:4275 punch from 0x5d0c67b to 0x5d123c6, (0x5d4b bytes) 2024-09-21T15:09:30.801 INFO:teuthology.orchestra.run.smithi161.stdout:4545 punch from 0x3277f24 to 0x3287cf1, (0xfdcd bytes) 2024-09-21T15:09:30.801 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.801 INFO:teuthology.orchestra.run.smithi161.stdout:4548 trunc from 0x42d0c38 to 0x43b69a8 2024-09-21T15:09:30.804 INFO:teuthology.orchestra.run.smithi161.stdout:4276 trunc from 0xd2104db to 0x8802530 2024-09-21T15:09:30.808 INFO:teuthology.orchestra.run.smithi161.stdout:4487 write 0x2e2d33b thru 0x2e3b738 (0xe3fe bytes) 2024-09-21T15:09:30.827 INFO:teuthology.orchestra.run.smithi161.stdout:4490 trunc from 0x406dc07 to 0x201d267 2024-09-21T15:09:30.834 INFO:teuthology.orchestra.run.smithi161.stdout:4353 write 0xd2034c6 thru 0xd204368 (0xea3 bytes) 2024-09-21T15:09:30.844 INFO:teuthology.orchestra.run.smithi161.stdout:4549 punch from 0x1356d73 to 0x13585e1, (0x186e bytes) 2024-09-21T15:09:30.863 INFO:teuthology.orchestra.run.smithi161.stdout:4355 writesame 0x955cb49 thru 0x95604ba data_size 0x1(0x3972 bytes) 2024-09-21T15:09:30.883 INFO:teuthology.orchestra.run.smithi161.stdout:4491 writesame 0x1f02a6c thru 0x1f04147 data_size 0xb(0x16dc bytes) 2024-09-21T15:09:30.887 INFO:teuthology.orchestra.run.smithi161.stdout:4277 write 0x2b7175d thru 0x2b7884c (0x70f0 bytes) 2024-09-21T15:09:30.891 INFO:teuthology.orchestra.run.smithi161.stdout:4356 read 0x15e5236 thru 0x15f35d5 (0xe3a0 bytes) 2024-09-21T15:09:30.891 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.891 INFO:teuthology.orchestra.run.smithi161.stdout:4358 write 0xd00bb43 thru 0xd017cca (0xc188 bytes) 2024-09-21T15:09:30.913 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone39 from 0xce3a959 (overlap 0xce3a959) to 0x0 2024-09-21T15:09:30.916 INFO:teuthology.orchestra.run.smithi161.stdout:4359 write 0x99fcd3 thru 0x9a1d19 (0x2047 bytes) 2024-09-21T15:09:30.924 INFO:teuthology.orchestra.run.smithi161.stdout:4550 writesame 0xdc99f30 thru 0xdca5083 data_size 0x9c(0xb154 bytes) 2024-09-21T15:09:30.931 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone34 from 0xec0ae06 (overlap 0x81745ac) to 0x26d61b3 2024-09-21T15:09:30.940 INFO:teuthology.orchestra.run.smithi161.stdout:4362 write 0xa5c95ed thru 0xa5cd204 (0x3c18 bytes) 2024-09-21T15:09:30.940 INFO:teuthology.orchestra.run.smithi161.stdout:4492 trunc from 0x201d267 to 0xd52e089 2024-09-21T15:09:30.941 INFO:teuthology.orchestra.run.smithi161.stdout:4551 read 0x1d72fef thru 0x1d7eeb0 (0xbec2 bytes) 2024-09-21T15:09:30.941 INFO:teuthology.orchestra.run.smithi161.stdout:4552 punch from 0x282dc0a to 0x2834987, (0x6d7d bytes) 2024-09-21T15:09:30.941 INFO:teuthology.orchestra.run.smithi161.stdout:4553 punch from 0x2f38792 to 0x2f3e32a, (0x5b98 bytes) 2024-09-21T15:09:30.941 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.949 INFO:teuthology.orchestra.run.smithi161.stdout:4555 trunc from 0xdca5084 to 0x9d20f9d 2024-09-21T15:09:30.976 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636a6202410 2024-09-21T15:09:30.976 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636a6202dd0 2024-09-21T15:09:30.976 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9636750 2024-09-21T15:09:30.976 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9bd95f0 2024-09-21T15:09:30.976 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa1e80d0 2024-09-21T15:09:30.976 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa338820 2024-09-21T15:09:30.976 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa339110 2024-09-21T15:09:30.977 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa4dcea0 2024-09-21T15:09:30.977 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636ab3b48f0 2024-09-21T15:09:30.977 INFO:teuthology.orchestra.run.smithi161.stdout:4279 read 0x2685c4f thru 0x268dd57 (0x8109 bytes) 2024-09-21T15:09:30.978 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.975+0000 7f7fd044c700 -1 reset not still connected to 0x5636ab3b5a00 2024-09-21T15:09:30.978 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:30.991 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.991+0000 7f7fd044c700 -1 reset not still connected to 0x5636ae41c410 2024-09-21T15:09:30.991 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.991+0000 7f7fd044c700 -1 reset not still connected to 0x5636aea724e0 2024-09-21T15:09:30.994 INFO:teuthology.orchestra.run.smithi161.stdout:4363 read 0x8f873c8 thru 0x8f874bd (0xf6 bytes) 2024-09-21T15:09:30.994 INFO:teuthology.orchestra.run.smithi161.stdout:4364 punch from 0xc362d3a to 0xc3631dd, (0x4a3 bytes) 2024-09-21T15:09:30.994 INFO:teuthology.orchestra.run.smithi161.stdout:4366 read 0x35d93b5 thru 0x35e6c10 (0xd85c bytes) 2024-09-21T15:09:30.994 INFO:teuthology.orchestra.run.smithi161.stdout:4367 punch from 0x35046da to 0x350bc38, (0x755e bytes) 2024-09-21T15:09:30.994 INFO:teuthology.orchestra.run.smithi161.stdout:4368 write 0xba793f5 thru 0xba7ef6d (0x5b79 bytes) 2024-09-21T15:09:30.994 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.991+0000 7f7fd044c700 -1 reset not still connected to 0x5636aea72750 2024-09-21T15:09:30.994 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.991+0000 7f7fd044c700 -1 reset not still connected to 0x5636aebddee0 2024-09-21T15:09:31.001 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.999+0000 7f7fd044c700 -1 reset not still connected to 0x5636b11416c0 2024-09-21T15:09:31.002 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.999+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41aa000 2024-09-21T15:09:31.002 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.999+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41aa5b0 2024-09-21T15:09:31.002 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.999+0000 7f7fd044c700 -1 reset not still connected to 0x5636b494ed00 2024-09-21T15:09:31.002 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.999+0000 7f7fd044c700 -1 reset not still connected to 0x5636b5986b60 2024-09-21T15:09:31.002 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.999+0000 7f7fd044c700 -1 reset not still connected to 0x5636b74af1e0 2024-09-21T15:09:31.002 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.999+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7f66d00 2024-09-21T15:09:31.002 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.999+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7f675f0 2024-09-21T15:09:31.002 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.999+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8416b60 2024-09-21T15:09:31.002 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:30.999+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc9a3ee0 2024-09-21T15:09:31.031 INFO:teuthology.orchestra.run.smithi161.stdout:4370 write 0x7846e thru 0x7b4b9 (0x304c bytes) 2024-09-21T15:09:31.050 INFO:teuthology.orchestra.run.smithi161.stdout:4371 write 0x80c7455 thru 0x80d41cf (0xcd7b bytes) 2024-09-21T15:09:31.056 INFO:teuthology.orchestra.run.smithi161.stdout:4493 writesame 0x9a7f0c3 thru 0x9a8317a data_size 0x4c(0x40b8 bytes) 2024-09-21T15:09:31.064 INFO:teuthology.orchestra.run.smithi161.stdout:4282 writesame 0xdd18d39 thru 0xdd21273 data_size 0x1(0x853b bytes) 2024-09-21T15:09:31.076 INFO:teuthology.orchestra.run.smithi161.stdout:4283 write 0x4c5e5ab thru 0x4c5eaa8 (0x4fe bytes) 2024-09-21T15:09:31.102 INFO:teuthology.orchestra.run.smithi161.stdout:4284 write 0xa519346 thru 0xa51ba26 (0x26e1 bytes) 2024-09-21T15:09:31.108 INFO:teuthology.orchestra.run.smithi161.stdout:4373 trunc from 0xd204369 to 0x261b851 2024-09-21T15:09:31.149 INFO:teuthology.orchestra.run.smithi161.stdout:4285 punch from 0x3aa4891 to 0x3ab445b, (0xfbca bytes) 2024-09-21T15:09:31.149 INFO:teuthology.orchestra.run.smithi161.stdout:4290 read 0xaadac1f thru 0xaae32f3 (0x86d5 bytes) 2024-09-21T15:09:31.150 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:31.150 INFO:teuthology.orchestra.run.smithi161.stdout:4292 punch from 0xccd84a3 to 0xccdf6b1, (0x720e bytes) 2024-09-21T15:09:31.150 INFO:teuthology.orchestra.run.smithi161.stdout:4293 clone 29 order 22 su 1048576 sc 9 2024-09-21T15:09:31.165 INFO:teuthology.orchestra.run.smithi161.stdout:4494 punch from 0xc953595 to 0xc953b5f, (0x5ca bytes) 2024-09-21T15:09:31.171 INFO:teuthology.orchestra.run.smithi161.stdout:4495 trunc from 0xd52e089 to 0x9c85a21 2024-09-21T15:09:31.183 INFO:teuthology.orchestra.run.smithi161.stdout:4556 punch from 0x5ed196c to 0x5edd06c, (0xb700 bytes) 2024-09-21T15:09:31.183 INFO:teuthology.orchestra.run.smithi161.stdout:4557 punch from 0x6d1d672 to 0x6d1d79e, (0x12c bytes) 2024-09-21T15:09:31.183 INFO:teuthology.orchestra.run.smithi161.stdout:4559 punch from 0x772b565 to 0x77305be, (0x5059 bytes) 2024-09-21T15:09:31.183 INFO:teuthology.orchestra.run.smithi161.stdout:4560 writesame 0x7dc63b5 thru 0x7dc7cb8 data_size 0x2(0x1904 bytes) 2024-09-21T15:09:31.204 INFO:teuthology.orchestra.run.smithi161.stdout:4562 punch from 0x72739c0 to 0x72826ed, (0xed2d bytes) 2024-09-21T15:09:31.356 INFO:teuthology.orchestra.run.smithi161.stdout:4374 trunc from 0x261b851 to 0xcfbd758 2024-09-21T15:09:31.371 INFO:teuthology.orchestra.run.smithi161.stdout:4496 trunc from 0x9c85a21 to 0x54f6909 2024-09-21T15:09:31.419 INFO:teuthology.orchestra.run.smithi161.stdout:4377 read 0x68b5eb8 thru 0x68b9a51 (0x3b9a bytes) 2024-09-21T15:09:31.420 INFO:teuthology.orchestra.run.smithi161.stdout:4378 read 0x3e0b764 thru 0x3e0f2ba (0x3b57 bytes) 2024-09-21T15:09:31.420 INFO:teuthology.orchestra.run.smithi161.stdout:4380 write 0x62ef42 thru 0x6381d5 (0x9294 bytes) 2024-09-21T15:09:31.433 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:31.455 INFO:teuthology.orchestra.run.smithi161.stdout:4382 trunc from 0xcfbd758 to 0xf54df 2024-09-21T15:09:31.532 INFO:teuthology.orchestra.run.smithi161.stdout:4497 read 0x4227a84 thru 0x4232e2a (0xb3a7 bytes) 2024-09-21T15:09:31.578 INFO:teuthology.orchestra.run.smithi161.stdout:4498 write 0x2ba2d44 thru 0x2bab733 (0x89f0 bytes) 2024-09-21T15:09:31.716 INFO:teuthology.orchestra.run.smithi161.stdout:4383 write 0xacc76bc thru 0xacd5277 (0xdbbc bytes) 2024-09-21T15:09:31.744 INFO:teuthology.orchestra.run.smithi161.stdout:4384 write 0x9ab656e thru 0x9abb642 (0x50d5 bytes) 2024-09-21T15:09:31.767 INFO:teuthology.orchestra.run.smithi161.stdout:4385 read 0x99e623e thru 0x99e9f19 (0x3cdc bytes) 2024-09-21T15:09:31.767 INFO:teuthology.orchestra.run.smithi161.stdout:4386 read 0x62c8b7a thru 0x62c971a (0xba1 bytes) 2024-09-21T15:09:31.768 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:31.775 INFO:teuthology.orchestra.run.smithi161.stdout:4389 trunc from 0xacd5278 to 0xdd2fb7a 2024-09-21T15:09:31.826 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:31.840 INFO:teuthology.orchestra.run.smithi161.stdout:4563 write 0xb3179f5 thru 0xb323bdb (0xc1e7 bytes) 2024-09-21T15:09:31.859 INFO:teuthology.orchestra.run.smithi161.stdout:4500 write 0x74ff6e6 thru 0x750269d (0x2fb8 bytes) 2024-09-21T15:09:31.874 INFO:teuthology.orchestra.run.smithi161.stdout:4391 write 0xe935ef8 thru 0xe9405f7 (0xa700 bytes) 2024-09-21T15:09:31.971 INFO:teuthology.orchestra.run.smithi161.stdout:4393 writesame 0x48623bf thru 0x4862b3c data_size 0x7(0x77e bytes) 2024-09-21T15:09:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:4394 read 0x2c28227 thru 0x2c3795f (0xf739 bytes) 2024-09-21T15:09:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:4396 read 0x326f1b0 thru 0x327152a (0x237b bytes) 2024-09-21T15:09:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:4398 punch from 0xc3ecb27 to 0xc3f35d9, (0x6ab2 bytes) 2024-09-21T15:09:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:4399 read 0x6d06663 thru 0x6d13541 (0xcedf bytes) 2024-09-21T15:09:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:31.986 INFO:teuthology.orchestra.run.smithi161.stdout:4403 write 0x44eb190 thru 0x44ef0f6 (0x3f67 bytes) 2024-09-21T15:09:32.004 INFO:teuthology.orchestra.run.smithi161.stdout:4565 writesame 0xd588118 thru 0xd591416 data_size 0xb(0x92ff bytes) 2024-09-21T15:09:32.012 INFO:teuthology.orchestra.run.smithi161.stdout:4404 read 0xd3685cb thru 0xd3727ae (0xa1e4 bytes) 2024-09-21T15:09:32.012 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:32.012 INFO:teuthology.orchestra.run.smithi161.stdout:4407 writesame 0xa6cea41 thru 0xa6d65b0 data_size 0x50(0x7b70 bytes) 2024-09-21T15:09:32.012 INFO:teuthology.orchestra.run.smithi161.stdout:4567 writesame 0x23dcd24 thru 0x23e1ba6 data_size 0x1(0x4e83 bytes) 2024-09-21T15:09:32.018 INFO:teuthology.orchestra.run.smithi161.stdout:4503 read 0x7055df3 thru 0x705fec3 (0xa0d1 bytes) 2024-09-21T15:09:32.019 INFO:teuthology.orchestra.run.smithi161.stdout:4505 read 0x71c8b30 thru 0x71cd867 (0x4d38 bytes) 2024-09-21T15:09:32.019 INFO:teuthology.orchestra.run.smithi161.stdout:4506 write 0xdc2f88 thru 0xdc4f80 (0x1ff9 bytes) 2024-09-21T15:09:32.037 INFO:teuthology.orchestra.run.smithi161.stdout:4507 read 0x6141f64 thru 0x6148b3b (0x6bd8 bytes) 2024-09-21T15:09:32.037 INFO:teuthology.orchestra.run.smithi161.stdout:4508 read 0x2ac7036 thru 0x2ac84f1 (0x14bc bytes) 2024-09-21T15:09:32.038 INFO:teuthology.orchestra.run.smithi161.stdout:4509 read 0x2d1113c thru 0x2d1e5fc (0xd4c1 bytes) 2024-09-21T15:09:32.039 INFO:teuthology.orchestra.run.smithi161.stdout:4510 punch from 0x4ea021a to 0x4ea902d, (0x8e13 bytes) 2024-09-21T15:09:32.039 INFO:teuthology.orchestra.run.smithi161.stdout:4511 read 0x21329bc thru 0x2139d4a (0x738f bytes) 2024-09-21T15:09:32.061 INFO:teuthology.orchestra.run.smithi161.stdout:4568 trunc from 0xd591417 to 0x4e41794 2024-09-21T15:09:32.089 INFO:teuthology.orchestra.run.smithi161.stdout:4408 trunc from 0xe9405f8 to 0xa500c10 2024-09-21T15:09:32.126 INFO:teuthology.orchestra.run.smithi161.stdout:4569 read 0x1da4f73 thru 0x1db3348 (0xe3d6 bytes) 2024-09-21T15:09:32.139 INFO:teuthology.orchestra.run.smithi161.stdout:4512 write 0x9715908 thru 0x971b52e (0x5c27 bytes) 2024-09-21T15:09:32.188 INFO:teuthology.orchestra.run.smithi161.stdout:4570 writesame 0xad27355 thru 0xad2cb81 data_size 0x1(0x582d bytes) 2024-09-21T15:09:32.193 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:32.193 INFO:teuthology.orchestra.run.smithi161.stdout:4572 writesame 0x4909369 thru 0x490f362 data_size 0x75(0x5ffa bytes) 2024-09-21T15:09:32.220 INFO:teuthology.orchestra.run.smithi161.stdout:4574 punch from 0x528b654 to 0x5294bb3, (0x955f bytes) 2024-09-21T15:09:32.220 INFO:teuthology.orchestra.run.smithi161.stdout:4575 read 0x9e96d92 thru 0x9e9ea48 (0x7cb7 bytes) 2024-09-21T15:09:32.221 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:32.231 INFO:teuthology.orchestra.run.smithi161.stdout:4578 trunc from 0xad2cb82 to 0x862083b 2024-09-21T15:09:32.242 INFO:teuthology.orchestra.run.smithi161.stdout:4513 trunc from 0x971b52f to 0x409950 2024-09-21T15:09:32.266 INFO:teuthology.orchestra.run.smithi161.stdout:4409 read 0x52655c4 thru 0x5269aff (0x453c bytes) 2024-09-21T15:09:32.266 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:32.271 INFO:teuthology.orchestra.run.smithi161.stdout:4414 trunc from 0xa500c10 to 0xcfc9464 2024-09-21T15:09:32.352 INFO:teuthology.orchestra.run.smithi161.stdout:4580 read 0x438ddc4 thru 0x439c908 (0xeb45 bytes) 2024-09-21T15:09:32.367 INFO:teuthology.orchestra.run.smithi161.stdout:4415 read 0xbe931ac thru 0xbe9c6a8 (0x94fd bytes) 2024-09-21T15:09:32.367 INFO:teuthology.orchestra.run.smithi161.stdout:4416 write 0x1e708c1 thru 0x1e73625 (0x2d65 bytes) 2024-09-21T15:09:32.408 INFO:teuthology.orchestra.run.smithi161.stdout:4581 read 0x23aaaa7 thru 0x23b6497 (0xb9f1 bytes) 2024-09-21T15:09:32.416 INFO:teuthology.orchestra.run.smithi161.stdout:4417 read 0xa5bca91 thru 0xa5c6295 (0x9805 bytes) 2024-09-21T15:09:32.442 INFO:teuthology.orchestra.run.smithi161.stdout:4418 trunc from 0xcfc9464 to 0xbaf2cb 2024-09-21T15:09:32.469 INFO:teuthology.orchestra.run.smithi161.stdout:4516 read 0x2fa0f8 thru 0x2fbca1 (0x1baa bytes) 2024-09-21T15:09:32.479 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone28 from 0xdd21274 (overlap 0x8802530) to 0x6ccea8c 2024-09-21T15:09:32.480 INFO:teuthology.orchestra.run.smithi161.stdout:4583 write 0xc56684d thru 0xc575682 (0xee36 bytes) 2024-09-21T15:09:32.491 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.491+0000 7f1e9c77a700 -1 reset not still connected to 0x56288c584340 2024-09-21T15:09:32.491 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.491+0000 7f1e9c77a700 -1 reset not still connected to 0x56288edfc9c0 2024-09-21T15:09:32.491 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.491+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f958270 2024-09-21T15:09:32.492 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.491+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f959ba0 2024-09-21T15:09:32.492 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.491+0000 7f1e9c77a700 -1 reset not still connected to 0x562890034680 2024-09-21T15:09:32.492 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.491+0000 7f1e9c77a700 -1 reset not still connected to 0x562890035520 2024-09-21T15:09:32.506 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x5628908044e0 2024-09-21T15:09:32.506 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x562890805d40 2024-09-21T15:09:32.506 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x56289097b110 2024-09-21T15:09:32.506 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x562890d15860 2024-09-21T15:09:32.506 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x5628937f24e0 2024-09-21T15:09:32.506 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5930 2024-09-21T15:09:32.506 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x562897c70ea0 2024-09-21T15:09:32.506 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x562897c71040 2024-09-21T15:09:32.507 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x562898c609c0 2024-09-21T15:09:32.507 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x562899844b60 2024-09-21T15:09:32.507 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x562899b8f5f0 2024-09-21T15:09:32.507 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x56289b6588f0 2024-09-21T15:09:32.507 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x56289cc5f5f0 2024-09-21T15:09:32.507 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x56289e9f8ea0 2024-09-21T15:09:32.507 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x56289e9f9930 2024-09-21T15:09:32.507 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x56289f19e820 2024-09-21T15:09:32.507 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0c5cf70 2024-09-21T15:09:32.507 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:32.503+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a1077790 2024-09-21T15:09:32.529 INFO:teuthology.orchestra.run.smithi161.stdout:4584 write 0x99f514f thru 0x9a02adf (0xd991 bytes) 2024-09-21T15:09:32.544 INFO:teuthology.orchestra.run.smithi161.stdout:4517 writesame 0xa08983a thru 0xa089dfd data_size 0x9(0x5c4 bytes) 2024-09-21T15:09:32.551 INFO:teuthology.orchestra.run.smithi161.stdout:4518 write 0x12d1ce9 thru 0x12d4d5f (0x3077 bytes) 2024-09-21T15:09:32.579 INFO:teuthology.orchestra.run.smithi161.stdout:4585 write 0x88eeff6 thru 0x88f17e3 (0x27ee bytes) 2024-09-21T15:09:32.586 INFO:teuthology.orchestra.run.smithi161.stdout:4519 trunc from 0xa089dfe to 0xc78ed2a 2024-09-21T15:09:32.598 INFO:teuthology.orchestra.run.smithi161.stdout:4586 punch from 0x829d76 to 0x82cea6, (0x3130 bytes) 2024-09-21T15:09:32.598 INFO:teuthology.orchestra.run.smithi161.stdout:4587 write 0x2d4a448 thru 0x2d4af10 (0xac9 bytes) 2024-09-21T15:09:32.641 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:32.641 INFO:teuthology.orchestra.run.smithi161.stdout:4589 read 0x2cc8bb1 thru 0x2cc935d (0x7ad bytes) 2024-09-21T15:09:32.649 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:32.649 INFO:teuthology.orchestra.run.smithi161.stdout:4591 write 0xed489d thru 0xedca22 (0x8186 bytes) 2024-09-21T15:09:32.706 INFO:teuthology.orchestra.run.smithi161.stdout:4521 trunc from 0xc78ed2a to 0x5c93a6a 2024-09-21T15:09:32.736 INFO:teuthology.orchestra.run.smithi161.stdout:4593 read 0x565d2da thru 0x566ab8c (0xd8b3 bytes) 2024-09-21T15:09:32.737 INFO:teuthology.orchestra.run.smithi161.stdout:4419 write 0xa01538d thru 0xa0161af (0xe23 bytes) 2024-09-21T15:09:32.739 INFO:teuthology.orchestra.run.smithi161.stdout:4594 trunc from 0xc575683 to 0xb4c7a95 2024-09-21T15:09:32.790 INFO:teuthology.orchestra.run.smithi161.stdout:4420 trunc from 0xa0161b0 to 0xba888d1 2024-09-21T15:09:32.798 INFO:teuthology.orchestra.run.smithi161.stdout:4522 read 0x527f918 thru 0x5289ada (0xa1c3 bytes) 2024-09-21T15:09:32.824 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #33, image image_cluster1.client.mirror.4-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent34 2024-09-21T15:09:32.826 INFO:teuthology.orchestra.run.smithi161.stdout:4595 write 0x1919797 thru 0x1919c48 (0x4b2 bytes) 2024-09-21T15:09:32.841 INFO:teuthology.orchestra.run.smithi161.stdout:4523 writesame 0xb7df74c thru 0xb7ef5e9 data_size 0x2e(0xfe9e bytes) 2024-09-21T15:09:32.846 INFO:teuthology.orchestra.run.smithi161.stdout:4597 trunc from 0xb4c7a95 to 0x4c7efc6 2024-09-21T15:09:32.847 INFO:teuthology.orchestra.run.smithi161.stdout:4525 punch from 0x7524c80 to 0x752af0a, (0x628a bytes) 2024-09-21T15:09:32.847 INFO:teuthology.orchestra.run.smithi161.stdout:4526 read 0x7ae387d thru 0x7ae9bf1 (0x6375 bytes) 2024-09-21T15:09:32.848 INFO:teuthology.orchestra.run.smithi161.stdout:4527 write 0x18a84f9 thru 0x18b100c (0x8b14 bytes) 2024-09-21T15:09:32.856 INFO:teuthology.orchestra.run.smithi161.stdout:4423 write 0xdeb1eb9 thru 0xdeb6c52 (0x4d9a bytes) 2024-09-21T15:09:32.869 INFO:teuthology.orchestra.run.smithi161.stdout:4529 punch from 0x6e4f76d to 0x6e5e0f3, (0xe986 bytes) 2024-09-21T15:09:32.870 INFO:teuthology.orchestra.run.smithi161.stdout:4530 read 0xe738c3 thru 0xe81316 (0xda54 bytes) 2024-09-21T15:09:32.870 INFO:teuthology.orchestra.run.smithi161.stdout:4531 read 0x23cdf07 thru 0x23da05c (0xc156 bytes) 2024-09-21T15:09:32.871 INFO:teuthology.orchestra.run.smithi161.stdout:4532 writesame 0x3c3d005 thru 0x3c40ccb data_size 0x1(0x3cc7 bytes) 2024-09-21T15:09:32.879 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:32.879 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:32.890 INFO:teuthology.orchestra.run.smithi161.stdout:4533 punch from 0x930ee57 to 0x931215f, (0x3308 bytes) 2024-09-21T15:09:32.893 INFO:teuthology.orchestra.run.smithi161.stdout:4534 writesame 0x2884761 thru 0x288498d data_size 0x1(0x22d bytes) 2024-09-21T15:09:32.907 INFO:teuthology.orchestra.run.smithi161.stdout:4427 trunc from 0xdeb6c53 to 0x42cda11 2024-09-21T15:09:32.907 INFO:teuthology.orchestra.run.smithi161.stdout:4536 read 0xb20f596 thru 0xb21c303 (0xcd6e bytes) 2024-09-21T15:09:32.907 INFO:teuthology.orchestra.run.smithi161.stdout:4537 write 0x138db94 thru 0x138f828 (0x1c95 bytes) 2024-09-21T15:09:32.923 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:32.923 INFO:teuthology.orchestra.run.smithi161.stdout:4540 write 0x1b26cd8 thru 0x1b2f5f7 (0x8920 bytes) 2024-09-21T15:09:32.963 INFO:teuthology.orchestra.run.smithi161.stdout:4542 read 0x677b54a thru 0x6780525 (0x4fdc bytes) 2024-09-21T15:09:32.967 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:32.967 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:32.967 INFO:teuthology.orchestra.run.smithi161.stdout:4547 read 0x5ea26ac thru 0x5eae21e (0xbb73 bytes) 2024-09-21T15:09:32.967 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:32.967 INFO:teuthology.orchestra.run.smithi161.stdout:4550 read 0x2e5ca68 thru 0x2e5ddef (0x1388 bytes) 2024-09-21T15:09:32.968 INFO:teuthology.orchestra.run.smithi161.stdout:4552 writesame 0x6732be9 thru 0x6739519 data_size 0x1(0x6931 bytes) 2024-09-21T15:09:32.992 INFO:teuthology.orchestra.run.smithi161.stdout:4599 writesame 0x9bece31 thru 0x9bf7b91 data_size 0x37(0xad61 bytes) 2024-09-21T15:09:33.011 INFO:teuthology.orchestra.run.smithi161.stdout:4553 read 0x22a2400 thru 0x22af1f4 (0xcdf5 bytes) 2024-09-21T15:09:33.015 INFO:teuthology.orchestra.run.smithi161.stdout:4554 read 0x53580a1 thru 0x5362a9d (0xa9fd bytes) 2024-09-21T15:09:33.025 INFO:teuthology.orchestra.run.smithi161.stdout:4600 read 0x4ae4396 thru 0x4ae45e6 (0x251 bytes) 2024-09-21T15:09:33.025 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:33.026 INFO:teuthology.orchestra.run.smithi161.stdout:4604 write 0x55060ec thru 0x550f4a8 (0x93bd bytes) 2024-09-21T15:09:33.034 INFO:teuthology.orchestra.run.smithi161.stdout:4428 trunc from 0x42cda11 to 0x588bb52 2024-09-21T15:09:33.170 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:33.171 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:33.171 INFO:teuthology.orchestra.run.smithi161.stdout:4431 read 0x380170b thru 0x380b1d2 (0x9ac8 bytes) 2024-09-21T15:09:33.171 INFO:teuthology.orchestra.run.smithi161.stdout:4432 writesame 0x56336b thru 0x57038d data_size 0x1(0xd023 bytes) 2024-09-21T15:09:33.192 INFO:teuthology.orchestra.run.smithi161.stdout:4605 read 0x945bc46 thru 0x945daf5 (0x1eb0 bytes) 2024-09-21T15:09:33.192 INFO:teuthology.orchestra.run.smithi161.stdout:4606 read 0x10a1012 thru 0x10ae8c6 (0xd8b5 bytes) 2024-09-21T15:09:33.192 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:33.192 INFO:teuthology.orchestra.run.smithi161.stdout:4609 punch from 0x73f459b to 0x73fd7b7, (0x921c bytes) 2024-09-21T15:09:33.192 INFO:teuthology.orchestra.run.smithi161.stdout:4610 write 0x16bbbd5 thru 0x16c24af (0x68db bytes) 2024-09-21T15:09:33.243 INFO:teuthology.orchestra.run.smithi161.stdout:4555 write 0xd1de7bc thru 0xd1eaf8c (0xc7d1 bytes) 2024-09-21T15:09:33.286 INFO:teuthology.orchestra.run.smithi161.stdout:4556 read 0x8b26431 thru 0x8b2c1f8 (0x5dc8 bytes) 2024-09-21T15:09:33.286 INFO:teuthology.orchestra.run.smithi161.stdout:4558 trunc from 0xd1eaf8d to 0xd44fb83 2024-09-21T15:09:33.315 INFO:teuthology.orchestra.run.smithi161.stdout:4433 read 0x3e2a764 thru 0x3e37416 (0xccb3 bytes) 2024-09-21T15:09:33.327 INFO:teuthology.orchestra.run.smithi161.stdout:4612 write 0x2c40418 thru 0x2c41f6f (0x1b58 bytes) 2024-09-21T15:09:33.391 INFO:teuthology.orchestra.run.smithi161.stdout:4613 trunc from 0x9bf7b92 to 0x62928cc 2024-09-21T15:09:33.427 INFO:teuthology.orchestra.run.smithi161.stdout:4559 read 0x2f77646 thru 0x2f7a06c (0x2a27 bytes) 2024-09-21T15:09:33.427 INFO:teuthology.orchestra.run.smithi161.stdout:4561 read 0xa21a589 thru 0xa21bf4f (0x19c7 bytes) 2024-09-21T15:09:33.440 INFO:teuthology.orchestra.run.smithi161.stdout:4434 write 0x8e687c6 thru 0x8e75fc1 (0xd7fc bytes) 2024-09-21T15:09:33.500 INFO:teuthology.orchestra.run.smithi161.stdout:4435 read 0x5893ad8 thru 0x58a2a2a (0xef53 bytes) 2024-09-21T15:09:33.500 INFO:teuthology.orchestra.run.smithi161.stdout:4436 punch from 0x52a780e to 0x52a8121, (0x913 bytes) 2024-09-21T15:09:33.508 INFO:teuthology.orchestra.run.smithi161.stdout:4438 trunc from 0x8e75fc2 to 0xc873c0e 2024-09-21T15:09:33.540 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #27, image image_cluster1.client.mirror.5-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent28 2024-09-21T15:09:33.571 INFO:teuthology.orchestra.run.smithi161.stdout:4562 write 0xebecbc2 thru 0xebf166f (0x4aae bytes) 2024-09-21T15:09:33.644 INFO:teuthology.orchestra.run.smithi161.stdout:4439 punch from 0x8545c27 to 0x8546fca, (0x13a3 bytes) 2024-09-21T15:09:33.644 INFO:teuthology.orchestra.run.smithi161.stdout:4440 writesame 0xbdc8614 thru 0xbdced88 data_size 0x1(0x6775 bytes) 2024-09-21T15:09:33.652 INFO:teuthology.orchestra.run.smithi161.stdout:4614 trunc from 0x62928cc to 0x584a9b4 2024-09-21T15:09:33.670 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:33.670 INFO:teuthology.orchestra.run.smithi161.stdout:4565 read 0xaeda820 thru 0xaeea0e5 (0xf8c6 bytes) 2024-09-21T15:09:33.671 INFO:teuthology.orchestra.run.smithi161.stdout:4566 writesame 0x232c22c thru 0x2333b67 data_size 0x2(0x793c bytes) 2024-09-21T15:09:33.703 INFO:teuthology.orchestra.run.smithi161.stdout:4441 read 0xb16ae15 thru 0xb16d3a0 (0x258c bytes) 2024-09-21T15:09:33.703 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:33.703 INFO:teuthology.orchestra.run.smithi161.stdout:4444 read 0x39b2e0d thru 0x39c1d8a (0xef7e bytes) 2024-09-21T15:09:33.703 INFO:teuthology.orchestra.run.smithi161.stdout:4447 read 0x6830c34 thru 0x6840051 (0xf41e bytes) 2024-09-21T15:09:33.703 INFO:teuthology.orchestra.run.smithi161.stdout:4448 writesame 0x1a00014 thru 0x1a0ad21 data_size 0x11(0xad0e bytes) 2024-09-21T15:09:33.705 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:33.705 INFO:teuthology.orchestra.run.smithi161.stdout:4568 write 0x96830c4 thru 0x968611b (0x3058 bytes) 2024-09-21T15:09:33.714 INFO:teuthology.orchestra.run.smithi161.stdout:4294 punch from 0xd1ce72b to 0xd1d58ad, (0x7182 bytes) 2024-09-21T15:09:33.738 INFO:teuthology.orchestra.run.smithi161.stdout:4449 read 0x1c9d2af thru 0x1ca9dc1 (0xcb13 bytes) 2024-09-21T15:09:33.738 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:33.738 INFO:teuthology.orchestra.run.smithi161.stdout:4454 write 0x421e424 thru 0x421ed02 (0x8df bytes) 2024-09-21T15:09:33.766 INFO:teuthology.orchestra.run.smithi161.stdout:4569 read 0xb6313d1 thru 0xb636e8b (0x5abb bytes) 2024-09-21T15:09:33.766 INFO:teuthology.orchestra.run.smithi161.stdout:4570 punch from 0xc7dc50d to 0xc7e6301, (0x9df4 bytes) 2024-09-21T15:09:33.766 INFO:teuthology.orchestra.run.smithi161.stdout:4571 writesame 0xd93d0c5 thru 0xd93fd64 data_size 0xe(0x2ca0 bytes) 2024-09-21T15:09:33.798 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:33.798 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:33.798 INFO:teuthology.orchestra.run.smithi161.stdout:4457 write 0x8694bdc thru 0x86a2731 (0xdb56 bytes) 2024-09-21T15:09:33.824 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:4458 read 0x5194cd2 thru 0x519633b (0x166a bytes) 2024-09-21T15:09:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:4459 read 0x51896e8 thru 0x5193cc0 (0xa5d9 bytes) 2024-09-21T15:09:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:4460 read 0x6109b7f thru 0x610badb (0x1f5d bytes) 2024-09-21T15:09:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:4461 read 0x4187092 thru 0x418f99d (0x890c bytes) 2024-09-21T15:09:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:4462 read 0xc6dce6a thru 0xc6e816f (0xb306 bytes) 2024-09-21T15:09:33.826 INFO:teuthology.orchestra.run.smithi161.stdout:4463 write 0x14e3070 thru 0x14e6b2f (0x3ac0 bytes) 2024-09-21T15:09:33.828 INFO:teuthology.orchestra.run.smithi161.stdout:4618 trunc from 0x584a9b4 to 0x7526d06 2024-09-21T15:09:33.850 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:33.850 INFO:teuthology.orchestra.run.smithi161.stdout:4466 punch from 0xbd171cd to 0xbd2633f, (0xf172 bytes) 2024-09-21T15:09:33.867 INFO:teuthology.orchestra.run.smithi161.stdout:4572 writesame 0x50aefcd thru 0x50b83ea data_size 0x1(0x941e bytes) 2024-09-21T15:09:33.874 INFO:teuthology.orchestra.run.smithi161.stdout:4619 read 0x3f2b543 thru 0x3f38285 (0xcd43 bytes) 2024-09-21T15:09:33.876 INFO:teuthology.orchestra.run.smithi161.stdout:4295 punch from 0x2ca1f00 to 0x2cab076, (0x9176 bytes) 2024-09-21T15:09:33.876 INFO:teuthology.orchestra.run.smithi161.stdout:4296 read 0x5a7f69e thru 0x5a8921a (0x9b7d bytes) 2024-09-21T15:09:33.905 INFO:teuthology.orchestra.run.smithi161.stdout:4469 write 0xd53037d thru 0xd53c71f (0xc3a3 bytes) 2024-09-21T15:09:33.909 INFO:teuthology.orchestra.run.smithi161.stdout:4621 write 0x84b0a27 thru 0x84be6e5 (0xdcbf bytes) 2024-09-21T15:09:33.922 INFO:teuthology.orchestra.run.smithi161.stdout:4297 trunc from 0xdd21274 to 0x30c94c3 2024-09-21T15:09:33.945 INFO:teuthology.orchestra.run.smithi161.stdout:4622 read 0x1159c8b thru 0x115bc43 (0x1fb9 bytes) 2024-09-21T15:09:33.945 INFO:teuthology.orchestra.run.smithi161.stdout:4624 read 0x45eb51f thru 0x45f43d2 (0x8eb4 bytes) 2024-09-21T15:09:33.961 INFO:teuthology.orchestra.run.smithi161.stdout:4625 trunc from 0x84be6e6 to 0x41a55e6 2024-09-21T15:09:33.965 INFO:teuthology.orchestra.run.smithi161.stdout:4470 trunc from 0xd53c720 to 0x4ee4906 2024-09-21T15:09:33.991 INFO:teuthology.orchestra.run.smithi161.stdout:4573 read 0x2b3354 thru 0x2ba659 (0x7306 bytes) 2024-09-21T15:09:34.024 INFO:teuthology.orchestra.run.smithi161.stdout:4574 read 0x9529aa6 thru 0x9534337 (0xa892 bytes) 2024-09-21T15:09:34.024 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.024 INFO:teuthology.orchestra.run.smithi161.stdout:4576 writesame 0x26278e9 thru 0x262a87a data_size 0x1(0x2f92 bytes) 2024-09-21T15:09:34.064 INFO:teuthology.orchestra.run.smithi161.stdout:4474 read 0x3f71627 thru 0x3f776e9 (0x60c3 bytes) 2024-09-21T15:09:34.071 INFO:teuthology.orchestra.run.smithi161.stdout:4577 write 0x354c8ff thru 0x3557641 (0xad43 bytes) 2024-09-21T15:09:34.089 INFO:teuthology.orchestra.run.smithi161.stdout:4627 read 0x32076f9 thru 0x320b03e (0x3946 bytes) 2024-09-21T15:09:34.164 INFO:teuthology.orchestra.run.smithi161.stdout:4578 write 0x27af22 thru 0x2852c8 (0xa3a7 bytes) 2024-09-21T15:09:34.167 INFO:teuthology.orchestra.run.smithi161.stdout:4628 write 0x8dfe626 thru 0x8e03d80 (0x575b bytes) 2024-09-21T15:09:34.168 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.168 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.168 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.168 INFO:teuthology.orchestra.run.smithi161.stdout:4301 write 0x2943964 thru 0x29490c2 (0x575f bytes) 2024-09-21T15:09:34.180 INFO:teuthology.orchestra.run.smithi161.stdout:4302 read 0x2f52d2c thru 0x2f5848c (0x5761 bytes) 2024-09-21T15:09:34.181 INFO:teuthology.orchestra.run.smithi161.stdout:4303 writesame 0x1f6ad13 thru 0x1f70a33 data_size 0x9(0x5d21 bytes) 2024-09-21T15:09:34.184 INFO:teuthology.orchestra.run.smithi161.stdout:4580 writesame 0x4999526 thru 0x49a2f24 data_size 0x11(0x99ff bytes) 2024-09-21T15:09:34.204 INFO:teuthology.orchestra.run.smithi161.stdout:4629 read 0x2316bc0 thru 0x231d087 (0x64c8 bytes) 2024-09-21T15:09:34.205 INFO:teuthology.orchestra.run.smithi161.stdout:4581 read 0x98408a7 thru 0x9849491 (0x8beb bytes) 2024-09-21T15:09:34.206 INFO:teuthology.orchestra.run.smithi161.stdout:4582 read 0x816f036 thru 0x817a44d (0xb418 bytes) 2024-09-21T15:09:34.206 INFO:teuthology.orchestra.run.smithi161.stdout:4583 write 0xe54d6f0 thru 0xe558382 (0xac93 bytes) 2024-09-21T15:09:34.216 INFO:teuthology.orchestra.run.smithi161.stdout:4475 write 0xe9f0d56 thru 0xe9f7c24 (0x6ecf bytes) 2024-09-21T15:09:34.217 INFO:teuthology.orchestra.run.smithi161.stdout:4630 trunc from 0x8e03d81 to 0xd9c89d1 2024-09-21T15:09:34.237 INFO:teuthology.orchestra.run.smithi161.stdout:4584 write 0xa192106 thru 0xa1a1521 (0xf41c bytes) 2024-09-21T15:09:34.243 INFO:teuthology.orchestra.run.smithi161.stdout:4476 writesame 0x8ff0d93 thru 0x8ff2819 data_size 0x1(0x1a87 bytes) 2024-09-21T15:09:34.255 INFO:teuthology.orchestra.run.smithi161.stdout:4585 read 0x2395b1f thru 0x2396d8a (0x126c bytes) 2024-09-21T15:09:34.256 INFO:teuthology.orchestra.run.smithi161.stdout:4587 write 0x6bbcd1a thru 0x6bc1b9a (0x4e81 bytes) 2024-09-21T15:09:34.266 INFO:teuthology.orchestra.run.smithi161.stdout:4477 punch from 0xc0b5a7d to 0xc0ba4e8, (0x4a6b bytes) 2024-09-21T15:09:34.266 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.266 INFO:teuthology.orchestra.run.smithi161.stdout:4479 write 0xa571b02 thru 0xa57b629 (0x9b28 bytes) 2024-09-21T15:09:34.267 INFO:teuthology.orchestra.run.smithi161.stdout:4589 punch from 0xe96af to 0xed6a9, (0x3ffa bytes) 2024-09-21T15:09:34.267 INFO:teuthology.orchestra.run.smithi161.stdout:4590 read 0xc7d180b thru 0xc7d6b51 (0x5347 bytes) 2024-09-21T15:09:34.267 INFO:teuthology.orchestra.run.smithi161.stdout:4591 punch from 0xd6d803c to 0xd6d9b37, (0x1afb bytes) 2024-09-21T15:09:34.267 INFO:teuthology.orchestra.run.smithi161.stdout:4592 write 0x20e96fb thru 0x20f710c (0xda12 bytes) 2024-09-21T15:09:34.282 INFO:teuthology.orchestra.run.smithi161.stdout:4480 write 0x7637d99 thru 0x76419d6 (0x9c3e bytes) 2024-09-21T15:09:34.290 INFO:teuthology.orchestra.run.smithi161.stdout:4593 trunc from 0xebf1670 to 0xd750c4e 2024-09-21T15:09:34.290 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.288+0000 7f68eae7f700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581ced152c0 finish: resending after timeout 2024-09-21T15:09:34.290 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.288+0000 7f68eae7f700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581ced14fc0 finish: resending after timeout 2024-09-21T15:09:34.290 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.288+0000 7f68eae7f700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581ced14f00 finish: resending after timeout 2024-09-21T15:09:34.290 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.288+0000 7f68ea67e700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581cd81f980 finish: resending after timeout 2024-09-21T15:09:34.291 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.288+0000 7f68eae7f700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d5283980 finish: resending after timeout 2024-09-21T15:09:34.291 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.288+0000 7f68ea67e700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d6802180 finish: resending after timeout 2024-09-21T15:09:34.291 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.288+0000 7f68eae7f700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d6802240 finish: resending after timeout 2024-09-21T15:09:34.292 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.288+0000 7f68eae7f700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d6802b40 finish: resending after timeout 2024-09-21T15:09:34.292 INFO:teuthology.orchestra.run.smithi161.stdout:4631 write 0x55b8137 thru 0x55be798 (0x6662 bytes) 2024-09-21T15:09:34.292 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.288+0000 7f68ea67e700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d0c5c0c0 finish: resending after timeout 2024-09-21T15:09:34.292 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.288+0000 7f68ea67e700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d6802f00 finish: resending after timeout 2024-09-21T15:09:34.302 INFO:teuthology.orchestra.run.smithi161.stdout:4481 punch from 0xb8c1b7d to 0xb8cc489, (0xa90c bytes) 2024-09-21T15:09:34.302 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.302 INFO:teuthology.orchestra.run.smithi161.stdout:4483 read 0x8b51cd6 thru 0x8b601b6 (0xe4e1 bytes) 2024-09-21T15:09:34.302 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.302 INFO:teuthology.orchestra.run.smithi161.stdout:4487 write 0x3627230 thru 0x362ad19 (0x3aea bytes) 2024-09-21T15:09:34.324 INFO:teuthology.orchestra.run.smithi161.stdout:4488 write 0x77c7c88 thru 0x77cf79a (0x7b13 bytes) 2024-09-21T15:09:34.327 INFO:teuthology.orchestra.run.smithi161.stdout:4634 write 0xc8be2fc thru 0xc8c6084 (0x7d89 bytes) 2024-09-21T15:09:34.335 INFO:teuthology.orchestra.run.smithi161.stdout:4304 writesame 0x82d95bd thru 0x82e8a44 data_size 0x28(0xf488 bytes) 2024-09-21T15:09:34.348 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.348 INFO:teuthology.orchestra.run.smithi161.stdout:4491 punch from 0x1582437 to 0x158ef2b, (0xcaf4 bytes) 2024-09-21T15:09:34.348 INFO:teuthology.orchestra.run.smithi161.stdout:4492 read 0x786ac40 thru 0x7878517 (0xd8d8 bytes) 2024-09-21T15:09:34.350 INFO:teuthology.orchestra.run.smithi161.stdout:4494 write 0xab6e131 thru 0xab7bc59 (0xdb29 bytes) 2024-09-21T15:09:34.356 INFO:teuthology.orchestra.run.smithi161.stdout:4635 clone 29 order 20 su 131072 sc 4 2024-09-21T15:09:34.366 INFO:teuthology.orchestra.run.smithi161.stdout:4596 clone 24 order 22 su 32768 sc 4 2024-09-21T15:09:34.381 INFO:teuthology.orchestra.run.smithi161.stdout:4495 writesame 0x15700af thru 0x157c611 data_size 0x17(0xc563 bytes) 2024-09-21T15:09:34.391 INFO:teuthology.orchestra.run.smithi161.stdout:4305 writesame 0xc3eabb3 thru 0xc3f2060 data_size 0x3a(0x74ae bytes) 2024-09-21T15:09:34.399 INFO:teuthology.orchestra.run.smithi161.stdout:4496 punch from 0xae9570e to 0xaea11bc, (0xbaae bytes) 2024-09-21T15:09:34.399 INFO:teuthology.orchestra.run.smithi161.stdout:4497 writesame 0xc8321a9 thru 0xc83ef46 data_size 0x1f(0xcd9e bytes) 2024-09-21T15:09:34.399 INFO:teuthology.orchestra.run.smithi161.stdout:4306 write 0x6da7564 thru 0x6daca43 (0x54e0 bytes) 2024-09-21T15:09:34.413 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.413 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.413 INFO:teuthology.orchestra.run.smithi161.stdout:4501 read 0xdff77b thru 0xe09de9 (0xa66f bytes) 2024-09-21T15:09:34.414 INFO:teuthology.orchestra.run.smithi161.stdout:4502 write 0xcce2385 thru 0xccea888 (0x8504 bytes) 2024-09-21T15:09:34.417 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.417 INFO:teuthology.orchestra.run.smithi161.stdout:4309 writesame 0xa27239d thru 0xa276751 data_size 0x1(0x43b5 bytes) 2024-09-21T15:09:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.416+0000 7f68eae7f700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581cd81ec00 finish: resending after timeout 2024-09-21T15:09:34.436 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.432+0000 7f68ea67e700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d4c56c00 finish: resending after timeout 2024-09-21T15:09:34.442 INFO:teuthology.orchestra.run.smithi161.stdout:4503 clone 29 order 18 su 4096 sc 2 2024-09-21T15:09:34.450 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.450 INFO:teuthology.orchestra.run.smithi161.stdout:4313 read 0x1325c01 thru 0x1333850 (0xdc50 bytes) 2024-09-21T15:09:34.450 INFO:teuthology.orchestra.run.smithi161.stdout:4314 punch from 0x802f076 to 0x8032d4a, (0x3cd4 bytes) 2024-09-21T15:09:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.456+0000 7f68eae7f700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d0c5d440 finish: resending after timeout 2024-09-21T15:09:34.463 INFO:teuthology.orchestra.run.smithi161.stdout:4315 trunc from 0xc3f2061 to 0x5447075 2024-09-21T15:09:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.492+0000 7f68ea67e700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581cb732240 finish: resending after timeout 2024-09-21T15:09:34.537 INFO:teuthology.orchestra.run.smithi161.stdout:4317 writesame 0x288fd5b thru 0x289c995 data_size 0x4d(0xcc3b bytes) 2024-09-21T15:09:34.544 INFO:teuthology.orchestra.run.smithi161.stdout:4318 read 0xc73450 thru 0xc7504e (0x1bff bytes) 2024-09-21T15:09:34.545 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.545 INFO:teuthology.orchestra.run.smithi161.stdout:4321 punch from 0x1a44b4a to 0x1a50e1f, (0xc2d5 bytes) 2024-09-21T15:09:34.545 INFO:teuthology.orchestra.run.smithi161.stdout:4322 read 0x235b773 thru 0x235ebfe (0x348c bytes) 2024-09-21T15:09:34.557 INFO:teuthology.orchestra.run.smithi161.stdout:4323 trunc from 0x5447075 to 0xc8393ed 2024-09-21T15:09:34.596 INFO:teuthology.orchestra.run.smithi161.stdout:4328 writesame 0xa55debd thru 0xa569ef7 data_size 0x1(0xc03b bytes) 2024-09-21T15:09:34.599 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.596+0000 7f68ea67e700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581cac12240 finish: resending after timeout 2024-09-21T15:09:34.615 INFO:teuthology.orchestra.run.smithi161.stdout:3735 read 0xd03411f thru 0xd03bd6f (0x7c51 bytes) 2024-09-21T15:09:34.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.640+0000 7f68eae7f700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581cd81eb40 finish: resending after timeout 2024-09-21T15:09:34.662 INFO:teuthology.orchestra.run.smithi161.stdout:4329 trunc from 0xc8393ed to 0xa4aebf0 2024-09-21T15:09:34.667 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.664+0000 7f68ea67e700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d6c54840 finish: resending after timeout 2024-09-21T15:09:34.692 INFO:teuthology.orchestra.run.smithi161.stdout:3736 write 0x9af5046 thru 0x9af734b (0x2306 bytes) 2024-09-21T15:09:34.724 INFO:teuthology.orchestra.run.smithi161.stdout:3737 write 0x43c0728 thru 0x43c5901 (0x51da bytes) 2024-09-21T15:09:34.725 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.720+0000 7f68ea67e700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d5283e00 finish: resending after timeout 2024-09-21T15:09:34.730 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.728+0000 7f68eae7f700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d1c92900 finish: resending after timeout 2024-09-21T15:09:34.740 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.736+0000 7f68ea67e700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d6c54f00 finish: resending after timeout 2024-09-21T15:09:34.741 INFO:teuthology.orchestra.run.smithi161.stdout:4331 write 0x1fc7b17 thru 0x1fd36d0 (0xbbba bytes) 2024-09-21T15:09:34.754 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:34.752+0000 7f68ea67e700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d6c54fc0 finish: resending after timeout 2024-09-21T15:09:34.761 INFO:teuthology.orchestra.run.smithi161.stdout:4333 read 0x7a03d43 thru 0x7a0546d (0x172b bytes) 2024-09-21T15:09:34.761 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.761 INFO:teuthology.orchestra.run.smithi161.stdout:4337 write 0x2fd7dc9 thru 0x2fe7495 (0xf6cd bytes) 2024-09-21T15:09:34.773 INFO:teuthology.orchestra.run.smithi161.stdout:3739 write 0xdd65c15 thru 0xdd67f4d (0x2339 bytes) 2024-09-21T15:09:34.776 INFO:teuthology.orchestra.run.smithi161.stdout:4339 punch from 0x43fcf5c to 0x43fdbe3, (0xc87 bytes) 2024-09-21T15:09:34.800 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.801 INFO:teuthology.orchestra.run.smithi161.stdout:3741 read 0xd7e8fc thru 0xd7eb65 (0x26a bytes) 2024-09-21T15:09:34.804 INFO:teuthology.orchestra.run.smithi161.stdout:3743 punch from 0x46e4087 to 0x46e868a, (0x4603 bytes) 2024-09-21T15:09:34.804 INFO:teuthology.orchestra.run.smithi161.stdout:3744 read 0xe89ae0 thru 0xe936e6 (0x9c07 bytes) 2024-09-21T15:09:34.818 INFO:teuthology.orchestra.run.smithi161.stdout:3745 read 0x3d33c35 thru 0x3d37212 (0x35de bytes) 2024-09-21T15:09:34.820 INFO:teuthology.orchestra.run.smithi161.stdout:3747 writesame 0x22a43f1 thru 0x22ae057 data_size 0x1(0x9c67 bytes) 2024-09-21T15:09:34.896 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.898 INFO:teuthology.orchestra.run.smithi161.stdout:3749 trunc from 0xec0ae06 to 0xe0d9571 2024-09-21T15:09:34.929 INFO:teuthology.orchestra.run.smithi161.stdout:4340 writesame 0xcc22fe9 thru 0xcc32dff data_size 0x1(0xfe17 bytes) 2024-09-21T15:09:34.978 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:34.978 INFO:teuthology.orchestra.run.smithi161.stdout:3751 read 0x7485fc thru 0x749268 (0xc6d bytes) 2024-09-21T15:09:34.980 INFO:teuthology.orchestra.run.smithi161.stdout:3753 trunc from 0xe0d9571 to 0xd68803a 2024-09-21T15:09:35.032 INFO:teuthology.orchestra.run.smithi161.stdout:4341 write 0xcea1c7f thru 0xceae87c (0xcbfe bytes) 2024-09-21T15:09:35.049 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone28 from 0xe9f7c25 (overlap 0xf54df) to 0x310f9 2024-09-21T15:09:35.078 INFO:teuthology.orchestra.run.smithi161.stdout:4342 write 0x40c5a12 thru 0x40cb449 (0x5a38 bytes) 2024-09-21T15:09:35.096 INFO:teuthology.orchestra.run.smithi161.stdout:4344 read 0xa8521fb thru 0xa857462 (0x5268 bytes) 2024-09-21T15:09:35.096 INFO:teuthology.orchestra.run.smithi161.stdout:4345 read 0x6787efb thru 0x6795480 (0xd586 bytes) 2024-09-21T15:09:35.116 INFO:teuthology.orchestra.run.smithi161.stdout:3755 write 0x9caece thru 0x9d07cd (0x5900 bytes) 2024-09-21T15:09:35.172 INFO:teuthology.orchestra.run.smithi161.stdout:4346 write 0xe42709e thru 0xe42c0a2 (0x5005 bytes) 2024-09-21T15:09:35.195 INFO:teuthology.orchestra.run.smithi161.stdout:3756 write 0xc10def2 thru 0xc116f55 (0x9064 bytes) 2024-09-21T15:09:35.202 INFO:teuthology.orchestra.run.smithi161.stdout:4347 write 0x801af6 thru 0x80a6d2 (0x8bdd bytes) 2024-09-21T15:09:35.204 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone23 from 0xd750c4e (overlap 0x409950) to 0x0 2024-09-21T15:09:35.218 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #27, image image_cluster1.client.mirror.2-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent28 2024-09-21T15:09:35.270 INFO:teuthology.orchestra.run.smithi161.stdout:4349 writesame 0xe31f49e thru 0xe328725 data_size 0x24(0x9288 bytes) 2024-09-21T15:09:35.317 INFO:teuthology.orchestra.run.smithi161.stdout:4350 write 0xcc25483 thru 0xcc2739f (0x1f1d bytes) 2024-09-21T15:09:35.335 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #27, image image_cluster1.client.mirror.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent28 2024-09-21T15:09:35.336 INFO:teuthology.orchestra.run.smithi161.stdout:4351 read 0x3cb309 thru 0x3cd428 (0x2120 bytes) 2024-09-21T15:09:35.337 INFO:teuthology.orchestra.run.smithi161.stdout:4352 read 0x8063af9 thru 0x806a99f (0x6ea7 bytes) 2024-09-21T15:09:35.337 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:35.337 INFO:teuthology.orchestra.run.smithi161.stdout:4355 write 0x3e4eb6f thru 0x3e5b3c2 (0xc854 bytes) 2024-09-21T15:09:35.362 INFO:teuthology.orchestra.run.smithi161.stdout:4356 write 0xcbddea4 thru 0xcbed48a (0xf5e7 bytes) 2024-09-21T15:09:35.403 INFO:teuthology.orchestra.run.smithi161.stdout:3757 write 0xdfb1720 thru 0xdfb7e19 (0x66fa bytes) 2024-09-21T15:09:35.416 INFO:teuthology.orchestra.run.smithi161.stdout:4357 punch from 0x2ebba01 to 0x2ec4cef, (0x92ee bytes) 2024-09-21T15:09:35.416 INFO:teuthology.orchestra.run.smithi161.stdout:4358 read 0xcc219cc thru 0xcc2e3e4 (0xca19 bytes) 2024-09-21T15:09:35.417 INFO:teuthology.orchestra.run.smithi161.stdout:4359 write 0xb815281 thru 0xb817e32 (0x2bb2 bytes) 2024-09-21T15:09:35.440 INFO:teuthology.orchestra.run.smithi161.stdout:4361 read 0x5a01229 thru 0x5a0e616 (0xd3ee bytes) 2024-09-21T15:09:35.440 INFO:teuthology.orchestra.run.smithi161.stdout:4362 write 0x62aea9d thru 0x62b5bb7 (0x711b bytes) 2024-09-21T15:09:35.455 INFO:teuthology.orchestra.run.smithi161.stdout:3759 punch from 0x67feb2a to 0x68025bc, (0x3a92 bytes) 2024-09-21T15:09:35.455 INFO:teuthology.orchestra.run.smithi161.stdout:3760 write 0xb9c7550 thru 0xb9c9731 (0x21e2 bytes) 2024-09-21T15:09:35.473 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:35.473 INFO:teuthology.orchestra.run.smithi161.stdout:4365 read 0x433d134 thru 0x433e37f (0x124c bytes) 2024-09-21T15:09:35.474 INFO:teuthology.orchestra.run.smithi161.stdout:4366 read 0x8353f2 thru 0x83d851 (0x8460 bytes) 2024-09-21T15:09:35.475 INFO:teuthology.orchestra.run.smithi161.stdout:4367 writesame 0x21454a7 thru 0x2155058 data_size 0x3(0xfbb2 bytes) 2024-09-21T15:09:35.576 INFO:teuthology.orchestra.run.smithi161.stdout:4369 read 0x2ff4c34 thru 0x2ff583d (0xc0a bytes) 2024-09-21T15:09:35.583 INFO:teuthology.orchestra.run.smithi161.stdout:3761 read 0x46090cc thru 0x4617ecf (0xee04 bytes) 2024-09-21T15:09:35.585 INFO:teuthology.orchestra.run.smithi161.stdout:3762 trunc from 0xdfb7e1a to 0xeb50909 2024-09-21T15:09:35.598 INFO:teuthology.orchestra.run.smithi161.stdout:4371 trunc from 0xe42c0a3 to 0x2df2302 2024-09-21T15:09:35.681 INFO:teuthology.orchestra.run.smithi161.stdout:3763 write 0x81fe318 thru 0x82084c1 (0xa1aa bytes) 2024-09-21T15:09:35.762 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:35.767 INFO:teuthology.orchestra.run.smithi161.stdout:3766 trunc from 0xeb50909 to 0xbb414b0 2024-09-21T15:09:35.773 INFO:teuthology.orchestra.run.smithi161.stdout:4504 read 0x696b960 thru 0x6979fbb (0xe65c bytes) 2024-09-21T15:09:35.841 INFO:teuthology.orchestra.run.smithi161.stdout:4373 read 0x13be256 thru 0x13c38a3 (0x564e bytes) 2024-09-21T15:09:35.841 INFO:teuthology.orchestra.run.smithi161.stdout:4374 writesame 0x1760218 thru 0x1769184 data_size 0x1(0x8f6d bytes) 2024-09-21T15:09:35.877 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #22, image image_cluster1.client.mirror.1-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent23 2024-09-21T15:09:35.978 INFO:teuthology.orchestra.run.smithi161.stdout:3768 write 0x2a11d37 thru 0x2a20e2f (0xf0f9 bytes) 2024-09-21T15:09:36.010 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.040 INFO:teuthology.orchestra.run.smithi161.stdout:4508 trunc from 0xe9f7c25 to 0x3926b47 2024-09-21T15:09:36.066 INFO:teuthology.orchestra.run.smithi161.stdout:3770 writesame 0xb365edd thru 0xb366a35 data_size 0x1(0xb59 bytes) 2024-09-21T15:09:36.116 INFO:teuthology.orchestra.run.smithi161.stdout:4375 punch from 0x2166567 to 0x216faed, (0x9586 bytes) 2024-09-21T15:09:36.116 INFO:teuthology.orchestra.run.smithi161.stdout:4376 write 0x1fb8672 thru 0x1fbba56 (0x33e5 bytes) 2024-09-21T15:09:36.117 INFO:teuthology.orchestra.run.smithi161.stdout:3771 trunc from 0xbb414b0 to 0xbad3023 2024-09-21T15:09:36.134 INFO:teuthology.orchestra.run.smithi161.stdout:4509 read 0x14abd3d thru 0x14bbb4a (0xfe0e bytes) 2024-09-21T15:09:36.135 INFO:teuthology.orchestra.run.smithi161.stdout:4510 read 0x262ad89 thru 0x262c534 (0x17ac bytes) 2024-09-21T15:09:36.135 INFO:teuthology.orchestra.run.smithi161.stdout:4514 read 0x1d146a1 thru 0x1d15f5f (0x18bf bytes) 2024-09-21T15:09:36.135 INFO:teuthology.orchestra.run.smithi161.stdout:4516 read 0x12cbc1f thru 0x12d2532 (0x6914 bytes) 2024-09-21T15:09:36.136 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.136 INFO:teuthology.orchestra.run.smithi161.stdout:4520 write 0x2959525 thru 0x29690a6 (0xfb82 bytes) 2024-09-21T15:09:36.147 INFO:teuthology.orchestra.run.smithi161.stdout:4598 writesame 0xb60803a thru 0xb60fdcd data_size 0xc(0x7d94 bytes) 2024-09-21T15:09:36.175 INFO:teuthology.orchestra.run.smithi161.stdout:4377 write 0x34b9df6 thru 0x34c416c (0xa377 bytes) 2024-09-21T15:09:36.189 INFO:teuthology.orchestra.run.smithi161.stdout:4378 read 0x25d27f5 thru 0x25d3aab (0x12b7 bytes) 2024-09-21T15:09:36.209 INFO:teuthology.orchestra.run.smithi161.stdout:4521 write 0xa1f7e63 thru 0xa2028db (0xaa79 bytes) 2024-09-21T15:09:36.229 INFO:teuthology.orchestra.run.smithi161.stdout:4599 punch from 0x8c3e048 to 0x8c49986, (0xb93e bytes) 2024-09-21T15:09:36.229 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.230 INFO:teuthology.orchestra.run.smithi161.stdout:4379 writesame 0x791571b thru 0x791bb3f data_size 0x1(0x6425 bytes) 2024-09-21T15:09:36.231 INFO:teuthology.orchestra.run.smithi161.stdout:4522 punch from 0x5ffccda to 0x600a99f, (0xdcc5 bytes) 2024-09-21T15:09:36.231 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.231 INFO:teuthology.orchestra.run.smithi161.stdout:4524 read 0x55cc7f3 thru 0x55ccd0c (0x51a bytes) 2024-09-21T15:09:36.231 INFO:teuthology.orchestra.run.smithi161.stdout:4525 read 0x835f0aa thru 0x83685fe (0x9555 bytes) 2024-09-21T15:09:36.231 INFO:teuthology.orchestra.run.smithi161.stdout:4526 read 0x16cb1ad thru 0x16d14b0 (0x6304 bytes) 2024-09-21T15:09:36.233 INFO:teuthology.orchestra.run.smithi161.stdout:4527 write 0x2b3f7ff thru 0x2b4becb (0xc6cd bytes) 2024-09-21T15:09:36.234 INFO:teuthology.orchestra.run.smithi161.stdout:3773 read 0x8b0a1eb thru 0x8b0a379 (0x18f bytes) 2024-09-21T15:09:36.234 INFO:teuthology.orchestra.run.smithi161.stdout:3774 write 0x56154e thru 0x5618a1 (0x354 bytes) 2024-09-21T15:09:36.235 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.236 INFO:teuthology.orchestra.run.smithi161.stdout:4381 read 0x72af216 thru 0x72b76d8 (0x84c3 bytes) 2024-09-21T15:09:36.272 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.273 INFO:teuthology.orchestra.run.smithi161.stdout:4529 punch from 0x2343e89 to 0x2349073, (0x51ea bytes) 2024-09-21T15:09:36.273 INFO:teuthology.orchestra.run.smithi161.stdout:4530 clone 30 order 23 su 65536 sc 2 2024-09-21T15:09:36.273 INFO:teuthology.orchestra.run.smithi161.stdout:4601 writesame 0xd8a0ab2 thru 0xd8a25a1 data_size 0x8(0x1af0 bytes) 2024-09-21T15:09:36.278 INFO:teuthology.orchestra.run.smithi161.stdout:3775 write 0x36f52cb thru 0x3701304 (0xc03a bytes) 2024-09-21T15:09:36.295 INFO:teuthology.orchestra.run.smithi161.stdout:4382 write 0x7b86f05 thru 0x7b8df97 (0x7093 bytes) 2024-09-21T15:09:36.300 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.300 INFO:teuthology.orchestra.run.smithi161.stdout:4638 write 0xc2b99ac thru 0xc2c7fb9 (0xe60e bytes) 2024-09-21T15:09:36.304 INFO:teuthology.orchestra.run.smithi161.stdout:4602 writesame 0x82af775 thru 0x82b884a data_size 0x1(0x90d6 bytes) 2024-09-21T15:09:36.330 INFO:teuthology.orchestra.run.smithi161.stdout:4383 write 0x3f4e2c2 thru 0x3f57fba (0x9cf9 bytes) 2024-09-21T15:09:36.339 INFO:teuthology.orchestra.run.smithi161.stdout:3779 read 0x8f10a3 thru 0x900899 (0xf7f7 bytes) 2024-09-21T15:09:36.347 INFO:teuthology.orchestra.run.smithi161.stdout:3780 punch from 0x8d72ba6 to 0x8d8238a, (0xf7e4 bytes) 2024-09-21T15:09:36.348 INFO:teuthology.orchestra.run.smithi161.stdout:3781 punch from 0x7a1c7a4 to 0x7a1f258, (0x2ab4 bytes) 2024-09-21T15:09:36.348 INFO:teuthology.orchestra.run.smithi161.stdout:3782 read 0xafba29a thru 0xafc8776 (0xe4dd bytes) 2024-09-21T15:09:36.348 INFO:teuthology.orchestra.run.smithi161.stdout:3784 read 0xa0980bd thru 0xa09d3d1 (0x5315 bytes) 2024-09-21T15:09:36.348 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.348 INFO:teuthology.orchestra.run.smithi161.stdout:3786 read 0x823ba20 thru 0x8243bcf (0x81b0 bytes) 2024-09-21T15:09:36.350 INFO:teuthology.orchestra.run.smithi161.stdout:3787 write 0x237c6b2 thru 0x2382af0 (0x643f bytes) 2024-09-21T15:09:36.353 INFO:teuthology.orchestra.run.smithi161.stdout:4384 trunc from 0x7b8df98 to 0x566c4f0 2024-09-21T15:09:36.375 INFO:teuthology.orchestra.run.smithi161.stdout:4605 write 0xa66edfb thru 0xa66f4f6 (0x6fc bytes) 2024-09-21T15:09:36.390 INFO:teuthology.orchestra.run.smithi161.stdout:4639 punch from 0x2f44cc7 to 0x2f5473c, (0xfa75 bytes) 2024-09-21T15:09:36.390 INFO:teuthology.orchestra.run.smithi161.stdout:4640 write 0x754243b thru 0x7547098 (0x4c5e bytes) 2024-09-21T15:09:36.408 INFO:teuthology.orchestra.run.smithi161.stdout:4641 writesame 0x7ceb77f thru 0x7cefab2 data_size 0x44(0x4334 bytes) 2024-09-21T15:09:36.419 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.419 INFO:teuthology.orchestra.run.smithi161.stdout:4609 writesame 0x19afb28 thru 0x19be18f data_size 0x49(0xe668 bytes) 2024-09-21T15:09:36.437 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.438 INFO:teuthology.orchestra.run.smithi161.stdout:4643 read 0x34a7324 thru 0x34b3967 (0xc644 bytes) 2024-09-21T15:09:36.438 INFO:teuthology.orchestra.run.smithi161.stdout:4646 read 0x95373a9 thru 0x9537a27 (0x67f bytes) 2024-09-21T15:09:36.438 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.445 INFO:teuthology.orchestra.run.smithi161.stdout:4648 trunc from 0xd9c89d1 to 0xb01d744 2024-09-21T15:09:36.458 INFO:teuthology.orchestra.run.smithi161.stdout:4385 read 0x2c19100 thru 0x2c22c9a (0x9b9b bytes) 2024-09-21T15:09:36.459 INFO:teuthology.orchestra.run.smithi161.stdout:4386 read 0xe0fb54 thru 0xe18415 (0x88c2 bytes) 2024-09-21T15:09:36.462 INFO:teuthology.orchestra.run.smithi161.stdout:3789 write 0xd397383 thru 0xd39c613 (0x5291 bytes) 2024-09-21T15:09:36.462 INFO:teuthology.orchestra.run.smithi161.stdout:4387 read 0x4899719 thru 0x48a5ff5 (0xc8dd bytes) 2024-09-21T15:09:36.462 INFO:teuthology.orchestra.run.smithi161.stdout:4388 read 0x3184985 thru 0x318c212 (0x788e bytes) 2024-09-21T15:09:36.509 INFO:teuthology.orchestra.run.smithi161.stdout:3793 read 0x3528ae0 thru 0x352a06e (0x158f bytes) 2024-09-21T15:09:36.509 INFO:teuthology.orchestra.run.smithi161.stdout:3794 read 0xbbf9aac thru 0xbc0061d (0x6b72 bytes) 2024-09-21T15:09:36.510 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.511 INFO:teuthology.orchestra.run.smithi161.stdout:4610 punch from 0xb58863f to 0xb58bdee, (0x37af bytes) 2024-09-21T15:09:36.513 INFO:teuthology.orchestra.run.smithi161.stdout:4611 flatten 2024-09-21T15:09:36.517 INFO:teuthology.orchestra.run.smithi161.stdout:3796 trunc from 0xd39c614 to 0x9e4e234 2024-09-21T15:09:36.523 INFO:teuthology.orchestra.run.smithi161.stdout:4389 writesame 0x61b74b5 thru 0x61b8d0c data_size 0x29(0x1858 bytes) 2024-09-21T15:09:36.662 INFO:teuthology.orchestra.run.smithi161.stdout:4390 write 0x9a28f35 thru 0x9a34152 (0xb21e bytes) 2024-09-21T15:09:36.712 INFO:teuthology.orchestra.run.smithi161.stdout:4649 read 0x8dfb332 thru 0x8e06447 (0xb116 bytes) 2024-09-21T15:09:36.728 INFO:teuthology.orchestra.run.smithi161.stdout:4391 read 0x6c95766 thru 0x6c9c960 (0x71fb bytes) 2024-09-21T15:09:36.728 INFO:teuthology.orchestra.run.smithi161.stdout:4393 read 0x28f9a17 thru 0x290015a (0x6744 bytes) 2024-09-21T15:09:36.729 INFO:teuthology.orchestra.run.smithi161.stdout:4394 punch from 0x7a187c8 to 0x7a1ba1b, (0x3253 bytes) 2024-09-21T15:09:36.737 INFO:teuthology.orchestra.run.smithi161.stdout:4395 trunc from 0x9a34153 to 0x530ad9f 2024-09-21T15:09:36.800 INFO:teuthology.orchestra.run.smithi161.stdout:4650 writesame 0xd845f6a thru 0xd852fc8 data_size 0x3(0xd05f bytes) 2024-09-21T15:09:36.804 INFO:teuthology.orchestra.run.smithi161.stdout:4651 read 0x194031b thru 0x1946e61 (0x6b47 bytes) 2024-09-21T15:09:36.804 INFO:teuthology.orchestra.run.smithi161.stdout:4652 punch from 0x66a25d7 to 0x66ac5fe, (0xa027 bytes) 2024-09-21T15:09:36.805 INFO:teuthology.orchestra.run.smithi161.stdout:4653 write 0x1773b4b thru 0x1777f26 (0x43dc bytes) 2024-09-21T15:09:36.821 INFO:teuthology.orchestra.run.smithi161.stdout:3797 read 0x8fe36fc thru 0x8ff2c31 (0xf536 bytes) 2024-09-21T15:09:36.822 INFO:teuthology.orchestra.run.smithi161.stdout:3798 punch from 0x38f1c75 to 0x38f5cee, (0x4079 bytes) 2024-09-21T15:09:36.822 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.856 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.856 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.880 INFO:teuthology.orchestra.run.smithi161.stdout:4396 writesame 0x552accb thru 0x552b3d5 data_size 0x1(0x70b bytes) 2024-09-21T15:09:36.886 INFO:teuthology.orchestra.run.smithi161.stdout:4397 punch from 0x5319d75 to 0x5321dde, (0x8069 bytes) 2024-09-21T15:09:36.893 INFO:teuthology.orchestra.run.smithi161.stdout:4398 trunc from 0x552b3d6 to 0x1fb88bc 2024-09-21T15:09:36.912 INFO:teuthology.orchestra.run.smithi161.stdout:4658 writesame 0xe4a17f5 thru 0xe4aa203 data_size 0x77(0x8a0f bytes) 2024-09-21T15:09:36.918 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.918 INFO:teuthology.orchestra.run.smithi161.stdout:4660 read 0x48a2876 thru 0x48ad26d (0xa9f8 bytes) 2024-09-21T15:09:36.918 INFO:teuthology.orchestra.run.smithi161.stdout:4661 write 0x438b926 thru 0x438e1f3 (0x28ce bytes) 2024-09-21T15:09:36.938 INFO:teuthology.orchestra.run.smithi161.stdout:3801 writesame 0xafdc633 thru 0xafeb57b data_size 0x7(0xef49 bytes) 2024-09-21T15:09:36.947 INFO:teuthology.orchestra.run.smithi161.stdout:3802 read 0x1e54b94 thru 0x1e5f10c (0xa579 bytes) 2024-09-21T15:09:36.948 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.948 INFO:teuthology.orchestra.run.smithi161.stdout:3805 read 0xd4d0cd thru 0xd4ff18 (0x2e4c bytes) 2024-09-21T15:09:36.952 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.952 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:36.952 INFO:teuthology.orchestra.run.smithi161.stdout:3810 write 0x35373b8 thru 0x353f621 (0x826a bytes) 2024-09-21T15:09:36.980 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone29 from 0xa2028dc (overlap 0x3926b47) to 0x0 2024-09-21T15:09:36.988 INFO:teuthology.orchestra.run.smithi161.stdout:4662 write 0xbb8e225 thru 0xbb9b730 (0xd50c bytes) 2024-09-21T15:09:37.062 INFO:teuthology.orchestra.run.smithi161.stdout:3811 read 0x5e7643f thru 0x5e7dda1 (0x7963 bytes) 2024-09-21T15:09:37.066 INFO:teuthology.orchestra.run.smithi161.stdout:3813 read 0x66d9dc0 thru 0x66e9ca0 (0xfee1 bytes) 2024-09-21T15:09:37.066 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:37.067 INFO:teuthology.orchestra.run.smithi161.stdout:3815 read 0x23d5c95 thru 0x23e599e (0xfd0a bytes) 2024-09-21T15:09:37.070 INFO:teuthology.orchestra.run.smithi161.stdout:3816 write 0x7e9b0c5 thru 0x7ea34e3 (0x841f bytes) 2024-09-21T15:09:37.076 INFO:teuthology.orchestra.run.smithi161.stdout:4400 punch from 0x115cdc4 to 0x1163480, (0x66bc bytes) 2024-09-21T15:09:37.079 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:37.080 INFO:teuthology.orchestra.run.smithi161.stdout:4664 punch from 0x79467e1 to 0x795317d, (0xc99c bytes) 2024-09-21T15:09:37.080 INFO:teuthology.orchestra.run.smithi161.stdout:4665 punch from 0x5558d2f to 0x5564fe0, (0xc2b1 bytes) 2024-09-21T15:09:37.080 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:37.080 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:37.080 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:37.085 INFO:teuthology.orchestra.run.smithi161.stdout:4673 trunc from 0xe4aa204 to 0xbac26c1 2024-09-21T15:09:37.115 INFO:teuthology.orchestra.run.smithi161.stdout:3817 read 0x7084efd thru 0x7089f37 (0x503b bytes) 2024-09-21T15:09:37.115 INFO:teuthology.orchestra.run.smithi161.stdout:3818 punch from 0x16796fe to 0x16853fa, (0xbcfc bytes) 2024-09-21T15:09:37.117 INFO:teuthology.orchestra.run.smithi161.stdout:4401 writesame 0x7aaf65c thru 0x7ab532d data_size 0x2(0x5cd2 bytes) 2024-09-21T15:09:37.122 INFO:teuthology.orchestra.run.smithi161.stdout:3819 trunc from 0xafeb57c to 0xe9dbb83 2024-09-21T15:09:37.130 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #38, image image_cluster1.client.mirror.3-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent39 2024-09-21T15:09:37.170 INFO:teuthology.orchestra.run.smithi161.stdout:4612 trunc from 0xd8a25a2 to 0x9c1925c 2024-09-21T15:09:37.194 INFO:teuthology.orchestra.run.smithi161.stdout:4404 writesame 0xd70b2bb thru 0xd719ce5 data_size 0x1(0xea2b bytes) 2024-09-21T15:09:37.202 INFO:teuthology.orchestra.run.smithi161.stdout:4405 write 0x2b69fef thru 0x2b78247 (0xe259 bytes) 2024-09-21T15:09:37.211 INFO:teuthology.orchestra.run.smithi161.stdout:3820 punch from 0x7c65037 to 0x7c6e914, (0x98dd bytes) 2024-09-21T15:09:37.211 INFO:teuthology.orchestra.run.smithi161.stdout:3821 read 0xa2afde6 thru 0xa2b64db (0x66f6 bytes) 2024-09-21T15:09:37.211 INFO:teuthology.orchestra.run.smithi161.stdout:3822 writesame 0x26f3cd0 thru 0x27024f0 data_size 0x5(0xe821 bytes) 2024-09-21T15:09:37.221 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.219+0000 7f1e9c77a700 -1 reset not still connected to 0x56287798b2b0 2024-09-21T15:09:37.222 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.219+0000 7f1e9c77a700 -1 reset not still connected to 0x562879b244e0 2024-09-21T15:09:37.227 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.223+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c23cea0 2024-09-21T15:09:37.228 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.227+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c888f70 2024-09-21T15:09:37.228 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.227+0000 7f1e9c77a700 -1 reset not still connected to 0x56287cb1c0d0 2024-09-21T15:09:37.229 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.227+0000 7f1e9c77a700 -1 reset not still connected to 0x56287ce70000 2024-09-21T15:09:37.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.227+0000 7f1e9c77a700 -1 reset not still connected to 0x56287dbf48f0 2024-09-21T15:09:37.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.227+0000 7f1e9c77a700 -1 reset not still connected to 0x56288301b2b0 2024-09-21T15:09:37.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.227+0000 7f1e9c77a700 -1 reset not still connected to 0x562889a48750 2024-09-21T15:09:37.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.227+0000 7f1e9c77a700 -1 reset not still connected to 0x562889a931e0 2024-09-21T15:09:37.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x56288edfc9c0 2024-09-21T15:09:37.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f3264e0 2024-09-21T15:09:37.232 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f958270 2024-09-21T15:09:37.232 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f959ba0 2024-09-21T15:09:37.232 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x562890035520 2024-09-21T15:09:37.233 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x5628908044e0 2024-09-21T15:09:37.233 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x56289097b110 2024-09-21T15:09:37.234 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x562890d15860 2024-09-21T15:09:37.234 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x5628937f24e0 2024-09-21T15:09:37.234 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5930 2024-09-21T15:09:37.234 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x562899844b60 2024-09-21T15:09:37.234 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x562899b8f5f0 2024-09-21T15:09:37.234 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x56289e304750 2024-09-21T15:09:37.234 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:37.231+0000 7f1e9c77a700 -1 reset not still connected to 0x56289e9f9930 2024-09-21T15:09:37.242 INFO:teuthology.orchestra.run.smithi161.stdout:4406 write 0x26fb4ce thru 0x26fbc55 (0x788 bytes) 2024-09-21T15:09:37.261 INFO:teuthology.orchestra.run.smithi161.stdout:4407 punch from 0x4f2bf39 to 0x4f33b07, (0x7bce bytes) 2024-09-21T15:09:37.261 INFO:teuthology.orchestra.run.smithi161.stdout:4409 write 0xb1bfac1 thru 0xb1c6bc3 (0x7103 bytes) 2024-09-21T15:09:37.294 INFO:teuthology.orchestra.run.smithi161.stdout:4410 read 0xc892481 thru 0xc8a0251 (0xddd1 bytes) 2024-09-21T15:09:37.294 INFO:teuthology.orchestra.run.smithi161.stdout:3824 trunc from 0xe9dbb83 to 0xbcd70a5 2024-09-21T15:09:37.294 INFO:teuthology.orchestra.run.smithi161.stdout:4411 write 0xc1b27ee thru 0xc1bef14 (0xc727 bytes) 2024-09-21T15:09:37.320 INFO:teuthology.orchestra.run.smithi161.stdout:4413 read 0xcd43b33 thru 0xcd4b8eb (0x7db9 bytes) 2024-09-21T15:09:37.320 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:37.320 INFO:teuthology.orchestra.run.smithi161.stdout:4417 read 0x3929182 thru 0x39343c4 (0xb243 bytes) 2024-09-21T15:09:37.327 INFO:teuthology.orchestra.run.smithi161.stdout:4674 punch from 0x98085de to 0x9813b76, (0xb598 bytes) 2024-09-21T15:09:37.327 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:37.332 INFO:teuthology.orchestra.run.smithi161.stdout:4676 trunc from 0xbac26c1 to 0x9c4fd08 2024-09-21T15:09:37.336 INFO:teuthology.orchestra.run.smithi161.stdout:4418 trunc from 0xd719ce6 to 0x549ee7e 2024-09-21T15:09:37.347 INFO:teuthology.orchestra.run.smithi161.stdout:4613 write 0x85d59bc thru 0x85e4520 (0xeb65 bytes) 2024-09-21T15:09:37.367 INFO:teuthology.orchestra.run.smithi161.stdout:3335 read 0x5d040fb thru 0x5d13d0d (0xfc13 bytes) 2024-09-21T15:09:37.404 INFO:teuthology.orchestra.run.smithi161.stdout:4421 read 0xdfd9c3 thru 0xe0285c (0x4e9a bytes) 2024-09-21T15:09:37.406 INFO:teuthology.orchestra.run.smithi161.stdout:3825 write 0xd85e94e thru 0xd868897 (0x9f4a bytes) 2024-09-21T15:09:37.419 INFO:teuthology.orchestra.run.smithi161.stdout:3336 writesame 0x42cb9 thru 0x51981 data_size 0x1(0xecc9 bytes) 2024-09-21T15:09:37.426 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:37.426 INFO:teuthology.orchestra.run.smithi161.stdout:4615 read 0x49884bb thru 0x4996548 (0xe08e bytes) 2024-09-21T15:09:37.427 INFO:teuthology.orchestra.run.smithi161.stdout:4616 punch from 0x54f44 to 0x5e700, (0x97bc bytes) 2024-09-21T15:09:37.427 INFO:teuthology.orchestra.run.smithi161.stdout:4617 write 0xcf1bbf thru 0xcf5022 (0x3464 bytes) 2024-09-21T15:09:37.496 INFO:teuthology.orchestra.run.smithi161.stdout:3826 write 0x8b24bb6 thru 0x8b2520c (0x657 bytes) 2024-09-21T15:09:37.541 INFO:teuthology.orchestra.run.smithi161.stdout:4618 trunc from 0x9c1925c to 0x33c86d9 2024-09-21T15:09:37.550 INFO:teuthology.orchestra.run.smithi161.stdout:4422 writesame 0x5d40cbf thru 0x5d4ac75 data_size 0x3f(0x9fb7 bytes) 2024-09-21T15:09:37.569 INFO:teuthology.orchestra.run.smithi161.stdout:3827 punch from 0x5bbf07e to 0x5bcdc38, (0xebba bytes) 2024-09-21T15:09:37.569 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:37.569 INFO:teuthology.orchestra.run.smithi161.stdout:3829 read 0xc1378dd thru 0xc13d197 (0x58bb bytes) 2024-09-21T15:09:37.569 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:37.569 INFO:teuthology.orchestra.run.smithi161.stdout:3831 punch from 0xa92ecf to 0xa9d94c, (0xaa7d bytes) 2024-09-21T15:09:37.570 INFO:teuthology.orchestra.run.smithi161.stdout:3832 read 0x7ba24c thru 0x7c529d (0xb052 bytes) 2024-09-21T15:09:37.572 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:37.573 INFO:teuthology.orchestra.run.smithi161.stdout:4426 punch from 0x16a5992 to 0x16a640c, (0xa7a bytes) 2024-09-21T15:09:37.573 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:37.568+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cd4ea3c0 handle_clone_image: failed to clone image mirror/10b56137f876 to image_cluster1.client.mirror.0-clone29 2024-09-21T15:09:37.591 INFO:teuthology.orchestra.run.smithi161.stdout:3833 punch from 0xcad6357 to 0xcae4e4c, (0xeaf5 bytes) 2024-09-21T15:09:37.592 INFO:teuthology.orchestra.run.smithi161.stdout:3834 write 0x7664451 thru 0x7667edb (0x3a8b bytes) 2024-09-21T15:09:37.644 INFO:teuthology.orchestra.run.smithi161.stdout:3835 read 0x7d83913 thru 0x7d84b49 (0x1237 bytes) 2024-09-21T15:09:37.648 INFO:teuthology.orchestra.run.smithi161.stdout:3836 read 0x9537520 thru 0x953cf83 (0x5a64 bytes) 2024-09-21T15:09:37.649 INFO:teuthology.orchestra.run.smithi161.stdout:3839 read 0x30c3ab thru 0x3106f8 (0x434e bytes) 2024-09-21T15:09:37.677 INFO:teuthology.orchestra.run.smithi161.stdout:3840 trunc from 0xd868898 to 0x2ca2010 2024-09-21T15:09:37.703 INFO:teuthology.orchestra.run.smithi161.stdout:4427 write 0xbbfce79 thru 0xbc0c224 (0xf3ac bytes) 2024-09-21T15:09:37.767 INFO:teuthology.orchestra.run.smithi161.stdout:4428 trunc from 0xbc0c225 to 0xdb3961d 2024-09-21T15:09:37.796 INFO:teuthology.orchestra.run.smithi161.stdout:4620 writesame 0x53fc018 thru 0x5403cfb data_size 0x2(0x7ce4 bytes) 2024-09-21T15:09:37.801 INFO:teuthology.orchestra.run.smithi161.stdout:4677 punch from 0x91a5ab5 to 0x91ae234, (0x877f bytes) 2024-09-21T15:09:37.801 INFO:teuthology.orchestra.run.smithi161.stdout:4679 write 0x3ba9346 thru 0x3bafa9e (0x6759 bytes) 2024-09-21T15:09:37.902 INFO:teuthology.orchestra.run.smithi161.stdout:4429 trunc from 0xdb3961d to 0x904759f 2024-09-21T15:09:37.941 INFO:teuthology.orchestra.run.smithi161.stdout:4621 write 0x840a729 thru 0x840a924 (0x1fc bytes) 2024-09-21T15:09:37.959 INFO:teuthology.orchestra.run.smithi161.stdout:4680 punch from 0xcb01df to 0xcb4e33, (0x4c54 bytes) 2024-09-21T15:09:37.959 INFO:teuthology.orchestra.run.smithi161.stdout:4681 read 0x70cb33e thru 0x70d8e53 (0xdb16 bytes) 2024-09-21T15:09:37.959 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:37.959 INFO:teuthology.orchestra.run.smithi161.stdout:4683 write 0x207967 thru 0x20d214 (0x58ae bytes) 2024-09-21T15:09:37.993 INFO:teuthology.orchestra.run.smithi161.stdout:4431 punch from 0x72668e8 to 0x726d6d5, (0x6ded bytes) 2024-09-21T15:09:38.111 INFO:teuthology.orchestra.run.smithi161.stdout:4433 write 0xc96804b thru 0xc96b6bc (0x3672 bytes) 2024-09-21T15:09:38.117 INFO:teuthology.orchestra.run.smithi161.stdout:3841 punch from 0x160d34 to 0x169f80, (0x924c bytes) 2024-09-21T15:09:38.117 INFO:teuthology.orchestra.run.smithi161.stdout:3842 read 0x13d12c4 thru 0x13d822a (0x6f67 bytes) 2024-09-21T15:09:38.122 INFO:teuthology.orchestra.run.smithi161.stdout:4622 write 0xe352326 thru 0xe357eaf (0x5b8a bytes) 2024-09-21T15:09:38.146 INFO:teuthology.orchestra.run.smithi161.stdout:4623 writesame 0xd6f8ea4 thru 0xd70581e data_size 0xb(0xc97b bytes) 2024-09-21T15:09:38.176 INFO:teuthology.orchestra.run.smithi161.stdout:4435 read 0x2a4ec5d thru 0x2a4f5f4 (0x998 bytes) 2024-09-21T15:09:38.176 INFO:teuthology.orchestra.run.smithi161.stdout:4436 punch from 0x17dfccc to 0x17edac7, (0xddfb bytes) 2024-09-21T15:09:38.176 INFO:teuthology.orchestra.run.smithi161.stdout:4437 read 0x4be8253 thru 0x4bedf23 (0x5cd1 bytes) 2024-09-21T15:09:38.177 INFO:teuthology.orchestra.run.smithi161.stdout:4438 writesame 0xadc04de thru 0xadc8383 data_size 0x1d(0x7ea6 bytes) 2024-09-21T15:09:38.177 INFO:teuthology.orchestra.run.smithi161.stdout:4684 writesame 0x37b9c1e thru 0x37c888b data_size 0x35(0xec6e bytes) 2024-09-21T15:09:38.193 INFO:teuthology.orchestra.run.smithi161.stdout:4624 write 0x76e1198 thru 0x76e6c0b (0x5a74 bytes) 2024-09-21T15:09:38.198 INFO:teuthology.orchestra.run.smithi161.stdout:4439 write 0x77c60a8 thru 0x77cc87b (0x67d4 bytes) 2024-09-21T15:09:38.199 INFO:teuthology.orchestra.run.smithi161.stdout:4685 writesame 0x4fe05c8 thru 0x4fe4d9a data_size 0x1b(0x47d3 bytes) 2024-09-21T15:09:38.229 INFO:teuthology.orchestra.run.smithi161.stdout:3843 write 0xe6e424f thru 0xe6e5fc8 (0x1d7a bytes) 2024-09-21T15:09:38.237 INFO:teuthology.orchestra.run.smithi161.stdout:4440 trunc from 0xc96b6bd to 0xe4acb41 2024-09-21T15:09:38.254 INFO:teuthology.orchestra.run.smithi161.stdout:4625 trunc from 0xe357eb0 to 0x10a3604 2024-09-21T15:09:38.265 INFO:teuthology.orchestra.run.smithi161.stdout:3846 read 0x5c3af64 thru 0x5c4a00a (0xf0a7 bytes) 2024-09-21T15:09:38.271 INFO:teuthology.orchestra.run.smithi161.stdout:3847 trunc from 0xe6e5fc9 to 0xa9d13b4 2024-09-21T15:09:38.299 INFO:teuthology.orchestra.run.smithi161.stdout:4441 trunc from 0xe4acb41 to 0xb51ed3c 2024-09-21T15:09:38.311 INFO:teuthology.orchestra.run.smithi161.stdout:4686 writesame 0xc0c6b39 thru 0xc0d0131 data_size 0x1(0x95f9 bytes) 2024-09-21T15:09:38.317 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:38.326 INFO:teuthology.orchestra.run.smithi161.stdout:4688 trunc from 0xc0d0132 to 0x6c97a9c 2024-09-21T15:09:38.368 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:38.368 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:38.370 INFO:teuthology.orchestra.run.smithi161.stdout:4442 read 0x256b25f thru 0x256de98 (0x2c3a bytes) 2024-09-21T15:09:38.370 INFO:teuthology.orchestra.run.smithi161.stdout:4443 read 0x744893d thru 0x74533d2 (0xaa96 bytes) 2024-09-21T15:09:38.382 INFO:teuthology.orchestra.run.smithi161.stdout:3852 trunc from 0xa9d13b4 to 0x3f87114 2024-09-21T15:09:38.417 INFO:teuthology.orchestra.run.smithi161.stdout:4626 trunc from 0x10a3604 to 0x579256 2024-09-21T15:09:38.420 INFO:teuthology.orchestra.run.smithi161.stdout:3854 trunc from 0x3f87114 to 0x2d54ef2 2024-09-21T15:09:38.421 INFO:teuthology.orchestra.run.smithi161.stdout:4444 write 0xeab3a8e thru 0xeab8da3 (0x5316 bytes) 2024-09-21T15:09:38.434 INFO:teuthology.orchestra.run.smithi161.stdout:4689 trunc from 0x6c97a9c to 0x32dbbfc 2024-09-21T15:09:38.446 INFO:teuthology.orchestra.run.smithi161.stdout:4445 read 0xb481b3c thru 0xb489fbc (0x8481 bytes) 2024-09-21T15:09:38.446 INFO:teuthology.orchestra.run.smithi161.stdout:4446 write 0x1c106 thru 0x26a7b (0xa976 bytes) 2024-09-21T15:09:38.482 INFO:teuthology.orchestra.run.smithi161.stdout:3337 writesame 0x2100406 thru 0x21039e1 data_size 0x12(0x35dc bytes) 2024-09-21T15:09:38.490 INFO:teuthology.orchestra.run.smithi161.stdout:4627 read 0x633a8 thru 0x7172d (0xe386 bytes) 2024-09-21T15:09:38.492 INFO:teuthology.orchestra.run.smithi161.stdout:4628 punch from 0x292d47 to 0x2a118f, (0xe448 bytes) 2024-09-21T15:09:38.492 INFO:teuthology.orchestra.run.smithi161.stdout:4629 read 0x2e9647 thru 0x2f2f2a (0x98e4 bytes) 2024-09-21T15:09:38.509 INFO:teuthology.orchestra.run.smithi161.stdout:4630 trunc from 0x579256 to 0x21798ee 2024-09-21T15:09:38.543 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:38.543 INFO:teuthology.orchestra.run.smithi161.stdout:4448 read 0x51416e0 thru 0x5148521 (0x6e42 bytes) 2024-09-21T15:09:38.543 INFO:teuthology.orchestra.run.smithi161.stdout:4449 read 0x6aeea28 thru 0x6aef682 (0xc5b bytes) 2024-09-21T15:09:38.543 INFO:teuthology.orchestra.run.smithi161.stdout:4450 read 0x8ea05f0 thru 0x8eaf861 (0xf272 bytes) 2024-09-21T15:09:38.543 INFO:teuthology.orchestra.run.smithi161.stdout:4451 write 0xaea9f29 thru 0xaeab151 (0x1229 bytes) 2024-09-21T15:09:38.571 INFO:teuthology.orchestra.run.smithi161.stdout:4691 read 0x26127ca thru 0x2616674 (0x3eab bytes) 2024-09-21T15:09:38.572 INFO:teuthology.orchestra.run.smithi161.stdout:4692 read 0x1847b71 thru 0x1847f1d (0x3ad bytes) 2024-09-21T15:09:38.572 INFO:teuthology.orchestra.run.smithi161.stdout:4694 write 0x271c67 thru 0x27b982 (0x9d1c bytes) 2024-09-21T15:09:38.582 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #28, image image_cluster1.client.mirror.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent29 2024-09-21T15:09:38.607 INFO:teuthology.orchestra.run.smithi161.stdout:4452 write 0x8ffe61d thru 0x900702e (0x8a12 bytes) 2024-09-21T15:09:38.637 INFO:teuthology.orchestra.run.smithi161.stdout:4632 read 0xf727ae thru 0xf7e967 (0xc1ba bytes) 2024-09-21T15:09:38.638 INFO:teuthology.orchestra.run.smithi161.stdout:4633 punch from 0x1ce2604 to 0x1ce2a01, (0x3fd bytes) 2024-09-21T15:09:38.638 INFO:teuthology.orchestra.run.smithi161.stdout:4634 punch from 0xe29344 to 0xe2c3ad, (0x3069 bytes) 2024-09-21T15:09:38.638 INFO:teuthology.orchestra.run.smithi161.stdout:4637 read 0x6a9ae9 thru 0x6b0090 (0x65a8 bytes) 2024-09-21T15:09:38.643 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:38.643 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:38.643 INFO:teuthology.orchestra.run.smithi161.stdout:4457 read 0x1f864e5 thru 0x1f92eea (0xca06 bytes) 2024-09-21T15:09:38.645 INFO:teuthology.orchestra.run.smithi161.stdout:3855 write 0x9e2bd24 thru 0x9e2e7cd (0x2aaa bytes) 2024-09-21T15:09:38.647 INFO:teuthology.orchestra.run.smithi161.stdout:4458 trunc from 0xeab8da4 to 0xdbb1767 2024-09-21T15:09:38.683 INFO:teuthology.orchestra.run.smithi161.stdout:3856 trunc from 0x9e2e7ce to 0x967436c 2024-09-21T15:09:38.697 INFO:teuthology.orchestra.run.smithi161.stdout:4695 write 0x568ab7b thru 0x569356a (0x89f0 bytes) 2024-09-21T15:09:38.698 INFO:teuthology.orchestra.run.smithi161.stdout:4638 write 0x2b1b7d5 thru 0x2b29ab2 (0xe2de bytes) 2024-09-21T15:09:38.710 INFO:teuthology.orchestra.run.smithi161.stdout:4460 write 0x655aa76 thru 0x655fee6 (0x5471 bytes) 2024-09-21T15:09:38.723 INFO:teuthology.orchestra.run.smithi161.stdout:4696 trunc from 0x569356b to 0x5a5a2f7 2024-09-21T15:09:38.724 INFO:teuthology.orchestra.run.smithi161.stdout:4640 read 0x28850cb thru 0x2892126 (0xd05c bytes) 2024-09-21T15:09:38.730 INFO:teuthology.orchestra.run.smithi161.stdout:4461 writesame 0x77b5d46 thru 0x77b9635 data_size 0x8(0x38f0 bytes) 2024-09-21T15:09:38.740 INFO:teuthology.orchestra.run.smithi161.stdout:4463 write 0xae57c43 thru 0xae665c3 (0xe981 bytes) 2024-09-21T15:09:38.747 INFO:teuthology.orchestra.run.smithi161.stdout:3858 punch from 0x22242a2 to 0x222b0d1, (0x6e2f bytes) 2024-09-21T15:09:38.747 INFO:teuthology.orchestra.run.smithi161.stdout:3861 read 0x8768f80 thru 0x876b01e (0x209f bytes) 2024-09-21T15:09:38.747 INFO:teuthology.orchestra.run.smithi161.stdout:3862 clone 36 order 25 su 8388608 sc 6 2024-09-21T15:09:38.757 INFO:teuthology.orchestra.run.smithi161.stdout:4465 write 0x1411d6d thru 0x1414a95 (0x2d29 bytes) 2024-09-21T15:09:38.775 INFO:teuthology.orchestra.run.smithi161.stdout:4697 read 0x589308a thru 0x58a2fc0 (0xff37 bytes) 2024-09-21T15:09:38.775 INFO:teuthology.orchestra.run.smithi161.stdout:4698 write 0x345797e thru 0x345dba6 (0x6229 bytes) 2024-09-21T15:09:38.781 INFO:teuthology.orchestra.run.smithi161.stdout:4641 write 0x5018d27 thru 0x502355a (0xa834 bytes) 2024-09-21T15:09:38.808 INFO:teuthology.orchestra.run.smithi161.stdout:4642 punch from 0x14e12c3 to 0x14e763b, (0x6378 bytes) 2024-09-21T15:09:38.808 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:38.808 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:38.808 INFO:teuthology.orchestra.run.smithi161.stdout:4646 read 0x4d825a1 thru 0x4d88f6a (0x69ca bytes) 2024-09-21T15:09:38.808 INFO:teuthology.orchestra.run.smithi161.stdout:4647 read 0x4a5227f thru 0x4a5d0d6 (0xae58 bytes) 2024-09-21T15:09:38.808 INFO:teuthology.orchestra.run.smithi161.stdout:4699 trunc from 0x5a5a2f7 to 0xa0bf725 2024-09-21T15:09:38.809 INFO:teuthology.orchestra.run.smithi161.stdout:4649 trunc from 0x502355b to 0x57ec556 2024-09-21T15:09:38.810 INFO:teuthology.orchestra.run.smithi161.stdout:3338 read 0x7336682 thru 0x733de03 (0x7782 bytes) 2024-09-21T15:09:38.811 INFO:teuthology.orchestra.run.smithi161.stdout:4467 write 0x9ac7cf4 thru 0x9acfb9e (0x7eab bytes) 2024-09-21T15:09:38.812 INFO:teuthology.orchestra.run.smithi161.stdout:4532 write 0x5541115 thru 0x5548eba (0x7da6 bytes) 2024-09-21T15:09:38.813 INFO:teuthology.orchestra.run.smithi161.stdout:3341 clone 41 order 21 su 16384 sc 13 2024-09-21T15:09:38.826 INFO:teuthology.orchestra.run.smithi161.stdout:4468 write 0x3c41831 thru 0x3c43c14 (0x23e4 bytes) 2024-09-21T15:09:38.844 INFO:teuthology.orchestra.run.smithi161.stdout:4469 read 0xd7c24ab thru 0xd7d0b74 (0xe6ca bytes) 2024-09-21T15:09:38.847 INFO:teuthology.orchestra.run.smithi161.stdout:4700 writesame 0x89ff0fa thru 0x8a0327b data_size 0x56(0x4182 bytes) 2024-09-21T15:09:38.858 INFO:teuthology.orchestra.run.smithi161.stdout:4650 read 0x25181c8 thru 0x251e8e5 (0x671e bytes) 2024-09-21T15:09:38.885 INFO:teuthology.orchestra.run.smithi161.stdout:4533 punch from 0x8d43a1b to 0x8d46371, (0x2956 bytes) 2024-09-21T15:09:38.885 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:38.886 INFO:teuthology.orchestra.run.smithi161.stdout:4536 punch from 0x35caaf9 to 0x35d67ca, (0xbcd1 bytes) 2024-09-21T15:09:38.887 INFO:teuthology.orchestra.run.smithi161.stdout:4470 trunc from 0xdbb1767 to 0x393cabb 2024-09-21T15:09:38.891 INFO:teuthology.orchestra.run.smithi161.stdout:4703 trunc from 0xa0bf725 to 0x14b148f 2024-09-21T15:09:38.898 INFO:teuthology.orchestra.run.smithi161.stdout:4652 writesame 0x79a252c thru 0x79b13cb data_size 0x5c(0xeea0 bytes) 2024-09-21T15:09:38.926 INFO:teuthology.orchestra.run.smithi161.stdout:4538 write 0xad40493 thru 0xad4fb49 (0xf6b7 bytes) 2024-09-21T15:09:38.950 INFO:teuthology.orchestra.run.smithi161.stdout:4539 write 0x56059bd thru 0x560c6cf (0x6d13 bytes) 2024-09-21T15:09:38.961 INFO:teuthology.orchestra.run.smithi161.stdout:4653 writesame 0xe10df9b thru 0xe11aa6c data_size 0xd(0xcad2 bytes) 2024-09-21T15:09:38.963 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:38.963 INFO:teuthology.orchestra.run.smithi161.stdout:4657 write 0x16f06c1 thru 0x16fea58 (0xe398 bytes) 2024-09-21T15:09:38.986 INFO:teuthology.orchestra.run.smithi161.stdout:4658 writesame 0xafb1ef2 thru 0xafb5b4e data_size 0x33(0x3c5d bytes) 2024-09-21T15:09:38.991 INFO:teuthology.orchestra.run.smithi161.stdout:4471 trunc from 0x393cabb to 0xe5f7fbb 2024-09-21T15:09:39.003 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.003 INFO:teuthology.orchestra.run.smithi161.stdout:4660 read 0xac51d71 thru 0xac57bf7 (0x5e87 bytes) 2024-09-21T15:09:39.004 INFO:teuthology.orchestra.run.smithi161.stdout:4541 write 0xc941c84 thru 0xc94ba66 (0x9de3 bytes) 2024-09-21T15:09:39.004 INFO:teuthology.orchestra.run.smithi161.stdout:4661 write 0x3cbef3b thru 0x3cc2c75 (0x3d3b bytes) 2024-09-21T15:09:39.022 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.019+0000 7f1e9c77a700 -1 reset not still connected to 0x562899844b60 2024-09-21T15:09:39.022 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.019+0000 7f1e9c77a700 -1 reset not still connected to 0x562899b8f5f0 2024-09-21T15:09:39.022 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.019+0000 7f1e9c77a700 -1 reset not still connected to 0x56289e304750 2024-09-21T15:09:39.041 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.044 INFO:teuthology.orchestra.run.smithi161.stdout:4662 write 0x930222 thru 0x93d7f5 (0xd5d4 bytes) 2024-09-21T15:09:39.047 INFO:teuthology.orchestra.run.smithi161.stdout:4704 writesame 0xcab661f thru 0xcac20a9 data_size 0x1(0xba8b bytes) 2024-09-21T15:09:39.052 INFO:teuthology.orchestra.run.smithi161.stdout:4472 write 0xe2a93d0 thru 0xe2b01bc (0x6ded bytes) 2024-09-21T15:09:39.054 INFO:teuthology.orchestra.run.smithi161.stdout:4705 read 0x12d4863 thru 0x12de748 (0x9ee6 bytes) 2024-09-21T15:09:39.054 INFO:teuthology.orchestra.run.smithi161.stdout:4706 read 0x9955369 thru 0x9964718 (0xf3b0 bytes) 2024-09-21T15:09:39.055 INFO:teuthology.orchestra.run.smithi161.stdout:4707 punch from 0x1ec56ec to 0x1ecef01, (0x9815 bytes) 2024-09-21T15:09:39.055 INFO:teuthology.orchestra.run.smithi161.stdout:4709 punch from 0xa011d96 to 0xa01d087, (0xb2f1 bytes) 2024-09-21T15:09:39.055 INFO:teuthology.orchestra.run.smithi161.stdout:4710 write 0x5c6a93b thru 0x5c73a50 (0x9116 bytes) 2024-09-21T15:09:39.056 INFO:teuthology.orchestra.run.smithi161.stdout:4543 trunc from 0xc94ba67 to 0x5e6f11e 2024-09-21T15:09:39.059 INFO:teuthology.orchestra.run.smithi161.stdout:4663 write 0x96282d7 thru 0x9631194 (0x8ebe bytes) 2024-09-21T15:09:39.074 INFO:teuthology.orchestra.run.smithi161.stdout:4473 write 0x3961611 thru 0x396e8ea (0xd2da bytes) 2024-09-21T15:09:39.075 INFO:teuthology.orchestra.run.smithi161.stdout:4711 flatten 2024-09-21T15:09:39.094 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.094 INFO:teuthology.orchestra.run.smithi161.stdout:4476 read 0x9439959 thru 0x943d773 (0x3e1b bytes) 2024-09-21T15:09:39.095 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.095 INFO:teuthology.orchestra.run.smithi161.stdout:4478 read 0x1b3589a thru 0x1b3a1cd (0x4934 bytes) 2024-09-21T15:09:39.096 INFO:teuthology.orchestra.run.smithi161.stdout:4480 write 0xd4c8491 thru 0xd4d6766 (0xe2d6 bytes) 2024-09-21T15:09:39.099 INFO:teuthology.orchestra.run.smithi161.stdout:4665 trunc from 0xe11aa6d to 0x544a0e2 2024-09-21T15:09:39.125 INFO:teuthology.orchestra.run.smithi161.stdout:4481 write 0x327e3af thru 0x327fb27 (0x1779 bytes) 2024-09-21T15:09:39.142 INFO:teuthology.orchestra.run.smithi161.stdout:4482 writesame 0xb7e753a thru 0xb7ea845 data_size 0x6(0x330c bytes) 2024-09-21T15:09:39.150 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.150 INFO:teuthology.orchestra.run.smithi161.stdout:4546 read 0x1e82bc4 thru 0x1e85a03 (0x2e40 bytes) 2024-09-21T15:09:39.157 INFO:teuthology.orchestra.run.smithi161.stdout:4483 read 0xcedfdc0 thru 0xcee3944 (0x3b85 bytes) 2024-09-21T15:09:39.157 INFO:teuthology.orchestra.run.smithi161.stdout:4484 write 0x88efa93 thru 0x88efeb4 (0x422 bytes) 2024-09-21T15:09:39.162 INFO:teuthology.orchestra.run.smithi161.stdout:4712 read 0x9cb9035 thru 0x9cc73fe (0xe3ca bytes) 2024-09-21T15:09:39.162 INFO:teuthology.orchestra.run.smithi161.stdout:4713 read 0xa1c8ffe thru 0xa1d6812 (0xd815 bytes) 2024-09-21T15:09:39.163 INFO:teuthology.orchestra.run.smithi161.stdout:4714 read 0x25c9dc4 thru 0x25d7740 (0xd97d bytes) 2024-09-21T15:09:39.163 INFO:teuthology.orchestra.run.smithi161.stdout:4715 punch from 0x344311d to 0x344d3e6, (0xa2c9 bytes) 2024-09-21T15:09:39.163 INFO:teuthology.orchestra.run.smithi161.stdout:4716 read 0xb0ecee2 thru 0xb0f21b8 (0x52d7 bytes) 2024-09-21T15:09:39.163 INFO:teuthology.orchestra.run.smithi161.stdout:4717 read 0x4632319 thru 0x463628a (0x3f72 bytes) 2024-09-21T15:09:39.164 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.164 INFO:teuthology.orchestra.run.smithi161.stdout:4720 write 0x21f1610 thru 0x21fd934 (0xc325 bytes) 2024-09-21T15:09:39.175 INFO:teuthology.orchestra.run.smithi161.stdout:4485 read 0xc4f9e98 thru 0xc4fb1d1 (0x133a bytes) 2024-09-21T15:09:39.175 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.175 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.175 INFO:teuthology.orchestra.run.smithi161.stdout:4488 read 0x2a40e05 thru 0x2a49194 (0x8390 bytes) 2024-09-21T15:09:39.176 INFO:teuthology.orchestra.run.smithi161.stdout:4489 writesame 0x20df512 thru 0x20e2fdc data_size 0x1d(0x3acb bytes) 2024-09-21T15:09:39.181 INFO:teuthology.orchestra.run.smithi161.stdout:4548 write 0x720c91c thru 0x7215ee5 (0x95ca bytes) 2024-09-21T15:09:39.183 INFO:teuthology.orchestra.run.smithi161.stdout:4721 write 0x31dd9a8 thru 0x31ed549 (0xfba2 bytes) 2024-09-21T15:09:39.186 INFO:teuthology.orchestra.run.smithi161.stdout:4490 write 0x210eb99 thru 0x211844a (0x98b2 bytes) 2024-09-21T15:09:39.199 INFO:teuthology.orchestra.run.smithi161.stdout:4492 write 0x3bde44d thru 0x3bde821 (0x3d5 bytes) 2024-09-21T15:09:39.199 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.199 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.199 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.199 INFO:teuthology.orchestra.run.smithi161.stdout:4553 write 0x23e650b thru 0x23e8af4 (0x25ea bytes) 2024-09-21T15:09:39.207 INFO:teuthology.orchestra.run.smithi161.stdout:4493 writesame 0x5788cb2 thru 0x578fd26 data_size 0x1(0x7075 bytes) 2024-09-21T15:09:39.215 INFO:teuthology.orchestra.run.smithi161.stdout:4666 write 0xaae1ece thru 0xaae8138 (0x626b bytes) 2024-09-21T15:09:39.241 INFO:teuthology.orchestra.run.smithi161.stdout:4496 read 0x9a1bf73 thru 0x9a2496e (0x89fc bytes) 2024-09-21T15:09:39.241 INFO:teuthology.orchestra.run.smithi161.stdout:4497 read 0x643b08 thru 0x64f97b (0xbe74 bytes) 2024-09-21T15:09:39.242 INFO:teuthology.orchestra.run.smithi161.stdout:4498 writesame 0xe03c98d thru 0xe03e386 data_size 0xe(0x19fa bytes) 2024-09-21T15:09:39.245 INFO:teuthology.orchestra.run.smithi161.stdout:4725 write 0xe325302 thru 0xe330da2 (0xbaa1 bytes) 2024-09-21T15:09:39.259 INFO:teuthology.orchestra.run.smithi161.stdout:4499 writesame 0x8e1bfda thru 0x8e2b937 data_size 0x3b(0xf95e bytes) 2024-09-21T15:09:39.261 INFO:teuthology.orchestra.run.smithi161.stdout:4728 writesame 0x7ab4a50 thru 0x7abc1f9 data_size 0x35(0x77aa bytes) 2024-09-21T15:09:39.274 INFO:teuthology.orchestra.run.smithi161.stdout:4502 write 0x159bce1 thru 0x15a666a (0xa98a bytes) 2024-09-21T15:09:39.278 INFO:teuthology.orchestra.run.smithi161.stdout:4729 write 0x5407886 thru 0x5407dc3 (0x53e bytes) 2024-09-21T15:09:39.288 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.288 INFO:teuthology.orchestra.run.smithi161.stdout:4555 read 0x6d1af8a thru 0x6d1f972 (0x49e9 bytes) 2024-09-21T15:09:39.289 INFO:teuthology.orchestra.run.smithi161.stdout:4556 read 0x49c98a2 thru 0x49ccd94 (0x34f3 bytes) 2024-09-21T15:09:39.289 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.292 INFO:teuthology.orchestra.run.smithi161.stdout:4731 punch from 0x88c8bab to 0x88cc1e3, (0x3638 bytes) 2024-09-21T15:09:39.293 INFO:teuthology.orchestra.run.smithi161.stdout:4732 read 0x7917268 thru 0x791c067 (0x4e00 bytes) 2024-09-21T15:09:39.304 INFO:teuthology.orchestra.run.smithi161.stdout:4668 writesame 0xc4800bd thru 0xc4900a7 data_size 0x1(0xffeb bytes) 2024-09-21T15:09:39.305 INFO:teuthology.orchestra.run.smithi161.stdout:4734 trunc from 0xe330da3 to 0xa894c4c 2024-09-21T15:09:39.308 INFO:teuthology.orchestra.run.smithi161.stdout:4669 writesame 0xa78c41d thru 0xa78da08 data_size 0x2e(0x15ec bytes) 2024-09-21T15:09:39.314 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.314 INFO:teuthology.orchestra.run.smithi161.stdout:4671 writesame 0xaabfbb6 thru 0xaacd57b data_size 0x32(0xd9c6 bytes) 2024-09-21T15:09:39.324 INFO:teuthology.orchestra.run.smithi161.stdout:4503 write 0xa248b50 thru 0xa2564cd (0xd97e bytes) 2024-09-21T15:09:39.333 INFO:teuthology.orchestra.run.smithi161.stdout:4672 write 0x5ca2d9e thru 0x5cace88 (0xa0eb bytes) 2024-09-21T15:09:39.334 INFO:teuthology.orchestra.run.smithi161.stdout:4558 writesame 0xb423a52 thru 0xb42b8ff data_size 0x5e(0x7eae bytes) 2024-09-21T15:09:39.340 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.340 INFO:teuthology.orchestra.run.smithi161.stdout:4561 read 0x89eaf3f thru 0x89f1c38 (0x6cfa bytes) 2024-09-21T15:09:39.340 INFO:teuthology.orchestra.run.smithi161.stdout:4562 write 0x4ec4567 thru 0x4eca5e6 (0x6080 bytes) 2024-09-21T15:09:39.345 INFO:teuthology.orchestra.run.smithi161.stdout:4504 writesame 0x3f4adfc thru 0x3f59ba5 data_size 0x1d(0xedaa bytes) 2024-09-21T15:09:39.358 INFO:teuthology.orchestra.run.smithi161.stdout:4505 write 0xc6a1573 thru 0xc6aad61 (0x97ef bytes) 2024-09-21T15:09:39.359 INFO:teuthology.orchestra.run.smithi161.stdout:4735 read 0x2da2aeb thru 0x2daf03b (0xc551 bytes) 2024-09-21T15:09:39.359 INFO:teuthology.orchestra.run.smithi161.stdout:4736 read 0x7335ac8 thru 0x73448c1 (0xedfa bytes) 2024-09-21T15:09:39.360 INFO:teuthology.orchestra.run.smithi161.stdout:4738 read 0x3c54f11 thru 0x3c6281a (0xd90a bytes) 2024-09-21T15:09:39.360 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.360 INFO:teuthology.orchestra.run.smithi161.stdout:4740 writesame 0x75505bd thru 0x755bb67 data_size 0x1(0xb5ab bytes) 2024-09-21T15:09:39.363 INFO:teuthology.orchestra.run.smithi161.stdout:4563 write 0xab6311 thru 0xabd217 (0x6f07 bytes) 2024-09-21T15:09:39.365 INFO:teuthology.orchestra.run.smithi161.stdout:4674 trunc from 0xc4900a8 to 0x5b0ba12 2024-09-21T15:09:39.370 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.371 INFO:teuthology.orchestra.run.smithi161.stdout:4507 punch from 0xd942f7 to 0xd99403, (0x510c bytes) 2024-09-21T15:09:39.371 INFO:teuthology.orchestra.run.smithi161.stdout:4508 punch from 0x8142a24 to 0x814aee3, (0x84bf bytes) 2024-09-21T15:09:39.371 INFO:teuthology.orchestra.run.smithi161.stdout:4509 writesame 0x371b892 thru 0x37212d7 data_size 0x5(0x5a46 bytes) 2024-09-21T15:09:39.416 INFO:teuthology.orchestra.run.smithi161.stdout:4742 read 0x5cde135 thru 0x5ce7cc8 (0x9b94 bytes) 2024-09-21T15:09:39.417 INFO:teuthology.orchestra.run.smithi161.stdout:4743 writesame 0x996d878 thru 0x996fb84 data_size 0x3(0x230d bytes) 2024-09-21T15:09:39.453 INFO:teuthology.orchestra.run.smithi161.stdout:4510 write 0xe73a797 thru 0xe7474f2 (0xcd5c bytes) 2024-09-21T15:09:39.457 INFO:teuthology.orchestra.run.smithi161.stdout:4744 trunc from 0xa894c4c to 0x79aca5f 2024-09-21T15:09:39.471 INFO:teuthology.orchestra.run.smithi161.stdout:4511 punch from 0x3661d31 to 0x36711c7, (0xf496 bytes) 2024-09-21T15:09:39.472 INFO:teuthology.orchestra.run.smithi161.stdout:4512 write 0xa61aec8 thru 0xa629588 (0xe6c1 bytes) 2024-09-21T15:09:39.489 INFO:teuthology.orchestra.run.smithi161.stdout:4513 read 0x533b42c thru 0x53411f6 (0x5dcb bytes) 2024-09-21T15:09:39.489 INFO:teuthology.orchestra.run.smithi161.stdout:4514 read 0x1436d18 thru 0x143db5d (0x6e46 bytes) 2024-09-21T15:09:39.507 INFO:teuthology.orchestra.run.smithi161.stdout:4515 read 0xa51bcb3 thru 0xa51d77f (0x1acd bytes) 2024-09-21T15:09:39.507 INFO:teuthology.orchestra.run.smithi161.stdout:4516 read 0x2cf99ef thru 0x2d0545a (0xba6c bytes) 2024-09-21T15:09:39.508 INFO:teuthology.orchestra.run.smithi161.stdout:4518 writesame 0x89764b0 thru 0x8985e6e data_size 0x1(0xf9bf bytes) 2024-09-21T15:09:39.515 INFO:teuthology.orchestra.run.smithi161.stdout:4676 write 0x2e2ec77 thru 0x2e388a4 (0x9c2e bytes) 2024-09-21T15:09:39.528 INFO:teuthology.orchestra.run.smithi161.stdout:4677 read 0x68f7df thru 0x69f29b (0xfabd bytes) 2024-09-21T15:09:39.529 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.529 INFO:teuthology.orchestra.run.smithi161.stdout:4679 read 0x272aca4 thru 0x272c5e6 (0x1943 bytes) 2024-09-21T15:09:39.549 INFO:teuthology.orchestra.run.smithi161.stdout:4680 trunc from 0x5b0ba12 to 0xead7fb1 2024-09-21T15:09:39.561 INFO:teuthology.orchestra.run.smithi161.stdout:4520 punch from 0xd0c01d to 0xd116f2, (0x56d5 bytes) 2024-09-21T15:09:39.562 INFO:teuthology.orchestra.run.smithi161.stdout:4521 read 0x229e292 thru 0x22a92cf (0xb03e bytes) 2024-09-21T15:09:39.562 INFO:teuthology.orchestra.run.smithi161.stdout:4522 write 0x254de8f thru 0x2553046 (0x51b8 bytes) 2024-09-21T15:09:39.570 INFO:teuthology.orchestra.run.smithi161.stdout:4745 write 0xac9cb48 thru 0xaca2ddc (0x6295 bytes) 2024-09-21T15:09:39.585 INFO:teuthology.orchestra.run.smithi161.stdout:4746 write 0x14bbe3d thru 0x14c4ab6 (0x8c7a bytes) 2024-09-21T15:09:39.587 INFO:teuthology.orchestra.run.smithi161.stdout:4566 read 0x8991121 thru 0x899c5f5 (0xb4d5 bytes) 2024-09-21T15:09:39.587 INFO:teuthology.orchestra.run.smithi161.stdout:4567 read 0x459b7b0 thru 0x45a81c4 (0xca15 bytes) 2024-09-21T15:09:39.588 INFO:teuthology.orchestra.run.smithi161.stdout:4523 writesame 0xbe99c30 thru 0xbe9b28f data_size 0x10(0x1660 bytes) 2024-09-21T15:09:39.597 INFO:teuthology.orchestra.run.smithi161.stdout:4747 trunc from 0xaca2ddd to 0x9fb3635 2024-09-21T15:09:39.599 INFO:teuthology.orchestra.run.smithi161.stdout:4524 writesame 0x9fe116 thru 0xa0c0fc data_size 0x1f(0xdfe7 bytes) 2024-09-21T15:09:39.618 INFO:teuthology.orchestra.run.smithi161.stdout:4681 trunc from 0xead7fb1 to 0x22e5c6a 2024-09-21T15:09:39.628 INFO:teuthology.orchestra.run.smithi161.stdout:4568 write 0xca72815 thru 0xca7bc40 (0x942c bytes) 2024-09-21T15:09:39.652 INFO:teuthology.orchestra.run.smithi161.stdout:4569 read 0x11f8551 thru 0x1207a21 (0xf4d1 bytes) 2024-09-21T15:09:39.652 INFO:teuthology.orchestra.run.smithi161.stdout:4525 write 0xc47eea2 thru 0xc48d352 (0xe4b1 bytes) 2024-09-21T15:09:39.661 INFO:teuthology.orchestra.run.smithi161.stdout:4570 clone 31 order 21 su 131072 sc 6 2024-09-21T15:09:39.668 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.668 INFO:teuthology.orchestra.run.smithi161.stdout:4751 write 0x8ed0c3c thru 0x8ed0f2d (0x2f2 bytes) 2024-09-21T15:09:39.682 INFO:teuthology.orchestra.run.smithi161.stdout:4526 read 0x73f57d thru 0x740076 (0xafa bytes) 2024-09-21T15:09:39.684 INFO:teuthology.orchestra.run.smithi161.stdout:4527 write 0x170d424 thru 0x171ba33 (0xe610 bytes) 2024-09-21T15:09:39.694 INFO:teuthology.orchestra.run.smithi161.stdout:4528 read 0x409746b thru 0x409b337 (0x3ecd bytes) 2024-09-21T15:09:39.695 INFO:teuthology.orchestra.run.smithi161.stdout:4530 write 0xc49ee85 thru 0xc4aa70d (0xb889 bytes) 2024-09-21T15:09:39.703 INFO:teuthology.orchestra.run.smithi161.stdout:4531 write 0x21f5a70 thru 0x2202fbc (0xd54d bytes) 2024-09-21T15:09:39.716 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:39.727 INFO:teuthology.orchestra.run.smithi161.stdout:4752 write 0xd29c6d9 thru 0xd2a931c (0xcc44 bytes) 2024-09-21T15:09:39.732 INFO:teuthology.orchestra.run.smithi161.stdout:4534 trunc from 0xe7474f3 to 0x4da345c 2024-09-21T15:09:39.742 INFO:teuthology.orchestra.run.smithi161.stdout:4683 write 0xc7ee844 thru 0xc7f6916 (0x80d3 bytes) 2024-09-21T15:09:39.766 INFO:teuthology.orchestra.run.smithi161.stdout:4753 trunc from 0xd2a931d to 0x55f0cc9 2024-09-21T15:09:39.814 INFO:teuthology.orchestra.run.smithi161.stdout:4685 write 0xe00ea69 thru 0xe01d88b (0xee23 bytes) 2024-09-21T15:09:39.815 INFO:teuthology.orchestra.run.smithi161.stdout:4535 write 0x1e5ac56 thru 0x1e6888c (0xdc37 bytes) 2024-09-21T15:09:39.841 INFO:teuthology.orchestra.run.smithi161.stdout:4687 trunc from 0xe01d88c to 0xdc7e39f 2024-09-21T15:09:39.885 INFO:teuthology.orchestra.run.smithi161.stdout:4537 writesame 0x542fcb1 thru 0x5437295 data_size 0x1(0x75e5 bytes) 2024-09-21T15:09:39.890 INFO:teuthology.orchestra.run.smithi161.stdout:4754 write 0xa474e15 thru 0xa481cff (0xceeb bytes) 2024-09-21T15:09:39.893 INFO:teuthology.orchestra.run.smithi161.stdout:4539 punch from 0x7bdfe7 to 0x7c65c8, (0x85e1 bytes) 2024-09-21T15:09:39.912 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.907+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c23cea0 2024-09-21T15:09:39.912 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.907+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c23d6c0 2024-09-21T15:09:39.912 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.907+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c888f70 2024-09-21T15:09:39.912 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.907+0000 7f1e9c77a700 -1 reset not still connected to 0x56287cb1c0d0 2024-09-21T15:09:39.912 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.907+0000 7f1e9c77a700 -1 reset not still connected to 0x56287ce70000 2024-09-21T15:09:39.912 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.907+0000 7f1e9c77a700 -1 reset not still connected to 0x56287dbf48f0 2024-09-21T15:09:39.913 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.907+0000 7f1e9c77a700 -1 reset not still connected to 0x5628828a7ba0 2024-09-21T15:09:39.913 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.907+0000 7f1e9c77a700 -1 reset not still connected to 0x562889a48750 2024-09-21T15:09:39.913 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x562889a931e0 2024-09-21T15:09:39.914 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x56288c584340 2024-09-21T15:09:39.915 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x56288edfc9c0 2024-09-21T15:09:39.915 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f3264e0 2024-09-21T15:09:39.915 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f958270 2024-09-21T15:09:39.915 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f959ba0 2024-09-21T15:09:39.915 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x562890034680 2024-09-21T15:09:39.915 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x562890035520 2024-09-21T15:09:39.915 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x5628908044e0 2024-09-21T15:09:39.916 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x562890805d40 2024-09-21T15:09:39.916 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x56289097b110 2024-09-21T15:09:39.916 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x562890d15860 2024-09-21T15:09:39.916 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x5628937f24e0 2024-09-21T15:09:39.916 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5930 2024-09-21T15:09:39.916 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.911+0000 7f1e9c77a700 -1 reset not still connected to 0x562899844b60 2024-09-21T15:09:39.921 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.919+0000 7f1e9c77a700 -1 reset not still connected to 0x562899b8f5f0 2024-09-21T15:09:39.921 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.919+0000 7f1e9c77a700 -1 reset not still connected to 0x56289cc5f5f0 2024-09-21T15:09:39.921 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:39.919+0000 7f1e9c77a700 -1 reset not still connected to 0x56289e304750 2024-09-21T15:09:39.934 INFO:teuthology.orchestra.run.smithi161.stdout:4689 read 0x23f8127 thru 0x23ff87c (0x7756 bytes) 2024-09-21T15:09:39.935 INFO:teuthology.orchestra.run.smithi161.stdout:4690 read 0x817a24a thru 0x81871a4 (0xcf5b bytes) 2024-09-21T15:09:39.935 INFO:teuthology.orchestra.run.smithi161.stdout:4691 writesame 0xa81ee0 thru 0xa8f206 data_size 0x13(0xd327 bytes) 2024-09-21T15:09:39.952 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone40 from 0xce3a959 (overlap 0xce3a959) to 0x527dd56 2024-09-21T15:09:39.955 INFO:teuthology.orchestra.run.smithi161.stdout:4758 trunc from 0xa481d00 to 0xecb833d 2024-09-21T15:09:39.959 INFO:teuthology.orchestra.run.smithi161.stdout:4540 writesame 0x59140ca thru 0x591ee65 data_size 0x52(0xad9c bytes) 2024-09-21T15:09:39.973 INFO:teuthology.orchestra.run.smithi161.stdout:4542 write 0x12b8801 thru 0x12be1fb (0x59fb bytes) 2024-09-21T15:09:39.990 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.4-clone35 2024-09-21T15:09:40.002 INFO:teuthology.orchestra.run.smithi161.stdout:4692 writesame 0xe2f6583 thru 0xe2ff9f2 data_size 0x98(0x9470 bytes) 2024-09-21T15:09:40.012 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:40.020 INFO:teuthology.orchestra.run.smithi161.stdout:4760 punch from 0x734a7af to 0x7351c5d, (0x74ae bytes) 2024-09-21T15:09:40.020 INFO:teuthology.orchestra.run.smithi161.stdout:4761 punch from 0xbb4438 to 0xbb5c1d, (0x17e5 bytes) 2024-09-21T15:09:40.020 INFO:teuthology.orchestra.run.smithi161.stdout:4764 punch from 0x89a851 to 0x8a8c5e, (0xe40d bytes) 2024-09-21T15:09:40.021 INFO:teuthology.orchestra.run.smithi161.stdout:4765 read 0x7f550c5 thru 0x7f5c600 (0x753c bytes) 2024-09-21T15:09:40.043 INFO:teuthology.orchestra.run.smithi161.stdout:4543 writesame 0x9618997 thru 0x962333a data_size 0x16(0xa9a4 bytes) 2024-09-21T15:09:40.048 INFO:teuthology.orchestra.run.smithi161.stdout:4544 read 0x366a816 thru 0x36760d9 (0xb8c4 bytes) 2024-09-21T15:09:40.052 INFO:teuthology.orchestra.run.smithi161.stdout:4545 trunc from 0x962333b to 0x843896b 2024-09-21T15:09:40.074 INFO:teuthology.orchestra.run.smithi161.stdout:4694 trunc from 0xe2ff9f3 to 0x438f52 2024-09-21T15:09:40.087 INFO:teuthology.orchestra.run.smithi161.stdout:4766 trunc from 0xecb833d to 0xe2ba90 2024-09-21T15:09:40.293 INFO:teuthology.orchestra.run.smithi161.stdout:4768 punch from 0x55dd06 to 0x561a5e, (0x3d58 bytes) 2024-09-21T15:09:40.293 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:40.298 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:40.298 INFO:teuthology.orchestra.run.smithi161.stdout:4547 read 0x239c98a thru 0x23a89ce (0xc045 bytes) 2024-09-21T15:09:40.360 INFO:teuthology.orchestra.run.smithi161.stdout:4771 writesame 0x636e49e thru 0x6377943 data_size 0x2(0x94a6 bytes) 2024-09-21T15:09:40.366 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:40.366 INFO:teuthology.orchestra.run.smithi161.stdout:4773 write 0x5dc6436 thru 0x5dd1fca (0xbb95 bytes) 2024-09-21T15:09:40.386 INFO:teuthology.orchestra.run.smithi161.stdout:4695 writesame 0x9979690 thru 0x9987188 data_size 0x1(0xdaf9 bytes) 2024-09-21T15:09:40.389 INFO:teuthology.orchestra.run.smithi161.stdout:4697 write 0x61ae75c thru 0x61b3e54 (0x56f9 bytes) 2024-09-21T15:09:40.419 INFO:teuthology.orchestra.run.smithi161.stdout:4775 punch from 0x205714e to 0x206429c, (0xd14e bytes) 2024-09-21T15:09:40.419 INFO:teuthology.orchestra.run.smithi161.stdout:4776 read 0xb0b2a4 thru 0xb16995 (0xb6f2 bytes) 2024-09-21T15:09:40.419 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:40.476 INFO:teuthology.orchestra.run.smithi161.stdout:4698 write 0xccb372c thru 0xccbbc62 (0x8537 bytes) 2024-09-21T15:09:40.509 INFO:teuthology.orchestra.run.smithi161.stdout:4778 write 0xcabfabd thru 0xcacad9d (0xb2e1 bytes) 2024-09-21T15:09:40.510 INFO:teuthology.orchestra.run.smithi161.stdout:4699 write 0x7bbe0f8 thru 0x7bc5e85 (0x7d8e bytes) 2024-09-21T15:09:40.559 INFO:teuthology.orchestra.run.smithi161.stdout:4701 writesame 0xa2a8f6c thru 0xa2b3853 data_size 0x2f(0xa8e8 bytes) 2024-09-21T15:09:40.560 INFO:teuthology.orchestra.run.smithi161.stdout:4548 write 0xbfb8974 thru 0xbfb9ad3 (0x1160 bytes) 2024-09-21T15:09:40.571 INFO:teuthology.orchestra.run.smithi161.stdout:4702 read 0xe115af thru 0xe1a511 (0x8f63 bytes) 2024-09-21T15:09:40.576 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:40.576 INFO:teuthology.orchestra.run.smithi161.stdout:4706 write 0x5ba2c0a thru 0x5bb0c08 (0xdfff bytes) 2024-09-21T15:09:40.610 INFO:teuthology.orchestra.run.smithi161.stdout:4549 punch from 0x638c93e to 0x6391b26, (0x51e8 bytes) 2024-09-21T15:09:40.611 INFO:teuthology.orchestra.run.smithi161.stdout:4550 punch from 0xa28b9fa to 0xa2950a5, (0x96ab bytes) 2024-09-21T15:09:40.611 INFO:teuthology.orchestra.run.smithi161.stdout:4552 clone 30 order 18 su 8192 sc 14 2024-09-21T15:09:40.629 INFO:teuthology.orchestra.run.smithi161.stdout:4779 write 0x4ac68f8 thru 0x4acad2f (0x4438 bytes) 2024-09-21T15:09:40.640 INFO:teuthology.orchestra.run.smithi161.stdout:4707 writesame 0xe6779d3 thru 0xe681ac6 data_size 0x2(0xa0f4 bytes) 2024-09-21T15:09:40.650 INFO:teuthology.orchestra.run.smithi161.stdout:4780 read 0x7226edc thru 0x7234c02 (0xdd27 bytes) 2024-09-21T15:09:40.650 INFO:teuthology.orchestra.run.smithi161.stdout:4781 read 0x2c088c1 thru 0x2c14ef2 (0xc632 bytes) 2024-09-21T15:09:40.650 INFO:teuthology.orchestra.run.smithi161.stdout:4782 read 0x50a85b7 thru 0x50ab2b9 (0x2d03 bytes) 2024-09-21T15:09:40.651 INFO:teuthology.orchestra.run.smithi161.stdout:4785 read 0xadf4479 thru 0xadf62ec (0x1e74 bytes) 2024-09-21T15:09:40.651 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:40.651 INFO:teuthology.orchestra.run.smithi161.stdout:4789 punch from 0xac68b21 to 0xac6a819, (0x1cf8 bytes) 2024-09-21T15:09:40.651 INFO:teuthology.orchestra.run.smithi161.stdout:4793 punch from 0x7f0eaac to 0x7f17a11, (0x8f65 bytes) 2024-09-21T15:09:40.651 INFO:teuthology.orchestra.run.smithi161.stdout:4797 write 0xbc0de72 thru 0xbc0ff3c (0x20cb bytes) 2024-09-21T15:09:40.659 INFO:teuthology.orchestra.run.smithi161.stdout:4708 trunc from 0xe681ac7 to 0x6921c51 2024-09-21T15:09:40.674 INFO:teuthology.orchestra.run.smithi161.stdout:4798 read 0x84771f4 thru 0x8481d2c (0xab39 bytes) 2024-09-21T15:09:40.674 INFO:teuthology.orchestra.run.smithi161.stdout:4799 write 0x47f083d thru 0x47f1b58 (0x131c bytes) 2024-09-21T15:09:40.709 INFO:teuthology.orchestra.run.smithi161.stdout:4800 read 0x226c7d9 thru 0x227a067 (0xd88f bytes) 2024-09-21T15:09:40.713 INFO:teuthology.orchestra.run.smithi161.stdout:4801 trunc from 0xcacad9e to 0xea5d8c7 2024-09-21T15:09:40.809 INFO:teuthology.orchestra.run.smithi161.stdout:4802 read 0x2ee0f92 thru 0x2ee63ad (0x541c bytes) 2024-09-21T15:09:40.809 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:40.809 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:40.809 INFO:teuthology.orchestra.run.smithi161.stdout:4807 clone 30 order 22 su 1048576 sc 4 2024-09-21T15:09:40.841 INFO:teuthology.orchestra.run.smithi161.stdout:4709 write 0xc0d0734 thru 0xc0dec66 (0xe533 bytes) 2024-09-21T15:09:40.863 INFO:teuthology.orchestra.run.smithi161.stdout:4711 writesame 0x5ceb8dc thru 0x5cedfc9 data_size 0x21(0x26ee bytes) 2024-09-21T15:09:40.873 INFO:teuthology.orchestra.run.smithi161.stdout:4712 read 0x46f210 thru 0x47ecad (0xfa9e bytes) 2024-09-21T15:09:40.875 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:40.875 INFO:teuthology.orchestra.run.smithi161.stdout:4714 read 0x487624d thru 0x4884c6c (0xea20 bytes) 2024-09-21T15:09:40.876 INFO:teuthology.orchestra.run.smithi161.stdout:4715 trunc from 0xc0dec67 to 0xca37298 2024-09-21T15:09:40.907 INFO:teuthology.orchestra.run.smithi161.stdout:4716 punch from 0x55e101d to 0x55e4d16, (0x3cf9 bytes) 2024-09-21T15:09:40.927 INFO:teuthology.orchestra.run.smithi161.stdout:4718 trunc from 0xca37298 to 0x1c67572 2024-09-21T15:09:40.950 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone30 from 0xca7bc41 (overlap 0x5e6f11e) to 0x54fd901 2024-09-21T15:09:41.006 INFO:teuthology.orchestra.run.smithi161.stdout:4719 writesame 0x4278346 thru 0x4284227 data_size 0x35(0xbee2 bytes) 2024-09-21T15:09:41.009 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #34, image image_cluster1.client.mirror.4-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent35 2024-09-21T15:09:41.051 INFO:teuthology.orchestra.run.smithi161.stdout:4720 write 0xad66648 thru 0xad760bc (0xfa75 bytes) 2024-09-21T15:09:41.081 INFO:teuthology.orchestra.run.smithi161.stdout:4721 writesame 0x6ae7cd4 thru 0x6af1f5f data_size 0x4(0xa28c bytes) 2024-09-21T15:09:41.100 INFO:teuthology.orchestra.run.smithi161.stdout:4722 write 0x6d9d4b thru 0x6e91b4 (0xf46a bytes) 2024-09-21T15:09:41.105 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.5-clone29 2024-09-21T15:09:41.113 INFO:teuthology.orchestra.run.smithi161.stdout:4723 write 0xa932f4d thru 0xa93f33c (0xc3f0 bytes) 2024-09-21T15:09:41.128 INFO:teuthology.orchestra.run.smithi161.stdout:4724 write 0x851e8a4 thru 0x851f41f (0xb7c bytes) 2024-09-21T15:09:41.137 INFO:teuthology.orchestra.run.smithi161.stdout:4726 punch from 0x4c4c3ea to 0x4c58322, (0xbf38 bytes) 2024-09-21T15:09:41.137 INFO:teuthology.orchestra.run.smithi161.stdout:4727 clone 25 order 18 su 1024 sc 9 2024-09-21T15:09:41.197 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #29, image image_cluster1.client.mirror.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent30 2024-09-21T15:09:41.217 INFO:teuthology.orchestra.run.smithi161.stdout:3864 write 0xd60d74e thru 0xd60f733 (0x1fe6 bytes) 2024-09-21T15:09:41.227 INFO:teuthology.orchestra.run.smithi161.stdout:3865 write 0x62fd619 thru 0x63005cd (0x2fb5 bytes) 2024-09-21T15:09:41.229 INFO:teuthology.orchestra.run.smithi161.stdout:4571 writesame 0x54823ff thru 0x54900f6 data_size 0xc(0xdcf8 bytes) 2024-09-21T15:09:41.273 INFO:teuthology.orchestra.run.smithi161.stdout:3866 write 0x262a0f4 thru 0x2630074 (0x5f81 bytes) 2024-09-21T15:09:41.289 INFO:teuthology.orchestra.run.smithi161.stdout:4572 trunc from 0xca7bc41 to 0x8651a6 2024-09-21T15:09:41.305 INFO:teuthology.orchestra.run.smithi161.stdout:3867 read 0x7c3bd7e thru 0x7c3efb9 (0x323c bytes) 2024-09-21T15:09:41.307 INFO:teuthology.orchestra.run.smithi161.stdout:3868 trunc from 0xd60f734 to 0xba582b4 2024-09-21T15:09:41.482 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:41.482 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:41.482 INFO:teuthology.orchestra.run.smithi161.stdout:3871 read 0xb0c69ff thru 0xb0c90cd (0x26cf bytes) 2024-09-21T15:09:41.482 INFO:teuthology.orchestra.run.smithi161.stdout:3872 punch from 0x7bfc388 to 0x7c008e8, (0x4560 bytes) 2024-09-21T15:09:41.482 INFO:teuthology.orchestra.run.smithi161.stdout:3873 writesame 0x736c202 thru 0x736ddf8 data_size 0x1(0x1bf7 bytes) 2024-09-21T15:09:41.498 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:41.498 INFO:teuthology.orchestra.run.smithi161.stdout:3875 read 0x23e9c38 thru 0x23ef524 (0x58ed bytes) 2024-09-21T15:09:41.499 INFO:teuthology.orchestra.run.smithi161.stdout:3878 read 0x3a484c6 thru 0x3a4ca2f (0x456a bytes) 2024-09-21T15:09:41.499 INFO:teuthology.orchestra.run.smithi161.stdout:3879 punch from 0x7866e75 to 0x786cec9, (0x6054 bytes) 2024-09-21T15:09:41.499 INFO:teuthology.orchestra.run.smithi161.stdout:3881 punch from 0x97e6058 to 0x97f583f, (0xf7e7 bytes) 2024-09-21T15:09:41.514 INFO:teuthology.orchestra.run.smithi161.stdout:3882 trunc from 0xba582b4 to 0x3cf59aa 2024-09-21T15:09:41.565 INFO:teuthology.orchestra.run.smithi161.stdout:4573 write 0xb5a15ef thru 0xb5a17af (0x1c1 bytes) 2024-09-21T15:09:41.578 INFO:teuthology.orchestra.run.smithi161.stdout:4574 read 0x403c2ef thru 0x4048c29 (0xc93b bytes) 2024-09-21T15:09:41.579 INFO:teuthology.orchestra.run.smithi161.stdout:4575 read 0x7cc8afc thru 0x7cd7810 (0xed15 bytes) 2024-09-21T15:09:41.579 INFO:teuthology.orchestra.run.smithi161.stdout:4576 write 0x1cb5769 thru 0x1cc0ba3 (0xb43b bytes) 2024-09-21T15:09:41.581 INFO:teuthology.orchestra.run.smithi161.stdout:3883 read 0x1c9494f thru 0x1c9c7f0 (0x7ea2 bytes) 2024-09-21T15:09:41.582 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:41.579+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0de9930 2024-09-21T15:09:41.587 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #28, image image_cluster1.client.mirror.5-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent29 2024-09-21T15:09:41.605 INFO:teuthology.orchestra.run.smithi161.stdout:4580 trunc from 0xb5a17b0 to 0x7b04f4b 2024-09-21T15:09:41.627 INFO:teuthology.orchestra.run.smithi161.stdout:3884 write 0xb2e577c thru 0xb2e81b8 (0x2a3d bytes) 2024-09-21T15:09:41.635 INFO:teuthology.orchestra.run.smithi161.stdout:3885 trunc from 0xb2e81b9 to 0xa8b4dbd 2024-09-21T15:09:41.643 INFO:teuthology.orchestra.run.smithi161.stdout:4582 punch from 0x6639392 to 0x6645e40, (0xcaae bytes) 2024-09-21T15:09:41.644 INFO:teuthology.orchestra.run.smithi161.stdout:4583 punch from 0x74d1500 to 0x74d8b14, (0x7614 bytes) 2024-09-21T15:09:41.760 INFO:teuthology.orchestra.run.smithi161.stdout:4584 write 0x922ce3c thru 0x9237e6a (0xb02f bytes) 2024-09-21T15:09:41.765 INFO:teuthology.orchestra.run.smithi161.stdout:3886 punch from 0x8d5e8c1 to 0x8d652b3, (0x69f2 bytes) 2024-09-21T15:09:41.798 INFO:teuthology.orchestra.run.smithi161.stdout:4587 read 0x7efb1db thru 0x7f07166 (0xbf8c bytes) 2024-09-21T15:09:41.798 INFO:teuthology.orchestra.run.smithi161.stdout:4589 read 0x33ac5d3 thru 0x33bb7b2 (0xf1e0 bytes) 2024-09-21T15:09:41.799 INFO:teuthology.orchestra.run.smithi161.stdout:4590 read 0x3e550f5 thru 0x3e60d34 (0xbc40 bytes) 2024-09-21T15:09:41.799 INFO:teuthology.orchestra.run.smithi161.stdout:4591 read 0x2594955 thru 0x259ce8c (0x8538 bytes) 2024-09-21T15:09:41.799 INFO:teuthology.orchestra.run.smithi161.stdout:4592 write 0x18727e1 thru 0x187a99c (0x81bc bytes) 2024-09-21T15:09:41.886 INFO:teuthology.orchestra.run.smithi161.stdout:4593 punch from 0x8fd5983 to 0x8fd8e19, (0x3496 bytes) 2024-09-21T15:09:41.894 INFO:teuthology.orchestra.run.smithi161.stdout:3889 writesame 0xd59c69a thru 0xd5a9bcf data_size 0x21(0xd536 bytes) 2024-09-21T15:09:41.927 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.923+0000 7f7fd044c700 -1 reset not still connected to 0x5636a0632a90 2024-09-21T15:09:41.927 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.923+0000 7f7fd044c700 -1 reset not still connected to 0x5636a0632dd0 2024-09-21T15:09:41.929 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.927+0000 7f7fd044c700 -1 reset not still connected to 0x5636a08f3ad0 2024-09-21T15:09:41.929 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.927+0000 7f7fd044c700 -1 reset not still connected to 0x5636a1d3b040 2024-09-21T15:09:41.929 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.927+0000 7f7fd044c700 -1 reset not still connected to 0x5636a1dfe5b0 2024-09-21T15:09:41.929 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.927+0000 7f7fd044c700 -1 reset not still connected to 0x5636a5c6c1a0 2024-09-21T15:09:41.933 INFO:teuthology.orchestra.run.smithi161.stdout:3890 write 0x150c2b7 thru 0x150df3d (0x1c87 bytes) 2024-09-21T15:09:41.935 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.935+0000 7f7fd044c700 -1 reset not still connected to 0x5636a6202dd0 2024-09-21T15:09:41.935 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.935+0000 7f7fd044c700 -1 reset not still connected to 0x5636a74f4c30 2024-09-21T15:09:41.938 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.935+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9636750 2024-09-21T15:09:41.938 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.935+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9bd95f0 2024-09-21T15:09:41.940 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.935+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa1e80d0 2024-09-21T15:09:41.941 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.935+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa338820 2024-09-21T15:09:41.942 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.939+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa339110 2024-09-21T15:09:41.942 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.939+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa4dcea0 2024-09-21T15:09:41.942 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.939+0000 7f7fd044c700 -1 reset not still connected to 0x5636ab3b48f0 2024-09-21T15:09:41.942 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.939+0000 7f7fd044c700 -1 reset not still connected to 0x5636ac39c000 2024-09-21T15:09:41.944 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.939+0000 7f7fd044c700 -1 reset not still connected to 0x5636ae41c410 2024-09-21T15:09:41.944 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.939+0000 7f7fd044c700 -1 reset not still connected to 0x5636aea724e0 2024-09-21T15:09:41.944 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.939+0000 7f7fd044c700 -1 reset not still connected to 0x5636aea72750 2024-09-21T15:09:41.944 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.939+0000 7f7fd044c700 -1 reset not still connected to 0x5636aebddee0 2024-09-21T15:09:41.945 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636b11416c0 2024-09-21T15:09:41.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636b2141450 2024-09-21T15:09:41.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636b21415f0 2024-09-21T15:09:41.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41aa000 2024-09-21T15:09:41.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41aa8f0 2024-09-21T15:09:41.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636b494ed00 2024-09-21T15:09:41.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636b5986b60 2024-09-21T15:09:41.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7f66d00 2024-09-21T15:09:41.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7f675f0 2024-09-21T15:09:41.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8416b60 2024-09-21T15:09:41.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc7185b0 2024-09-21T15:09:41.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:09:41.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:41.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636be75ef70 2024-09-21T15:09:41.964 INFO:teuthology.orchestra.run.smithi161.stdout:3891 write 0x4aa622e thru 0x4aae666 (0x8439 bytes) 2024-09-21T15:09:41.968 INFO:teuthology.orchestra.run.smithi161.stdout:4594 writesame 0xdffca5b thru 0xe00bc74 data_size 0x85(0xf21a bytes) 2024-09-21T15:09:41.987 INFO:teuthology.orchestra.run.smithi161.stdout:3892 writesame 0x5f0e75c thru 0x5f13633 data_size 0x3a(0x4ed8 bytes) 2024-09-21T15:09:41.996 INFO:teuthology.orchestra.run.smithi161.stdout:3895 write 0x3284b73 thru 0x3288d9f (0x422d bytes) 2024-09-21T15:09:41.998 INFO:teuthology.orchestra.run.smithi161.stdout:4595 trunc from 0xe00bc75 to 0x8013c86 2024-09-21T15:09:42.008 INFO:teuthology.orchestra.run.smithi161.stdout:3896 write 0xb70268 thru 0xb74580 (0x4319 bytes) 2024-09-21T15:09:42.036 INFO:teuthology.orchestra.run.smithi161.stdout:3897 trunc from 0xd5a9bd0 to 0x3cb2c7e 2024-09-21T15:09:42.056 INFO:teuthology.orchestra.run.smithi161.stdout:4596 clone 32 order 21 su 524288 sc 15 2024-09-21T15:09:42.078 INFO:teuthology.orchestra.run.smithi161.stdout:3898 read 0x10e2982 thru 0x10e3a21 (0x10a0 bytes) 2024-09-21T15:09:42.078 INFO:teuthology.orchestra.run.smithi161.stdout:3899 read 0x17fd27b thru 0x180c3fa (0xf180 bytes) 2024-09-21T15:09:42.080 INFO:teuthology.orchestra.run.smithi161.stdout:3900 punch from 0x3338b2c to 0x3339948, (0xe1c bytes) 2024-09-21T15:09:42.080 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:42.080 INFO:teuthology.orchestra.run.smithi161.stdout:3903 punch from 0x3bb27f2 to 0x3bb6dcf, (0x45dd bytes) 2024-09-21T15:09:42.087 INFO:teuthology.orchestra.run.smithi161.stdout:3904 trunc from 0x3cb2c7e to 0x15a409 2024-09-21T15:09:42.133 INFO:teuthology.orchestra.run.smithi161.stdout:3905 trunc from 0x15a409 to 0xbbfa4f 2024-09-21T15:09:42.160 INFO:teuthology.orchestra.run.smithi161.stdout:3906 writesame 0x1101cf thru 0x11915b data_size 0x1(0x8f8d bytes) 2024-09-21T15:09:42.198 INFO:teuthology.orchestra.run.smithi161.stdout:3907 read 0x2d1552 thru 0x2da82a (0x92d9 bytes) 2024-09-21T15:09:42.228 INFO:teuthology.orchestra.run.smithi161.stdout:4553 punch from 0x50224b1 to 0x502912f, (0x6c7e bytes) 2024-09-21T15:09:42.232 INFO:teuthology.orchestra.run.smithi161.stdout:3909 write 0x29e3773 thru 0x29f2f44 (0xf7d2 bytes) 2024-09-21T15:09:42.255 INFO:teuthology.orchestra.run.smithi161.stdout:3910 writesame 0x1fa6a3f thru 0x1fb699b data_size 0x4d(0xff5d bytes) 2024-09-21T15:09:42.266 INFO:teuthology.orchestra.run.smithi161.stdout:3911 read 0x1721ac9 thru 0x172fa68 (0xdfa0 bytes) 2024-09-21T15:09:42.267 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:42.267 INFO:teuthology.orchestra.run.smithi161.stdout:4556 punch from 0xb6b749f to 0xb6c4acb, (0xd62c bytes) 2024-09-21T15:09:42.267 INFO:teuthology.orchestra.run.smithi161.stdout:4557 writesame 0xb255e9e thru 0xb262440 data_size 0x5(0xc5a3 bytes) 2024-09-21T15:09:42.282 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #23, image image_cluster1.client.mirror.1-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent24 2024-09-21T15:09:42.304 INFO:teuthology.orchestra.run.smithi161.stdout:4560 read 0x1ef97a9 thru 0x1f06d60 (0xd5b8 bytes) 2024-09-21T15:09:42.314 INFO:teuthology.orchestra.run.smithi161.stdout:4564 read 0xa8cf247 thru 0xa8d51db (0x5f95 bytes) 2024-09-21T15:09:42.314 INFO:teuthology.orchestra.run.smithi161.stdout:4565 write 0xac4aafb thru 0xac56453 (0xb959 bytes) 2024-09-21T15:09:42.326 INFO:teuthology.orchestra.run.smithi161.stdout:3912 writesame 0x53c641f thru 0x53cb9e7 data_size 0x1(0x55c9 bytes) 2024-09-21T15:09:42.335 INFO:teuthology.orchestra.run.smithi161.stdout:3913 write 0xe4bf93 thru 0xe54788 (0x87f6 bytes) 2024-09-21T15:09:42.336 INFO:teuthology.orchestra.run.smithi161.stdout:4730 write 0xac420ec thru 0xac50cb7 (0xebcc bytes) 2024-09-21T15:09:42.357 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #28, image image_cluster1.client.mirror.2-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent29 2024-09-21T15:09:42.359 INFO:teuthology.orchestra.run.smithi161.stdout:3914 punch from 0x12ebf21 to 0x12fb4f1, (0xf5d0 bytes) 2024-09-21T15:09:42.404 INFO:teuthology.orchestra.run.smithi161.stdout:4566 writesame 0xca98250 thru 0xcaa661b data_size 0x3d(0xe3cc bytes) 2024-09-21T15:09:42.411 INFO:teuthology.orchestra.run.smithi161.stdout:3919 write 0xea4613f thru 0xea4ca36 (0x68f8 bytes) 2024-09-21T15:09:42.425 INFO:teuthology.orchestra.run.smithi161.stdout:4567 trunc from 0xcaa661c to 0x3c33e8b 2024-09-21T15:09:42.427 INFO:teuthology.orchestra.run.smithi161.stdout:3921 writesame 0x7e625dc thru 0x7e6d471 data_size 0x75(0xae96 bytes) 2024-09-21T15:09:42.556 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:42.556 INFO:teuthology.orchestra.run.smithi161.stdout:3923 read 0xc375f99 thru 0xc3760d8 (0x140 bytes) 2024-09-21T15:09:42.556 INFO:teuthology.orchestra.run.smithi161.stdout:3924 punch from 0xa7b9d16 to 0xa7c573b, (0xba25 bytes) 2024-09-21T15:09:42.557 INFO:teuthology.orchestra.run.smithi161.stdout:3925 writesame 0x80f168c thru 0x80f5f33 data_size 0x28(0x48a8 bytes) 2024-09-21T15:09:42.591 INFO:teuthology.orchestra.run.smithi161.stdout:3928 read 0x6a0a098 thru 0x6a15595 (0xb4fe bytes) 2024-09-21T15:09:42.618 INFO:teuthology.orchestra.run.smithi161.stdout:4568 write 0x379442f thru 0x3798546 (0x4118 bytes) 2024-09-21T15:09:42.627 INFO:teuthology.orchestra.run.smithi161.stdout:3932 writesame 0xeae0ac4 thru 0xeaef2e6 data_size 0x5d(0xe823 bytes) 2024-09-21T15:09:42.657 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:42.655+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c23d6c0 2024-09-21T15:09:42.709 INFO:teuthology.orchestra.run.smithi161.stdout:3933 read 0xc51ed0b thru 0xc52615e (0x7454 bytes) 2024-09-21T15:09:42.709 INFO:teuthology.orchestra.run.smithi161.stdout:3934 punch from 0x94d7b27 to 0x94e515d, (0xd636 bytes) 2024-09-21T15:09:42.712 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:42.712 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:42.716 INFO:teuthology.orchestra.run.smithi161.stdout:3935 trunc from 0xeaef2e7 to 0x9835b6d 2024-09-21T15:09:42.763 INFO:teuthology.orchestra.run.smithi161.stdout:4571 write 0x7f17202 thru 0x7f1937f (0x217e bytes) 2024-09-21T15:09:42.785 INFO:teuthology.orchestra.run.smithi161.stdout:4574 punch from 0x8a6d46 to 0x8b1909, (0xabc3 bytes) 2024-09-21T15:09:42.786 INFO:teuthology.orchestra.run.smithi161.stdout:4575 read 0x31e06a1 thru 0x31ee696 (0xdff6 bytes) 2024-09-21T15:09:42.786 INFO:teuthology.orchestra.run.smithi161.stdout:4576 punch from 0x1cdf696 to 0x1cdf88d, (0x1f7 bytes) 2024-09-21T15:09:42.786 INFO:teuthology.orchestra.run.smithi161.stdout:4577 punch from 0x50f6630 to 0x51007a7, (0xa177 bytes) 2024-09-21T15:09:42.786 INFO:teuthology.orchestra.run.smithi161.stdout:4579 punch from 0x62afa2b to 0x62b627c, (0x6851 bytes) 2024-09-21T15:09:42.786 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:42.786 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:42.786 INFO:teuthology.orchestra.run.smithi161.stdout:4582 read 0x3042094 thru 0x304c477 (0xa3e4 bytes) 2024-09-21T15:09:42.789 INFO:teuthology.orchestra.run.smithi161.stdout:4583 read 0x660992d thru 0x6614641 (0xad15 bytes) 2024-09-21T15:09:42.790 INFO:teuthology.orchestra.run.smithi161.stdout:4584 writesame 0x36f0399 thru 0x36fb713 data_size 0x1(0xb37b bytes) 2024-09-21T15:09:42.797 INFO:teuthology.orchestra.run.smithi161.stdout:3936 punch from 0x93ba048 to 0x93c957e, (0xf536 bytes) 2024-09-21T15:09:42.804 INFO:teuthology.orchestra.run.smithi161.stdout:3937 trunc from 0x9835b6d to 0xdd26aae 2024-09-21T15:09:42.862 INFO:teuthology.orchestra.run.smithi161.stdout:4731 punch from 0x552f5ad to 0x55373fa, (0x7e4d bytes) 2024-09-21T15:09:42.862 INFO:teuthology.orchestra.run.smithi161.stdout:4733 read 0x8dfe5b3 thru 0x8e02136 (0x3b84 bytes) 2024-09-21T15:09:42.864 INFO:teuthology.orchestra.run.smithi161.stdout:4734 write 0x861980e thru 0x861bc87 (0x247a bytes) 2024-09-21T15:09:42.866 INFO:teuthology.orchestra.run.smithi161.stdout:4586 write 0x569e5e6 thru 0x56a852a (0x9f45 bytes) 2024-09-21T15:09:42.872 INFO:teuthology.orchestra.run.smithi161.stdout:3939 punch from 0xbc6192a to 0xbc6a6fa, (0x8dd0 bytes) 2024-09-21T15:09:42.873 INFO:teuthology.orchestra.run.smithi161.stdout:3941 write 0x815dedc thru 0x815f7bf (0x18e4 bytes) 2024-09-21T15:09:42.892 INFO:teuthology.orchestra.run.smithi161.stdout:3943 punch from 0xcb84e78 to 0xcb8b5e3, (0x676b bytes) 2024-09-21T15:09:42.892 INFO:teuthology.orchestra.run.smithi161.stdout:3944 punch from 0x34788c0 to 0x347c355, (0x3a95 bytes) 2024-09-21T15:09:42.892 INFO:teuthology.orchestra.run.smithi161.stdout:3945 punch from 0x5eb0604 to 0x5eb33ca, (0x2dc6 bytes) 2024-09-21T15:09:42.892 INFO:teuthology.orchestra.run.smithi161.stdout:3946 read 0xb742653 thru 0xb749f73 (0x7921 bytes) 2024-09-21T15:09:42.892 INFO:teuthology.orchestra.run.smithi161.stdout:3948 read 0xc31c87d thru 0xc32004b (0x37cf bytes) 2024-09-21T15:09:42.892 INFO:teuthology.orchestra.run.smithi161.stdout:3949 write 0x9f9cea4 thru 0x9fa82eb (0xb448 bytes) 2024-09-21T15:09:42.898 INFO:teuthology.orchestra.run.smithi161.stdout:4588 read 0x6b2d901 thru 0x6b3c25f (0xe95f bytes) 2024-09-21T15:09:42.898 INFO:teuthology.orchestra.run.smithi161.stdout:4589 read 0x44cbf04 thru 0x44d6d7a (0xae77 bytes) 2024-09-21T15:09:42.898 INFO:teuthology.orchestra.run.smithi161.stdout:4590 writesame 0x55ce664 thru 0x55d5a89 data_size 0x1(0x7426 bytes) 2024-09-21T15:09:42.917 INFO:teuthology.orchestra.run.smithi161.stdout:3950 writesame 0x3744567 thru 0x37509f7 data_size 0x1(0xc491 bytes) 2024-09-21T15:09:42.928 INFO:teuthology.orchestra.run.smithi161.stdout:4591 writesame 0x65192a1 thru 0x651b999 data_size 0x1(0x26f9 bytes) 2024-09-21T15:09:42.965 INFO:teuthology.orchestra.run.smithi161.stdout:4592 read 0x3aef29f thru 0x3afda40 (0xe7a2 bytes) 2024-09-21T15:09:42.965 INFO:teuthology.orchestra.run.smithi161.stdout:4593 read 0x3b487af thru 0x3b52fc2 (0xa814 bytes) 2024-09-21T15:09:42.965 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:42.965 INFO:teuthology.orchestra.run.smithi161.stdout:4596 write 0x81372b thru 0x817d20 (0x45f6 bytes) 2024-09-21T15:09:42.970 INFO:teuthology.orchestra.run.smithi161.stdout:3951 read 0x1219a63 thru 0x121be04 (0x23a2 bytes) 2024-09-21T15:09:42.970 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:42.970 INFO:teuthology.orchestra.run.smithi161.stdout:3954 punch from 0xc79d668 to 0xc79ec98, (0x1630 bytes) 2024-09-21T15:09:42.970 INFO:teuthology.orchestra.run.smithi161.stdout:3956 read 0x9a66103 thru 0x9a6ae85 (0x4d83 bytes) 2024-09-21T15:09:42.971 INFO:teuthology.orchestra.run.smithi161.stdout:3957 writesame 0xb6f3443 thru 0xb6fb6d1 data_size 0xd(0x828f bytes) 2024-09-21T15:09:42.985 INFO:teuthology.orchestra.run.smithi161.stdout:3958 write 0xcd2a13b thru 0xcd2a516 (0x3dc bytes) 2024-09-21T15:09:43.009 INFO:teuthology.orchestra.run.smithi161.stdout:4809 write 0x8c4b017 thru 0x8c532e3 (0x82cd bytes) 2024-09-21T15:09:43.016 INFO:teuthology.orchestra.run.smithi161.stdout:4598 read 0x1fa6951 thru 0x1fa9ae6 (0x3196 bytes) 2024-09-21T15:09:43.019 INFO:teuthology.orchestra.run.smithi161.stdout:4599 punch from 0x5e0ea49 to 0x5e11a72, (0x3029 bytes) 2024-09-21T15:09:43.020 INFO:teuthology.orchestra.run.smithi161.stdout:4600 write 0x25f852f thru 0x25fd8a3 (0x5375 bytes) 2024-09-21T15:09:43.052 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.051+0000 7f7fd044c700 -1 reset not still connected to 0x5636a0632a90 2024-09-21T15:09:43.053 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.051+0000 7f7fd044c700 -1 reset not still connected to 0x5636a08f3ad0 2024-09-21T15:09:43.053 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.051+0000 7f7fd044c700 -1 reset not still connected to 0x5636a1dfe5b0 2024-09-21T15:09:43.069 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.063+0000 7f7fd044c700 -1 reset not still connected to 0x5636a6202dd0 2024-09-21T15:09:43.069 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.063+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9636750 2024-09-21T15:09:43.070 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.063+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9bd95f0 2024-09-21T15:09:43.070 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.063+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa1e80d0 2024-09-21T15:09:43.070 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.063+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa339110 2024-09-21T15:09:43.070 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.063+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa4dcea0 2024-09-21T15:09:43.070 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.063+0000 7f7fd044c700 -1 reset not still connected to 0x5636ab3b48f0 2024-09-21T15:09:43.076 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.067+0000 7f7fd044c700 -1 reset not still connected to 0x5636aea724e0 2024-09-21T15:09:43.076 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.067+0000 7f7fd044c700 -1 reset not still connected to 0x5636aea72750 2024-09-21T15:09:43.076 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.067+0000 7f7fd044c700 -1 reset not still connected to 0x5636aebddee0 2024-09-21T15:09:43.076 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.067+0000 7f7fd044c700 -1 reset not still connected to 0x5636b11416c0 2024-09-21T15:09:43.078 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.071+0000 7f7fd044c700 -1 reset not still connected to 0x5636b21415f0 2024-09-21T15:09:43.089 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.087+0000 7f7fd044c700 -1 reset not still connected to 0x5636b5986b60 2024-09-21T15:09:43.090 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.087+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7f66d00 2024-09-21T15:09:43.093 INFO:teuthology.orchestra.run.smithi161.stdout:4735 punch from 0x6674bb8 to 0x6681905, (0xcd4d bytes) 2024-09-21T15:09:43.094 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7f675f0 2024-09-21T15:09:43.094 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8416b60 2024-09-21T15:09:43.097 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.087+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:09:43.097 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.087+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afeebba0 2024-09-21T15:09:43.100 INFO:teuthology.orchestra.run.smithi161.stdout:4736 trunc from 0xad760bd to 0xea45f8d 2024-09-21T15:09:43.102 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.095+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:09:43.107 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.103+0000 7f7fd044c700 -1 reset not still connected to 0x5636be75ef70 2024-09-21T15:09:43.107 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.103+0000 7f7fd044c700 -1 reset not still connected to 0x5636bef84000 2024-09-21T15:09:43.107 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.103+0000 7f7fd044c700 -1 reset not still connected to 0x56369d0125b0 2024-09-21T15:09:43.108 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.107+0000 7f7fd044c700 -1 reset not still connected to 0x56369e02d380 2024-09-21T15:09:43.108 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.107+0000 7f7fd044c700 -1 reset not still connected to 0x56369e02d6c0 2024-09-21T15:09:43.108 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.107+0000 7f7fd044c700 -1 reset not still connected to 0x56369e03e680 2024-09-21T15:09:43.108 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.107+0000 7f7fd044c700 -1 reset not still connected to 0x56369e03f2b0 2024-09-21T15:09:43.108 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.107+0000 7f7fd044c700 -1 reset not still connected to 0x56369e8b7450 2024-09-21T15:09:43.108 INFO:teuthology.orchestra.run.smithi161.stdout:3959 write 0xbdaea7b thru 0xbdba4f8 (0xba7e bytes) 2024-09-21T15:09:43.109 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.107+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95a410 2024-09-21T15:09:43.109 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.107+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bad0 2024-09-21T15:09:43.109 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.107+0000 7f7fd044c700 -1 reset not still connected to 0x5636a0632a90 2024-09-21T15:09:43.109 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.107+0000 7f7fd044c700 -1 reset not still connected to 0x5636a0632dd0 2024-09-21T15:09:43.109 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.107+0000 7f7fd044c700 -1 reset not still connected to 0x5636a08f3ad0 2024-09-21T15:09:43.111 INFO:teuthology.orchestra.run.smithi161.stdout:4602 read 0x77d07be thru 0x77d76f6 (0x6f39 bytes) 2024-09-21T15:09:43.111 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:43.111 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:43.111 INFO:teuthology.orchestra.run.smithi161.stdout:4605 write 0x79ccc2c thru 0x79ce69d (0x1a72 bytes) 2024-09-21T15:09:43.113 INFO:teuthology.orchestra.run.smithi161.stdout:4811 trunc from 0xea5d8c7 to 0xdf514ee 2024-09-21T15:09:43.114 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.103+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b04ba750 2024-09-21T15:09:43.118 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636a1d3b040 2024-09-21T15:09:43.118 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636a1dfe5b0 2024-09-21T15:09:43.119 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636a44c0000 2024-09-21T15:09:43.119 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636a5c6c1a0 2024-09-21T15:09:43.119 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636a6202dd0 2024-09-21T15:09:43.119 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636a74f4c30 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9636750 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9bd95f0 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa1e80d0 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa339110 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa4dcea0 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636ab3b48f0 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636ac39c000 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636ae41c410 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636aea724e0 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636aea72750 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636aebddee0 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636b11416c0 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636b2141450 2024-09-21T15:09:43.120 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636b21415f0 2024-09-21T15:09:43.121 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41aa000 2024-09-21T15:09:43.121 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636b5986b60 2024-09-21T15:09:43.121 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7f66d00 2024-09-21T15:09:43.121 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7f675f0 2024-09-21T15:09:43.121 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8416b60 2024-09-21T15:09:43.121 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:09:43.121 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:43.115+0000 7f7fd044c700 -1 reset not still connected to 0x5636bef84000 2024-09-21T15:09:43.121 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:09:43.121 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b08a2f70 2024-09-21T15:09:43.121 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07380 2024-09-21T15:09:43.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07930 2024-09-21T15:09:43.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c821a0 2024-09-21T15:09:43.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c82ea0 2024-09-21T15:09:43.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:09:43.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83930 2024-09-21T15:09:43.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:09:43.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:09:43.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049c70 2024-09-21T15:09:43.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11740d0 2024-09-21T15:09:43.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:09:43.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6b60 2024-09-21T15:09:43.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6ea0 2024-09-21T15:09:43.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e7d40 2024-09-21T15:09:43.125 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14df040 2024-09-21T15:09:43.125 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14df380 2024-09-21T15:09:43.125 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b18321a0 2024-09-21T15:09:43.125 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1832340 2024-09-21T15:09:43.126 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1832dd0 2024-09-21T15:09:43.126 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833040 2024-09-21T15:09:43.126 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:09:43.126 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cffba0 2024-09-21T15:09:43.127 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202c1a0 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202c750 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b21ba9c0 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b21bb2b0 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b21bb860 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b21bb930 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266d450 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266d6c0 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2858750 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2860b60 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2860f70 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2861ee0 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386820 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386d00 2024-09-21T15:09:43.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:09:43.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:09:43.142 INFO:teuthology.orchestra.run.smithi161.stdout:4606 read 0x665b2ab thru 0x665f33c (0x4092 bytes) 2024-09-21T15:09:43.142 INFO:teuthology.orchestra.run.smithi161.stdout:4607 write 0x13ebf71 thru 0x13ed1ac (0x123c bytes) 2024-09-21T15:09:43.142 INFO:teuthology.orchestra.run.smithi161.stdout:3960 trunc from 0xdd26aae to 0x70285cd 2024-09-21T15:09:43.174 INFO:teuthology.orchestra.run.smithi161.stdout:4738 clone 26 order 21 su 32768 sc 3 2024-09-21T15:09:43.190 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone31 from 0x8013c86 (overlap 0x8651a6) to 0x0 2024-09-21T15:09:43.197 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:43.204 INFO:teuthology.orchestra.run.smithi161.stdout:4813 trunc from 0xdf514ee to 0x3d25f42 2024-09-21T15:09:43.212 INFO:teuthology.orchestra.run.smithi161.stdout:3961 write 0x4664766 thru 0x466acbd (0x6558 bytes) 2024-09-21T15:09:43.236 INFO:teuthology.orchestra.run.smithi161.stdout:3963 read 0x145395e thru 0x1458e6e (0x5511 bytes) 2024-09-21T15:09:43.236 INFO:teuthology.orchestra.run.smithi161.stdout:4608 write 0x9687b4a thru 0x9696c28 (0xf0df bytes) 2024-09-21T15:09:43.237 INFO:teuthology.orchestra.run.smithi161.stdout:3964 writesame 0x21c3419 thru 0x21c4ec4 data_size 0x6(0x1aac bytes) 2024-09-21T15:09:43.261 INFO:teuthology.orchestra.run.smithi161.stdout:3965 writesame 0x62e63b7 thru 0x62ebd69 data_size 0x1(0x59b3 bytes) 2024-09-21T15:09:43.286 INFO:teuthology.orchestra.run.smithi161.stdout:4609 read 0x5c49b4c thru 0x5c4f210 (0x56c5 bytes) 2024-09-21T15:09:43.286 INFO:teuthology.orchestra.run.smithi161.stdout:4612 punch from 0x3d3ca88 to 0x3d44200, (0x7778 bytes) 2024-09-21T15:09:43.286 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:43.286 INFO:teuthology.orchestra.run.smithi161.stdout:4614 punch from 0x23298cb to 0x232c86c, (0x2fa1 bytes) 2024-09-21T15:09:43.286 INFO:teuthology.orchestra.run.smithi161.stdout:4617 read 0x44502dc thru 0x445ffea (0xfd0f bytes) 2024-09-21T15:09:43.289 INFO:teuthology.orchestra.run.smithi161.stdout:3966 trunc from 0x70285cd to 0x7157b38 2024-09-21T15:09:43.297 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:43.298 INFO:teuthology.orchestra.run.smithi161.stdout:4817 writesame 0x1774d73 thru 0x1778967 data_size 0x1(0x3bf5 bytes) 2024-09-21T15:09:43.319 INFO:teuthology.orchestra.run.smithi161.stdout:4821 punch from 0x341b298 to 0x341d959, (0x26c1 bytes) 2024-09-21T15:09:43.319 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:43.319 INFO:teuthology.orchestra.run.smithi161.stdout:4823 write 0x21962b2 thru 0x2197d48 (0x1a97 bytes) 2024-09-21T15:09:43.323 INFO:teuthology.orchestra.run.smithi161.stdout:3967 read 0x2ec817f thru 0x2ed3f71 (0xbdf3 bytes) 2024-09-21T15:09:43.324 INFO:teuthology.orchestra.run.smithi161.stdout:3968 punch from 0x59063b4 to 0x590d1ce, (0x6e1a bytes) 2024-09-21T15:09:43.324 INFO:teuthology.orchestra.run.smithi161.stdout:3969 read 0x3d41c88 thru 0x3d4bee8 (0xa261 bytes) 2024-09-21T15:09:43.325 INFO:teuthology.orchestra.run.smithi161.stdout:3970 write 0x5eac960 thru 0x5ebbfa9 (0xf64a bytes) 2024-09-21T15:09:43.326 INFO:teuthology.orchestra.run.smithi161.stdout:4618 write 0xa469620 thru 0xa46dd56 (0x4737 bytes) 2024-09-21T15:09:43.349 INFO:teuthology.orchestra.run.smithi161.stdout:3971 write 0x3908d94 thru 0x391356d (0xa7da bytes) 2024-09-21T15:09:43.361 INFO:teuthology.orchestra.run.smithi161.stdout:4619 trunc from 0xa46dd57 to 0x9f72cd3 2024-09-21T15:09:43.363 INFO:teuthology.orchestra.run.smithi161.stdout:3972 writesame 0x711e21b thru 0x7127490 data_size 0x9(0x9276 bytes) 2024-09-21T15:09:43.373 INFO:teuthology.orchestra.run.smithi161.stdout:3973 read 0x49a3897 thru 0x49aed2c (0xb496 bytes) 2024-09-21T15:09:43.374 INFO:teuthology.orchestra.run.smithi161.stdout:3974 write 0x68b7ab8 thru 0x68baa22 (0x2f6b bytes) 2024-09-21T15:09:43.387 INFO:teuthology.orchestra.run.smithi161.stdout:4824 write 0xc27770f thru 0xc284e5b (0xd74d bytes) 2024-09-21T15:09:43.407 INFO:teuthology.orchestra.run.smithi161.stdout:4825 write 0xaeb1633 thru 0xaeb900d (0x79db bytes) 2024-09-21T15:09:43.411 INFO:teuthology.orchestra.run.smithi161.stdout:4621 punch from 0x3403d24 to 0x3411447, (0xd723 bytes) 2024-09-21T15:09:43.411 INFO:teuthology.orchestra.run.smithi161.stdout:4622 write 0x234728d thru 0x234e670 (0x73e4 bytes) 2024-09-21T15:09:43.428 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xed90311 2024-09-21T15:09:43.432 INFO:teuthology.orchestra.run.smithi161.stdout:4826 trunc from 0xc284e5c to 0xed90311 2024-09-21T15:09:43.439 INFO:teuthology.orchestra.run.smithi161.stdout:3975 writesame 0xa7631e6 thru 0xa772f8d data_size 0x4(0xfda8 bytes) 2024-09-21T15:09:43.446 INFO:teuthology.orchestra.run.smithi161.stdout:4624 punch from 0xd12303 to 0xd197e8, (0x74e5 bytes) 2024-09-21T15:09:43.449 INFO:teuthology.orchestra.run.smithi161.stdout:3976 write 0x268764c thru 0x26884d2 (0xe87 bytes) 2024-09-21T15:09:43.457 INFO:teuthology.orchestra.run.smithi161.stdout:3977 write 0x529d4d2 thru 0x52ac2f8 (0xee27 bytes) 2024-09-21T15:09:43.472 INFO:teuthology.orchestra.run.smithi161.stdout:3978 trunc from 0xa772f8e to 0xa2836b5 2024-09-21T15:09:43.475 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #30, image image_cluster1.client.mirror.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent31 2024-09-21T15:09:43.476 INFO:teuthology.orchestra.run.smithi161.stdout:4827 read 0x79ea1d5 thru 0x79f4f5f (0xad8b bytes) 2024-09-21T15:09:43.476 INFO:teuthology.orchestra.run.smithi161.stdout:4828 read 0x8a1f1f0 thru 0x8a240fa (0x4f0b bytes) 2024-09-21T15:09:43.477 INFO:teuthology.orchestra.run.smithi161.stdout:4831 read 0x61fba6c thru 0x62024b4 (0x6a49 bytes) 2024-09-21T15:09:43.477 INFO:teuthology.orchestra.run.smithi161.stdout:4832 write 0xbbb31af thru 0xbbc1f29 (0xed7b bytes) 2024-09-21T15:09:43.489 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #39, image image_cluster1.client.mirror.3-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent40 2024-09-21T15:09:43.501 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:43.502 INFO:teuthology.orchestra.run.smithi161.stdout:4835 write 0x4f6cdba thru 0x4f6d195 (0x3dc bytes) 2024-09-21T15:09:43.504 INFO:teuthology.orchestra.run.smithi161.stdout:4626 write 0xce45c23 thru 0xce47dfd (0x21db bytes) 2024-09-21T15:09:43.523 INFO:teuthology.orchestra.run.smithi161.stdout:4629 punch from 0xc2bd3de to 0xc2cc1c3, (0xede5 bytes) 2024-09-21T15:09:43.523 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:43.528 INFO:teuthology.orchestra.run.smithi161.stdout:3981 read 0x1ff8406 thru 0x2006232 (0xde2d bytes) 2024-09-21T15:09:43.530 INFO:teuthology.orchestra.run.smithi161.stdout:3983 writesame 0x6adfbff thru 0x6aec10b data_size 0xab(0xc50d bytes) 2024-09-21T15:09:43.541 INFO:teuthology.orchestra.run.smithi161.stdout:3984 read 0x76f4abf thru 0x76fd0a0 (0x85e2 bytes) 2024-09-21T15:09:43.541 INFO:teuthology.orchestra.run.smithi161.stdout:3342 writesame 0x7578dd2 thru 0x7580541 data_size 0x93(0x7770 bytes) 2024-09-21T15:09:43.541 INFO:teuthology.orchestra.run.smithi161.stdout:4836 trunc from 0xed90311 to 0x3236ca8 2024-09-21T15:09:43.548 INFO:teuthology.orchestra.run.smithi161.stdout:3985 trunc from 0xa2836b5 to 0x6404fbd 2024-09-21T15:09:43.564 INFO:teuthology.orchestra.run.smithi161.stdout:4633 write 0xd7688e3 thru 0xd76e9f3 (0x6111 bytes) 2024-09-21T15:09:43.635 INFO:teuthology.orchestra.run.smithi161.stdout:4635 read 0xc1a3694 thru 0xc1a7db9 (0x4726 bytes) 2024-09-21T15:09:43.636 INFO:teuthology.orchestra.run.smithi161.stdout:4636 punch from 0xb502111 to 0xb510685, (0xe574 bytes) 2024-09-21T15:09:43.636 INFO:teuthology.orchestra.run.smithi161.stdout:4637 writesame 0x45836b1 thru 0x458b790 data_size 0x10(0x80e0 bytes) 2024-09-21T15:09:43.727 INFO:teuthology.orchestra.run.smithi161.stdout:3986 read 0x35ddbf5 thru 0x35dff87 (0x2393 bytes) 2024-09-21T15:09:43.728 INFO:teuthology.orchestra.run.smithi161.stdout:3987 read 0x2e63eaa thru 0x2e67b10 (0x3c67 bytes) 2024-09-21T15:09:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:4638 read 0x3c11b19 thru 0x3c12408 (0x8f0 bytes) 2024-09-21T15:09:43.735 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:43.736 INFO:teuthology.orchestra.run.smithi161.stdout:4839 punch from 0x150110d to 0x1503d4d, (0x2c40 bytes) 2024-09-21T15:09:43.736 INFO:teuthology.orchestra.run.smithi161.stdout:4840 punch from 0xfbfef8 to 0xfca8fd, (0xaa05 bytes) 2024-09-21T15:09:43.736 INFO:teuthology.orchestra.run.smithi161.stdout:4841 writesame 0x24126f4 thru 0x2412884 data_size 0x1(0x191 bytes) 2024-09-21T15:09:43.788 INFO:teuthology.orchestra.run.smithi161.stdout:4842 read 0x5d27b0 thru 0x5d87bd (0x600e bytes) 2024-09-21T15:09:43.805 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:43.821 INFO:teuthology.orchestra.run.smithi161.stdout:3988 write 0xda7b0e8 thru 0xda85e41 (0xad5a bytes) 2024-09-21T15:09:43.821 INFO:teuthology.orchestra.run.smithi161.stdout:4639 write 0xe394632 thru 0xe39c862 (0x8231 bytes) 2024-09-21T15:09:43.822 INFO:teuthology.orchestra.run.smithi161.stdout:3344 trunc from 0xce3a959 to 0x40f9394 2024-09-21T15:09:43.863 INFO:teuthology.orchestra.run.smithi161.stdout:3989 punch from 0xc32a740 to 0xc335bf8, (0xb4b8 bytes) 2024-09-21T15:09:43.864 INFO:teuthology.orchestra.run.smithi161.stdout:3991 read 0x3a47d84 thru 0x3a50c3e (0x8ebb bytes) 2024-09-21T15:09:43.888 INFO:teuthology.orchestra.run.smithi161.stdout:4843 write 0xe42b672 thru 0xe42da90 (0x241f bytes) 2024-09-21T15:09:43.917 INFO:teuthology.orchestra.run.smithi161.stdout:4640 read 0x5be9183 thru 0x5bec5bc (0x343a bytes) 2024-09-21T15:09:43.917 INFO:teuthology.orchestra.run.smithi161.stdout:4641 punch from 0x6db3117 to 0x6dbe147, (0xb030 bytes) 2024-09-21T15:09:43.917 INFO:teuthology.orchestra.run.smithi161.stdout:4642 write 0xc000b36 thru 0xc0102a6 (0xf771 bytes) 2024-09-21T15:09:43.921 INFO:teuthology.orchestra.run.smithi161.stdout:4844 write 0xd3edc53 thru 0xd3f8988 (0xad36 bytes) 2024-09-21T15:09:43.935 INFO:teuthology.orchestra.run.smithi161.stdout:3992 trunc from 0xda85e42 to 0x2a2c89a 2024-09-21T15:09:44.024 INFO:teuthology.orchestra.run.smithi161.stdout:4847 read 0xb9b6d31 thru 0xb9c1677 (0xa947 bytes) 2024-09-21T15:09:44.036 INFO:teuthology.orchestra.run.smithi161.stdout:4643 writesame 0xdaa37d1 thru 0xdaa7a98 data_size 0x4(0x42c8 bytes) 2024-09-21T15:09:44.045 INFO:teuthology.orchestra.run.smithi161.stdout:4848 trunc from 0xe42da91 to 0x412c04d 2024-09-21T15:09:44.081 INFO:teuthology.orchestra.run.smithi161.stdout:4644 read 0x8ccbb87 thru 0x8ccce92 (0x130c bytes) 2024-09-21T15:09:44.081 INFO:teuthology.orchestra.run.smithi161.stdout:4645 writesame 0x2c1328c thru 0x2c17244 data_size 0x1(0x3fb9 bytes) 2024-09-21T15:09:44.147 INFO:teuthology.orchestra.run.smithi161.stdout:4646 trunc from 0xe39c863 to 0x52b375b 2024-09-21T15:09:44.244 INFO:teuthology.orchestra.run.smithi161.stdout:3993 writesame 0x9c7028e thru 0x9c7ee0b data_size 0x2b(0xeb7e bytes) 2024-09-21T15:09:44.245 INFO:teuthology.orchestra.run.smithi161.stdout:4849 write 0x8bc86c5 thru 0x8bd1517 (0x8e53 bytes) 2024-09-21T15:09:44.264 INFO:teuthology.orchestra.run.smithi161.stdout:4850 writesame 0x32a0291 thru 0x32ae120 data_size 0x18(0xde90 bytes) 2024-09-21T15:09:44.265 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone25 from 0xea45f8d (overlap 0xad760bd) to 0x9c1d710 2024-09-21T15:09:44.266 INFO:teuthology.orchestra.run.smithi161.stdout:3994 trunc from 0x9c7ee0c to 0x46ba752 2024-09-21T15:09:44.278 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:44.279 INFO:teuthology.orchestra.run.smithi161.stdout:4853 read 0x5e19fa6 thru 0x5e1b508 (0x1563 bytes) 2024-09-21T15:09:44.279 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:44.279 INFO:teuthology.orchestra.run.smithi161.stdout:4855 write 0x85757cf thru 0x857a065 (0x4897 bytes) 2024-09-21T15:09:44.299 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:44.299 INFO:teuthology.orchestra.run.smithi161.stdout:4857 read 0x1ca8e2e thru 0x1cafd6b (0x6f3e bytes) 2024-09-21T15:09:44.300 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:44.300 INFO:teuthology.orchestra.run.smithi161.stdout:4859 read 0x85dc7ac thru 0x85e7b48 (0xb39d bytes) 2024-09-21T15:09:44.300 INFO:teuthology.orchestra.run.smithi161.stdout:4860 punch from 0x5d92ff to 0x5e8ad3, (0xf7d4 bytes) 2024-09-21T15:09:44.300 INFO:teuthology.orchestra.run.smithi161.stdout:4862 write 0x745b74b thru 0x745c46c (0xd22 bytes) 2024-09-21T15:09:44.315 INFO:teuthology.orchestra.run.smithi161.stdout:3345 read 0x2b86d4c thru 0x2b926fc (0xb9b1 bytes) 2024-09-21T15:09:44.325 INFO:teuthology.orchestra.run.smithi161.stdout:4597 write 0x2709981 thru 0x270f9e2 (0x6062 bytes) 2024-09-21T15:09:44.337 INFO:teuthology.orchestra.run.smithi161.stdout:3996 read 0x96ac8d thru 0x9707ba (0x5b2e bytes) 2024-09-21T15:09:44.339 INFO:teuthology.orchestra.run.smithi161.stdout:3997 read 0x3934752 thru 0x393a93b (0x61ea bytes) 2024-09-21T15:09:44.346 INFO:teuthology.orchestra.run.smithi161.stdout:4649 write 0x8dbfa34 thru 0x8dcf5e1 (0xfbae bytes) 2024-09-21T15:09:44.349 INFO:teuthology.orchestra.run.smithi161.stdout:3346 read 0x138288c thru 0x138821f (0x5994 bytes) 2024-09-21T15:09:44.394 INFO:teuthology.orchestra.run.smithi161.stdout:3999 write 0x9b5ad46 thru 0x9b64aa8 (0x9d63 bytes) 2024-09-21T15:09:44.426 INFO:teuthology.orchestra.run.smithi161.stdout:4598 write 0x987dd34 thru 0x988648d (0x875a bytes) 2024-09-21T15:09:44.447 INFO:teuthology.orchestra.run.smithi161.stdout:4599 read 0x197af33 thru 0x19819af (0x6a7d bytes) 2024-09-21T15:09:44.447 INFO:teuthology.orchestra.run.smithi161.stdout:4600 write 0x5b3c53c thru 0x5b3f46b (0x2f30 bytes) 2024-09-21T15:09:44.461 INFO:teuthology.orchestra.run.smithi161.stdout:4000 read 0x5daf42f thru 0x5dbed1d (0xf8ef bytes) 2024-09-21T15:09:44.461 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:44.461 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:44.461 INFO:teuthology.orchestra.run.smithi161.stdout:4656 writesame 0x35d0be8 thru 0x35da13a data_size 0x2b(0x9553 bytes) 2024-09-21T15:09:44.462 INFO:teuthology.orchestra.run.smithi161.stdout:4001 read 0x7c8e6db thru 0x7c8fa18 (0x133e bytes) 2024-09-21T15:09:44.515 INFO:teuthology.orchestra.run.smithi161.stdout:4601 write 0xc354616 thru 0xc355bfe (0x15e9 bytes) 2024-09-21T15:09:44.537 INFO:teuthology.orchestra.run.smithi161.stdout:4603 trunc from 0xc355bff to 0xed7e0aa 2024-09-21T15:09:44.559 INFO:teuthology.orchestra.run.smithi161.stdout:3347 write 0x7b0b422 thru 0x7b0dcfa (0x28d9 bytes) 2024-09-21T15:09:44.568 INFO:teuthology.orchestra.run.smithi161.stdout:4604 trunc from 0xed7e0aa to 0xe65727b 2024-09-21T15:09:44.580 INFO:teuthology.orchestra.run.smithi161.stdout:4002 writesame 0xa23db67 thru 0xa23f583 data_size 0x7(0x1a1d bytes) 2024-09-21T15:09:44.582 INFO:teuthology.orchestra.run.smithi161.stdout:3348 read 0xd243ca thru 0xd30f37 (0xcb6e bytes) 2024-09-21T15:09:44.605 INFO:teuthology.orchestra.run.smithi161.stdout:4605 read 0xa6f9b2e thru 0xa6fbbe6 (0x20b9 bytes) 2024-09-21T15:09:44.605 INFO:teuthology.orchestra.run.smithi161.stdout:4606 writesame 0x813d82a thru 0x8140f6c data_size 0x1(0x3743 bytes) 2024-09-21T15:09:44.610 INFO:teuthology.orchestra.run.smithi161.stdout:4657 writesame 0x7913a26 thru 0x7914dbe data_size 0x1(0x1399 bytes) 2024-09-21T15:09:44.626 INFO:teuthology.orchestra.run.smithi161.stdout:4607 writesame 0x2afa118 thru 0x2b06485 data_size 0x5(0xc36e bytes) 2024-09-21T15:09:44.633 INFO:teuthology.orchestra.run.smithi161.stdout:3349 writesame 0x8134a71 thru 0x813d873 data_size 0xb(0x8e03 bytes) 2024-09-21T15:09:44.640 INFO:teuthology.orchestra.run.smithi161.stdout:4003 write 0x513677d thru 0x514154b (0xadcf bytes) 2024-09-21T15:09:44.683 INFO:teuthology.orchestra.run.smithi161.stdout:4658 write 0xa1e460b thru 0xa1e6330 (0x1d26 bytes) 2024-09-21T15:09:44.698 INFO:teuthology.orchestra.run.smithi161.stdout:3350 punch from 0x7af0c36 to 0x7af6d7c, (0x6146 bytes) 2024-09-21T15:09:44.698 INFO:teuthology.orchestra.run.smithi161.stdout:3351 read 0x3ace75a thru 0x3ad6d6e (0x8615 bytes) 2024-09-21T15:09:44.699 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:44.705 INFO:teuthology.orchestra.run.smithi161.stdout:4608 write 0xd1d28ae thru 0xd1dc732 (0x9e85 bytes) 2024-09-21T15:09:44.722 INFO:teuthology.orchestra.run.smithi161.stdout:4005 trunc from 0xa23f584 to 0x5b4442a 2024-09-21T15:09:44.725 INFO:teuthology.orchestra.run.smithi161.stdout:4863 writesame 0xa0e2145 thru 0xa0e47a2 data_size 0x3(0x265e bytes) 2024-09-21T15:09:44.729 INFO:teuthology.orchestra.run.smithi161.stdout:4610 read 0xc56e2fc thru 0xc57cbc9 (0xe8ce bytes) 2024-09-21T15:09:44.729 INFO:teuthology.orchestra.run.smithi161.stdout:4611 writesame 0x4ce2670 thru 0x4ce8223 data_size 0x2(0x5bb4 bytes) 2024-09-21T15:09:44.731 INFO:teuthology.orchestra.run.smithi161.stdout:4864 read 0x70ccce4 thru 0x70ccda0 (0xbd bytes) 2024-09-21T15:09:44.732 INFO:teuthology.orchestra.run.smithi161.stdout:4865 punch from 0x98315a4 to 0x983fbd1, (0xe62d bytes) 2024-09-21T15:09:44.743 INFO:teuthology.orchestra.run.smithi161.stdout:4660 read 0x9c082fd thru 0x9c08601 (0x305 bytes) 2024-09-21T15:09:44.743 INFO:teuthology.orchestra.run.smithi161.stdout:4662 punch from 0x151d417 to 0x1526815, (0x93fe bytes) 2024-09-21T15:09:44.743 INFO:teuthology.orchestra.run.smithi161.stdout:4663 punch from 0x116deed to 0x11786ca, (0xa7dd bytes) 2024-09-21T15:09:44.743 INFO:teuthology.orchestra.run.smithi161.stdout:4664 read 0x3bfde27 thru 0x3c0d515 (0xf6ef bytes) 2024-09-21T15:09:44.750 INFO:teuthology.orchestra.run.smithi161.stdout:4866 trunc from 0xa0e47a3 to 0x1e51390 2024-09-21T15:09:44.761 INFO:teuthology.orchestra.run.smithi161.stdout:4665 writesame 0x28f6086 thru 0x28faa8c data_size 0x1(0x4a07 bytes) 2024-09-21T15:09:44.780 INFO:teuthology.orchestra.run.smithi161.stdout:4612 trunc from 0xe65727b to 0x165496a 2024-09-21T15:09:44.793 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:44.803 INFO:teuthology.orchestra.run.smithi161.stdout:4006 trunc from 0x5b4442a to 0x478796d 2024-09-21T15:09:44.809 INFO:teuthology.orchestra.run.smithi161.stdout:3353 writesame 0x8a8be67 thru 0x8a9a35a data_size 0x2(0xe4f4 bytes) 2024-09-21T15:09:44.819 INFO:teuthology.orchestra.run.smithi161.stdout:3354 read 0x7d38f5 thru 0x7db297 (0x79a3 bytes) 2024-09-21T15:09:44.825 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:44.823+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655a00 2024-09-21T15:09:44.845 INFO:teuthology.orchestra.run.smithi161.stdout:4667 write 0xdb1d541 thru 0xdb21023 (0x3ae3 bytes) 2024-09-21T15:09:44.873 INFO:teuthology.orchestra.run.smithi161.stdout:3355 trunc from 0x8a9a35b to 0x276aa21 2024-09-21T15:09:44.885 INFO:teuthology.orchestra.run.smithi161.stdout:4668 read 0x7719a8c thru 0x77230a5 (0x961a bytes) 2024-09-21T15:09:44.885 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:44.887 INFO:teuthology.orchestra.run.smithi161.stdout:4670 trunc from 0xdb21024 to 0xe4747a5 2024-09-21T15:09:44.931 INFO:teuthology.orchestra.run.smithi161.stdout:4007 read 0x3cc4186 thru 0x3ccc5dc (0x8457 bytes) 2024-09-21T15:09:44.946 INFO:teuthology.orchestra.run.smithi161.stdout:4672 punch from 0x4889597 to 0x488edca, (0x5833 bytes) 2024-09-21T15:09:44.946 INFO:teuthology.orchestra.run.smithi161.stdout:4674 punch from 0x52398c6 to 0x52486e9, (0xee23 bytes) 2024-09-21T15:09:44.947 INFO:teuthology.orchestra.run.smithi161.stdout:4675 write 0x8d8ae87 thru 0x8d9668c (0xb806 bytes) 2024-09-21T15:09:45.001 INFO:teuthology.orchestra.run.smithi161.stdout:4613 write 0x1f0cc16 thru 0x1f10240 (0x362b bytes) 2024-09-21T15:09:45.064 INFO:teuthology.orchestra.run.smithi161.stdout:4008 write 0x6d46e8f thru 0x6d4ca52 (0x5bc4 bytes) 2024-09-21T15:09:45.088 INFO:teuthology.orchestra.run.smithi161.stdout:4676 write 0x9fc19aa thru 0x9fcef15 (0xd56c bytes) 2024-09-21T15:09:45.094 INFO:teuthology.orchestra.run.smithi161.stdout:4010 trunc from 0x6d4ca53 to 0x6f2ccea 2024-09-21T15:09:45.098 INFO:teuthology.orchestra.run.smithi161.stdout:4614 punch from 0xecd76c to 0xecedf9, (0x168d bytes) 2024-09-21T15:09:45.098 INFO:teuthology.orchestra.run.smithi161.stdout:4615 read 0x108b1be thru 0x109734d (0xc190 bytes) 2024-09-21T15:09:45.103 INFO:teuthology.orchestra.run.smithi161.stdout:4616 trunc from 0x1f10241 to 0x3074e24 2024-09-21T15:09:45.215 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:45.282 INFO:teuthology.orchestra.run.smithi161.stdout:4011 trunc from 0x6f2ccea to 0x357ce 2024-09-21T15:09:45.366 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:45.383 INFO:teuthology.orchestra.run.smithi161.stdout:4869 read 0x208224 thru 0x21389d (0xb67a bytes) 2024-09-21T15:09:45.385 INFO:teuthology.orchestra.run.smithi161.stdout:4871 read 0x13a6a6 thru 0x13dff8 (0x3953 bytes) 2024-09-21T15:09:45.385 INFO:teuthology.orchestra.run.smithi161.stdout:4678 trunc from 0xe4747a5 to 0x5120c08 2024-09-21T15:09:45.387 INFO:teuthology.orchestra.run.smithi161.stdout:4618 write 0x86753f2 thru 0x867f558 (0xa167 bytes) 2024-09-21T15:09:45.456 INFO:teuthology.orchestra.run.smithi161.stdout:4872 read 0x8cca33 thru 0x8d4485 (0x7a53 bytes) 2024-09-21T15:09:45.456 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:45.457 INFO:teuthology.orchestra.run.smithi161.stdout:4874 read 0x845413 thru 0x84cd8e (0x797c bytes) 2024-09-21T15:09:45.457 INFO:teuthology.orchestra.run.smithi161.stdout:4877 punch from 0x336c8b to 0x338f0b, (0x2280 bytes) 2024-09-21T15:09:45.457 INFO:teuthology.orchestra.run.smithi161.stdout:4878 read 0x1410439 thru 0x141a356 (0x9f1e bytes) 2024-09-21T15:09:45.540 INFO:teuthology.orchestra.run.smithi161.stdout:4679 read 0x26f0c6e thru 0x26f0dfc (0x18f bytes) 2024-09-21T15:09:45.542 INFO:teuthology.orchestra.run.smithi161.stdout:4619 write 0x6a5244d thru 0x6a5b58a (0x913e bytes) 2024-09-21T15:09:45.552 INFO:teuthology.orchestra.run.smithi161.stdout:4680 trunc from 0x5120c08 to 0xa96f846 2024-09-21T15:09:45.556 INFO:teuthology.orchestra.run.smithi161.stdout:4620 punch from 0xa64b13 to 0xa747bd, (0xfcaa bytes) 2024-09-21T15:09:45.556 INFO:teuthology.orchestra.run.smithi161.stdout:4621 write 0x144023e thru 0x144c77c (0xc53f bytes) 2024-09-21T15:09:45.568 INFO:teuthology.orchestra.run.smithi161.stdout:4013 writesame 0x9b2037b thru 0x9b25205 data_size 0x1(0x4e8b bytes) 2024-09-21T15:09:45.569 INFO:teuthology.orchestra.run.smithi161.stdout:4622 read 0x2421e19 thru 0x2429392 (0x757a bytes) 2024-09-21T15:09:45.570 INFO:teuthology.orchestra.run.smithi161.stdout:4624 read 0x3d675a6 thru 0x3d6e65b (0x70b6 bytes) 2024-09-21T15:09:45.570 INFO:teuthology.orchestra.run.smithi161.stdout:4625 write 0x2ef3fc6 thru 0x2efac23 (0x6c5e bytes) 2024-09-21T15:09:45.573 INFO:teuthology.orchestra.run.smithi161.stdout:4014 write 0x6eb90a thru 0x6f47ba (0x8eb1 bytes) 2024-09-21T15:09:45.597 INFO:teuthology.orchestra.run.smithi161.stdout:4627 trunc from 0x867f559 to 0x25c5c3c 2024-09-21T15:09:45.664 INFO:teuthology.orchestra.run.smithi161.stdout:4681 write 0x61838d7 thru 0x619159a (0xdcc4 bytes) 2024-09-21T15:09:45.664 INFO:teuthology.orchestra.run.smithi161.stdout:4015 trunc from 0x9b25206 to 0xda0223d 2024-09-21T15:09:45.667 INFO:teuthology.orchestra.run.smithi161.stdout:4879 write 0x3d798e4 thru 0x3d8232e (0x8a4b bytes) 2024-09-21T15:09:45.696 INFO:teuthology.orchestra.run.smithi161.stdout:4880 read 0x37baf11 thru 0x37c7d09 (0xcdf9 bytes) 2024-09-21T15:09:45.731 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:45.732 INFO:teuthology.orchestra.run.smithi161.stdout:4629 punch from 0x22782ff to 0x227980e, (0x150f bytes) 2024-09-21T15:09:45.732 INFO:teuthology.orchestra.run.smithi161.stdout:4631 read 0xc04e2b thru 0xc0f971 (0xab47 bytes) 2024-09-21T15:09:45.733 INFO:teuthology.orchestra.run.smithi161.stdout:4632 read 0x318820 thru 0x31e88f (0x6070 bytes) 2024-09-21T15:09:45.751 INFO:teuthology.orchestra.run.smithi161.stdout:4683 read 0x2c443cc thru 0x2c4eb76 (0xa7ab bytes) 2024-09-21T15:09:45.756 INFO:teuthology.orchestra.run.smithi161.stdout:4684 read 0x2e71e04 thru 0x2e74223 (0x2420 bytes) 2024-09-21T15:09:45.757 INFO:teuthology.orchestra.run.smithi161.stdout:4018 trunc from 0xda0223d to 0x5114d7 2024-09-21T15:09:45.757 INFO:teuthology.orchestra.run.smithi161.stdout:4688 writesame 0x7d78eff thru 0x7d84621 data_size 0x1(0xb723 bytes) 2024-09-21T15:09:45.766 INFO:teuthology.orchestra.run.smithi161.stdout:4633 write 0x5ac7f7b thru 0x5ad6a85 (0xeb0b bytes) 2024-09-21T15:09:45.804 INFO:teuthology.orchestra.run.smithi161.stdout:4690 writesame 0x551f0d5 thru 0x552a180 data_size 0x6(0xb0ac bytes) 2024-09-21T15:09:45.807 INFO:teuthology.orchestra.run.smithi161.stdout:4634 trunc from 0x5ad6a86 to 0x6b4e494 2024-09-21T15:09:45.809 INFO:teuthology.orchestra.run.smithi161.stdout:3358 punch from 0x223ac09 to 0x223d258, (0x264f bytes) 2024-09-21T15:09:45.810 INFO:teuthology.orchestra.run.smithi161.stdout:3359 read 0x1d3caef thru 0x1d4ac19 (0xe12b bytes) 2024-09-21T15:09:45.823 INFO:teuthology.orchestra.run.smithi161.stdout:4019 punch from 0x4f7563 to 0x501db0, (0xa84d bytes) 2024-09-21T15:09:45.823 INFO:teuthology.orchestra.run.smithi161.stdout:4020 trunc from 0x5114d7 to 0x3f20b5 2024-09-21T15:09:45.862 INFO:teuthology.orchestra.run.smithi161.stdout:3361 write 0x44ca34c thru 0x44da0d5 (0xfd8a bytes) 2024-09-21T15:09:45.870 INFO:teuthology.orchestra.run.smithi161.stdout:4635 trunc from 0x6b4e494 to 0xec9ca4c 2024-09-21T15:09:45.870 INFO:teuthology.orchestra.run.smithi161.stdout:4691 read 0x952e5b5 thru 0x952fd11 (0x175d bytes) 2024-09-21T15:09:45.871 INFO:teuthology.orchestra.run.smithi161.stdout:4692 write 0x184fdf thru 0x186004 (0x1026 bytes) 2024-09-21T15:09:45.890 INFO:teuthology.orchestra.run.smithi161.stdout:4636 punch from 0x9a79d9b to 0x9a80a18, (0x6c7d bytes) 2024-09-21T15:09:45.890 INFO:teuthology.orchestra.run.smithi161.stdout:4639 read 0x1d77d9f thru 0x1d7e6b3 (0x6915 bytes) 2024-09-21T15:09:45.891 INFO:teuthology.orchestra.run.smithi161.stdout:4641 trunc from 0xec9ca4c to 0xe5feac3 2024-09-21T15:09:45.915 INFO:teuthology.orchestra.run.smithi161.stdout:4642 read 0xcf4fe6d thru 0xcf529d6 (0x2b6a bytes) 2024-09-21T15:09:45.915 INFO:teuthology.orchestra.run.smithi161.stdout:4643 punch from 0xa1a4f31 to 0xa1ae5ae, (0x967d bytes) 2024-09-21T15:09:45.915 INFO:teuthology.orchestra.run.smithi161.stdout:4644 read 0x14ad36d thru 0x14b6db1 (0x9a45 bytes) 2024-09-21T15:09:45.918 INFO:teuthology.orchestra.run.smithi161.stdout:4645 write 0xc5e2c36 thru 0xc5ea0f7 (0x74c2 bytes) 2024-09-21T15:09:45.936 INFO:teuthology.orchestra.run.smithi161.stdout:4646 read 0x349fa0a thru 0x34a380a (0x3e01 bytes) 2024-09-21T15:09:45.937 INFO:teuthology.orchestra.run.smithi161.stdout:4647 read 0x6953f1b thru 0x695abc3 (0x6ca9 bytes) 2024-09-21T15:09:45.937 INFO:teuthology.orchestra.run.smithi161.stdout:4648 write 0xb8312b3 thru 0xb8341ce (0x2f1c bytes) 2024-09-21T15:09:45.944 INFO:teuthology.orchestra.run.smithi161.stdout:4022 write 0xb2d4553 thru 0xb2dd158 (0x8c06 bytes) 2024-09-21T15:09:45.980 INFO:teuthology.orchestra.run.smithi161.stdout:4651 writesame 0xe66b029 thru 0xe674bba data_size 0x1(0x9b92 bytes) 2024-09-21T15:09:45.984 INFO:teuthology.orchestra.run.smithi161.stdout:4652 punch from 0x806624c to 0x8072c18, (0xc9cc bytes) 2024-09-21T15:09:45.984 INFO:teuthology.orchestra.run.smithi161.stdout:4653 read 0x7e32927 thru 0x7e33a75 (0x114f bytes) 2024-09-21T15:09:45.984 INFO:teuthology.orchestra.run.smithi161.stdout:4694 trunc from 0xa96f846 to 0xb07ed09 2024-09-21T15:09:46.000 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:45.995+0000 7f68eae7f700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d6c54f00 finish: resending after timeout 2024-09-21T15:09:46.001 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:45.995+0000 7f68ea67e700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5581d6c54fc0 finish: resending after timeout 2024-09-21T15:09:46.029 INFO:teuthology.orchestra.run.smithi161.stdout:4655 writesame 0xe8b6a2b thru 0xe8c0449 data_size 0xd(0x9a1f bytes) 2024-09-21T15:09:46.029 INFO:teuthology.orchestra.run.smithi161.stdout:4695 trunc from 0xb07ed09 to 0x954ae1b 2024-09-21T15:09:46.035 INFO:teuthology.orchestra.run.smithi161.stdout:4656 punch from 0x2c5e216 to 0x2c6ccb6, (0xeaa0 bytes) 2024-09-21T15:09:46.035 INFO:teuthology.orchestra.run.smithi161.stdout:4657 write 0x4497dcc thru 0x449bd1b (0x3f50 bytes) 2024-09-21T15:09:46.045 INFO:teuthology.orchestra.run.smithi161.stdout:3362 writesame 0x6325c5f thru 0x632e401 data_size 0x1(0x87a3 bytes) 2024-09-21T15:09:46.050 INFO:teuthology.orchestra.run.smithi161.stdout:4662 write 0x549d64d thru 0x54ac38d (0xed41 bytes) 2024-09-21T15:09:46.051 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.051 INFO:teuthology.orchestra.run.smithi161.stdout:3364 read 0x604308f thru 0x605112c (0xe09e bytes) 2024-09-21T15:09:46.080 INFO:teuthology.orchestra.run.smithi161.stdout:4023 read 0x32ff635 thru 0x330114e (0x1b1a bytes) 2024-09-21T15:09:46.081 INFO:teuthology.orchestra.run.smithi161.stdout:4024 punch from 0x305ee1c to 0x306ba92, (0xcc76 bytes) 2024-09-21T15:09:46.081 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.081 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.081 INFO:teuthology.orchestra.run.smithi161.stdout:4030 punch from 0x14ea3dc to 0x14f4b14, (0xa738 bytes) 2024-09-21T15:09:46.081 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.081 INFO:teuthology.orchestra.run.smithi161.stdout:4032 writesame 0x11ad130 thru 0x11ba59a data_size 0x2f(0xd46b bytes) 2024-09-21T15:09:46.091 INFO:teuthology.orchestra.run.smithi161.stdout:4033 punch from 0xa9eedf1 to 0xa9fbabd, (0xcccc bytes) 2024-09-21T15:09:46.091 INFO:teuthology.orchestra.run.smithi161.stdout:4034 writesame 0xb0982e4 thru 0xb0a231c data_size 0x1(0xa039 bytes) 2024-09-21T15:09:46.106 INFO:teuthology.orchestra.run.smithi161.stdout:4697 write 0x66790d8 thru 0x667ce6e (0x3d97 bytes) 2024-09-21T15:09:46.130 INFO:teuthology.orchestra.run.smithi161.stdout:4663 write 0x254e2a1 thru 0x25536df (0x543f bytes) 2024-09-21T15:09:46.131 INFO:teuthology.orchestra.run.smithi161.stdout:4698 trunc from 0x954ae1b to 0x5da4023 2024-09-21T15:09:46.162 INFO:teuthology.orchestra.run.smithi161.stdout:4664 trunc from 0xe8c044a to 0x57090c2 2024-09-21T15:09:46.177 INFO:teuthology.orchestra.run.smithi161.stdout:4035 punch from 0xa09885b to 0xa0a2798, (0x9f3d bytes) 2024-09-21T15:09:46.177 INFO:teuthology.orchestra.run.smithi161.stdout:4036 punch from 0x2f5d7a5 to 0x2f6b026, (0xd881 bytes) 2024-09-21T15:09:46.177 INFO:teuthology.orchestra.run.smithi161.stdout:4037 read 0x4d371f thru 0x4da091 (0x6973 bytes) 2024-09-21T15:09:46.181 INFO:teuthology.orchestra.run.smithi161.stdout:3365 writesame 0x6c4b13b thru 0x6c4dd51 data_size 0x1(0x2c17 bytes) 2024-09-21T15:09:46.182 INFO:teuthology.orchestra.run.smithi161.stdout:4881 write 0xdce9c10 thru 0xdcf6858 (0xcc49 bytes) 2024-09-21T15:09:46.189 INFO:teuthology.orchestra.run.smithi161.stdout:3366 punch from 0x87c86e to 0x882279, (0x5a0b bytes) 2024-09-21T15:09:46.195 INFO:teuthology.orchestra.run.smithi161.stdout:4038 trunc from 0xb2dd159 to 0x3e9657b 2024-09-21T15:09:46.196 INFO:teuthology.orchestra.run.smithi161.stdout:3367 trunc from 0x6c4dd52 to 0x3ca56de 2024-09-21T15:09:46.220 INFO:teuthology.orchestra.run.smithi161.stdout:4699 punch from 0x4e4f91e to 0x4e5c55a, (0xcc3c bytes) 2024-09-21T15:09:46.220 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.220 INFO:teuthology.orchestra.run.smithi161.stdout:4701 read 0x31bc34 thru 0x329adc (0xdea9 bytes) 2024-09-21T15:09:46.222 INFO:teuthology.orchestra.run.smithi161.stdout:4883 flatten 2024-09-21T15:09:46.279 INFO:teuthology.orchestra.run.smithi161.stdout:4665 flatten 2024-09-21T15:09:46.301 INFO:teuthology.orchestra.run.smithi161.stdout:4041 trunc from 0x3e9657b to 0x55b64b4 2024-09-21T15:09:46.325 INFO:teuthology.orchestra.run.smithi161.stdout:4702 write 0xc1c60ff thru 0xc1d312a (0xd02c bytes) 2024-09-21T15:09:46.326 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.326 INFO:teuthology.orchestra.run.smithi161.stdout:4667 read 0x4e6fa20 thru 0x4e76628 (0x6c09 bytes) 2024-09-21T15:09:46.326 INFO:teuthology.orchestra.run.smithi161.stdout:4668 writesame 0x33a648d thru 0x33aea9f data_size 0x11(0x8613 bytes) 2024-09-21T15:09:46.326 INFO:teuthology.orchestra.run.smithi161.stdout:3368 read 0x3b03cf8 thru 0x3b13b93 (0xfe9c bytes) 2024-09-21T15:09:46.327 INFO:teuthology.orchestra.run.smithi161.stdout:3369 punch from 0x1aeba6d to 0x1afb9bb, (0xff4e bytes) 2024-09-21T15:09:46.328 INFO:teuthology.orchestra.run.smithi161.stdout:3371 read 0x39162ef thru 0x391af8e (0x4ca0 bytes) 2024-09-21T15:09:46.328 INFO:teuthology.orchestra.run.smithi161.stdout:3372 writesame 0x224a4bb thru 0x22519db data_size 0x5(0x7521 bytes) 2024-09-21T15:09:46.335 INFO:teuthology.orchestra.run.smithi161.stdout:4669 read 0x3ff7f37 thru 0x3ffe4b4 (0x657e bytes) 2024-09-21T15:09:46.336 INFO:teuthology.orchestra.run.smithi161.stdout:4670 read 0x44fb322 thru 0x4503d53 (0x8a32 bytes) 2024-09-21T15:09:46.352 INFO:teuthology.orchestra.run.smithi161.stdout:4671 trunc from 0x57090c2 to 0xd5df431 2024-09-21T15:09:46.379 INFO:teuthology.orchestra.run.smithi161.stdout:4672 read 0xa592f9f thru 0xa599a3b (0x6a9d bytes) 2024-09-21T15:09:46.379 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.380 INFO:teuthology.orchestra.run.smithi161.stdout:4674 punch from 0x7dcc89e to 0x7ddc4dc, (0xfc3e bytes) 2024-09-21T15:09:46.380 INFO:teuthology.orchestra.run.smithi161.stdout:4675 write 0x58e8a9f thru 0x58f28a4 (0x9e06 bytes) 2024-09-21T15:09:46.410 INFO:teuthology.orchestra.run.smithi161.stdout:3373 read 0x13d4fc6 thru 0x13e00a8 (0xb0e3 bytes) 2024-09-21T15:09:46.413 INFO:teuthology.orchestra.run.smithi161.stdout:4042 write 0xcef08b6 thru 0xcef1749 (0xe94 bytes) 2024-09-21T15:09:46.429 INFO:teuthology.orchestra.run.smithi161.stdout:4044 writesame 0x4e2e19f thru 0x4e331a1 data_size 0x1(0x5003 bytes) 2024-09-21T15:09:46.440 INFO:teuthology.orchestra.run.smithi161.stdout:4676 write 0xdcddb72 thru 0xdcec862 (0xecf1 bytes) 2024-09-21T15:09:46.459 INFO:teuthology.orchestra.run.smithi161.stdout:4678 write 0x4936031 thru 0x493dd22 (0x7cf2 bytes) 2024-09-21T15:09:46.462 INFO:teuthology.orchestra.run.smithi161.stdout:4703 read 0x34f4858 thru 0x34f7b72 (0x331b bytes) 2024-09-21T15:09:46.462 INFO:teuthology.orchestra.run.smithi161.stdout:4704 write 0x31f7f0f thru 0x3204f79 (0xd06b bytes) 2024-09-21T15:09:46.491 INFO:teuthology.orchestra.run.smithi161.stdout:4679 write 0x7cf7b25 thru 0x7cf9a18 (0x1ef4 bytes) 2024-09-21T15:09:46.512 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.512 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.512 INFO:teuthology.orchestra.run.smithi161.stdout:4047 write 0x6f38e1e thru 0x6f39a41 (0xc24 bytes) 2024-09-21T15:09:46.535 INFO:teuthology.orchestra.run.smithi161.stdout:4049 write 0x1564c68 thru 0x156a421 (0x57ba bytes) 2024-09-21T15:09:46.541 INFO:teuthology.orchestra.run.smithi161.stdout:3374 write 0x4c696ef thru 0x4c74e2f (0xb741 bytes) 2024-09-21T15:09:46.558 INFO:teuthology.orchestra.run.smithi161.stdout:4705 read 0x55af769 thru 0x55b84b0 (0x8d48 bytes) 2024-09-21T15:09:46.561 INFO:teuthology.orchestra.run.smithi161.stdout:4680 writesame 0x659c4fc thru 0x65a7f5e data_size 0x5(0xba63 bytes) 2024-09-21T15:09:46.589 INFO:teuthology.orchestra.run.smithi161.stdout:4681 punch from 0x438f6dd to 0x4393f53, (0x4876 bytes) 2024-09-21T15:09:46.589 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.589 INFO:teuthology.orchestra.run.smithi161.stdout:4050 write 0x3b354c2 thru 0x3b42087 (0xcbc6 bytes) 2024-09-21T15:09:46.590 INFO:teuthology.orchestra.run.smithi161.stdout:4684 write 0xd1aa7d0 thru 0xd1b74ec (0xcd1d bytes) 2024-09-21T15:09:46.599 INFO:teuthology.orchestra.run.smithi161.stdout:4708 write 0x12c7456 thru 0x12d4ec7 (0xda72 bytes) 2024-09-21T15:09:46.612 INFO:teuthology.orchestra.run.smithi161.stdout:4686 write 0xb2be1a4 thru 0xb2be821 (0x67e bytes) 2024-09-21T15:09:46.620 INFO:teuthology.orchestra.run.smithi161.stdout:4051 punch from 0x94dcbec to 0x94e7e31, (0xb245 bytes) 2024-09-21T15:09:46.620 INFO:teuthology.orchestra.run.smithi161.stdout:4052 read 0xe5b49 thru 0xe77a0 (0x1c58 bytes) 2024-09-21T15:09:46.621 INFO:teuthology.orchestra.run.smithi161.stdout:4053 punch from 0x900c76d to 0x901a485, (0xdd18 bytes) 2024-09-21T15:09:46.621 INFO:teuthology.orchestra.run.smithi161.stdout:4054 punch from 0x2bfb737 to 0x2bfec55, (0x351e bytes) 2024-09-21T15:09:46.621 INFO:teuthology.orchestra.run.smithi161.stdout:4055 write 0x5676323 thru 0x567e822 (0x8500 bytes) 2024-09-21T15:09:46.628 INFO:teuthology.orchestra.run.smithi161.stdout:4688 read 0xd383ba7 thru 0xd3865cc (0x2a26 bytes) 2024-09-21T15:09:46.639 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.640 INFO:teuthology.orchestra.run.smithi161.stdout:4885 write 0x396b6bf thru 0x3970655 (0x4f97 bytes) 2024-09-21T15:09:46.644 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.649 INFO:teuthology.orchestra.run.smithi161.stdout:4689 trunc from 0xdcec863 to 0x4761550 2024-09-21T15:09:46.676 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.676 INFO:teuthology.orchestra.run.smithi161.stdout:4890 punch from 0x5f48210 to 0x5f53b5b, (0xb94b bytes) 2024-09-21T15:09:46.676 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.717 INFO:teuthology.orchestra.run.smithi161.stdout:4709 write 0x3191b53 thru 0x3199f4d (0x83fb bytes) 2024-09-21T15:09:46.717 INFO:teuthology.orchestra.run.smithi161.stdout:4057 write 0x5e3308c thru 0x5e414e7 (0xe45c bytes) 2024-09-21T15:09:46.776 INFO:teuthology.orchestra.run.smithi161.stdout:3376 write 0xe8132fd thru 0xe821831 (0xe535 bytes) 2024-09-21T15:09:46.789 INFO:teuthology.orchestra.run.smithi161.stdout:4058 punch from 0x94d411e to 0x94da253, (0x6135 bytes) 2024-09-21T15:09:46.789 INFO:teuthology.orchestra.run.smithi161.stdout:4060 punch from 0x1abf00a to 0x1ac02aa, (0x12a0 bytes) 2024-09-21T15:09:46.790 INFO:teuthology.orchestra.run.smithi161.stdout:4710 trunc from 0xc1d312b to 0xb29e9e8 2024-09-21T15:09:46.838 INFO:teuthology.orchestra.run.smithi161.stdout:4061 writesame 0xdf3cad6 thru 0xdf3eac5 data_size 0x38(0x1ff0 bytes) 2024-09-21T15:09:46.842 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.842 INFO:teuthology.orchestra.run.smithi161.stdout:4063 writesame 0x3823342 thru 0x382e7ad data_size 0xc(0xb46c bytes) 2024-09-21T15:09:46.859 INFO:teuthology.orchestra.run.smithi161.stdout:4690 write 0xc63d8cd thru 0xc648130 (0xa864 bytes) 2024-09-21T15:09:46.893 INFO:teuthology.orchestra.run.smithi161.stdout:3377 write 0x1945868 thru 0x195460e (0xeda7 bytes) 2024-09-21T15:09:46.902 INFO:teuthology.orchestra.run.smithi161.stdout:4691 punch from 0xbc9a3 to 0xc0ffc, (0x4659 bytes) 2024-09-21T15:09:46.903 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.903 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:46.903 INFO:teuthology.orchestra.run.smithi161.stdout:4694 punch from 0x5af0ec1 to 0x5af5c36, (0x4d75 bytes) 2024-09-21T15:09:46.903 INFO:teuthology.orchestra.run.smithi161.stdout:4696 write 0x15145be thru 0x1516068 (0x1aab bytes) 2024-09-21T15:09:46.925 INFO:teuthology.orchestra.run.smithi161.stdout:4064 writesame 0x44b2759 thru 0x44be8bf data_size 0xb(0xc167 bytes) 2024-09-21T15:09:46.930 INFO:teuthology.orchestra.run.smithi161.stdout:4697 read 0x7345d8a thru 0x734ff80 (0xa1f7 bytes) 2024-09-21T15:09:46.930 INFO:teuthology.orchestra.run.smithi161.stdout:4699 write 0x6da94ea thru 0x6dac3aa (0x2ec1 bytes) 2024-09-21T15:09:46.947 INFO:teuthology.orchestra.run.smithi161.stdout:4065 punch from 0x1315b00 to 0x1322dc3, (0xd2c3 bytes) 2024-09-21T15:09:46.961 INFO:teuthology.orchestra.run.smithi161.stdout:4066 trunc from 0xdf3eac6 to 0x738d666 2024-09-21T15:09:47.079 INFO:teuthology.orchestra.run.smithi161.stdout:4712 trunc from 0xb29e9e8 to 0x7772936 2024-09-21T15:09:47.091 INFO:teuthology.orchestra.run.smithi161.stdout:4894 write 0xe3bfd2b thru 0xe3cd076 (0xd34c bytes) 2024-09-21T15:09:47.165 INFO:teuthology.orchestra.run.smithi161.stdout:4895 write 0x173d362 thru 0x1742e99 (0x5b38 bytes) 2024-09-21T15:09:47.188 INFO:teuthology.orchestra.run.smithi161.stdout:4701 writesame 0xc8f910b thru 0xc8fde31 data_size 0x1(0x4d27 bytes) 2024-09-21T15:09:47.192 INFO:teuthology.orchestra.run.smithi161.stdout:4702 write 0x3e4796 thru 0x3ed557 (0x8dc2 bytes) 2024-09-21T15:09:47.192 INFO:teuthology.orchestra.run.smithi161.stdout:4896 writesame 0x3d63686 thru 0x3d6ba96 data_size 0x1(0x8411 bytes) 2024-09-21T15:09:47.221 INFO:teuthology.orchestra.run.smithi161.stdout:4713 read 0x6326d04 thru 0x6330fb7 (0xa2b4 bytes) 2024-09-21T15:09:47.221 INFO:teuthology.orchestra.run.smithi161.stdout:4714 read 0x6a59be thru 0x6a703f (0x1682 bytes) 2024-09-21T15:09:47.222 INFO:teuthology.orchestra.run.smithi161.stdout:4706 read 0x44ff798 thru 0x450b4ba (0xbd23 bytes) 2024-09-21T15:09:47.222 INFO:teuthology.orchestra.run.smithi161.stdout:4707 read 0x4dbd1b0 thru 0x4dbfafd (0x294e bytes) 2024-09-21T15:09:47.222 INFO:teuthology.orchestra.run.smithi161.stdout:4709 read 0x79934ea thru 0x799bb89 (0x86a0 bytes) 2024-09-21T15:09:47.222 INFO:teuthology.orchestra.run.smithi161.stdout:4710 write 0x583b04c thru 0x58406c3 (0x5678 bytes) 2024-09-21T15:09:47.228 INFO:teuthology.orchestra.run.smithi161.stdout:4717 read 0x728d92a thru 0x729b821 (0xdef8 bytes) 2024-09-21T15:09:47.228 INFO:teuthology.orchestra.run.smithi161.stdout:4719 write 0xfb271f thru 0xfc100a (0xe8ec bytes) 2024-09-21T15:09:47.235 INFO:teuthology.orchestra.run.smithi161.stdout:4897 read 0x55ed789 thru 0x55fb632 (0xdeaa bytes) 2024-09-21T15:09:47.248 INFO:teuthology.orchestra.run.smithi161.stdout:4711 writesame 0xc813814 thru 0xc8152a5 data_size 0x13(0x1a92 bytes) 2024-09-21T15:09:47.248 INFO:teuthology.orchestra.run.smithi161.stdout:4898 trunc from 0xe3cd077 to 0x731c468 2024-09-21T15:09:47.268 INFO:teuthology.orchestra.run.smithi161.stdout:4712 write 0x1cc7958 thru 0x1ccaf31 (0x35da bytes) 2024-09-21T15:09:47.275 INFO:teuthology.orchestra.run.smithi161.stdout:4714 write 0x20274a9 thru 0x202df71 (0x6ac9 bytes) 2024-09-21T15:09:47.289 INFO:teuthology.orchestra.run.smithi161.stdout:4715 read 0x39d8561 thru 0x39e0990 (0x8430 bytes) 2024-09-21T15:09:47.301 INFO:teuthology.orchestra.run.smithi161.stdout:4716 trunc from 0xc8fde32 to 0x6e09d87 2024-09-21T15:09:47.321 INFO:teuthology.orchestra.run.smithi161.stdout:4067 write 0xe7433b9 thru 0xe7472cc (0x3f14 bytes) 2024-09-21T15:09:47.342 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.342 INFO:teuthology.orchestra.run.smithi161.stdout:4069 read 0xd41790 thru 0xd48396 (0x6c07 bytes) 2024-09-21T15:09:47.343 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.343 INFO:teuthology.orchestra.run.smithi161.stdout:4071 read 0x596e6a8 thru 0x597101d (0x2976 bytes) 2024-09-21T15:09:47.347 INFO:teuthology.orchestra.run.smithi161.stdout:4072 read 0x365077d thru 0x3652375 (0x1bf9 bytes) 2024-09-21T15:09:47.362 INFO:teuthology.orchestra.run.smithi161.stdout:4073 trunc from 0xe7472cd to 0x73bb76f 2024-09-21T15:09:47.363 INFO:teuthology.orchestra.run.smithi161.stdout:4901 read 0x21eff41 thru 0x21ff5c8 (0xf688 bytes) 2024-09-21T15:09:47.363 INFO:teuthology.orchestra.run.smithi161.stdout:4902 write 0xac3588 thru 0xac68e8 (0x3361 bytes) 2024-09-21T15:09:47.364 INFO:teuthology.orchestra.run.smithi161.stdout:3378 read 0x40a6a8c thru 0x40b136d (0xa8e2 bytes) 2024-09-21T15:09:47.367 INFO:teuthology.orchestra.run.smithi161.stdout:3379 read 0x5377a16 thru 0x5380fdf (0x95ca bytes) 2024-09-21T15:09:47.367 INFO:teuthology.orchestra.run.smithi161.stdout:3380 read 0xcca403c thru 0xcca754c (0x3511 bytes) 2024-09-21T15:09:47.367 INFO:teuthology.orchestra.run.smithi161.stdout:3381 write 0xa245180 thru 0xa247489 (0x230a bytes) 2024-09-21T15:09:47.371 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.372 INFO:teuthology.orchestra.run.smithi161.stdout:4720 writesame 0xbf55f30 thru 0xbf5ea31 data_size 0x1b(0x8b02 bytes) 2024-09-21T15:09:47.378 INFO:teuthology.orchestra.run.smithi161.stdout:4718 trunc from 0x6e09d87 to 0x3a5afcf 2024-09-21T15:09:47.378 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.378 INFO:teuthology.orchestra.run.smithi161.stdout:4722 writesame 0x851316a thru 0x851fb05 data_size 0x8a(0xc99c bytes) 2024-09-21T15:09:47.380 INFO:teuthology.orchestra.run.smithi161.stdout:3382 write 0x6ff614f thru 0x700472f (0xe5e1 bytes) 2024-09-21T15:09:47.414 INFO:teuthology.orchestra.run.smithi161.stdout:4723 read 0x51bc97d thru 0x51c70f7 (0xa77b bytes) 2024-09-21T15:09:47.414 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.414 INFO:teuthology.orchestra.run.smithi161.stdout:3385 punch from 0x69b971f to 0x69c5fc1, (0xc8a2 bytes) 2024-09-21T15:09:47.415 INFO:teuthology.orchestra.run.smithi161.stdout:4724 writesame 0x62b5ce3 thru 0x62b7906 data_size 0x2(0x1c24 bytes) 2024-09-21T15:09:47.415 INFO:teuthology.orchestra.run.smithi161.stdout:3386 write 0xcbc6964 thru 0xcbc8fb2 (0x264f bytes) 2024-09-21T15:09:47.420 INFO:teuthology.orchestra.run.smithi161.stdout:4074 trunc from 0x73bb76f to 0x6b2897e 2024-09-21T15:09:47.430 INFO:teuthology.orchestra.run.smithi161.stdout:4903 write 0x9f2d90b thru 0x9f33cbd (0x63b3 bytes) 2024-09-21T15:09:47.433 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.434 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.434 INFO:teuthology.orchestra.run.smithi161.stdout:3389 write 0xe726edc thru 0xe734bed (0xdd12 bytes) 2024-09-21T15:09:47.448 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.448 INFO:teuthology.orchestra.run.smithi161.stdout:4722 punch from 0x2bb4205 to 0x2bb8277, (0x4072 bytes) 2024-09-21T15:09:47.450 INFO:teuthology.orchestra.run.smithi161.stdout:4904 write 0x7ea1237 thru 0x7ea9b3d (0x8907 bytes) 2024-09-21T15:09:47.463 INFO:teuthology.orchestra.run.smithi161.stdout:4075 punch from 0x158c006 to 0x1595253, (0x924d bytes) 2024-09-21T15:09:47.468 INFO:teuthology.orchestra.run.smithi161.stdout:3394 read 0x49b2e45 thru 0x49b32ed (0x4a9 bytes) 2024-09-21T15:09:47.469 INFO:teuthology.orchestra.run.smithi161.stdout:3395 writesame 0x50de1ed thru 0x50e1d42 data_size 0x46(0x3b56 bytes) 2024-09-21T15:09:47.471 INFO:teuthology.orchestra.run.smithi161.stdout:4907 writesame 0x49dbce3 thru 0x49e5cf3 data_size 0x57(0xa011 bytes) 2024-09-21T15:09:47.490 INFO:teuthology.orchestra.run.smithi161.stdout:4728 writesame 0xe01d2b5 thru 0xe020104 data_size 0x39(0x2e50 bytes) 2024-09-21T15:09:47.496 INFO:teuthology.orchestra.run.smithi161.stdout:4729 writesame 0x682ed66 thru 0x683ced3 data_size 0x3a(0xe16e bytes) 2024-09-21T15:09:47.517 INFO:teuthology.orchestra.run.smithi161.stdout:4908 punch from 0x6c831b5 to 0x6c8956f, (0x63ba bytes) 2024-09-21T15:09:47.517 INFO:teuthology.orchestra.run.smithi161.stdout:4910 read 0x53c0010 thru 0x53c32d2 (0x32c3 bytes) 2024-09-21T15:09:47.517 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.519 INFO:teuthology.orchestra.run.smithi161.stdout:4723 writesame 0x70d285a thru 0x70de652 data_size 0x57(0xbdf9 bytes) 2024-09-21T15:09:47.524 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.524 INFO:teuthology.orchestra.run.smithi161.stdout:3397 read 0x76e513b thru 0x76f1439 (0xc2ff bytes) 2024-09-21T15:09:47.525 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.525 INFO:teuthology.orchestra.run.smithi161.stdout:3399 read 0xe020ec0 thru 0xe023a98 (0x2bd9 bytes) 2024-09-21T15:09:47.525 INFO:teuthology.orchestra.run.smithi161.stdout:3400 read 0xaf18fa4 thru 0xaf1cda2 (0x3dff bytes) 2024-09-21T15:09:47.526 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.526 INFO:teuthology.orchestra.run.smithi161.stdout:3403 read 0x395448 thru 0x39d154 (0x7d0d bytes) 2024-09-21T15:09:47.531 INFO:teuthology.orchestra.run.smithi161.stdout:4912 trunc from 0x9f33cbe to 0x4e940ed 2024-09-21T15:09:47.532 INFO:teuthology.orchestra.run.smithi161.stdout:3404 read 0x56743ea thru 0x567acf7 (0x690e bytes) 2024-09-21T15:09:47.533 INFO:teuthology.orchestra.run.smithi161.stdout:3405 writesame 0x23b4fff thru 0x23b7d9b data_size 0x1(0x2d9d bytes) 2024-09-21T15:09:47.536 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #24, image image_cluster1.client.mirror.1-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent25 2024-09-21T15:09:47.537 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.537 INFO:teuthology.orchestra.run.smithi161.stdout:4725 read 0x1927985 thru 0x19310c0 (0x973c bytes) 2024-09-21T15:09:47.540 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.540 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.540 INFO:teuthology.orchestra.run.smithi161.stdout:4730 punch from 0x249bd23 to 0x24a07a8, (0x4a85 bytes) 2024-09-21T15:09:47.540 INFO:teuthology.orchestra.run.smithi161.stdout:4731 write 0x536e98b thru 0x53781f4 (0x986a bytes) 2024-09-21T15:09:47.541 INFO:teuthology.orchestra.run.smithi161.stdout:4730 read 0xed89f thru 0xfd5e6 (0xfd48 bytes) 2024-09-21T15:09:47.541 INFO:teuthology.orchestra.run.smithi161.stdout:4077 write 0xb3db015 thru 0xb3dfa57 (0x4a43 bytes) 2024-09-21T15:09:47.545 INFO:teuthology.orchestra.run.smithi161.stdout:4731 read 0xd92070c thru 0xd925979 (0x526e bytes) 2024-09-21T15:09:47.545 INFO:teuthology.orchestra.run.smithi161.stdout:4733 read 0xbbe7ff9 thru 0xbbebf98 (0x3fa0 bytes) 2024-09-21T15:09:47.551 INFO:teuthology.orchestra.run.smithi161.stdout:4734 trunc from 0xe020105 to 0xb362999 2024-09-21T15:09:47.551 INFO:teuthology.orchestra.run.smithi161.stdout:3407 writesame 0xd92d95c thru 0xd9357f2 data_size 0x1(0x7e97 bytes) 2024-09-21T15:09:47.554 INFO:teuthology.orchestra.run.smithi161.stdout:4078 write 0x23d0e7f thru 0x23d7d5e (0x6ee0 bytes) 2024-09-21T15:09:47.567 INFO:teuthology.orchestra.run.smithi161.stdout:4079 write 0x5cd011d thru 0x5cd0f40 (0xe24 bytes) 2024-09-21T15:09:47.580 INFO:teuthology.orchestra.run.smithi161.stdout:4080 read 0x9de0558 thru 0x9de45c5 (0x406e bytes) 2024-09-21T15:09:47.586 INFO:teuthology.orchestra.run.smithi161.stdout:3408 clone 42 order 20 su 65536 sc 5 2024-09-21T15:09:47.594 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.595 INFO:teuthology.orchestra.run.smithi161.stdout:4736 read 0x60c5db0 thru 0x60c9b29 (0x3d7a bytes) 2024-09-21T15:09:47.595 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.595 INFO:teuthology.orchestra.run.smithi161.stdout:4738 punch from 0x75a2565 to 0x75a4f67, (0x2a02 bytes) 2024-09-21T15:09:47.595 INFO:teuthology.orchestra.run.smithi161.stdout:4740 write 0x1afd766 thru 0x1b05ce5 (0x8580 bytes) 2024-09-21T15:09:47.615 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.615 INFO:teuthology.orchestra.run.smithi161.stdout:4914 clone 31 order 20 su 32768 sc 5 2024-09-21T15:09:47.617 INFO:teuthology.orchestra.run.smithi161.stdout:4732 write 0xabc909b thru 0xabcdad8 (0x4a3e bytes) 2024-09-21T15:09:47.624 INFO:teuthology.orchestra.run.smithi161.stdout:4081 writesame 0xc07d7a0 thru 0xc087ed6 data_size 0x13(0xa737 bytes) 2024-09-21T15:09:47.636 INFO:teuthology.orchestra.run.smithi161.stdout:4082 read 0x79c5c4b thru 0x79d1f6f (0xc325 bytes) 2024-09-21T15:09:47.636 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.637 INFO:teuthology.orchestra.run.smithi161.stdout:4084 punch from 0x2ebd56f to 0x2ecad61, (0xd7f2 bytes) 2024-09-21T15:09:47.637 INFO:teuthology.orchestra.run.smithi161.stdout:4085 punch from 0x30a39e6 to 0x30a44f5, (0xb0f bytes) 2024-09-21T15:09:47.637 INFO:teuthology.orchestra.run.smithi161.stdout:4086 read 0xab8176b thru 0xab8caf0 (0xb386 bytes) 2024-09-21T15:09:47.637 INFO:teuthology.orchestra.run.smithi161.stdout:4736 writesame 0xa964edf thru 0xa974d95 data_size 0x1(0xfeb7 bytes) 2024-09-21T15:09:47.640 INFO:teuthology.orchestra.run.smithi161.stdout:4742 read 0x8852f3 thru 0x885459 (0x167 bytes) 2024-09-21T15:09:47.641 INFO:teuthology.orchestra.run.smithi161.stdout:4744 read 0x1a3a4fe thru 0x1a43579 (0x907c bytes) 2024-09-21T15:09:47.645 INFO:teuthology.orchestra.run.smithi161.stdout:4746 write 0x1a1c9df thru 0x1a222b1 (0x58d3 bytes) 2024-09-21T15:09:47.663 INFO:teuthology.orchestra.run.smithi161.stdout:4748 write 0xad68df8 thru 0xad6f94f (0x6b58 bytes) 2024-09-21T15:09:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:4752 read 0x82867a5 thru 0x8296336 (0xfb92 bytes) 2024-09-21T15:09:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:4754 write 0x9fd0e40 thru 0x9fd68a6 (0x5a67 bytes) 2024-09-21T15:09:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:4738 read 0x1ec85ce thru 0x1ed59ed (0xd420 bytes) 2024-09-21T15:09:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:4742 read 0x1082963 thru 0x1084239 (0x18d7 bytes) 2024-09-21T15:09:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:4087 write 0xe8ef927 thru 0xe8f8c3b (0x9315 bytes) 2024-09-21T15:09:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:4743 punch from 0x6f1430 to 0x6fa90b, (0x94db bytes) 2024-09-21T15:09:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.708 INFO:teuthology.orchestra.run.smithi161.stdout:4748 trunc from 0xabcdad9 to 0x5fb6ad4 2024-09-21T15:09:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:4088 write 0xbeecec4 thru 0xbeee0c7 (0x1204 bytes) 2024-09-21T15:09:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:4089 read 0x1057e4b thru 0x105aacb (0x2c81 bytes) 2024-09-21T15:09:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:4090 write 0x7ec5b8b thru 0x7ec5f52 (0x3c8 bytes) 2024-09-21T15:09:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:4094 write 0xaf5bce4 thru 0xaf60525 (0x4842 bytes) 2024-09-21T15:09:47.742 INFO:teuthology.orchestra.run.smithi161.stdout:4095 write 0x8f4204d thru 0x8f4eb3c (0xcaf0 bytes) 2024-09-21T15:09:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:4096 write 0x957f5b6 thru 0x958b035 (0xba80 bytes) 2024-09-21T15:09:47.764 INFO:teuthology.orchestra.run.smithi161.stdout:4757 writesame 0xdeee431 thru 0xdefbaad data_size 0x3(0xd67d bytes) 2024-09-21T15:09:47.765 INFO:teuthology.orchestra.run.smithi161.stdout:4097 writesame 0x1617cfb thru 0x162717e data_size 0x2(0xf484 bytes) 2024-09-21T15:09:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:4758 trunc from 0xdefbaae to 0x747363c 2024-09-21T15:09:47.795 INFO:teuthology.orchestra.run.smithi161.stdout:4098 write 0xa562c88 thru 0xa5672ef (0x4668 bytes) 2024-09-21T15:09:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:4750 writesame 0x955bd11 thru 0x9567860 data_size 0x1(0xbb50 bytes) 2024-09-21T15:09:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:4751 read 0x1ba688d thru 0x1bb4b60 (0xe2d4 bytes) 2024-09-21T15:09:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:4099 writesame 0x7fc6769 thru 0x7fd668a data_size 0x22(0xff22 bytes) 2024-09-21T15:09:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:4100 writesame 0x3940005 thru 0x394fad1 data_size 0x1(0xfacd bytes) 2024-09-21T15:09:47.847 INFO:teuthology.orchestra.run.smithi161.stdout:4759 punch from 0x2ad674d to 0x2ae35e7, (0xce9a bytes) 2024-09-21T15:09:47.847 INFO:teuthology.orchestra.run.smithi161.stdout:4761 read 0x45c15e2 thru 0x45c9bbb (0x85da bytes) 2024-09-21T15:09:47.848 INFO:teuthology.orchestra.run.smithi161.stdout:4762 punch from 0x7458702 to 0x7459e8e, (0x178c bytes) 2024-09-21T15:09:47.848 INFO:teuthology.orchestra.run.smithi161.stdout:4763 punch from 0x398a209 to 0x3991281, (0x7078 bytes) 2024-09-21T15:09:47.848 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.848 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.850 INFO:teuthology.orchestra.run.smithi161.stdout:4753 writesame 0xb5d4247 thru 0xb5d7143 data_size 0x1(0x2efd bytes) 2024-09-21T15:09:47.855 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.856 INFO:teuthology.orchestra.run.smithi161.stdout:4755 trunc from 0xb5d7144 to 0xa99018f 2024-09-21T15:09:47.859 INFO:teuthology.orchestra.run.smithi161.stdout:4767 trunc from 0x747363c to 0xceaac7f 2024-09-21T15:09:47.874 INFO:teuthology.orchestra.run.smithi161.stdout:4102 write 0xccd75be thru 0xccd9924 (0x2367 bytes) 2024-09-21T15:09:47.888 INFO:teuthology.orchestra.run.smithi161.stdout:4768 writesame 0x8a4e88 thru 0x8afd21 data_size 0x1(0xae9a bytes) 2024-09-21T15:09:47.894 INFO:teuthology.orchestra.run.smithi161.stdout:4756 write 0x8d0cbb8 thru 0x8d18ca7 (0xc0f0 bytes) 2024-09-21T15:09:47.902 INFO:teuthology.orchestra.run.smithi161.stdout:4103 trunc from 0xe8f8c3c to 0x8faea84 2024-09-21T15:09:47.918 INFO:teuthology.orchestra.run.smithi161.stdout:4758 read 0x2adf8fc thru 0x2ae3a6b (0x4170 bytes) 2024-09-21T15:09:47.926 INFO:teuthology.orchestra.run.smithi161.stdout:4759 trunc from 0xa99018f to 0xe66fb48 2024-09-21T15:09:47.946 INFO:teuthology.orchestra.run.smithi161.stdout:4739 read 0x2598e65 thru 0x259cb0e (0x3caa bytes) 2024-09-21T15:09:47.951 INFO:teuthology.orchestra.run.smithi161.stdout:4769 write 0x228aa0d thru 0x228c86a (0x1e5e bytes) 2024-09-21T15:09:47.979 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.979 INFO:teuthology.orchestra.run.smithi161.stdout:4761 write 0x684caf1 thru 0x685c894 (0xfda4 bytes) 2024-09-21T15:09:47.981 INFO:teuthology.orchestra.run.smithi161.stdout:4741 write 0xb1bfeae thru 0xb1ce85c (0xe9af bytes) 2024-09-21T15:09:47.985 INFO:teuthology.orchestra.run.smithi161.stdout:4104 punch from 0x61b73c5 to 0x61b8f17, (0x1b52 bytes) 2024-09-21T15:09:47.986 INFO:teuthology.orchestra.run.smithi161.stdout:4105 write 0x6cfc290 thru 0x6cfd30a (0x107b bytes) 2024-09-21T15:09:47.989 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:47.989 INFO:teuthology.orchestra.run.smithi161.stdout:4772 write 0x1999ab1 thru 0x19a84e7 (0xea37 bytes) 2024-09-21T15:09:47.998 INFO:teuthology.orchestra.run.smithi161.stdout:4107 write 0x15441fc thru 0x154eace (0xa8d3 bytes) 2024-09-21T15:09:48.037 INFO:teuthology.orchestra.run.smithi161.stdout:4762 trunc from 0xe66fb48 to 0x250bec3 2024-09-21T15:09:48.039 INFO:teuthology.orchestra.run.smithi161.stdout:4109 writesame 0x59980c7 thru 0x599e0f6 data_size 0x72(0x6030 bytes) 2024-09-21T15:09:48.048 INFO:teuthology.orchestra.run.smithi161.stdout:4110 read 0x2b6546e thru 0x2b718a8 (0xc43b bytes) 2024-09-21T15:09:48.053 INFO:teuthology.orchestra.run.smithi161.stdout:4111 trunc from 0x8faea84 to 0xaa51113 2024-09-21T15:09:48.066 INFO:teuthology.orchestra.run.smithi161.stdout:4774 writesame 0x490d379 thru 0x490f93c data_size 0x2(0x25c4 bytes) 2024-09-21T15:09:48.089 INFO:teuthology.orchestra.run.smithi161.stdout:4777 punch from 0xc8c5de8 to 0xc8ce34c, (0x8564 bytes) 2024-09-21T15:09:48.090 INFO:teuthology.orchestra.run.smithi161.stdout:4778 writesame 0x9a88316 thru 0x9a92904 data_size 0x1(0xa5ef bytes) 2024-09-21T15:09:48.108 INFO:teuthology.orchestra.run.smithi161.stdout:4742 write 0xea4f054 thru 0xea5eb38 (0xfae5 bytes) 2024-09-21T15:09:48.109 INFO:teuthology.orchestra.run.smithi161.stdout:4764 read 0x228f31f thru 0x229058e (0x1270 bytes) 2024-09-21T15:09:48.112 INFO:teuthology.orchestra.run.smithi161.stdout:4113 trunc from 0xaa51113 to 0xb9cf3a3 2024-09-21T15:09:48.138 INFO:teuthology.orchestra.run.smithi161.stdout:4779 punch from 0x197b3cb to 0x1989c3e, (0xe873 bytes) 2024-09-21T15:09:48.138 INFO:teuthology.orchestra.run.smithi161.stdout:4780 write 0x9e58119 thru 0x9e5f44d (0x7335 bytes) 2024-09-21T15:09:48.149 INFO:teuthology.orchestra.run.smithi161.stdout:4743 punch from 0xfbb80d to 0xfc7bc5, (0xc3b8 bytes) 2024-09-21T15:09:48.149 INFO:teuthology.orchestra.run.smithi161.stdout:4744 writesame 0x649bce4 thru 0x64a4dc8 data_size 0x7(0x90e5 bytes) 2024-09-21T15:09:48.164 INFO:teuthology.orchestra.run.smithi161.stdout:4114 read 0x4f0868 thru 0x4fcbc3 (0xc35c bytes) 2024-09-21T15:09:48.165 INFO:teuthology.orchestra.run.smithi161.stdout:4115 write 0x6f0ecad thru 0x6f152fd (0x6651 bytes) 2024-09-21T15:09:48.170 INFO:teuthology.orchestra.run.smithi161.stdout:4781 writesame 0xc7358d1 thru 0xc7431c7 data_size 0x1(0xd8f7 bytes) 2024-09-21T15:09:48.192 INFO:teuthology.orchestra.run.smithi161.stdout:4118 read 0x1fa05bc thru 0x1fa2523 (0x1f68 bytes) 2024-09-21T15:09:48.192 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:48.193 INFO:teuthology.orchestra.run.smithi161.stdout:4120 read 0x91e3ff6 thru 0x91e7449 (0x3454 bytes) 2024-09-21T15:09:48.193 INFO:teuthology.orchestra.run.smithi161.stdout:4121 punch from 0x1714d91 to 0x1722a3f, (0xdcae bytes) 2024-09-21T15:09:48.193 INFO:teuthology.orchestra.run.smithi161.stdout:4122 write 0x39bd7fe thru 0x39c04a8 (0x2cab bytes) 2024-09-21T15:09:48.203 INFO:teuthology.orchestra.run.smithi161.stdout:4123 writesame 0x945c7e1 thru 0x945d178 data_size 0x4(0x998 bytes) 2024-09-21T15:09:48.227 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:48.229 INFO:teuthology.orchestra.run.smithi161.stdout:4124 punch from 0x3e07499 to 0x3e08409, (0xf70 bytes) 2024-09-21T15:09:48.230 INFO:teuthology.orchestra.run.smithi161.stdout:4126 writesame 0x29c7c7e thru 0x29c8ae6 data_size 0x11(0xe69 bytes) 2024-09-21T15:09:48.274 INFO:teuthology.orchestra.run.smithi161.stdout:4765 writesame 0xb9ee648 thru 0xb9efdae data_size 0x1(0x1767 bytes) 2024-09-21T15:09:48.277 INFO:teuthology.orchestra.run.smithi161.stdout:4766 write 0x2c7f8ca thru 0x2c846a0 (0x4dd7 bytes) 2024-09-21T15:09:48.291 INFO:teuthology.orchestra.run.smithi161.stdout:4127 punch from 0x718e61e to 0x7193cca, (0x56ac bytes) 2024-09-21T15:09:48.309 INFO:teuthology.orchestra.run.smithi161.stdout:4128 trunc from 0xb9cf3a3 to 0x327bf31 2024-09-21T15:09:48.319 INFO:teuthology.orchestra.run.smithi161.stdout:4767 read 0x5d41bc4 thru 0x5d41d72 (0x1af bytes) 2024-09-21T15:09:48.319 INFO:teuthology.orchestra.run.smithi161.stdout:4768 writesame 0x652a931 thru 0x6534d36 data_size 0x26(0xa406 bytes) 2024-09-21T15:09:48.321 INFO:teuthology.orchestra.run.smithi161.stdout:4783 write 0xe0de7c3 thru 0xe0e99c2 (0xb200 bytes) 2024-09-21T15:09:48.365 INFO:teuthology.orchestra.run.smithi161.stdout:4769 trunc from 0xb9efdaf to 0x4cf3bd 2024-09-21T15:09:48.380 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:48.380 INFO:teuthology.orchestra.run.smithi161.stdout:4132 punch from 0x33258f to 0x33fb8d, (0xd5fe bytes) 2024-09-21T15:09:48.380 INFO:teuthology.orchestra.run.smithi161.stdout:4133 read 0xe7056d thru 0xe75081 (0x4b15 bytes) 2024-09-21T15:09:48.381 INFO:teuthology.orchestra.run.smithi161.stdout:4134 read 0x2def90f thru 0x2df5a3f (0x6131 bytes) 2024-09-21T15:09:48.381 INFO:teuthology.orchestra.run.smithi161.stdout:4784 writesame 0x3c6b830 thru 0x3c6b887 data_size 0x1(0x58 bytes) 2024-09-21T15:09:48.390 INFO:teuthology.orchestra.run.smithi161.stdout:4785 read 0x3695cbd thru 0x36a1367 (0xb6ab bytes) 2024-09-21T15:09:48.396 INFO:teuthology.orchestra.run.smithi161.stdout:4786 read 0x1b4fbb1 thru 0x1b5d6fb (0xdb4b bytes) 2024-09-21T15:09:48.424 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:48.424 INFO:teuthology.orchestra.run.smithi161.stdout:4788 write 0x7e5a1c5 thru 0x7e68e0b (0xec47 bytes) 2024-09-21T15:09:48.482 INFO:teuthology.orchestra.run.smithi161.stdout:4789 writesame 0x91ded17 thru 0x91e99b6 data_size 0x10(0xaca0 bytes) 2024-09-21T15:09:48.497 INFO:teuthology.orchestra.run.smithi161.stdout:4135 write 0x79288c5 thru 0x7935807 (0xcf43 bytes) 2024-09-21T15:09:48.508 INFO:teuthology.orchestra.run.smithi161.stdout:4770 trunc from 0x4cf3bd to 0x12aa241 2024-09-21T15:09:48.522 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:48.523 INFO:teuthology.orchestra.run.smithi161.stdout:4791 write 0x12fe53d thru 0x1304d20 (0x67e4 bytes) 2024-09-21T15:09:48.538 INFO:teuthology.orchestra.run.smithi161.stdout:4748 writesame 0x35c8868 thru 0x35cf9fe data_size 0x1b(0x7197 bytes) 2024-09-21T15:09:48.541 INFO:teuthology.orchestra.run.smithi161.stdout:4792 punch from 0xeffc55 to 0xf06e3b, (0x71e6 bytes) 2024-09-21T15:09:48.541 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:48.541 INFO:teuthology.orchestra.run.smithi161.stdout:4795 read 0x51ebd07 thru 0x51f5c92 (0x9f8c bytes) 2024-09-21T15:09:48.548 INFO:teuthology.orchestra.run.smithi161.stdout:4771 read 0x448e7d thru 0x453301 (0xa485 bytes) 2024-09-21T15:09:48.553 INFO:teuthology.orchestra.run.smithi161.stdout:4796 trunc from 0xe0e99c3 to 0x86074c2 2024-09-21T15:09:48.553 INFO:teuthology.orchestra.run.smithi161.stdout:4774 punch from 0xfe24a2 to 0xfe50d2, (0x2c30 bytes) 2024-09-21T15:09:48.555 INFO:teuthology.orchestra.run.smithi161.stdout:4137 write 0xaca4335 thru 0xacaf697 (0xb363 bytes) 2024-09-21T15:09:48.565 INFO:teuthology.orchestra.run.smithi161.stdout:4139 write 0x8a5b872 thru 0x8a62fec (0x777b bytes) 2024-09-21T15:09:48.587 INFO:teuthology.orchestra.run.smithi161.stdout:4140 write 0x592d7f8 thru 0x5931440 (0x3c49 bytes) 2024-09-21T15:09:48.605 INFO:teuthology.orchestra.run.smithi161.stdout:4775 write 0x3be9189 thru 0x3bf3326 (0xa19e bytes) 2024-09-21T15:09:48.665 INFO:teuthology.orchestra.run.smithi161.stdout:4797 read 0xde4acf thru 0xdf42dc (0xf80e bytes) 2024-09-21T15:09:48.670 INFO:teuthology.orchestra.run.smithi161.stdout:4776 writesame 0xbe591dc thru 0xbe688fd data_size 0x7(0xf722 bytes) 2024-09-21T15:09:48.675 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:48.675 INFO:teuthology.orchestra.run.smithi161.stdout:4779 read 0x8760509 thru 0x876e9a7 (0xe49f bytes) 2024-09-21T15:09:48.680 INFO:teuthology.orchestra.run.smithi161.stdout:4780 trunc from 0xbe688fe to 0xe28519e 2024-09-21T15:09:48.694 INFO:teuthology.orchestra.run.smithi161.stdout:4141 trunc from 0xacaf698 to 0x57f4650 2024-09-21T15:09:48.699 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:48.699 INFO:teuthology.orchestra.run.smithi161.stdout:4750 write 0x37e7583 thru 0x37e82bd (0xd3b bytes) 2024-09-21T15:09:48.719 INFO:teuthology.orchestra.run.smithi161.stdout:4799 write 0xd0bfc41 thru 0xd0c34ab (0x386b bytes) 2024-09-21T15:09:48.726 INFO:teuthology.orchestra.run.smithi161.stdout:4781 read 0xb5244d2 thru 0xb52484a (0x379 bytes) 2024-09-21T15:09:48.727 INFO:teuthology.orchestra.run.smithi161.stdout:4782 write 0x4397aae thru 0x439b617 (0x3b6a bytes) 2024-09-21T15:09:48.744 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:48.744 INFO:teuthology.orchestra.run.smithi161.stdout:4784 clone 33 order 19 su 8192 sc 8 2024-09-21T15:09:48.748 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:48.758 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone41 from 0xe821832 (overlap 0x276aa21) to 0xbd3309 2024-09-21T15:09:48.804 INFO:teuthology.orchestra.run.smithi161.stdout:4803 write 0xe1c2ad1 thru 0xe1c8584 (0x5ab4 bytes) 2024-09-21T15:09:48.818 INFO:teuthology.orchestra.run.smithi161.stdout:4143 writesame 0xb454d7a thru 0xb45fe9f data_size 0x19(0xb126 bytes) 2024-09-21T15:09:48.827 INFO:teuthology.orchestra.run.smithi161.stdout:4751 write 0x8f940e7 thru 0x8f993ba (0x52d4 bytes) 2024-09-21T15:09:48.828 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #29, image image_cluster1.client.mirror.2-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent30 2024-09-21T15:09:48.839 INFO:teuthology.orchestra.run.smithi161.stdout:4804 read 0xc7abd6a thru 0xc7b6d4d (0xafe4 bytes) 2024-09-21T15:09:48.839 INFO:teuthology.orchestra.run.smithi161.stdout:4805 read 0x73aaa9f thru 0x73b5827 (0xad89 bytes) 2024-09-21T15:09:48.840 INFO:teuthology.orchestra.run.smithi161.stdout:4806 read 0x888906c thru 0x888c6f5 (0x368a bytes) 2024-09-21T15:09:48.841 INFO:teuthology.orchestra.run.smithi161.stdout:4807 read 0xa61a262 thru 0xa626bcd (0xc96c bytes) 2024-09-21T15:09:48.841 INFO:teuthology.orchestra.run.smithi161.stdout:4808 write 0xb39b702 thru 0xb39ef71 (0x3870 bytes) 2024-09-21T15:09:48.855 INFO:teuthology.orchestra.run.smithi161.stdout:4144 trunc from 0xb45fea0 to 0x4c64218 2024-09-21T15:09:48.879 INFO:teuthology.orchestra.run.smithi161.stdout:4809 flatten 2024-09-21T15:09:49.340 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.331+0000 7f1e9c77a700 -1 reset not still connected to 0x562889a48750 2024-09-21T15:09:49.340 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.335+0000 7f1e9c77a700 -1 reset not still connected to 0x56288edfc9c0 2024-09-21T15:09:49.340 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.335+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f959ba0 2024-09-21T15:09:49.344 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.339+0000 7f1e9c77a700 -1 reset not still connected to 0x562890035520 2024-09-21T15:09:49.348 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.339+0000 7f1e9c77a700 -1 reset not still connected to 0x5628908044e0 2024-09-21T15:09:49.348 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.339+0000 7f1e9c77a700 -1 reset not still connected to 0x562890805d40 2024-09-21T15:09:49.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.339+0000 7f1e9c77a700 -1 reset not still connected to 0x56289097b110 2024-09-21T15:09:49.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.339+0000 7f1e9c77a700 -1 reset not still connected to 0x562890d15860 2024-09-21T15:09:49.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.339+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5930 2024-09-21T15:09:49.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.339+0000 7f1e9c77a700 -1 reset not still connected to 0x562897c70ea0 2024-09-21T15:09:49.352 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.343+0000 7f1e9c77a700 -1 reset not still connected to 0x562897c71040 2024-09-21T15:09:49.353 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.343+0000 7f1e9c77a700 -1 reset not still connected to 0x562899844b60 2024-09-21T15:09:49.354 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.347+0000 7f1e9c77a700 -1 reset not still connected to 0x56289cc5f5f0 2024-09-21T15:09:49.356 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.351+0000 7f1e9c77a700 -1 reset not still connected to 0x56289e304750 2024-09-21T15:09:49.356 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.351+0000 7f1e9c77a700 -1 reset not still connected to 0x56289f19e820 2024-09-21T15:09:49.356 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.351+0000 7f1e9c77a700 -1 reset not still connected to 0x56289f998270 2024-09-21T15:09:49.356 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.351+0000 7f1e9c77a700 -1 reset not still connected to 0x56289fa76750 2024-09-21T15:09:49.357 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.351+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a22ebee0 2024-09-21T15:09:49.357 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.351+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a22ff110 2024-09-21T15:09:49.357 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.351+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2e89860 2024-09-21T15:09:49.357 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:49.351+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a46e1380 2024-09-21T15:09:49.365 INFO:teuthology.orchestra.run.smithi161.stdout:4753 read 0xd1e1350 thru 0xd1ead6b (0x9a1c bytes) 2024-09-21T15:09:49.366 INFO:teuthology.orchestra.run.smithi161.stdout:4754 read 0xafaf4ce thru 0xafb798e (0x84c1 bytes) 2024-09-21T15:09:49.367 INFO:teuthology.orchestra.run.smithi161.stdout:4755 write 0x1cd06b thru 0x1d5dc3 (0x8d59 bytes) 2024-09-21T15:09:49.376 INFO:teuthology.orchestra.run.smithi161.stdout:4145 write 0x7b9a50d thru 0x7ba7bbe (0xd6b2 bytes) 2024-09-21T15:09:49.677 INFO:teuthology.orchestra.run.smithi161.stdout:4147 write 0x89d90a7 thru 0x89e09da (0x7934 bytes) 2024-09-21T15:09:49.853 INFO:teuthology.orchestra.run.smithi161.stdout:4148 write 0x9ab65c7 thru 0x9ac1549 (0xaf83 bytes) 2024-09-21T15:09:49.869 INFO:teuthology.orchestra.run.smithi161.stdout:4149 trunc from 0x9ac154a to 0xb902298 2024-09-21T15:09:49.940 INFO:teuthology.orchestra.run.smithi161.stdout:4915 write 0xaed898d thru 0xaee2ddc (0xa450 bytes) 2024-09-21T15:09:49.952 INFO:teuthology.orchestra.run.smithi161.stdout:4151 trunc from 0xb902298 to 0x32af1c7 2024-09-21T15:09:49.987 INFO:teuthology.orchestra.run.smithi161.stdout:4916 read 0x8338bff thru 0x833f711 (0x6b13 bytes) 2024-09-21T15:09:49.996 INFO:teuthology.orchestra.run.smithi161.stdout:4756 writesame 0x2b6b4a7 thru 0x2b73b0d data_size 0x3(0x8667 bytes) 2024-09-21T15:09:50.000 INFO:teuthology.orchestra.run.smithi161.stdout:4917 trunc from 0xaee2ddd to 0x3d3f4dd 2024-09-21T15:09:50.013 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #40, image image_cluster1.client.mirror.3-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent41 2024-09-21T15:09:50.083 INFO:teuthology.orchestra.run.smithi161.stdout:4152 writesame 0xd0523b6 thru 0xd05c9af data_size 0xe(0xa5fa bytes) 2024-09-21T15:09:50.087 INFO:teuthology.orchestra.run.smithi161.stdout:4154 write 0x3559c54 thru 0x3564dde (0xb18b bytes) 2024-09-21T15:09:50.094 INFO:teuthology.orchestra.run.smithi161.stdout:4918 punch from 0x27ea491 to 0x27ec5c5, (0x2134 bytes) 2024-09-21T15:09:50.148 INFO:teuthology.orchestra.run.smithi161.stdout:4156 read 0x35677ef thru 0x356e0b5 (0x68c7 bytes) 2024-09-21T15:09:50.149 INFO:teuthology.orchestra.run.smithi161.stdout:4157 write 0x6f707c6 thru 0x6f7f949 (0xf184 bytes) 2024-09-21T15:09:50.173 INFO:teuthology.orchestra.run.smithi161.stdout:4810 write 0x248386f thru 0x249094f (0xd0e1 bytes) 2024-09-21T15:09:50.188 INFO:teuthology.orchestra.run.smithi161.stdout:4757 write 0x786a566 thru 0x786f0b8 (0x4b53 bytes) 2024-09-21T15:09:50.317 INFO:teuthology.orchestra.run.smithi161.stdout:4919 write 0xc029960 thru 0xc02f62c (0x5ccd bytes) 2024-09-21T15:09:50.341 INFO:teuthology.orchestra.run.smithi161.stdout:4922 read 0xa6306d7 thru 0xa633e81 (0x37ab bytes) 2024-09-21T15:09:50.341 INFO:teuthology.orchestra.run.smithi161.stdout:4924 read 0x248e611 thru 0x249526d (0x6c5d bytes) 2024-09-21T15:09:50.342 INFO:teuthology.orchestra.run.smithi161.stdout:4925 trunc from 0xc02f62d to 0xb90c5f3 2024-09-21T15:09:50.347 INFO:teuthology.orchestra.run.smithi161.stdout:4812 write 0x2ffde69 thru 0x300254a (0x46e2 bytes) 2024-09-21T15:09:50.348 INFO:teuthology.orchestra.run.smithi161.stdout:4159 read 0xb47dbc0 thru 0xb489f8b (0xc3cc bytes) 2024-09-21T15:09:50.351 INFO:teuthology.orchestra.run.smithi161.stdout:4161 clone 37 order 21 su 1048576 sc 8 2024-09-21T15:09:50.356 INFO:teuthology.orchestra.run.smithi161.stdout:4758 trunc from 0xea5eb39 to 0xc073e27 2024-09-21T15:09:50.373 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #31, image image_cluster1.client.mirror.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent32 2024-09-21T15:09:50.376 INFO:teuthology.orchestra.run.smithi161.stdout:4813 punch from 0x49fd32d to 0x4a0aebe, (0xdb91 bytes) 2024-09-21T15:09:50.376 INFO:teuthology.orchestra.run.smithi161.stdout:4814 write 0xc870d9f thru 0xc878fee (0x8250 bytes) 2024-09-21T15:09:50.405 INFO:teuthology.orchestra.run.smithi161.stdout:4816 writesame 0x57649e6 thru 0x576d398 data_size 0x1(0x89b3 bytes) 2024-09-21T15:09:50.423 INFO:teuthology.orchestra.run.smithi161.stdout:4785 punch from 0xa67f8b to 0xa73a3b, (0xbab0 bytes) 2024-09-21T15:09:50.434 INFO:teuthology.orchestra.run.smithi161.stdout:4818 punch from 0xb1e9f03 to 0xb1f185e, (0x795b bytes) 2024-09-21T15:09:50.434 INFO:teuthology.orchestra.run.smithi161.stdout:4820 punch from 0x2d4bb88 to 0x2d4de4e, (0x22c6 bytes) 2024-09-21T15:09:50.434 INFO:teuthology.orchestra.run.smithi161.stdout:4821 write 0x1ecc306 thru 0x1edb599 (0xf294 bytes) 2024-09-21T15:09:50.447 INFO:teuthology.orchestra.run.smithi161.stdout:4926 writesame 0xc2bbdcb thru 0xc2be661 data_size 0x1(0x2897 bytes) 2024-09-21T15:09:50.455 INFO:teuthology.orchestra.run.smithi161.stdout:4786 write 0x8a540e6 thru 0x8a5acde (0x6bf9 bytes) 2024-09-21T15:09:50.456 INFO:teuthology.orchestra.run.smithi161.stdout:4823 read 0x34031d0 thru 0x340d4f0 (0xa321 bytes) 2024-09-21T15:09:50.465 INFO:teuthology.orchestra.run.smithi161.stdout:4759 write 0x6b60e72 thru 0x6b613d3 (0x562 bytes) 2024-09-21T15:09:50.473 INFO:teuthology.orchestra.run.smithi161.stdout:4927 trunc from 0xc2be662 to 0x32a793e 2024-09-21T15:09:50.476 INFO:teuthology.orchestra.run.smithi161.stdout:4824 trunc from 0xe1c8585 to 0x57be8ea 2024-09-21T15:09:50.523 INFO:teuthology.orchestra.run.smithi161.stdout:4787 punch from 0x31160ce to 0x3119da3, (0x3cd5 bytes) 2024-09-21T15:09:50.524 INFO:teuthology.orchestra.run.smithi161.stdout:4788 write 0x6416a8 thru 0x6452e9 (0x3c42 bytes) 2024-09-21T15:09:50.608 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:50.608 INFO:teuthology.orchestra.run.smithi161.stdout:4791 write 0xcd09b6d thru 0xcd136ef (0x9b83 bytes) 2024-09-21T15:09:50.687 INFO:teuthology.orchestra.run.smithi161.stdout:4792 write 0x5c20387 thru 0x5c2afdc (0xac56 bytes) 2024-09-21T15:09:50.721 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:50.721 INFO:teuthology.orchestra.run.smithi161.stdout:4827 read 0x4f3b620 thru 0x4f3b9b9 (0x39a bytes) 2024-09-21T15:09:50.721 INFO:teuthology.orchestra.run.smithi161.stdout:4828 write 0x34a82 thru 0x3ddb1 (0x9330 bytes) 2024-09-21T15:09:50.739 INFO:teuthology.orchestra.run.smithi161.stdout:4794 writesame 0x6ab18fb thru 0x6ab7095 data_size 0x1(0x579b bytes) 2024-09-21T15:09:50.746 INFO:teuthology.orchestra.run.smithi161.stdout:4829 write 0x170c295 thru 0x171074e (0x44ba bytes) 2024-09-21T15:09:50.761 INFO:teuthology.orchestra.run.smithi161.stdout:4830 punch from 0x911187 to 0x91fc7d, (0xeaf6 bytes) 2024-09-21T15:09:50.763 INFO:teuthology.orchestra.run.smithi161.stdout:4928 write 0x74d19d8 thru 0x74de5f6 (0xcc1f bytes) 2024-09-21T15:09:50.767 INFO:teuthology.orchestra.run.smithi161.stdout:4831 trunc from 0x57be8ea to 0x88dcc80 2024-09-21T15:09:50.781 INFO:teuthology.orchestra.run.smithi161.stdout:4760 write 0x8f13d33 thru 0x8f1bad7 (0x7da5 bytes) 2024-09-21T15:09:50.792 INFO:teuthology.orchestra.run.smithi161.stdout:4795 writesame 0xd4ff0b9 thru 0xd501c4d data_size 0x1(0x2b95 bytes) 2024-09-21T15:09:50.795 INFO:teuthology.orchestra.run.smithi161.stdout:4930 clone 32 order 24 su 8388608 sc 12 2024-09-21T15:09:50.823 INFO:teuthology.orchestra.run.smithi161.stdout:4832 read 0x130ed37 thru 0x131cb85 (0xde4f bytes) 2024-09-21T15:09:50.847 INFO:teuthology.orchestra.run.smithi161.stdout:4797 trunc from 0xe28519e to 0x2a83f07 2024-09-21T15:09:50.870 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.4-clone36 intact 2024-09-21T15:09:50.910 INFO:teuthology.orchestra.run.smithi161.stdout:4833 trunc from 0x88dcc80 to 0x83265f 2024-09-21T15:09:50.991 INFO:teuthology.orchestra.run.smithi161.stdout:4761 read 0x85f5ca6 thru 0x85f887b (0x2bd6 bytes) 2024-09-21T15:09:51.009 INFO:teuthology.orchestra.run.smithi161.stdout:4762 write 0xa68931e thru 0xa689b04 (0x7e7 bytes) 2024-09-21T15:09:51.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.067+0000 7ff753f07700 -1 reset not still connected to 0x5601688028f0 2024-09-21T15:09:51.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.067+0000 7ff753f07700 -1 reset not still connected to 0x560168803860 2024-09-21T15:09:51.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x560168803ee0 2024-09-21T15:09:51.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x5601692b52b0 2024-09-21T15:09:51.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x560169f100d0 2024-09-21T15:09:51.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x560169f10270 2024-09-21T15:09:51.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x560169f10680 2024-09-21T15:09:51.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9c70 2024-09-21T15:09:51.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x56016a6df860 2024-09-21T15:09:51.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x56016a6dfa00 2024-09-21T15:09:51.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x56016a9c85b0 2024-09-21T15:09:51.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6340 2024-09-21T15:09:51.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e64e0 2024-09-21T15:09:51.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6a90 2024-09-21T15:09:51.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72d00 2024-09-21T15:09:51.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72ea0 2024-09-21T15:09:51.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x56016b24fee0 2024-09-21T15:09:51.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x56016d18f450 2024-09-21T15:09:51.078 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:51.071+0000 7ff753f07700 -1 reset not still connected to 0x56016dd771e0 2024-09-21T15:09:51.096 INFO:teuthology.orchestra.run.smithi161.stdout:4798 trunc from 0x2a83f07 to 0xb570bb6 2024-09-21T15:09:51.142 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #35, image image_cluster1.client.mirror.4-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent36 2024-09-21T15:09:51.285 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:51.285 INFO:teuthology.orchestra.run.smithi161.stdout:4800 read 0x37099a0 thru 0x370d4c9 (0x3b2a bytes) 2024-09-21T15:09:51.285 INFO:teuthology.orchestra.run.smithi161.stdout:4803 write 0x7689024 thru 0x7697e9a (0xee77 bytes) 2024-09-21T15:09:51.318 INFO:teuthology.orchestra.run.smithi161.stdout:4804 read 0x5b2e0c2 thru 0x5b34a6d (0x69ac bytes) 2024-09-21T15:09:51.318 INFO:teuthology.orchestra.run.smithi161.stdout:4807 write 0x4216696 thru 0x421af2c (0x4897 bytes) 2024-09-21T15:09:51.331 INFO:teuthology.orchestra.run.smithi161.stdout:4834 read 0x37e292 thru 0x37ee32 (0xba1 bytes) 2024-09-21T15:09:51.331 INFO:teuthology.orchestra.run.smithi161.stdout:4835 read 0x5c3529 thru 0x5c56ac (0x2184 bytes) 2024-09-21T15:09:51.341 INFO:teuthology.orchestra.run.smithi161.stdout:4808 read 0x93dbb0b thru 0x93e8580 (0xca76 bytes) 2024-09-21T15:09:51.342 INFO:teuthology.orchestra.run.smithi161.stdout:4810 punch from 0xa72f9b to 0xa779de, (0x4a43 bytes) 2024-09-21T15:09:51.351 INFO:teuthology.orchestra.run.smithi161.stdout:4812 trunc from 0xb570bb6 to 0x65317cc 2024-09-21T15:09:51.380 INFO:teuthology.orchestra.run.smithi161.stdout:4836 write 0x589c954 thru 0x58a5df1 (0x949e bytes) 2024-09-21T15:09:51.413 INFO:teuthology.orchestra.run.smithi161.stdout:4813 writesame 0x177f26f thru 0x178424f data_size 0xd(0x4fe1 bytes) 2024-09-21T15:09:51.471 INFO:teuthology.orchestra.run.smithi161.stdout:4763 trunc from 0xc073e27 to 0x33f9898 2024-09-21T15:09:51.551 INFO:teuthology.orchestra.run.smithi161.stdout:4837 write 0xc5d1bc2 thru 0xc5d54cb (0x390a bytes) 2024-09-21T15:09:51.571 INFO:teuthology.orchestra.run.smithi161.stdout:4162 write 0x5c7d82b thru 0x5c85075 (0x784b bytes) 2024-09-21T15:09:51.573 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:51.573 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:51.573 INFO:teuthology.orchestra.run.smithi161.stdout:4817 write 0x5c3adc0 thru 0x5c4a699 (0xf8da bytes) 2024-09-21T15:09:51.626 INFO:teuthology.orchestra.run.smithi161.stdout:4838 trunc from 0xc5d54cc to 0xe622220 2024-09-21T15:09:51.662 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:51.678 INFO:teuthology.orchestra.run.smithi161.stdout:4818 writesame 0xc8a2189 thru 0xc8afa88 data_size 0x80(0xd900 bytes) 2024-09-21T15:09:51.681 INFO:teuthology.orchestra.run.smithi161.stdout:4840 trunc from 0xe622220 to 0x481a7d6 2024-09-21T15:09:51.696 INFO:teuthology.orchestra.run.smithi161.stdout:4819 trunc from 0xc8afa89 to 0x64e95ff 2024-09-21T15:09:51.719 INFO:teuthology.orchestra.run.smithi161.stdout:4163 trunc from 0xd05c9b0 to 0xe172a29 2024-09-21T15:09:51.754 INFO:teuthology.orchestra.run.smithi161.stdout:4164 write 0x498fc49 thru 0x4998863 (0x8c1b bytes) 2024-09-21T15:09:51.754 INFO:teuthology.orchestra.run.smithi161.stdout:4820 read 0x4f48bfa thru 0x4f54922 (0xbd29 bytes) 2024-09-21T15:09:51.754 INFO:teuthology.orchestra.run.smithi161.stdout:4821 read 0x1fcca45 thru 0x1fce8ea (0x1ea6 bytes) 2024-09-21T15:09:51.764 INFO:teuthology.orchestra.run.smithi161.stdout:4764 read 0x32f83b7 thru 0x32fcb27 (0x4771 bytes) 2024-09-21T15:09:51.765 INFO:teuthology.orchestra.run.smithi161.stdout:4166 writesame 0x119d9cb thru 0x11acee1 data_size 0x1(0xf517 bytes) 2024-09-21T15:09:51.768 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone31 from 0x74de5f7 (overlap 0x32a793e) to 0x144307f 2024-09-21T15:09:51.798 INFO:teuthology.orchestra.run.smithi161.stdout:4843 writesame 0xeb05ddd thru 0xeb10906 data_size 0x86(0xab2a bytes) 2024-09-21T15:09:51.812 INFO:teuthology.orchestra.run.smithi161.stdout:4844 writesame 0x82c5c95 thru 0x82cee2a data_size 0x5(0x9196 bytes) 2024-09-21T15:09:51.831 INFO:teuthology.orchestra.run.smithi161.stdout:4167 read 0x90ebdbc thru 0x90f8832 (0xca77 bytes) 2024-09-21T15:09:51.834 INFO:teuthology.orchestra.run.smithi161.stdout:4170 write 0x157b745 thru 0x15886c9 (0xcf85 bytes) 2024-09-21T15:09:51.850 INFO:teuthology.orchestra.run.smithi161.stdout:4822 write 0xd86d898 thru 0xd874973 (0x70dc bytes) 2024-09-21T15:09:51.861 INFO:teuthology.orchestra.run.smithi161.stdout:4171 read 0x5621b3 thru 0x5658a2 (0x36f0 bytes) 2024-09-21T15:09:51.861 INFO:teuthology.orchestra.run.smithi161.stdout:4172 read 0xc502883 thru 0xc50cacc (0xa24a bytes) 2024-09-21T15:09:51.862 INFO:teuthology.orchestra.run.smithi161.stdout:4173 writesame 0xb5e373a thru 0xb5ea612 data_size 0x9(0x6ed9 bytes) 2024-09-21T15:09:51.865 INFO:teuthology.orchestra.run.smithi161.stdout:4845 read 0xe3d1c2f thru 0xe3dfd65 (0xe137 bytes) 2024-09-21T15:09:51.866 INFO:teuthology.orchestra.run.smithi161.stdout:4846 write 0x48acac8 thru 0x48b832a (0xb863 bytes) 2024-09-21T15:09:51.881 INFO:teuthology.orchestra.run.smithi161.stdout:4767 writesame 0xd132ca4 thru 0xd13a47c data_size 0x15(0x77d9 bytes) 2024-09-21T15:09:51.889 INFO:teuthology.orchestra.run.smithi161.stdout:4768 read 0x8bfb61a thru 0x8bfe8d7 (0x32be bytes) 2024-09-21T15:09:51.889 INFO:teuthology.orchestra.run.smithi161.stdout:4769 read 0x2c72e3 thru 0x2d3863 (0xc581 bytes) 2024-09-21T15:09:51.892 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:51.892 INFO:teuthology.orchestra.run.smithi161.stdout:4175 read 0x4505c7b thru 0x450a624 (0x49aa bytes) 2024-09-21T15:09:51.892 INFO:teuthology.orchestra.run.smithi161.stdout:4177 read 0x2becb80 thru 0x2bfa45b (0xd8dc bytes) 2024-09-21T15:09:51.894 INFO:teuthology.orchestra.run.smithi161.stdout:4179 read 0x46a64bc thru 0x46a9159 (0x2c9e bytes) 2024-09-21T15:09:51.895 INFO:teuthology.orchestra.run.smithi161.stdout:4180 write 0xe094794 thru 0xe09b066 (0x68d3 bytes) 2024-09-21T15:09:51.899 INFO:teuthology.orchestra.run.smithi161.stdout:4772 write 0x8554ed8 thru 0x8561ddf (0xcf08 bytes) 2024-09-21T15:09:51.919 INFO:teuthology.orchestra.run.smithi161.stdout:4848 writesame 0xc6132bc thru 0xc615f7c data_size 0x39(0x2cc1 bytes) 2024-09-21T15:09:51.929 INFO:teuthology.orchestra.run.smithi161.stdout:4773 punch from 0x8e08bd0 to 0x8e09f4c, (0x137c bytes) 2024-09-21T15:09:51.947 INFO:teuthology.orchestra.run.smithi161.stdout:4849 read 0xe0e9189 thru 0xe0eadc6 (0x1c3e bytes) 2024-09-21T15:09:51.947 INFO:teuthology.orchestra.run.smithi161.stdout:4850 punch from 0x34375ad to 0x3446c24, (0xf677 bytes) 2024-09-21T15:09:51.948 INFO:teuthology.orchestra.run.smithi161.stdout:4853 read 0x4f1541a thru 0x4f16bcc (0x17b3 bytes) 2024-09-21T15:09:51.948 INFO:teuthology.orchestra.run.smithi161.stdout:4854 write 0x65ebe53 thru 0x65f5bbb (0x9d69 bytes) 2024-09-21T15:09:51.949 INFO:teuthology.orchestra.run.smithi161.stdout:3409 trunc from 0xe821832 to 0xaef6d23 2024-09-21T15:09:51.951 INFO:teuthology.orchestra.run.smithi161.stdout:4824 writesame 0xdabee88 thru 0xdac0215 data_size 0x1(0x138e bytes) 2024-09-21T15:09:52.017 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:52.018 INFO:teuthology.orchestra.run.smithi161.stdout:4826 write 0xa707107 thru 0xa713bed (0xcae7 bytes) 2024-09-21T15:09:52.029 INFO:teuthology.orchestra.run.smithi161.stdout:4775 write 0xdf7e676 thru 0xdf7f99f (0x132a bytes) 2024-09-21T15:09:52.032 INFO:teuthology.orchestra.run.smithi161.stdout:4856 read 0x88d7a16 thru 0x88d7e97 (0x482 bytes) 2024-09-21T15:09:52.032 INFO:teuthology.orchestra.run.smithi161.stdout:4181 writesame 0xe3c41b0 thru 0xe3d14a8 data_size 0x33(0xd2f9 bytes) 2024-09-21T15:09:52.037 INFO:teuthology.orchestra.run.smithi161.stdout:4182 read 0xd16ca75 thru 0xd17ae56 (0xe3e2 bytes) 2024-09-21T15:09:52.048 INFO:teuthology.orchestra.run.smithi161.stdout:4777 read 0xb6c2495 thru 0xb6cee51 (0xc9bd bytes) 2024-09-21T15:09:52.050 INFO:teuthology.orchestra.run.smithi161.stdout:4183 trunc from 0xe3d14a9 to 0x7ed0aa6 2024-09-21T15:09:52.054 INFO:teuthology.orchestra.run.smithi161.stdout:4859 trunc from 0xeb10907 to 0x380a65b 2024-09-21T15:09:52.055 INFO:teuthology.orchestra.run.smithi161.stdout:4827 read 0x9705876 thru 0x9713922 (0xe0ad bytes) 2024-09-21T15:09:52.055 INFO:teuthology.orchestra.run.smithi161.stdout:4828 write 0xb4a1cec thru 0xb4a208d (0x3a2 bytes) 2024-09-21T15:09:52.068 INFO:teuthology.orchestra.run.smithi161.stdout:4778 trunc from 0xdf7f9a0 to 0x2d00bf6 2024-09-21T15:09:52.072 INFO:teuthology.orchestra.run.smithi161.stdout:3411 read 0x6d0c576 thru 0x6d0d1cb (0xc56 bytes) 2024-09-21T15:09:52.103 INFO:teuthology.orchestra.run.smithi161.stdout:4829 trunc from 0xdac0216 to 0x409adbb 2024-09-21T15:09:52.117 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #30, image image_cluster1.client.mirror.2-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent31 2024-09-21T15:09:52.129 INFO:teuthology.orchestra.run.smithi161.stdout:3412 write 0xd1190c1 thru 0xd11a631 (0x1571 bytes) 2024-09-21T15:09:52.136 INFO:teuthology.orchestra.run.smithi161.stdout:4861 read 0x240b985 thru 0x24118c6 (0x5f42 bytes) 2024-09-21T15:09:52.141 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:52.141 INFO:teuthology.orchestra.run.smithi161.stdout:4185 write 0x26fd881 thru 0x2704c55 (0x73d5 bytes) 2024-09-21T15:09:52.150 INFO:teuthology.orchestra.run.smithi161.stdout:3414 read 0xc3ac9ff thru 0xc3b5700 (0x8d02 bytes) 2024-09-21T15:09:52.150 INFO:teuthology.orchestra.run.smithi161.stdout:3416 write 0xbe52c26 thru 0xbe5a436 (0x7811 bytes) 2024-09-21T15:09:52.171 INFO:teuthology.orchestra.run.smithi161.stdout:4186 writesame 0x17f462e thru 0x17fe08c data_size 0x3(0x9a5f bytes) 2024-09-21T15:09:52.174 INFO:teuthology.orchestra.run.smithi161.stdout:3418 write 0x2b787f thru 0x2bfd83 (0x8505 bytes) 2024-09-21T15:09:52.199 INFO:teuthology.orchestra.run.smithi161.stdout:4187 punch from 0x427f9c7 to 0x4283e1f, (0x4458 bytes) 2024-09-21T15:09:52.199 INFO:teuthology.orchestra.run.smithi161.stdout:4863 writesame 0xd5f6dac thru 0xd5faa4c data_size 0x1(0x3ca1 bytes) 2024-09-21T15:09:52.204 INFO:teuthology.orchestra.run.smithi161.stdout:4864 writesame 0x6aa141c thru 0x6aa2e77 data_size 0x7(0x1a5c bytes) 2024-09-21T15:09:52.206 INFO:teuthology.orchestra.run.smithi161.stdout:3420 write 0xbc8a91b thru 0xbc98c01 (0xe2e7 bytes) 2024-09-21T15:09:52.211 INFO:teuthology.orchestra.run.smithi161.stdout:4779 read 0x124bf0d thru 0x124d8a0 (0x1994 bytes) 2024-09-21T15:09:52.211 INFO:teuthology.orchestra.run.smithi161.stdout:4780 punch from 0x273a75c to 0x273c840, (0x20e4 bytes) 2024-09-21T15:09:52.211 INFO:teuthology.orchestra.run.smithi161.stdout:4783 punch from 0x8f6111 to 0x8ff344, (0x9233 bytes) 2024-09-21T15:09:52.217 INFO:teuthology.orchestra.run.smithi161.stdout:4188 trunc from 0x7ed0aa6 to 0xc8f25a 2024-09-21T15:09:52.223 INFO:teuthology.orchestra.run.smithi161.stdout:4865 punch from 0x3336626 to 0x33463ab, (0xfd85 bytes) 2024-09-21T15:09:52.223 INFO:teuthology.orchestra.run.smithi161.stdout:4866 read 0xccbf159 thru 0xccce952 (0xf7fa bytes) 2024-09-21T15:09:52.223 INFO:teuthology.orchestra.run.smithi161.stdout:4867 write 0x31e6a87 thru 0x31e6fdc (0x556 bytes) 2024-09-21T15:09:52.232 INFO:teuthology.orchestra.run.smithi161.stdout:3421 read 0xbc68545 thru 0xbc694e3 (0xf9f bytes) 2024-09-21T15:09:52.232 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:52.232 INFO:teuthology.orchestra.run.smithi161.stdout:3423 read 0x7db509f thru 0x7dc2701 (0xd663 bytes) 2024-09-21T15:09:52.232 INFO:teuthology.orchestra.run.smithi161.stdout:3424 read 0x43c6227 thru 0x43d3f58 (0xdd32 bytes) 2024-09-21T15:09:52.233 INFO:teuthology.orchestra.run.smithi161.stdout:3425 read 0x2f4f6c3 thru 0x2f59d2a (0xa668 bytes) 2024-09-21T15:09:52.239 INFO:teuthology.orchestra.run.smithi161.stdout:3426 trunc from 0xd11a632 to 0xea33568 2024-09-21T15:09:52.241 INFO:teuthology.orchestra.run.smithi161.stdout:4868 writesame 0x58231c9 thru 0x582878a data_size 0x3(0x55c2 bytes) 2024-09-21T15:09:52.241 INFO:teuthology.orchestra.run.smithi161.stdout:4831 write 0x5adeeb2 thru 0x5aec5f2 (0xd741 bytes) 2024-09-21T15:09:52.272 INFO:teuthology.orchestra.run.smithi161.stdout:4869 write 0x7fa1d74 thru 0x7fa72df (0x556c bytes) 2024-09-21T15:09:52.281 INFO:teuthology.orchestra.run.smithi161.stdout:4784 writesame 0x67877ad thru 0x6795f93 data_size 0x4d(0xe7e7 bytes) 2024-09-21T15:09:52.287 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:52.287 INFO:teuthology.orchestra.run.smithi161.stdout:4833 punch from 0x29b8e97 to 0x29bedfc, (0x5f65 bytes) 2024-09-21T15:09:52.287 INFO:teuthology.orchestra.run.smithi161.stdout:4834 write 0x2a6adb0 thru 0x2a6b0a8 (0x2f9 bytes) 2024-09-21T15:09:52.291 INFO:teuthology.orchestra.run.smithi161.stdout:4785 punch from 0x128d9b6 to 0x12951d8, (0x7822 bytes) 2024-09-21T15:09:52.298 INFO:teuthology.orchestra.run.smithi161.stdout:4786 trunc from 0x6795f94 to 0x96419c9 2024-09-21T15:09:52.300 INFO:teuthology.orchestra.run.smithi161.stdout:4870 punch from 0x5ad9f07 to 0x5adf26a, (0x5363 bytes) 2024-09-21T15:09:52.301 INFO:teuthology.orchestra.run.smithi161.stdout:4835 read 0x3d35f25 thru 0x3d45dc8 (0xfea4 bytes) 2024-09-21T15:09:52.301 INFO:teuthology.orchestra.run.smithi161.stdout:4872 read 0x2dda553 thru 0x2de661b (0xc0c9 bytes) 2024-09-21T15:09:52.301 INFO:teuthology.orchestra.run.smithi161.stdout:4873 read 0xcd775e7 thru 0xcd7baaa (0x44c4 bytes) 2024-09-21T15:09:52.301 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:52.301 INFO:teuthology.orchestra.run.smithi161.stdout:4876 read 0x1b4e6f thru 0x1b6cd5 (0x1e67 bytes) 2024-09-21T15:09:52.302 INFO:teuthology.orchestra.run.smithi161.stdout:4877 read 0x1f40116 thru 0x1f4faa4 (0xf98f bytes) 2024-09-21T15:09:52.302 INFO:teuthology.orchestra.run.smithi161.stdout:4878 write 0x536b5c3 thru 0x5371c15 (0x6653 bytes) 2024-09-21T15:09:52.306 INFO:teuthology.orchestra.run.smithi161.stdout:3427 read 0x2fe73ef thru 0x2fec47e (0x5090 bytes) 2024-09-21T15:09:52.322 INFO:teuthology.orchestra.run.smithi161.stdout:4189 trunc from 0xc8f25a to 0x418ff2 2024-09-21T15:09:52.322 INFO:teuthology.orchestra.run.smithi161.stdout:3429 trunc from 0xea33568 to 0x71ed492 2024-09-21T15:09:52.323 INFO:teuthology.orchestra.run.smithi161.stdout:4880 writesame 0x8cd5fa8 thru 0x8ce1389 data_size 0x4b(0xb3e2 bytes) 2024-09-21T15:09:52.355 INFO:teuthology.orchestra.run.smithi161.stdout:4881 punch from 0xc211ef5 to 0xc21be7f, (0x9f8a bytes) 2024-09-21T15:09:52.356 INFO:teuthology.orchestra.run.smithi161.stdout:4882 writesame 0x19fbf3e thru 0x1a09975 data_size 0x4(0xda38 bytes) 2024-09-21T15:09:52.357 INFO:teuthology.orchestra.run.smithi161.stdout:4787 read 0x9629fe1 thru 0x962bec1 (0x1ee1 bytes) 2024-09-21T15:09:52.357 INFO:teuthology.orchestra.run.smithi161.stdout:4788 read 0x68f63be thru 0x68f8563 (0x21a6 bytes) 2024-09-21T15:09:52.357 INFO:teuthology.orchestra.run.smithi161.stdout:4793 read 0x805a72a thru 0x806934d (0xec24 bytes) 2024-09-21T15:09:52.358 INFO:teuthology.orchestra.run.smithi161.stdout:4931 read 0x5a88219 thru 0x5a9238a (0xa172 bytes) 2024-09-21T15:09:52.391 INFO:teuthology.orchestra.run.smithi161.stdout:4836 write 0xeb0ef0a thru 0xeb1684a (0x7941 bytes) 2024-09-21T15:09:52.398 INFO:teuthology.orchestra.run.smithi161.stdout:4932 clone 33 order 19 su 4096 sc 8 2024-09-21T15:09:52.407 INFO:teuthology.orchestra.run.smithi161.stdout:4883 write 0xc5116ba thru 0xc5130e5 (0x1a2c bytes) 2024-09-21T15:09:52.417 INFO:teuthology.orchestra.run.smithi161.stdout:4795 write 0xa68a02d thru 0xa691a2d (0x7a01 bytes) 2024-09-21T15:09:52.421 INFO:teuthology.orchestra.run.smithi161.stdout:4190 punch from 0x15ca47 to 0x15cf38, (0x4f1 bytes) 2024-09-21T15:09:52.421 INFO:teuthology.orchestra.run.smithi161.stdout:4191 read 0x829 thru 0x9c93 (0x946b bytes) 2024-09-21T15:09:52.422 INFO:teuthology.orchestra.run.smithi161.stdout:4192 read 0x19ff20 thru 0x1ad681 (0xd762 bytes) 2024-09-21T15:09:52.424 INFO:teuthology.orchestra.run.smithi161.stdout:4837 read 0x87f33d2 thru 0x87fd845 (0xa474 bytes) 2024-09-21T15:09:52.424 INFO:teuthology.orchestra.run.smithi161.stdout:4838 read 0xe038b3b thru 0xe03a798 (0x1c5e bytes) 2024-09-21T15:09:52.425 INFO:teuthology.orchestra.run.smithi161.stdout:4840 punch from 0x17e4b2b to 0x17e6c3d, (0x2112 bytes) 2024-09-21T15:09:52.425 INFO:teuthology.orchestra.run.smithi161.stdout:4843 read 0xa6b58f3 thru 0xa6b9961 (0x406f bytes) 2024-09-21T15:09:52.426 INFO:teuthology.orchestra.run.smithi161.stdout:4884 writesame 0xabed06e thru 0xabf0fb5 data_size 0x3c(0x3f48 bytes) 2024-09-21T15:09:52.433 INFO:teuthology.orchestra.run.smithi161.stdout:4796 write 0x918856a thru 0x9190532 (0x7fc9 bytes) 2024-09-21T15:09:52.438 INFO:teuthology.orchestra.run.smithi161.stdout:3433 read 0x51d66dd thru 0x51ddd5e (0x7682 bytes) 2024-09-21T15:09:52.445 INFO:teuthology.orchestra.run.smithi161.stdout:4844 trunc from 0xeb1684b to 0x9dee9b3 2024-09-21T15:09:52.446 INFO:teuthology.orchestra.run.smithi161.stdout:4885 writesame 0x58ea13c thru 0x58f9f5d data_size 0x15(0xfe22 bytes) 2024-09-21T15:09:52.448 INFO:teuthology.orchestra.run.smithi161.stdout:3434 trunc from 0x71ed492 to 0xb5e6eae 2024-09-21T15:09:52.462 INFO:teuthology.orchestra.run.smithi161.stdout:4797 trunc from 0xa691a2e to 0x68996c0 2024-09-21T15:09:52.485 INFO:teuthology.orchestra.run.smithi161.stdout:3435 write 0x74186fe thru 0x74272b8 (0xebbb bytes) 2024-09-21T15:09:52.486 INFO:teuthology.orchestra.run.smithi161.stdout:4886 write 0x9bfdde6 thru 0x9c07bff (0x9e1a bytes) 2024-09-21T15:09:52.517 INFO:teuthology.orchestra.run.smithi161.stdout:4887 read 0x7b941d4 thru 0x7b97753 (0x3580 bytes) 2024-09-21T15:09:52.517 INFO:teuthology.orchestra.run.smithi161.stdout:4889 write 0x9e7da05 thru 0x9e81f6b (0x4567 bytes) 2024-09-21T15:09:52.523 INFO:teuthology.orchestra.run.smithi161.stdout:4194 write 0xc4551eb thru 0xc457231 (0x2047 bytes) 2024-09-21T15:09:52.529 INFO:teuthology.orchestra.run.smithi161.stdout:3437 writesame 0x6decd72 thru 0x6df5b6d data_size 0xd(0x8dfc bytes) 2024-09-21T15:09:52.538 INFO:teuthology.orchestra.run.smithi161.stdout:4846 writesame 0x84eea41 thru 0x84f503f data_size 0x1(0x65ff bytes) 2024-09-21T15:09:52.541 INFO:teuthology.orchestra.run.smithi161.stdout:4890 punch from 0xa552c51 to 0xa555a3e, (0x2ded bytes) 2024-09-21T15:09:52.541 INFO:teuthology.orchestra.run.smithi161.stdout:4891 read 0x17cd95b thru 0x17d44e0 (0x6b86 bytes) 2024-09-21T15:09:52.543 INFO:teuthology.orchestra.run.smithi161.stdout:4195 writesame 0x22282bd thru 0x2229d24 data_size 0x4(0x1a68 bytes) 2024-09-21T15:09:52.557 INFO:teuthology.orchestra.run.smithi161.stdout:4892 trunc from 0xd5faa4d to 0x68743d7 2024-09-21T15:09:52.568 INFO:teuthology.orchestra.run.smithi161.stdout:4849 write 0x20e5bb2 thru 0x20ec44f (0x689e bytes) 2024-09-21T15:09:52.568 INFO:teuthology.orchestra.run.smithi161.stdout:3439 writesame 0x5d33d7 thru 0x5de6c0 data_size 0x1(0xb2ea bytes) 2024-09-21T15:09:52.573 INFO:teuthology.orchestra.run.smithi161.stdout:4196 read 0xace9464 thru 0xacf84d5 (0xf072 bytes) 2024-09-21T15:09:52.573 INFO:teuthology.orchestra.run.smithi161.stdout:4197 read 0x97c51a1 thru 0x97ccad2 (0x7932 bytes) 2024-09-21T15:09:52.574 INFO:teuthology.orchestra.run.smithi161.stdout:4199 write 0x4550470 thru 0x455dfd8 (0xdb69 bytes) 2024-09-21T15:09:52.611 INFO:teuthology.orchestra.run.smithi161.stdout:4200 punch from 0x44eeb59 to 0x44fb3ad, (0xc854 bytes) 2024-09-21T15:09:52.617 INFO:teuthology.orchestra.run.smithi161.stdout:4799 writesame 0xd66611e thru 0xd6748f1 data_size 0x4a(0xe7d4 bytes) 2024-09-21T15:09:52.617 INFO:teuthology.orchestra.run.smithi161.stdout:4850 punch from 0x5c4c1a4 to 0x5c523d0, (0x622c bytes) 2024-09-21T15:09:52.618 INFO:teuthology.orchestra.run.smithi161.stdout:4851 write 0x5da34bb thru 0x5dacaa7 (0x95ed bytes) 2024-09-21T15:09:52.626 INFO:teuthology.orchestra.run.smithi161.stdout:4800 read 0x61fda2e thru 0x61ff2e5 (0x18b8 bytes) 2024-09-21T15:09:52.626 INFO:teuthology.orchestra.run.smithi161.stdout:4801 read 0xd067a62 thru 0xd071559 (0x9af8 bytes) 2024-09-21T15:09:52.627 INFO:teuthology.orchestra.run.smithi161.stdout:4802 punch from 0x954d69c to 0x955981a, (0xc17e bytes) 2024-09-21T15:09:52.627 INFO:teuthology.orchestra.run.smithi161.stdout:4803 read 0x533d34a thru 0x5341e14 (0x4acb bytes) 2024-09-21T15:09:52.627 INFO:teuthology.orchestra.run.smithi161.stdout:4805 read 0x1cb7779 thru 0x1cbd285 (0x5b0d bytes) 2024-09-21T15:09:52.628 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:52.628 INFO:teuthology.orchestra.run.smithi161.stdout:4807 punch from 0x1ce6acf to 0x1ceac3c, (0x416d bytes) 2024-09-21T15:09:52.628 INFO:teuthology.orchestra.run.smithi161.stdout:4808 read 0x99570f9 thru 0x995fc21 (0x8b29 bytes) 2024-09-21T15:09:52.629 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:52.629 INFO:teuthology.orchestra.run.smithi161.stdout:4810 read 0x3e4f7ee thru 0x3e5e72f (0xef42 bytes) 2024-09-21T15:09:52.629 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:52.629 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:52.657 INFO:teuthology.orchestra.run.smithi161.stdout:4815 trunc from 0xd6748f2 to 0x4d7316 2024-09-21T15:09:52.664 INFO:teuthology.orchestra.run.smithi161.stdout:4852 trunc from 0x9dee9b3 to 0x808146b 2024-09-21T15:09:52.670 INFO:teuthology.orchestra.run.smithi161.stdout:3440 read 0x5381353 thru 0x538eda2 (0xda50 bytes) 2024-09-21T15:09:52.673 INFO:teuthology.orchestra.run.smithi161.stdout:3442 read 0x7330e66 thru 0x733f71c (0xe8b7 bytes) 2024-09-21T15:09:52.674 INFO:teuthology.orchestra.run.smithi161.stdout:4893 read 0x2bca0fa thru 0x2bd3e20 (0x9d27 bytes) 2024-09-21T15:09:52.674 INFO:teuthology.orchestra.run.smithi161.stdout:3443 write 0x935907c thru 0x9366278 (0xd1fd bytes) 2024-09-21T15:09:52.675 INFO:teuthology.orchestra.run.smithi161.stdout:4894 trunc from 0x68743d7 to 0x6e51252 2024-09-21T15:09:52.703 INFO:teuthology.orchestra.run.smithi161.stdout:4203 writesame 0xd2241a8 thru 0xd22d736 data_size 0x1(0x958f bytes) 2024-09-21T15:09:52.710 INFO:teuthology.orchestra.run.smithi161.stdout:3444 read 0x457adaf thru 0x4581ae4 (0x6d36 bytes) 2024-09-21T15:09:52.710 INFO:teuthology.orchestra.run.smithi161.stdout:4204 read 0x3bbbb64 thru 0x3bbc3e4 (0x881 bytes) 2024-09-21T15:09:52.710 INFO:teuthology.orchestra.run.smithi161.stdout:4205 write 0x50c36f8 thru 0x50cddef (0xa6f8 bytes) 2024-09-21T15:09:52.713 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:52.713 INFO:teuthology.orchestra.run.smithi161.stdout:3447 write 0x7de326 thru 0x7e0ee8 (0x2bc3 bytes) 2024-09-21T15:09:52.736 INFO:teuthology.orchestra.run.smithi161.stdout:4898 read 0x5496f89 thru 0x54991b6 (0x222e bytes) 2024-09-21T15:09:52.736 INFO:teuthology.orchestra.run.smithi161.stdout:4900 punch from 0x4028bf7 to 0x4031a03, (0x8e0c bytes) 2024-09-21T15:09:52.736 INFO:teuthology.orchestra.run.smithi161.stdout:4902 read 0x855be3 thru 0x85b0da (0x54f8 bytes) 2024-09-21T15:09:52.752 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:52.752 INFO:teuthology.orchestra.run.smithi161.stdout:4905 punch from 0x3d4978d to 0x3d4fa9d, (0x6310 bytes) 2024-09-21T15:09:52.752 INFO:teuthology.orchestra.run.smithi161.stdout:4906 read 0x259c85 thru 0x266021 (0xc39d bytes) 2024-09-21T15:09:52.776 INFO:teuthology.orchestra.run.smithi161.stdout:4909 write 0x19957bd thru 0x199a5b6 (0x4dfa bytes) 2024-09-21T15:09:52.783 INFO:teuthology.orchestra.run.smithi161.stdout:3449 write 0x4d4cdf6 thru 0x4d591c0 (0xc3cb bytes) 2024-09-21T15:09:52.795 INFO:teuthology.orchestra.run.smithi161.stdout:4910 clone 31 order 23 su 131072 sc 6 2024-09-21T15:09:52.871 INFO:teuthology.orchestra.run.smithi161.stdout:3450 write 0xae3e05b thru 0xae4b9cb (0xd971 bytes) 2024-09-21T15:09:52.882 INFO:teuthology.orchestra.run.smithi161.stdout:4853 write 0x4851d4 thru 0x490073 (0xaea0 bytes) 2024-09-21T15:09:52.919 INFO:teuthology.orchestra.run.smithi161.stdout:3451 trunc from 0xb5e6eae to 0x2f2b46 2024-09-21T15:09:52.939 INFO:teuthology.orchestra.run.smithi161.stdout:4206 writesame 0xe3735e2 thru 0xe376ec8 data_size 0x1(0x38e7 bytes) 2024-09-21T15:09:52.942 INFO:teuthology.orchestra.run.smithi161.stdout:4855 read 0x29840c6 thru 0x2985456 (0x1391 bytes) 2024-09-21T15:09:52.950 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:52.950 INFO:teuthology.orchestra.run.smithi161.stdout:4212 write 0xd5e6c20 thru 0xd5ee845 (0x7c26 bytes) 2024-09-21T15:09:52.977 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:52.977 INFO:teuthology.orchestra.run.smithi161.stdout:4214 read 0xb3ec3c6 thru 0xb3f8ba9 (0xc7e4 bytes) 2024-09-21T15:09:52.977 INFO:teuthology.orchestra.run.smithi161.stdout:4215 read 0x53d9dea thru 0x53dc4bc (0x26d3 bytes) 2024-09-21T15:09:52.978 INFO:teuthology.orchestra.run.smithi161.stdout:4216 write 0x5547b42 thru 0x5549007 (0x14c6 bytes) 2024-09-21T15:09:52.997 INFO:teuthology.orchestra.run.smithi161.stdout:4217 punch from 0xc0b0f46 to 0xc0bf1d0, (0xe28a bytes) 2024-09-21T15:09:52.997 INFO:teuthology.orchestra.run.smithi161.stdout:4220 write 0x6105352 thru 0x6114994 (0xf643 bytes) 2024-09-21T15:09:53.000 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone32 from 0x74de5f7 (overlap 0x74de5f7) to 0x461f061 2024-09-21T15:09:53.006 INFO:teuthology.orchestra.run.smithi161.stdout:4856 writesame 0x8536df1 thru 0x853c8c2 data_size 0x6(0x5ad2 bytes) 2024-09-21T15:09:53.015 INFO:teuthology.orchestra.run.smithi161.stdout:4857 trunc from 0x853c8c3 to 0x9c218dd 2024-09-21T15:09:53.038 INFO:teuthology.orchestra.run.smithi161.stdout:4222 trunc from 0xe376ec9 to 0x82900af 2024-09-21T15:09:53.082 INFO:teuthology.orchestra.run.smithi161.stdout:3452 writesame 0x4fca7ff thru 0x4fd0981 data_size 0x35(0x6183 bytes) 2024-09-21T15:09:53.082 INFO:teuthology.orchestra.run.smithi161.stdout:4858 read 0x40898e3 thru 0x4090c76 (0x7394 bytes) 2024-09-21T15:09:53.083 INFO:teuthology.orchestra.run.smithi161.stdout:4860 read 0x68198e5 thru 0x6824954 (0xb070 bytes) 2024-09-21T15:09:53.083 INFO:teuthology.orchestra.run.smithi161.stdout:4861 write 0x9348b15 thru 0x9353ce1 (0xb1cd bytes) 2024-09-21T15:09:53.093 INFO:teuthology.orchestra.run.smithi161.stdout:3454 read 0x5d1cc2 thru 0x5dc953 (0xac92 bytes) 2024-09-21T15:09:53.093 INFO:teuthology.orchestra.run.smithi161.stdout:3456 read 0x11a107 thru 0x12147d (0x7377 bytes) 2024-09-21T15:09:53.104 INFO:teuthology.orchestra.run.smithi161.stdout:3457 trunc from 0x4fd0982 to 0x1b021f9 2024-09-21T15:09:53.106 INFO:teuthology.orchestra.run.smithi161.stdout:4817 write 0x856e0e3 thru 0x857debd (0xfddb bytes) 2024-09-21T15:09:53.127 INFO:teuthology.orchestra.run.smithi161.stdout:4819 read 0x42d9403 thru 0x42dfd7e (0x697c bytes) 2024-09-21T15:09:53.140 INFO:teuthology.orchestra.run.smithi161.stdout:4820 trunc from 0x857debe to 0x28f3951 2024-09-21T15:09:53.141 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.147 INFO:teuthology.orchestra.run.smithi161.stdout:4225 write 0xa93a89f thru 0xa943691 (0x8df3 bytes) 2024-09-21T15:09:53.164 INFO:teuthology.orchestra.run.smithi161.stdout:4228 punch from 0x5606e89 to 0x560f48d, (0x8604 bytes) 2024-09-21T15:09:53.168 INFO:teuthology.orchestra.run.smithi161.stdout:4862 writesame 0xcad1379 thru 0xcad858b data_size 0x1d(0x7213 bytes) 2024-09-21T15:09:53.171 INFO:teuthology.orchestra.run.smithi161.stdout:4863 writesame 0x474ae4e thru 0x475201a data_size 0x27(0x71cd bytes) 2024-09-21T15:09:53.177 INFO:teuthology.orchestra.run.smithi161.stdout:4229 trunc from 0xa943692 to 0x315c5af 2024-09-21T15:09:53.192 INFO:teuthology.orchestra.run.smithi161.stdout:3460 writesame 0x819c7c6 thru 0x819ecff data_size 0x5(0x253a bytes) 2024-09-21T15:09:53.195 INFO:teuthology.orchestra.run.smithi161.stdout:4821 write 0x237dea4 thru 0x2386166 (0x82c3 bytes) 2024-09-21T15:09:53.196 INFO:teuthology.orchestra.run.smithi161.stdout:4864 write 0x4f52ebd thru 0x4f5834e (0x5492 bytes) 2024-09-21T15:09:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:3462 write 0x1a39d3d thru 0x1a45b7e (0xbe42 bytes) 2024-09-21T15:09:53.228 INFO:teuthology.orchestra.run.smithi161.stdout:3463 read 0x21af64a thru 0x21b237f (0x2d36 bytes) 2024-09-21T15:09:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:4868 punch from 0x1d39b0f to 0x1d3b08e, (0x157f bytes) 2024-09-21T15:09:53.232 INFO:teuthology.orchestra.run.smithi161.stdout:4869 write 0x1f22885 thru 0x1f28ea4 (0x6620 bytes) 2024-09-21T15:09:53.236 INFO:teuthology.orchestra.run.smithi161.stdout:3464 trunc from 0x819ed00 to 0xc2870a8 2024-09-21T15:09:53.238 INFO:teuthology.orchestra.run.smithi161.stdout:4822 trunc from 0x28f3951 to 0x6b70a04 2024-09-21T15:09:53.253 INFO:teuthology.orchestra.run.smithi161.stdout:4873 write 0x6564067 thru 0x656c9d7 (0x8971 bytes) 2024-09-21T15:09:53.272 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.286 INFO:teuthology.orchestra.run.smithi161.stdout:3465 write 0x70f3c14 thru 0x70f6363 (0x2750 bytes) 2024-09-21T15:09:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:4230 writesame 0x9c4bbae thru 0x9c51cd0 data_size 0x1b(0x6123 bytes) 2024-09-21T15:09:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:3466 read 0x937185e thru 0x937ca72 (0xb215 bytes) 2024-09-21T15:09:53.301 INFO:teuthology.orchestra.run.smithi161.stdout:3467 writesame 0x6691269 thru 0x669456b data_size 0x3(0x3303 bytes) 2024-09-21T15:09:53.315 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #31, image image_cluster1.client.mirror.2-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent32 2024-09-21T15:09:53.318 INFO:teuthology.orchestra.run.smithi161.stdout:4874 write 0xdc79ee1 thru 0xdc7eecd (0x4fed bytes) 2024-09-21T15:09:53.321 INFO:teuthology.orchestra.run.smithi161.stdout:4827 writesame 0xe29a6ce thru 0xe29d54b data_size 0xb(0x2e7e bytes) 2024-09-21T15:09:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:3468 read 0x702544f thru 0x703070b (0xb2bd bytes) 2024-09-21T15:09:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:3469 read 0x8961120 thru 0x89662dd (0x51be bytes) 2024-09-21T15:09:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.323 INFO:teuthology.orchestra.run.smithi161.stdout:3473 punch from 0x3a7b055 to 0x3a87820, (0xc7cb bytes) 2024-09-21T15:09:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:4829 punch from 0x52bb6b3 to 0x52c0667, (0x4fb4 bytes) 2024-09-21T15:09:53.328 INFO:teuthology.orchestra.run.smithi161.stdout:4830 read 0xaba9467 thru 0xabadf14 (0x4aae bytes) 2024-09-21T15:09:53.329 INFO:teuthology.orchestra.run.smithi161.stdout:4831 writesame 0xb5deac7 thru 0xb5e9b07 data_size 0x1(0xb041 bytes) 2024-09-21T15:09:53.369 INFO:teuthology.orchestra.run.smithi161.stdout:4875 trunc from 0xdc7eece to 0x73a6807 2024-09-21T15:09:53.373 INFO:teuthology.orchestra.run.smithi161.stdout:4231 writesame 0xd0fc321 thru 0xd1051c4 data_size 0x66(0x8ea4 bytes) 2024-09-21T15:09:53.383 INFO:teuthology.orchestra.run.smithi161.stdout:4832 write 0xbe83f85 thru 0xbe8a2ae (0x632a bytes) 2024-09-21T15:09:53.391 INFO:teuthology.orchestra.run.smithi161.stdout:3474 writesame 0xc9ca606 thru 0xc9d04dd data_size 0x14(0x5ed8 bytes) 2024-09-21T15:09:53.397 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.397 INFO:teuthology.orchestra.run.smithi161.stdout:3476 write 0x14d27ae thru 0x14dc3e8 (0x9c3b bytes) 2024-09-21T15:09:53.400 INFO:teuthology.orchestra.run.smithi161.stdout:4835 write 0x36e973f thru 0x36eddf2 (0x46b4 bytes) 2024-09-21T15:09:53.402 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.416 INFO:teuthology.orchestra.run.smithi161.stdout:4839 read 0x68bfe25 thru 0x68c9fe1 (0xa1bd bytes) 2024-09-21T15:09:53.416 INFO:teuthology.orchestra.run.smithi161.stdout:4842 punch from 0x755437f to 0x75563f9, (0x207a bytes) 2024-09-21T15:09:53.417 INFO:teuthology.orchestra.run.smithi161.stdout:4843 trunc from 0xe29d54c to 0xe921a63 2024-09-21T15:09:53.420 INFO:teuthology.orchestra.run.smithi161.stdout:4235 trunc from 0xd1051c5 to 0x474ebcd 2024-09-21T15:09:53.444 INFO:teuthology.orchestra.run.smithi161.stdout:4876 read 0x1fdbda1 thru 0x1fe4996 (0x8bf6 bytes) 2024-09-21T15:09:53.445 INFO:teuthology.orchestra.run.smithi161.stdout:4881 read 0x260b4c7 thru 0x260d4ee (0x2028 bytes) 2024-09-21T15:09:53.445 INFO:teuthology.orchestra.run.smithi161.stdout:4882 read 0x2d9a8d1 thru 0x2da6e95 (0xc5c5 bytes) 2024-09-21T15:09:53.446 INFO:teuthology.orchestra.run.smithi161.stdout:4883 read 0x4c1c05f thru 0x4c24cbc (0x8c5e bytes) 2024-09-21T15:09:53.447 INFO:teuthology.orchestra.run.smithi161.stdout:4884 punch from 0x10c913b to 0x10d3dfd, (0xacc2 bytes) 2024-09-21T15:09:53.447 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.447 INFO:teuthology.orchestra.run.smithi161.stdout:4887 read 0x43f7625 thru 0x43fb4ed (0x3ec9 bytes) 2024-09-21T15:09:53.447 INFO:teuthology.orchestra.run.smithi161.stdout:4844 read 0xbe9ad90 thru 0xbea4706 (0x9977 bytes) 2024-09-21T15:09:53.450 INFO:teuthology.orchestra.run.smithi161.stdout:3477 write 0xcc8cb5d thru 0xcc90fe6 (0x448a bytes) 2024-09-21T15:09:53.452 INFO:teuthology.orchestra.run.smithi161.stdout:4888 trunc from 0x73a6807 to 0x8d7da09 2024-09-21T15:09:53.452 INFO:teuthology.orchestra.run.smithi161.stdout:4237 writesame 0x10a452f thru 0x10ae828 data_size 0x2(0xa2fa bytes) 2024-09-21T15:09:53.463 INFO:teuthology.orchestra.run.smithi161.stdout:4846 trunc from 0xe921a63 to 0x6eb4a17 2024-09-21T15:09:53.467 INFO:teuthology.orchestra.run.smithi161.stdout:3478 punch from 0xbb8d891 to 0xbb9131a, (0x3a89 bytes) 2024-09-21T15:09:53.467 INFO:teuthology.orchestra.run.smithi161.stdout:3480 punch from 0x7eca739 to 0x7ece8a7, (0x416e bytes) 2024-09-21T15:09:53.467 INFO:teuthology.orchestra.run.smithi161.stdout:3482 read 0x87758bf thru 0x87791b5 (0x38f7 bytes) 2024-09-21T15:09:53.467 INFO:teuthology.orchestra.run.smithi161.stdout:3483 punch from 0x31eb64d to 0x31f7b13, (0xc4c6 bytes) 2024-09-21T15:09:53.467 INFO:teuthology.orchestra.run.smithi161.stdout:3486 write 0x7bb4f4c thru 0x7bb8892 (0x3947 bytes) 2024-09-21T15:09:53.482 INFO:teuthology.orchestra.run.smithi161.stdout:4238 read 0x179f58b thru 0x17a6d9d (0x7813 bytes) 2024-09-21T15:09:53.483 INFO:teuthology.orchestra.run.smithi161.stdout:4889 trunc from 0x8d7da09 to 0xa27ce24 2024-09-21T15:09:53.500 INFO:teuthology.orchestra.run.smithi161.stdout:4240 trunc from 0x474ebcd to 0xc0efcf6 2024-09-21T15:09:53.527 INFO:teuthology.orchestra.run.smithi161.stdout:4891 writesame 0x99ef179 thru 0x99ff15a data_size 0x7(0xffe2 bytes) 2024-09-21T15:09:53.531 INFO:teuthology.orchestra.run.smithi161.stdout:4847 punch from 0x2b5622c to 0x2b5f1bd, (0x8f91 bytes) 2024-09-21T15:09:53.531 INFO:teuthology.orchestra.run.smithi161.stdout:4848 write 0x637a080 thru 0x637d6fe (0x367f bytes) 2024-09-21T15:09:53.553 INFO:teuthology.orchestra.run.smithi161.stdout:4849 writesame 0x4b26a29 thru 0x4b32a9d data_size 0xb(0xc075 bytes) 2024-09-21T15:09:53.561 INFO:teuthology.orchestra.run.smithi161.stdout:3487 writesame 0xe8ad4c7 thru 0xe8bba64 data_size 0xc2(0xe59e bytes) 2024-09-21T15:09:53.563 INFO:teuthology.orchestra.run.smithi161.stdout:4241 write 0x4057ff6 thru 0x4067416 (0xf421 bytes) 2024-09-21T15:09:53.566 INFO:teuthology.orchestra.run.smithi161.stdout:3488 write 0xa3653b8 thru 0xa36ce19 (0x7a62 bytes) 2024-09-21T15:09:53.567 INFO:teuthology.orchestra.run.smithi161.stdout:4892 punch from 0x5e86c21 to 0x5e8adc5, (0x41a4 bytes) 2024-09-21T15:09:53.576 INFO:teuthology.orchestra.run.smithi161.stdout:4893 trunc from 0xa27ce24 to 0x5fa3f8e 2024-09-21T15:09:53.580 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.582 INFO:teuthology.orchestra.run.smithi161.stdout:4242 write 0x7852ddf thru 0x7855593 (0x27b5 bytes) 2024-09-21T15:09:53.593 INFO:teuthology.orchestra.run.smithi161.stdout:4243 read 0xbf040ab thru 0xbf102fa (0xc250 bytes) 2024-09-21T15:09:53.608 INFO:teuthology.orchestra.run.smithi161.stdout:3489 trunc from 0xe8bba65 to 0xda8550 2024-09-21T15:09:53.619 INFO:teuthology.orchestra.run.smithi161.stdout:4852 writesame 0x7aed5b6 thru 0x7af90c9 data_size 0x4e(0xbb14 bytes) 2024-09-21T15:09:53.639 INFO:teuthology.orchestra.run.smithi161.stdout:4853 trunc from 0x7af90ca to 0xebdde24 2024-09-21T15:09:53.641 INFO:teuthology.orchestra.run.smithi161.stdout:4244 write 0xc631e9c thru 0xc632e6e (0xfd3 bytes) 2024-09-21T15:09:53.641 INFO:teuthology.orchestra.run.smithi161.stdout:4894 read 0x4b05036 thru 0x4b0df77 (0x8f42 bytes) 2024-09-21T15:09:53.658 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.658 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.659 INFO:teuthology.orchestra.run.smithi161.stdout:4248 trunc from 0xc632e6f to 0xc04e366 2024-09-21T15:09:53.670 INFO:teuthology.orchestra.run.smithi161.stdout:3490 punch from 0x84494b to 0x8481ef, (0x38a4 bytes) 2024-09-21T15:09:53.686 INFO:teuthology.orchestra.run.smithi161.stdout:4896 writesame 0x948973f thru 0x948ef5a data_size 0x2(0x581c bytes) 2024-09-21T15:09:53.686 INFO:teuthology.orchestra.run.smithi161.stdout:4854 read 0xb9a7a46 thru 0xb9b08d4 (0x8e8f bytes) 2024-09-21T15:09:53.686 INFO:teuthology.orchestra.run.smithi161.stdout:4855 writesame 0xdba26a8 thru 0xdbaf8e9 data_size 0x3(0xd242 bytes) 2024-09-21T15:09:53.688 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.688 INFO:teuthology.orchestra.run.smithi161.stdout:4900 write 0x79c6b70 thru 0x79d20f2 (0xb583 bytes) 2024-09-21T15:09:53.731 INFO:teuthology.orchestra.run.smithi161.stdout:4856 read 0x31ba119 thru 0x31bb6ad (0x1595 bytes) 2024-09-21T15:09:53.731 INFO:teuthology.orchestra.run.smithi161.stdout:4857 write 0xb9f8935 thru 0xba00f78 (0x8644 bytes) 2024-09-21T15:09:53.735 INFO:teuthology.orchestra.run.smithi161.stdout:3493 writesame 0x230d039 thru 0x2318d5c data_size 0x5a(0xbd24 bytes) 2024-09-21T15:09:53.739 INFO:teuthology.orchestra.run.smithi161.stdout:4901 write 0x6ba4d4d thru 0x6bb26f9 (0xd9ad bytes) 2024-09-21T15:09:53.740 INFO:teuthology.orchestra.run.smithi161.stdout:3494 punch from 0x156c31f to 0x156c7c8, (0x4a9 bytes) 2024-09-21T15:09:53.740 INFO:teuthology.orchestra.run.smithi161.stdout:3497 read 0xfa5118 thru 0xfac2a5 (0x718e bytes) 2024-09-21T15:09:53.740 INFO:teuthology.orchestra.run.smithi161.stdout:4249 writesame 0xe714fa thru 0xe7a689 data_size 0x10(0x9190 bytes) 2024-09-21T15:09:53.751 INFO:teuthology.orchestra.run.smithi161.stdout:4859 read 0xe53adb7 thru 0xe54274a (0x7994 bytes) 2024-09-21T15:09:53.751 INFO:teuthology.orchestra.run.smithi161.stdout:4860 write 0x930b899 thru 0x931b3e6 (0xfb4e bytes) 2024-09-21T15:09:53.758 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.776 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.777 INFO:teuthology.orchestra.run.smithi161.stdout:4862 writesame 0x40d5c21 thru 0x40e2037 data_size 0x1d(0xc417 bytes) 2024-09-21T15:09:53.777 INFO:teuthology.orchestra.run.smithi161.stdout:4902 punch from 0x72e5c5d to 0x72f4912, (0xecb5 bytes) 2024-09-21T15:09:53.777 INFO:teuthology.orchestra.run.smithi161.stdout:4903 write 0x5ab31b3 thru 0x5abe167 (0xafb5 bytes) 2024-09-21T15:09:53.800 INFO:teuthology.orchestra.run.smithi161.stdout:4904 write 0x5b324fd thru 0x5b4234c (0xfe50 bytes) 2024-09-21T15:09:53.800 INFO:teuthology.orchestra.run.smithi161.stdout:4863 write 0x2b6a1f2 thru 0x2b6e426 (0x4235 bytes) 2024-09-21T15:09:53.815 INFO:teuthology.orchestra.run.smithi161.stdout:4905 write 0x3633986 thru 0x36400f6 (0xc771 bytes) 2024-09-21T15:09:53.817 INFO:teuthology.orchestra.run.smithi161.stdout:4251 write 0xe79ae5e thru 0xe7a56ab (0xa84e bytes) 2024-09-21T15:09:53.819 INFO:teuthology.orchestra.run.smithi161.stdout:3498 write 0x90f413a thru 0x90f8922 (0x47e9 bytes) 2024-09-21T15:09:53.829 INFO:teuthology.orchestra.run.smithi161.stdout:4864 read 0x75383c2 thru 0x7544d42 (0xc981 bytes) 2024-09-21T15:09:53.829 INFO:teuthology.orchestra.run.smithi161.stdout:4865 write 0x10ff416 thru 0x110cfa2 (0xdb8d bytes) 2024-09-21T15:09:53.842 INFO:teuthology.orchestra.run.smithi161.stdout:4252 writesame 0xd4afeb8 thru 0xd4b64f6 data_size 0x19(0x663f bytes) 2024-09-21T15:09:53.842 INFO:teuthology.orchestra.run.smithi161.stdout:3499 write 0x3fcf86 thru 0x406a04 (0x9a7f bytes) 2024-09-21T15:09:53.858 INFO:teuthology.orchestra.run.smithi161.stdout:4869 read 0x1b678b4 thru 0x1b6d169 (0x58b6 bytes) 2024-09-21T15:09:53.858 INFO:teuthology.orchestra.run.smithi161.stdout:4870 punch from 0x5497706 to 0x5498131, (0xa2b bytes) 2024-09-21T15:09:53.859 INFO:teuthology.orchestra.run.smithi161.stdout:4254 writesame 0xa08036 thru 0xa1171e data_size 0x1(0x96e9 bytes) 2024-09-21T15:09:53.859 INFO:teuthology.orchestra.run.smithi161.stdout:4871 write 0x7823ccf thru 0x7825c53 (0x1f85 bytes) 2024-09-21T15:09:53.872 INFO:teuthology.orchestra.run.smithi161.stdout:4906 trunc from 0x948ef5b to 0xc9ca564 2024-09-21T15:09:53.874 INFO:teuthology.orchestra.run.smithi161.stdout:4872 read 0x45270ff thru 0x452b561 (0x4463 bytes) 2024-09-21T15:09:53.874 INFO:teuthology.orchestra.run.smithi161.stdout:4873 read 0xd849910 thru 0xd853809 (0x9efa bytes) 2024-09-21T15:09:53.881 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.882 INFO:teuthology.orchestra.run.smithi161.stdout:4878 writesame 0x1623f8b thru 0x16286b2 data_size 0x63(0x4728 bytes) 2024-09-21T15:09:53.894 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.903 INFO:teuthology.orchestra.run.smithi161.stdout:4907 write 0x5f53b46 thru 0x5f60622 (0xcadd bytes) 2024-09-21T15:09:53.905 INFO:teuthology.orchestra.run.smithi161.stdout:4255 punch from 0x3aebae9 to 0x3af2a91, (0x6fa8 bytes) 2024-09-21T15:09:53.905 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.905 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:53.905 INFO:teuthology.orchestra.run.smithi161.stdout:4258 read 0x3363e42 thru 0x33708e7 (0xcaa6 bytes) 2024-09-21T15:09:53.907 INFO:teuthology.orchestra.run.smithi161.stdout:3500 write 0xd69c936 thru 0xd69ca9a (0x165 bytes) 2024-09-21T15:09:53.912 INFO:teuthology.orchestra.run.smithi161.stdout:4259 trunc from 0xe7a56ac to 0xb3576dc 2024-09-21T15:09:53.913 INFO:teuthology.orchestra.run.smithi161.stdout:4880 trunc from 0xebdde24 to 0x63f0d74 2024-09-21T15:09:53.931 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #29, image image_cluster1.client.mirror.5-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent30 2024-09-21T15:09:53.932 INFO:teuthology.orchestra.run.smithi161.stdout:3501 read 0xbbf7454 thru 0xbbffb5f (0x870c bytes) 2024-09-21T15:09:53.932 INFO:teuthology.orchestra.run.smithi161.stdout:3502 read 0xb20597a thru 0xb20b343 (0x59ca bytes) 2024-09-21T15:09:53.933 INFO:teuthology.orchestra.run.smithi161.stdout:4908 write 0xde6d0b thru 0xdf3d50 (0xd046 bytes) 2024-09-21T15:09:53.943 INFO:teuthology.orchestra.run.smithi161.stdout:3503 trunc from 0xd69ca9b to 0x8c3567c 2024-09-21T15:09:53.980 INFO:teuthology.orchestra.run.smithi161.stdout:4909 read 0x9a941e2 thru 0x9a9bdc1 (0x7be0 bytes) 2024-09-21T15:09:53.981 INFO:teuthology.orchestra.run.smithi161.stdout:4911 read 0x80aa402 thru 0x80b558e (0xb18d bytes) 2024-09-21T15:09:53.981 INFO:teuthology.orchestra.run.smithi161.stdout:4915 punch from 0xa6cfc4e to 0xa6dcb40, (0xcef2 bytes) 2024-09-21T15:09:53.981 INFO:teuthology.orchestra.run.smithi161.stdout:4916 read 0x85bf2b4 thru 0x85c6558 (0x72a5 bytes) 2024-09-21T15:09:53.981 INFO:teuthology.orchestra.run.smithi161.stdout:4918 write 0x2e93c22 thru 0x2e96e64 (0x3243 bytes) 2024-09-21T15:09:53.989 INFO:teuthology.orchestra.run.smithi161.stdout:4260 read 0x39ea30c thru 0x39edcb3 (0x39a8 bytes) 2024-09-21T15:09:53.989 INFO:teuthology.orchestra.run.smithi161.stdout:4261 writesame 0x220dc9b thru 0x220e5c1 data_size 0xb(0x927 bytes) 2024-09-21T15:09:54.002 INFO:teuthology.orchestra.run.smithi161.stdout:4262 write 0x9fe144a thru 0x9fe61fa (0x4db1 bytes) 2024-09-21T15:09:54.022 INFO:teuthology.orchestra.run.smithi161.stdout:4264 writesame 0x187be8b thru 0x187f895 data_size 0x27(0x3a0b bytes) 2024-09-21T15:09:54.028 INFO:teuthology.orchestra.run.smithi161.stdout:4265 read 0x5414198 thru 0x541b7d1 (0x763a bytes) 2024-09-21T15:09:54.028 INFO:teuthology.orchestra.run.smithi161.stdout:4266 punch from 0x329116f to 0x32a0c81, (0xfb12 bytes) 2024-09-21T15:09:54.028 INFO:teuthology.orchestra.run.smithi161.stdout:4267 punch from 0x832ce35 to 0x8334315, (0x74e0 bytes) 2024-09-21T15:09:54.029 INFO:teuthology.orchestra.run.smithi161.stdout:4268 trunc from 0xb3576dc to 0xac63f6a 2024-09-21T15:09:54.031 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:54.032 INFO:teuthology.orchestra.run.smithi161.stdout:4881 write 0xa7b7f30 thru 0xa7c316b (0xb23c bytes) 2024-09-21T15:09:54.047 INFO:teuthology.orchestra.run.smithi161.stdout:4921 write 0xe8ad5c1 thru 0xe8b18a1 (0x42e1 bytes) 2024-09-21T15:09:54.055 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:54.055 INFO:teuthology.orchestra.run.smithi161.stdout:4883 write 0x17c374d thru 0x17c8076 (0x492a bytes) 2024-09-21T15:09:54.073 INFO:teuthology.orchestra.run.smithi161.stdout:4922 read 0x8db1bf0 thru 0x8dbfc4d (0xe05e bytes) 2024-09-21T15:09:54.073 INFO:teuthology.orchestra.run.smithi161.stdout:4933 trunc from 0x74de5f7 to 0x4ae3a54 2024-09-21T15:09:54.073 INFO:teuthology.orchestra.run.smithi161.stdout:4925 read 0x1615168 thru 0x161718c (0x2025 bytes) 2024-09-21T15:09:54.074 INFO:teuthology.orchestra.run.smithi161.stdout:4884 punch from 0x238ea4d to 0x23929e9, (0x3f9c bytes) 2024-09-21T15:09:54.075 INFO:teuthology.orchestra.run.smithi161.stdout:4926 read 0x9b7ebbf thru 0x9b85b71 (0x6fb3 bytes) 2024-09-21T15:09:54.076 INFO:teuthology.orchestra.run.smithi161.stdout:4927 write 0xceaf72 thru 0xcf329a (0x8329 bytes) 2024-09-21T15:09:54.076 INFO:teuthology.orchestra.run.smithi161.stdout:4271 writesame 0x8593fb5 thru 0x8596386 data_size 0x23(0x23d2 bytes) 2024-09-21T15:09:54.081 INFO:teuthology.orchestra.run.smithi161.stdout:3506 writesame 0xdc7a4eb thru 0xdc81618 data_size 0x21(0x712e bytes) 2024-09-21T15:09:54.087 INFO:teuthology.orchestra.run.smithi161.stdout:3508 trunc from 0xdc81619 to 0xd606eb3 2024-09-21T15:09:54.095 INFO:teuthology.orchestra.run.smithi161.stdout:4272 flatten 2024-09-21T15:09:54.100 INFO:teuthology.orchestra.run.smithi161.stdout:4929 write 0x70a674b thru 0x70ab784 (0x503a bytes) 2024-09-21T15:09:54.123 INFO:teuthology.orchestra.run.smithi161.stdout:4930 write 0xda8c4f8 thru 0xda8ee3b (0x2944 bytes) 2024-09-21T15:09:54.130 INFO:teuthology.orchestra.run.smithi161.stdout:4885 write 0xc85bdda thru 0xc864153 (0x837a bytes) 2024-09-21T15:09:54.142 INFO:teuthology.orchestra.run.smithi161.stdout:3509 punch from 0x119131f to 0x11a1253, (0xff34 bytes) 2024-09-21T15:09:54.142 INFO:teuthology.orchestra.run.smithi161.stdout:3510 clone 43 order 23 su 1048576 sc 2 2024-09-21T15:09:54.151 INFO:teuthology.orchestra.run.smithi161.stdout:4931 write 0x768b3c3 thru 0x76989e5 (0xd623 bytes) 2024-09-21T15:09:54.156 INFO:teuthology.orchestra.run.smithi161.stdout:4273 trunc from 0xac63f6a to 0x37b43bc 2024-09-21T15:09:54.160 INFO:teuthology.orchestra.run.smithi161.stdout:4886 punch from 0xaf1fdf4 to 0xaf24853, (0x4a5f bytes) 2024-09-21T15:09:54.161 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:54.161 INFO:teuthology.orchestra.run.smithi161.stdout:4891 read 0x57b08c6 thru 0x57b9b79 (0x92b4 bytes) 2024-09-21T15:09:54.161 INFO:teuthology.orchestra.run.smithi161.stdout:4892 punch from 0x1d24d34 to 0x1d3347c, (0xe748 bytes) 2024-09-21T15:09:54.161 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:54.168 INFO:teuthology.orchestra.run.smithi161.stdout:4899 trunc from 0xc864154 to 0x854428e 2024-09-21T15:09:54.188 INFO:teuthology.orchestra.run.smithi161.stdout:4934 punch from 0x867f384 to 0x8680add, (0x1759 bytes) 2024-09-21T15:09:54.188 INFO:teuthology.orchestra.run.smithi161.stdout:4935 read 0xe7c436e thru 0xe7ca822 (0x64b5 bytes) 2024-09-21T15:09:54.188 INFO:teuthology.orchestra.run.smithi161.stdout:4936 punch from 0xbcdceed to 0xbce6876, (0x9989 bytes) 2024-09-21T15:09:54.188 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:54.206 INFO:teuthology.orchestra.run.smithi161.stdout:4938 trunc from 0xe8b18a2 to 0x331c91c 2024-09-21T15:09:54.211 INFO:teuthology.orchestra.run.smithi161.stdout:4275 punch from 0x1e90cba to 0x1e9fc18, (0xef5e bytes) 2024-09-21T15:09:54.214 INFO:teuthology.orchestra.run.smithi161.stdout:4934 read 0x1f44d79 thru 0x1f4e9aa (0x9c32 bytes) 2024-09-21T15:09:54.221 INFO:teuthology.orchestra.run.smithi161.stdout:4935 trunc from 0x4ae3a54 to 0x5d516ee 2024-09-21T15:09:54.232 INFO:teuthology.orchestra.run.smithi161.stdout:4900 read 0x102bb9 thru 0x105087 (0x24cf bytes) 2024-09-21T15:09:54.272 INFO:teuthology.orchestra.run.smithi161.stdout:4937 punch from 0x5af8502 to 0x5afcfcd, (0x4acb bytes) 2024-09-21T15:09:54.273 INFO:teuthology.orchestra.run.smithi161.stdout:4938 write 0x500a314 thru 0x501329e (0x8f8b bytes) 2024-09-21T15:09:54.294 INFO:teuthology.orchestra.run.smithi161.stdout:4901 writesame 0x9fb4f61 thru 0x9fbc6a0 data_size 0x6a(0x7740 bytes) 2024-09-21T15:09:54.294 INFO:teuthology.orchestra.run.smithi161.stdout:4276 write 0xe3f8563 thru 0xe405933 (0xd3d1 bytes) 2024-09-21T15:09:54.300 INFO:teuthology.orchestra.run.smithi161.stdout:4903 write 0x97be876 thru 0x97cbe46 (0xd5d1 bytes) 2024-09-21T15:09:54.307 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:54.319 INFO:teuthology.orchestra.run.smithi161.stdout:4277 read 0xa8f3103 thru 0xa8fa494 (0x7392 bytes) 2024-09-21T15:09:54.319 INFO:teuthology.orchestra.run.smithi161.stdout:4278 writesame 0xd99447d thru 0xd9951e6 data_size 0x11(0xd6a bytes) 2024-09-21T15:09:54.333 INFO:teuthology.orchestra.run.smithi161.stdout:4279 write 0x841bffa thru 0x841fae4 (0x3aeb bytes) 2024-09-21T15:09:54.342 INFO:teuthology.orchestra.run.smithi161.stdout:4904 trunc from 0x9fbc6a1 to 0x66515c 2024-09-21T15:09:54.348 INFO:teuthology.orchestra.run.smithi161.stdout:4280 punch from 0x9664baf to 0x96677f2, (0x2c43 bytes) 2024-09-21T15:09:54.348 INFO:teuthology.orchestra.run.smithi161.stdout:4281 writesame 0x34403dd thru 0x3449c85 data_size 0x7(0x98a9 bytes) 2024-09-21T15:09:54.352 INFO:teuthology.orchestra.run.smithi161.stdout:4943 writesame 0xd7d8b33 thru 0xd7dfb3f data_size 0x1(0x700d bytes) 2024-09-21T15:09:54.357 INFO:teuthology.orchestra.run.smithi161.stdout:4945 read 0x9db692a thru 0x9dbfcbe (0x9395 bytes) 2024-09-21T15:09:54.357 INFO:teuthology.orchestra.run.smithi161.stdout:4946 write 0x7dc37b7 thru 0x7dc873f (0x4f89 bytes) 2024-09-21T15:09:54.359 INFO:teuthology.orchestra.run.smithi161.stdout:4939 writesame 0xc5b2a88 thru 0xc5ba748 data_size 0x1(0x7cc1 bytes) 2024-09-21T15:09:54.368 INFO:teuthology.orchestra.run.smithi161.stdout:4911 read 0xf2d88d thru 0xf33c9b (0x640f bytes) 2024-09-21T15:09:54.375 INFO:teuthology.orchestra.run.smithi161.stdout:4282 write 0x1f1a68d thru 0x1f26d38 (0xc6ac bytes) 2024-09-21T15:09:54.381 INFO:teuthology.orchestra.run.smithi161.stdout:4940 read 0x114d1ce thru 0x114f3c7 (0x21fa bytes) 2024-09-21T15:09:54.383 INFO:teuthology.orchestra.run.smithi161.stdout:4941 write 0x68e8e79 thru 0x68f257b (0x9703 bytes) 2024-09-21T15:09:54.397 INFO:teuthology.orchestra.run.smithi161.stdout:4283 write 0x9c8152f thru 0x9c8fd8d (0xe85f bytes) 2024-09-21T15:09:54.399 INFO:teuthology.orchestra.run.smithi161.stdout:4947 punch from 0x2ef048a to 0x2ef5e61, (0x59d7 bytes) 2024-09-21T15:09:54.399 INFO:teuthology.orchestra.run.smithi161.stdout:4949 write 0x7953e34 thru 0x7958890 (0x4a5d bytes) 2024-09-21T15:09:54.410 INFO:teuthology.orchestra.run.smithi161.stdout:4912 read 0x156ab8a thru 0x1570e8b (0x6302 bytes) 2024-09-21T15:09:54.425 INFO:teuthology.orchestra.run.smithi161.stdout:4942 read 0x169c578 thru 0x169da3b (0x14c4 bytes) 2024-09-21T15:09:54.426 INFO:teuthology.orchestra.run.smithi161.stdout:4284 trunc from 0xe405934 to 0xea34753 2024-09-21T15:09:54.426 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xedc68c4 2024-09-21T15:09:54.428 INFO:teuthology.orchestra.run.smithi161.stdout:4943 read 0x7b91308 thru 0x7b9c3b9 (0xb0b2 bytes) 2024-09-21T15:09:54.428 INFO:teuthology.orchestra.run.smithi161.stdout:4945 read 0x3f79602 thru 0x3f7a85c (0x125b bytes) 2024-09-21T15:09:54.428 INFO:teuthology.orchestra.run.smithi161.stdout:4946 write 0x5ffa68c thru 0x6006716 (0xc08b bytes) 2024-09-21T15:09:54.448 INFO:teuthology.orchestra.run.smithi161.stdout:4913 write 0xbefef64 thru 0xbf05a5a (0x6af7 bytes) 2024-09-21T15:09:54.451 INFO:teuthology.orchestra.run.smithi161.stdout:4905 trunc from 0x66515c to 0xedc68c4 2024-09-21T15:09:54.469 INFO:teuthology.orchestra.run.smithi161.stdout:4286 read 0x3968d05 thru 0x3975149 (0xc445 bytes) 2024-09-21T15:09:54.469 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:54.469 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:54.469 INFO:teuthology.orchestra.run.smithi161.stdout:4291 read 0x74814ad thru 0x748db17 (0xc66b bytes) 2024-09-21T15:09:54.470 INFO:teuthology.orchestra.run.smithi161.stdout:4293 writesame 0x171e055 thru 0x172867b data_size 0x2f(0xa627 bytes) 2024-09-21T15:09:54.478 INFO:teuthology.orchestra.run.smithi161.stdout:4947 write 0x6fe9af5 thru 0x6feebbe (0x50ca bytes) 2024-09-21T15:09:54.480 INFO:teuthology.orchestra.run.smithi161.stdout:4950 write 0xee46e51 thru 0xee4c369 (0x5519 bytes) 2024-09-21T15:09:54.490 INFO:teuthology.orchestra.run.smithi161.stdout:4914 read 0xb36cf8d thru 0xb36db3a (0xbae bytes) 2024-09-21T15:09:54.490 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:54.490 INFO:teuthology.orchestra.run.smithi161.stdout:4916 write 0x715b33c thru 0x7167a47 (0xc70c bytes) 2024-09-21T15:09:54.491 INFO:teuthology.orchestra.run.smithi161.stdout:4294 write 0x26d4492 thru 0x26e1d92 (0xd901 bytes) 2024-09-21T15:09:54.502 INFO:teuthology.orchestra.run.smithi161.stdout:4906 writesame 0x1d56a25 thru 0x1d65a03 data_size 0x3(0xefdf bytes) 2024-09-21T15:09:54.521 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:54.539 INFO:teuthology.orchestra.run.smithi161.stdout:4295 read 0x7cad7ba thru 0x7cb4472 (0x6cb9 bytes) 2024-09-21T15:09:54.539 INFO:teuthology.orchestra.run.smithi161.stdout:4297 write 0x321c67a thru 0x3220ecc (0x4853 bytes) 2024-09-21T15:09:54.545 INFO:teuthology.orchestra.run.smithi161.stdout:4907 write 0x59b329c thru 0x59ba1b1 (0x6f16 bytes) 2024-09-21T15:09:54.545 INFO:teuthology.orchestra.run.smithi161.stdout:4917 write 0x989156d thru 0x98a1230 (0xfcc4 bytes) 2024-09-21T15:09:54.546 INFO:teuthology.orchestra.run.smithi161.stdout:4952 trunc from 0xee4c36a to 0x1b738cd 2024-09-21T15:09:54.566 INFO:teuthology.orchestra.run.smithi161.stdout:4298 punch from 0xade559b to 0xadf4acc, (0xf531 bytes) 2024-09-21T15:09:54.566 INFO:teuthology.orchestra.run.smithi161.stdout:4299 punch from 0x9a8f72a to 0x9a99916, (0xa1ec bytes) 2024-09-21T15:09:54.566 INFO:teuthology.orchestra.run.smithi161.stdout:4300 writesame 0x2decbc0 thru 0x2dfb5c9 data_size 0x1d(0xea0a bytes) 2024-09-21T15:09:54.572 INFO:teuthology.orchestra.run.smithi161.stdout:4921 trunc from 0xbf05a5b to 0x9200d15 2024-09-21T15:09:54.579 INFO:teuthology.orchestra.run.smithi161.stdout:4908 trunc from 0xedc68c4 to 0x81d8052 2024-09-21T15:09:54.588 INFO:teuthology.orchestra.run.smithi161.stdout:4948 writesame 0xd4b139b thru 0xd4bdf30 data_size 0x17(0xcb96 bytes) 2024-09-21T15:09:54.595 INFO:teuthology.orchestra.run.smithi161.stdout:4303 read 0x746d600 thru 0x7473198 (0x5b99 bytes) 2024-09-21T15:09:54.595 INFO:teuthology.orchestra.run.smithi161.stdout:4304 write 0xa7bb67c thru 0xa7bbbc5 (0x54a bytes) 2024-09-21T15:09:54.599 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:54.599 INFO:teuthology.orchestra.run.smithi161.stdout:4950 writesame 0xba6aeee thru 0xba77e52 data_size 0x1(0xcf65 bytes) 2024-09-21T15:09:54.631 INFO:teuthology.orchestra.run.smithi161.stdout:4305 write 0x370c058 thru 0x371c00a (0xffb3 bytes) 2024-09-21T15:09:54.664 INFO:teuthology.orchestra.run.smithi161.stdout:4922 write 0x121b389 thru 0x1228536 (0xd1ae bytes) 2024-09-21T15:09:54.665 INFO:teuthology.orchestra.run.smithi161.stdout:4306 trunc from 0xea34753 to 0xd74cb00 2024-09-21T15:09:54.667 INFO:teuthology.orchestra.run.smithi161.stdout:4909 write 0x2ce4a84 thru 0x2ce5c11 (0x118e bytes) 2024-09-21T15:09:54.729 INFO:teuthology.orchestra.run.smithi161.stdout:4951 write 0xe326a3a thru 0xe331ea6 (0xb46d bytes) 2024-09-21T15:09:54.744 INFO:teuthology.orchestra.run.smithi161.stdout:4923 write 0x56233af thru 0x5626741 (0x3393 bytes) 2024-09-21T15:09:54.745 INFO:teuthology.orchestra.run.smithi161.stdout:4954 read 0x33c317 thru 0x342514 (0x61fe bytes) 2024-09-21T15:09:54.768 INFO:teuthology.orchestra.run.smithi161.stdout:4910 write 0xd3361c6 thru 0xd3373eb (0x1226 bytes) 2024-09-21T15:09:54.774 INFO:teuthology.orchestra.run.smithi161.stdout:4952 punch from 0xd303568 to 0xd30ed54, (0xb7ec bytes) 2024-09-21T15:09:54.774 INFO:teuthology.orchestra.run.smithi161.stdout:4954 write 0x8fc1c0b thru 0x8fc923c (0x7632 bytes) 2024-09-21T15:09:54.778 INFO:teuthology.orchestra.run.smithi161.stdout:4307 trunc from 0xd74cb00 to 0xb5064a 2024-09-21T15:09:54.796 INFO:teuthology.orchestra.run.smithi161.stdout:4911 punch from 0x657f4ba to 0x658f200, (0xfd46 bytes) 2024-09-21T15:09:54.796 INFO:teuthology.orchestra.run.smithi161.stdout:4913 write 0x48290c2 thru 0x4833f73 (0xaeb2 bytes) 2024-09-21T15:09:54.799 INFO:teuthology.orchestra.run.smithi161.stdout:4924 writesame 0x5d6728b thru 0x5d6f216 data_size 0x12(0x7f8c bytes) 2024-09-21T15:09:54.830 INFO:teuthology.orchestra.run.smithi161.stdout:4955 write 0xd335e9f thru 0xd33c380 (0x64e2 bytes) 2024-09-21T15:09:54.838 INFO:teuthology.orchestra.run.smithi161.stdout:4955 write 0x82e0e7d thru 0x82eaf2f (0xa0b3 bytes) 2024-09-21T15:09:54.845 INFO:teuthology.orchestra.run.smithi161.stdout:4915 trunc from 0xd3373ec to 0x4c30e7c 2024-09-21T15:09:54.851 INFO:teuthology.orchestra.run.smithi161.stdout:4925 trunc from 0x9200d15 to 0x6f4bdf9 2024-09-21T15:09:54.878 INFO:teuthology.orchestra.run.smithi161.stdout:4956 trunc from 0xe331ea7 to 0xe297b21 2024-09-21T15:09:54.887 INFO:teuthology.orchestra.run.smithi161.stdout:4956 trunc from 0x82eaf30 to 0x24eebba 2024-09-21T15:09:54.899 INFO:teuthology.orchestra.run.smithi161.stdout:4309 trunc from 0xb5064a to 0x5ff81b2 2024-09-21T15:09:54.907 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone42 from 0xd606eb3 (overlap 0x2f2b46) to 0x0 2024-09-21T15:09:54.923 INFO:teuthology.orchestra.run.smithi161.stdout:4916 read 0x3fc038e thru 0x3fcb46a (0xb0dd bytes) 2024-09-21T15:09:54.924 INFO:teuthology.orchestra.run.smithi161.stdout:4919 read 0x21080ab thru 0x2113eab (0xbe01 bytes) 2024-09-21T15:09:54.924 INFO:teuthology.orchestra.run.smithi161.stdout:4920 read 0x1b3d9bc thru 0x1b47c29 (0xa26e bytes) 2024-09-21T15:09:54.924 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:54.924 INFO:teuthology.orchestra.run.smithi161.stdout:4923 read 0x14a4fed thru 0x14aef95 (0x9fa9 bytes) 2024-09-21T15:09:54.925 INFO:teuthology.orchestra.run.smithi161.stdout:4924 punch from 0x5bd373 to 0x5c38a5, (0x6532 bytes) 2024-09-21T15:09:54.925 INFO:teuthology.orchestra.run.smithi161.stdout:4926 read 0x2a4f727 thru 0x2a524b9 (0x2d93 bytes) 2024-09-21T15:09:54.932 INFO:teuthology.orchestra.run.smithi161.stdout:4928 trunc from 0x4c30e7c to 0x1411c78 2024-09-21T15:09:54.945 INFO:teuthology.orchestra.run.smithi161.stdout:4960 read 0xb0bff8a thru 0xb0c928e (0x9305 bytes) 2024-09-21T15:09:54.952 INFO:teuthology.orchestra.run.smithi161.stdout:4310 trunc from 0x5ff81b2 to 0xc6086d5 2024-09-21T15:09:54.954 INFO:teuthology.orchestra.run.smithi161.stdout:4963 trunc from 0xe297b21 to 0x9a1ea94 2024-09-21T15:09:54.954 INFO:teuthology.orchestra.run.smithi161.stdout:4957 punch from 0x16a6f4c to 0x16b2e34, (0xbee8 bytes) 2024-09-21T15:09:54.956 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:54.994 INFO:teuthology.orchestra.run.smithi161.stdout:4311 read 0x1f91e45 thru 0x1f9cc93 (0xae4f bytes) 2024-09-21T15:09:54.994 INFO:teuthology.orchestra.run.smithi161.stdout:4312 write 0x4f3c0d5 thru 0x4f460e8 (0xa014 bytes) 2024-09-21T15:09:55.002 INFO:teuthology.orchestra.run.smithi161.stdout:4929 punch from 0xc83544 to 0xc8cd76, (0x9832 bytes) 2024-09-21T15:09:55.012 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.012 INFO:teuthology.orchestra.run.smithi161.stdout:4318 writesame 0x892fe1 thru 0x893418 data_size 0x18(0x438 bytes) 2024-09-21T15:09:55.012 INFO:teuthology.orchestra.run.smithi161.stdout:4928 write 0xc1ace18 thru 0xc1ae556 (0x173f bytes) 2024-09-21T15:09:55.015 INFO:teuthology.orchestra.run.smithi161.stdout:4960 write 0xb72a661 thru 0xb734e14 (0xa7b4 bytes) 2024-09-21T15:09:55.020 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.020 INFO:teuthology.orchestra.run.smithi161.stdout:4320 punch from 0x2088bf3 to 0x208c562, (0x396f bytes) 2024-09-21T15:09:55.020 INFO:teuthology.orchestra.run.smithi161.stdout:4322 read 0x88cfdb4 thru 0x88d17c2 (0x1a0f bytes) 2024-09-21T15:09:55.020 INFO:teuthology.orchestra.run.smithi161.stdout:4323 read 0x28335a2 thru 0x2840fa5 (0xda04 bytes) 2024-09-21T15:09:55.020 INFO:teuthology.orchestra.run.smithi161.stdout:4326 write 0x7542206 thru 0x7549dd8 (0x7bd3 bytes) 2024-09-21T15:09:55.026 INFO:teuthology.orchestra.run.smithi161.stdout:4964 write 0x63ac146 thru 0x63b643a (0xa2f5 bytes) 2024-09-21T15:09:55.027 INFO:teuthology.orchestra.run.smithi161.stdout:4929 write 0x3b20cd2 thru 0x3b2c772 (0xbaa1 bytes) 2024-09-21T15:09:55.038 INFO:teuthology.orchestra.run.smithi161.stdout:4327 read 0xa6ce13f thru 0xa6d3a4f (0x5911 bytes) 2024-09-21T15:09:55.038 INFO:teuthology.orchestra.run.smithi161.stdout:4329 punch from 0x574f5ab to 0x57569ae, (0x7403 bytes) 2024-09-21T15:09:55.038 INFO:teuthology.orchestra.run.smithi161.stdout:4330 writesame 0x5c05f8d thru 0x5c1074a data_size 0x33(0xa7be bytes) 2024-09-21T15:09:55.059 INFO:teuthology.orchestra.run.smithi161.stdout:4962 read 0xa547bf9 thru 0xa5551a0 (0xd5a8 bytes) 2024-09-21T15:09:55.060 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.060 INFO:teuthology.orchestra.run.smithi161.stdout:4968 punch from 0x276cf09 to 0x2779fa9, (0xd0a0 bytes) 2024-09-21T15:09:55.061 INFO:teuthology.orchestra.run.smithi161.stdout:4963 write 0xf28f31 thru 0xf2e0f3 (0x51c3 bytes) 2024-09-21T15:09:55.063 INFO:teuthology.orchestra.run.smithi161.stdout:4930 trunc from 0xc1ae557 to 0xae5946d 2024-09-21T15:09:55.063 INFO:teuthology.orchestra.run.smithi161.stdout:4331 write 0xb59af7d thru 0xb5a5d28 (0xadac bytes) 2024-09-21T15:09:55.076 INFO:teuthology.orchestra.run.smithi161.stdout:4965 read 0x3fb6a45 thru 0x3fc26f6 (0xbcb2 bytes) 2024-09-21T15:09:55.076 INFO:teuthology.orchestra.run.smithi161.stdout:4966 read 0x1b3cc7d thru 0x1b4816d (0xb4f1 bytes) 2024-09-21T15:09:55.078 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.079 INFO:teuthology.orchestra.run.smithi161.stdout:4968 read 0xecff12 thru 0xed67b9 (0x68a8 bytes) 2024-09-21T15:09:55.079 INFO:teuthology.orchestra.run.smithi161.stdout:4931 write 0xe3f3ce7 thru 0xe3f5b0d (0x1e27 bytes) 2024-09-21T15:09:55.084 INFO:teuthology.orchestra.run.smithi161.stdout:4332 write 0x4007adf thru 0x400a50d (0x2a2f bytes) 2024-09-21T15:09:55.086 INFO:teuthology.orchestra.run.smithi161.stdout:4969 trunc from 0xb734e15 to 0xe318e85 2024-09-21T15:09:55.091 INFO:teuthology.orchestra.run.smithi161.stdout:4933 write 0x4e47c1e thru 0x4e51cbf (0xa0a2 bytes) 2024-09-21T15:09:55.102 INFO:teuthology.orchestra.run.smithi161.stdout:4333 writesame 0xa204814 thru 0xa20baf5 data_size 0x22(0x72e2 bytes) 2024-09-21T15:09:55.111 INFO:teuthology.orchestra.run.smithi161.stdout:4969 writesame 0xc3a7c85 thru 0xc3b32e8 data_size 0x12(0xb664 bytes) 2024-09-21T15:09:55.123 INFO:teuthology.orchestra.run.smithi161.stdout:4934 read 0x680da36 thru 0x680ebd5 (0x11a0 bytes) 2024-09-21T15:09:55.124 INFO:teuthology.orchestra.run.smithi161.stdout:4935 read 0xcd26fe9 thru 0xcd34ab8 (0xdad0 bytes) 2024-09-21T15:09:55.124 INFO:teuthology.orchestra.run.smithi161.stdout:4937 punch from 0x36dde34 to 0x36e0eed, (0x30b9 bytes) 2024-09-21T15:09:55.124 INFO:teuthology.orchestra.run.smithi161.stdout:4939 read 0x6dba33c thru 0x6dbf856 (0x551b bytes) 2024-09-21T15:09:55.124 INFO:teuthology.orchestra.run.smithi161.stdout:4940 punch from 0x76e26e8 to 0x76e8a64, (0x637c bytes) 2024-09-21T15:09:55.125 INFO:teuthology.orchestra.run.smithi161.stdout:4941 write 0x90964c2 thru 0x90a5616 (0xf155 bytes) 2024-09-21T15:09:55.132 INFO:teuthology.orchestra.run.smithi161.stdout:4931 read 0x23a7fa4 thru 0x23a891a (0x977 bytes) 2024-09-21T15:09:55.132 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.132 INFO:teuthology.orchestra.run.smithi161.stdout:4933 writesame 0x2d3bfbe thru 0x2d3d5b6 data_size 0xf(0x15f9 bytes) 2024-09-21T15:09:55.136 INFO:teuthology.orchestra.run.smithi161.stdout:4970 trunc from 0xc3b32e9 to 0x4500e58 2024-09-21T15:09:55.146 INFO:teuthology.orchestra.run.smithi161.stdout:4934 read 0x4dd0413 thru 0x4ddcc5e (0xc84c bytes) 2024-09-21T15:09:55.147 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.147 INFO:teuthology.orchestra.run.smithi161.stdout:4936 read 0x79174db thru 0x791a465 (0x2f8b bytes) 2024-09-21T15:09:55.147 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.147 INFO:teuthology.orchestra.run.smithi161.stdout:4939 read 0x9cd6769 thru 0x9cdc6c8 (0x5f60 bytes) 2024-09-21T15:09:55.148 INFO:teuthology.orchestra.run.smithi161.stdout:4940 writesame 0xa9c42a1 thru 0xa9d127d data_size 0x1(0xcfdd bytes) 2024-09-21T15:09:55.148 INFO:teuthology.orchestra.run.smithi161.stdout:4944 read 0xb60238 thru 0xb6ebe2 (0xe9ab bytes) 2024-09-21T15:09:55.149 INFO:teuthology.orchestra.run.smithi161.stdout:4945 writesame 0xc3ae5c7 thru 0xc3bc1cb data_size 0x19(0xdc05 bytes) 2024-09-21T15:09:55.156 INFO:teuthology.orchestra.run.smithi161.stdout:4970 trunc from 0xe318e85 to 0x5a0852 2024-09-21T15:09:55.171 INFO:teuthology.orchestra.run.smithi161.stdout:4334 write 0xd0c1448 thru 0xd0cef0b (0xdac4 bytes) 2024-09-21T15:09:55.191 INFO:teuthology.orchestra.run.smithi161.stdout:4948 read 0x2822810 thru 0x282a642 (0x7e33 bytes) 2024-09-21T15:09:55.192 INFO:teuthology.orchestra.run.smithi161.stdout:4949 read 0xe317728 thru 0xe31a9e7 (0x32c0 bytes) 2024-09-21T15:09:55.193 INFO:teuthology.orchestra.run.smithi161.stdout:4950 read 0xd96f941 thru 0xd97c99a (0xd05a bytes) 2024-09-21T15:09:55.193 INFO:teuthology.orchestra.run.smithi161.stdout:4951 write 0x9ea1b52 thru 0x9eadf0c (0xc3bb bytes) 2024-09-21T15:09:55.224 INFO:teuthology.orchestra.run.smithi161.stdout:4336 read 0xb8b4519 thru 0xb8be2aa (0x9d92 bytes) 2024-09-21T15:09:55.224 INFO:teuthology.orchestra.run.smithi161.stdout:4337 read 0x18ddd8d thru 0x18e8934 (0xaba8 bytes) 2024-09-21T15:09:55.224 INFO:teuthology.orchestra.run.smithi161.stdout:4338 read 0x88958d0 thru 0x889748b (0x1bbc bytes) 2024-09-21T15:09:55.224 INFO:teuthology.orchestra.run.smithi161.stdout:4339 write 0xb8bbd09 thru 0xb8c4baa (0x8ea2 bytes) 2024-09-21T15:09:55.227 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.227 INFO:teuthology.orchestra.run.smithi161.stdout:4956 punch from 0x81f1a2c to 0x81fca44, (0xb018 bytes) 2024-09-21T15:09:55.227 INFO:teuthology.orchestra.run.smithi161.stdout:4957 write 0xac34439 thru 0xac36c72 (0x283a bytes) 2024-09-21T15:09:55.239 INFO:teuthology.orchestra.run.smithi161.stdout:4941 write 0x197158 thru 0x1a240c (0xb2b5 bytes) 2024-09-21T15:09:55.249 INFO:teuthology.orchestra.run.smithi161.stdout:4958 read 0xb2019d9 thru 0xb2053d7 (0x39ff bytes) 2024-09-21T15:09:55.249 INFO:teuthology.orchestra.run.smithi161.stdout:4959 punch from 0xbccb863 to 0xbcd3e57, (0x85f4 bytes) 2024-09-21T15:09:55.249 INFO:teuthology.orchestra.run.smithi161.stdout:4960 read 0x4f908e1 thru 0x4f99154 (0x8874 bytes) 2024-09-21T15:09:55.251 INFO:teuthology.orchestra.run.smithi161.stdout:4341 read 0x65bda7f thru 0x65bf8fe (0x1e80 bytes) 2024-09-21T15:09:55.251 INFO:teuthology.orchestra.run.smithi161.stdout:4342 punch from 0x542f155 to 0x5438809, (0x96b4 bytes) 2024-09-21T15:09:55.251 INFO:teuthology.orchestra.run.smithi161.stdout:4343 writesame 0xc95c512 thru 0xc9685df data_size 0x3a(0xc0ce bytes) 2024-09-21T15:09:55.251 INFO:teuthology.orchestra.run.smithi161.stdout:4961 write 0xfb0b5b thru 0xfb7b00 (0x6fa6 bytes) 2024-09-21T15:09:55.256 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #41, image image_cluster1.client.mirror.3-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent42 2024-09-21T15:09:55.256 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.257 INFO:teuthology.orchestra.run.smithi161.stdout:4943 read 0x5d7a87e thru 0x5d8889e (0xe021 bytes) 2024-09-21T15:09:55.263 INFO:teuthology.orchestra.run.smithi161.stdout:4971 write 0x5409dd thru 0x54485d (0x3e81 bytes) 2024-09-21T15:09:55.269 INFO:teuthology.orchestra.run.smithi161.stdout:4344 read 0x46cef83 thru 0x46d4404 (0x5482 bytes) 2024-09-21T15:09:55.269 INFO:teuthology.orchestra.run.smithi161.stdout:4345 read 0x2389dcd thru 0x239403c (0xa270 bytes) 2024-09-21T15:09:55.274 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.274 INFO:teuthology.orchestra.run.smithi161.stdout:4963 write 0xad672ce thru 0xad709aa (0x96dd bytes) 2024-09-21T15:09:55.283 INFO:teuthology.orchestra.run.smithi161.stdout:4973 trunc from 0x5a0852 to 0x19d4013 2024-09-21T15:09:55.290 INFO:teuthology.orchestra.run.smithi161.stdout:4347 trunc from 0xd0cef0c to 0x81ff75 2024-09-21T15:09:55.310 INFO:teuthology.orchestra.run.smithi161.stdout:4964 read 0x94afb13 thru 0x94b1cb6 (0x21a4 bytes) 2024-09-21T15:09:55.311 INFO:teuthology.orchestra.run.smithi161.stdout:4965 read 0xa44c93a thru 0xa4556dc (0x8da3 bytes) 2024-09-21T15:09:55.311 INFO:teuthology.orchestra.run.smithi161.stdout:4966 write 0x417d46a thru 0x41899e0 (0xc577 bytes) 2024-09-21T15:09:55.320 INFO:teuthology.orchestra.run.smithi161.stdout:4944 write 0xcdcd18e thru 0xcdd4d51 (0x7bc4 bytes) 2024-09-21T15:09:55.339 INFO:teuthology.orchestra.run.smithi161.stdout:4967 write 0xa8c45fb thru 0xa8d3642 (0xf048 bytes) 2024-09-21T15:09:55.342 INFO:teuthology.orchestra.run.smithi161.stdout:4945 write 0x4b38f40 thru 0x4b40c46 (0x7d07 bytes) 2024-09-21T15:09:55.354 INFO:teuthology.orchestra.run.smithi161.stdout:4968 read 0x639edbc thru 0x63ab0ef (0xc334 bytes) 2024-09-21T15:09:55.355 INFO:teuthology.orchestra.run.smithi161.stdout:4971 write 0x196b2c thru 0x1993aa (0x287f bytes) 2024-09-21T15:09:55.356 INFO:teuthology.orchestra.run.smithi161.stdout:3511 writesame 0x91cf56a thru 0x91d1ab3 data_size 0x1(0x254a bytes) 2024-09-21T15:09:55.361 INFO:teuthology.orchestra.run.smithi161.stdout:4971 read 0x13afd7c thru 0x13bf634 (0xf8b9 bytes) 2024-09-21T15:09:55.367 INFO:teuthology.orchestra.run.smithi161.stdout:4972 read 0x1c714bb thru 0x1c80fa6 (0xfaec bytes) 2024-09-21T15:09:55.368 INFO:teuthology.orchestra.run.smithi161.stdout:4972 writesame 0x2b109f6 thru 0x2b1d019 data_size 0x12(0xc624 bytes) 2024-09-21T15:09:55.369 INFO:teuthology.orchestra.run.smithi161.stdout:4974 read 0xd80d5a thru 0xd81106 (0x3ad bytes) 2024-09-21T15:09:55.388 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.389 INFO:teuthology.orchestra.run.smithi161.stdout:4975 trunc from 0x4500e58 to 0xea06347 2024-09-21T15:09:55.391 INFO:teuthology.orchestra.run.smithi161.stdout:4946 read 0x803b5bd thru 0x8042ca9 (0x76ed bytes) 2024-09-21T15:09:55.391 INFO:teuthology.orchestra.run.smithi161.stdout:4948 writesame 0x349012d thru 0x349897f data_size 0x1(0x8853 bytes) 2024-09-21T15:09:55.394 INFO:teuthology.orchestra.run.smithi161.stdout:4974 trunc from 0xe3f5b0e to 0xa9ec979 2024-09-21T15:09:55.404 INFO:teuthology.orchestra.run.smithi161.stdout:3512 read 0x7d1e532 thru 0x7d20fe1 (0x2ab0 bytes) 2024-09-21T15:09:55.408 INFO:teuthology.orchestra.run.smithi161.stdout:4975 writesame 0xc38e44b thru 0xc395a6d data_size 0x11(0x7623 bytes) 2024-09-21T15:09:55.413 INFO:teuthology.orchestra.run.smithi161.stdout:4348 writesame 0x5fc8318 thru 0x5fceaad data_size 0x1(0x6796 bytes) 2024-09-21T15:09:55.413 INFO:teuthology.orchestra.run.smithi161.stdout:3514 trunc from 0xd606eb3 to 0x7d1a871 2024-09-21T15:09:55.423 INFO:teuthology.orchestra.run.smithi161.stdout:4349 write 0x1a99e3d thru 0x1aa0952 (0x6b16 bytes) 2024-09-21T15:09:55.424 INFO:teuthology.orchestra.run.smithi161.stdout:4976 write 0x31d9e1d thru 0x31e8dcc (0xefb0 bytes) 2024-09-21T15:09:55.447 INFO:teuthology.orchestra.run.smithi161.stdout:4949 write 0x531144f thru 0x5313dc3 (0x2975 bytes) 2024-09-21T15:09:55.453 INFO:teuthology.orchestra.run.smithi161.stdout:4350 punch from 0x1141cc7 to 0x114b634, (0x996d bytes) 2024-09-21T15:09:55.493 INFO:teuthology.orchestra.run.smithi161.stdout:4975 read 0xa465a40 thru 0xa474bdd (0xf19e bytes) 2024-09-21T15:09:55.493 INFO:teuthology.orchestra.run.smithi161.stdout:4976 write 0x8666945 thru 0x8669e01 (0x34bd bytes) 2024-09-21T15:09:55.496 INFO:teuthology.orchestra.run.smithi161.stdout:4979 write 0xcff16fe thru 0xcff5ede (0x47e1 bytes) 2024-09-21T15:09:55.520 INFO:teuthology.orchestra.run.smithi161.stdout:4952 write 0x21735ed thru 0x217f458 (0xbe6c bytes) 2024-09-21T15:09:55.524 INFO:teuthology.orchestra.run.smithi161.stdout:4981 read 0x4e64847 thru 0x4e6a8b8 (0x6072 bytes) 2024-09-21T15:09:55.524 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.524 INFO:teuthology.orchestra.run.smithi161.stdout:4983 punch from 0xb238500 to 0xb23d15f, (0x4c5f bytes) 2024-09-21T15:09:55.525 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.525 INFO:teuthology.orchestra.run.smithi161.stdout:4986 read 0x8dee22c thru 0x8df791e (0x96f3 bytes) 2024-09-21T15:09:55.525 INFO:teuthology.orchestra.run.smithi161.stdout:4987 read 0x8d5b82 thru 0x8e3cfa (0xe179 bytes) 2024-09-21T15:09:55.525 INFO:teuthology.orchestra.run.smithi161.stdout:4989 writesame 0x759e0cd thru 0x75a450b data_size 0x1(0x643f bytes) 2024-09-21T15:09:55.526 INFO:teuthology.orchestra.run.smithi161.stdout:3515 write 0x49c1724 thru 0x49cb9d5 (0xa2b2 bytes) 2024-09-21T15:09:55.536 INFO:teuthology.orchestra.run.smithi161.stdout:4978 write 0x7742f4f thru 0x774f121 (0xc1d3 bytes) 2024-09-21T15:09:55.565 INFO:teuthology.orchestra.run.smithi161.stdout:4979 write 0x11d06c2 thru 0x11dd16b (0xcaaa bytes) 2024-09-21T15:09:55.568 INFO:teuthology.orchestra.run.smithi161.stdout:4990 writesame 0x5ffe890 thru 0x6003c48 data_size 0x1(0x53b9 bytes) 2024-09-21T15:09:55.569 INFO:teuthology.orchestra.run.smithi161.stdout:4977 writesame 0x95916b8 thru 0x959ea59 data_size 0x2(0xd3a2 bytes) 2024-09-21T15:09:55.576 INFO:teuthology.orchestra.run.smithi161.stdout:3517 punch from 0x32ad3ab to 0x32b7881, (0xa4d6 bytes) 2024-09-21T15:09:55.576 INFO:teuthology.orchestra.run.smithi161.stdout:3518 read 0x51f248d thru 0x51f992d (0x74a1 bytes) 2024-09-21T15:09:55.576 INFO:teuthology.orchestra.run.smithi161.stdout:3519 write 0x22da68e thru 0x22dc266 (0x1bd9 bytes) 2024-09-21T15:09:55.590 INFO:teuthology.orchestra.run.smithi161.stdout:4351 write 0x7f021e8 thru 0x7f0825d (0x6076 bytes) 2024-09-21T15:09:55.592 INFO:teuthology.orchestra.run.smithi161.stdout:4991 read 0x16b8de8 thru 0x16c2dd1 (0x9fea bytes) 2024-09-21T15:09:55.592 INFO:teuthology.orchestra.run.smithi161.stdout:4992 punch from 0x14ff1d2 to 0x150c17d, (0xcfab bytes) 2024-09-21T15:09:55.592 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.592 INFO:teuthology.orchestra.run.smithi161.stdout:4997 punch from 0x384c8bf to 0x384e51b, (0x1c5c bytes) 2024-09-21T15:09:55.593 INFO:teuthology.orchestra.run.smithi161.stdout:4998 read 0x158b0 thru 0x20400 (0xab51 bytes) 2024-09-21T15:09:55.608 INFO:teuthology.orchestra.run.smithi161.stdout:4980 write 0x6ac1501 thru 0x6acff24 (0xea24 bytes) 2024-09-21T15:09:55.612 INFO:teuthology.orchestra.run.smithi161.stdout:4999 trunc from 0xcff5edf to 0x683223b 2024-09-21T15:09:55.617 INFO:teuthology.orchestra.run.smithi161.stdout:3520 read 0x2afeba2 thru 0x2b03877 (0x4cd6 bytes) 2024-09-21T15:09:55.622 INFO:teuthology.orchestra.run.smithi161.stdout:4352 read 0x7ee57ed thru 0x7ef0b10 (0xb324 bytes) 2024-09-21T15:09:55.623 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.623 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.623 INFO:teuthology.orchestra.run.smithi161.stdout:4356 write 0x56cfeb thru 0x56eb62 (0x1b78 bytes) 2024-09-21T15:09:55.628 INFO:teuthology.orchestra.run.smithi161.stdout:4982 read 0x86ab2eb thru 0x86af5dd (0x42f3 bytes) 2024-09-21T15:09:55.629 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.630 INFO:teuthology.orchestra.run.smithi161.stdout:4984 flatten 2024-09-21T15:09:55.641 INFO:teuthology.orchestra.run.smithi161.stdout:4978 trunc from 0xea06347 to 0x1d4a4c2 2024-09-21T15:09:55.645 INFO:teuthology.orchestra.run.smithi161.stdout:4357 read 0x2e02552 thru 0x2e0f9b1 (0xd460 bytes) 2024-09-21T15:09:55.650 INFO:teuthology.orchestra.run.smithi161.stdout:4953 writesame 0xeab80eb thru 0xeabd60e data_size 0x2(0x5524 bytes) 2024-09-21T15:09:55.655 INFO:teuthology.orchestra.run.smithi161.stdout:4954 write 0xb8aadaf thru 0xb8ac963 (0x1bb5 bytes) 2024-09-21T15:09:55.685 INFO:teuthology.orchestra.run.smithi161.stdout:4986 write 0x3f157a4 thru 0x3f1b404 (0x5c61 bytes) 2024-09-21T15:09:55.687 INFO:teuthology.orchestra.run.smithi161.stdout:3521 write 0xbba0db3 thru 0xbbab6b6 (0xa904 bytes) 2024-09-21T15:09:55.688 INFO:teuthology.orchestra.run.smithi161.stdout:5000 trunc from 0x683223b to 0x745ff4e 2024-09-21T15:09:55.691 INFO:teuthology.orchestra.run.smithi161.stdout:4955 trunc from 0xeabd60f to 0x9829aad 2024-09-21T15:09:55.695 INFO:teuthology.orchestra.run.smithi161.stdout:4987 punch from 0x2ff0a39 to 0x2ff579a, (0x4d61 bytes) 2024-09-21T15:09:55.695 INFO:teuthology.orchestra.run.smithi161.stdout:4988 write 0x3656379 thru 0x3659dc2 (0x3a4a bytes) 2024-09-21T15:09:55.697 INFO:teuthology.orchestra.run.smithi161.stdout:4358 write 0xb1f17eb thru 0xb1fb85a (0xa070 bytes) 2024-09-21T15:09:55.702 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.702 INFO:teuthology.orchestra.run.smithi161.stdout:3527 read 0x2dfefcc thru 0x2e081e6 (0x921b bytes) 2024-09-21T15:09:55.709 INFO:teuthology.orchestra.run.smithi161.stdout:3528 read 0x51a1783 thru 0x51a37be (0x203c bytes) 2024-09-21T15:09:55.709 INFO:teuthology.orchestra.run.smithi161.stdout:3529 read 0xa226182 thru 0xa22dabb (0x793a bytes) 2024-09-21T15:09:55.709 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.718 INFO:teuthology.orchestra.run.smithi161.stdout:3531 trunc from 0xbbab6b7 to 0x6978a5f 2024-09-21T15:09:55.723 INFO:teuthology.orchestra.run.smithi161.stdout:4360 write 0x34791f8 thru 0x34866b8 (0xd4c1 bytes) 2024-09-21T15:09:55.735 INFO:teuthology.orchestra.run.smithi161.stdout:5001 read 0x1a759ca thru 0x1a79abc (0x40f3 bytes) 2024-09-21T15:09:55.735 INFO:teuthology.orchestra.run.smithi161.stdout:5006 read 0x46cc82d thru 0x46d4c16 (0x83ea bytes) 2024-09-21T15:09:55.735 INFO:teuthology.orchestra.run.smithi161.stdout:5007 punch from 0x2b97cf6 to 0x2ba5b9e, (0xdea8 bytes) 2024-09-21T15:09:55.769 INFO:teuthology.orchestra.run.smithi161.stdout:4361 trunc from 0xb1fb85b to 0x42c0c05 2024-09-21T15:09:55.789 INFO:teuthology.orchestra.run.smithi161.stdout:4989 write 0xbe1f42e thru 0xbe21aba (0x268d bytes) 2024-09-21T15:09:55.790 INFO:teuthology.orchestra.run.smithi161.stdout:4957 punch from 0x14e01f to 0x15d03e, (0xf01f bytes) 2024-09-21T15:09:55.791 INFO:teuthology.orchestra.run.smithi161.stdout:5009 write 0xbf73865 thru 0xbf79aee (0x628a bytes) 2024-09-21T15:09:55.812 INFO:teuthology.orchestra.run.smithi161.stdout:4991 writesame 0x370bbef thru 0x3713b36 data_size 0x4(0x7f48 bytes) 2024-09-21T15:09:55.815 INFO:teuthology.orchestra.run.smithi161.stdout:5010 punch from 0x515abb4 to 0x5164c49, (0xa095 bytes) 2024-09-21T15:09:55.816 INFO:teuthology.orchestra.run.smithi161.stdout:5012 writesame 0x8bd1b65 thru 0x8bd4945 data_size 0x2d(0x2de1 bytes) 2024-09-21T15:09:55.818 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.818 INFO:teuthology.orchestra.run.smithi161.stdout:3534 punch from 0x22b002c to 0x22b8811, (0x87e5 bytes) 2024-09-21T15:09:55.818 INFO:teuthology.orchestra.run.smithi161.stdout:3536 read 0x1c6b38e thru 0x1c74c43 (0x98b6 bytes) 2024-09-21T15:09:55.828 INFO:teuthology.orchestra.run.smithi161.stdout:4979 read 0x163a196 thru 0x163d6c6 (0x3531 bytes) 2024-09-21T15:09:55.828 INFO:teuthology.orchestra.run.smithi161.stdout:4961 write 0xadc895b thru 0xadd26d1 (0x9d77 bytes) 2024-09-21T15:09:55.833 INFO:teuthology.orchestra.run.smithi161.stdout:5014 writesame 0xa4081a4 thru 0xa4085b8 data_size 0xb(0x415 bytes) 2024-09-21T15:09:55.836 INFO:teuthology.orchestra.run.smithi161.stdout:4993 trunc from 0xbe21abb to 0xab76382 2024-09-21T15:09:55.843 INFO:teuthology.orchestra.run.smithi161.stdout:4980 trunc from 0x1d4a4c2 to 0x7791817 2024-09-21T15:09:55.846 INFO:teuthology.orchestra.run.smithi161.stdout:5016 write 0x8c95e32 thru 0x8ca2339 (0xc508 bytes) 2024-09-21T15:09:55.861 INFO:teuthology.orchestra.run.smithi161.stdout:4362 trunc from 0x42c0c05 to 0xb925b1a 2024-09-21T15:09:55.861 INFO:teuthology.orchestra.run.smithi161.stdout:3537 write 0xbf6d262 thru 0xbf74578 (0x7317 bytes) 2024-09-21T15:09:55.896 INFO:teuthology.orchestra.run.smithi161.stdout:4981 writesame 0x33d0063 thru 0x33d39b8 data_size 0x29(0x3956 bytes) 2024-09-21T15:09:55.909 INFO:teuthology.orchestra.run.smithi161.stdout:4363 write 0x81353b9 thru 0x81417b7 (0xc3ff bytes) 2024-09-21T15:09:55.913 INFO:teuthology.orchestra.run.smithi161.stdout:5018 trunc from 0xbf79aef to 0xbf96b5 2024-09-21T15:09:55.922 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:55.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f110 2024-09-21T15:09:55.922 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:09:55.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4daba00 2024-09-21T15:09:55.924 INFO:teuthology.orchestra.run.smithi161.stdout:4962 writesame 0xec1a1e1 thru 0xec299bf data_size 0x31(0xf7df bytes) 2024-09-21T15:09:55.931 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.931 INFO:teuthology.orchestra.run.smithi161.stdout:4995 write 0x586fcb8 thru 0x587ee6e (0xf1b7 bytes) 2024-09-21T15:09:55.933 INFO:teuthology.orchestra.run.smithi161.stdout:4963 write 0xc716c12 thru 0xc7232e4 (0xc6d3 bytes) 2024-09-21T15:09:55.937 INFO:teuthology.orchestra.run.smithi161.stdout:4983 writesame 0x2cfceb5 thru 0x2cffff1 data_size 0x1(0x313d bytes) 2024-09-21T15:09:55.945 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.945 INFO:teuthology.orchestra.run.smithi161.stdout:4366 punch from 0x65d5b62 to 0x65e418d, (0xe62b bytes) 2024-09-21T15:09:55.945 INFO:teuthology.orchestra.run.smithi161.stdout:4368 write 0x64a374 thru 0x64a433 (0xc0 bytes) 2024-09-21T15:09:55.962 INFO:teuthology.orchestra.run.smithi161.stdout:4964 punch from 0x1995a1 to 0x19f5b7, (0x6016 bytes) 2024-09-21T15:09:55.962 INFO:teuthology.orchestra.run.smithi161.stdout:4965 punch from 0xa1105fb to 0xa111a08, (0x140d bytes) 2024-09-21T15:09:55.965 INFO:teuthology.orchestra.run.smithi161.stdout:4369 writesame 0x9c3ec39 thru 0x9c48326 data_size 0x1(0x96ee bytes) 2024-09-21T15:09:55.972 INFO:teuthology.orchestra.run.smithi161.stdout:4984 write 0x3ae92eb thru 0x3af5326 (0xc03c bytes) 2024-09-21T15:09:55.972 INFO:teuthology.orchestra.run.smithi161.stdout:3538 write 0xd30e2ff thru 0xd316484 (0x8186 bytes) 2024-09-21T15:09:55.973 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:55.977 INFO:teuthology.orchestra.run.smithi161.stdout:4966 trunc from 0xec299c0 to 0x72503b7 2024-09-21T15:09:56.001 INFO:teuthology.orchestra.run.smithi161.stdout:3539 read 0xaeb4c4f thru 0xaec15a8 (0xc95a bytes) 2024-09-21T15:09:56.002 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.002 INFO:teuthology.orchestra.run.smithi161.stdout:3543 read 0x80bd40e thru 0x80c6669 (0x925c bytes) 2024-09-21T15:09:56.002 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.002 INFO:teuthology.orchestra.run.smithi161.stdout:3546 punch from 0xc2c5bd1 to 0xc2d53b4, (0xf7e3 bytes) 2024-09-21T15:09:56.002 INFO:teuthology.orchestra.run.smithi161.stdout:3547 read 0x7de157d thru 0x7de3b36 (0x25ba bytes) 2024-09-21T15:09:56.002 INFO:teuthology.orchestra.run.smithi161.stdout:3548 read 0x1f79a5b thru 0x1f81f01 (0x84a7 bytes) 2024-09-21T15:09:56.003 INFO:teuthology.orchestra.run.smithi161.stdout:3549 read 0x4ba5ef3 thru 0x4bb36d8 (0xd7e6 bytes) 2024-09-21T15:09:56.003 INFO:teuthology.orchestra.run.smithi161.stdout:3550 writesame 0x7918fcc thru 0x7921de9 data_size 0x1(0x8e1e bytes) 2024-09-21T15:09:56.016 INFO:teuthology.orchestra.run.smithi161.stdout:4370 writesame 0xb03d442 thru 0xb03ec29 data_size 0x2d(0x17e8 bytes) 2024-09-21T15:09:56.024 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.024 INFO:teuthology.orchestra.run.smithi161.stdout:4986 read 0x39fccbd thru 0x39fe4a5 (0x17e9 bytes) 2024-09-21T15:09:56.037 INFO:teuthology.orchestra.run.smithi161.stdout:4997 write 0xc4463db thru 0xc452340 (0xbf66 bytes) 2024-09-21T15:09:56.044 INFO:teuthology.orchestra.run.smithi161.stdout:4372 read 0xb1bda35 thru 0xb1c576a (0x7d36 bytes) 2024-09-21T15:09:56.044 INFO:teuthology.orchestra.run.smithi161.stdout:4373 write 0xa39b83f thru 0xa3a19b8 (0x617a bytes) 2024-09-21T15:09:56.053 INFO:teuthology.orchestra.run.smithi161.stdout:3551 read 0x32bc8e2 thru 0x32c90f2 (0xc811 bytes) 2024-09-21T15:09:56.053 INFO:teuthology.orchestra.run.smithi161.stdout:3554 punch from 0xc240086 to 0xc24b9f5, (0xb96f bytes) 2024-09-21T15:09:56.053 INFO:teuthology.orchestra.run.smithi161.stdout:3556 writesame 0x34f0874 thru 0x34fcf0c data_size 0x7(0xc699 bytes) 2024-09-21T15:09:56.071 INFO:teuthology.orchestra.run.smithi161.stdout:4374 write 0x311fe6f thru 0x3122d78 (0x2f0a bytes) 2024-09-21T15:09:56.076 INFO:teuthology.orchestra.run.smithi161.stdout:5019 write 0x9d25c96 thru 0x9d35af1 (0xfe5c bytes) 2024-09-21T15:09:56.077 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.077 INFO:teuthology.orchestra.run.smithi161.stdout:4970 write 0x11e1431 thru 0x11e4626 (0x31f6 bytes) 2024-09-21T15:09:56.082 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.082 INFO:teuthology.orchestra.run.smithi161.stdout:3558 writesame 0xaef390f thru 0xaefe42d data_size 0x1(0xab1f bytes) 2024-09-21T15:09:56.107 INFO:teuthology.orchestra.run.smithi161.stdout:4988 write 0xddd4954 thru 0xdde1888 (0xcf35 bytes) 2024-09-21T15:09:56.111 INFO:teuthology.orchestra.run.smithi161.stdout:4375 trunc from 0xb925b1a to 0x30e233f 2024-09-21T15:09:56.129 INFO:teuthology.orchestra.run.smithi161.stdout:5020 writesame 0x11b0eec thru 0x11b3e1c data_size 0x1(0x2f31 bytes) 2024-09-21T15:09:56.129 INFO:teuthology.orchestra.run.smithi161.stdout:4998 write 0xce82d07 thru 0xce8e39a (0xb694 bytes) 2024-09-21T15:09:56.142 INFO:teuthology.orchestra.run.smithi161.stdout:3560 read 0x42cad44 thru 0x42d529c (0xa559 bytes) 2024-09-21T15:09:56.142 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.155 INFO:teuthology.orchestra.run.smithi161.stdout:3561 trunc from 0xd316485 to 0x78651ee 2024-09-21T15:09:56.166 INFO:teuthology.orchestra.run.smithi161.stdout:4989 write 0xc3439ab thru 0xc34aea4 (0x74fa bytes) 2024-09-21T15:09:56.172 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.172 INFO:teuthology.orchestra.run.smithi161.stdout:5000 write 0x7bb4924 thru 0x7bba43f (0x5b1c bytes) 2024-09-21T15:09:56.207 INFO:teuthology.orchestra.run.smithi161.stdout:5001 writesame 0x5b6a661 thru 0x5b6c39c data_size 0x2(0x1d3c bytes) 2024-09-21T15:09:56.209 INFO:teuthology.orchestra.run.smithi161.stdout:4995 read 0x94689d5 thru 0x947685e (0xde8a bytes) 2024-09-21T15:09:56.209 INFO:teuthology.orchestra.run.smithi161.stdout:4996 write 0x5816843 thru 0x58228d5 (0xc093 bytes) 2024-09-21T15:09:56.225 INFO:teuthology.orchestra.run.smithi161.stdout:5021 write 0xb5cb35d thru 0xb5d22f3 (0x6f97 bytes) 2024-09-21T15:09:56.225 INFO:teuthology.orchestra.run.smithi161.stdout:5002 read 0x9dbee07 thru 0x9dc2920 (0x3b1a bytes) 2024-09-21T15:09:56.226 INFO:teuthology.orchestra.run.smithi161.stdout:4973 write 0xc1c114d thru 0xc1ca451 (0x9305 bytes) 2024-09-21T15:09:56.226 INFO:teuthology.orchestra.run.smithi161.stdout:5005 write 0x4304d3e thru 0x430ff5e (0xb221 bytes) 2024-09-21T15:09:56.234 INFO:teuthology.orchestra.run.smithi161.stdout:4376 trunc from 0x30e233f to 0xa66b3c2 2024-09-21T15:09:56.254 INFO:teuthology.orchestra.run.smithi161.stdout:4974 punch from 0x965c0ed to 0x96676e2, (0xb5f5 bytes) 2024-09-21T15:09:56.255 INFO:teuthology.orchestra.run.smithi161.stdout:5006 write 0x7d7dcf3 thru 0x7d84ff2 (0x7300 bytes) 2024-09-21T15:09:56.255 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.256 INFO:teuthology.orchestra.run.smithi161.stdout:4998 read 0xc1969d9 thru 0xc196e9a (0x4c2 bytes) 2024-09-21T15:09:56.256 INFO:teuthology.orchestra.run.smithi161.stdout:4999 punch from 0xa1d7ce to 0xa242f1, (0x6b23 bytes) 2024-09-21T15:09:56.256 INFO:teuthology.orchestra.run.smithi161.stdout:5001 read 0x57fbb08 thru 0x580a1e8 (0xe6e1 bytes) 2024-09-21T15:09:56.258 INFO:teuthology.orchestra.run.smithi161.stdout:4975 trunc from 0xc1ca452 to 0xaad54c8 2024-09-21T15:09:56.258 INFO:teuthology.orchestra.run.smithi161.stdout:5002 read 0x6273c32 thru 0x6279f96 (0x6365 bytes) 2024-09-21T15:09:56.258 INFO:teuthology.orchestra.run.smithi161.stdout:5022 write 0x21c67fe thru 0x21cce9f (0x66a2 bytes) 2024-09-21T15:09:56.259 INFO:teuthology.orchestra.run.smithi161.stdout:5006 trunc from 0xdde1889 to 0xe565ce5 2024-09-21T15:09:56.273 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.273 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.273 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.273 INFO:teuthology.orchestra.run.smithi161.stdout:5013 writesame 0x5ba68c6 thru 0x5bade85 data_size 0x10(0x75c0 bytes) 2024-09-21T15:09:56.288 INFO:teuthology.orchestra.run.smithi161.stdout:5025 read 0x1d699a3 thru 0x1d798e9 (0xff47 bytes) 2024-09-21T15:09:56.288 INFO:teuthology.orchestra.run.smithi161.stdout:5026 punch from 0x39accb3 to 0x39adc30, (0xf7d bytes) 2024-09-21T15:09:56.289 INFO:teuthology.orchestra.run.smithi161.stdout:4377 writesame 0x5e8d78d thru 0x5e8f7f8 data_size 0xa(0x206c bytes) 2024-09-21T15:09:56.295 INFO:teuthology.orchestra.run.smithi161.stdout:3562 write 0xcc50746 thru 0xcc59f5c (0x9817 bytes) 2024-09-21T15:09:56.297 INFO:teuthology.orchestra.run.smithi161.stdout:5027 trunc from 0xb5d22f4 to 0x7a6d3d2 2024-09-21T15:09:56.306 INFO:teuthology.orchestra.run.smithi161.stdout:5016 punch from 0x15ffce3 to 0x160bb40, (0xbe5d bytes) 2024-09-21T15:09:56.306 INFO:teuthology.orchestra.run.smithi161.stdout:5017 writesame 0x2f62265 thru 0x2f64d3d data_size 0x1(0x2ad9 bytes) 2024-09-21T15:09:56.315 INFO:teuthology.orchestra.run.smithi161.stdout:4379 read 0x3f8cd7 thru 0x3f9b3e (0xe68 bytes) 2024-09-21T15:09:56.316 INFO:teuthology.orchestra.run.smithi161.stdout:4380 write 0x6f665a8 thru 0x6f6bcff (0x5758 bytes) 2024-09-21T15:09:56.319 INFO:teuthology.orchestra.run.smithi161.stdout:5007 write 0xa20ae29 thru 0xa20e887 (0x3a5f bytes) 2024-09-21T15:09:56.331 INFO:teuthology.orchestra.run.smithi161.stdout:3563 trunc from 0xcc59f5d to 0x7bba3af 2024-09-21T15:09:56.331 INFO:teuthology.orchestra.run.smithi161.stdout:4977 read 0x9ae047e thru 0x9ae2ac2 (0x2645 bytes) 2024-09-21T15:09:56.342 INFO:teuthology.orchestra.run.smithi161.stdout:4381 read 0x49d1973 thru 0x49e17d7 (0xfe65 bytes) 2024-09-21T15:09:56.350 INFO:teuthology.orchestra.run.smithi161.stdout:5020 trunc from 0xce8e39b to 0x46fd0f 2024-09-21T15:09:56.356 INFO:teuthology.orchestra.run.smithi161.stdout:5008 writesame 0xc6861c6 thru 0xc689451 data_size 0x4(0x328c bytes) 2024-09-21T15:09:56.358 INFO:teuthology.orchestra.run.smithi161.stdout:4382 trunc from 0xa66b3c2 to 0x1f36641 2024-09-21T15:09:56.384 INFO:teuthology.orchestra.run.smithi161.stdout:4980 writesame 0xe992747 thru 0xe99fbd9 data_size 0x1(0xd493 bytes) 2024-09-21T15:09:56.389 INFO:teuthology.orchestra.run.smithi161.stdout:4981 punch from 0x322c8b9 to 0x322d91b, (0x1062 bytes) 2024-09-21T15:09:56.389 INFO:teuthology.orchestra.run.smithi161.stdout:4983 read 0x49518c1 thru 0x4956d2b (0x546b bytes) 2024-09-21T15:09:56.391 INFO:teuthology.orchestra.run.smithi161.stdout:4984 read 0xe825199 thru 0xe82d01c (0x7e84 bytes) 2024-09-21T15:09:56.392 INFO:teuthology.orchestra.run.smithi161.stdout:4985 write 0x407d223 thru 0x407e16c (0xf4a bytes) 2024-09-21T15:09:56.399 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.399 INFO:teuthology.orchestra.run.smithi161.stdout:5010 writesame 0xd9c3e75 thru 0xd9d2250 data_size 0x6(0xe3dc bytes) 2024-09-21T15:09:56.402 INFO:teuthology.orchestra.run.smithi161.stdout:5029 trunc from 0x7a6d3d2 to 0xdfec17e 2024-09-21T15:09:56.429 INFO:teuthology.orchestra.run.smithi161.stdout:3564 read 0xf8db7b thru 0xf8fd26 (0x21ac bytes) 2024-09-21T15:09:56.448 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.448 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:5030 read 0xb07006f thru 0xb078923 (0x88b5 bytes) 2024-09-21T15:09:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:5031 punch from 0x5cc66b8 to 0x5cd3fc5, (0xd90d bytes) 2024-09-21T15:09:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:5032 punch from 0x64b0a22 to 0x64b5d70, (0x534e bytes) 2024-09-21T15:09:56.455 INFO:teuthology.orchestra.run.smithi161.stdout:5033 read 0x93c8d1 thru 0x9438d9 (0x7009 bytes) 2024-09-21T15:09:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:4383 read 0x163afd5 thru 0x1644fe1 (0xa00d bytes) 2024-09-21T15:09:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:4384 read 0x1b9e649 thru 0x1bad342 (0xecfa bytes) 2024-09-21T15:09:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:4385 read 0x142098a thru 0x142a982 (0x9ff9 bytes) 2024-09-21T15:09:56.466 INFO:teuthology.orchestra.run.smithi161.stdout:5034 trunc from 0xdfec17e to 0x92c2103 2024-09-21T15:09:56.468 INFO:teuthology.orchestra.run.smithi161.stdout:4986 write 0xe9fbafe thru 0xe9ff458 (0x395b bytes) 2024-09-21T15:09:56.469 INFO:teuthology.orchestra.run.smithi161.stdout:3565 writesame 0x9593556 thru 0x9597573 data_size 0x1d(0x401e bytes) 2024-09-21T15:09:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:3567 read 0x91a1fd9 thru 0x91ae7e4 (0xc80c bytes) 2024-09-21T15:09:56.473 INFO:teuthology.orchestra.run.smithi161.stdout:3568 writesame 0x338d745 thru 0x339d4c9 data_size 0x1(0xfd85 bytes) 2024-09-21T15:09:56.493 INFO:teuthology.orchestra.run.smithi161.stdout:5021 punch from 0xef17 to 0xf848, (0x931 bytes) 2024-09-21T15:09:56.495 INFO:teuthology.orchestra.run.smithi161.stdout:4987 read 0x68bd21a thru 0x68be4d7 (0x12be bytes) 2024-09-21T15:09:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:4989 write 0x1f38152 thru 0x1f3964a (0x14f9 bytes) 2024-09-21T15:09:56.504 INFO:teuthology.orchestra.run.smithi161.stdout:4990 write 0xad936b4 thru 0xada02b2 (0xcbff bytes) 2024-09-21T15:09:56.506 INFO:teuthology.orchestra.run.smithi161.stdout:5016 write 0xe668c22 thru 0xe668f87 (0x366 bytes) 2024-09-21T15:09:56.513 INFO:teuthology.orchestra.run.smithi161.stdout:4386 write 0x7161a5a thru 0x7165b4d (0x40f4 bytes) 2024-09-21T15:09:56.524 INFO:teuthology.orchestra.run.smithi161.stdout:5017 read 0x45401c0 thru 0x4542fe2 (0x2e23 bytes) 2024-09-21T15:09:56.525 INFO:teuthology.orchestra.run.smithi161.stdout:5018 trunc from 0xe668f88 to 0xdb50e86 2024-09-21T15:09:56.549 INFO:teuthology.orchestra.run.smithi161.stdout:3569 write 0x265dbab thru 0x266cf73 (0xf3c9 bytes) 2024-09-21T15:09:56.553 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.554 INFO:teuthology.orchestra.run.smithi161.stdout:4991 read 0xd13094f thru 0xd13b513 (0xabc5 bytes) 2024-09-21T15:09:56.556 INFO:teuthology.orchestra.run.smithi161.stdout:5022 write 0x8e96f27 thru 0x8ea630c (0xf3e6 bytes) 2024-09-21T15:09:56.559 INFO:teuthology.orchestra.run.smithi161.stdout:5037 trunc from 0x92c2103 to 0x71352b8 2024-09-21T15:09:56.566 INFO:teuthology.orchestra.run.smithi161.stdout:3570 read 0xededed thru 0xee331d (0x4531 bytes) 2024-09-21T15:09:56.566 INFO:teuthology.orchestra.run.smithi161.stdout:4388 punch from 0x17713f7 to 0x1774610, (0x3219 bytes) 2024-09-21T15:09:56.566 INFO:teuthology.orchestra.run.smithi161.stdout:3571 writesame 0x1ac865c thru 0x1ad0ced data_size 0x32(0x8692 bytes) 2024-09-21T15:09:56.566 INFO:teuthology.orchestra.run.smithi161.stdout:4389 read 0x410fad2 thru 0x411b83d (0xbd6c bytes) 2024-09-21T15:09:56.567 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.567 INFO:teuthology.orchestra.run.smithi161.stdout:4391 write 0x42ccdc1 thru 0x42cf90f (0x2b4f bytes) 2024-09-21T15:09:56.573 INFO:teuthology.orchestra.run.smithi161.stdout:4992 trunc from 0xe9ff459 to 0x5c09fda 2024-09-21T15:09:56.586 INFO:teuthology.orchestra.run.smithi161.stdout:5023 read 0x8b251d0 thru 0x8b30d9e (0xbbcf bytes) 2024-09-21T15:09:56.589 INFO:teuthology.orchestra.run.smithi161.stdout:4392 punch from 0x2306d58 to 0x2312d5c, (0xc004 bytes) 2024-09-21T15:09:56.590 INFO:teuthology.orchestra.run.smithi161.stdout:4394 read 0x3bf6791 thru 0x3c02d26 (0xc596 bytes) 2024-09-21T15:09:56.590 INFO:teuthology.orchestra.run.smithi161.stdout:4395 punch from 0x1d90b57 to 0x1d94ee0, (0x4389 bytes) 2024-09-21T15:09:56.590 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.590 INFO:teuthology.orchestra.run.smithi161.stdout:4398 read 0x6e7edaa thru 0x6e83889 (0x4ae0 bytes) 2024-09-21T15:09:56.590 INFO:teuthology.orchestra.run.smithi161.stdout:4399 read 0x671bd3c thru 0x6725041 (0x9306 bytes) 2024-09-21T15:09:56.590 INFO:teuthology.orchestra.run.smithi161.stdout:4400 writesame 0xf8bf1a thru 0xf9ab7a data_size 0x17(0xec61 bytes) 2024-09-21T15:09:56.596 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.613 INFO:teuthology.orchestra.run.smithi161.stdout:5038 punch from 0x4a40edc to 0x4a45c5e, (0x4d82 bytes) 2024-09-21T15:09:56.613 INFO:teuthology.orchestra.run.smithi161.stdout:5039 punch from 0x2bd9f78 to 0x2be56a7, (0xb72f bytes) 2024-09-21T15:09:56.617 INFO:teuthology.orchestra.run.smithi161.stdout:4402 writesame 0x21e239f thru 0x21f123f data_size 0x7(0xeea1 bytes) 2024-09-21T15:09:56.617 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.617 INFO:teuthology.orchestra.run.smithi161.stdout:5020 read 0x5f9412e thru 0x5f9990b (0x57de bytes) 2024-09-21T15:09:56.623 INFO:teuthology.orchestra.run.smithi161.stdout:5021 trunc from 0xdb50e86 to 0xa732811 2024-09-21T15:09:56.659 INFO:teuthology.orchestra.run.smithi161.stdout:5024 write 0xdfe2994 thru 0xdfe9263 (0x68d0 bytes) 2024-09-21T15:09:56.667 INFO:teuthology.orchestra.run.smithi161.stdout:3573 writesame 0xe2fc6d2 thru 0xe307d8a data_size 0x1(0xb6b9 bytes) 2024-09-21T15:09:56.672 INFO:teuthology.orchestra.run.smithi161.stdout:5040 writesame 0x92eb8e6 thru 0x92ec910 data_size 0x1(0x102b bytes) 2024-09-21T15:09:56.673 INFO:teuthology.orchestra.run.smithi161.stdout:3574 read 0x8bf5d78 thru 0x8c0578b (0xfa14 bytes) 2024-09-21T15:09:56.673 INFO:teuthology.orchestra.run.smithi161.stdout:3575 punch from 0x46a318c to 0x46a9db3, (0x6c27 bytes) 2024-09-21T15:09:56.673 INFO:teuthology.orchestra.run.smithi161.stdout:3577 write 0x5e5041 thru 0x5f1097 (0xc057 bytes) 2024-09-21T15:09:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:5025 punch from 0xc77e8a5 to 0xc780a39, (0x2194 bytes) 2024-09-21T15:09:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:5026 read 0x203435c thru 0x203a66a (0x630f bytes) 2024-09-21T15:09:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:4994 write 0xdbc5ea thru 0xdbd059 (0xa70 bytes) 2024-09-21T15:09:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:5027 read 0x92510d7 thru 0x9255730 (0x465a bytes) 2024-09-21T15:09:56.683 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.696 INFO:teuthology.orchestra.run.smithi161.stdout:4403 write 0x8384aaa thru 0x838df93 (0x94ea bytes) 2024-09-21T15:09:56.700 INFO:teuthology.orchestra.run.smithi161.stdout:5041 trunc from 0x92ec911 to 0xdff3449 2024-09-21T15:09:56.710 INFO:teuthology.orchestra.run.smithi161.stdout:5029 trunc from 0xdfe9264 to 0x4ef790d 2024-09-21T15:09:56.711 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:56.702+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95a410 2024-09-21T15:09:56.711 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:56.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636a0632a90 2024-09-21T15:09:56.712 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:56.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636a1dfe5b0 2024-09-21T15:09:56.712 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:56.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9636750 2024-09-21T15:09:56.712 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:56.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9bd95f0 2024-09-21T15:09:56.712 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:56.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636aebddee0 2024-09-21T15:09:56.712 INFO:teuthology.orchestra.run.smithi161.stdout:3579 write 0x4cbfb78 thru 0x4ccd294 (0xd71d bytes) 2024-09-21T15:09:56.718 INFO:teuthology.orchestra.run.smithi161.stdout:4995 trunc from 0x5c09fda to 0x20f35e9 2024-09-21T15:09:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:5022 write 0xe21600 thru 0xe282cb (0x6ccc bytes) 2024-09-21T15:09:56.744 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.759 INFO:teuthology.orchestra.run.smithi161.stdout:3580 trunc from 0xe307d8b to 0x9d0ac02 2024-09-21T15:09:56.794 INFO:teuthology.orchestra.run.smithi161.stdout:4406 writesame 0xd1a592d thru 0xd1ad11c data_size 0x26(0x77f0 bytes) 2024-09-21T15:09:56.800 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.813 INFO:teuthology.orchestra.run.smithi161.stdout:4408 trunc from 0xd1ad11d to 0x69985d7 2024-09-21T15:09:56.872 INFO:teuthology.orchestra.run.smithi161.stdout:5042 read 0x66e1943 thru 0x66e1e3a (0x4f8 bytes) 2024-09-21T15:09:56.872 INFO:teuthology.orchestra.run.smithi161.stdout:5043 read 0xbc5284d thru 0xbc55a07 (0x31bb bytes) 2024-09-21T15:09:56.872 INFO:teuthology.orchestra.run.smithi161.stdout:5044 write 0xaa20c04 thru 0xaa210bf (0x4bc bytes) 2024-09-21T15:09:56.875 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.875 INFO:teuthology.orchestra.run.smithi161.stdout:5031 read 0x2ec4772 thru 0x2ec880d (0x409c bytes) 2024-09-21T15:09:56.875 INFO:teuthology.orchestra.run.smithi161.stdout:5032 read 0x4685b07 thru 0x46948ec (0xede6 bytes) 2024-09-21T15:09:56.876 INFO:teuthology.orchestra.run.smithi161.stdout:5033 writesame 0x1a69f60 thru 0x1a6a526 data_size 0x3(0x5c7 bytes) 2024-09-21T15:09:56.877 INFO:teuthology.orchestra.run.smithi161.stdout:4409 trunc from 0x69985d7 to 0xcb03483 2024-09-21T15:09:56.887 INFO:teuthology.orchestra.run.smithi161.stdout:5045 punch from 0x63f1eab to 0x63fa6bb, (0x8810 bytes) 2024-09-21T15:09:56.887 INFO:teuthology.orchestra.run.smithi161.stdout:5048 read 0x911dab0 thru 0x9122f76 (0x54c7 bytes) 2024-09-21T15:09:56.887 INFO:teuthology.orchestra.run.smithi161.stdout:5049 punch from 0x1674489 to 0x167e455, (0x9fcc bytes) 2024-09-21T15:09:56.891 INFO:teuthology.orchestra.run.smithi161.stdout:5036 read 0x2dd1748 thru 0x2dd1f30 (0x7e9 bytes) 2024-09-21T15:09:56.898 INFO:teuthology.orchestra.run.smithi161.stdout:5050 trunc from 0xdff3449 to 0xafbc64b 2024-09-21T15:09:56.899 INFO:teuthology.orchestra.run.smithi161.stdout:5039 trunc from 0x4ef790d to 0x31e0c31 2024-09-21T15:09:56.914 INFO:teuthology.orchestra.run.smithi161.stdout:4411 read 0xa050496 thru 0xa051489 (0xff4 bytes) 2024-09-21T15:09:56.914 INFO:teuthology.orchestra.run.smithi161.stdout:4412 read 0xc6e59eb thru 0xc6f0b57 (0xb16d bytes) 2024-09-21T15:09:56.914 INFO:teuthology.orchestra.run.smithi161.stdout:4413 writesame 0x2f2e77d thru 0x2f3d912 data_size 0x22(0xf196 bytes) 2024-09-21T15:09:56.954 INFO:teuthology.orchestra.run.smithi161.stdout:5040 trunc from 0x31e0c31 to 0x1c5eaf3 2024-09-21T15:09:56.965 INFO:teuthology.orchestra.run.smithi161.stdout:5051 trunc from 0xafbc64b to 0xc620de 2024-09-21T15:09:56.979 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.979 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.979 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:56.994 INFO:teuthology.orchestra.run.smithi161.stdout:5041 write 0x531a27 thru 0x534edf (0x34b9 bytes) 2024-09-21T15:09:56.997 INFO:teuthology.orchestra.run.smithi161.stdout:4419 trunc from 0xcb03483 to 0x2ed2e15 2024-09-21T15:09:57.028 INFO:teuthology.orchestra.run.smithi161.stdout:4996 write 0x2868efd thru 0x286d57e (0x4682 bytes) 2024-09-21T15:09:57.041 INFO:teuthology.orchestra.run.smithi161.stdout:4998 read 0x23cd5c5 thru 0x23d1bd2 (0x460e bytes) 2024-09-21T15:09:57.042 INFO:teuthology.orchestra.run.smithi161.stdout:5001 read 0x45ee35 thru 0x462449 (0x3615 bytes) 2024-09-21T15:09:57.045 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.045 INFO:teuthology.orchestra.run.smithi161.stdout:5004 punch from 0x16d6451 to 0x16d66ce, (0x27d bytes) 2024-09-21T15:09:57.049 INFO:teuthology.orchestra.run.smithi161.stdout:5052 trunc from 0xc620de to 0x8056310 2024-09-21T15:09:57.050 INFO:teuthology.orchestra.run.smithi161.stdout:5023 read 0x2252b93 thru 0x225bfab (0x9419 bytes) 2024-09-21T15:09:57.056 INFO:teuthology.orchestra.run.smithi161.stdout:3581 trunc from 0x9d0ac02 to 0xd2be4b8 2024-09-21T15:09:57.056 INFO:teuthology.orchestra.run.smithi161.stdout:5005 trunc from 0x286d57f to 0x78656ae 2024-09-21T15:09:57.064 INFO:teuthology.orchestra.run.smithi161.stdout:5024 trunc from 0xa732811 to 0x2bed321 2024-09-21T15:09:57.068 INFO:teuthology.orchestra.run.smithi161.stdout:4420 read 0x1c6efde thru 0x1c73c62 (0x4c85 bytes) 2024-09-21T15:09:57.068 INFO:teuthology.orchestra.run.smithi161.stdout:5043 write 0xcffd245 thru 0xcffe197 (0xf53 bytes) 2024-09-21T15:09:57.085 INFO:teuthology.orchestra.run.smithi161.stdout:5044 writesame 0xae4a66e thru 0xae558e2 data_size 0x1(0xb275 bytes) 2024-09-21T15:09:57.097 INFO:teuthology.orchestra.run.smithi161.stdout:5053 punch from 0x6bda5ee to 0x6bdf712, (0x5124 bytes) 2024-09-21T15:09:57.097 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.097 INFO:teuthology.orchestra.run.smithi161.stdout:5055 write 0x6d26d6c thru 0x6d2b69b (0x4930 bytes) 2024-09-21T15:09:57.109 INFO:teuthology.orchestra.run.smithi161.stdout:3583 punch from 0x81e1982 to 0x81e907a, (0x76f8 bytes) 2024-09-21T15:09:57.109 INFO:teuthology.orchestra.run.smithi161.stdout:5006 writesame 0x24235f1 thru 0x24306b3 data_size 0x1(0xd0c3 bytes) 2024-09-21T15:09:57.109 INFO:teuthology.orchestra.run.smithi161.stdout:3584 write 0x27576e2 thru 0x275c2aa (0x4bc9 bytes) 2024-09-21T15:09:57.127 INFO:teuthology.orchestra.run.smithi161.stdout:4423 write 0x61e08a4 thru 0x61e34a2 (0x2bff bytes) 2024-09-21T15:09:57.147 INFO:teuthology.orchestra.run.smithi161.stdout:5046 writesame 0x9bfe70b thru 0x9c09589 data_size 0x1f(0xae7f bytes) 2024-09-21T15:09:57.164 INFO:teuthology.orchestra.run.smithi161.stdout:3588 read 0x5dc9985 thru 0x5dd40f5 (0xa771 bytes) 2024-09-21T15:09:57.165 INFO:teuthology.orchestra.run.smithi161.stdout:3589 read 0x6350845 thru 0x635914e (0x890a bytes) 2024-09-21T15:09:57.165 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.167 INFO:teuthology.orchestra.run.smithi161.stdout:3592 trunc from 0xd2be4b8 to 0xc4cf6d1 2024-09-21T15:09:57.170 INFO:teuthology.orchestra.run.smithi161.stdout:5009 clone 32 order 20 su 32768 sc 2 2024-09-21T15:09:57.175 INFO:teuthology.orchestra.run.smithi161.stdout:4425 punch from 0x25fc480 to 0x2601ac8, (0x5648 bytes) 2024-09-21T15:09:57.175 INFO:teuthology.orchestra.run.smithi161.stdout:4426 read 0xa59fb6 thru 0xa5b7fe (0x1849 bytes) 2024-09-21T15:09:57.176 INFO:teuthology.orchestra.run.smithi161.stdout:4427 punch from 0x3863da7 to 0x386b75b, (0x79b4 bytes) 2024-09-21T15:09:57.176 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.176 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.176 INFO:teuthology.orchestra.run.smithi161.stdout:4430 punch from 0x7e0935 to 0x7eb49d, (0xab68 bytes) 2024-09-21T15:09:57.176 INFO:teuthology.orchestra.run.smithi161.stdout:4431 read 0x538d465 thru 0x539b9bc (0xe558 bytes) 2024-09-21T15:09:57.181 INFO:teuthology.orchestra.run.smithi161.stdout:5025 write 0x22dc5a7 thru 0x22e116d (0x4bc7 bytes) 2024-09-21T15:09:57.216 INFO:teuthology.orchestra.run.smithi161.stdout:5056 write 0xd12bcd1 thru 0xd12f596 (0x38c6 bytes) 2024-09-21T15:09:57.232 INFO:teuthology.orchestra.run.smithi161.stdout:3595 read 0x9e7fe39 thru 0x9e8840c (0x85d4 bytes) 2024-09-21T15:09:57.232 INFO:teuthology.orchestra.run.smithi161.stdout:3596 writesame 0xac00d30 thru 0xac04015 data_size 0x5(0x32e6 bytes) 2024-09-21T15:09:57.233 INFO:teuthology.orchestra.run.smithi161.stdout:4432 writesame 0xc5b6961 thru 0xc5bf05a data_size 0x27(0x86fa bytes) 2024-09-21T15:09:57.234 INFO:teuthology.orchestra.run.smithi161.stdout:5047 write 0xdfdbf88 thru 0xdfe769f (0xb718 bytes) 2024-09-21T15:09:57.239 INFO:teuthology.orchestra.run.smithi161.stdout:4433 read 0x74eb89c thru 0x74f43fe (0x8b63 bytes) 2024-09-21T15:09:57.239 INFO:teuthology.orchestra.run.smithi161.stdout:5060 writesame 0x824e7d3 thru 0x82549a6 data_size 0x6(0x61d4 bytes) 2024-09-21T15:09:57.240 INFO:teuthology.orchestra.run.smithi161.stdout:4434 write 0x7bdb029 thru 0x7be337e (0x8356 bytes) 2024-09-21T15:09:57.252 INFO:teuthology.orchestra.run.smithi161.stdout:3598 read 0xb221801 thru 0xb224813 (0x3013 bytes) 2024-09-21T15:09:57.252 INFO:teuthology.orchestra.run.smithi161.stdout:3599 read 0x1d56582 thru 0x1d594fb (0x2f7a bytes) 2024-09-21T15:09:57.252 INFO:teuthology.orchestra.run.smithi161.stdout:3600 read 0x56039c6 thru 0x56056ba (0x1cf5 bytes) 2024-09-21T15:09:57.257 INFO:teuthology.orchestra.run.smithi161.stdout:5048 write 0xd4f8ebf thru 0xd501619 (0x875b bytes) 2024-09-21T15:09:57.257 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.262 INFO:teuthology.orchestra.run.smithi161.stdout:4436 trunc from 0xc5bf05b to 0xec71d00 2024-09-21T15:09:57.266 INFO:teuthology.orchestra.run.smithi161.stdout:5061 writesame 0xbcd314a thru 0xbcd5eb6 data_size 0x1(0x2d6d bytes) 2024-09-21T15:09:57.281 INFO:teuthology.orchestra.run.smithi161.stdout:5026 write 0x7fa63b8 thru 0x7fa9ddd (0x3a26 bytes) 2024-09-21T15:09:57.296 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.297 INFO:teuthology.orchestra.run.smithi161.stdout:5064 read 0x5bff01e thru 0x5c0eb9a (0xfb7d bytes) 2024-09-21T15:09:57.297 INFO:teuthology.orchestra.run.smithi161.stdout:5065 read 0x60aac8d thru 0x60ace3a (0x21ae bytes) 2024-09-21T15:09:57.297 INFO:teuthology.orchestra.run.smithi161.stdout:5066 write 0x63d0ef3 thru 0x63dd8fe (0xca0c bytes) 2024-09-21T15:09:57.298 INFO:teuthology.orchestra.run.smithi161.stdout:5049 trunc from 0xdfe76a0 to 0x413ecfa 2024-09-21T15:09:57.312 INFO:teuthology.orchestra.run.smithi161.stdout:3601 write 0xee197c0 thru 0xee2009f (0x68e0 bytes) 2024-09-21T15:09:57.316 INFO:teuthology.orchestra.run.smithi161.stdout:4437 read 0x8bee8ef thru 0x8bf41f9 (0x590b bytes) 2024-09-21T15:09:57.316 INFO:teuthology.orchestra.run.smithi161.stdout:4441 read 0x620eaec thru 0x621e2c1 (0xf7d6 bytes) 2024-09-21T15:09:57.316 INFO:teuthology.orchestra.run.smithi161.stdout:4442 write 0x2724252 thru 0x272baae (0x785d bytes) 2024-09-21T15:09:57.320 INFO:teuthology.orchestra.run.smithi161.stdout:5027 read 0xc24afc thru 0xc2f82e (0xad33 bytes) 2024-09-21T15:09:57.343 INFO:teuthology.orchestra.run.smithi161.stdout:3602 read 0xbe3263a thru 0xbe3551b (0x2ee2 bytes) 2024-09-21T15:09:57.343 INFO:teuthology.orchestra.run.smithi161.stdout:3603 read 0x3407c3d thru 0x340d3e8 (0x57ac bytes) 2024-09-21T15:09:57.343 INFO:teuthology.orchestra.run.smithi161.stdout:5067 write 0x5955a6b thru 0x595b7f1 (0x5d87 bytes) 2024-09-21T15:09:57.343 INFO:teuthology.orchestra.run.smithi161.stdout:4444 write 0x23d1fca thru 0x23d36e7 (0x171e bytes) 2024-09-21T15:09:57.344 INFO:teuthology.orchestra.run.smithi161.stdout:3605 writesame 0xc9435b8 thru 0xc94dc2d data_size 0x8f(0xa676 bytes) 2024-09-21T15:09:57.363 INFO:teuthology.orchestra.run.smithi161.stdout:4445 write 0x5f4c297 thru 0x5f52ef4 (0x6c5e bytes) 2024-09-21T15:09:57.363 INFO:teuthology.orchestra.run.smithi161.stdout:3609 write 0x70ffa46 thru 0x7101676 (0x1c31 bytes) 2024-09-21T15:09:57.372 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.372 INFO:teuthology.orchestra.run.smithi161.stdout:5069 punch from 0x55a1be7 to 0x55ada0e, (0xbe27 bytes) 2024-09-21T15:09:57.372 INFO:teuthology.orchestra.run.smithi161.stdout:5072 writesame 0x13ed517 thru 0x13fd4af data_size 0x11(0xff99 bytes) 2024-09-21T15:09:57.380 INFO:teuthology.orchestra.run.smithi161.stdout:3610 read 0x61e385a thru 0x61edb2a (0xa2d1 bytes) 2024-09-21T15:09:57.381 INFO:teuthology.orchestra.run.smithi161.stdout:4446 read 0x2ef071b thru 0x2ef17c3 (0x10a9 bytes) 2024-09-21T15:09:57.381 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.381 INFO:teuthology.orchestra.run.smithi161.stdout:4448 write 0x4d720df thru 0x4d7dbc0 (0xbae2 bytes) 2024-09-21T15:09:57.382 INFO:teuthology.orchestra.run.smithi161.stdout:3611 writesame 0xc87710c thru 0xc88244c data_size 0x1(0xb341 bytes) 2024-09-21T15:09:57.390 INFO:teuthology.orchestra.run.smithi161.stdout:5028 write 0xbe42e9a thru 0xbe4f06a (0xc1d1 bytes) 2024-09-21T15:09:57.401 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.401 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.401 INFO:teuthology.orchestra.run.smithi161.stdout:4451 read 0x4b1d5fc thru 0x4b1f96b (0x2370 bytes) 2024-09-21T15:09:57.401 INFO:teuthology.orchestra.run.smithi161.stdout:4453 writesame 0x3a91bd0 thru 0x3a955ca data_size 0x1(0x39fb bytes) 2024-09-21T15:09:57.425 INFO:teuthology.orchestra.run.smithi161.stdout:5074 writesame 0x9aa14ac thru 0x9aab619 data_size 0x1(0xa16e bytes) 2024-09-21T15:09:57.435 INFO:teuthology.orchestra.run.smithi161.stdout:3612 punch from 0xb2ba65b to 0xb2c37cd, (0x9172 bytes) 2024-09-21T15:09:57.435 INFO:teuthology.orchestra.run.smithi161.stdout:3614 read 0x6acfd83 thru 0x6ade0af (0xe32d bytes) 2024-09-21T15:09:57.436 INFO:teuthology.orchestra.run.smithi161.stdout:3615 read 0x68b3519 thru 0x68be5fb (0xb0e3 bytes) 2024-09-21T15:09:57.436 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.436 INFO:teuthology.orchestra.run.smithi161.stdout:5030 writesame 0x5375589 thru 0x53816d9 data_size 0xb(0xc151 bytes) 2024-09-21T15:09:57.437 INFO:teuthology.orchestra.run.smithi161.stdout:3617 read 0x4b39e1c thru 0x4b47eef (0xe0d4 bytes) 2024-09-21T15:09:57.439 INFO:teuthology.orchestra.run.smithi161.stdout:3618 writesame 0x349c37b thru 0x34aa764 data_size 0x1(0xe3ea bytes) 2024-09-21T15:09:57.441 INFO:teuthology.orchestra.run.smithi161.stdout:4454 punch from 0xbdb6151 to 0xbdbdfd6, (0x7e85 bytes) 2024-09-21T15:09:57.441 INFO:teuthology.orchestra.run.smithi161.stdout:4456 read 0x639e564 thru 0x63a852c (0x9fc9 bytes) 2024-09-21T15:09:57.441 INFO:teuthology.orchestra.run.smithi161.stdout:4457 punch from 0x1dceace to 0x1dda5fc, (0xbb2e bytes) 2024-09-21T15:09:57.445 INFO:teuthology.orchestra.run.smithi161.stdout:5050 writesame 0xc653d02 thru 0xc6569e6 data_size 0x3(0x2ce5 bytes) 2024-09-21T15:09:57.453 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.464 INFO:teuthology.orchestra.run.smithi161.stdout:3621 trunc from 0xee200a0 to 0x9b4fa1e 2024-09-21T15:09:57.465 INFO:teuthology.orchestra.run.smithi161.stdout:4458 trunc from 0xec71d00 to 0x2e69c98 2024-09-21T15:09:57.480 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.483 INFO:teuthology.orchestra.run.smithi161.stdout:5075 writesame 0xe50e11 thru 0xe5d09d data_size 0x1(0xc28d bytes) 2024-09-21T15:09:57.531 INFO:teuthology.orchestra.run.smithi161.stdout:5076 writesame 0x41f0844 thru 0x41fce98 data_size 0x1(0xc655 bytes) 2024-09-21T15:09:57.550 INFO:teuthology.orchestra.run.smithi161.stdout:5051 write 0xd52933b thru 0xd52ac8f (0x1955 bytes) 2024-09-21T15:09:57.551 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.551 INFO:teuthology.orchestra.run.smithi161.stdout:3624 read 0x989a79e thru 0x98a7216 (0xca79 bytes) 2024-09-21T15:09:57.552 INFO:teuthology.orchestra.run.smithi161.stdout:3625 punch from 0x502aac9 to 0x503356e, (0x8aa5 bytes) 2024-09-21T15:09:57.552 INFO:teuthology.orchestra.run.smithi161.stdout:3626 read 0x74a8f82 thru 0x74a93e0 (0x45f bytes) 2024-09-21T15:09:57.552 INFO:teuthology.orchestra.run.smithi161.stdout:3628 write 0x971a678 thru 0x971c81e (0x21a7 bytes) 2024-09-21T15:09:57.571 INFO:teuthology.orchestra.run.smithi161.stdout:5032 write 0xc270f7d thru 0xc272b07 (0x1b8b bytes) 2024-09-21T15:09:57.573 INFO:teuthology.orchestra.run.smithi161.stdout:3629 read 0x10ae1bc thru 0x10bc56c (0xe3b1 bytes) 2024-09-21T15:09:57.575 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.575 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.587 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.590 INFO:teuthology.orchestra.run.smithi161.stdout:5053 trunc from 0xd52ac90 to 0xbb3f2de 2024-09-21T15:09:57.591 INFO:teuthology.orchestra.run.smithi161.stdout:5077 punch from 0x7c34c46 to 0x7c3ca29, (0x7de3 bytes) 2024-09-21T15:09:57.591 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.607 INFO:teuthology.orchestra.run.smithi161.stdout:4461 write 0x80abf99 thru 0x80b9826 (0xd88e bytes) 2024-09-21T15:09:57.610 INFO:teuthology.orchestra.run.smithi161.stdout:5079 trunc from 0xd12f597 to 0x2d46ebd 2024-09-21T15:09:57.650 INFO:teuthology.orchestra.run.smithi161.stdout:3632 writesame 0xbfee9ec thru 0xbff3cec data_size 0x9(0x5301 bytes) 2024-09-21T15:09:57.666 INFO:teuthology.orchestra.run.smithi161.stdout:3634 write 0x121c7c8 thru 0x121dad0 (0x1309 bytes) 2024-09-21T15:09:57.704 INFO:teuthology.orchestra.run.smithi161.stdout:5054 punch from 0xa7207e3 to 0xa725153, (0x4970 bytes) 2024-09-21T15:09:57.704 INFO:teuthology.orchestra.run.smithi161.stdout:5055 read 0x99c152a thru 0x99c649e (0x4f75 bytes) 2024-09-21T15:09:57.704 INFO:teuthology.orchestra.run.smithi161.stdout:5056 write 0xb1906 thru 0xb399e (0x2099 bytes) 2024-09-21T15:09:57.725 INFO:teuthology.orchestra.run.smithi161.stdout:5034 write 0xdaa7ce6 thru 0xdab4e3d (0xd158 bytes) 2024-09-21T15:09:57.739 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:57.739 INFO:teuthology.orchestra.run.smithi161.stdout:3637 punch from 0xa99bb15 to 0xa9a3d6d, (0x8258 bytes) 2024-09-21T15:09:57.739 INFO:teuthology.orchestra.run.smithi161.stdout:3638 write 0x3671f84 thru 0x3679800 (0x787d bytes) 2024-09-21T15:09:57.752 INFO:teuthology.orchestra.run.smithi161.stdout:5057 read 0x21732be thru 0x2173e85 (0xbc8 bytes) 2024-09-21T15:09:57.752 INFO:teuthology.orchestra.run.smithi161.stdout:5059 read 0x4b35e69 thru 0x4b43bbb (0xdd53 bytes) 2024-09-21T15:09:57.752 INFO:teuthology.orchestra.run.smithi161.stdout:5060 writesame 0x6e83b87 thru 0x6e92e5a data_size 0x2(0xf2d4 bytes) 2024-09-21T15:09:57.823 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.806+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95a410 2024-09-21T15:09:57.823 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.806+0000 7f7fd044c700 -1 reset not still connected to 0x5636a0632a90 2024-09-21T15:09:57.824 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.810+0000 7f7fd044c700 -1 reset not still connected to 0x5636a0632dd0 2024-09-21T15:09:57.824 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.810+0000 7f7fd044c700 -1 reset not still connected to 0x5636a08f3ad0 2024-09-21T15:09:57.825 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.810+0000 7f7fd044c700 -1 reset not still connected to 0x5636a1d3b040 2024-09-21T15:09:57.825 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.810+0000 7f7fd044c700 -1 reset not still connected to 0x5636a1dfe5b0 2024-09-21T15:09:57.825 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.810+0000 7f7fd044c700 -1 reset not still connected to 0x5636a6202dd0 2024-09-21T15:09:57.825 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.810+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9636750 2024-09-21T15:09:57.825 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.810+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9bd95f0 2024-09-21T15:09:57.825 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.810+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa1e80d0 2024-09-21T15:09:57.825 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.810+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa339110 2024-09-21T15:09:57.843 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.822+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa4dcea0 2024-09-21T15:09:57.843 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.822+0000 7f7fd044c700 -1 reset not still connected to 0x5636aea72750 2024-09-21T15:09:57.843 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.822+0000 7f7fd044c700 -1 reset not still connected to 0x5636aebddee0 2024-09-21T15:09:57.858 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.846+0000 7f7fd044c700 -1 reset not still connected to 0x5636b11416c0 2024-09-21T15:09:57.859 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.846+0000 7f7fd044c700 -1 reset not still connected to 0x5636b2141450 2024-09-21T15:09:57.859 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.846+0000 7f7fd044c700 -1 reset not still connected to 0x5636b21415f0 2024-09-21T15:09:57.861 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7f66d00 2024-09-21T15:09:57.861 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:09:57.861 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636be16b6c0 2024-09-21T15:09:57.861 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636bef84000 2024-09-21T15:09:57.861 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:09:57.854+0000 7f7fd044c700 -1 reset not still connected to 0x5636bf8ccf70 2024-09-21T15:09:57.869 INFO:teuthology.orchestra.run.smithi161.stdout:3639 punch from 0x60e3867 to 0x60f143a, (0xdbd3 bytes) 2024-09-21T15:09:57.869 INFO:teuthology.orchestra.run.smithi161.stdout:3640 write 0xba9850d thru 0xbaa133f (0x8e33 bytes) 2024-09-21T15:09:57.889 INFO:teuthology.orchestra.run.smithi161.stdout:5035 write 0xbf1c76b thru 0xbf266aa (0x9f40 bytes) 2024-09-21T15:09:57.889 INFO:teuthology.orchestra.run.smithi161.stdout:5063 punch from 0xac17254 to 0xac1a19f, (0x2f4b bytes) 2024-09-21T15:09:57.889 INFO:teuthology.orchestra.run.smithi161.stdout:5064 writesame 0xa50921e thru 0xa516fd9 data_size 0x2e(0xddbc bytes) 2024-09-21T15:09:57.971 INFO:teuthology.orchestra.run.smithi161.stdout:5065 writesame 0x8235212 thru 0x824503c data_size 0x45(0xfe2b bytes) 2024-09-21T15:09:57.971 INFO:teuthology.orchestra.run.smithi161.stdout:5036 write 0x363c0d5 thru 0x363eba1 (0x2acd bytes) 2024-09-21T15:09:58.014 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:58.014 INFO:teuthology.orchestra.run.smithi161.stdout:3642 writesame 0x62df279 thru 0x62ed9db data_size 0x37(0xe763 bytes) 2024-09-21T15:09:58.030 INFO:teuthology.orchestra.run.smithi161.stdout:4462 write 0xa47317d thru 0xa47f5be (0xc442 bytes) 2024-09-21T15:09:58.039 INFO:teuthology.orchestra.run.smithi161.stdout:5066 read 0x957c8fa thru 0x9585b1b (0x9222 bytes) 2024-09-21T15:09:58.039 INFO:teuthology.orchestra.run.smithi161.stdout:5067 write 0x2e9e9ea thru 0x2e9fdab (0x13c2 bytes) 2024-09-21T15:09:58.064 INFO:teuthology.orchestra.run.smithi161.stdout:5039 punch from 0x35cc41e to 0x35cdb24, (0x1706 bytes) 2024-09-21T15:09:58.064 INFO:teuthology.orchestra.run.smithi161.stdout:5040 read 0x55ffb76 thru 0x5603e90 (0x431b bytes) 2024-09-21T15:09:58.064 INFO:teuthology.orchestra.run.smithi161.stdout:5041 writesame 0x8e8105b thru 0x8e891ab data_size 0x5(0x8151 bytes) 2024-09-21T15:09:58.099 INFO:teuthology.orchestra.run.smithi161.stdout:4463 read 0x96dcdc0 thru 0x96e5334 (0x8575 bytes) 2024-09-21T15:09:58.099 INFO:teuthology.orchestra.run.smithi161.stdout:4464 read 0x56146b7 thru 0x561b95b (0x72a5 bytes) 2024-09-21T15:09:58.099 INFO:teuthology.orchestra.run.smithi161.stdout:4466 read 0x64edf78 thru 0x64fcbc4 (0xec4d bytes) 2024-09-21T15:09:58.100 INFO:teuthology.orchestra.run.smithi161.stdout:4467 writesame 0x102e7e2 thru 0x103c96f data_size 0x1(0xe18e bytes) 2024-09-21T15:09:58.105 INFO:teuthology.orchestra.run.smithi161.stdout:5068 read 0x5dcb7b7 thru 0x5dcf6d9 (0x3f23 bytes) 2024-09-21T15:09:58.106 INFO:teuthology.orchestra.run.smithi161.stdout:5070 write 0x5ed2cd0 thru 0x5ee29ab (0xfcdc bytes) 2024-09-21T15:09:58.153 INFO:teuthology.orchestra.run.smithi161.stdout:5042 read 0x7a94b4b thru 0x7aa1020 (0xc4d6 bytes) 2024-09-21T15:09:58.153 INFO:teuthology.orchestra.run.smithi161.stdout:5043 punch from 0x9177c9b to 0x9178bd4, (0xf39 bytes) 2024-09-21T15:09:58.153 INFO:teuthology.orchestra.run.smithi161.stdout:5044 write 0x69fb48e thru 0x69fcac1 (0x1634 bytes) 2024-09-21T15:09:58.154 INFO:teuthology.orchestra.run.smithi161.stdout:5071 punch from 0x3789c9d to 0x379428c, (0xa5ef bytes) 2024-09-21T15:09:58.154 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:58.154 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:58.154 INFO:teuthology.orchestra.run.smithi161.stdout:5077 write 0x378c3bd thru 0x3793fac (0x7bf0 bytes) 2024-09-21T15:09:58.156 INFO:teuthology.orchestra.run.smithi161.stdout:5083 write 0x2ebdea4 thru 0x2ec6a5f (0x8bbc bytes) 2024-09-21T15:09:58.204 INFO:teuthology.orchestra.run.smithi161.stdout:5078 read 0x4a44a67 thru 0x4a50016 (0xb5b0 bytes) 2024-09-21T15:09:58.205 INFO:teuthology.orchestra.run.smithi161.stdout:5045 write 0x553fe thru 0x59fd9 (0x4bdc bytes) 2024-09-21T15:09:58.207 INFO:teuthology.orchestra.run.smithi161.stdout:5080 trunc from 0xbb3f2de to 0xa6b1cf0 2024-09-21T15:09:58.209 INFO:teuthology.orchestra.run.smithi161.stdout:4468 writesame 0x10c7c8a thru 0x10d1b63 data_size 0x1(0x9eda bytes) 2024-09-21T15:09:58.209 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone31 from 0x78656ae (overlap 0x20f35e9) to 0xd2e25d 2024-09-21T15:09:58.222 INFO:teuthology.orchestra.run.smithi161.stdout:5084 read 0x2991e90 thru 0x299c4a9 (0xa61a bytes) 2024-09-21T15:09:58.223 INFO:teuthology.orchestra.run.smithi161.stdout:5085 write 0x2b81ba9 thru 0x2b89a2a (0x7e82 bytes) 2024-09-21T15:09:58.277 INFO:teuthology.orchestra.run.smithi161.stdout:4470 read 0x9e029da thru 0x9e126ec (0xfd13 bytes) 2024-09-21T15:09:58.278 INFO:teuthology.orchestra.run.smithi161.stdout:4472 punch from 0x49681b2 to 0x496c09b, (0x3ee9 bytes) 2024-09-21T15:09:58.278 INFO:teuthology.orchestra.run.smithi161.stdout:4473 trunc from 0xa47f5bf to 0xae3d4f7 2024-09-21T15:09:58.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:58.295+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb357860 handle_clone_image: failed to clone image mirror/10aefa5564af to image_cluster1.client.mirror.1-clone25 2024-09-21T15:09:58.312 INFO:teuthology.orchestra.run.smithi161.stdout:5087 trunc from 0x2ec6a60 to 0x34c299d 2024-09-21T15:09:58.314 INFO:teuthology.orchestra.run.smithi161.stdout:5081 read 0x4186f78 thru 0x418c360 (0x53e9 bytes) 2024-09-21T15:09:58.314 INFO:teuthology.orchestra.run.smithi161.stdout:5083 read 0x159b6f7 thru 0x15a0a6c (0x5376 bytes) 2024-09-21T15:09:58.314 INFO:teuthology.orchestra.run.smithi161.stdout:5084 read 0x2da694a thru 0x2dae836 (0x7eed bytes) 2024-09-21T15:09:58.314 INFO:teuthology.orchestra.run.smithi161.stdout:5087 write 0x6ef08d5 thru 0x6ef5f14 (0x5640 bytes) 2024-09-21T15:09:58.353 INFO:teuthology.orchestra.run.smithi161.stdout:4474 read 0x75af15c thru 0x75b215c (0x3001 bytes) 2024-09-21T15:09:58.353 INFO:teuthology.orchestra.run.smithi161.stdout:4475 writesame 0x4e35281 thru 0x4e38281 data_size 0x1(0x3001 bytes) 2024-09-21T15:09:58.396 INFO:teuthology.orchestra.run.smithi161.stdout:5088 write 0xafaa143 thru 0xafb4474 (0xa332 bytes) 2024-09-21T15:09:58.421 INFO:teuthology.orchestra.run.smithi161.stdout:5089 read 0x5233f09 thru 0x523c3c1 (0x84b9 bytes) 2024-09-21T15:09:58.421 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:58.421 INFO:teuthology.orchestra.run.smithi161.stdout:5091 writesame 0x53e06c thru 0x54cb66 data_size 0x35(0xeafb bytes) 2024-09-21T15:09:58.426 INFO:teuthology.orchestra.run.smithi161.stdout:3643 write 0xe6454d6 thru 0xe64995c (0x4487 bytes) 2024-09-21T15:09:58.434 INFO:teuthology.orchestra.run.smithi161.stdout:5046 punch from 0xa87ab60 to 0xa87c164, (0x1604 bytes) 2024-09-21T15:09:58.434 INFO:teuthology.orchestra.run.smithi161.stdout:5048 punch from 0x258ec0d to 0x259e3b5, (0xf7a8 bytes) 2024-09-21T15:09:58.434 INFO:teuthology.orchestra.run.smithi161.stdout:5050 punch from 0xe9d4c9 to 0xeaa3bd, (0xcef4 bytes) 2024-09-21T15:09:58.434 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:58.434 INFO:teuthology.orchestra.run.smithi161.stdout:5055 read 0xbd9f15e thru 0xbda226d (0x3110 bytes) 2024-09-21T15:09:58.435 INFO:teuthology.orchestra.run.smithi161.stdout:5092 trunc from 0xafb4475 to 0xbebd3a3 2024-09-21T15:09:58.435 INFO:teuthology.orchestra.run.smithi161.stdout:5056 writesame 0xb147ea5 thru 0xb150dd2 data_size 0x52(0x8f2e bytes) 2024-09-21T15:09:58.435 INFO:teuthology.orchestra.run.smithi161.stdout:5088 read 0x1bd7e28 thru 0x1be4242 (0xc41b bytes) 2024-09-21T15:09:58.436 INFO:teuthology.orchestra.run.smithi161.stdout:5089 punch from 0x41ea71 to 0x426765, (0x7cf4 bytes) 2024-09-21T15:09:58.442 INFO:teuthology.orchestra.run.smithi161.stdout:3644 punch from 0x37a81fa to 0x37b4557, (0xc35d bytes) 2024-09-21T15:09:58.442 INFO:teuthology.orchestra.run.smithi161.stdout:3645 read 0x77eeafb thru 0x77fc601 (0xdb07 bytes) 2024-09-21T15:09:58.443 INFO:teuthology.orchestra.run.smithi161.stdout:3646 punch from 0xa1e4454 to 0xa1f0012, (0xbbbe bytes) 2024-09-21T15:09:58.443 INFO:teuthology.orchestra.run.smithi161.stdout:3647 writesame 0x3c933cf thru 0x3ca22fa data_size 0x2(0xef2c bytes) 2024-09-21T15:09:58.465 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #30, image image_cluster1.client.mirror.5-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent31 2024-09-21T15:09:58.488 INFO:teuthology.orchestra.run.smithi161.stdout:5090 write 0xaa912cc thru 0xaa96e64 (0x5b99 bytes) 2024-09-21T15:09:58.495 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:58.495 INFO:teuthology.orchestra.run.smithi161.stdout:5094 write 0xc2c672 thru 0xc36f30 (0xa8bf bytes) 2024-09-21T15:09:58.496 INFO:teuthology.orchestra.run.smithi161.stdout:3648 read 0x9cf5cc3 thru 0x9cfefc8 (0x9306 bytes) 2024-09-21T15:09:58.496 INFO:teuthology.orchestra.run.smithi161.stdout:3649 punch from 0x3ceacd6 to 0x3cf78ff, (0xcc29 bytes) 2024-09-21T15:09:58.496 INFO:teuthology.orchestra.run.smithi161.stdout:3650 read 0x395ef23 thru 0x395f361 (0x43f bytes) 2024-09-21T15:09:58.504 INFO:teuthology.orchestra.run.smithi161.stdout:3652 read 0x6fda99f thru 0x6fe85ac (0xdc0e bytes) 2024-09-21T15:09:58.507 INFO:teuthology.orchestra.run.smithi161.stdout:3653 punch from 0x5637a6a to 0x563eb92, (0x7128 bytes) 2024-09-21T15:09:58.507 INFO:teuthology.orchestra.run.smithi161.stdout:3654 writesame 0xbd9ed92 thru 0xbda4d02 data_size 0x1(0x5f71 bytes) 2024-09-21T15:09:58.516 INFO:teuthology.orchestra.run.smithi161.stdout:5057 trunc from 0xdab4e3e to 0xcb8e74c 2024-09-21T15:09:58.522 INFO:teuthology.orchestra.run.smithi161.stdout:5091 writesame 0x96c8bc2 thru 0x96d064c data_size 0x1(0x7a8b bytes) 2024-09-21T15:09:58.538 INFO:teuthology.orchestra.run.smithi161.stdout:5096 punch from 0x4d524b6 to 0x4d622e8, (0xfe32 bytes) 2024-09-21T15:09:58.549 INFO:teuthology.orchestra.run.smithi161.stdout:5097 trunc from 0xbebd3a3 to 0x5b2bedf 2024-09-21T15:09:58.560 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf4d03930 2024-09-21T15:09:58.560 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf548c750 2024-09-21T15:09:58.560 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf560f930 2024-09-21T15:09:58.560 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf6aac680 2024-09-21T15:09:58.561 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf88a9790 2024-09-21T15:09:58.561 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf9ca4340 2024-09-21T15:09:58.561 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfb693040 2024-09-21T15:09:58.561 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfcc4d790 2024-09-21T15:09:58.561 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfddb6750 2024-09-21T15:09:58.561 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfe47d380 2024-09-21T15:09:58.561 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfe9d1ad0 2024-09-21T15:09:58.561 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbff4f9c70 2024-09-21T15:09:58.561 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbff8ca4e0 2024-09-21T15:09:58.561 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbff8cb930 2024-09-21T15:09:58.561 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbffbded00 2024-09-21T15:09:58.561 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc02925d40 2024-09-21T15:09:58.561 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc02bdec30 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0750f040 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc09d14820 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc09d725b0 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc09d73c70 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0a457ee0 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0b93aa90 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0d9d21a0 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0dafcc30 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0dafd040 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0deabe10 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc120bc4e0 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc133b0340 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc133b1790 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc13de68f0 2024-09-21T15:09:58.562 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc14eecdd0 2024-09-21T15:09:58.563 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc14eecea0 2024-09-21T15:09:58.563 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158eb790 2024-09-21T15:09:58.563 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc15a9f380 2024-09-21T15:09:58.563 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc16e7a4e0 2024-09-21T15:09:58.563 INFO:teuthology.orchestra.run.smithi161.stdout:3655 write 0xb4cab2a thru 0xb4ce553 (0x3a2a bytes) 2024-09-21T15:09:58.564 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.554+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc19580a90 2024-09-21T15:09:58.564 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:58.558+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1a255040 2024-09-21T15:09:58.594 INFO:teuthology.orchestra.run.smithi161.stdout:5092 write 0x4862774 thru 0x486efa3 (0xc830 bytes) 2024-09-21T15:09:58.596 INFO:teuthology.orchestra.run.smithi161.stdout:3656 read 0x1c322b5 thru 0x1c360cd (0x3e19 bytes) 2024-09-21T15:09:58.597 INFO:teuthology.orchestra.run.smithi161.stdout:3657 read 0x3c65c13 thru 0x3c66eb9 (0x12a7 bytes) 2024-09-21T15:09:58.597 INFO:teuthology.orchestra.run.smithi161.stdout:3658 clone 44 order 25 su 1048576 sc 12 2024-09-21T15:09:58.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:58.619+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb90e000 handle_clone_image: failed to clone image mirror/10b79333f776 to image_cluster1.client.mirror.5-clone31 2024-09-21T15:09:58.650 INFO:teuthology.orchestra.run.smithi161.stdout:5060 write 0x49c1f2d thru 0x49c97bd (0x7891 bytes) 2024-09-21T15:09:58.660 INFO:teuthology.orchestra.run.smithi161.stdout:5093 writesame 0x8a81c92 thru 0x8a8fb31 data_size 0x20(0xdea0 bytes) 2024-09-21T15:09:58.687 INFO:teuthology.orchestra.run.smithi161.stdout:4476 write 0x819e882 thru 0x819fcc8 (0x1447 bytes) 2024-09-21T15:09:58.711 INFO:teuthology.orchestra.run.smithi161.stdout:4477 write 0x651424f thru 0x6514902 (0x6b4 bytes) 2024-09-21T15:09:58.720 INFO:teuthology.orchestra.run.smithi161.stdout:5062 read 0xfc7614 thru 0xfcdba7 (0x6594 bytes) 2024-09-21T15:09:58.721 INFO:teuthology.orchestra.run.smithi161.stdout:5098 read 0x349d51 thru 0x34d380 (0x3630 bytes) 2024-09-21T15:09:58.723 INFO:teuthology.orchestra.run.smithi161.stdout:5099 read 0x1eb739f thru 0x1ebf18e (0x7df0 bytes) 2024-09-21T15:09:58.723 INFO:teuthology.orchestra.run.smithi161.stdout:5100 write 0x28f4de2 thru 0x28f69ad (0x1bcc bytes) 2024-09-21T15:09:58.723 INFO:teuthology.orchestra.run.smithi161.stdout:5065 trunc from 0xcb8e74c to 0xd76bcf1 2024-09-21T15:09:58.732 INFO:teuthology.orchestra.run.smithi161.stdout:4478 punch from 0x45d2853 to 0x45db152, (0x88ff bytes) 2024-09-21T15:09:58.733 INFO:teuthology.orchestra.run.smithi161.stdout:4484 writesame 0x1f4c0d thru 0x1f9531 data_size 0x23(0x4925 bytes) 2024-09-21T15:09:58.761 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.755+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:09:58.762 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.755+0000 7ff753f07700 -1 reset not still connected to 0x56016878a1a0 2024-09-21T15:09:58.762 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.755+0000 7ff753f07700 -1 reset not still connected to 0x56016878ab60 2024-09-21T15:09:58.762 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.755+0000 7ff753f07700 -1 reset not still connected to 0x56016878ac30 2024-09-21T15:09:58.765 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.759+0000 7ff753f07700 -1 reset not still connected to 0x56016878b1e0 2024-09-21T15:09:58.767 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.759+0000 7ff753f07700 -1 reset not still connected to 0x56016878b520 2024-09-21T15:09:58.768 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.763+0000 7ff753f07700 -1 reset not still connected to 0x560168802750 2024-09-21T15:09:58.769 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.763+0000 7ff753f07700 -1 reset not still connected to 0x5601688028f0 2024-09-21T15:09:58.769 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.763+0000 7ff753f07700 -1 reset not still connected to 0x560168803860 2024-09-21T15:09:58.769 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.763+0000 7ff753f07700 -1 reset not still connected to 0x560168803ee0 2024-09-21T15:09:58.770 INFO:teuthology.orchestra.run.smithi161.stdout:5102 punch from 0x1061057 to 0x10672eb, (0x6294 bytes) 2024-09-21T15:09:58.771 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.763+0000 7ff753f07700 -1 reset not still connected to 0x560168d92340 2024-09-21T15:09:58.771 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.767+0000 7ff753f07700 -1 reset not still connected to 0x5601692225b0 2024-09-21T15:09:58.771 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.767+0000 7ff753f07700 -1 reset not still connected to 0x5601692b52b0 2024-09-21T15:09:58.771 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.767+0000 7ff753f07700 -1 reset not still connected to 0x560169400a90 2024-09-21T15:09:58.771 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.767+0000 7ff753f07700 -1 reset not still connected to 0x560169401520 2024-09-21T15:09:58.771 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.767+0000 7ff753f07700 -1 reset not still connected to 0x560169401e10 2024-09-21T15:09:58.771 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.767+0000 7ff753f07700 -1 reset not still connected to 0x560169783c70 2024-09-21T15:09:58.771 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.767+0000 7ff753f07700 -1 reset not still connected to 0x560169b608f0 2024-09-21T15:09:58.772 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.767+0000 7ff753f07700 -1 reset not still connected to 0x560169e2eb60 2024-09-21T15:09:58.772 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.767+0000 7ff753f07700 -1 reset not still connected to 0x560169ec2dd0 2024-09-21T15:09:58.772 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.767+0000 7ff753f07700 -1 reset not still connected to 0x560169f100d0 2024-09-21T15:09:58.772 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.767+0000 7ff753f07700 -1 reset not still connected to 0x560169f10270 2024-09-21T15:09:58.781 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.775+0000 7ff753f07700 -1 reset not still connected to 0x560169f10680 2024-09-21T15:09:58.782 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.775+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9930 2024-09-21T15:09:58.782 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.775+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9c70 2024-09-21T15:09:58.782 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.775+0000 7ff753f07700 -1 reset not still connected to 0x56016a38c410 2024-09-21T15:09:58.783 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.775+0000 7ff753f07700 -1 reset not still connected to 0x56016a50a8f0 2024-09-21T15:09:58.783 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.775+0000 7ff753f07700 -1 reset not still connected to 0x56016a50a9c0 2024-09-21T15:09:58.783 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.775+0000 7ff753f07700 -1 reset not still connected to 0x56016a50ac30 2024-09-21T15:09:58.783 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.775+0000 7ff753f07700 -1 reset not still connected to 0x56016a50aea0 2024-09-21T15:09:58.783 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.775+0000 7ff753f07700 -1 reset not still connected to 0x56016a50b930 2024-09-21T15:09:58.783 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.775+0000 7ff753f07700 -1 reset not still connected to 0x56016a50ba00 2024-09-21T15:09:58.784 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.775+0000 7ff753f07700 -1 reset not still connected to 0x56016a5c6d00 2024-09-21T15:09:58.784 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.775+0000 7ff753f07700 -1 reset not still connected to 0x56016a5c7860 2024-09-21T15:09:58.784 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.775+0000 7ff753f07700 -1 reset not still connected to 0x56016a6de8f0 2024-09-21T15:09:58.784 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016a6df2b0 2024-09-21T15:09:58.784 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016a6df860 2024-09-21T15:09:58.784 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016a6dfa00 2024-09-21T15:09:58.784 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016a9c85b0 2024-09-21T15:09:58.784 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6340 2024-09-21T15:09:58.784 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e64e0 2024-09-21T15:09:58.784 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6a90 2024-09-21T15:09:58.784 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e72b0 2024-09-21T15:09:58.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72820 2024-09-21T15:09:58.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72d00 2024-09-21T15:09:58.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72dd0 2024-09-21T15:09:58.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72ea0 2024-09-21T15:09:58.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016ad41ee0 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f380 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f450 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016b24fee0 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016b9cdd40 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016bff6000 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016bff7790 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b5ee0 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016c23a000 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ee0 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016d18f450 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016dd771e0 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016dd772b0 2024-09-21T15:09:58.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77e10 2024-09-21T15:09:58.787 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016e328270 2024-09-21T15:09:58.787 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016e3288f0 2024-09-21T15:09:58.787 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016e328b60 2024-09-21T15:09:58.787 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016e329a00 2024-09-21T15:09:58.787 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed1e0 2024-09-21T15:09:58.787 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:09:58.787 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:09:58.779+0000 7ff753f07700 -1 reset not still connected to 0x56016ebedee0 2024-09-21T15:09:58.789 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:58.792 INFO:teuthology.orchestra.run.smithi161.stdout:4487 trunc from 0xae3d4f7 to 0x67dc080 2024-09-21T15:09:58.808 INFO:teuthology.orchestra.run.smithi161.stdout:5095 write 0xd63403a thru 0xd6359a7 (0x196e bytes) 2024-09-21T15:09:58.826 INFO:teuthology.orchestra.run.smithi161.stdout:5066 trunc from 0xd76bcf1 to 0x5c1413d 2024-09-21T15:09:58.830 INFO:teuthology.orchestra.run.smithi161.stdout:5096 write 0x7ab04b4 thru 0x7ab86a9 (0x81f6 bytes) 2024-09-21T15:09:58.834 INFO:teuthology.orchestra.run.smithi161.stdout:5104 write 0xdb81568 thru 0xdb908f4 (0xf38d bytes) 2024-09-21T15:09:58.874 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:58.871+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cc4083c0 handle_clone_image: failed to clone image mirror/10b5d41a3c8 to image_cluster1.client.mirror.0-clone30 2024-09-21T15:09:58.879 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:58.879 INFO:teuthology.orchestra.run.smithi161.stdout:5106 read 0xcaa887 thru 0xcb859a (0xdd14 bytes) 2024-09-21T15:09:58.879 INFO:teuthology.orchestra.run.smithi161.stdout:5097 write 0x2e92f06 thru 0x2ea064d (0xd748 bytes) 2024-09-21T15:09:58.879 INFO:teuthology.orchestra.run.smithi161.stdout:5107 read 0x7f571a9 thru 0x7f5c669 (0x54c1 bytes) 2024-09-21T15:09:58.880 INFO:teuthology.orchestra.run.smithi161.stdout:5110 write 0x33615eb thru 0x3364a3b (0x3451 bytes) 2024-09-21T15:09:58.882 INFO:teuthology.orchestra.run.smithi161.stdout:4488 punch from 0x2babc0d to 0x2bb582f, (0x9c22 bytes) 2024-09-21T15:09:58.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:09:58.883+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb7a1860 handle_clone_image: failed to clone image mirror/10b4436084fb to image_cluster1.client.mirror.3-clone18 2024-09-21T15:09:58.890 INFO:teuthology.orchestra.run.smithi161.stdout:4489 trunc from 0x67dc080 to 0xad93bd2 2024-09-21T15:09:58.895 INFO:teuthology.orchestra.run.smithi161.stdout:5111 writesame 0x2a106fe thru 0x2a14210 data_size 0x3(0x3b13 bytes) 2024-09-21T15:09:58.901 INFO:teuthology.orchestra.run.smithi161.stdout:5098 write 0x1adf3ee thru 0x1ae0b34 (0x1747 bytes) 2024-09-21T15:09:58.909 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:58.909 INFO:teuthology.orchestra.run.smithi161.stdout:5113 writesame 0x1ccd97f thru 0x1cd7076 data_size 0x4(0x96f8 bytes) 2024-09-21T15:09:58.917 INFO:teuthology.orchestra.run.smithi161.stdout:5099 read 0x3176dc2 thru 0x317ef05 (0x8144 bytes) 2024-09-21T15:09:58.917 INFO:teuthology.orchestra.run.smithi161.stdout:5100 punch from 0xc149fdd to 0xc14ab5d, (0xb80 bytes) 2024-09-21T15:09:58.918 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:58.918 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:58.918 INFO:teuthology.orchestra.run.smithi161.stdout:5105 write 0x4d042d thru 0x4d1136 (0xd0a bytes) 2024-09-21T15:09:58.918 INFO:teuthology.orchestra.run.smithi161.stdout:4490 write 0x7d7c494 thru 0x7d808dd (0x444a bytes) 2024-09-21T15:09:58.931 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:58.932 INFO:teuthology.orchestra.run.smithi161.stdout:5108 write 0x6d2bb37 thru 0x6d38d0d (0xd1d7 bytes) 2024-09-21T15:09:58.947 INFO:teuthology.orchestra.run.smithi161.stdout:5114 trunc from 0xdb908f5 to 0x5d2decf 2024-09-21T15:09:58.950 INFO:teuthology.orchestra.run.smithi161.stdout:4493 trunc from 0xad93bd2 to 0x721fc28 2024-09-21T15:09:58.973 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:58.973 INFO:teuthology.orchestra.run.smithi161.stdout:5113 write 0x20a6877 thru 0x20ae92a (0x80b4 bytes) 2024-09-21T15:09:58.977 INFO:teuthology.orchestra.run.smithi161.stdout:5067 writesame 0xa40f430 thru 0xa41c3e9 data_size 0x3(0xcfba bytes) 2024-09-21T15:09:58.985 INFO:teuthology.orchestra.run.smithi161.stdout:5068 punch from 0x464ad1d to 0x464f265, (0x4548 bytes) 2024-09-21T15:09:58.985 INFO:teuthology.orchestra.run.smithi161.stdout:5069 read 0xfaef23 thru 0xfbd700 (0xe7de bytes) 2024-09-21T15:09:59.002 INFO:teuthology.orchestra.run.smithi161.stdout:5114 write 0x2ca183d thru 0x2ca251f (0xce3 bytes) 2024-09-21T15:09:59.015 INFO:teuthology.orchestra.run.smithi161.stdout:5115 read 0xd5db87d thru 0xd5df639 (0x3dbd bytes) 2024-09-21T15:09:59.015 INFO:teuthology.orchestra.run.smithi161.stdout:5116 punch from 0xa9ccc38 to 0xa9d05ac, (0x3974 bytes) 2024-09-21T15:09:59.016 INFO:teuthology.orchestra.run.smithi161.stdout:5118 read 0xd8d21a thru 0xd959c7 (0x87ae bytes) 2024-09-21T15:09:59.019 INFO:teuthology.orchestra.run.smithi161.stdout:5119 writesame 0x94c0945 thru 0x94d06a8 data_size 0x2(0xfd64 bytes) 2024-09-21T15:09:59.024 INFO:teuthology.orchestra.run.smithi161.stdout:4494 write 0x3df7293 thru 0x3df7ee8 (0xc56 bytes) 2024-09-21T15:09:59.048 INFO:teuthology.orchestra.run.smithi161.stdout:5115 read 0x1daf2ea thru 0x1dbcbd2 (0xd8e9 bytes) 2024-09-21T15:09:59.052 INFO:teuthology.orchestra.run.smithi161.stdout:5116 trunc from 0x5d2decf to 0x7cfb033 2024-09-21T15:09:59.086 INFO:teuthology.orchestra.run.smithi161.stdout:5073 write 0xcc93970 thru 0xcc97943 (0x3fd4 bytes) 2024-09-21T15:09:59.086 INFO:teuthology.orchestra.run.smithi161.stdout:4495 write 0x933297 thru 0x93cff5 (0x9d5f bytes) 2024-09-21T15:09:59.105 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf9ca4340 2024-09-21T15:09:59.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf9f63ba0 2024-09-21T15:09:59.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfb693040 2024-09-21T15:09:59.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfcc4d790 2024-09-21T15:09:59.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfe47d380 2024-09-21T15:09:59.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfe9d1ad0 2024-09-21T15:09:59.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbff4f9c70 2024-09-21T15:09:59.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbff8ca4e0 2024-09-21T15:09:59.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbff8cb930 2024-09-21T15:09:59.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc02925d40 2024-09-21T15:09:59.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc02bdec30 2024-09-21T15:09:59.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0750f040 2024-09-21T15:09:59.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc09d14820 2024-09-21T15:09:59.107 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc09d725b0 2024-09-21T15:09:59.107 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.098+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0a457ee0 2024-09-21T15:09:59.107 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.102+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0d9d21a0 2024-09-21T15:09:59.107 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.102+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0deabe10 2024-09-21T15:09:59.107 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.102+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc120bc4e0 2024-09-21T15:09:59.107 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.102+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc133b1790 2024-09-21T15:09:59.107 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.102+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc133b1930 2024-09-21T15:09:59.109 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.106+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc14eecea0 2024-09-21T15:09:59.109 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.106+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc16e7a4e0 2024-09-21T15:09:59.110 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.106+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1766cf70 2024-09-21T15:09:59.110 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.106+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc19580a90 2024-09-21T15:09:59.110 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.106+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1a254820 2024-09-21T15:09:59.110 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:09:59.106+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1a255040 2024-09-21T15:09:59.127 INFO:teuthology.orchestra.run.smithi161.stdout:5120 write 0x7737e06 thru 0x774008a (0x8285 bytes) 2024-09-21T15:09:59.128 INFO:teuthology.orchestra.run.smithi161.stdout:4496 punch from 0x2a5dd1e to 0x2a680cf, (0xa3b1 bytes) 2024-09-21T15:09:59.136 INFO:teuthology.orchestra.run.smithi161.stdout:5074 writesame 0x29fab29 thru 0x2a06c4f data_size 0x1(0xc127 bytes) 2024-09-21T15:09:59.142 INFO:teuthology.orchestra.run.smithi161.stdout:4497 trunc from 0x721fc28 to 0x8552b9 2024-09-21T15:09:59.146 INFO:teuthology.orchestra.run.smithi161.stdout:5117 trunc from 0x7cfb033 to 0xa26ed4b 2024-09-21T15:09:59.174 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.174 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.174 INFO:teuthology.orchestra.run.smithi161.stdout:5123 read 0x7d0bf60 thru 0x7d0c0d1 (0x172 bytes) 2024-09-21T15:09:59.175 INFO:teuthology.orchestra.run.smithi161.stdout:5125 read 0xa0a0050 thru 0xa0a97db (0x978c bytes) 2024-09-21T15:09:59.186 INFO:teuthology.orchestra.run.smithi161.stdout:5126 trunc from 0xd6359a8 to 0x75debb2 2024-09-21T15:09:59.187 INFO:teuthology.orchestra.run.smithi161.stdout:5075 punch from 0x230a8bd to 0x231880c, (0xdf4f bytes) 2024-09-21T15:09:59.187 INFO:teuthology.orchestra.run.smithi161.stdout:5076 write 0xe539e1 thru 0xe5ef84 (0xb5a4 bytes) 2024-09-21T15:09:59.210 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.210 INFO:teuthology.orchestra.run.smithi161.stdout:5080 write 0x6801cb9 thru 0x680fbf7 (0xdf3f bytes) 2024-09-21T15:09:59.213 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.213 INFO:teuthology.orchestra.run.smithi161.stdout:5119 writesame 0x187cd11 thru 0x188c3ad data_size 0x1d(0xf69d bytes) 2024-09-21T15:09:59.230 INFO:teuthology.orchestra.run.smithi161.stdout:5120 write 0xe5a41a thru 0xe66194 (0xbd7b bytes) 2024-09-21T15:09:59.238 INFO:teuthology.orchestra.run.smithi161.stdout:4498 read 0x279467 thru 0x279603 (0x19d bytes) 2024-09-21T15:09:59.256 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.256 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.256 INFO:teuthology.orchestra.run.smithi161.stdout:5084 punch from 0x5712ed5 to 0x571fbbc, (0xcce7 bytes) 2024-09-21T15:09:59.256 INFO:teuthology.orchestra.run.smithi161.stdout:5086 punch from 0x2d24f3f to 0x2d2ba5b, (0x6b1c bytes) 2024-09-21T15:09:59.256 INFO:teuthology.orchestra.run.smithi161.stdout:5088 write 0x61bd246 thru 0x61c88b8 (0xb673 bytes) 2024-09-21T15:09:59.263 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.279 INFO:teuthology.orchestra.run.smithi161.stdout:4499 write 0x260fa2a thru 0x2614a6c (0x5043 bytes) 2024-09-21T15:09:59.289 INFO:teuthology.orchestra.run.smithi161.stdout:5127 punch from 0x3a8d8dd to 0x3a984ab, (0xabce bytes) 2024-09-21T15:09:59.296 INFO:teuthology.orchestra.run.smithi161.stdout:5089 write 0x8d30d9f thru 0x8d38f9f (0x8201 bytes) 2024-09-21T15:09:59.303 INFO:teuthology.orchestra.run.smithi161.stdout:4500 read 0xb4dc07 thru 0xb52080 (0x447a bytes) 2024-09-21T15:09:59.303 INFO:teuthology.orchestra.run.smithi161.stdout:4501 punch from 0x21fa874 to 0x220284a, (0x7fd6 bytes) 2024-09-21T15:09:59.303 INFO:teuthology.orchestra.run.smithi161.stdout:4502 punch from 0x224d85b to 0x224da91, (0x236 bytes) 2024-09-21T15:09:59.311 INFO:teuthology.orchestra.run.smithi161.stdout:5124 write 0xa9fd331 thru 0xaa06b3b (0x980b bytes) 2024-09-21T15:09:59.337 INFO:teuthology.orchestra.run.smithi161.stdout:4506 writesame 0x2a5582c thru 0x2a56c8d data_size 0x1(0x1462 bytes) 2024-09-21T15:09:59.337 INFO:teuthology.orchestra.run.smithi161.stdout:5125 read 0x25bb886 thru 0x25c551b (0x9c96 bytes) 2024-09-21T15:09:59.341 INFO:teuthology.orchestra.run.smithi161.stdout:5128 write 0xae4f0d7 thru 0xae55d3a (0x6c64 bytes) 2024-09-21T15:09:59.347 INFO:teuthology.orchestra.run.smithi161.stdout:5126 trunc from 0xaa06b3c to 0x59bbc90 2024-09-21T15:09:59.360 INFO:teuthology.orchestra.run.smithi161.stdout:5129 punch from 0x3af4268 to 0x3af62be, (0x2056 bytes) 2024-09-21T15:09:59.360 INFO:teuthology.orchestra.run.smithi161.stdout:5131 read 0x343c5b4 thru 0x3440f45 (0x4992 bytes) 2024-09-21T15:09:59.360 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.365 INFO:teuthology.orchestra.run.smithi161.stdout:5090 write 0xce52a97 thru 0xce5d432 (0xa99c bytes) 2024-09-21T15:09:59.365 INFO:teuthology.orchestra.run.smithi161.stdout:4509 write 0x3cd4172 thru 0x3cdf368 (0xb1f7 bytes) 2024-09-21T15:09:59.377 INFO:teuthology.orchestra.run.smithi161.stdout:5133 trunc from 0xae55d3b to 0xc6e88e 2024-09-21T15:09:59.382 INFO:teuthology.orchestra.run.smithi161.stdout:4510 read 0x35cfd6 thru 0x364a6e (0x7a99 bytes) 2024-09-21T15:09:59.387 INFO:teuthology.orchestra.run.smithi161.stdout:5091 clone 34 order 22 su 1048576 sc 3 2024-09-21T15:09:59.453 INFO:teuthology.orchestra.run.smithi161.stdout:4512 writesame 0xd467df1 thru 0xd46a883 data_size 0x15(0x2a93 bytes) 2024-09-21T15:09:59.459 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.459 INFO:teuthology.orchestra.run.smithi161.stdout:4514 trunc from 0xd46a884 to 0xdc77574 2024-09-21T15:09:59.481 INFO:teuthology.orchestra.run.smithi161.stdout:4515 write 0x6058635 thru 0x605a80b (0x21d7 bytes) 2024-09-21T15:09:59.484 INFO:teuthology.orchestra.run.smithi161.stdout:5127 write 0xdd1a2e5 thru 0xdd211d1 (0x6eed bytes) 2024-09-21T15:09:59.499 INFO:teuthology.orchestra.run.smithi161.stdout:4516 punch from 0x4c686f8 to 0x4c77435, (0xed3d bytes) 2024-09-21T15:09:59.499 INFO:teuthology.orchestra.run.smithi161.stdout:4517 punch from 0x8fb9775 to 0x8fc8c53, (0xf4de bytes) 2024-09-21T15:09:59.499 INFO:teuthology.orchestra.run.smithi161.stdout:4518 writesame 0xbd8d56f thru 0xbd930d8 data_size 0x1(0x5b6a bytes) 2024-09-21T15:09:59.512 INFO:teuthology.orchestra.run.smithi161.stdout:5128 trunc from 0xdd211d2 to 0x88899ae 2024-09-21T15:09:59.513 INFO:teuthology.orchestra.run.smithi161.stdout:5134 write 0xae013ea thru 0xae08618 (0x722f bytes) 2024-09-21T15:09:59.534 INFO:teuthology.orchestra.run.smithi161.stdout:4520 writesame 0x9fff447 thru 0xa000be2 data_size 0x2(0x179c bytes) 2024-09-21T15:09:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:4522 punch from 0x2383c8b to 0x239354d, (0xf8c2 bytes) 2024-09-21T15:09:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:4523 writesame 0x1aff648 thru 0x1b04e98 data_size 0x1(0x5851 bytes) 2024-09-21T15:09:59.580 INFO:teuthology.orchestra.run.smithi161.stdout:5137 punch from 0x1e64174 to 0x1e668e7, (0x2773 bytes) 2024-09-21T15:09:59.580 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.580 INFO:teuthology.orchestra.run.smithi161.stdout:5144 read 0x7270c61 thru 0x7280a68 (0xfe08 bytes) 2024-09-21T15:09:59.580 INFO:teuthology.orchestra.run.smithi161.stdout:5145 write 0x2b43837 thru 0x2b518b4 (0xe07e bytes) 2024-09-21T15:09:59.624 INFO:teuthology.orchestra.run.smithi161.stdout:5129 read 0x64539e6 thru 0x6455ced (0x2308 bytes) 2024-09-21T15:09:59.624 INFO:teuthology.orchestra.run.smithi161.stdout:5130 read 0x39a6e17 thru 0x39aa26c (0x3456 bytes) 2024-09-21T15:09:59.625 INFO:teuthology.orchestra.run.smithi161.stdout:5132 punch from 0x14f5ba0 to 0x14f75d7, (0x1a37 bytes) 2024-09-21T15:09:59.625 INFO:teuthology.orchestra.run.smithi161.stdout:5133 punch from 0x3415719 to 0x3419759, (0x4040 bytes) 2024-09-21T15:09:59.625 INFO:teuthology.orchestra.run.smithi161.stdout:5134 write 0x2d8f415 thru 0x2d9c578 (0xd164 bytes) 2024-09-21T15:09:59.626 INFO:teuthology.orchestra.run.smithi161.stdout:4524 read 0x412686d thru 0x4132cd3 (0xc467 bytes) 2024-09-21T15:09:59.627 INFO:teuthology.orchestra.run.smithi161.stdout:4526 read 0x6ecd2c2 thru 0x6ed88cf (0xb60e bytes) 2024-09-21T15:09:59.627 INFO:teuthology.orchestra.run.smithi161.stdout:4527 punch from 0x2eaf6e5 to 0x2ebb5f9, (0xbf14 bytes) 2024-09-21T15:09:59.627 INFO:teuthology.orchestra.run.smithi161.stdout:4528 write 0xa2bf8fc thru 0xa2c3e4d (0x4552 bytes) 2024-09-21T15:09:59.635 INFO:teuthology.orchestra.run.smithi161.stdout:5146 clone 34 order 24 su 131072 sc 12 2024-09-21T15:09:59.666 INFO:teuthology.orchestra.run.smithi161.stdout:4529 trunc from 0xdc77574 to 0x75bd7fc 2024-09-21T15:09:59.722 INFO:teuthology.orchestra.run.smithi161.stdout:5136 writesame 0xcab5d9c thru 0xcabbc0d data_size 0x2(0x5e72 bytes) 2024-09-21T15:09:59.726 INFO:teuthology.orchestra.run.smithi161.stdout:5137 read 0x74cd16d thru 0x74d1c22 (0x4ab6 bytes) 2024-09-21T15:09:59.727 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.727 INFO:teuthology.orchestra.run.smithi161.stdout:5139 write 0x54f011c thru 0x54fc239 (0xc11e bytes) 2024-09-21T15:09:59.743 INFO:teuthology.orchestra.run.smithi161.stdout:5140 writesame 0x867c413 thru 0x8688776 data_size 0x7a(0xc364 bytes) 2024-09-21T15:09:59.766 INFO:teuthology.orchestra.run.smithi161.stdout:5141 read 0x3b6da8e thru 0x3b7bc46 (0xe1b9 bytes) 2024-09-21T15:09:59.767 INFO:teuthology.orchestra.run.smithi161.stdout:5142 write 0xa393f97 thru 0xa3a0ba0 (0xcc0a bytes) 2024-09-21T15:09:59.786 INFO:teuthology.orchestra.run.smithi161.stdout:4530 writesame 0xe26396c thru 0xe2640b2 data_size 0x9(0x747 bytes) 2024-09-21T15:09:59.794 INFO:teuthology.orchestra.run.smithi161.stdout:5143 write 0x2414adc thru 0x241f1a9 (0xa6ce bytes) 2024-09-21T15:09:59.795 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.804 INFO:teuthology.orchestra.run.smithi161.stdout:4533 trunc from 0xe2640b3 to 0x831cd74 2024-09-21T15:09:59.815 INFO:teuthology.orchestra.run.smithi161.stdout:5144 read 0x688674c thru 0x688c365 (0x5c1a bytes) 2024-09-21T15:09:59.815 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.816 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.816 INFO:teuthology.orchestra.run.smithi161.stdout:5148 clone 27 order 24 su 1048576 sc 9 2024-09-21T15:09:59.844 INFO:teuthology.orchestra.run.smithi161.stdout:4534 write 0x78aafd1 thru 0x78ba6bc (0xf6ec bytes) 2024-09-21T15:09:59.850 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone33 from 0xce5d433 (overlap 0x1d4a4c2) to 0x0 2024-09-21T15:09:59.868 INFO:teuthology.orchestra.run.smithi161.stdout:4536 trunc from 0x831cd74 to 0x32fb960 2024-09-21T15:09:59.923 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:09:59.923 INFO:teuthology.orchestra.run.smithi161.stdout:5012 write 0x70f895a thru 0x710872c (0xfdd3 bytes) 2024-09-21T15:09:59.945 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone43 from 0xe64995d (overlap 0x6978a5f) to 0x0 2024-09-21T15:09:59.981 INFO:teuthology.orchestra.run.smithi161.stdout:4537 write 0x54b1414 thru 0x54b587e (0x446b bytes) 2024-09-21T15:09:59.995 INFO:teuthology.orchestra.run.smithi161.stdout:4538 punch from 0xb30201 to 0xb3a296, (0xa095 bytes) 2024-09-21T15:09:59.995 INFO:teuthology.orchestra.run.smithi161.stdout:4539 punch from 0x44873a9 to 0x4487ab5, (0x70c bytes) 2024-09-21T15:09:59.995 INFO:teuthology.orchestra.run.smithi161.stdout:4541 read 0xb5a027 thru 0xb65030 (0xb00a bytes) 2024-09-21T15:09:59.996 INFO:teuthology.orchestra.run.smithi161.stdout:4542 write 0x1c74be9 thru 0x1c7fa75 (0xae8d bytes) 2024-09-21T15:10:00.074 INFO:teuthology.orchestra.run.smithi161.stdout:4543 writesame 0x7e68af5 thru 0x7e6c841 data_size 0x1(0x3d4d bytes) 2024-09-21T15:10:00.078 INFO:teuthology.orchestra.run.smithi161.stdout:4544 read 0x3abb10d thru 0x3ac5988 (0xa87c bytes) 2024-09-21T15:10:00.085 INFO:teuthology.orchestra.run.smithi161.stdout:4545 trunc from 0x7e6c842 to 0xab99fb8 2024-09-21T15:10:00.092 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.092 INFO:teuthology.orchestra.run.smithi161.stdout:5015 read 0x11c3cbe thru 0x11c4b57 (0xe9a bytes) 2024-09-21T15:10:00.092 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.121 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.128 INFO:teuthology.orchestra.run.smithi161.stdout:5017 write 0x88611d2 thru 0x886b031 (0x9e60 bytes) 2024-09-21T15:10:00.152 INFO:teuthology.orchestra.run.smithi161.stdout:4547 writesame 0xd2ccc10 thru 0xd2dc260 data_size 0x1(0xf651 bytes) 2024-09-21T15:10:00.156 INFO:teuthology.orchestra.run.smithi161.stdout:5019 trunc from 0x886b032 to 0x458f34e 2024-09-21T15:10:00.164 INFO:teuthology.orchestra.run.smithi161.stdout:4548 trunc from 0xd2dc261 to 0x8523658 2024-09-21T15:10:00.235 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.235 INFO:teuthology.orchestra.run.smithi161.stdout:5021 read 0x152fc28 thru 0x153e34c (0xe725 bytes) 2024-09-21T15:10:00.290 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.290 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.295 INFO:teuthology.orchestra.run.smithi161.stdout:4549 write 0x874e075 thru 0x874fb2c (0x1ab8 bytes) 2024-09-21T15:10:00.306 INFO:teuthology.orchestra.run.smithi161.stdout:5024 trunc from 0x458f34e to 0xb2692d4 2024-09-21T15:10:00.307 INFO:teuthology.orchestra.run.smithi161.stdout:4551 writesame 0x24c5359 thru 0x24ccc0a data_size 0x7(0x78b2 bytes) 2024-09-21T15:10:00.323 INFO:teuthology.orchestra.run.smithi161.stdout:4552 write 0x5a349ac thru 0x5a4453c (0xfb91 bytes) 2024-09-21T15:10:00.335 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.335 INFO:teuthology.orchestra.run.smithi161.stdout:5027 read 0x5d7907a thru 0x5d88483 (0xf40a bytes) 2024-09-21T15:10:00.335 INFO:teuthology.orchestra.run.smithi161.stdout:5028 punch from 0x71317d8 to 0x713fe7f, (0xe6a7 bytes) 2024-09-21T15:10:00.339 INFO:teuthology.orchestra.run.smithi161.stdout:5029 trunc from 0xb2692d4 to 0x9779880 2024-09-21T15:10:00.363 INFO:teuthology.orchestra.run.smithi161.stdout:4553 punch from 0x21cfc36 to 0x21db64d, (0xba17 bytes) 2024-09-21T15:10:00.363 INFO:teuthology.orchestra.run.smithi161.stdout:4554 read 0x715023b thru 0x71551ef (0x4fb5 bytes) 2024-09-21T15:10:00.363 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.364 INFO:teuthology.orchestra.run.smithi161.stdout:4556 writesame 0x5ffc301 thru 0x600284a data_size 0x5(0x654a bytes) 2024-09-21T15:10:00.380 INFO:teuthology.orchestra.run.smithi161.stdout:5030 write 0x672ad9b thru 0x6736e70 (0xc0d6 bytes) 2024-09-21T15:10:00.396 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.396 INFO:teuthology.orchestra.run.smithi161.stdout:5033 read 0x4198c78 thru 0x419efde (0x6367 bytes) 2024-09-21T15:10:00.396 INFO:teuthology.orchestra.run.smithi161.stdout:5035 read 0x80e221e thru 0x80e7400 (0x51e3 bytes) 2024-09-21T15:10:00.396 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.407 INFO:teuthology.orchestra.run.smithi161.stdout:5038 trunc from 0x9779880 to 0xebb5dce 2024-09-21T15:10:00.435 INFO:teuthology.orchestra.run.smithi161.stdout:5039 punch from 0x1cd6c58 to 0x1cda268, (0x3610 bytes) 2024-09-21T15:10:00.450 INFO:teuthology.orchestra.run.smithi161.stdout:4557 write 0x39889e0 thru 0x398fa67 (0x7088 bytes) 2024-09-21T15:10:00.454 INFO:teuthology.orchestra.run.smithi161.stdout:5041 trunc from 0xebb5dce to 0x570a7b8 2024-09-21T15:10:00.503 INFO:teuthology.orchestra.run.smithi161.stdout:5042 writesame 0x7663e2 thru 0x76b356 data_size 0x1(0x4f75 bytes) 2024-09-21T15:10:00.507 INFO:teuthology.orchestra.run.smithi161.stdout:4558 punch from 0x6c0e81c to 0x6c1011b, (0x18ff bytes) 2024-09-21T15:10:00.507 INFO:teuthology.orchestra.run.smithi161.stdout:4559 read 0x2be0321 thru 0x2be2324 (0x2004 bytes) 2024-09-21T15:10:00.507 INFO:teuthology.orchestra.run.smithi161.stdout:4560 writesame 0x67af854 thru 0x67bded6 data_size 0x1(0xe683 bytes) 2024-09-21T15:10:00.523 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #42, image image_cluster1.client.mirror.3-clone42 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent43 2024-09-21T15:10:00.606 INFO:teuthology.orchestra.run.smithi161.stdout:4561 punch from 0x5848a3f to 0x5857bd6, (0xf197 bytes) 2024-09-21T15:10:00.606 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.616 INFO:teuthology.orchestra.run.smithi161.stdout:4563 trunc from 0x874fb2d to 0x4a5fa98 2024-09-21T15:10:00.617 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.617 INFO:teuthology.orchestra.run.smithi161.stdout:3662 write 0xd2b44e5 thru 0xd2c1680 (0xd19c bytes) 2024-09-21T15:10:00.633 INFO:teuthology.orchestra.run.smithi161.stdout:5043 write 0xb0242f3 thru 0xb02cded (0x8afb bytes) 2024-09-21T15:10:00.658 INFO:teuthology.orchestra.run.smithi161.stdout:5048 read 0x47f4f5d thru 0x4801d7c (0xce20 bytes) 2024-09-21T15:10:00.659 INFO:teuthology.orchestra.run.smithi161.stdout:5049 punch from 0x93d6414 to 0x93dca23, (0x660f bytes) 2024-09-21T15:10:00.659 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.659 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.659 INFO:teuthology.orchestra.run.smithi161.stdout:5052 read 0x79f8c86 thru 0x7a067ba (0xdb35 bytes) 2024-09-21T15:10:00.659 INFO:teuthology.orchestra.run.smithi161.stdout:5053 write 0x10f337d thru 0x10f7fd3 (0x4c57 bytes) 2024-09-21T15:10:00.684 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.684 INFO:teuthology.orchestra.run.smithi161.stdout:5055 punch from 0x1d5da39 to 0x1d6130e, (0x38d5 bytes) 2024-09-21T15:10:00.684 INFO:teuthology.orchestra.run.smithi161.stdout:5056 read 0xaa6cb0e thru 0xaa71a07 (0x4efa bytes) 2024-09-21T15:10:00.684 INFO:teuthology.orchestra.run.smithi161.stdout:5057 punch from 0x6803f78 to 0x6809acc, (0x5b54 bytes) 2024-09-21T15:10:00.684 INFO:teuthology.orchestra.run.smithi161.stdout:5058 writesame 0xac425a0 thru 0xac438ea data_size 0x1(0x134b bytes) 2024-09-21T15:10:00.749 INFO:teuthology.orchestra.run.smithi161.stdout:5060 write 0xe7d72e9 thru 0xe7dd592 (0x62aa bytes) 2024-09-21T15:10:00.775 INFO:teuthology.orchestra.run.smithi161.stdout:4566 read 0x2cb29e2 thru 0x2cbdcdd (0xb2fc bytes) 2024-09-21T15:10:00.776 INFO:teuthology.orchestra.run.smithi161.stdout:4568 write 0x209d0de thru 0x20a3846 (0x6769 bytes) 2024-09-21T15:10:00.787 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.787 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.787 INFO:teuthology.orchestra.run.smithi161.stdout:4573 read 0x20d00fc thru 0x20dafef (0xaef4 bytes) 2024-09-21T15:10:00.788 INFO:teuthology.orchestra.run.smithi161.stdout:4575 write 0x394c5d6 thru 0x394d747 (0x1172 bytes) 2024-09-21T15:10:00.790 INFO:teuthology.orchestra.run.smithi161.stdout:5061 trunc from 0xe7dd593 to 0x5c513d5 2024-09-21T15:10:00.846 INFO:teuthology.orchestra.run.smithi161.stdout:3664 writesame 0x37bdacb thru 0x37bf43e data_size 0x3(0x1974 bytes) 2024-09-21T15:10:00.861 INFO:teuthology.orchestra.run.smithi161.stdout:4576 read 0x4330e0f thru 0x4331a50 (0xc42 bytes) 2024-09-21T15:10:00.862 INFO:teuthology.orchestra.run.smithi161.stdout:4577 read 0x494773d thru 0x494cf3f (0x5803 bytes) 2024-09-21T15:10:00.862 INFO:teuthology.orchestra.run.smithi161.stdout:4578 read 0x20067ce thru 0x200e5c9 (0x7dfc bytes) 2024-09-21T15:10:00.865 INFO:teuthology.orchestra.run.smithi161.stdout:4580 read 0x260958f thru 0x260e5eb (0x505d bytes) 2024-09-21T15:10:00.868 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.868 INFO:teuthology.orchestra.run.smithi161.stdout:4583 read 0x167f46a thru 0x16886c0 (0x9257 bytes) 2024-09-21T15:10:00.868 INFO:teuthology.orchestra.run.smithi161.stdout:5062 read 0x5552ff1 thru 0x555d7bc (0xa7cc bytes) 2024-09-21T15:10:00.868 INFO:teuthology.orchestra.run.smithi161.stdout:5063 clone 33 order 20 su 262144 sc 10 2024-09-21T15:10:00.928 INFO:teuthology.orchestra.run.smithi161.stdout:3665 write 0x22b710a thru 0x22bdbc2 (0x6ab9 bytes) 2024-09-21T15:10:00.958 INFO:teuthology.orchestra.run.smithi161.stdout:4584 write 0x77796aa thru 0x7786854 (0xd1ab bytes) 2024-09-21T15:10:00.973 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:00.973 INFO:teuthology.orchestra.run.smithi161.stdout:3669 writesame 0x95163a5 thru 0x951d562 data_size 0x45(0x71be bytes) 2024-09-21T15:10:01.015 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.015 INFO:teuthology.orchestra.run.smithi161.stdout:3671 read 0x70c124d thru 0x70c643a (0x51ee bytes) 2024-09-21T15:10:01.017 INFO:teuthology.orchestra.run.smithi161.stdout:3672 read 0x2056d69 thru 0x2060c9e (0x9f36 bytes) 2024-09-21T15:10:01.018 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.018 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.021 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.0-clone33 from 0xae08619 (overlap 0x5a0852) to 0x3604fe 2024-09-21T15:10:01.023 INFO:teuthology.orchestra.run.smithi161.stdout:3675 trunc from 0xe64995d to 0xb54f26f 2024-09-21T15:10:01.059 INFO:teuthology.orchestra.run.smithi161.stdout:4586 write 0xdb173cf thru 0xdb1869a (0x12cc bytes) 2024-09-21T15:10:01.102 INFO:teuthology.orchestra.run.smithi161.stdout:4587 punch from 0x999fc9b to 0x99aaf65, (0xb2ca bytes) 2024-09-21T15:10:01.102 INFO:teuthology.orchestra.run.smithi161.stdout:4589 write 0xabdbb81 thru 0xabe9b8a (0xe00a bytes) 2024-09-21T15:10:01.149 INFO:teuthology.orchestra.run.smithi161.stdout:3676 punch from 0x606eb55 to 0x6074f73, (0x641e bytes) 2024-09-21T15:10:01.149 INFO:teuthology.orchestra.run.smithi161.stdout:3678 read 0x98832be thru 0x9892456 (0xf199 bytes) 2024-09-21T15:10:01.157 INFO:teuthology.orchestra.run.smithi161.stdout:4590 punch from 0x3603293 to 0x36041dd, (0xf4a bytes) 2024-09-21T15:10:01.158 INFO:teuthology.orchestra.run.smithi161.stdout:4591 write 0x99d3cc8 thru 0x99d785c (0x3b95 bytes) 2024-09-21T15:10:01.168 INFO:teuthology.orchestra.run.smithi161.stdout:3679 trunc from 0xb54f26f to 0x30e2db4 2024-09-21T15:10:01.187 INFO:teuthology.orchestra.run.smithi161.stdout:4592 write 0x126a595 thru 0x1278e29 (0xe895 bytes) 2024-09-21T15:10:01.209 INFO:teuthology.orchestra.run.smithi161.stdout:4593 write 0xd88340 thru 0xd908ea (0x85ab bytes) 2024-09-21T15:10:01.216 INFO:teuthology.orchestra.run.smithi161.stdout:4594 writesame 0x5ba4eca thru 0x5ba7b22 data_size 0x1(0x2c59 bytes) 2024-09-21T15:10:01.234 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.237 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #32, image image_cluster1.client.mirror.2-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent33 2024-09-21T15:10:01.257 INFO:teuthology.orchestra.run.smithi161.stdout:3680 write 0x83fdc5d thru 0x83ffa22 (0x1dc6 bytes) 2024-09-21T15:10:01.267 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.267 INFO:teuthology.orchestra.run.smithi161.stdout:3682 read 0x4f94431 thru 0x4f97681 (0x3251 bytes) 2024-09-21T15:10:01.268 INFO:teuthology.orchestra.run.smithi161.stdout:3684 read 0x2f09c6e thru 0x2f1790d (0xdca0 bytes) 2024-09-21T15:10:01.268 INFO:teuthology.orchestra.run.smithi161.stdout:3685 read 0x794ff9a thru 0x795d33a (0xd3a1 bytes) 2024-09-21T15:10:01.269 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.277 INFO:teuthology.orchestra.run.smithi161.stdout:4598 writesame 0xdf9447e thru 0xdf99ad6 data_size 0x1(0x5659 bytes) 2024-09-21T15:10:01.280 INFO:teuthology.orchestra.run.smithi161.stdout:3687 trunc from 0x83ffa23 to 0x2190a65 2024-09-21T15:10:01.291 INFO:teuthology.orchestra.run.smithi161.stdout:4599 trunc from 0xdf99ad7 to 0x8af44f6 2024-09-21T15:10:01.299 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #32, image image_cluster1.client.mirror.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent33 2024-09-21T15:10:01.353 INFO:teuthology.orchestra.run.smithi161.stdout:4600 read 0x3eb7560 thru 0x3eb980c (0x22ad bytes) 2024-09-21T15:10:01.382 INFO:teuthology.orchestra.run.smithi161.stdout:3689 write 0xb30fd3f thru 0xb31f9b8 (0xfc7a bytes) 2024-09-21T15:10:01.389 INFO:teuthology.orchestra.run.smithi161.stdout:4601 writesame 0xed3e5be thru 0xed47005 data_size 0x4b(0x8a48 bytes) 2024-09-21T15:10:01.394 INFO:teuthology.orchestra.run.smithi161.stdout:4602 punch from 0xa67a03d to 0xa689e93, (0xfe56 bytes) 2024-09-21T15:10:01.394 INFO:teuthology.orchestra.run.smithi161.stdout:4603 read 0x91b021f thru 0x91badac (0xab8e bytes) 2024-09-21T15:10:01.394 INFO:teuthology.orchestra.run.smithi161.stdout:4604 writesame 0x94da340 thru 0x94e4cf4 data_size 0x1(0xa9b5 bytes) 2024-09-21T15:10:01.396 INFO:teuthology.orchestra.run.smithi161.stdout:3691 write 0x8483a3f thru 0x84844d5 (0xa97 bytes) 2024-09-21T15:10:01.437 INFO:teuthology.orchestra.run.smithi161.stdout:4607 write 0xea4bdad thru 0xea4e773 (0x29c7 bytes) 2024-09-21T15:10:01.441 INFO:teuthology.orchestra.run.smithi161.stdout:3693 writesame 0xc7af90a thru 0xc7bc217 data_size 0x2(0xc90e bytes) 2024-09-21T15:10:01.449 INFO:teuthology.orchestra.run.smithi161.stdout:4609 write 0x2efbb96 thru 0x2eff455 (0x38c0 bytes) 2024-09-21T15:10:01.449 INFO:teuthology.orchestra.run.smithi161.stdout:3694 write 0x30739f3 thru 0x307f714 (0xbd22 bytes) 2024-09-21T15:10:01.458 INFO:teuthology.orchestra.run.smithi161.stdout:4610 write 0x72c0442 thru 0x72c7edf (0x7a9e bytes) 2024-09-21T15:10:01.466 INFO:teuthology.orchestra.run.smithi161.stdout:3695 trunc from 0xc7bc218 to 0xa4097e1 2024-09-21T15:10:01.469 INFO:teuthology.orchestra.run.smithi161.stdout:4611 punch from 0xd5cea26 to 0xd5d674e, (0x7d28 bytes) 2024-09-21T15:10:01.469 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.469 INFO:teuthology.orchestra.run.smithi161.stdout:4614 write 0x71e3fd thru 0x72a253 (0xbe57 bytes) 2024-09-21T15:10:01.471 INFO:teuthology.orchestra.run.smithi161.stdout:5092 write 0x4da461e thru 0x4da6efe (0x28e1 bytes) 2024-09-21T15:10:01.483 INFO:teuthology.orchestra.run.smithi161.stdout:4615 read 0xd8ed64b thru 0xd8f2e70 (0x5826 bytes) 2024-09-21T15:10:01.483 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.483 INFO:teuthology.orchestra.run.smithi161.stdout:4617 read 0x78ebd12 thru 0x78f7775 (0xba64 bytes) 2024-09-21T15:10:01.483 INFO:teuthology.orchestra.run.smithi161.stdout:4619 write 0x10eee04 thru 0x10fba10 (0xcc0d bytes) 2024-09-21T15:10:01.498 INFO:teuthology.orchestra.run.smithi161.stdout:4622 read 0x69a25e4 thru 0x69ae952 (0xc36f bytes) 2024-09-21T15:10:01.499 INFO:teuthology.orchestra.run.smithi161.stdout:4623 write 0xa069f92 thru 0xa06b41f (0x148e bytes) 2024-09-21T15:10:01.507 INFO:teuthology.orchestra.run.smithi161.stdout:3696 read 0x864a547 thru 0x864bbe4 (0x169e bytes) 2024-09-21T15:10:01.509 INFO:teuthology.orchestra.run.smithi161.stdout:3697 punch from 0x43ca717 to 0x43d9a89, (0xf372 bytes) 2024-09-21T15:10:01.510 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.510 INFO:teuthology.orchestra.run.smithi161.stdout:3702 writesame 0x59a101c thru 0x59aa4d7 data_size 0x26(0x94bc bytes) 2024-09-21T15:10:01.513 INFO:teuthology.orchestra.run.smithi161.stdout:4624 write 0xc563ed0 thru 0xc564dd7 (0xf08 bytes) 2024-09-21T15:10:01.516 INFO:teuthology.orchestra.run.smithi161.stdout:5093 punch from 0xbf0237e to 0xbf0b275, (0x8ef7 bytes) 2024-09-21T15:10:01.517 INFO:teuthology.orchestra.run.smithi161.stdout:5095 write 0xaa63bd2 thru 0xaa705d8 (0xca07 bytes) 2024-09-21T15:10:01.523 INFO:teuthology.orchestra.run.smithi161.stdout:3704 read 0x97c59bf thru 0x97cc82b (0x6e6d bytes) 2024-09-21T15:10:01.523 INFO:teuthology.orchestra.run.smithi161.stdout:3705 write 0x35eb56 thru 0x36c1e8 (0xd693 bytes) 2024-09-21T15:10:01.533 INFO:teuthology.orchestra.run.smithi161.stdout:4625 punch from 0x6202c6e to 0x620b468, (0x87fa bytes) 2024-09-21T15:10:01.533 INFO:teuthology.orchestra.run.smithi161.stdout:4626 write 0x61a4776 thru 0x61af71c (0xafa7 bytes) 2024-09-21T15:10:01.537 INFO:teuthology.orchestra.run.smithi161.stdout:3706 punch from 0x481463c to 0x481e65a, (0xa01e bytes) 2024-09-21T15:10:01.537 INFO:teuthology.orchestra.run.smithi161.stdout:3711 read 0x381de79 thru 0x382a25b (0xc3e3 bytes) 2024-09-21T15:10:01.538 INFO:teuthology.orchestra.run.smithi161.stdout:3717 write 0x506ca74 thru 0x507b055 (0xe5e2 bytes) 2024-09-21T15:10:01.542 INFO:teuthology.orchestra.run.smithi161.stdout:5096 read 0x8d18e84 thru 0x8d1cd86 (0x3f03 bytes) 2024-09-21T15:10:01.543 INFO:teuthology.orchestra.run.smithi161.stdout:5097 read 0xc178262 thru 0xc17d8e8 (0x5687 bytes) 2024-09-21T15:10:01.543 INFO:teuthology.orchestra.run.smithi161.stdout:5098 write 0x782c762 thru 0x782d8a2 (0x1141 bytes) 2024-09-21T15:10:01.574 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.574 INFO:teuthology.orchestra.run.smithi161.stdout:3721 write 0x3db0dd thru 0x3e7761 (0xc685 bytes) 2024-09-21T15:10:01.576 INFO:teuthology.orchestra.run.smithi161.stdout:4627 write 0x2a865a3 thru 0x2a9481e (0xe27c bytes) 2024-09-21T15:10:01.623 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.623 INFO:teuthology.orchestra.run.smithi161.stdout:3723 write 0x63cd01b thru 0x63d19ac (0x4992 bytes) 2024-09-21T15:10:01.625 INFO:teuthology.orchestra.run.smithi161.stdout:5099 write 0x8f5d4ec thru 0x8f65be3 (0x86f8 bytes) 2024-09-21T15:10:01.639 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.639 INFO:teuthology.orchestra.run.smithi161.stdout:4629 write 0x831a956 thru 0x8326748 (0xbdf3 bytes) 2024-09-21T15:10:01.653 INFO:teuthology.orchestra.run.smithi161.stdout:3724 trunc from 0xa4097e1 to 0x2872e65 2024-09-21T15:10:01.660 INFO:teuthology.orchestra.run.smithi161.stdout:5100 read 0x2b8e0c6 thru 0x2b9d0aa (0xefe5 bytes) 2024-09-21T15:10:01.673 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.673 INFO:teuthology.orchestra.run.smithi161.stdout:4631 writesame 0x245468 thru 0x250fb7 data_size 0xd8(0xbb50 bytes) 2024-09-21T15:10:01.693 INFO:teuthology.orchestra.run.smithi161.stdout:4632 writesame 0xaf7765f thru 0xaf82163 data_size 0x1(0xab05 bytes) 2024-09-21T15:10:01.721 INFO:teuthology.orchestra.run.smithi161.stdout:3726 read 0xa5e147 thru 0xa6a9cb (0xc885 bytes) 2024-09-21T15:10:01.721 INFO:teuthology.orchestra.run.smithi161.stdout:3729 punch from 0x836433 to 0x842faf, (0xcb7c bytes) 2024-09-21T15:10:01.727 INFO:teuthology.orchestra.run.smithi161.stdout:5101 write 0xdab7b1b thru 0xdac71bc (0xf6a2 bytes) 2024-09-21T15:10:01.746 INFO:teuthology.orchestra.run.smithi161.stdout:4633 write 0x8d3b9f7 thru 0x8d46d8c (0xb396 bytes) 2024-09-21T15:10:01.751 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.751 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.751 INFO:teuthology.orchestra.run.smithi161.stdout:5104 writesame 0xd531c9e thru 0xd53928d data_size 0x2(0x75f0 bytes) 2024-09-21T15:10:01.759 INFO:teuthology.orchestra.run.smithi161.stdout:3731 write 0x70808b6 thru 0x708b6d8 (0xae23 bytes) 2024-09-21T15:10:01.764 INFO:teuthology.orchestra.run.smithi161.stdout:4634 write 0x60d84bc thru 0x60e3449 (0xaf8e bytes) 2024-09-21T15:10:01.774 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #25, image image_cluster1.client.mirror.1-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent26 2024-09-21T15:10:01.778 INFO:teuthology.orchestra.run.smithi161.stdout:5105 write 0x1ba49d5 thru 0x1bae9d4 (0xa000 bytes) 2024-09-21T15:10:01.779 INFO:teuthology.orchestra.run.smithi161.stdout:4635 write 0xc7a0b83 thru 0xc7a5f21 (0x539f bytes) 2024-09-21T15:10:01.790 INFO:teuthology.orchestra.run.smithi161.stdout:3732 trunc from 0x708b6d9 to 0xc618d0f 2024-09-21T15:10:01.805 INFO:teuthology.orchestra.run.smithi161.stdout:4636 read 0xdfc3617 thru 0xdfd3403 (0xfded bytes) 2024-09-21T15:10:01.806 INFO:teuthology.orchestra.run.smithi161.stdout:4637 punch from 0x38ab692 to 0x38b05d5, (0x4f43 bytes) 2024-09-21T15:10:01.806 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.806 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.806 INFO:teuthology.orchestra.run.smithi161.stdout:4641 write 0x103980b thru 0x103c2b8 (0x2aae bytes) 2024-09-21T15:10:01.815 INFO:teuthology.orchestra.run.smithi161.stdout:4644 writesame 0x954bdca thru 0x954fdc4 data_size 0x1(0x3ffb bytes) 2024-09-21T15:10:01.824 INFO:teuthology.orchestra.run.smithi161.stdout:3733 read 0xb080eec thru 0xb0815fa (0x70f bytes) 2024-09-21T15:10:01.825 INFO:teuthology.orchestra.run.smithi161.stdout:3734 write 0x5b277e thru 0x5b4202 (0x1a85 bytes) 2024-09-21T15:10:01.840 INFO:teuthology.orchestra.run.smithi161.stdout:3735 read 0x11a5a06 thru 0x11a90d9 (0x36d4 bytes) 2024-09-21T15:10:01.840 INFO:teuthology.orchestra.run.smithi161.stdout:4646 read 0x44fbfd7 thru 0x45026a7 (0x66d1 bytes) 2024-09-21T15:10:01.840 INFO:teuthology.orchestra.run.smithi161.stdout:4647 write 0xe7aa8ca thru 0xe7abe51 (0x1588 bytes) 2024-09-21T15:10:01.842 INFO:teuthology.orchestra.run.smithi161.stdout:3736 write 0x7cb5ba7 thru 0x7cb9984 (0x3dde bytes) 2024-09-21T15:10:01.846 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.5-clone32 2024-09-21T15:10:01.849 INFO:teuthology.orchestra.run.smithi161.stdout:3737 punch from 0x7172a7c to 0x71797c4, (0x6d48 bytes) 2024-09-21T15:10:01.849 INFO:teuthology.orchestra.run.smithi161.stdout:3738 read 0x35da5c thru 0x3652ce (0x7873 bytes) 2024-09-21T15:10:01.850 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:01.850 INFO:teuthology.orchestra.run.smithi161.stdout:3740 clone 45 order 22 su 1048576 sc 7 2024-09-21T15:10:01.851 INFO:teuthology.orchestra.run.smithi161.stdout:5147 read 0x2fc05da thru 0x2fce7b5 (0xe1dc bytes) 2024-09-21T15:10:01.858 INFO:teuthology.orchestra.run.smithi161.stdout:4648 trunc from 0xed47006 to 0xb2ee845 2024-09-21T15:10:01.877 INFO:teuthology.orchestra.run.smithi161.stdout:5106 write 0x9008e48 thru 0x9017e4a (0xf003 bytes) 2024-09-21T15:10:01.908 INFO:teuthology.orchestra.run.smithi161.stdout:5107 write 0x738698 thru 0x739de0 (0x1749 bytes) 2024-09-21T15:10:01.924 INFO:teuthology.orchestra.run.smithi161.stdout:5148 read 0x21657a2 thru 0x2168a9b (0x32fa bytes) 2024-09-21T15:10:01.925 INFO:teuthology.orchestra.run.smithi161.stdout:5149 writesame 0x5fe18d3 thru 0x5febb3c data_size 0x1(0xa26a bytes) 2024-09-21T15:10:02.058 INFO:teuthology.orchestra.run.smithi161.stdout:4649 write 0x2d491ee thru 0x2d54c9b (0xbaae bytes) 2024-09-21T15:10:02.141 INFO:teuthology.orchestra.run.smithi161.stdout:5111 writesame 0x3e9dd3c thru 0x3e9ff8b data_size 0x12(0x2250 bytes) 2024-09-21T15:10:02.157 INFO:teuthology.orchestra.run.smithi161.stdout:4650 write 0x3eccfa thru 0x3ed75f (0xa66 bytes) 2024-09-21T15:10:02.189 INFO:teuthology.orchestra.run.smithi161.stdout:5112 punch from 0x8de1d8e to 0x8dec559, (0xa7cb bytes) 2024-09-21T15:10:02.189 INFO:teuthology.orchestra.run.smithi161.stdout:5113 read 0xaa80ffd thru 0xaa825e4 (0x15e8 bytes) 2024-09-21T15:10:02.190 INFO:teuthology.orchestra.run.smithi161.stdout:5114 write 0x2a379c3 thru 0x2a38d9c (0x13da bytes) 2024-09-21T15:10:02.234 INFO:teuthology.orchestra.run.smithi161.stdout:4651 punch from 0x587a287 to 0x5887e78, (0xdbf1 bytes) 2024-09-21T15:10:02.241 INFO:teuthology.orchestra.run.smithi161.stdout:4652 trunc from 0xb2ee845 to 0x84c62ff 2024-09-21T15:10:02.248 INFO:teuthology.orchestra.run.smithi161.stdout:5115 punch from 0x16c4f30 to 0x16d2632, (0xd702 bytes) 2024-09-21T15:10:02.248 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:02.248 INFO:teuthology.orchestra.run.smithi161.stdout:5117 trunc from 0xdac71bd to 0xd9900b8 2024-09-21T15:10:02.336 INFO:teuthology.orchestra.run.smithi161.stdout:5118 trunc from 0xd9900b8 to 0x4191146 2024-09-21T15:10:02.472 INFO:teuthology.orchestra.run.smithi161.stdout:5119 writesame 0x9b0f8fe thru 0x9b1b453 data_size 0x3(0xbb56 bytes) 2024-09-21T15:10:02.475 INFO:teuthology.orchestra.run.smithi161.stdout:5150 writesame 0xc335924 thru 0xc33cf86 data_size 0x1(0x7663 bytes) 2024-09-21T15:10:02.480 INFO:teuthology.orchestra.run.smithi161.stdout:5151 punch from 0xa972411 to 0xa97fa97, (0xd686 bytes) 2024-09-21T15:10:02.480 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:02.480 INFO:teuthology.orchestra.run.smithi161.stdout:5155 write 0x7c8b85e thru 0x7c934aa (0x7c4d bytes) 2024-09-21T15:10:02.481 INFO:teuthology.orchestra.run.smithi161.stdout:5123 read 0x81e2b6e thru 0x81e5b0e (0x2fa1 bytes) 2024-09-21T15:10:02.481 INFO:teuthology.orchestra.run.smithi161.stdout:5124 write 0x2429fa0 thru 0x2438050 (0xe0b1 bytes) 2024-09-21T15:10:02.546 INFO:teuthology.orchestra.run.smithi161.stdout:5125 write 0x31780b4 thru 0x3179cea (0x1c37 bytes) 2024-09-21T15:10:02.567 INFO:teuthology.orchestra.run.smithi161.stdout:5156 read 0x9fde6e5 thru 0x9fe6ab7 (0x83d3 bytes) 2024-09-21T15:10:02.568 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:02.568 INFO:teuthology.orchestra.run.smithi161.stdout:5158 read 0xbaf164 thru 0xbbc5f2 (0xd48f bytes) 2024-09-21T15:10:02.568 INFO:teuthology.orchestra.run.smithi161.stdout:5159 read 0x7b63248 thru 0x7b66967 (0x3720 bytes) 2024-09-21T15:10:02.568 INFO:teuthology.orchestra.run.smithi161.stdout:5160 read 0xaac87f2 thru 0xaacf7bb (0x6fca bytes) 2024-09-21T15:10:02.569 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:02.571 INFO:teuthology.orchestra.run.smithi161.stdout:5162 trunc from 0xc33cf87 to 0xafc2da6 2024-09-21T15:10:02.629 INFO:teuthology.orchestra.run.smithi161.stdout:5126 read 0x11969e9 thru 0x119cc1b (0x6233 bytes) 2024-09-21T15:10:02.696 INFO:teuthology.orchestra.run.smithi161.stdout:5127 read 0x2cee5a0 thru 0x2cf6778 (0x81d9 bytes) 2024-09-21T15:10:02.696 INFO:teuthology.orchestra.run.smithi161.stdout:5128 writesame 0x87dc06e thru 0x87e1e32 data_size 0x1(0x5dc5 bytes) 2024-09-21T15:10:02.731 INFO:teuthology.orchestra.run.smithi161.stdout:5129 write 0xd8d133 thru 0xd8e008 (0xed6 bytes) 2024-09-21T15:10:02.753 INFO:teuthology.orchestra.run.smithi161.stdout:4654 write 0xd648da2 thru 0xd6540f9 (0xb358 bytes) 2024-09-21T15:10:02.846 INFO:teuthology.orchestra.run.smithi161.stdout:4655 write 0x70cd00f thru 0x70d33eb (0x63dd bytes) 2024-09-21T15:10:02.912 INFO:teuthology.orchestra.run.smithi161.stdout:4656 read 0x57b6265 thru 0x57be98b (0x8727 bytes) 2024-09-21T15:10:02.912 INFO:teuthology.orchestra.run.smithi161.stdout:4657 write 0x144ee6f thru 0x145751f (0x86b1 bytes) 2024-09-21T15:10:02.943 INFO:teuthology.orchestra.run.smithi161.stdout:5130 write 0x678457b thru 0x678f0f7 (0xab7d bytes) 2024-09-21T15:10:02.978 INFO:teuthology.orchestra.run.smithi161.stdout:5131 punch from 0x78d7509 to 0x78d8709, (0x1200 bytes) 2024-09-21T15:10:02.981 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #31, image image_cluster1.client.mirror.5-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent32 2024-09-21T15:10:02.985 INFO:teuthology.orchestra.run.smithi161.stdout:4658 write 0x2043f9e thru 0x204bd48 (0x7dab bytes) 2024-09-21T15:10:03.031 INFO:teuthology.orchestra.run.smithi161.stdout:4660 write 0x3f5a83f thru 0x3f5c95a (0x211c bytes) 2024-09-21T15:10:03.049 INFO:teuthology.orchestra.run.smithi161.stdout:5133 write 0xbfb33fe thru 0xbfb5838 (0x243b bytes) 2024-09-21T15:10:03.062 INFO:teuthology.orchestra.run.smithi161.stdout:5136 writesame 0xae935ce thru 0xae97b22 data_size 0x1(0x4555 bytes) 2024-09-21T15:10:03.091 INFO:teuthology.orchestra.run.smithi161.stdout:5138 write 0x3f2f75e thru 0x3f3866c (0x8f0f bytes) 2024-09-21T15:10:03.108 INFO:teuthology.orchestra.run.smithi161.stdout:5140 write 0x9a43247 thru 0x9a511e7 (0xdfa1 bytes) 2024-09-21T15:10:03.119 INFO:teuthology.orchestra.run.smithi161.stdout:4661 read 0x6016130 thru 0x6017983 (0x1854 bytes) 2024-09-21T15:10:03.119 INFO:teuthology.orchestra.run.smithi161.stdout:4662 write 0x1f19ab thru 0x1fc218 (0xa86e bytes) 2024-09-21T15:10:03.160 INFO:teuthology.orchestra.run.smithi161.stdout:5141 writesame 0xc1b799c thru 0xc1b81b7 data_size 0x1(0x81c bytes) 2024-09-21T15:10:03.165 INFO:teuthology.orchestra.run.smithi161.stdout:5142 writesame 0xb2e5498 thru 0xb2e705d data_size 0x1e(0x1bc6 bytes) 2024-09-21T15:10:03.179 INFO:teuthology.orchestra.run.smithi161.stdout:5143 punch from 0x7e6ca06 to 0x7e7584e, (0x8e48 bytes) 2024-09-21T15:10:03.179 INFO:teuthology.orchestra.run.smithi161.stdout:5144 write 0x6bc31d9 thru 0x6bc6c93 (0x3abb bytes) 2024-09-21T15:10:03.191 INFO:teuthology.orchestra.run.smithi161.stdout:5145 writesame 0xc1a4c20 thru 0xc1b06c9 data_size 0x1(0xbaaa bytes) 2024-09-21T15:10:03.223 INFO:teuthology.orchestra.run.smithi161.stdout:4663 writesame 0x9fa6e8c thru 0x9fa99d8 data_size 0x5(0x2b4d bytes) 2024-09-21T15:10:03.241 INFO:teuthology.orchestra.run.smithi161.stdout:5146 punch from 0x3eed60a to 0x3efa1a4, (0xcb9a bytes) 2024-09-21T15:10:03.242 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.242 INFO:teuthology.orchestra.run.smithi161.stdout:5149 write 0x25a5b41 thru 0x25b10ca (0xb58a bytes) 2024-09-21T15:10:03.277 INFO:teuthology.orchestra.run.smithi161.stdout:4664 read 0x2040a2a thru 0x20444f4 (0x3acb bytes) 2024-09-21T15:10:03.293 INFO:teuthology.orchestra.run.smithi161.stdout:5150 write 0x41d371f thru 0x41df9e6 (0xc2c8 bytes) 2024-09-21T15:10:03.303 INFO:teuthology.orchestra.run.smithi161.stdout:4665 trunc from 0xd6540fa to 0x54ffde 2024-09-21T15:10:03.304 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.304 INFO:teuthology.orchestra.run.smithi161.stdout:5152 read 0x75ba751 thru 0x75c21cd (0x7a7d bytes) 2024-09-21T15:10:03.304 INFO:teuthology.orchestra.run.smithi161.stdout:5153 writesame 0x400d6e8 thru 0x401c018 data_size 0x21(0xe931 bytes) 2024-09-21T15:10:03.311 INFO:teuthology.orchestra.run.smithi161.stdout:5154 read 0x4768f2b thru 0x47725d7 (0x96ad bytes) 2024-09-21T15:10:03.312 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.312 INFO:teuthology.orchestra.run.smithi161.stdout:5158 write 0xbe43f3a thru 0xbe488db (0x49a2 bytes) 2024-09-21T15:10:03.322 INFO:teuthology.orchestra.run.smithi161.stdout:5163 write 0xb8df451 thru 0xb8e946f (0xa01f bytes) 2024-09-21T15:10:03.326 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.326 INFO:teuthology.orchestra.run.smithi161.stdout:5160 write 0x33657d1 thru 0x336ce44 (0x7674 bytes) 2024-09-21T15:10:03.348 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:03.346+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074cd00 2024-09-21T15:10:03.350 INFO:teuthology.orchestra.run.smithi161.stdout:5064 write 0x9d5f19f thru 0x9d67e94 (0x8cf6 bytes) 2024-09-21T15:10:03.358 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:03.354+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f89040 2024-09-21T15:10:03.359 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.359 INFO:teuthology.orchestra.run.smithi161.stdout:5165 read 0x5dc7a74 thru 0x5dd651d (0xeaaa bytes) 2024-09-21T15:10:03.360 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.360 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.360 INFO:teuthology.orchestra.run.smithi161.stdout:5171 writesame 0x95de0f3 thru 0x95e4756 data_size 0x2(0x6664 bytes) 2024-09-21T15:10:03.389 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.389 INFO:teuthology.orchestra.run.smithi161.stdout:5162 write 0x6a635c7 thru 0x6a6e6b2 (0xb0ec bytes) 2024-09-21T15:10:03.395 INFO:teuthology.orchestra.run.smithi161.stdout:5065 write 0x944eca7 thru 0x945083d (0x1b97 bytes) 2024-09-21T15:10:03.399 INFO:teuthology.orchestra.run.smithi161.stdout:5173 trunc from 0xb8e9470 to 0x1b7fe43 2024-09-21T15:10:03.404 INFO:teuthology.orchestra.run.smithi161.stdout:5163 writesame 0xa3ba2d0 thru 0xa3ca1b9 data_size 0x2(0xfeea bytes) 2024-09-21T15:10:03.411 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.3-clone44 intact 2024-09-21T15:10:03.415 INFO:teuthology.orchestra.run.smithi161.stdout:5066 read 0x96ee126 thru 0x96f8c86 (0xab61 bytes) 2024-09-21T15:10:03.422 INFO:teuthology.orchestra.run.smithi161.stdout:5068 trunc from 0x9d67e95 to 0xc5d8cba 2024-09-21T15:10:03.443 INFO:teuthology.orchestra.run.smithi161.stdout:5164 clone 35 order 21 su 65536 sc 9 2024-09-21T15:10:03.452 INFO:teuthology.orchestra.run.smithi161.stdout:5174 read 0x7e0eb2 thru 0x7efffd (0xf14c bytes) 2024-09-21T15:10:03.453 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.454 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.454 INFO:teuthology.orchestra.run.smithi161.stdout:5070 write 0xade7a1a thru 0xade89bb (0xfa2 bytes) 2024-09-21T15:10:03.454 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.467 INFO:teuthology.orchestra.run.smithi161.stdout:5071 write 0x2f9323c thru 0x2f9fa75 (0xc83a bytes) 2024-09-21T15:10:03.481 INFO:teuthology.orchestra.run.smithi161.stdout:4667 trunc from 0x54ffde to 0xe8f9a88 2024-09-21T15:10:03.481 INFO:teuthology.orchestra.run.smithi161.stdout:5072 writesame 0x1a703cd thru 0x1a7765f data_size 0x3(0x7293 bytes) 2024-09-21T15:10:03.491 INFO:teuthology.orchestra.run.smithi161.stdout:5179 write 0x992f3de thru 0x993bd87 (0xc9aa bytes) 2024-09-21T15:10:03.500 INFO:teuthology.orchestra.run.smithi161.stdout:5074 read 0x7fe0eb7 thru 0x7fef0fb (0xe245 bytes) 2024-09-21T15:10:03.500 INFO:teuthology.orchestra.run.smithi161.stdout:5075 read 0x5d84407 thru 0x5d8b029 (0x6c23 bytes) 2024-09-21T15:10:03.500 INFO:teuthology.orchestra.run.smithi161.stdout:5078 write 0xa2aac42 thru 0xa2b5de7 (0xb1a6 bytes) 2024-09-21T15:10:03.508 INFO:teuthology.orchestra.run.smithi161.stdout:5180 read 0x25f08e4 thru 0x25f759a (0x6cb7 bytes) 2024-09-21T15:10:03.509 INFO:teuthology.orchestra.run.smithi161.stdout:5181 read 0x1e9d671 thru 0x1eaca97 (0xf427 bytes) 2024-09-21T15:10:03.514 INFO:teuthology.orchestra.run.smithi161.stdout:4668 punch from 0x56fac52 to 0x56fe24b, (0x35f9 bytes) 2024-09-21T15:10:03.514 INFO:teuthology.orchestra.run.smithi161.stdout:4669 punch from 0x584e2c to 0x58c647, (0x781b bytes) 2024-09-21T15:10:03.514 INFO:teuthology.orchestra.run.smithi161.stdout:4670 read 0xd7defac thru 0xd7e7920 (0x8975 bytes) 2024-09-21T15:10:03.514 INFO:teuthology.orchestra.run.smithi161.stdout:4672 punch from 0x530e7c5 to 0x531c0c7, (0xd902 bytes) 2024-09-21T15:10:03.515 INFO:teuthology.orchestra.run.smithi161.stdout:4673 read 0x6f88f6 thru 0x6fead8 (0x61e3 bytes) 2024-09-21T15:10:03.515 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.515 INFO:teuthology.orchestra.run.smithi161.stdout:4675 writesame 0xac1b47d thru 0xac28445 data_size 0x33(0xcfc9 bytes) 2024-09-21T15:10:03.523 INFO:teuthology.orchestra.run.smithi161.stdout:5079 write 0x25666ed thru 0x25757ff (0xf113 bytes) 2024-09-21T15:10:03.529 INFO:teuthology.orchestra.run.smithi161.stdout:5182 read 0x3f61eba thru 0x3f62a3c (0xb83 bytes) 2024-09-21T15:10:03.529 INFO:teuthology.orchestra.run.smithi161.stdout:5183 write 0x8127412 thru 0x8130697 (0x9286 bytes) 2024-09-21T15:10:03.538 INFO:teuthology.orchestra.run.smithi161.stdout:5184 write 0x3f6e6fb thru 0x3f76e72 (0x8778 bytes) 2024-09-21T15:10:03.554 INFO:teuthology.orchestra.run.smithi161.stdout:5185 trunc from 0x993bd88 to 0xdcf1de5 2024-09-21T15:10:03.617 INFO:teuthology.orchestra.run.smithi161.stdout:4677 writesame 0x7461a62 thru 0x74621f3 data_size 0x13(0x792 bytes) 2024-09-21T15:10:03.618 INFO:teuthology.orchestra.run.smithi161.stdout:5080 write 0x729331d thru 0x7297443 (0x4127 bytes) 2024-09-21T15:10:03.635 INFO:teuthology.orchestra.run.smithi161.stdout:4680 write 0x69d91f4 thru 0x69de38d (0x519a bytes) 2024-09-21T15:10:03.639 INFO:teuthology.orchestra.run.smithi161.stdout:5186 punch from 0xbc524e2 to 0xbc61f43, (0xfa61 bytes) 2024-09-21T15:10:03.639 INFO:teuthology.orchestra.run.smithi161.stdout:5191 read 0x30b0277 thru 0x30b6d78 (0x6b02 bytes) 2024-09-21T15:10:03.640 INFO:teuthology.orchestra.run.smithi161.stdout:5192 read 0x66675f3 thru 0x666f90e (0x831c bytes) 2024-09-21T15:10:03.643 INFO:teuthology.orchestra.run.smithi161.stdout:5193 trunc from 0xdcf1de5 to 0xca0d7c0 2024-09-21T15:10:03.650 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.650 INFO:teuthology.orchestra.run.smithi161.stdout:4682 write 0xadcf557 thru 0xadd15eb (0x2095 bytes) 2024-09-21T15:10:03.664 INFO:teuthology.orchestra.run.smithi161.stdout:4683 read 0x937cf81 thru 0x937f04f (0x20cf bytes) 2024-09-21T15:10:03.664 INFO:teuthology.orchestra.run.smithi161.stdout:4684 read 0x8dae0e1 thru 0x8dbca4b (0xe96b bytes) 2024-09-21T15:10:03.664 INFO:teuthology.orchestra.run.smithi161.stdout:4686 write 0x25b38a7 thru 0x25ba732 (0x6e8c bytes) 2024-09-21T15:10:03.665 INFO:teuthology.orchestra.run.smithi161.stdout:5194 punch from 0xbb26127 to 0xbb2bc2a, (0x5b03 bytes) 2024-09-21T15:10:03.665 INFO:teuthology.orchestra.run.smithi161.stdout:5196 read 0x73402e8 thru 0x734c5dc (0xc2f5 bytes) 2024-09-21T15:10:03.667 INFO:teuthology.orchestra.run.smithi161.stdout:5197 writesame 0x22e708b thru 0x22ed3c7 data_size 0x1(0x633d bytes) 2024-09-21T15:10:03.675 INFO:teuthology.orchestra.run.smithi161.stdout:5081 write 0xd230565 thru 0xd23b31a (0xadb6 bytes) 2024-09-21T15:10:03.679 INFO:teuthology.orchestra.run.smithi161.stdout:4687 write 0x280b3a6 thru 0x280ca62 (0x16bd bytes) 2024-09-21T15:10:03.695 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.695 INFO:teuthology.orchestra.run.smithi161.stdout:5200 writesame 0x94b9b49 thru 0x94c17ff data_size 0x1(0x7cb7 bytes) 2024-09-21T15:10:03.699 INFO:teuthology.orchestra.run.smithi161.stdout:4689 punch from 0xe82aa7d to 0xe837034, (0xc5b7 bytes) 2024-09-21T15:10:03.699 INFO:teuthology.orchestra.run.smithi161.stdout:4690 read 0xc71d131 thru 0xc72c680 (0xf550 bytes) 2024-09-21T15:10:03.699 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.699 INFO:teuthology.orchestra.run.smithi161.stdout:4695 read 0x5f99fb4 thru 0x5f9b874 (0x18c1 bytes) 2024-09-21T15:10:03.700 INFO:teuthology.orchestra.run.smithi161.stdout:4696 write 0x2c8272e thru 0x2c919d5 (0xf2a8 bytes) 2024-09-21T15:10:03.708 INFO:teuthology.orchestra.run.smithi161.stdout:5082 punch from 0xb345bfd to 0xb34fe2d, (0xa230 bytes) 2024-09-21T15:10:03.721 INFO:teuthology.orchestra.run.smithi161.stdout:4697 writesame 0x3cb124a thru 0x3cb6131 data_size 0x32(0x4ee8 bytes) 2024-09-21T15:10:03.727 INFO:teuthology.orchestra.run.smithi161.stdout:5201 punch from 0x6317360 to 0x6326805, (0xf4a5 bytes) 2024-09-21T15:10:03.727 INFO:teuthology.orchestra.run.smithi161.stdout:5203 read 0xa1879ba thru 0xa18d8b7 (0x5efe bytes) 2024-09-21T15:10:03.732 INFO:teuthology.orchestra.run.smithi161.stdout:5204 read 0x7aca14 thru 0x7ae931 (0x1f1e bytes) 2024-09-21T15:10:03.733 INFO:teuthology.orchestra.run.smithi161.stdout:5205 read 0xbc92c2c thru 0xbca0f8a (0xe35f bytes) 2024-09-21T15:10:03.734 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.735 INFO:teuthology.orchestra.run.smithi161.stdout:5207 read 0x3aa2142 thru 0x3ab13e4 (0xf2a3 bytes) 2024-09-21T15:10:03.735 INFO:teuthology.orchestra.run.smithi161.stdout:5208 read 0x792aeeb thru 0x79308c3 (0x59d9 bytes) 2024-09-21T15:10:03.736 INFO:teuthology.orchestra.run.smithi161.stdout:5209 punch from 0x232735 to 0x23abb4, (0x847f bytes) 2024-09-21T15:10:03.736 INFO:teuthology.orchestra.run.smithi161.stdout:5211 read 0x860abc thru 0x861485 (0x9ca bytes) 2024-09-21T15:10:03.737 INFO:teuthology.orchestra.run.smithi161.stdout:5212 writesame 0x15c983b thru 0x15d492b data_size 0x15(0xb0f1 bytes) 2024-09-21T15:10:03.745 INFO:teuthology.orchestra.run.smithi161.stdout:4698 read 0xcc320b3 thru 0xcc35ceb (0x3c39 bytes) 2024-09-21T15:10:03.745 INFO:teuthology.orchestra.run.smithi161.stdout:4699 read 0x8237721 thru 0x8244d7f (0xd65f bytes) 2024-09-21T15:10:03.745 INFO:teuthology.orchestra.run.smithi161.stdout:4701 read 0x60b03e7 thru 0x60b3ea3 (0x3abd bytes) 2024-09-21T15:10:03.745 INFO:teuthology.orchestra.run.smithi161.stdout:4704 punch from 0x2407891 to 0x241116a, (0x98d9 bytes) 2024-09-21T15:10:03.746 INFO:teuthology.orchestra.run.smithi161.stdout:4705 write 0x2f1227a thru 0x2f1cf44 (0xaccb bytes) 2024-09-21T15:10:03.752 INFO:teuthology.orchestra.run.smithi161.stdout:5213 read 0xb8cb48 thru 0xb97736 (0xabef bytes) 2024-09-21T15:10:03.752 INFO:teuthology.orchestra.run.smithi161.stdout:5214 writesame 0x91a1c81 thru 0x91b074d data_size 0x1f(0xeacd bytes) 2024-09-21T15:10:03.760 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.760 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:03.761 INFO:teuthology.orchestra.run.smithi161.stdout:5217 writesame 0x69d53c2 thru 0x69d724f data_size 0x1(0x1e8e bytes) 2024-09-21T15:10:03.773 INFO:teuthology.orchestra.run.smithi161.stdout:5218 write 0x9848001 thru 0x984843b (0x43b bytes) 2024-09-21T15:10:03.780 INFO:teuthology.orchestra.run.smithi161.stdout:5219 write 0xb9ae4ee thru 0xb9b04f6 (0x2009 bytes) 2024-09-21T15:10:03.789 INFO:teuthology.orchestra.run.smithi161.stdout:5221 read 0x2b9e6a thru 0x2c6e86 (0xd01d bytes) 2024-09-21T15:10:03.798 INFO:teuthology.orchestra.run.smithi161.stdout:5222 trunc from 0xca0d7c0 to 0xd7b854d 2024-09-21T15:10:03.835 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #43, image image_cluster1.client.mirror.3-clone43 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent44 2024-09-21T15:10:03.838 INFO:teuthology.orchestra.run.smithi161.stdout:4706 trunc from 0xe8f9a88 to 0x56ebe82 2024-09-21T15:10:03.847 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone34 from 0xc1b81b8 (overlap 0x4191146) to 0x1a3a082 2024-09-21T15:10:03.849 INFO:teuthology.orchestra.run.smithi161.stdout:5224 read 0x5665131 thru 0x566fe46 (0xad16 bytes) 2024-09-21T15:10:03.849 INFO:teuthology.orchestra.run.smithi161.stdout:5225 writesame 0x240d3ee thru 0x240ed40 data_size 0x1(0x1953 bytes) 2024-09-21T15:10:03.863 INFO:teuthology.orchestra.run.smithi161.stdout:5226 write 0x9202e6 thru 0x92d138 (0xce53 bytes) 2024-09-21T15:10:03.878 INFO:teuthology.orchestra.run.smithi161.stdout:5227 punch from 0x7e5a31f to 0x7e610f2, (0x6dd3 bytes) 2024-09-21T15:10:03.879 INFO:teuthology.orchestra.run.smithi161.stdout:5228 read 0x74f508d thru 0x74fd6af (0x8623 bytes) 2024-09-21T15:10:03.879 INFO:teuthology.orchestra.run.smithi161.stdout:5229 write 0xa5e6c74 thru 0xa5f56b2 (0xea3f bytes) 2024-09-21T15:10:03.886 INFO:teuthology.orchestra.run.smithi161.stdout:5083 write 0xecc6058 thru 0xecd5b3f (0xfae8 bytes) 2024-09-21T15:10:03.893 INFO:teuthology.orchestra.run.smithi161.stdout:5231 read 0x15de525 thru 0x15e1346 (0x2e22 bytes) 2024-09-21T15:10:03.894 INFO:teuthology.orchestra.run.smithi161.stdout:5232 punch from 0x47ad56d to 0x47bc2f0, (0xed83 bytes) 2024-09-21T15:10:03.897 INFO:teuthology.orchestra.run.smithi161.stdout:5234 trunc from 0xd7b854d to 0xc5d2417 2024-09-21T15:10:03.905 INFO:teuthology.orchestra.run.smithi161.stdout:3741 write 0x57a1bfd thru 0x57acb4d (0xaf51 bytes) 2024-09-21T15:10:03.972 INFO:teuthology.orchestra.run.smithi161.stdout:5235 write 0xe9c9d24 thru 0xe9d4a36 (0xad13 bytes) 2024-09-21T15:10:04.003 INFO:teuthology.orchestra.run.smithi161.stdout:5087 writesame 0x7c81711 thru 0x7c84352 data_size 0x37(0x2c42 bytes) 2024-09-21T15:10:04.005 INFO:teuthology.orchestra.run.smithi161.stdout:5236 writesame 0xbd6183 thru 0xbd747f data_size 0x1(0x12fd bytes) 2024-09-21T15:10:04.016 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.016 INFO:teuthology.orchestra.run.smithi161.stdout:5238 write 0x18f293f thru 0x1901130 (0xe7f2 bytes) 2024-09-21T15:10:04.029 INFO:teuthology.orchestra.run.smithi161.stdout:5239 write 0xdd8fcbb thru 0xdd9f8bd (0xfc03 bytes) 2024-09-21T15:10:04.032 INFO:teuthology.orchestra.run.smithi161.stdout:3742 write 0x8166464 thru 0x8166776 (0x313 bytes) 2024-09-21T15:10:04.050 INFO:teuthology.orchestra.run.smithi161.stdout:5241 write 0x2df7fc1 thru 0x2dfdfc4 (0x6004 bytes) 2024-09-21T15:10:04.062 INFO:teuthology.orchestra.run.smithi161.stdout:5242 write 0x8d09249 thru 0x8d0da79 (0x4831 bytes) 2024-09-21T15:10:04.070 INFO:teuthology.orchestra.run.smithi161.stdout:5244 punch from 0x3558a79 to 0x3565d7c, (0xd303 bytes) 2024-09-21T15:10:04.070 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.070 INFO:teuthology.orchestra.run.smithi161.stdout:5246 write 0x6f2aae4 thru 0x6f2b37c (0x899 bytes) 2024-09-21T15:10:04.084 INFO:teuthology.orchestra.run.smithi161.stdout:5089 write 0x355daa4 thru 0x3567a39 (0x9f96 bytes) 2024-09-21T15:10:04.095 INFO:teuthology.orchestra.run.smithi161.stdout:5247 trunc from 0xe9d4a37 to 0x71059ad 2024-09-21T15:10:04.112 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.112 INFO:teuthology.orchestra.run.smithi161.stdout:5091 write 0x4e56d60 thru 0x4e5e1e2 (0x7483 bytes) 2024-09-21T15:10:04.123 INFO:teuthology.orchestra.run.smithi161.stdout:3743 write 0x6629673 thru 0x662c853 (0x31e1 bytes) 2024-09-21T15:10:04.145 INFO:teuthology.orchestra.run.smithi161.stdout:3744 read 0x9ff6e85 thru 0xa00252d (0xb6a9 bytes) 2024-09-21T15:10:04.183 INFO:teuthology.orchestra.run.smithi161.stdout:5092 read 0x4b63d8a thru 0x4b6aff2 (0x7269 bytes) 2024-09-21T15:10:04.184 INFO:teuthology.orchestra.run.smithi161.stdout:5094 read 0xb82273e thru 0xb832101 (0xf9c4 bytes) 2024-09-21T15:10:04.184 INFO:teuthology.orchestra.run.smithi161.stdout:5095 read 0xaf4e4ab thru 0xaf5ca33 (0xe589 bytes) 2024-09-21T15:10:04.184 INFO:teuthology.orchestra.run.smithi161.stdout:5097 read 0xb7c8047 thru 0xb7cfb51 (0x7b0b bytes) 2024-09-21T15:10:04.184 INFO:teuthology.orchestra.run.smithi161.stdout:5102 writesame 0x3ddccd2 thru 0x3de45bd data_size 0x4(0x78ec bytes) 2024-09-21T15:10:04.191 INFO:teuthology.orchestra.run.smithi161.stdout:5248 write 0x56408eb thru 0x564e524 (0xdc3a bytes) 2024-09-21T15:10:04.193 INFO:teuthology.orchestra.run.smithi161.stdout:4709 writesame 0x898acbb thru 0x89961a1 data_size 0x2b(0xb4e7 bytes) 2024-09-21T15:10:04.219 INFO:teuthology.orchestra.run.smithi161.stdout:4712 read 0x88acc79 thru 0x88af44b (0x27d3 bytes) 2024-09-21T15:10:04.223 INFO:teuthology.orchestra.run.smithi161.stdout:5103 read 0x700f0b9 thru 0x701053e (0x1486 bytes) 2024-09-21T15:10:04.230 INFO:teuthology.orchestra.run.smithi161.stdout:4713 trunc from 0x89961a2 to 0x2a65992 2024-09-21T15:10:04.257 INFO:teuthology.orchestra.run.smithi161.stdout:5249 write 0x9a54605 thru 0x9a5885d (0x4259 bytes) 2024-09-21T15:10:04.267 INFO:teuthology.orchestra.run.smithi161.stdout:5250 writesame 0x9acfd2 thru 0x9ae5e3 data_size 0x19(0x1612 bytes) 2024-09-21T15:10:04.273 INFO:teuthology.orchestra.run.smithi161.stdout:5252 punch from 0x265e58c to 0x266beb0, (0xd924 bytes) 2024-09-21T15:10:04.273 INFO:teuthology.orchestra.run.smithi161.stdout:5253 read 0x12a3425 thru 0x12aa492 (0x706e bytes) 2024-09-21T15:10:04.274 INFO:teuthology.orchestra.run.smithi161.stdout:5254 punch from 0x5008af0 to 0x5014c78, (0xc188 bytes) 2024-09-21T15:10:04.274 INFO:teuthology.orchestra.run.smithi161.stdout:5255 write 0x63f57dc thru 0x63f7c9a (0x24bf bytes) 2024-09-21T15:10:04.282 INFO:teuthology.orchestra.run.smithi161.stdout:5256 write 0x2d17417 thru 0x2d19b3b (0x2725 bytes) 2024-09-21T15:10:04.288 INFO:teuthology.orchestra.run.smithi161.stdout:5257 write 0x7c6366 thru 0x7c7dea (0x1a85 bytes) 2024-09-21T15:10:04.295 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #33, image image_cluster1.client.mirror.2-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent34 2024-09-21T15:10:04.296 INFO:teuthology.orchestra.run.smithi161.stdout:5258 write 0x78fb9cb thru 0x790b122 (0xf758 bytes) 2024-09-21T15:10:04.304 INFO:teuthology.orchestra.run.smithi161.stdout:5104 punch from 0x486d336 to 0x4878fa4, (0xbc6e bytes) 2024-09-21T15:10:04.304 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.304 INFO:teuthology.orchestra.run.smithi161.stdout:5106 punch from 0x49be5c9 to 0x49cc297, (0xdcce bytes) 2024-09-21T15:10:04.304 INFO:teuthology.orchestra.run.smithi161.stdout:5107 read 0xcc09e9e thru 0xcc0b87f (0x19e2 bytes) 2024-09-21T15:10:04.304 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.304 INFO:teuthology.orchestra.run.smithi161.stdout:5109 writesame 0x78a376d thru 0x78a58ee data_size 0x1(0x2182 bytes) 2024-09-21T15:10:04.314 INFO:teuthology.orchestra.run.smithi161.stdout:3745 write 0xd528725 thru 0xd530a76 (0x8352 bytes) 2024-09-21T15:10:04.328 INFO:teuthology.orchestra.run.smithi161.stdout:5260 write 0x724cb2e thru 0x724ee86 (0x2359 bytes) 2024-09-21T15:10:04.342 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.342 INFO:teuthology.orchestra.run.smithi161.stdout:3748 punch from 0x5cb07e9 to 0x5cb64f7, (0x5d0e bytes) 2024-09-21T15:10:04.342 INFO:teuthology.orchestra.run.smithi161.stdout:3750 writesame 0x6ecd3ce thru 0x6ecd440 data_size 0x1(0x73 bytes) 2024-09-21T15:10:04.345 INFO:teuthology.orchestra.run.smithi161.stdout:5261 read 0x17b2099 thru 0x17bf9c3 (0xd92b bytes) 2024-09-21T15:10:04.368 INFO:teuthology.orchestra.run.smithi161.stdout:3751 read 0x20bbe18 thru 0x20c5f7a (0xa163 bytes) 2024-09-21T15:10:04.368 INFO:teuthology.orchestra.run.smithi161.stdout:3753 read 0x42a4ba0 thru 0x42b28d2 (0xdd33 bytes) 2024-09-21T15:10:04.369 INFO:teuthology.orchestra.run.smithi161.stdout:3755 read 0x9837186 thru 0x98445b1 (0xd42c bytes) 2024-09-21T15:10:04.397 INFO:teuthology.orchestra.run.smithi161.stdout:5170 write 0x8ca90b3 thru 0x8cad510 (0x445e bytes) 2024-09-21T15:10:04.398 INFO:teuthology.orchestra.run.smithi161.stdout:5262 write 0xed413fd thru 0xed5101c (0xfc20 bytes) 2024-09-21T15:10:04.436 INFO:teuthology.orchestra.run.smithi161.stdout:5264 trunc from 0xed5101d to 0xa9c367b 2024-09-21T15:10:04.445 INFO:teuthology.orchestra.run.smithi161.stdout:5110 read 0x7e90f5f thru 0x7e94e63 (0x3f05 bytes) 2024-09-21T15:10:04.445 INFO:teuthology.orchestra.run.smithi161.stdout:5113 punch from 0xaa7fe4b to 0xaa86b3b, (0x6cf0 bytes) 2024-09-21T15:10:04.445 INFO:teuthology.orchestra.run.smithi161.stdout:5114 read 0x5ebc4df thru 0x5ec2898 (0x63ba bytes) 2024-09-21T15:10:04.445 INFO:teuthology.orchestra.run.smithi161.stdout:5115 writesame 0x768de3 thru 0x774be2 data_size 0x80(0xbe00 bytes) 2024-09-21T15:10:04.456 INFO:teuthology.orchestra.run.smithi161.stdout:5171 punch from 0x51081df to 0x510a015, (0x1e36 bytes) 2024-09-21T15:10:04.456 INFO:teuthology.orchestra.run.smithi161.stdout:5172 writesame 0x2579d2e thru 0x2588db7 data_size 0x63(0xf08a bytes) 2024-09-21T15:10:04.474 INFO:teuthology.orchestra.run.smithi161.stdout:3756 writesame 0xdf8f549 thru 0xdf9267c data_size 0x4(0x3134 bytes) 2024-09-21T15:10:04.492 INFO:teuthology.orchestra.run.smithi161.stdout:3757 punch from 0x34fcba1 to 0x350396f, (0x6dce bytes) 2024-09-21T15:10:04.492 INFO:teuthology.orchestra.run.smithi161.stdout:3759 write 0xa69c48b thru 0xa6a3a7f (0x75f5 bytes) 2024-09-21T15:10:04.502 INFO:teuthology.orchestra.run.smithi161.stdout:5173 trunc from 0xc1b81b8 to 0xca55194 2024-09-21T15:10:04.506 INFO:teuthology.orchestra.run.smithi161.stdout:4714 read 0xb6f0dc thru 0xb70ccd (0x1bf2 bytes) 2024-09-21T15:10:04.506 INFO:teuthology.orchestra.run.smithi161.stdout:4716 read 0xcca72a thru 0xcd7dfb (0xd6d2 bytes) 2024-09-21T15:10:04.518 INFO:teuthology.orchestra.run.smithi161.stdout:3760 punch from 0x20341df to 0x203e1ab, (0x9fcc bytes) 2024-09-21T15:10:04.519 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.519 INFO:teuthology.orchestra.run.smithi161.stdout:3764 read 0xcbf1656 thru 0xcbfc90e (0xb2b9 bytes) 2024-09-21T15:10:04.519 INFO:teuthology.orchestra.run.smithi161.stdout:3767 read 0x1d0ea62 thru 0x1d12ff7 (0x4596 bytes) 2024-09-21T15:10:04.519 INFO:teuthology.orchestra.run.smithi161.stdout:3770 read 0x3c87c3e thru 0x3c94303 (0xc6c6 bytes) 2024-09-21T15:10:04.522 INFO:teuthology.orchestra.run.smithi161.stdout:5116 read 0x2105175 thru 0x21087ea (0x3676 bytes) 2024-09-21T15:10:04.525 INFO:teuthology.orchestra.run.smithi161.stdout:3776 read 0x128856d thru 0x1289e73 (0x1907 bytes) 2024-09-21T15:10:04.525 INFO:teuthology.orchestra.run.smithi161.stdout:3777 read 0x1168343 thru 0x1171504 (0x91c2 bytes) 2024-09-21T15:10:04.527 INFO:teuthology.orchestra.run.smithi161.stdout:3778 trunc from 0xdf9267d to 0xe97d437 2024-09-21T15:10:04.545 INFO:teuthology.orchestra.run.smithi161.stdout:5117 trunc from 0xecd5b40 to 0x17590d8 2024-09-21T15:10:04.548 INFO:teuthology.orchestra.run.smithi161.stdout:5174 punch from 0x674e7f9 to 0x6758bfa, (0xa401 bytes) 2024-09-21T15:10:04.548 INFO:teuthology.orchestra.run.smithi161.stdout:5175 read 0xc4da7bb thru 0xc4e55a7 (0xaded bytes) 2024-09-21T15:10:04.555 INFO:teuthology.orchestra.run.smithi161.stdout:5177 trunc from 0xca55194 to 0x94514ca 2024-09-21T15:10:04.657 INFO:teuthology.orchestra.run.smithi161.stdout:4717 write 0x8fc65d3 thru 0x8fd1af3 (0xb521 bytes) 2024-09-21T15:10:04.684 INFO:teuthology.orchestra.run.smithi161.stdout:3779 read 0xe8c6249 thru 0xe8d21ea (0xbfa2 bytes) 2024-09-21T15:10:04.684 INFO:teuthology.orchestra.run.smithi161.stdout:3780 read 0x1931d50 thru 0x193fdff (0xe0b0 bytes) 2024-09-21T15:10:04.686 INFO:teuthology.orchestra.run.smithi161.stdout:3781 write 0x8054d30 thru 0x805cf10 (0x81e1 bytes) 2024-09-21T15:10:04.707 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.707 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.707 INFO:teuthology.orchestra.run.smithi161.stdout:5181 writesame 0x62ab6ca thru 0x62ac659 data_size 0x18(0xf90 bytes) 2024-09-21T15:10:04.720 INFO:teuthology.orchestra.run.smithi161.stdout:4719 trunc from 0x8fd1af4 to 0x53cd75d 2024-09-21T15:10:04.734 INFO:teuthology.orchestra.run.smithi161.stdout:3782 trunc from 0xe97d437 to 0x3bc495b 2024-09-21T15:10:04.737 INFO:teuthology.orchestra.run.smithi161.stdout:5182 read 0x4ca944e thru 0x4cb6a31 (0xd5e4 bytes) 2024-09-21T15:10:04.743 INFO:teuthology.orchestra.run.smithi161.stdout:5118 clone 34 order 24 su 131072 sc 2 2024-09-21T15:10:04.749 INFO:teuthology.orchestra.run.smithi161.stdout:5183 trunc from 0x94514ca to 0x2fc7e9a 2024-09-21T15:10:04.797 INFO:teuthology.orchestra.run.smithi161.stdout:5265 write 0xbd998e3 thru 0xbda8237 (0xe955 bytes) 2024-09-21T15:10:04.802 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.802 INFO:teuthology.orchestra.run.smithi161.stdout:4721 read 0x18b8044 thru 0x18bf84f (0x780c bytes) 2024-09-21T15:10:04.802 INFO:teuthology.orchestra.run.smithi161.stdout:4723 read 0x1644175 thru 0x1648da8 (0x4c34 bytes) 2024-09-21T15:10:04.818 INFO:teuthology.orchestra.run.smithi161.stdout:4725 trunc from 0x53cd75d to 0xb8dc504 2024-09-21T15:10:04.851 INFO:teuthology.orchestra.run.smithi161.stdout:4727 writesame 0xe751fb thru 0xe76ad0 data_size 0x16(0x18d6 bytes) 2024-09-21T15:10:04.863 INFO:teuthology.orchestra.run.smithi161.stdout:3783 read 0x32ad136 thru 0x32b2a3e (0x5909 bytes) 2024-09-21T15:10:04.867 INFO:teuthology.orchestra.run.smithi161.stdout:4728 punch from 0x96eb506 to 0x96f78d7, (0xc3d1 bytes) 2024-09-21T15:10:04.867 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.867 INFO:teuthology.orchestra.run.smithi161.stdout:4730 write 0xe780ce thru 0xe81800 (0x9733 bytes) 2024-09-21T15:10:04.873 INFO:teuthology.orchestra.run.smithi161.stdout:5266 write 0xd3cbf62 thru 0xd3d3f1c (0x7fbb bytes) 2024-09-21T15:10:04.892 INFO:teuthology.orchestra.run.smithi161.stdout:4731 read 0x32e8c7 thru 0x33b7a8 (0xcee2 bytes) 2024-09-21T15:10:04.894 INFO:teuthology.orchestra.run.smithi161.stdout:5267 write 0x934bbcf thru 0x9353b7f (0x7fb1 bytes) 2024-09-21T15:10:04.894 INFO:teuthology.orchestra.run.smithi161.stdout:4732 read 0x8b458c9 thru 0x8b47631 (0x1d69 bytes) 2024-09-21T15:10:04.894 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.895 INFO:teuthology.orchestra.run.smithi161.stdout:4734 write 0xb5b419e thru 0xb5c3cb7 (0xfb1a bytes) 2024-09-21T15:10:04.913 INFO:teuthology.orchestra.run.smithi161.stdout:5268 write 0x41b0f57 thru 0x41b8c2c (0x7cd6 bytes) 2024-09-21T15:10:04.928 INFO:teuthology.orchestra.run.smithi161.stdout:5269 read 0xcbc7440 thru 0xcbd721c (0xfddd bytes) 2024-09-21T15:10:04.928 INFO:teuthology.orchestra.run.smithi161.stdout:4736 writesame 0x42b1de5 thru 0x42bfd2b data_size 0x57(0xdf47 bytes) 2024-09-21T15:10:04.929 INFO:teuthology.orchestra.run.smithi161.stdout:5270 read 0x66605e8 thru 0x66655a7 (0x4fc0 bytes) 2024-09-21T15:10:04.933 INFO:teuthology.orchestra.run.smithi161.stdout:5184 trunc from 0x2fc7e9a to 0xa82bc9d 2024-09-21T15:10:04.963 INFO:teuthology.orchestra.run.smithi161.stdout:3784 write 0x6500138 thru 0x650c150 (0xc019 bytes) 2024-09-21T15:10:04.970 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.970 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:04.985 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.002 INFO:teuthology.orchestra.run.smithi161.stdout:5272 writesame 0xc334a44 thru 0xc338802 data_size 0xb(0x3dbf bytes) 2024-09-21T15:10:05.012 INFO:teuthology.orchestra.run.smithi161.stdout:5186 write 0xa8f50a5 thru 0xa8fd7a0 (0x86fc bytes) 2024-09-21T15:10:05.014 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.003+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9c70 2024-09-21T15:10:05.014 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.003+0000 7ff753f07700 -1 reset not still connected to 0x56016a38c410 2024-09-21T15:10:05.016 INFO:teuthology.orchestra.run.smithi161.stdout:5273 writesame 0x2206046 thru 0x2211086 data_size 0x1(0xb041 bytes) 2024-09-21T15:10:05.018 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.007+0000 7ff753f07700 -1 reset not still connected to 0x56016a50a9c0 2024-09-21T15:10:05.018 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.007+0000 7ff753f07700 -1 reset not still connected to 0x56016a50b930 2024-09-21T15:10:05.018 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.007+0000 7ff753f07700 -1 reset not still connected to 0x56016a50ba00 2024-09-21T15:10:05.018 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.007+0000 7ff753f07700 -1 reset not still connected to 0x56016a5c6d00 2024-09-21T15:10:05.018 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.007+0000 7ff753f07700 -1 reset not still connected to 0x56016a5c7860 2024-09-21T15:10:05.018 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.007+0000 7ff753f07700 -1 reset not still connected to 0x56016a6df860 2024-09-21T15:10:05.019 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.007+0000 7ff753f07700 -1 reset not still connected to 0x56016a6dfa00 2024-09-21T15:10:05.019 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.007+0000 7ff753f07700 -1 reset not still connected to 0x56016a9c85b0 2024-09-21T15:10:05.019 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.007+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6340 2024-09-21T15:10:05.019 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.007+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e64e0 2024-09-21T15:10:05.019 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.007+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6a90 2024-09-21T15:10:05.023 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e72b0 2024-09-21T15:10:05.023 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72d00 2024-09-21T15:10:05.023 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72ea0 2024-09-21T15:10:05.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f450 2024-09-21T15:10:05.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016b24fee0 2024-09-21T15:10:05.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016b9cdd40 2024-09-21T15:10:05.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016bff6000 2024-09-21T15:10:05.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016bff7790 2024-09-21T15:10:05.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016c23a000 2024-09-21T15:10:05.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:10:05.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ee0 2024-09-21T15:10:05.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016d18f450 2024-09-21T15:10:05.026 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016dd771e0 2024-09-21T15:10:05.026 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56016feb4b60 2024-09-21T15:10:05.026 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:05.015+0000 7ff753f07700 -1 reset not still connected to 0x56017063fee0 2024-09-21T15:10:05.026 INFO:teuthology.orchestra.run.smithi161.stdout:4739 writesame 0xe9d9c36 thru 0xe9db322 data_size 0x1(0x16ed bytes) 2024-09-21T15:10:05.051 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.051 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.051 INFO:teuthology.orchestra.run.smithi161.stdout:5193 writesame 0x80e4897 thru 0x80e5396 data_size 0x10(0xb00 bytes) 2024-09-21T15:10:05.056 INFO:teuthology.orchestra.run.smithi161.stdout:4740 read 0x76e52d6 thru 0x76ef23e (0x9f69 bytes) 2024-09-21T15:10:05.056 INFO:teuthology.orchestra.run.smithi161.stdout:4741 writesame 0xb33a8c7 thru 0xb3496a4 data_size 0x99(0xedde bytes) 2024-09-21T15:10:05.066 INFO:teuthology.orchestra.run.smithi161.stdout:3786 trunc from 0x650c151 to 0x2c6984f 2024-09-21T15:10:05.087 INFO:teuthology.orchestra.run.smithi161.stdout:5274 trunc from 0xd3d3f1d to 0x490908c 2024-09-21T15:10:05.087 INFO:teuthology.orchestra.run.smithi161.stdout:4742 read 0x5c4b4c3 thru 0x5c4d8b8 (0x23f6 bytes) 2024-09-21T15:10:05.087 INFO:teuthology.orchestra.run.smithi161.stdout:4743 write 0xd29e2a8 thru 0xd29e8ee (0x647 bytes) 2024-09-21T15:10:05.107 INFO:teuthology.orchestra.run.smithi161.stdout:4744 writesame 0x4209ca0 thru 0x420ca49 data_size 0x23(0x2daa bytes) 2024-09-21T15:10:05.115 INFO:teuthology.orchestra.run.smithi161.stdout:4745 write 0xa353554 thru 0xa3603c3 (0xce70 bytes) 2024-09-21T15:10:05.144 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.144 INFO:teuthology.orchestra.run.smithi161.stdout:4747 write 0x931ba07 thru 0x931d3cd (0x19c7 bytes) 2024-09-21T15:10:05.174 INFO:teuthology.orchestra.run.smithi161.stdout:4748 trunc from 0xe9db323 to 0x746fe74 2024-09-21T15:10:05.180 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.180 INFO:teuthology.orchestra.run.smithi161.stdout:3788 punch from 0xebbd57 to 0xeca0ee, (0xe397 bytes) 2024-09-21T15:10:05.203 INFO:teuthology.orchestra.run.smithi161.stdout:3789 writesame 0x31b5ce0 thru 0x31b6643 data_size 0x2(0x964 bytes) 2024-09-21T15:10:05.215 INFO:teuthology.orchestra.run.smithi161.stdout:3790 punch from 0x1d96c6 to 0x1e2bf2, (0x952c bytes) 2024-09-21T15:10:05.215 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.215 INFO:teuthology.orchestra.run.smithi161.stdout:3793 read 0xc83022 thru 0xc84686 (0x1665 bytes) 2024-09-21T15:10:05.216 INFO:teuthology.orchestra.run.smithi161.stdout:3794 punch from 0x2793232 to 0x2795e0f, (0x2bdd bytes) 2024-09-21T15:10:05.217 INFO:teuthology.orchestra.run.smithi161.stdout:3795 write 0x223d969 thru 0x2246fa6 (0x963e bytes) 2024-09-21T15:10:05.228 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.236 INFO:teuthology.orchestra.run.smithi161.stdout:4749 read 0x4f77b31 thru 0x4f7a55a (0x2a2a bytes) 2024-09-21T15:10:05.236 INFO:teuthology.orchestra.run.smithi161.stdout:4750 read 0xa5c337 thru 0xa67249 (0xaf13 bytes) 2024-09-21T15:10:05.236 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.236 INFO:teuthology.orchestra.run.smithi161.stdout:4752 read 0x4a4d03 thru 0x4b0aa0 (0xbd9e bytes) 2024-09-21T15:10:05.240 INFO:teuthology.orchestra.run.smithi161.stdout:3799 trunc from 0x31b6644 to 0x7e0a6ad 2024-09-21T15:10:05.246 INFO:teuthology.orchestra.run.smithi161.stdout:4753 trunc from 0x746fe74 to 0xbfe5438 2024-09-21T15:10:05.257 INFO:teuthology.orchestra.run.smithi161.stdout:5194 write 0xc81fba2 thru 0xc829696 (0x9af5 bytes) 2024-09-21T15:10:05.271 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.271 INFO:teuthology.orchestra.run.smithi161.stdout:3801 write 0x158bd39 thru 0x159b58f (0xf857 bytes) 2024-09-21T15:10:05.276 INFO:teuthology.orchestra.run.smithi161.stdout:4755 read 0xb7ee9b9 thru 0xb7f0508 (0x1b50 bytes) 2024-09-21T15:10:05.276 INFO:teuthology.orchestra.run.smithi161.stdout:4757 punch from 0x54077a3 to 0x54172b3, (0xfb10 bytes) 2024-09-21T15:10:05.276 INFO:teuthology.orchestra.run.smithi161.stdout:4760 writesame 0x50144d1 thru 0x5014971 data_size 0x5(0x4a1 bytes) 2024-09-21T15:10:05.277 INFO:teuthology.orchestra.run.smithi161.stdout:5195 trunc from 0xc829697 to 0x95d3da5 2024-09-21T15:10:05.290 INFO:teuthology.orchestra.run.smithi161.stdout:4761 punch from 0x542bbf9 to 0x542d493, (0x189a bytes) 2024-09-21T15:10:05.290 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.291 INFO:teuthology.orchestra.run.smithi161.stdout:4764 read 0x5e984ed thru 0x5ea7080 (0xeb94 bytes) 2024-09-21T15:10:05.291 INFO:teuthology.orchestra.run.smithi161.stdout:4765 write 0x1c2f554 thru 0x1c3628e (0x6d3b bytes) 2024-09-21T15:10:05.318 INFO:teuthology.orchestra.run.smithi161.stdout:4768 writesame 0x135d4a thru 0x140d85 data_size 0x2(0xb03c bytes) 2024-09-21T15:10:05.335 INFO:teuthology.orchestra.run.smithi161.stdout:3802 writesame 0xa18114c thru 0xa18f5f0 data_size 0x3(0xe4a5 bytes) 2024-09-21T15:10:05.345 INFO:teuthology.orchestra.run.smithi161.stdout:4769 writesame 0xab3e90a thru 0xab458ab data_size 0x21(0x6fa2 bytes) 2024-09-21T15:10:05.375 INFO:teuthology.orchestra.run.smithi161.stdout:4770 trunc from 0xbfe5438 to 0x52e30f0 2024-09-21T15:10:05.378 INFO:teuthology.orchestra.run.smithi161.stdout:3803 write 0xd0af1fd thru 0xd0b03a3 (0x11a7 bytes) 2024-09-21T15:10:05.388 INFO:teuthology.orchestra.run.smithi161.stdout:3804 write 0x8293cdf thru 0x829f3b8 (0xb6da bytes) 2024-09-21T15:10:05.405 INFO:teuthology.orchestra.run.smithi161.stdout:3805 trunc from 0xd0b03a4 to 0xc2dfb2c 2024-09-21T15:10:05.407 INFO:teuthology.orchestra.run.smithi161.stdout:5197 read 0x80a68a0 thru 0x80aa320 (0x3a81 bytes) 2024-09-21T15:10:05.407 INFO:teuthology.orchestra.run.smithi161.stdout:5198 read 0x790726b thru 0x7916771 (0xf507 bytes) 2024-09-21T15:10:05.407 INFO:teuthology.orchestra.run.smithi161.stdout:5199 write 0x64e0da9 thru 0x64e2daf (0x2007 bytes) 2024-09-21T15:10:05.430 INFO:teuthology.orchestra.run.smithi161.stdout:5200 read 0x1477466 thru 0x147f195 (0x7d30 bytes) 2024-09-21T15:10:05.443 INFO:teuthology.orchestra.run.smithi161.stdout:4773 read 0x21cf6f5 thru 0x21d6970 (0x727c bytes) 2024-09-21T15:10:05.446 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.449 INFO:teuthology.orchestra.run.smithi161.stdout:4774 trunc from 0x52e30f0 to 0x77bc197 2024-09-21T15:10:05.465 INFO:teuthology.orchestra.run.smithi161.stdout:5275 write 0x285bcae thru 0x286410f (0x8462 bytes) 2024-09-21T15:10:05.485 INFO:teuthology.orchestra.run.smithi161.stdout:5276 punch from 0x2650a7b to 0x265304c, (0x25d1 bytes) 2024-09-21T15:10:05.488 INFO:teuthology.orchestra.run.smithi161.stdout:3806 read 0x5166cd6 thru 0x516c58b (0x58b6 bytes) 2024-09-21T15:10:05.488 INFO:teuthology.orchestra.run.smithi161.stdout:3808 writesame 0x9a0353f thru 0x9a10e2e data_size 0x1a(0xd8f0 bytes) 2024-09-21T15:10:05.499 INFO:teuthology.orchestra.run.smithi161.stdout:4775 read 0x4b243c8 thru 0x4b2c2bc (0x7ef5 bytes) 2024-09-21T15:10:05.500 INFO:teuthology.orchestra.run.smithi161.stdout:3809 read 0xbf85602 thru 0xbf8ccb4 (0x76b3 bytes) 2024-09-21T15:10:05.501 INFO:teuthology.orchestra.run.smithi161.stdout:3811 write 0x31eac55 thru 0x31f5468 (0xa814 bytes) 2024-09-21T15:10:05.505 INFO:teuthology.orchestra.run.smithi161.stdout:5202 writesame 0xb1fc446 thru 0xb20b38b data_size 0xa6(0xef46 bytes) 2024-09-21T15:10:05.517 INFO:teuthology.orchestra.run.smithi161.stdout:3812 writesame 0x9405d76 thru 0x940fb54 data_size 0x3b(0x9ddf bytes) 2024-09-21T15:10:05.536 INFO:teuthology.orchestra.run.smithi161.stdout:3813 read 0x35c273 thru 0x36bda8 (0xfb36 bytes) 2024-09-21T15:10:05.539 INFO:teuthology.orchestra.run.smithi161.stdout:3814 trunc from 0xc2dfb2c to 0xcc48ebd 2024-09-21T15:10:05.555 INFO:teuthology.orchestra.run.smithi161.stdout:4776 writesame 0xe340153 thru 0xe34f6bf data_size 0x27(0xf56d bytes) 2024-09-21T15:10:05.570 INFO:teuthology.orchestra.run.smithi161.stdout:5203 writesame 0xd8b106f thru 0xd8b9775 data_size 0x1(0x8707 bytes) 2024-09-21T15:10:05.570 INFO:teuthology.orchestra.run.smithi161.stdout:4777 read 0xa6cb869 thru 0xa6cd821 (0x1fb9 bytes) 2024-09-21T15:10:05.570 INFO:teuthology.orchestra.run.smithi161.stdout:4780 write 0x57665f5 thru 0x5772fed (0xc9f9 bytes) 2024-09-21T15:10:05.579 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.582 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.586 INFO:teuthology.orchestra.run.smithi161.stdout:3816 trunc from 0xcc48ebd to 0x97bdabe 2024-09-21T15:10:05.597 INFO:teuthology.orchestra.run.smithi161.stdout:4783 trunc from 0xe34f6c0 to 0x63513c3 2024-09-21T15:10:05.636 INFO:teuthology.orchestra.run.smithi161.stdout:5277 writesame 0x85d02fe thru 0x85d75f1 data_size 0xe(0x72f4 bytes) 2024-09-21T15:10:05.651 INFO:teuthology.orchestra.run.smithi161.stdout:5278 read 0x7f818a thru 0x7f9e5c (0x1cd3 bytes) 2024-09-21T15:10:05.653 INFO:teuthology.orchestra.run.smithi161.stdout:5279 read 0x7927ddc thru 0x79316e7 (0x990c bytes) 2024-09-21T15:10:05.654 INFO:teuthology.orchestra.run.smithi161.stdout:5280 write 0x2980c61 thru 0x298600d (0x53ad bytes) 2024-09-21T15:10:05.658 INFO:teuthology.orchestra.run.smithi161.stdout:5205 writesame 0xde49bc0 thru 0xde4c597 data_size 0x1a(0x29d8 bytes) 2024-09-21T15:10:05.661 INFO:teuthology.orchestra.run.smithi161.stdout:5206 read 0xd00883b thru 0xd013edb (0xb6a1 bytes) 2024-09-21T15:10:05.661 INFO:teuthology.orchestra.run.smithi161.stdout:5207 read 0x978da43 thru 0x979180b (0x3dc9 bytes) 2024-09-21T15:10:05.663 INFO:teuthology.orchestra.run.smithi161.stdout:3817 trunc from 0x97bdabe to 0x2621718 2024-09-21T15:10:05.665 INFO:teuthology.orchestra.run.smithi161.stdout:5209 trunc from 0xde4c598 to 0xc44c439 2024-09-21T15:10:05.702 INFO:teuthology.orchestra.run.smithi161.stdout:4784 write 0x6630829 thru 0x663a019 (0x97f1 bytes) 2024-09-21T15:10:05.714 INFO:teuthology.orchestra.run.smithi161.stdout:5281 read 0x6fc1f43 thru 0x6fcaa9a (0x8b58 bytes) 2024-09-21T15:10:05.724 INFO:teuthology.orchestra.run.smithi161.stdout:4785 read 0x4cdefa3 thru 0x4ce3ec5 (0x4f23 bytes) 2024-09-21T15:10:05.724 INFO:teuthology.orchestra.run.smithi161.stdout:4786 writesame 0x4ed04bf thru 0x4ede05b data_size 0x13(0xdb9d bytes) 2024-09-21T15:10:05.728 INFO:teuthology.orchestra.run.smithi161.stdout:5210 punch from 0xa4e8c89 to 0xa4f29fc, (0x9d73 bytes) 2024-09-21T15:10:05.728 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.731 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.732 INFO:teuthology.orchestra.run.smithi161.stdout:3819 read 0x1c8935b thru 0x1c911fa (0x7ea0 bytes) 2024-09-21T15:10:05.732 INFO:teuthology.orchestra.run.smithi161.stdout:3821 read 0x1c98281 thru 0x1ca216e (0x9eee bytes) 2024-09-21T15:10:05.765 INFO:teuthology.orchestra.run.smithi161.stdout:5284 write 0x91b4604 thru 0x91bcaff (0x84fc bytes) 2024-09-21T15:10:05.786 INFO:teuthology.orchestra.run.smithi161.stdout:5285 punch from 0x1e67079 to 0x1e699e0, (0x2967 bytes) 2024-09-21T15:10:05.786 INFO:teuthology.orchestra.run.smithi161.stdout:5286 writesame 0x929dd thru 0x94c66 data_size 0x1(0x228a bytes) 2024-09-21T15:10:05.790 INFO:teuthology.orchestra.run.smithi161.stdout:5212 write 0xc78adfa thru 0xc7941cb (0x93d2 bytes) 2024-09-21T15:10:05.799 INFO:teuthology.orchestra.run.smithi161.stdout:4787 write 0xcb5826d thru 0xcb66410 (0xe1a4 bytes) 2024-09-21T15:10:05.812 INFO:teuthology.orchestra.run.smithi161.stdout:3822 writesame 0xe559c46 thru 0xe559ed4 data_size 0x1(0x28f bytes) 2024-09-21T15:10:05.820 INFO:teuthology.orchestra.run.smithi161.stdout:4788 writesame 0x8d422ea thru 0x8d4424e data_size 0x2f(0x1f65 bytes) 2024-09-21T15:10:05.820 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.820 INFO:teuthology.orchestra.run.smithi161.stdout:5214 write 0x1109975 thru 0x110efb3 (0x563f bytes) 2024-09-21T15:10:05.853 INFO:teuthology.orchestra.run.smithi161.stdout:5287 writesame 0xb85917b thru 0xb867bef data_size 0xab(0xea75 bytes) 2024-09-21T15:10:05.859 INFO:teuthology.orchestra.run.smithi161.stdout:4789 trunc from 0xcb66411 to 0x1710bd5 2024-09-21T15:10:05.862 INFO:teuthology.orchestra.run.smithi161.stdout:5288 write 0xb5998e2 thru 0xb59e89f (0x4fbe bytes) 2024-09-21T15:10:05.869 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.5-clone33 2024-09-21T15:10:05.874 INFO:teuthology.orchestra.run.smithi161.stdout:5289 write 0x4f89973 thru 0x4f8c084 (0x2712 bytes) 2024-09-21T15:10:05.888 INFO:teuthology.orchestra.run.smithi161.stdout:3823 write 0xee3596e thru 0xee45496 (0xfb29 bytes) 2024-09-21T15:10:05.889 INFO:teuthology.orchestra.run.smithi161.stdout:5290 write 0x641280f thru 0x641d721 (0xaf13 bytes) 2024-09-21T15:10:05.924 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.924 INFO:teuthology.orchestra.run.smithi161.stdout:5295 punch from 0x4afe0e9 to 0x4b0d6d2, (0xf5e9 bytes) 2024-09-21T15:10:05.926 INFO:teuthology.orchestra.run.smithi161.stdout:5215 write 0x36d0555 thru 0x36df44f (0xeefb bytes) 2024-09-21T15:10:05.929 INFO:teuthology.orchestra.run.smithi161.stdout:3824 read 0x765c2d1 thru 0x765e89a (0x25ca bytes) 2024-09-21T15:10:05.929 INFO:teuthology.orchestra.run.smithi161.stdout:3825 write 0xa5e6495 thru 0xa5f5354 (0xeec0 bytes) 2024-09-21T15:10:05.932 INFO:teuthology.orchestra.run.smithi161.stdout:5296 trunc from 0xb867bf0 to 0x6fabae2 2024-09-21T15:10:05.983 INFO:teuthology.orchestra.run.smithi161.stdout:3827 read 0xd952f4f thru 0xd958725 (0x57d7 bytes) 2024-09-21T15:10:05.983 INFO:teuthology.orchestra.run.smithi161.stdout:3828 read 0x88a3ca3 thru 0x88a7901 (0x3c5f bytes) 2024-09-21T15:10:05.983 INFO:teuthology.orchestra.run.smithi161.stdout:3829 punch from 0x44e0dde to 0x44e1bc2, (0xde4 bytes) 2024-09-21T15:10:05.984 INFO:teuthology.orchestra.run.smithi161.stdout:3831 read 0x50b26d4 thru 0x50b32ac (0xbd9 bytes) 2024-09-21T15:10:05.989 INFO:teuthology.orchestra.run.smithi161.stdout:5217 read 0x5be283a thru 0x5be88fc (0x60c3 bytes) 2024-09-21T15:10:05.989 INFO:teuthology.orchestra.run.smithi161.stdout:5218 read 0x6557aeb thru 0x655ed7c (0x7292 bytes) 2024-09-21T15:10:05.990 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:05.990 INFO:teuthology.orchestra.run.smithi161.stdout:5220 write 0x771224a thru 0x771b27f (0x9036 bytes) 2024-09-21T15:10:06.003 INFO:teuthology.orchestra.run.smithi161.stdout:3833 trunc from 0xee45497 to 0x5f5862b 2024-09-21T15:10:06.004 INFO:teuthology.orchestra.run.smithi161.stdout:5221 punch from 0x92404e3 to 0x9244bd0, (0x46ed bytes) 2024-09-21T15:10:06.004 INFO:teuthology.orchestra.run.smithi161.stdout:5222 read 0xaec659 thru 0xaf79db (0xb383 bytes) 2024-09-21T15:10:06.032 INFO:teuthology.orchestra.run.smithi161.stdout:5223 trunc from 0xc7941cc to 0x5f27bdd 2024-09-21T15:10:06.036 INFO:teuthology.orchestra.run.smithi161.stdout:5297 writesame 0x17f2973 thru 0x17fb9d4 data_size 0x1(0x9062 bytes) 2024-09-21T15:10:06.057 INFO:teuthology.orchestra.run.smithi161.stdout:3836 punch from 0x3c586ad to 0x3c5bf9c, (0x38ef bytes) 2024-09-21T15:10:06.061 INFO:teuthology.orchestra.run.smithi161.stdout:3837 trunc from 0x5f5862b to 0x3d224df 2024-09-21T15:10:06.075 INFO:teuthology.orchestra.run.smithi161.stdout:5299 read 0x577eb93 thru 0x578ba9e (0xcf0c bytes) 2024-09-21T15:10:06.076 INFO:teuthology.orchestra.run.smithi161.stdout:5300 read 0xae6d2b thru 0xaed16a (0x6440 bytes) 2024-09-21T15:10:06.077 INFO:teuthology.orchestra.run.smithi161.stdout:5301 write 0x64664cb thru 0x646c8e5 (0x641b bytes) 2024-09-21T15:10:06.091 INFO:teuthology.orchestra.run.smithi161.stdout:4790 writesame 0x93994e2 thru 0x93a484c data_size 0x1(0xb36b bytes) 2024-09-21T15:10:06.094 INFO:teuthology.orchestra.run.smithi161.stdout:5302 trunc from 0x6fabae2 to 0x1ec42dd 2024-09-21T15:10:06.097 INFO:teuthology.orchestra.run.smithi161.stdout:5226 write 0x144a0bc thru 0x144d922 (0x3867 bytes) 2024-09-21T15:10:06.104 INFO:teuthology.orchestra.run.smithi161.stdout:3838 trunc from 0x3d224df to 0x696a9d9 2024-09-21T15:10:06.105 INFO:teuthology.orchestra.run.smithi161.stdout:4791 trunc from 0x93a484d to 0x59cba2f 2024-09-21T15:10:06.129 INFO:teuthology.orchestra.run.smithi161.stdout:5227 write 0x1145fb thru 0x11881a (0x4220 bytes) 2024-09-21T15:10:06.136 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #32, image image_cluster1.client.mirror.5-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent33 2024-09-21T15:10:06.136 INFO:teuthology.orchestra.run.smithi161.stdout:3841 read 0x5882179 thru 0x588de94 (0xbd1c bytes) 2024-09-21T15:10:06.137 INFO:teuthology.orchestra.run.smithi161.stdout:3842 read 0xc0792e thru 0xc11d35 (0xa408 bytes) 2024-09-21T15:10:06.139 INFO:teuthology.orchestra.run.smithi161.stdout:3843 trunc from 0x696a9d9 to 0x5aa014b 2024-09-21T15:10:06.164 INFO:teuthology.orchestra.run.smithi161.stdout:5230 read 0x322e75f thru 0x3232037 (0x38d9 bytes) 2024-09-21T15:10:06.164 INFO:teuthology.orchestra.run.smithi161.stdout:5231 punch from 0x17035a7 to 0x1712e1f, (0xf878 bytes) 2024-09-21T15:10:06.181 INFO:teuthology.orchestra.run.smithi161.stdout:4792 writesame 0x60647d7 thru 0x606bf07 data_size 0x7(0x7731 bytes) 2024-09-21T15:10:06.185 INFO:teuthology.orchestra.run.smithi161.stdout:5232 trunc from 0x5f27bdd to 0xebd274f 2024-09-21T15:10:06.205 INFO:teuthology.orchestra.run.smithi161.stdout:5303 write 0x60bae1d thru 0x60c7e08 (0xcfec bytes) 2024-09-21T15:10:06.224 INFO:teuthology.orchestra.run.smithi161.stdout:5305 writesame 0x5d0546e thru 0x5d0b3ee data_size 0x1(0x5f81 bytes) 2024-09-21T15:10:06.230 INFO:teuthology.orchestra.run.smithi161.stdout:3844 writesame 0xccfa692 thru 0xccfb6c8 data_size 0x1(0x1037 bytes) 2024-09-21T15:10:06.235 INFO:teuthology.orchestra.run.smithi161.stdout:3845 read 0x794a4db thru 0x794af8f (0xab5 bytes) 2024-09-21T15:10:06.235 INFO:teuthology.orchestra.run.smithi161.stdout:3846 write 0xb356d06 thru 0xb35c4a9 (0x57a4 bytes) 2024-09-21T15:10:06.238 INFO:teuthology.orchestra.run.smithi161.stdout:4793 writesame 0x829ba0c thru 0x82a3e08 data_size 0x7(0x83fd bytes) 2024-09-21T15:10:06.243 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.243 INFO:teuthology.orchestra.run.smithi161.stdout:4796 punch from 0x74ac107 to 0x74af306, (0x31ff bytes) 2024-09-21T15:10:06.243 INFO:teuthology.orchestra.run.smithi161.stdout:4798 writesame 0x773198d thru 0x773c8a8 data_size 0xe(0xaf1c bytes) 2024-09-21T15:10:06.250 INFO:teuthology.orchestra.run.smithi161.stdout:5308 read 0x36e732c thru 0x36edad3 (0x67a8 bytes) 2024-09-21T15:10:06.251 INFO:teuthology.orchestra.run.smithi161.stdout:5310 read 0x4cb7380 thru 0x4cba1c7 (0x2e48 bytes) 2024-09-21T15:10:06.251 INFO:teuthology.orchestra.run.smithi161.stdout:5311 read 0x2f21976 thru 0x2f26519 (0x4ba4 bytes) 2024-09-21T15:10:06.253 INFO:teuthology.orchestra.run.smithi161.stdout:5233 trunc from 0xebd274f to 0x2535103 2024-09-21T15:10:06.255 INFO:teuthology.orchestra.run.smithi161.stdout:3847 read 0x709ba73 thru 0x709e815 (0x2da3 bytes) 2024-09-21T15:10:06.256 INFO:teuthology.orchestra.run.smithi161.stdout:3848 write 0x823509c thru 0x823da9b (0x8a00 bytes) 2024-09-21T15:10:06.267 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.267 INFO:teuthology.orchestra.run.smithi161.stdout:4800 write 0x5de1a9d thru 0x5de3e16 (0x237a bytes) 2024-09-21T15:10:06.275 INFO:teuthology.orchestra.run.smithi161.stdout:3849 trunc from 0xccfb6c9 to 0xb2ec505 2024-09-21T15:10:06.285 INFO:teuthology.orchestra.run.smithi161.stdout:4801 writesame 0x5fb734f thru 0x5fc4f87 data_size 0x1(0xdc39 bytes) 2024-09-21T15:10:06.296 INFO:teuthology.orchestra.run.smithi161.stdout:5312 write 0x81b6afc thru 0x81bbeb0 (0x53b5 bytes) 2024-09-21T15:10:06.302 INFO:teuthology.orchestra.run.smithi161.stdout:5234 read 0x1f8e4c9 thru 0x1f9b911 (0xd449 bytes) 2024-09-21T15:10:06.303 INFO:teuthology.orchestra.run.smithi161.stdout:5235 write 0x1999cd thru 0x19ef7a (0x55ae bytes) 2024-09-21T15:10:06.341 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.346 INFO:teuthology.orchestra.run.smithi161.stdout:5313 punch from 0x367c243 to 0x36852c0, (0x907d bytes) 2024-09-21T15:10:06.346 INFO:teuthology.orchestra.run.smithi161.stdout:5316 write 0x71264d0 thru 0x712bd60 (0x5891 bytes) 2024-09-21T15:10:06.353 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.353 INFO:teuthology.orchestra.run.smithi161.stdout:3851 write 0x1b0ad86 thru 0x1b171ae (0xc429 bytes) 2024-09-21T15:10:06.353 INFO:teuthology.orchestra.run.smithi161.stdout:5317 write 0x550e857 thru 0x5515ccd (0x7477 bytes) 2024-09-21T15:10:06.354 INFO:teuthology.orchestra.run.smithi161.stdout:5236 trunc from 0x2535103 to 0x801e718 2024-09-21T15:10:06.371 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.371 INFO:teuthology.orchestra.run.smithi161.stdout:5319 write 0x745769d thru 0x7457d04 (0x668 bytes) 2024-09-21T15:10:06.382 INFO:teuthology.orchestra.run.smithi161.stdout:3853 read 0x27327c4 thru 0x2738ee6 (0x6723 bytes) 2024-09-21T15:10:06.383 INFO:teuthology.orchestra.run.smithi161.stdout:3854 write 0x211102e thru 0x211feb3 (0xee86 bytes) 2024-09-21T15:10:06.398 INFO:teuthology.orchestra.run.smithi161.stdout:3855 read 0x833f062 thru 0x8346da4 (0x7d43 bytes) 2024-09-21T15:10:06.398 INFO:teuthology.orchestra.run.smithi161.stdout:3857 writesame 0x10761e5 thru 0x1083735 data_size 0x3(0xd551 bytes) 2024-09-21T15:10:06.398 INFO:teuthology.orchestra.run.smithi161.stdout:4803 write 0xd88b50f thru 0xd89a8c6 (0xf3b8 bytes) 2024-09-21T15:10:06.405 INFO:teuthology.orchestra.run.smithi161.stdout:5237 punch from 0x20b6b6a to 0x20b6ba2, (0x38 bytes) 2024-09-21T15:10:06.405 INFO:teuthology.orchestra.run.smithi161.stdout:5239 read 0xcb4d5e thru 0xcb8453 (0x36f6 bytes) 2024-09-21T15:10:06.411 INFO:teuthology.orchestra.run.smithi161.stdout:4805 read 0x22b49ef thru 0x22bf797 (0xada9 bytes) 2024-09-21T15:10:06.411 INFO:teuthology.orchestra.run.smithi161.stdout:4806 writesame 0x3ff9824 thru 0x4003edb data_size 0x37(0xa6b8 bytes) 2024-09-21T15:10:06.418 INFO:teuthology.orchestra.run.smithi161.stdout:5240 trunc from 0x801e718 to 0xeb2bd00 2024-09-21T15:10:06.426 INFO:teuthology.orchestra.run.smithi161.stdout:3860 read 0x42688f0 thru 0x426aaa1 (0x21b2 bytes) 2024-09-21T15:10:06.426 INFO:teuthology.orchestra.run.smithi161.stdout:3861 punch from 0x23118a2 to 0x231403b, (0x2799 bytes) 2024-09-21T15:10:06.426 INFO:teuthology.orchestra.run.smithi161.stdout:3862 write 0x5e6d2da thru 0x5e7bbcd (0xe8f4 bytes) 2024-09-21T15:10:06.433 INFO:teuthology.orchestra.run.smithi161.stdout:4807 read 0xbd2e1df thru 0xbd3d775 (0xf597 bytes) 2024-09-21T15:10:06.434 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.434 INFO:teuthology.orchestra.run.smithi161.stdout:4810 read 0xaab02e1 thru 0xaab1727 (0x1447 bytes) 2024-09-21T15:10:06.434 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.434 INFO:teuthology.orchestra.run.smithi161.stdout:4812 read 0xb5c5072 thru 0xb5d375d (0xe6ec bytes) 2024-09-21T15:10:06.434 INFO:teuthology.orchestra.run.smithi161.stdout:4816 punch from 0x72b55e4 to 0x72c35a3, (0xdfbf bytes) 2024-09-21T15:10:06.434 INFO:teuthology.orchestra.run.smithi161.stdout:4818 writesame 0xaaf6c2c thru 0xaafcd26 data_size 0x25(0x60fb bytes) 2024-09-21T15:10:06.434 INFO:teuthology.orchestra.run.smithi161.stdout:5320 write 0x9b5ceae thru 0x9b68ab2 (0xbc05 bytes) 2024-09-21T15:10:06.447 INFO:teuthology.orchestra.run.smithi161.stdout:5321 write 0x20f5f97 thru 0x210028c (0xa2f6 bytes) 2024-09-21T15:10:06.454 INFO:teuthology.orchestra.run.smithi161.stdout:4819 writesame 0x43ad161 thru 0x43bc049 data_size 0x57(0xeee9 bytes) 2024-09-21T15:10:06.459 INFO:teuthology.orchestra.run.smithi161.stdout:5243 punch from 0xf88d82 to 0xf8f138, (0x63b6 bytes) 2024-09-21T15:10:06.459 INFO:teuthology.orchestra.run.smithi161.stdout:5245 punch from 0x18a991a to 0x18adc47, (0x432d bytes) 2024-09-21T15:10:06.459 INFO:teuthology.orchestra.run.smithi161.stdout:5246 write 0x57cb8ee thru 0x57d33d3 (0x7ae6 bytes) 2024-09-21T15:10:06.467 INFO:teuthology.orchestra.run.smithi161.stdout:5119 writesame 0x4437710 thru 0x443de81 data_size 0x1(0x6772 bytes) 2024-09-21T15:10:06.472 INFO:teuthology.orchestra.run.smithi161.stdout:4820 write 0x509d1af thru 0x50a7e90 (0xace2 bytes) 2024-09-21T15:10:06.474 INFO:teuthology.orchestra.run.smithi161.stdout:5120 read 0x4213f2d thru 0x421d925 (0x99f9 bytes) 2024-09-21T15:10:06.474 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.474 INFO:teuthology.orchestra.run.smithi161.stdout:5123 read 0x1b26fcd thru 0x1b36520 (0xf554 bytes) 2024-09-21T15:10:06.479 INFO:teuthology.orchestra.run.smithi161.stdout:3863 write 0xc582405 thru 0xc58f8fc (0xd4f8 bytes) 2024-09-21T15:10:06.479 INFO:teuthology.orchestra.run.smithi161.stdout:5247 read 0x999ba92 thru 0x999fbc9 (0x4138 bytes) 2024-09-21T15:10:06.480 INFO:teuthology.orchestra.run.smithi161.stdout:5248 writesame 0xb12ca9a thru 0xb1319ba data_size 0x1(0x4f21 bytes) 2024-09-21T15:10:06.509 INFO:teuthology.orchestra.run.smithi161.stdout:4822 write 0x1844143 thru 0x184c51f (0x83dd bytes) 2024-09-21T15:10:06.527 INFO:teuthology.orchestra.run.smithi161.stdout:3864 read 0x6df4524 thru 0x6df4530 (0xd bytes) 2024-09-21T15:10:06.527 INFO:teuthology.orchestra.run.smithi161.stdout:3865 writesame 0xa6d8868 thru 0xa6e86df data_size 0x44(0xfe78 bytes) 2024-09-21T15:10:06.529 INFO:teuthology.orchestra.run.smithi161.stdout:5249 write 0xd3df91b thru 0xd3e1bbc (0x22a2 bytes) 2024-09-21T15:10:06.532 INFO:teuthology.orchestra.run.smithi161.stdout:5124 write 0x55dd111 thru 0x55e1bef (0x4adf bytes) 2024-09-21T15:10:06.534 INFO:teuthology.orchestra.run.smithi161.stdout:5322 write 0xaedeb5f thru 0xaeec8ac (0xdd4e bytes) 2024-09-21T15:10:06.540 INFO:teuthology.orchestra.run.smithi161.stdout:4823 write 0x5938b2e thru 0x5939a33 (0xf06 bytes) 2024-09-21T15:10:06.555 INFO:teuthology.orchestra.run.smithi161.stdout:3867 read 0xa517139 thru 0xa5243ad (0xd275 bytes) 2024-09-21T15:10:06.555 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.555 INFO:teuthology.orchestra.run.smithi161.stdout:3870 read 0x4e1d058 thru 0x4e275bd (0xa566 bytes) 2024-09-21T15:10:06.555 INFO:teuthology.orchestra.run.smithi161.stdout:3871 read 0x248902e thru 0x248ba61 (0x2a34 bytes) 2024-09-21T15:10:06.557 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.557 INFO:teuthology.orchestra.run.smithi161.stdout:5324 read 0x90b7df7 thru 0x90bad47 (0x2f51 bytes) 2024-09-21T15:10:06.557 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.557 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.563 INFO:teuthology.orchestra.run.smithi161.stdout:3872 trunc from 0xc58f8fd to 0x90edff5 2024-09-21T15:10:06.565 INFO:teuthology.orchestra.run.smithi161.stdout:5125 punch from 0x43b549e to 0x43bbf57, (0x6ab9 bytes) 2024-09-21T15:10:06.565 INFO:teuthology.orchestra.run.smithi161.stdout:4824 read 0x29c503c thru 0x29c60e8 (0x10ad bytes) 2024-09-21T15:10:06.566 INFO:teuthology.orchestra.run.smithi161.stdout:5126 read 0x1ae5968 thru 0x1af1d76 (0xc40f bytes) 2024-09-21T15:10:06.566 INFO:teuthology.orchestra.run.smithi161.stdout:5128 read 0x26a2abf thru 0x26a7572 (0x4ab4 bytes) 2024-09-21T15:10:06.566 INFO:teuthology.orchestra.run.smithi161.stdout:5129 read 0x98e4fa thru 0x9974ca (0x8fd1 bytes) 2024-09-21T15:10:06.567 INFO:teuthology.orchestra.run.smithi161.stdout:5325 trunc from 0xaeec8ad to 0xe18f0fc 2024-09-21T15:10:06.567 INFO:teuthology.orchestra.run.smithi161.stdout:5131 punch from 0x548ce6b to 0x548d2b6, (0x44b bytes) 2024-09-21T15:10:06.568 INFO:teuthology.orchestra.run.smithi161.stdout:5132 read 0x48706ef thru 0x4871b9a (0x14ac bytes) 2024-09-21T15:10:06.568 INFO:teuthology.orchestra.run.smithi161.stdout:5133 write 0x4f503d2 thru 0x4f5dd6e (0xd99d bytes) 2024-09-21T15:10:06.571 INFO:teuthology.orchestra.run.smithi161.stdout:4826 trunc from 0xd89a8c7 to 0xc39c8ea 2024-09-21T15:10:06.577 INFO:teuthology.orchestra.run.smithi161.stdout:5255 trunc from 0xeb2bd00 to 0x46af750 2024-09-21T15:10:06.586 INFO:teuthology.orchestra.run.smithi161.stdout:5134 punch from 0x4a76ba1 to 0x4a81f7f, (0xb3de bytes) 2024-09-21T15:10:06.586 INFO:teuthology.orchestra.run.smithi161.stdout:5135 write 0x3d3bcab thru 0x3d40ebd (0x5213 bytes) 2024-09-21T15:10:06.606 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.612 INFO:teuthology.orchestra.run.smithi161.stdout:5326 writesame 0x2576897 thru 0x2576ed1 data_size 0x5(0x63b bytes) 2024-09-21T15:10:06.633 INFO:teuthology.orchestra.run.smithi161.stdout:5328 trunc from 0xe18f0fc to 0x937356c 2024-09-21T15:10:06.634 INFO:teuthology.orchestra.run.smithi161.stdout:5256 punch from 0x2669c1e to 0x26736ae, (0x9a90 bytes) 2024-09-21T15:10:06.634 INFO:teuthology.orchestra.run.smithi161.stdout:4828 write 0x936f074 thru 0x9375ee9 (0x6e76 bytes) 2024-09-21T15:10:06.637 INFO:teuthology.orchestra.run.smithi161.stdout:3873 trunc from 0x90edff5 to 0x7000b0d 2024-09-21T15:10:06.643 INFO:teuthology.orchestra.run.smithi161.stdout:5137 write 0x7e62e64 thru 0x7e632f5 (0x492 bytes) 2024-09-21T15:10:06.666 INFO:teuthology.orchestra.run.smithi161.stdout:5139 write 0x63f25bf thru 0x63fc8f0 (0xa332 bytes) 2024-09-21T15:10:06.682 INFO:teuthology.orchestra.run.smithi161.stdout:5141 write 0x5b98bcf thru 0x5ba71bc (0xe5ee bytes) 2024-09-21T15:10:06.692 INFO:teuthology.orchestra.run.smithi161.stdout:5257 writesame 0xdb5794e thru 0xdb5eff1 data_size 0x6(0x76a4 bytes) 2024-09-21T15:10:06.693 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.693 INFO:teuthology.orchestra.run.smithi161.stdout:5142 write 0x2fc1967 thru 0x2fc5d33 (0x43cd bytes) 2024-09-21T15:10:06.694 INFO:teuthology.orchestra.run.smithi161.stdout:5330 trunc from 0x937356c to 0x8e9c348 2024-09-21T15:10:06.694 INFO:teuthology.orchestra.run.smithi161.stdout:3874 punch from 0x18d70c7 to 0x18dec9e, (0x7bd7 bytes) 2024-09-21T15:10:06.694 INFO:teuthology.orchestra.run.smithi161.stdout:3875 trunc from 0x7000b0d to 0x6de9a8c 2024-09-21T15:10:06.702 INFO:teuthology.orchestra.run.smithi161.stdout:4829 write 0xd2f1b38 thru 0xd2f50e2 (0x35ab bytes) 2024-09-21T15:10:06.705 INFO:teuthology.orchestra.run.smithi161.stdout:5143 write 0x4adb158 thru 0x4ae99fa (0xe8a3 bytes) 2024-09-21T15:10:06.713 INFO:teuthology.orchestra.run.smithi161.stdout:5259 trunc from 0xdb5eff2 to 0x3d59883 2024-09-21T15:10:06.719 INFO:teuthology.orchestra.run.smithi161.stdout:4831 writesame 0xb5348b7 thru 0xb535a1f data_size 0x1(0x1169 bytes) 2024-09-21T15:10:06.719 INFO:teuthology.orchestra.run.smithi161.stdout:5144 writesame 0x6a4c3ce thru 0x6a55871 data_size 0x3f(0x94a4 bytes) 2024-09-21T15:10:06.737 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.737 INFO:teuthology.orchestra.run.smithi161.stdout:4836 write 0x73361e thru 0x733857 (0x23a bytes) 2024-09-21T15:10:06.742 INFO:teuthology.orchestra.run.smithi161.stdout:5332 punch from 0x88967a0 to 0x8897e6d, (0x16cd bytes) 2024-09-21T15:10:06.742 INFO:teuthology.orchestra.run.smithi161.stdout:5333 write 0x28b0b74 thru 0x28b8209 (0x7696 bytes) 2024-09-21T15:10:06.744 INFO:teuthology.orchestra.run.smithi161.stdout:5145 trunc from 0x7e632f6 to 0xda67ba9 2024-09-21T15:10:06.752 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.760 INFO:teuthology.orchestra.run.smithi161.stdout:3876 writesame 0xcbd789b thru 0xcbe1c78 data_size 0x19(0xa3de bytes) 2024-09-21T15:10:06.765 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.765 INFO:teuthology.orchestra.run.smithi161.stdout:3880 write 0x795071e thru 0x795f0cd (0xe9b0 bytes) 2024-09-21T15:10:06.784 INFO:teuthology.orchestra.run.smithi161.stdout:3881 writesame 0xe0a902 thru 0xe0a965 data_size 0x4(0x64 bytes) 2024-09-21T15:10:06.797 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.797 INFO:teuthology.orchestra.run.smithi161.stdout:5147 write 0x307c904 thru 0x308c298 (0xf995 bytes) 2024-09-21T15:10:06.797 INFO:teuthology.orchestra.run.smithi161.stdout:3882 write 0xb778940 thru 0xb779056 (0x717 bytes) 2024-09-21T15:10:06.800 INFO:teuthology.orchestra.run.smithi161.stdout:5261 write 0xb5bdaf1 thru 0xb5c8903 (0xae13 bytes) 2024-09-21T15:10:06.803 INFO:teuthology.orchestra.run.smithi161.stdout:4837 writesame 0xed06a4e thru 0xed0b465 data_size 0x4(0x4a18 bytes) 2024-09-21T15:10:06.809 INFO:teuthology.orchestra.run.smithi161.stdout:4838 read 0x2bb69b9 thru 0x2bb6ea1 (0x4e9 bytes) 2024-09-21T15:10:06.810 INFO:teuthology.orchestra.run.smithi161.stdout:4839 write 0xe89752f thru 0xe897826 (0x2f8 bytes) 2024-09-21T15:10:06.815 INFO:teuthology.orchestra.run.smithi161.stdout:5148 write 0x311ccec thru 0x3124338 (0x764d bytes) 2024-09-21T15:10:06.821 INFO:teuthology.orchestra.run.smithi161.stdout:5335 write 0xc52bb8e thru 0xc53797a (0xbded bytes) 2024-09-21T15:10:06.825 INFO:teuthology.orchestra.run.smithi161.stdout:5262 punch from 0x8279307 to 0x8280bb2, (0x78ab bytes) 2024-09-21T15:10:06.825 INFO:teuthology.orchestra.run.smithi161.stdout:5263 read 0x5e9a2cd thru 0x5e9bc72 (0x19a6 bytes) 2024-09-21T15:10:06.825 INFO:teuthology.orchestra.run.smithi161.stdout:5264 punch from 0x2563de3 to 0x256997d, (0x5b9a bytes) 2024-09-21T15:10:06.826 INFO:teuthology.orchestra.run.smithi161.stdout:5266 write 0x37e1399 thru 0x37ebe6f (0xaad7 bytes) 2024-09-21T15:10:06.832 INFO:teuthology.orchestra.run.smithi161.stdout:5150 punch from 0xbab747c to 0xbac7072, (0xfbf6 bytes) 2024-09-21T15:10:06.832 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.832 INFO:teuthology.orchestra.run.smithi161.stdout:5152 write 0x3e362e4 thru 0x3e40618 (0xa335 bytes) 2024-09-21T15:10:06.834 INFO:teuthology.orchestra.run.smithi161.stdout:3885 trunc from 0xcbe1c79 to 0x8313251 2024-09-21T15:10:06.839 INFO:teuthology.orchestra.run.smithi161.stdout:4840 trunc from 0xed0b466 to 0xa887f3a 2024-09-21T15:10:06.843 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:06.843 INFO:teuthology.orchestra.run.smithi161.stdout:5155 punch from 0x9668dfe to 0x967088b, (0x7a8d bytes) 2024-09-21T15:10:06.843 INFO:teuthology.orchestra.run.smithi161.stdout:5336 write 0x2b433dc thru 0x2b4ecec (0xb911 bytes) 2024-09-21T15:10:06.845 INFO:teuthology.orchestra.run.smithi161.stdout:5267 trunc from 0xb5c8904 to 0xa232799 2024-09-21T15:10:06.855 INFO:teuthology.orchestra.run.smithi161.stdout:5339 punch from 0xfa4da7 to 0xfa7212, (0x246b bytes) 2024-09-21T15:10:06.856 INFO:teuthology.orchestra.run.smithi161.stdout:5340 writesame 0xc16aa7d thru 0xc175cce data_size 0x6e(0xb252 bytes) 2024-09-21T15:10:06.871 INFO:teuthology.orchestra.run.smithi161.stdout:5341 read 0x3a33b5b thru 0x3a3b1a2 (0x7648 bytes) 2024-09-21T15:10:06.872 INFO:teuthology.orchestra.run.smithi161.stdout:5342 read 0x58a5c8d thru 0x58b1f5a (0xc2ce bytes) 2024-09-21T15:10:06.873 INFO:teuthology.orchestra.run.smithi161.stdout:5343 write 0x7e7f56e thru 0x7e8b57d (0xc010 bytes) 2024-09-21T15:10:06.881 INFO:teuthology.orchestra.run.smithi161.stdout:5156 write 0xeac9af5 thru 0xeaced77 (0x5283 bytes) 2024-09-21T15:10:06.899 INFO:teuthology.orchestra.run.smithi161.stdout:5344 trunc from 0xc53797b to 0x8e7139e 2024-09-21T15:10:06.903 INFO:teuthology.orchestra.run.smithi161.stdout:3886 read 0x8eef22 thru 0x8f6468 (0x7547 bytes) 2024-09-21T15:10:06.905 INFO:teuthology.orchestra.run.smithi161.stdout:3887 read 0x7a04a6c thru 0x7a078c5 (0x2e5a bytes) 2024-09-21T15:10:06.909 INFO:teuthology.orchestra.run.smithi161.stdout:5269 punch from 0x891b8ad to 0x8921578, (0x5ccb bytes) 2024-09-21T15:10:06.909 INFO:teuthology.orchestra.run.smithi161.stdout:3888 trunc from 0x8313251 to 0x701edf7 2024-09-21T15:10:06.916 INFO:teuthology.orchestra.run.smithi161.stdout:5160 read 0x2904711 thru 0x29086c4 (0x3fb4 bytes) 2024-09-21T15:10:06.927 INFO:teuthology.orchestra.run.smithi161.stdout:4841 read 0x3948fd0 thru 0x394a9f2 (0x1a23 bytes) 2024-09-21T15:10:06.932 INFO:teuthology.orchestra.run.smithi161.stdout:4842 trunc from 0xa887f3a to 0x8ededb0 2024-09-21T15:10:06.936 INFO:teuthology.orchestra.run.smithi161.stdout:5270 trunc from 0xa232799 to 0x4bff1d3 2024-09-21T15:10:06.939 INFO:teuthology.orchestra.run.smithi161.stdout:5162 trunc from 0xeaced78 to 0x54379ec 2024-09-21T15:10:06.972 INFO:teuthology.orchestra.run.smithi161.stdout:3889 read 0x3636374 thru 0x363a238 (0x3ec5 bytes) 2024-09-21T15:10:06.980 INFO:teuthology.orchestra.run.smithi161.stdout:5345 writesame 0x3cf44cb thru 0x3cf8d99 data_size 0x39(0x48cf bytes) 2024-09-21T15:10:06.985 INFO:teuthology.orchestra.run.smithi161.stdout:3890 trunc from 0x701edf7 to 0x3378535 2024-09-21T15:10:07.003 INFO:teuthology.orchestra.run.smithi161.stdout:5163 read 0x1530c0 thru 0x15551c (0x245d bytes) 2024-09-21T15:10:07.003 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.003 INFO:teuthology.orchestra.run.smithi161.stdout:5168 read 0x517668 thru 0x526691 (0xf02a bytes) 2024-09-21T15:10:07.005 INFO:teuthology.orchestra.run.smithi161.stdout:5169 read 0x30b9fad thru 0x30bb845 (0x1899 bytes) 2024-09-21T15:10:07.012 INFO:teuthology.orchestra.run.smithi161.stdout:4843 read 0x5a424cc thru 0x5a4f1c4 (0xccf9 bytes) 2024-09-21T15:10:07.013 INFO:teuthology.orchestra.run.smithi161.stdout:4844 write 0x47a0590 thru 0x47a2797 (0x2208 bytes) 2024-09-21T15:10:07.020 INFO:teuthology.orchestra.run.smithi161.stdout:5271 write 0x6cd8c18 thru 0x6ce61fe (0xd5e7 bytes) 2024-09-21T15:10:07.031 INFO:teuthology.orchestra.run.smithi161.stdout:3891 punch from 0x1d2c097 to 0x1d30f49, (0x4eb2 bytes) 2024-09-21T15:10:07.031 INFO:teuthology.orchestra.run.smithi161.stdout:3892 read 0x262b5f8 thru 0x2639ad3 (0xe4dc bytes) 2024-09-21T15:10:07.036 INFO:teuthology.orchestra.run.smithi161.stdout:5272 write 0x61e51d7 thru 0x61eebe9 (0x9a13 bytes) 2024-09-21T15:10:07.041 INFO:teuthology.orchestra.run.smithi161.stdout:5346 write 0xc30c68e thru 0xc310360 (0x3cd3 bytes) 2024-09-21T15:10:07.051 INFO:teuthology.orchestra.run.smithi161.stdout:5273 writesame 0x3f5898f thru 0x3f59559 data_size 0x1(0xbcb bytes) 2024-09-21T15:10:07.058 INFO:teuthology.orchestra.run.smithi161.stdout:5347 read 0xb41770b thru 0xb41b5b9 (0x3eaf bytes) 2024-09-21T15:10:07.059 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.059 INFO:teuthology.orchestra.run.smithi161.stdout:5349 read 0xa6d2269 thru 0xa6db5d9 (0x9371 bytes) 2024-09-21T15:10:07.076 INFO:teuthology.orchestra.run.smithi161.stdout:5171 writesame 0xd2c7083 thru 0xd2ca89b data_size 0x1(0x3819 bytes) 2024-09-21T15:10:07.077 INFO:teuthology.orchestra.run.smithi161.stdout:3893 write 0x7e54676 thru 0x7e56a34 (0x23bf bytes) 2024-09-21T15:10:07.080 INFO:teuthology.orchestra.run.smithi161.stdout:5150 read 0x82a9bfe thru 0x82aee19 (0x521c bytes) 2024-09-21T15:10:07.085 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:07.082+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc052615f0 2024-09-21T15:10:07.085 INFO:teuthology.orchestra.run.smithi161.stdout:5173 read 0x228221b thru 0x228f393 (0xd179 bytes) 2024-09-21T15:10:07.086 INFO:teuthology.orchestra.run.smithi161.stdout:4845 write 0xbcf2e7d thru 0xbcf70e9 (0x426d bytes) 2024-09-21T15:10:07.088 INFO:teuthology.orchestra.run.smithi161.stdout:5174 read 0xa962ac4 thru 0xa96354d (0xa8a bytes) 2024-09-21T15:10:07.088 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.088 INFO:teuthology.orchestra.run.smithi161.stdout:5176 write 0x8cc4014 thru 0x8cccd70 (0x8d5d bytes) 2024-09-21T15:10:07.101 INFO:teuthology.orchestra.run.smithi161.stdout:3896 read 0x3a4a2dc thru 0x3a51122 (0x6e47 bytes) 2024-09-21T15:10:07.109 INFO:teuthology.orchestra.run.smithi161.stdout:4846 write 0x9728827 thru 0x9738394 (0xfb6e bytes) 2024-09-21T15:10:07.117 INFO:teuthology.orchestra.run.smithi161.stdout:5350 write 0xdf874a0 thru 0xdf8e314 (0x6e75 bytes) 2024-09-21T15:10:07.123 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.130 INFO:teuthology.orchestra.run.smithi161.stdout:5276 write 0x7eaa5a7 thru 0x7eaab58 (0x5b2 bytes) 2024-09-21T15:10:07.133 INFO:teuthology.orchestra.run.smithi161.stdout:5352 write 0x46522c0 thru 0x465cc92 (0xa9d3 bytes) 2024-09-21T15:10:07.149 INFO:teuthology.orchestra.run.smithi161.stdout:5278 punch from 0x22ee7a3 to 0x22f5226, (0x6a83 bytes) 2024-09-21T15:10:07.158 INFO:teuthology.orchestra.run.smithi161.stdout:3898 write 0xb5f0f61 thru 0xb5f919d (0x823d bytes) 2024-09-21T15:10:07.159 INFO:teuthology.orchestra.run.smithi161.stdout:5178 write 0xd856910 thru 0xd865e42 (0xf533 bytes) 2024-09-21T15:10:07.159 INFO:teuthology.orchestra.run.smithi161.stdout:5153 write 0xd4d7c2f thru 0xd4e64be (0xe890 bytes) 2024-09-21T15:10:07.161 INFO:teuthology.orchestra.run.smithi161.stdout:4848 trunc from 0xbcf70ea to 0xb03343 2024-09-21T15:10:07.163 INFO:teuthology.orchestra.run.smithi161.stdout:5279 trunc from 0x7eaab59 to 0x4848fd4 2024-09-21T15:10:07.164 INFO:teuthology.orchestra.run.smithi161.stdout:5353 trunc from 0xdf8e315 to 0xa0c3d72 2024-09-21T15:10:07.190 INFO:teuthology.orchestra.run.smithi161.stdout:3901 punch from 0x3180b94 to 0x3186bc6, (0x6032 bytes) 2024-09-21T15:10:07.190 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.190 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.190 INFO:teuthology.orchestra.run.smithi161.stdout:3905 writesame 0x6e2d8a5 thru 0x6e320fa data_size 0x2f(0x4856 bytes) 2024-09-21T15:10:07.193 INFO:teuthology.orchestra.run.smithi161.stdout:5180 write 0x365f755 thru 0x366eb2a (0xf3d6 bytes) 2024-09-21T15:10:07.196 INFO:teuthology.orchestra.run.smithi161.stdout:5155 write 0x112639c thru 0x112872d (0x2392 bytes) 2024-09-21T15:10:07.220 INFO:teuthology.orchestra.run.smithi161.stdout:5181 read 0x84c2a7 thru 0x84c32d (0x87 bytes) 2024-09-21T15:10:07.220 INFO:teuthology.orchestra.run.smithi161.stdout:5182 read 0x9336575 thru 0x93442de (0xdd6a bytes) 2024-09-21T15:10:07.221 INFO:teuthology.orchestra.run.smithi161.stdout:5183 write 0xc9c5e60 thru 0xc9cbe98 (0x6039 bytes) 2024-09-21T15:10:07.222 INFO:teuthology.orchestra.run.smithi161.stdout:3906 read 0x4c53c52 thru 0x4c5aa9f (0x6e4e bytes) 2024-09-21T15:10:07.222 INFO:teuthology.orchestra.run.smithi161.stdout:3909 read 0x3aec11a thru 0x3af367d (0x7564 bytes) 2024-09-21T15:10:07.222 INFO:teuthology.orchestra.run.smithi161.stdout:3910 read 0x742be0f thru 0x7436f13 (0xb105 bytes) 2024-09-21T15:10:07.222 INFO:teuthology.orchestra.run.smithi161.stdout:3911 write 0xb4a37a5 thru 0xb4a5f35 (0x2791 bytes) 2024-09-21T15:10:07.229 INFO:teuthology.orchestra.run.smithi161.stdout:5157 trunc from 0xd4e64bf to 0xdfd532b 2024-09-21T15:10:07.232 INFO:teuthology.orchestra.run.smithi161.stdout:5186 write 0x21876b0 thru 0x219033f (0x8c90 bytes) 2024-09-21T15:10:07.244 INFO:teuthology.orchestra.run.smithi161.stdout:3912 read 0x59ed510 thru 0x59f2c6f (0x5760 bytes) 2024-09-21T15:10:07.246 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.246 INFO:teuthology.orchestra.run.smithi161.stdout:5282 read 0x16f9ccb thru 0x17032cc (0x9602 bytes) 2024-09-21T15:10:07.247 INFO:teuthology.orchestra.run.smithi161.stdout:5284 read 0x1ffdf5 thru 0x200603 (0x80f bytes) 2024-09-21T15:10:07.252 INFO:teuthology.orchestra.run.smithi161.stdout:5187 write 0xc99e3a6 thru 0xc9a9d37 (0xb992 bytes) 2024-09-21T15:10:07.256 INFO:teuthology.orchestra.run.smithi161.stdout:3913 trunc from 0xb5f919e to 0x591f8b4 2024-09-21T15:10:07.263 INFO:teuthology.orchestra.run.smithi161.stdout:5354 punch from 0x9f6c464 to 0x9f7390d, (0x74a9 bytes) 2024-09-21T15:10:07.264 INFO:teuthology.orchestra.run.smithi161.stdout:5355 writesame 0x10bc8e6 thru 0x10c0fb0 data_size 0x7(0x46cb bytes) 2024-09-21T15:10:07.267 INFO:teuthology.orchestra.run.smithi161.stdout:5188 punch from 0xaaf3119 to 0xaafe3c4, (0xb2ab bytes) 2024-09-21T15:10:07.267 INFO:teuthology.orchestra.run.smithi161.stdout:5190 write 0x88f4c4b thru 0x89049ee (0xfda4 bytes) 2024-09-21T15:10:07.267 INFO:teuthology.orchestra.run.smithi161.stdout:4849 read 0x855065 thru 0x863120 (0xe0bc bytes) 2024-09-21T15:10:07.267 INFO:teuthology.orchestra.run.smithi161.stdout:4850 punch from 0x92f16e to 0x93b1b4, (0xc046 bytes) 2024-09-21T15:10:07.268 INFO:teuthology.orchestra.run.smithi161.stdout:4851 punch from 0x2f3061 to 0x2fda7a, (0xaa19 bytes) 2024-09-21T15:10:07.268 INFO:teuthology.orchestra.run.smithi161.stdout:4852 read 0x21076e thru 0x217233 (0x6ac6 bytes) 2024-09-21T15:10:07.270 INFO:teuthology.orchestra.run.smithi161.stdout:4856 read 0x53b150 thru 0x547a9f (0xc950 bytes) 2024-09-21T15:10:07.286 INFO:teuthology.orchestra.run.smithi161.stdout:5356 trunc from 0xa0c3d72 to 0xe36936a 2024-09-21T15:10:07.291 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.291 INFO:teuthology.orchestra.run.smithi161.stdout:5194 writesame 0x916a30d thru 0x9172f63 data_size 0x1(0x8c57 bytes) 2024-09-21T15:10:07.293 INFO:teuthology.orchestra.run.smithi161.stdout:5158 trunc from 0xdfd532b to 0x50c5df9 2024-09-21T15:10:07.327 INFO:teuthology.orchestra.run.smithi161.stdout:5285 write 0xde0daa2 thru 0xde157f0 (0x7d4f bytes) 2024-09-21T15:10:07.334 INFO:teuthology.orchestra.run.smithi161.stdout:5195 read 0x3ca03bd thru 0x3ca1669 (0x12ad bytes) 2024-09-21T15:10:07.335 INFO:teuthology.orchestra.run.smithi161.stdout:5196 read 0x2330e1e thru 0x2336bdb (0x5dbe bytes) 2024-09-21T15:10:07.336 INFO:teuthology.orchestra.run.smithi161.stdout:5197 write 0x6fc747b thru 0x6fcbf76 (0x4afc bytes) 2024-09-21T15:10:07.338 INFO:teuthology.orchestra.run.smithi161.stdout:4857 write 0x68a7eb3 thru 0x68b6abd (0xec0b bytes) 2024-09-21T15:10:07.349 INFO:teuthology.orchestra.run.smithi161.stdout:5286 write 0xa8284e1 thru 0xa82e3c9 (0x5ee9 bytes) 2024-09-21T15:10:07.357 INFO:teuthology.orchestra.run.smithi161.stdout:5357 writesame 0x44a2648 thru 0x44b0c21 data_size 0x7(0xe5da bytes) 2024-09-21T15:10:07.372 INFO:teuthology.orchestra.run.smithi161.stdout:4859 write 0x4714ad2 thru 0x471aab5 (0x5fe4 bytes) 2024-09-21T15:10:07.381 INFO:teuthology.orchestra.run.smithi161.stdout:5358 read 0x7134ad1 thru 0x7143830 (0xed60 bytes) 2024-09-21T15:10:07.382 INFO:teuthology.orchestra.run.smithi161.stdout:5360 clone 35 order 18 su 65536 sc 14 2024-09-21T15:10:07.383 INFO:teuthology.orchestra.run.smithi161.stdout:5287 read 0x96a5e92 thru 0x96a7aeb (0x1c5a bytes) 2024-09-21T15:10:07.384 INFO:teuthology.orchestra.run.smithi161.stdout:5288 write 0x8cb775f thru 0x8cbce45 (0x56e7 bytes) 2024-09-21T15:10:07.389 INFO:teuthology.orchestra.run.smithi161.stdout:5198 read 0xa1f3e43 thru 0xa200577 (0xc735 bytes) 2024-09-21T15:10:07.389 INFO:teuthology.orchestra.run.smithi161.stdout:5200 punch from 0x4f4d545 to 0x4f529dc, (0x5497 bytes) 2024-09-21T15:10:07.389 INFO:teuthology.orchestra.run.smithi161.stdout:5201 punch from 0x8941c31 to 0x894d025, (0xb3f4 bytes) 2024-09-21T15:10:07.389 INFO:teuthology.orchestra.run.smithi161.stdout:5202 read 0x99d40e8 thru 0x99d8e7e (0x4d97 bytes) 2024-09-21T15:10:07.389 INFO:teuthology.orchestra.run.smithi161.stdout:5203 read 0x192da thru 0x20c8d (0x79b4 bytes) 2024-09-21T15:10:07.394 INFO:teuthology.orchestra.run.smithi161.stdout:5204 punch from 0x25f3e42 to 0x2602341, (0xe4ff bytes) 2024-09-21T15:10:07.394 INFO:teuthology.orchestra.run.smithi161.stdout:5205 writesame 0x5451d7 thru 0x548da3 data_size 0x1b(0x3bcd bytes) 2024-09-21T15:10:07.395 INFO:teuthology.orchestra.run.smithi161.stdout:4862 writesame 0x11502f9 thru 0x115d0bf data_size 0x1(0xcdc7 bytes) 2024-09-21T15:10:07.407 INFO:teuthology.orchestra.run.smithi161.stdout:5289 write 0x40ec85f thru 0x40f5c38 (0x93da bytes) 2024-09-21T15:10:07.407 INFO:teuthology.orchestra.run.smithi161.stdout:3915 write 0xa159d9e thru 0xa15a53d (0x7a0 bytes) 2024-09-21T15:10:07.420 INFO:teuthology.orchestra.run.smithi161.stdout:5160 punch from 0x276a81c to 0x2778c8f, (0xe473 bytes) 2024-09-21T15:10:07.420 INFO:teuthology.orchestra.run.smithi161.stdout:5161 writesame 0x32dbda4 thru 0x32ea1d0 data_size 0x1(0xe42d bytes) 2024-09-21T15:10:07.462 INFO:teuthology.orchestra.run.smithi161.stdout:5162 punch from 0x4ad7981 to 0x4ae2ac6, (0xb145 bytes) 2024-09-21T15:10:07.462 INFO:teuthology.orchestra.run.smithi161.stdout:5163 read 0x2154520 thru 0x2158319 (0x3dfa bytes) 2024-09-21T15:10:07.463 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.463 INFO:teuthology.orchestra.run.smithi161.stdout:5165 read 0x2d8a58c thru 0x2d9a162 (0xfbd7 bytes) 2024-09-21T15:10:07.464 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.464 INFO:teuthology.orchestra.run.smithi161.stdout:5207 write 0x9c690a thru 0x9ca00d (0x3704 bytes) 2024-09-21T15:10:07.465 INFO:teuthology.orchestra.run.smithi161.stdout:5166 write 0x377f503 thru 0x378e4ab (0xefa9 bytes) 2024-09-21T15:10:07.471 INFO:teuthology.orchestra.run.smithi161.stdout:5290 write 0x8c36b8b thru 0x8c3c7fc (0x5c72 bytes) 2024-09-21T15:10:07.481 INFO:teuthology.orchestra.run.smithi161.stdout:5209 trunc from 0xd865e43 to 0x9f33e70 2024-09-21T15:10:07.483 INFO:teuthology.orchestra.run.smithi161.stdout:5167 writesame 0xc5d647 thru 0xc615c9 data_size 0x1(0x3f83 bytes) 2024-09-21T15:10:07.490 INFO:teuthology.orchestra.run.smithi161.stdout:5291 punch from 0xdd88ab6 to 0xdd93ad9, (0xb023 bytes) 2024-09-21T15:10:07.490 INFO:teuthology.orchestra.run.smithi161.stdout:5292 write 0xd85373f thru 0xd85727f (0x3b41 bytes) 2024-09-21T15:10:07.503 INFO:teuthology.orchestra.run.smithi161.stdout:5168 read 0x28f7d63 thru 0x290141e (0x96bc bytes) 2024-09-21T15:10:07.510 INFO:teuthology.orchestra.run.smithi161.stdout:5293 write 0x2849f04 thru 0x285385d (0x995a bytes) 2024-09-21T15:10:07.510 INFO:teuthology.orchestra.run.smithi161.stdout:3917 write 0xbcc9d3b thru 0xbcd1011 (0x72d7 bytes) 2024-09-21T15:10:07.520 INFO:teuthology.orchestra.run.smithi161.stdout:5169 trunc from 0x50c5df9 to 0xd84f721 2024-09-21T15:10:07.520 INFO:teuthology.orchestra.run.smithi161.stdout:5295 write 0x71830aa thru 0x7183ced (0xc44 bytes) 2024-09-21T15:10:07.521 INFO:teuthology.orchestra.run.smithi161.stdout:4863 write 0xdc58337 thru 0xdc5f84e (0x7518 bytes) 2024-09-21T15:10:07.531 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.531 INFO:teuthology.orchestra.run.smithi161.stdout:3919 writesame 0x7522ed8 thru 0x752651c data_size 0xb(0x3645 bytes) 2024-09-21T15:10:07.544 INFO:teuthology.orchestra.run.smithi161.stdout:5296 punch from 0xdcf2c21 to 0xdcf8cc9, (0x60a8 bytes) 2024-09-21T15:10:07.544 INFO:teuthology.orchestra.run.smithi161.stdout:5297 read 0x6de7374 thru 0x6ded16d (0x5dfa bytes) 2024-09-21T15:10:07.544 INFO:teuthology.orchestra.run.smithi161.stdout:5298 writesame 0x1e1150b thru 0x1e1da30 data_size 0x7(0xc526 bytes) 2024-09-21T15:10:07.556 INFO:teuthology.orchestra.run.smithi161.stdout:5210 trunc from 0x9f33e70 to 0x244a61 2024-09-21T15:10:07.557 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.557 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.557 INFO:teuthology.orchestra.run.smithi161.stdout:3923 read 0x1595272 thru 0x159cb06 (0x7895 bytes) 2024-09-21T15:10:07.558 INFO:teuthology.orchestra.run.smithi161.stdout:3924 read 0x54a9b3e thru 0x54b8996 (0xee59 bytes) 2024-09-21T15:10:07.558 INFO:teuthology.orchestra.run.smithi161.stdout:3925 read 0xd7ba88 thru 0xd851c8 (0x9741 bytes) 2024-09-21T15:10:07.561 INFO:teuthology.orchestra.run.smithi161.stdout:4864 trunc from 0xdc5f84f to 0x4e78bdd 2024-09-21T15:10:07.579 INFO:teuthology.orchestra.run.smithi161.stdout:5171 read 0x31bf04a thru 0x31cef70 (0xff27 bytes) 2024-09-21T15:10:07.579 INFO:teuthology.orchestra.run.smithi161.stdout:5172 write 0x4d44ca0 thru 0x4d52e28 (0xe189 bytes) 2024-09-21T15:10:07.582 INFO:teuthology.orchestra.run.smithi161.stdout:3926 trunc from 0xbcd1012 to 0x33ef263 2024-09-21T15:10:07.600 INFO:teuthology.orchestra.run.smithi161.stdout:5173 read 0x9c95b82 thru 0x9c96eef (0x136e bytes) 2024-09-21T15:10:07.600 INFO:teuthology.orchestra.run.smithi161.stdout:5175 writesame 0xabb3d78 thru 0xabbb100 data_size 0x1(0x7389 bytes) 2024-09-21T15:10:07.609 INFO:teuthology.orchestra.run.smithi161.stdout:5299 trunc from 0xde157f1 to 0x4edab2d 2024-09-21T15:10:07.692 INFO:teuthology.orchestra.run.smithi161.stdout:5178 flatten 2024-09-21T15:10:07.701 INFO:teuthology.orchestra.run.smithi161.stdout:5211 read 0xecbfd thru 0xf4031 (0x7435 bytes) 2024-09-21T15:10:07.732 INFO:teuthology.orchestra.run.smithi161.stdout:3927 read 0x2477670 thru 0x2486829 (0xf1ba bytes) 2024-09-21T15:10:07.732 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.742 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.743 INFO:teuthology.orchestra.run.smithi161.stdout:5301 read 0x5acae0 thru 0x5b73a7 (0xa8c8 bytes) 2024-09-21T15:10:07.746 INFO:teuthology.orchestra.run.smithi161.stdout:5302 punch from 0x3f36d66 to 0x3f3ab4a, (0x3de4 bytes) 2024-09-21T15:10:07.746 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.753 INFO:teuthology.orchestra.run.smithi161.stdout:5179 write 0x5be1bad thru 0x5bf1a4c (0xfea0 bytes) 2024-09-21T15:10:07.769 INFO:teuthology.orchestra.run.smithi161.stdout:5180 write 0x74ea40e thru 0x74fa200 (0xfdf3 bytes) 2024-09-21T15:10:07.783 INFO:teuthology.orchestra.run.smithi161.stdout:5214 write 0xdbe74a6 thru 0xdbf238d (0xaee8 bytes) 2024-09-21T15:10:07.786 INFO:teuthology.orchestra.run.smithi161.stdout:5181 punch from 0x7035b9a to 0x7039953, (0x3db9 bytes) 2024-09-21T15:10:07.786 INFO:teuthology.orchestra.run.smithi161.stdout:5182 write 0xc37442b thru 0xc381072 (0xcc48 bytes) 2024-09-21T15:10:07.793 INFO:teuthology.orchestra.run.smithi161.stdout:4865 writesame 0xad731ed thru 0xad82ac6 data_size 0x35(0xf8da bytes) 2024-09-21T15:10:07.794 INFO:teuthology.orchestra.run.smithi161.stdout:3930 write 0xa064ca2 thru 0xa06aee0 (0x623f bytes) 2024-09-21T15:10:07.802 INFO:teuthology.orchestra.run.smithi161.stdout:4866 write 0xa4decd4 thru 0xa4ed96a (0xec97 bytes) 2024-09-21T15:10:07.811 INFO:teuthology.orchestra.run.smithi161.stdout:5304 writesame 0x920618b thru 0x9206eeb data_size 0x5(0xd61 bytes) 2024-09-21T15:10:07.812 INFO:teuthology.orchestra.run.smithi161.stdout:5183 punch from 0xd76a40d to 0xd76f2ca, (0x4ebd bytes) 2024-09-21T15:10:07.818 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.818 INFO:teuthology.orchestra.run.smithi161.stdout:3934 write 0x1926c5e thru 0x19307ba (0x9b5d bytes) 2024-09-21T15:10:07.819 INFO:teuthology.orchestra.run.smithi161.stdout:5306 read 0x18a0a5 thru 0x19212b (0x8087 bytes) 2024-09-21T15:10:07.821 INFO:teuthology.orchestra.run.smithi161.stdout:4868 read 0x57cd5b5 thru 0x57d2d8a (0x57d6 bytes) 2024-09-21T15:10:07.821 INFO:teuthology.orchestra.run.smithi161.stdout:5307 punch from 0x4970ee0 to 0x4974125, (0x3245 bytes) 2024-09-21T15:10:07.821 INFO:teuthology.orchestra.run.smithi161.stdout:4869 read 0x222d32c thru 0x2233f59 (0x6c2e bytes) 2024-09-21T15:10:07.821 INFO:teuthology.orchestra.run.smithi161.stdout:5309 read 0x86ee810 thru 0x86fbb7a (0xd36b bytes) 2024-09-21T15:10:07.822 INFO:teuthology.orchestra.run.smithi161.stdout:4871 read 0x543d8fa thru 0x544d7b5 (0xfebc bytes) 2024-09-21T15:10:07.822 INFO:teuthology.orchestra.run.smithi161.stdout:4873 write 0x6579199 thru 0x657db2a (0x4992 bytes) 2024-09-21T15:10:07.828 INFO:teuthology.orchestra.run.smithi161.stdout:5184 trunc from 0xd84f721 to 0x62f0414 2024-09-21T15:10:07.833 INFO:teuthology.orchestra.run.smithi161.stdout:5311 trunc from 0x9206eec to 0xe96f4b4 2024-09-21T15:10:07.833 INFO:teuthology.orchestra.run.smithi161.stdout:5215 trunc from 0xdbf238e to 0x3f558f7 2024-09-21T15:10:07.851 INFO:teuthology.orchestra.run.smithi161.stdout:3935 read 0x4f60e69 thru 0x4f6cacd (0xbc65 bytes) 2024-09-21T15:10:07.851 INFO:teuthology.orchestra.run.smithi161.stdout:3936 punch from 0x1b22325 to 0x1b25adf, (0x37ba bytes) 2024-09-21T15:10:07.852 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.852 INFO:teuthology.orchestra.run.smithi161.stdout:3938 write 0x3719cc0 thru 0x3729514 (0xf855 bytes) 2024-09-21T15:10:07.881 INFO:teuthology.orchestra.run.smithi161.stdout:3940 write 0x2651f9c thru 0x2657b0c (0x5b71 bytes) 2024-09-21T15:10:07.887 INFO:teuthology.orchestra.run.smithi161.stdout:5313 punch from 0xb8c08c1 to 0xb8c9f03, (0x9642 bytes) 2024-09-21T15:10:07.887 INFO:teuthology.orchestra.run.smithi161.stdout:5315 writesame 0x764870f thru 0x76503ef data_size 0x1(0x7ce1 bytes) 2024-09-21T15:10:07.898 INFO:teuthology.orchestra.run.smithi161.stdout:3941 read 0x55dd5f1 thru 0x55e1886 (0x4296 bytes) 2024-09-21T15:10:07.898 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.898 INFO:teuthology.orchestra.run.smithi161.stdout:3944 writesame 0x4170c5c thru 0x417b207 data_size 0x2e(0xa5ac bytes) 2024-09-21T15:10:07.900 INFO:teuthology.orchestra.run.smithi161.stdout:4874 write 0xb10b82f thru 0xb113f9a (0x876c bytes) 2024-09-21T15:10:07.905 INFO:teuthology.orchestra.run.smithi161.stdout:5216 read 0xb1d258 thru 0xb23567 (0x6310 bytes) 2024-09-21T15:10:07.907 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.907 INFO:teuthology.orchestra.run.smithi161.stdout:5218 read 0x908525 thru 0x913161 (0xac3d bytes) 2024-09-21T15:10:07.913 INFO:teuthology.orchestra.run.smithi161.stdout:5220 trunc from 0x3f558f7 to 0x2603d9b 2024-09-21T15:10:07.914 INFO:teuthology.orchestra.run.smithi161.stdout:3947 write 0x8d7b53e thru 0x8d7dc6b (0x272e bytes) 2024-09-21T15:10:07.915 INFO:teuthology.orchestra.run.smithi161.stdout:5185 read 0x3db4916 thru 0x3db93c3 (0x4aae bytes) 2024-09-21T15:10:07.921 INFO:teuthology.orchestra.run.smithi161.stdout:5186 trunc from 0x62f0414 to 0x7e4de11 2024-09-21T15:10:07.922 INFO:teuthology.orchestra.run.smithi161.stdout:4876 write 0x8521609 thru 0x8527127 (0x5b1f bytes) 2024-09-21T15:10:07.927 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.0-clone34 intact 2024-09-21T15:10:07.933 INFO:teuthology.orchestra.run.smithi161.stdout:5317 write 0x21f98fc thru 0x2205a76 (0xc17b bytes) 2024-09-21T15:10:07.938 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:07.938 INFO:teuthology.orchestra.run.smithi161.stdout:4878 write 0x8bc0649 thru 0x8bc4c16 (0x45ce bytes) 2024-09-21T15:10:07.955 INFO:teuthology.orchestra.run.smithi161.stdout:3948 read 0x809c776 thru 0x80aabec (0xe477 bytes) 2024-09-21T15:10:07.956 INFO:teuthology.orchestra.run.smithi161.stdout:5188 write 0x4bf9e8f thru 0x4c07d7b (0xdeed bytes) 2024-09-21T15:10:07.966 INFO:teuthology.orchestra.run.smithi161.stdout:4882 punch from 0x600be68 to 0x60153b3, (0x954b bytes) 2024-09-21T15:10:07.966 INFO:teuthology.orchestra.run.smithi161.stdout:4883 read 0x4917d71 thru 0x491c6ec (0x497c bytes) 2024-09-21T15:10:07.966 INFO:teuthology.orchestra.run.smithi161.stdout:4884 read 0xa0c8ed6 thru 0xa0d4714 (0xb83f bytes) 2024-09-21T15:10:07.967 INFO:teuthology.orchestra.run.smithi161.stdout:4885 writesame 0x9940e2c thru 0x994774c data_size 0x1(0x6921 bytes) 2024-09-21T15:10:07.967 INFO:teuthology.orchestra.run.smithi161.stdout:5223 read 0x1f8cb14 thru 0x1f8fed1 (0x33be bytes) 2024-09-21T15:10:07.967 INFO:teuthology.orchestra.run.smithi161.stdout:5225 read 0x46b245 thru 0x47a766 (0xf522 bytes) 2024-09-21T15:10:07.971 INFO:teuthology.orchestra.run.smithi161.stdout:5189 read 0x251b232 thru 0x25211bb (0x5f8a bytes) 2024-09-21T15:10:07.971 INFO:teuthology.orchestra.run.smithi161.stdout:5191 punch from 0x4fd1cb2 to 0x4fd8a7f, (0x6dcd bytes) 2024-09-21T15:10:08.003 INFO:teuthology.orchestra.run.smithi161.stdout:4887 read 0x61e797b thru 0x61e9b5e (0x21e4 bytes) 2024-09-21T15:10:08.005 INFO:teuthology.orchestra.run.smithi161.stdout:3949 writesame 0xa28c99f thru 0xa2911d7 data_size 0x1(0x4839 bytes) 2024-09-21T15:10:08.012 INFO:teuthology.orchestra.run.smithi161.stdout:5318 trunc from 0xe96f4b4 to 0x7bf20d 2024-09-21T15:10:08.014 INFO:teuthology.orchestra.run.smithi161.stdout:3950 writesame 0x7df470f thru 0x7df8881 data_size 0x5(0x4173 bytes) 2024-09-21T15:10:08.018 INFO:teuthology.orchestra.run.smithi161.stdout:5226 writesame 0x62a0db2 thru 0x62a7e55 data_size 0x36(0x70a4 bytes) 2024-09-21T15:10:08.025 INFO:teuthology.orchestra.run.smithi161.stdout:5227 write 0x39700a thru 0x397efb (0xef2 bytes) 2024-09-21T15:10:08.033 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.033 INFO:teuthology.orchestra.run.smithi161.stdout:3952 read 0x54b06cd thru 0x54b5ed6 (0x580a bytes) 2024-09-21T15:10:08.033 INFO:teuthology.orchestra.run.smithi161.stdout:3953 write 0x57f4725 thru 0x57f99aa (0x5286 bytes) 2024-09-21T15:10:08.041 INFO:teuthology.orchestra.run.smithi161.stdout:5192 write 0x924df83 thru 0x925da01 (0xfa7f bytes) 2024-09-21T15:10:08.042 INFO:teuthology.orchestra.run.smithi161.stdout:5228 read 0x2804fe1 thru 0x2814b58 (0xfb78 bytes) 2024-09-21T15:10:08.042 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.062 INFO:teuthology.orchestra.run.smithi161.stdout:4888 write 0xe38ef96 thru 0xe39ba30 (0xca9b bytes) 2024-09-21T15:10:08.068 INFO:teuthology.orchestra.run.smithi161.stdout:3954 trunc from 0xa2911d8 to 0xde00a8b 2024-09-21T15:10:08.117 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.117 INFO:teuthology.orchestra.run.smithi161.stdout:5195 write 0x3c49a99 thru 0x3c4e58a (0x4af2 bytes) 2024-09-21T15:10:08.146 INFO:teuthology.orchestra.run.smithi161.stdout:4889 write 0x57cf4c6 thru 0x57dc40b (0xcf46 bytes) 2024-09-21T15:10:08.153 INFO:teuthology.orchestra.run.smithi161.stdout:5197 read 0x3337d78 thru 0x333abac (0x2e35 bytes) 2024-09-21T15:10:08.154 INFO:teuthology.orchestra.run.smithi161.stdout:5198 write 0x6bba6a8 thru 0x6bca3fc (0xfd55 bytes) 2024-09-21T15:10:08.157 INFO:teuthology.orchestra.run.smithi161.stdout:5230 writesame 0x8a9567f thru 0x8a9cc35 data_size 0x7b(0x75b7 bytes) 2024-09-21T15:10:08.164 INFO:teuthology.orchestra.run.smithi161.stdout:5231 read 0x6c506e0 thru 0x6c584de (0x7dff bytes) 2024-09-21T15:10:08.164 INFO:teuthology.orchestra.run.smithi161.stdout:5232 punch from 0x3ea14ba to 0x3ea4916, (0x345c bytes) 2024-09-21T15:10:08.164 INFO:teuthology.orchestra.run.smithi161.stdout:5233 read 0x10d1674 thru 0x10d42c9 (0x2c56 bytes) 2024-09-21T15:10:08.193 INFO:teuthology.orchestra.run.smithi161.stdout:5200 read 0x314529f thru 0x3153901 (0xe663 bytes) 2024-09-21T15:10:08.195 INFO:teuthology.orchestra.run.smithi161.stdout:5201 read 0x9ffbeb thru 0xa0bdfd (0xc213 bytes) 2024-09-21T15:10:08.198 INFO:teuthology.orchestra.run.smithi161.stdout:5205 writesame 0x7493382 thru 0x74940e1 data_size 0x10(0xd60 bytes) 2024-09-21T15:10:08.201 INFO:teuthology.orchestra.run.smithi161.stdout:4891 write 0x785fe3f thru 0x7865f59 (0x611b bytes) 2024-09-21T15:10:08.212 INFO:teuthology.orchestra.run.smithi161.stdout:5206 punch from 0x5a072a4 to 0x5a09908, (0x2664 bytes) 2024-09-21T15:10:08.212 INFO:teuthology.orchestra.run.smithi161.stdout:5208 punch from 0x53d1018 to 0x53dba74, (0xaa5c bytes) 2024-09-21T15:10:08.212 INFO:teuthology.orchestra.run.smithi161.stdout:5209 punch from 0x1f4e7e6 to 0x1f5af67, (0xc781 bytes) 2024-09-21T15:10:08.212 INFO:teuthology.orchestra.run.smithi161.stdout:5210 punch from 0x32fa1b9 to 0x32fbdca, (0x1c11 bytes) 2024-09-21T15:10:08.212 INFO:teuthology.orchestra.run.smithi161.stdout:5211 read 0x7cccc58 thru 0x7cd14d2 (0x487b bytes) 2024-09-21T15:10:08.214 INFO:teuthology.orchestra.run.smithi161.stdout:5212 read 0x86fe491 thru 0x8707194 (0x8d04 bytes) 2024-09-21T15:10:08.215 INFO:teuthology.orchestra.run.smithi161.stdout:5213 read 0x13c7af4 thru 0x13c8f47 (0x1454 bytes) 2024-09-21T15:10:08.215 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.215 INFO:teuthology.orchestra.run.smithi161.stdout:5215 punch from 0x732c5f5 to 0x732d448, (0xe53 bytes) 2024-09-21T15:10:08.216 INFO:teuthology.orchestra.run.smithi161.stdout:5218 write 0x76bb4b0 thru 0x76c2959 (0x74aa bytes) 2024-09-21T15:10:08.219 INFO:teuthology.orchestra.run.smithi161.stdout:4894 read 0x95d7daa thru 0x95db641 (0x3898 bytes) 2024-09-21T15:10:08.219 INFO:teuthology.orchestra.run.smithi161.stdout:4895 punch from 0x68def57 to 0x68e7563, (0x860c bytes) 2024-09-21T15:10:08.219 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.219 INFO:teuthology.orchestra.run.smithi161.stdout:4897 write 0xdf5bc4a thru 0xdf6a6f8 (0xeaaf bytes) 2024-09-21T15:10:08.219 INFO:teuthology.orchestra.run.smithi161.stdout:3955 writesame 0xa89b192 thru 0xa8a5b65 data_size 0x6(0xa9d4 bytes) 2024-09-21T15:10:08.220 INFO:teuthology.orchestra.run.smithi161.stdout:5234 write 0xc82f482 thru 0xc837c89 (0x8808 bytes) 2024-09-21T15:10:08.231 INFO:teuthology.orchestra.run.smithi161.stdout:5222 writesame 0x336ccce thru 0x337222a data_size 0xd(0x555d bytes) 2024-09-21T15:10:08.248 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.248 INFO:teuthology.orchestra.run.smithi161.stdout:5237 write 0x76920c thru 0x776f48 (0xdd3d bytes) 2024-09-21T15:10:08.265 INFO:teuthology.orchestra.run.smithi161.stdout:4898 trunc from 0xe39ba31 to 0x4b98e22 2024-09-21T15:10:08.266 INFO:teuthology.orchestra.run.smithi161.stdout:5240 write 0xa380796 thru 0xa388bc5 (0x8430 bytes) 2024-09-21T15:10:08.266 INFO:teuthology.orchestra.run.smithi161.stdout:5319 trunc from 0x7bf20d to 0x983ed8e 2024-09-21T15:10:08.294 INFO:teuthology.orchestra.run.smithi161.stdout:5241 write 0x78d1865 thru 0x78d5754 (0x3ef0 bytes) 2024-09-21T15:10:08.297 INFO:teuthology.orchestra.run.smithi161.stdout:3956 writesame 0xe5fdde1 thru 0xe6049f2 data_size 0x6a(0x6c12 bytes) 2024-09-21T15:10:08.300 INFO:teuthology.orchestra.run.smithi161.stdout:3957 read 0xd244fe5 thru 0xd25152a (0xc546 bytes) 2024-09-21T15:10:08.308 INFO:teuthology.orchestra.run.smithi161.stdout:5223 writesame 0xa51f025 thru 0xa528f2f data_size 0x11(0x9f0b bytes) 2024-09-21T15:10:08.308 INFO:teuthology.orchestra.run.smithi161.stdout:5242 punch from 0x61696d7 to 0x61791a8, (0xfad1 bytes) 2024-09-21T15:10:08.309 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #33, image image_cluster1.client.mirror.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent34 2024-09-21T15:10:08.311 INFO:teuthology.orchestra.run.smithi161.stdout:5321 punch from 0x6432ed7 to 0x6437f37, (0x5060 bytes) 2024-09-21T15:10:08.311 INFO:teuthology.orchestra.run.smithi161.stdout:5224 write 0x8dff22b thru 0x8e06cf0 (0x7ac6 bytes) 2024-09-21T15:10:08.312 INFO:teuthology.orchestra.run.smithi161.stdout:5322 write 0x19c6b8c thru 0x19cc173 (0x55e8 bytes) 2024-09-21T15:10:08.322 INFO:teuthology.orchestra.run.smithi161.stdout:3958 trunc from 0xe6049f3 to 0x24d1d69 2024-09-21T15:10:08.332 INFO:teuthology.orchestra.run.smithi161.stdout:5323 read 0x551dbea thru 0x55216df (0x3af6 bytes) 2024-09-21T15:10:08.332 INFO:teuthology.orchestra.run.smithi161.stdout:5326 read 0x2e71bd1 thru 0x2e777b4 (0x5be4 bytes) 2024-09-21T15:10:08.335 INFO:teuthology.orchestra.run.smithi161.stdout:5225 trunc from 0xa528f30 to 0x59ec2e8 2024-09-21T15:10:08.346 INFO:teuthology.orchestra.run.smithi161.stdout:4899 punch from 0x333e905 to 0x334415b, (0x5856 bytes) 2024-09-21T15:10:08.346 INFO:teuthology.orchestra.run.smithi161.stdout:4900 write 0x39b08f7 thru 0x39b6d32 (0x643c bytes) 2024-09-21T15:10:08.359 INFO:teuthology.orchestra.run.smithi161.stdout:5243 writesame 0xe471b5c thru 0xe478808 data_size 0x1(0x6cad bytes) 2024-09-21T15:10:08.366 INFO:teuthology.orchestra.run.smithi161.stdout:5244 punch from 0xe299434 to 0xe29b3eb, (0x1fb7 bytes) 2024-09-21T15:10:08.366 INFO:teuthology.orchestra.run.smithi161.stdout:5246 write 0x25f2c40 thru 0x25fd725 (0xaae6 bytes) 2024-09-21T15:10:08.450 INFO:teuthology.orchestra.run.smithi161.stdout:5247 write 0x5d9dab thru 0x5e2ef3 (0x9149 bytes) 2024-09-21T15:10:08.458 INFO:teuthology.orchestra.run.smithi161.stdout:5361 write 0xd42363b thru 0xd4296db (0x60a1 bytes) 2024-09-21T15:10:08.459 INFO:teuthology.orchestra.run.smithi161.stdout:5327 write 0xcbb68f3 thru 0xcbbdb55 (0x7263 bytes) 2024-09-21T15:10:08.468 INFO:teuthology.orchestra.run.smithi161.stdout:5250 write 0x187a9dd thru 0x188a570 (0xfb94 bytes) 2024-09-21T15:10:08.472 INFO:teuthology.orchestra.run.smithi161.stdout:3960 write 0x5b4677 thru 0x5becdf (0xa669 bytes) 2024-09-21T15:10:08.483 INFO:teuthology.orchestra.run.smithi161.stdout:5330 write 0xbbbdb13 thru 0xbbc5a27 (0x7f15 bytes) 2024-09-21T15:10:08.486 INFO:teuthology.orchestra.run.smithi161.stdout:5226 write 0x42a052a thru 0x42ab88c (0xb363 bytes) 2024-09-21T15:10:08.487 INFO:teuthology.orchestra.run.smithi161.stdout:5251 write 0x2567209 thru 0x256eb39 (0x7931 bytes) 2024-09-21T15:10:08.490 INFO:teuthology.orchestra.run.smithi161.stdout:4901 write 0xbc86ab8 thru 0xbc8e897 (0x7de0 bytes) 2024-09-21T15:10:08.499 INFO:teuthology.orchestra.run.smithi161.stdout:5252 read 0x675ee87 thru 0x6762454 (0x35ce bytes) 2024-09-21T15:10:08.500 INFO:teuthology.orchestra.run.smithi161.stdout:5253 write 0xd414c49 thru 0xd41ac07 (0x5fbf bytes) 2024-09-21T15:10:08.509 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.509 INFO:teuthology.orchestra.run.smithi161.stdout:5228 read 0x2b50d31 thru 0x2b55fb7 (0x5287 bytes) 2024-09-21T15:10:08.509 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.509 INFO:teuthology.orchestra.run.smithi161.stdout:5333 read 0x5b17f4c thru 0x5b1e38d (0x6442 bytes) 2024-09-21T15:10:08.509 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.510 INFO:teuthology.orchestra.run.smithi161.stdout:5334 writesame 0x7d88147 thru 0x7d8d8c2 data_size 0x4(0x577c bytes) 2024-09-21T15:10:08.513 INFO:teuthology.orchestra.run.smithi161.stdout:4902 clone 38 order 22 su 65536 sc 4 2024-09-21T15:10:08.517 INFO:teuthology.orchestra.run.smithi161.stdout:5254 punch from 0x72e8608 to 0x72f84b0, (0xfea8 bytes) 2024-09-21T15:10:08.517 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.517 INFO:teuthology.orchestra.run.smithi161.stdout:5256 read 0x3b31ff2 thru 0x3b41521 (0xf530 bytes) 2024-09-21T15:10:08.517 INFO:teuthology.orchestra.run.smithi161.stdout:5257 read 0x562fde8 thru 0x5634beb (0x4e04 bytes) 2024-09-21T15:10:08.517 INFO:teuthology.orchestra.run.smithi161.stdout:5258 write 0x2595e4e thru 0x259fc0b (0x9dbe bytes) 2024-09-21T15:10:08.518 INFO:teuthology.orchestra.run.smithi161.stdout:5362 read 0x4381978 thru 0x4385acf (0x4158 bytes) 2024-09-21T15:10:08.519 INFO:teuthology.orchestra.run.smithi161.stdout:5230 trunc from 0x59ec2e8 to 0x9e0ecb8 2024-09-21T15:10:08.520 INFO:teuthology.orchestra.run.smithi161.stdout:5364 trunc from 0xe36936a to 0xe8bcdb1 2024-09-21T15:10:08.527 INFO:teuthology.orchestra.run.smithi161.stdout:5335 write 0x2624408 thru 0x26316d4 (0xd2cd bytes) 2024-09-21T15:10:08.545 INFO:teuthology.orchestra.run.smithi161.stdout:5259 clone 35 order 24 su 8388608 sc 7 2024-09-21T15:10:08.548 INFO:teuthology.orchestra.run.smithi161.stdout:3961 write 0x276809f thru 0x276dbd6 (0x5b38 bytes) 2024-09-21T15:10:08.551 INFO:teuthology.orchestra.run.smithi161.stdout:5336 writesame 0x2e5a1f thru 0x2ef221 data_size 0x2b(0x9803 bytes) 2024-09-21T15:10:08.568 INFO:teuthology.orchestra.run.smithi161.stdout:5337 writesame 0x86145ae thru 0x8616138 data_size 0x1(0x1b8b bytes) 2024-09-21T15:10:08.568 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.568 INFO:teuthology.orchestra.run.smithi161.stdout:5232 write 0x78b718d thru 0x78baa8b (0x38ff bytes) 2024-09-21T15:10:08.576 INFO:teuthology.orchestra.run.smithi161.stdout:5367 punch from 0x2625e6a to 0x2630a4a, (0xabe0 bytes) 2024-09-21T15:10:08.576 INFO:teuthology.orchestra.run.smithi161.stdout:5368 writesame 0x7a099e2 thru 0x7a13145 data_size 0x2(0x9764 bytes) 2024-09-21T15:10:08.579 INFO:teuthology.orchestra.run.smithi161.stdout:5234 read 0x8b9f8dc thru 0x8ba50db (0x5800 bytes) 2024-09-21T15:10:08.580 INFO:teuthology.orchestra.run.smithi161.stdout:5235 read 0x589c10e thru 0x58a0ad4 (0x49c7 bytes) 2024-09-21T15:10:08.584 INFO:teuthology.orchestra.run.smithi161.stdout:5237 write 0x5da7c54 thru 0x5daaa48 (0x2df5 bytes) 2024-09-21T15:10:08.585 INFO:teuthology.orchestra.run.smithi161.stdout:3962 trunc from 0x276dbd7 to 0xb964b5c 2024-09-21T15:10:08.585 INFO:teuthology.orchestra.run.smithi161.stdout:5339 write 0xc342a3c thru 0xc34728c (0x4851 bytes) 2024-09-21T15:10:08.599 INFO:teuthology.orchestra.run.smithi161.stdout:5238 read 0x92f44e6 thru 0x92f8a69 (0x4584 bytes) 2024-09-21T15:10:08.599 INFO:teuthology.orchestra.run.smithi161.stdout:5240 read 0x1eed960 thru 0x1ef7155 (0x97f6 bytes) 2024-09-21T15:10:08.600 INFO:teuthology.orchestra.run.smithi161.stdout:5241 write 0x6c63993 thru 0x6c6aeb2 (0x7520 bytes) 2024-09-21T15:10:08.609 INFO:teuthology.orchestra.run.smithi161.stdout:5369 write 0xe1af52c thru 0xe1baf8f (0xba64 bytes) 2024-09-21T15:10:08.623 INFO:teuthology.orchestra.run.smithi161.stdout:5340 read 0x57cb256 thru 0x57d2a44 (0x77ef bytes) 2024-09-21T15:10:08.623 INFO:teuthology.orchestra.run.smithi161.stdout:5341 write 0x62afba6 thru 0x62b066e (0xac9 bytes) 2024-09-21T15:10:08.628 INFO:teuthology.orchestra.run.smithi161.stdout:5243 clone 28 order 19 su 2048 sc 14 2024-09-21T15:10:08.654 INFO:teuthology.orchestra.run.smithi161.stdout:5370 write 0xa4d3485 thru 0xa4e3425 (0xffa1 bytes) 2024-09-21T15:10:08.662 INFO:teuthology.orchestra.run.smithi161.stdout:5342 punch from 0x56e1421 to 0x56ed3e8, (0xbfc7 bytes) 2024-09-21T15:10:08.662 INFO:teuthology.orchestra.run.smithi161.stdout:5345 punch from 0xaf54c31 to 0xaf581b6, (0x3585 bytes) 2024-09-21T15:10:08.662 INFO:teuthology.orchestra.run.smithi161.stdout:5346 punch from 0xa7a88ac to 0xa7ae6a5, (0x5df9 bytes) 2024-09-21T15:10:08.662 INFO:teuthology.orchestra.run.smithi161.stdout:5347 writesame 0x7506e5c thru 0x750a7b0 data_size 0x1(0x3955 bytes) 2024-09-21T15:10:08.668 INFO:teuthology.orchestra.run.smithi161.stdout:3963 write 0x45c5d0b thru 0x45d0eb7 (0xb1ad bytes) 2024-09-21T15:10:08.692 INFO:teuthology.orchestra.run.smithi161.stdout:5348 trunc from 0xcbbdb56 to 0xcbb3041 2024-09-21T15:10:08.693 INFO:teuthology.orchestra.run.smithi161.stdout:3964 punch from 0x2ee0c1b to 0x2ee9f8d, (0x9372 bytes) 2024-09-21T15:10:08.693 INFO:teuthology.orchestra.run.smithi161.stdout:3965 write 0x7872e43 thru 0x787fdc3 (0xcf81 bytes) 2024-09-21T15:10:08.719 INFO:teuthology.orchestra.run.smithi161.stdout:5373 trunc from 0xe8bcdb1 to 0x369d6 2024-09-21T15:10:08.736 INFO:teuthology.orchestra.run.smithi161.stdout:5351 write 0xbc2aa3d thru 0xbc3a14a (0xf70e bytes) 2024-09-21T15:10:08.755 INFO:teuthology.orchestra.run.smithi161.stdout:3966 write 0xc4a7582 thru 0xc4ac17c (0x4bfb bytes) 2024-09-21T15:10:08.775 INFO:teuthology.orchestra.run.smithi161.stdout:5352 write 0xa830e09 thru 0xa8323cb (0x15c3 bytes) 2024-09-21T15:10:08.780 INFO:teuthology.orchestra.run.smithi161.stdout:3968 trunc from 0xc4ac17d to 0xc49a991 2024-09-21T15:10:08.791 INFO:teuthology.orchestra.run.smithi161.stdout:5354 write 0x1720c36 thru 0x172c8f6 (0xbcc1 bytes) 2024-09-21T15:10:08.806 INFO:teuthology.orchestra.run.smithi161.stdout:5356 read 0x36207da thru 0x3624bbd (0x43e4 bytes) 2024-09-21T15:10:08.806 INFO:teuthology.orchestra.run.smithi161.stdout:5357 read 0x56fded8 thru 0x56ff4ea (0x1613 bytes) 2024-09-21T15:10:08.807 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.807 INFO:teuthology.orchestra.run.smithi161.stdout:5359 punch from 0x9eaf990 to 0x9ebe348, (0xe9b8 bytes) 2024-09-21T15:10:08.807 INFO:teuthology.orchestra.run.smithi161.stdout:5360 read 0x54b8321 thru 0x54b982f (0x150f bytes) 2024-09-21T15:10:08.807 INFO:teuthology.orchestra.run.smithi161.stdout:5367 write 0xd371c5 thru 0xd3ff3b (0x8d77 bytes) 2024-09-21T15:10:08.822 INFO:teuthology.orchestra.run.smithi161.stdout:5368 write 0x72c1cb9 thru 0x72d1a6e (0xfdb6 bytes) 2024-09-21T15:10:08.824 INFO:teuthology.orchestra.run.smithi161.stdout:3969 punch from 0x4288640 to 0x429360d, (0xafcd bytes) 2024-09-21T15:10:08.824 INFO:teuthology.orchestra.run.smithi161.stdout:3972 punch from 0xab60ec8 to 0xab6bacf, (0xac07 bytes) 2024-09-21T15:10:08.824 INFO:teuthology.orchestra.run.smithi161.stdout:3973 read 0x174473 thru 0x17d58a (0x9118 bytes) 2024-09-21T15:10:08.828 INFO:teuthology.orchestra.run.smithi161.stdout:3974 punch from 0x80c9958 to 0x80cf9a5, (0x604d bytes) 2024-09-21T15:10:08.829 INFO:teuthology.orchestra.run.smithi161.stdout:5376 trunc from 0x369d6 to 0xa3cfcfb 2024-09-21T15:10:08.832 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone34 from 0xe478809 (overlap 0x244a61) to 0x196743 2024-09-21T15:10:08.839 INFO:teuthology.orchestra.run.smithi161.stdout:5369 read 0x156dafb thru 0x157878a (0xac90 bytes) 2024-09-21T15:10:08.840 INFO:teuthology.orchestra.run.smithi161.stdout:5370 read 0x1979294 thru 0x198100d (0x7d7a bytes) 2024-09-21T15:10:08.841 INFO:teuthology.orchestra.run.smithi161.stdout:3976 trunc from 0xc49a991 to 0x52003cc 2024-09-21T15:10:08.841 INFO:teuthology.orchestra.run.smithi161.stdout:5373 write 0x22b4fa8 thru 0x22b9950 (0x49a9 bytes) 2024-09-21T15:10:08.857 INFO:teuthology.orchestra.run.smithi161.stdout:5378 read 0x2568b47 thru 0x25768b3 (0xdd6d bytes) 2024-09-21T15:10:08.858 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.859 INFO:teuthology.orchestra.run.smithi161.stdout:5381 write 0x359c43 thru 0x36574c (0xbb0a bytes) 2024-09-21T15:10:08.869 INFO:teuthology.orchestra.run.smithi161.stdout:5376 trunc from 0xcbb3041 to 0xbcde2e3 2024-09-21T15:10:08.895 INFO:teuthology.orchestra.run.smithi161.stdout:5383 trunc from 0xa3cfcfb to 0x6bc5d3e 2024-09-21T15:10:08.906 INFO:teuthology.orchestra.run.smithi161.stdout:3978 punch from 0x179655e to 0x17a2436, (0xbed8 bytes) 2024-09-21T15:10:08.906 INFO:teuthology.orchestra.run.smithi161.stdout:3980 punch from 0x3b9aa98 to 0x3ba5f8e, (0xb4f6 bytes) 2024-09-21T15:10:08.906 INFO:teuthology.orchestra.run.smithi161.stdout:3981 write 0xc46e8a thru 0xc56908 (0xfa7f bytes) 2024-09-21T15:10:08.934 INFO:teuthology.orchestra.run.smithi161.stdout:3982 trunc from 0x52003cc to 0xa547096 2024-09-21T15:10:08.941 INFO:teuthology.orchestra.run.smithi161.stdout:5377 read 0x230fea0 thru 0x231ae6a (0xafcb bytes) 2024-09-21T15:10:08.942 INFO:teuthology.orchestra.run.smithi161.stdout:5378 writesame 0x3bf817a thru 0x3c05319 data_size 0x68(0xd1a0 bytes) 2024-09-21T15:10:08.965 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:08.977 INFO:teuthology.orchestra.run.smithi161.stdout:3985 trunc from 0xa547096 to 0x44321d8 2024-09-21T15:10:08.993 INFO:teuthology.orchestra.run.smithi161.stdout:5384 writesame 0xe7f32a7 thru 0xe7f68e2 data_size 0x4e(0x363c bytes) 2024-09-21T15:10:08.997 INFO:teuthology.orchestra.run.smithi161.stdout:5385 punch from 0xb95f0eb to 0xb96c3bc, (0xd2d1 bytes) 2024-09-21T15:10:08.998 INFO:teuthology.orchestra.run.smithi161.stdout:5387 read 0x3c2e970 thru 0x3c3e3a3 (0xfa34 bytes) 2024-09-21T15:10:08.998 INFO:teuthology.orchestra.run.smithi161.stdout:5388 write 0x28d8e23 thru 0x28e66aa (0xd888 bytes) 2024-09-21T15:10:09.003 INFO:teuthology.orchestra.run.smithi161.stdout:5379 write 0xe85013b thru 0xe856955 (0x681b bytes) 2024-09-21T15:10:09.016 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #33, image image_cluster1.client.mirror.5-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent34 2024-09-21T15:10:09.020 INFO:teuthology.orchestra.run.smithi161.stdout:3986 punch from 0x43d2940 to 0x43d863b, (0x5cfb bytes) 2024-09-21T15:10:09.021 INFO:teuthology.orchestra.run.smithi161.stdout:5390 punch from 0xd7d7710 to 0xd7e64df, (0xedcf bytes) 2024-09-21T15:10:09.021 INFO:teuthology.orchestra.run.smithi161.stdout:5391 write 0xd993a61 thru 0xd99baaf (0x804f bytes) 2024-09-21T15:10:09.027 INFO:teuthology.orchestra.run.smithi161.stdout:5380 write 0x38d28bf thru 0x38d542c (0x2b6e bytes) 2024-09-21T15:10:09.039 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.031+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810dd0 2024-09-21T15:10:09.039 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.040 INFO:teuthology.orchestra.run.smithi161.stdout:5394 writesame 0x6293074 thru 0x629b2ed data_size 0x39(0x827a bytes) 2024-09-21T15:10:09.041 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.035+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1d2b0 2024-09-21T15:10:09.042 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.035+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af842270 2024-09-21T15:10:09.042 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.035+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac04e0 2024-09-21T15:10:09.042 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.035+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac0a90 2024-09-21T15:10:09.043 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.044 INFO:teuthology.orchestra.run.smithi161.stdout:5382 read 0xb2a4130 thru 0xb2b3934 (0xf805 bytes) 2024-09-21T15:10:09.044 INFO:teuthology.orchestra.run.smithi161.stdout:5383 write 0xc9a796d thru 0xc9b3d94 (0xc428 bytes) 2024-09-21T15:10:09.044 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.035+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:10:09.044 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.035+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd2b0 2024-09-21T15:10:09.047 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd450 2024-09-21T15:10:09.047 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:10:09.048 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afeebba0 2024-09-21T15:10:09.049 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b04ba750 2024-09-21T15:10:09.049 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b04bba00 2024-09-21T15:10:09.049 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc8f0 2024-09-21T15:10:09.049 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b08a2f70 2024-09-21T15:10:09.049 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07790 2024-09-21T15:10:09.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07930 2024-09-21T15:10:09.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c821a0 2024-09-21T15:10:09.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c82ea0 2024-09-21T15:10:09.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:10:09.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:10:09.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:10:09.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6ea0 2024-09-21T15:10:09.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14df380 2024-09-21T15:10:09.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1832340 2024-09-21T15:10:09.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:10:09.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cffba0 2024-09-21T15:10:09.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.043+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b21bb930 2024-09-21T15:10:09.053 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.047+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adaa2d00 2024-09-21T15:10:09.053 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.047+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adaa3860 2024-09-21T15:10:09.056 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.051+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5930 2024-09-21T15:10:09.056 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.051+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5a00 2024-09-21T15:10:09.056 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.051+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5ba0 2024-09-21T15:10:09.056 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.051+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae3e7c70 2024-09-21T15:10:09.056 INFO:teuthology.orchestra.run.smithi161.stdout:5395 write 0x5d7c73c thru 0x5d87a6f (0xb334 bytes) 2024-09-21T15:10:09.057 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.051+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae4ce820 2024-09-21T15:10:09.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.051+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae4cf450 2024-09-21T15:10:09.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.051+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810b60 2024-09-21T15:10:09.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.051+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810dd0 2024-09-21T15:10:09.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.051+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1d2b0 2024-09-21T15:10:09.066 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.059+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a4e0 2024-09-21T15:10:09.066 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.059+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af76a1a0 2024-09-21T15:10:09.067 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.059+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af842270 2024-09-21T15:10:09.067 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.059+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac04e0 2024-09-21T15:10:09.067 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.059+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac0a90 2024-09-21T15:10:09.067 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.059+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac1c70 2024-09-21T15:10:09.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:10:09.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd2b0 2024-09-21T15:10:09.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd450 2024-09-21T15:10:09.069 INFO:teuthology.orchestra.run.smithi161.stdout:5385 write 0x87bcc6d thru 0x87c51e9 (0x857d bytes) 2024-09-21T15:10:09.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:10:09.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afeebba0 2024-09-21T15:10:09.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b04ba750 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b04bba00 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc8f0 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b08a2f70 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07790 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07930 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c821a0 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c82ea0 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6ea0 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14df380 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1832340 2024-09-21T15:10:09.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:10:09.071 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cffba0 2024-09-21T15:10:09.071 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b21bb930 2024-09-21T15:10:09.071 INFO:teuthology.orchestra.run.smithi161.stdout:3987 write 0xa053390 thru 0xa05f735 (0xc3a6 bytes) 2024-09-21T15:10:09.087 INFO:teuthology.orchestra.run.smithi161.stdout:5396 read 0x16fa6e thru 0x1701e8 (0x77b bytes) 2024-09-21T15:10:09.087 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.087 INFO:teuthology.orchestra.run.smithi161.stdout:5399 writesame 0x2c3f4a6 thru 0x2c49361 data_size 0x2(0x9ebc bytes) 2024-09-21T15:10:09.089 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.083+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:10:09.098 INFO:teuthology.orchestra.run.smithi161.stdout:5386 trunc from 0xe856956 to 0x97a3761 2024-09-21T15:10:09.103 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.099+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07790 2024-09-21T15:10:09.103 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.099+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07930 2024-09-21T15:10:09.103 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.099+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c821a0 2024-09-21T15:10:09.104 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.099+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c82ea0 2024-09-21T15:10:09.104 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.099+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:10:09.104 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.099+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:10:09.109 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.103+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:10:09.111 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.111 INFO:teuthology.orchestra.run.smithi161.stdout:5402 read 0x43752d9 thru 0x438157d (0xc2a5 bytes) 2024-09-21T15:10:09.115 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.103+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049c70 2024-09-21T15:10:09.115 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.103+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6ea0 2024-09-21T15:10:09.115 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.103+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14df380 2024-09-21T15:10:09.115 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.103+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1832340 2024-09-21T15:10:09.115 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.103+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1832dd0 2024-09-21T15:10:09.115 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.103+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:10:09.115 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.103+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cffba0 2024-09-21T15:10:09.116 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.103+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202c1a0 2024-09-21T15:10:09.116 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.107+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b21bb930 2024-09-21T15:10:09.116 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266d450 2024-09-21T15:10:09.117 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266d6c0 2024-09-21T15:10:09.117 INFO:teuthology.orchestra.run.smithi161.stdout:5403 trunc from 0xe7f68e3 to 0xb3a2b7e 2024-09-21T15:10:09.118 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2858750 2024-09-21T15:10:09.118 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2860b60 2024-09-21T15:10:09.119 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2860f70 2024-09-21T15:10:09.120 INFO:teuthology.orchestra.run.smithi161.stdout:5262 read 0x37b8d05 thru 0x37bc70e (0x3a0a bytes) 2024-09-21T15:10:09.120 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2861ee0 2024-09-21T15:10:09.120 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3101a00 2024-09-21T15:10:09.121 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386820 2024-09-21T15:10:09.121 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4166f70 2024-09-21T15:10:09.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fd40 2024-09-21T15:10:09.124 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eb2b0 2024-09-21T15:10:09.124 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:09.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebe10 2024-09-21T15:10:09.128 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #36, image image_cluster1.client.mirror.4-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent37 2024-09-21T15:10:09.140 INFO:teuthology.orchestra.run.smithi161.stdout:3988 write 0xde95204 thru 0xde9b9db (0x67d8 bytes) 2024-09-21T15:10:09.150 INFO:teuthology.orchestra.run.smithi161.stdout:5263 punch from 0x8b0fb03 to 0x8b1aa56, (0xaf53 bytes) 2024-09-21T15:10:09.150 INFO:teuthology.orchestra.run.smithi161.stdout:5264 read 0xb702eef thru 0xb709202 (0x6314 bytes) 2024-09-21T15:10:09.150 INFO:teuthology.orchestra.run.smithi161.stdout:5265 write 0xe10be91 thru 0xe11a2b1 (0xe421 bytes) 2024-09-21T15:10:09.158 INFO:teuthology.orchestra.run.smithi161.stdout:5388 writesame 0xa5784a thru 0xa60a69 data_size 0x70(0x9220 bytes) 2024-09-21T15:10:09.162 INFO:teuthology.orchestra.run.smithi161.stdout:3991 read 0xa8e312e thru 0xa8f0f54 (0xde27 bytes) 2024-09-21T15:10:09.162 INFO:teuthology.orchestra.run.smithi161.stdout:3993 read 0x206b8d6 thru 0x2073d4b (0x8476 bytes) 2024-09-21T15:10:09.162 INFO:teuthology.orchestra.run.smithi161.stdout:3994 write 0x64629d6 thru 0x646d4da (0xab05 bytes) 2024-09-21T15:10:09.170 INFO:teuthology.orchestra.run.smithi161.stdout:5266 read 0x862f2b5 thru 0x86371e6 (0x7f32 bytes) 2024-09-21T15:10:09.170 INFO:teuthology.orchestra.run.smithi161.stdout:5269 punch from 0xc0694 to 0xcf80e, (0xf17a bytes) 2024-09-21T15:10:09.170 INFO:teuthology.orchestra.run.smithi161.stdout:5270 writesame 0x2ba7a0e thru 0x2ba95bc data_size 0x1(0x1baf bytes) 2024-09-21T15:10:09.176 INFO:teuthology.orchestra.run.smithi161.stdout:5404 punch from 0x5ec6d71 to 0x5eca3bf, (0x364e bytes) 2024-09-21T15:10:09.177 INFO:teuthology.orchestra.run.smithi161.stdout:5405 writesame 0x31cf53d thru 0x31d103b data_size 0x1(0x1aff bytes) 2024-09-21T15:10:09.177 INFO:teuthology.orchestra.run.smithi161.stdout:3996 write 0x84d712b thru 0x84e22bb (0xb191 bytes) 2024-09-21T15:10:09.196 INFO:teuthology.orchestra.run.smithi161.stdout:3997 read 0x64fbdfb thru 0x6508ffd (0xd203 bytes) 2024-09-21T15:10:09.196 INFO:teuthology.orchestra.run.smithi161.stdout:3998 write 0x61bed43 thru 0x61c8e67 (0xa125 bytes) 2024-09-21T15:10:09.201 INFO:teuthology.orchestra.run.smithi161.stdout:5271 writesame 0x93cac56 thru 0x93d7518 data_size 0x13(0xc8c3 bytes) 2024-09-21T15:10:09.202 INFO:teuthology.orchestra.run.smithi161.stdout:5406 trunc from 0xb3a2b7e to 0xbafd772 2024-09-21T15:10:09.218 INFO:teuthology.orchestra.run.smithi161.stdout:3999 read 0xb2ea274 thru 0xb2ec3e9 (0x2176 bytes) 2024-09-21T15:10:09.218 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.220 INFO:teuthology.orchestra.run.smithi161.stdout:4004 trunc from 0xde9b9dc to 0xcada6ba 2024-09-21T15:10:09.223 INFO:teuthology.orchestra.run.smithi161.stdout:5272 writesame 0x4f09b6f thru 0x4f171db data_size 0x1(0xd66d bytes) 2024-09-21T15:10:09.228 INFO:teuthology.orchestra.run.smithi161.stdout:5389 write 0xe6594f1 thru 0xe65f5d5 (0x60e5 bytes) 2024-09-21T15:10:09.247 INFO:teuthology.orchestra.run.smithi161.stdout:5390 writesame 0x511499b thru 0x511e683 data_size 0x1(0x9ce9 bytes) 2024-09-21T15:10:09.251 INFO:teuthology.orchestra.run.smithi161.stdout:5407 read 0xaa57b0f thru 0xaa676c7 (0xfbb9 bytes) 2024-09-21T15:10:09.273 INFO:teuthology.orchestra.run.smithi161.stdout:4005 punch from 0x222dcc4 to 0x223dcaa, (0xffe6 bytes) 2024-09-21T15:10:09.273 INFO:teuthology.orchestra.run.smithi161.stdout:4006 read 0x3cd0631 thru 0x3cd15d2 (0xfa2 bytes) 2024-09-21T15:10:09.273 INFO:teuthology.orchestra.run.smithi161.stdout:4008 punch from 0x14ac2a1 to 0x14b662c, (0xa38b bytes) 2024-09-21T15:10:09.273 INFO:teuthology.orchestra.run.smithi161.stdout:4010 read 0x9caeebc thru 0x9cafe32 (0xf77 bytes) 2024-09-21T15:10:09.273 INFO:teuthology.orchestra.run.smithi161.stdout:4012 write 0x8e9207b thru 0x8e99e0d (0x7d93 bytes) 2024-09-21T15:10:09.284 INFO:teuthology.orchestra.run.smithi161.stdout:5273 read 0x6989bf5 thru 0x6991cda (0x80e6 bytes) 2024-09-21T15:10:09.302 INFO:teuthology.orchestra.run.smithi161.stdout:5274 trunc from 0xe478809 to 0x5c0eb03 2024-09-21T15:10:09.305 INFO:teuthology.orchestra.run.smithi161.stdout:5391 read 0xa8cea55 thru 0xa8db871 (0xce1d bytes) 2024-09-21T15:10:09.306 INFO:teuthology.orchestra.run.smithi161.stdout:5392 write 0x3040868 thru 0x3041416 (0xbaf bytes) 2024-09-21T15:10:09.312 INFO:teuthology.orchestra.run.smithi161.stdout:4013 trunc from 0xcada6ba to 0x685c629 2024-09-21T15:10:09.315 INFO:teuthology.orchestra.run.smithi161.stdout:5408 write 0xcf957cc thru 0xcfa240a (0xcc3f bytes) 2024-09-21T15:10:09.322 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.322 INFO:teuthology.orchestra.run.smithi161.stdout:5395 punch from 0xd411fff to 0xd418b39, (0x6b3a bytes) 2024-09-21T15:10:09.322 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.331 INFO:teuthology.orchestra.run.smithi161.stdout:5398 trunc from 0xe65f5d6 to 0xa120627 2024-09-21T15:10:09.341 INFO:teuthology.orchestra.run.smithi161.stdout:5409 write 0x73a7af3 thru 0x73b2c24 (0xb132 bytes) 2024-09-21T15:10:09.368 INFO:teuthology.orchestra.run.smithi161.stdout:5411 writesame 0x787dca3 thru 0x7884e45 data_size 0x1(0x71a3 bytes) 2024-09-21T15:10:09.407 INFO:teuthology.orchestra.run.smithi161.stdout:5413 read 0xcca1796 thru 0xccae096 (0xc901 bytes) 2024-09-21T15:10:09.408 INFO:teuthology.orchestra.run.smithi161.stdout:5414 read 0x862ec6d thru 0x8636aea (0x7e7e bytes) 2024-09-21T15:10:09.408 INFO:teuthology.orchestra.run.smithi161.stdout:5415 punch from 0x565c909 to 0x56649c5, (0x80bc bytes) 2024-09-21T15:10:09.408 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.408 INFO:teuthology.orchestra.run.smithi161.stdout:5418 write 0x92c5b75 thru 0x92cb556 (0x59e2 bytes) 2024-09-21T15:10:09.409 INFO:teuthology.orchestra.run.smithi161.stdout:4014 read 0x66d24c0 thru 0x66db0d9 (0x8c1a bytes) 2024-09-21T15:10:09.409 INFO:teuthology.orchestra.run.smithi161.stdout:4015 punch from 0x2f94b51 to 0x2f9cd53, (0x8202 bytes) 2024-09-21T15:10:09.412 INFO:teuthology.orchestra.run.smithi161.stdout:5399 trunc from 0xa120627 to 0x7681a45 2024-09-21T15:10:09.431 INFO:teuthology.orchestra.run.smithi161.stdout:5421 punch from 0x611793b to 0x6121cfb, (0xa3c0 bytes) 2024-09-21T15:10:09.431 INFO:teuthology.orchestra.run.smithi161.stdout:5422 punch from 0x3c6d370 to 0x3c718a3, (0x4533 bytes) 2024-09-21T15:10:09.431 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.431 INFO:teuthology.orchestra.run.smithi161.stdout:5424 write 0xbcc1fd7 thru 0xbcceaa9 (0xcad3 bytes) 2024-09-21T15:10:09.440 INFO:teuthology.orchestra.run.smithi161.stdout:5276 writesame 0x9dd3405 thru 0x9de132b data_size 0x1(0xdf27 bytes) 2024-09-21T15:10:09.446 INFO:teuthology.orchestra.run.smithi161.stdout:4016 write 0x9149252 thru 0x9158595 (0xf344 bytes) 2024-09-21T15:10:09.456 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.467 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.467 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.475 INFO:teuthology.orchestra.run.smithi161.stdout:4019 trunc from 0x9158596 to 0x5d6a496 2024-09-21T15:10:09.491 INFO:teuthology.orchestra.run.smithi161.stdout:5277 write 0xd726d8f thru 0xd7368e2 (0xfb54 bytes) 2024-09-21T15:10:09.497 INFO:teuthology.orchestra.run.smithi161.stdout:5426 write 0xd57ef33 thru 0xd580748 (0x1816 bytes) 2024-09-21T15:10:09.518 INFO:teuthology.orchestra.run.smithi161.stdout:5280 trunc from 0xd7368e3 to 0xcba3c3d 2024-09-21T15:10:09.520 INFO:teuthology.orchestra.run.smithi161.stdout:5402 write 0xd5be464 thru 0xd5c4c49 (0x67e6 bytes) 2024-09-21T15:10:09.525 INFO:teuthology.orchestra.run.smithi161.stdout:5427 read 0x738d23f thru 0x7394dd5 (0x7b97 bytes) 2024-09-21T15:10:09.525 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.525 INFO:teuthology.orchestra.run.smithi161.stdout:5430 write 0xa29404e thru 0xa297d90 (0x3d43 bytes) 2024-09-21T15:10:09.546 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.553 INFO:teuthology.orchestra.run.smithi161.stdout:4020 write 0x4745bfe thru 0x47499a1 (0x3da4 bytes) 2024-09-21T15:10:09.557 INFO:teuthology.orchestra.run.smithi161.stdout:5431 trunc from 0xd580749 to 0x8d6ea8a 2024-09-21T15:10:09.558 INFO:teuthology.orchestra.run.smithi161.stdout:5405 trunc from 0xd5c4c4a to 0x77c1293 2024-09-21T15:10:09.565 INFO:teuthology.orchestra.run.smithi161.stdout:5281 write 0xbf5a6a7 thru 0xbf66bde (0xc538 bytes) 2024-09-21T15:10:09.566 INFO:teuthology.orchestra.run.smithi161.stdout:4021 read 0x25a47f thru 0x25fe56 (0x59d8 bytes) 2024-09-21T15:10:09.568 INFO:teuthology.orchestra.run.smithi161.stdout:4022 write 0x4707388 thru 0x470911f (0x1d98 bytes) 2024-09-21T15:10:09.590 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.602 INFO:teuthology.orchestra.run.smithi161.stdout:5285 trunc from 0xcba3c3d to 0x67600d5 2024-09-21T15:10:09.622 INFO:teuthology.orchestra.run.smithi161.stdout:4903 write 0xd404c5 thru 0xd4aded (0xa929 bytes) 2024-09-21T15:10:09.657 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.660 INFO:teuthology.orchestra.run.smithi161.stdout:4024 write 0xacd8f90 thru 0xacdd6bf (0x4730 bytes) 2024-09-21T15:10:09.687 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.687 INFO:teuthology.orchestra.run.smithi161.stdout:4027 write 0x10478d5 thru 0x104bd00 (0x442c bytes) 2024-09-21T15:10:09.697 INFO:teuthology.orchestra.run.smithi161.stdout:4904 write 0x9bbd967 thru 0x9bc7161 (0x97fb bytes) 2024-09-21T15:10:09.703 INFO:teuthology.orchestra.run.smithi161.stdout:5406 write 0xb49badb thru 0xb4aa5b2 (0xead8 bytes) 2024-09-21T15:10:09.710 INFO:teuthology.orchestra.run.smithi161.stdout:4028 read 0x820e186 thru 0x82173bb (0x9236 bytes) 2024-09-21T15:10:09.720 INFO:teuthology.orchestra.run.smithi161.stdout:5436 write 0xb8443f6 thru 0xb84d58d (0x9198 bytes) 2024-09-21T15:10:09.731 INFO:teuthology.orchestra.run.smithi161.stdout:4905 trunc from 0xbc8e898 to 0xca5df5a 2024-09-21T15:10:09.734 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.734 INFO:teuthology.orchestra.run.smithi161.stdout:5409 punch from 0xa913d17 to 0xa9225e5, (0xe8ce bytes) 2024-09-21T15:10:09.734 INFO:teuthology.orchestra.run.smithi161.stdout:5410 read 0x198d329 thru 0x199c876 (0xf54e bytes) 2024-09-21T15:10:09.735 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.735 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.735 INFO:teuthology.orchestra.run.smithi161.stdout:5415 writesame 0xb202cf2 thru 0xb204179 data_size 0x24(0x1488 bytes) 2024-09-21T15:10:09.750 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.750 INFO:teuthology.orchestra.run.smithi161.stdout:5438 read 0x560159f thru 0x560bc22 (0xa684 bytes) 2024-09-21T15:10:09.750 INFO:teuthology.orchestra.run.smithi161.stdout:5439 read 0x1546c88 thru 0x1547b16 (0xe8f bytes) 2024-09-21T15:10:09.750 INFO:teuthology.orchestra.run.smithi161.stdout:5440 read 0x959498f thru 0x959e30d (0x997f bytes) 2024-09-21T15:10:09.751 INFO:teuthology.orchestra.run.smithi161.stdout:5441 read 0x768c20f thru 0x7693d60 (0x7b52 bytes) 2024-09-21T15:10:09.751 INFO:teuthology.orchestra.run.smithi161.stdout:5442 write 0x2d5c4bf thru 0x2d6aaf4 (0xe636 bytes) 2024-09-21T15:10:09.752 INFO:teuthology.orchestra.run.smithi161.stdout:5287 write 0x679d421 thru 0x67a60eb (0x8ccb bytes) 2024-09-21T15:10:09.759 INFO:teuthology.orchestra.run.smithi161.stdout:5416 trunc from 0xb4aa5b3 to 0xa878225 2024-09-21T15:10:09.764 INFO:teuthology.orchestra.run.smithi161.stdout:5290 punch from 0x4371e23 to 0x4380b16, (0xecf3 bytes) 2024-09-21T15:10:09.764 INFO:teuthology.orchestra.run.smithi161.stdout:5293 read 0x448b645 thru 0x449504f (0x9a0b bytes) 2024-09-21T15:10:09.765 INFO:teuthology.orchestra.run.smithi161.stdout:4029 writesame 0xc7f5d27 thru 0xc7ffd27 data_size 0x1(0xa001 bytes) 2024-09-21T15:10:09.769 INFO:teuthology.orchestra.run.smithi161.stdout:4031 write 0x1b4051d thru 0x1b42420 (0x1f04 bytes) 2024-09-21T15:10:09.772 INFO:teuthology.orchestra.run.smithi161.stdout:5443 write 0x7bf6aff thru 0x7bf7cde (0x11e0 bytes) 2024-09-21T15:10:09.775 INFO:teuthology.orchestra.run.smithi161.stdout:4906 write 0x6ba30b0 thru 0x6ba478b (0x16dc bytes) 2024-09-21T15:10:09.782 INFO:teuthology.orchestra.run.smithi161.stdout:4032 read 0x1690047 thru 0x169ae99 (0xae53 bytes) 2024-09-21T15:10:09.783 INFO:teuthology.orchestra.run.smithi161.stdout:4033 write 0x6c2c99c thru 0x6c2fbef (0x3254 bytes) 2024-09-21T15:10:09.797 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:09.797 INFO:teuthology.orchestra.run.smithi161.stdout:4908 writesame 0x3da3335 thru 0x3da9b81 data_size 0x1(0x684d bytes) 2024-09-21T15:10:09.799 INFO:teuthology.orchestra.run.smithi161.stdout:4034 read 0x6436869 thru 0x643c438 (0x5bd0 bytes) 2024-09-21T15:10:09.800 INFO:teuthology.orchestra.run.smithi161.stdout:4037 write 0x7033c78 thru 0x703c5a9 (0x8932 bytes) 2024-09-21T15:10:09.821 INFO:teuthology.orchestra.run.smithi161.stdout:5295 write 0xe06a7d9 thru 0xe071aa8 (0x72d0 bytes) 2024-09-21T15:10:09.825 INFO:teuthology.orchestra.run.smithi161.stdout:5417 read 0x3b64a3a thru 0x3b743ef (0xf9b6 bytes) 2024-09-21T15:10:09.831 INFO:teuthology.orchestra.run.smithi161.stdout:5418 trunc from 0xa878225 to 0xc0e8900 2024-09-21T15:10:09.836 INFO:teuthology.orchestra.run.smithi161.stdout:4038 trunc from 0xc7ffd28 to 0x320c681 2024-09-21T15:10:09.837 INFO:teuthology.orchestra.run.smithi161.stdout:4910 write 0x25a25dc thru 0x25a5368 (0x2d8d bytes) 2024-09-21T15:10:09.850 INFO:teuthology.orchestra.run.smithi161.stdout:5445 writesame 0xd7d4db1 thru 0xd7d5943 data_size 0x1(0xb93 bytes) 2024-09-21T15:10:09.855 INFO:teuthology.orchestra.run.smithi161.stdout:5446 punch from 0x88d33b to 0x892198, (0x4e5d bytes) 2024-09-21T15:10:09.855 INFO:teuthology.orchestra.run.smithi161.stdout:5447 read 0x8bf217b thru 0x8bff600 (0xd486 bytes) 2024-09-21T15:10:09.855 INFO:teuthology.orchestra.run.smithi161.stdout:5448 write 0x6f533de thru 0x6f5913f (0x5d62 bytes) 2024-09-21T15:10:09.856 INFO:teuthology.orchestra.run.smithi161.stdout:4911 punch from 0x6ccfe3f to 0x6cd439d, (0x455e bytes) 2024-09-21T15:10:09.856 INFO:teuthology.orchestra.run.smithi161.stdout:4912 write 0x7e837c thru 0x7f7858 (0xf4dd bytes) 2024-09-21T15:10:09.864 INFO:teuthology.orchestra.run.smithi161.stdout:5296 trunc from 0xe071aa9 to 0x26e51de 2024-09-21T15:10:09.870 INFO:teuthology.orchestra.run.smithi161.stdout:5420 write 0xa1492ff thru 0xa14e2da (0x4fdc bytes) 2024-09-21T15:10:09.893 INFO:teuthology.orchestra.run.smithi161.stdout:4914 clone 39 order 20 su 65536 sc 13 2024-09-21T15:10:09.893 INFO:teuthology.orchestra.run.smithi161.stdout:5450 trunc from 0xd7d5944 to 0xb369d06 2024-09-21T15:10:09.900 INFO:teuthology.orchestra.run.smithi161.stdout:5421 write 0x9e22989 thru 0x9e2c2da (0x9952 bytes) 2024-09-21T15:10:09.927 INFO:teuthology.orchestra.run.smithi161.stdout:5422 write 0xad59dde thru 0xad5da26 (0x3c49 bytes) 2024-09-21T15:10:09.944 INFO:teuthology.orchestra.run.smithi161.stdout:4039 punch from 0x16accef to 0x16bbd80, (0xf091 bytes) 2024-09-21T15:10:09.946 INFO:teuthology.orchestra.run.smithi161.stdout:5423 write 0x262a5ff thru 0x262e5b0 (0x3fb2 bytes) 2024-09-21T15:10:09.963 INFO:teuthology.orchestra.run.smithi161.stdout:5424 punch from 0x8569c2 to 0x858dae, (0x23ec bytes) 2024-09-21T15:10:09.963 INFO:teuthology.orchestra.run.smithi161.stdout:5425 write 0x8dae7e3 thru 0x8db753a (0x8d58 bytes) 2024-09-21T15:10:09.966 INFO:teuthology.orchestra.run.smithi161.stdout:5451 read 0xa689a2e thru 0xa68b5aa (0x1b7d bytes) 2024-09-21T15:10:09.966 INFO:teuthology.orchestra.run.smithi161.stdout:5452 read 0x25ea272 thru 0x25f07ec (0x657b bytes) 2024-09-21T15:10:09.966 INFO:teuthology.orchestra.run.smithi161.stdout:5453 write 0x4e680e5 thru 0x4e775c0 (0xf4dc bytes) 2024-09-21T15:10:09.974 INFO:teuthology.orchestra.run.smithi161.stdout:5297 writesame 0x215a93b thru 0x216063c data_size 0x5(0x5d02 bytes) 2024-09-21T15:10:09.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:09.994+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a519e820 2024-09-21T15:10:09.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:09.994+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a519f5f0 2024-09-21T15:10:09.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:09.994+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a519f6c0 2024-09-21T15:10:09.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:09.994+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a5462d00 2024-09-21T15:10:09.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:09.994+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a5463ee0 2024-09-21T15:10:10.012 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:10.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a5fc96c0 2024-09-21T15:10:10.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:10.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6ea0 2024-09-21T15:10:10.019 INFO:teuthology.orchestra.run.smithi161.stdout:5426 punch from 0xb6f9f5 to 0xb79289, (0x9894 bytes) 2024-09-21T15:10:10.020 INFO:teuthology.orchestra.run.smithi161.stdout:5427 trunc from 0xc0e8900 to 0xb983157 2024-09-21T15:10:10.041 INFO:teuthology.orchestra.run.smithi161.stdout:5455 write 0xaeb6dc8 thru 0xaec2018 (0xb251 bytes) 2024-09-21T15:10:10.064 INFO:teuthology.orchestra.run.smithi161.stdout:4040 write 0xea30044 thru 0xea33460 (0x341d bytes) 2024-09-21T15:10:10.074 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:10.074 INFO:teuthology.orchestra.run.smithi161.stdout:5459 read 0xa9e4e42 thru 0xa9e7cdb (0x2e9a bytes) 2024-09-21T15:10:10.078 INFO:teuthology.orchestra.run.smithi161.stdout:4041 write 0x5518ee9 thru 0x5523c99 (0xadb1 bytes) 2024-09-21T15:10:10.081 INFO:teuthology.orchestra.run.smithi161.stdout:5429 punch from 0x908d361 to 0x9097a93, (0xa732 bytes) 2024-09-21T15:10:10.084 INFO:teuthology.orchestra.run.smithi161.stdout:5461 trunc from 0xb369d06 to 0x77eeb26 2024-09-21T15:10:10.100 INFO:teuthology.orchestra.run.smithi161.stdout:4042 read 0x85c1c1d thru 0x85c7b04 (0x5ee8 bytes) 2024-09-21T15:10:10.113 INFO:teuthology.orchestra.run.smithi161.stdout:5298 write 0xa7c9899 thru 0xa7d7ec7 (0xe62f bytes) 2024-09-21T15:10:10.122 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #26, image image_cluster1.client.mirror.1-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent27 2024-09-21T15:10:10.127 INFO:teuthology.orchestra.run.smithi161.stdout:5430 trunc from 0xb983157 to 0x21c7068 2024-09-21T15:10:10.131 INFO:teuthology.orchestra.run.smithi161.stdout:4043 trunc from 0xea33461 to 0x17165b8 2024-09-21T15:10:10.135 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.127+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e72b0 2024-09-21T15:10:10.135 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.127+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72820 2024-09-21T15:10:10.135 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.127+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72d00 2024-09-21T15:10:10.137 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.127+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72dd0 2024-09-21T15:10:10.138 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016ad41ee0 2024-09-21T15:10:10.138 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016b24fee0 2024-09-21T15:10:10.138 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016b9cdd40 2024-09-21T15:10:10.138 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016bff6000 2024-09-21T15:10:10.138 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016bff7790 2024-09-21T15:10:10.138 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016c23a000 2024-09-21T15:10:10.138 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:10:10.139 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016c6a9930 2024-09-21T15:10:10.140 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ee0 2024-09-21T15:10:10.140 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016d18f450 2024-09-21T15:10:10.140 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016dd771e0 2024-09-21T15:10:10.140 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016e328270 2024-09-21T15:10:10.142 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016e329a00 2024-09-21T15:10:10.142 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.131+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f520 2024-09-21T15:10:10.142 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.135+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed1e0 2024-09-21T15:10:10.154 INFO:teuthology.orchestra.run.smithi161.stdout:5299 trunc from 0xa7d7ec8 to 0xea156eb 2024-09-21T15:10:10.154 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.135+0000 7ff753f07700 -1 reset not still connected to 0x56016ebedee0 2024-09-21T15:10:10.154 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.135+0000 7ff753f07700 -1 reset not still connected to 0x56016feb4b60 2024-09-21T15:10:10.154 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.135+0000 7ff753f07700 -1 reset not still connected to 0x56016feb5ad0 2024-09-21T15:10:10.155 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:10.135+0000 7ff753f07700 -1 reset not still connected to 0x56017063fee0 2024-09-21T15:10:10.185 INFO:teuthology.orchestra.run.smithi161.stdout:5462 read 0x636eaa thru 0x64169a (0xa7f1 bytes) 2024-09-21T15:10:10.186 INFO:teuthology.orchestra.run.smithi161.stdout:5464 writesame 0x64761e4 thru 0x648522f data_size 0x34(0xf04c bytes) 2024-09-21T15:10:10.204 INFO:teuthology.orchestra.run.smithi161.stdout:5301 write 0xaa4410a thru 0xaa509f4 (0xc8eb bytes) 2024-09-21T15:10:10.215 INFO:teuthology.orchestra.run.smithi161.stdout:5466 punch from 0x38e7e57 to 0x38f6d21, (0xeeca bytes) 2024-09-21T15:10:10.215 INFO:teuthology.orchestra.run.smithi161.stdout:5467 read 0x6eaf660 thru 0x6eb325e (0x3bff bytes) 2024-09-21T15:10:10.215 INFO:teuthology.orchestra.run.smithi161.stdout:5468 write 0x3d00149 thru 0x3d09b41 (0x99f9 bytes) 2024-09-21T15:10:10.229 INFO:teuthology.orchestra.run.smithi161.stdout:5469 read 0xdfdf28 thru 0xe0cbed (0xecc6 bytes) 2024-09-21T15:10:10.229 INFO:teuthology.orchestra.run.smithi161.stdout:5470 punch from 0x5a9a8d6 to 0x5aa8890, (0xdfba bytes) 2024-09-21T15:10:10.230 INFO:teuthology.orchestra.run.smithi161.stdout:5302 writesame 0x90de423 thru 0x90e5f0c data_size 0x1(0x7aea bytes) 2024-09-21T15:10:10.231 INFO:teuthology.orchestra.run.smithi161.stdout:5471 trunc from 0x77eeb26 to 0x8721588 2024-09-21T15:10:10.265 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:10.281 INFO:teuthology.orchestra.run.smithi161.stdout:4044 write 0x5783a3a thru 0x57885b8 (0x4b7f bytes) 2024-09-21T15:10:10.283 INFO:teuthology.orchestra.run.smithi161.stdout:5473 writesame 0x61cc1fc thru 0x61da62f data_size 0x7f(0xe434 bytes) 2024-09-21T15:10:10.286 INFO:teuthology.orchestra.run.smithi161.stdout:5431 write 0xb20f4e6 thru 0xb21cd57 (0xd872 bytes) 2024-09-21T15:10:10.300 INFO:teuthology.orchestra.run.smithi161.stdout:5306 trunc from 0xea156eb to 0x14752b8 2024-09-21T15:10:10.308 INFO:teuthology.orchestra.run.smithi161.stdout:5474 read 0x61ff756 thru 0x6206323 (0x6bce bytes) 2024-09-21T15:10:10.308 INFO:teuthology.orchestra.run.smithi161.stdout:5475 read 0x44c7921 thru 0x44d13ef (0x9acf bytes) 2024-09-21T15:10:10.311 INFO:teuthology.orchestra.run.smithi161.stdout:5432 writesame 0x720daa2 thru 0x720e1b9 data_size 0x4(0x718 bytes) 2024-09-21T15:10:10.311 INFO:teuthology.orchestra.run.smithi161.stdout:4045 punch from 0x389e4d to 0x38d34c, (0x34ff bytes) 2024-09-21T15:10:10.311 INFO:teuthology.orchestra.run.smithi161.stdout:4048 read 0x21a6b70 thru 0x21b3159 (0xc5ea bytes) 2024-09-21T15:10:10.311 INFO:teuthology.orchestra.run.smithi161.stdout:4049 punch from 0x41587b6 to 0x415e481, (0x5ccb bytes) 2024-09-21T15:10:10.311 INFO:teuthology.orchestra.run.smithi161.stdout:4050 punch from 0x1f0cad4 to 0x1f0f4c5, (0x29f1 bytes) 2024-09-21T15:10:10.311 INFO:teuthology.orchestra.run.smithi161.stdout:4051 write 0xcc227b thru 0xccb44a (0x91d0 bytes) 2024-09-21T15:10:10.318 INFO:teuthology.orchestra.run.smithi161.stdout:5476 trunc from 0x8721588 to 0x2c46397 2024-09-21T15:10:10.324 INFO:teuthology.orchestra.run.smithi161.stdout:4053 punch from 0x5696b61 to 0x56a215c, (0xb5fb bytes) 2024-09-21T15:10:10.324 INFO:teuthology.orchestra.run.smithi161.stdout:4055 writesame 0x29de627 thru 0x29ebfec data_size 0x7d(0xd9c6 bytes) 2024-09-21T15:10:10.328 INFO:teuthology.orchestra.run.smithi161.stdout:5434 write 0x52c5ce8 thru 0x52cdff0 (0x8309 bytes) 2024-09-21T15:10:10.353 INFO:teuthology.orchestra.run.smithi161.stdout:4057 read 0x2660a2d thru 0x266c20a (0xb7de bytes) 2024-09-21T15:10:10.353 INFO:teuthology.orchestra.run.smithi161.stdout:4058 read 0x1a7fda thru 0x1b0597 (0x85be bytes) 2024-09-21T15:10:10.354 INFO:teuthology.orchestra.run.smithi161.stdout:5436 read 0x4beedd1 thru 0x4bf0626 (0x1856 bytes) 2024-09-21T15:10:10.356 INFO:teuthology.orchestra.run.smithi161.stdout:4060 read 0x565dd15 thru 0x5666240 (0x852c bytes) 2024-09-21T15:10:10.356 INFO:teuthology.orchestra.run.smithi161.stdout:4062 read 0x1e81a84 thru 0x1e8a896 (0x8e13 bytes) 2024-09-21T15:10:10.356 INFO:teuthology.orchestra.run.smithi161.stdout:4063 read 0x23952e5 thru 0x2395e3a (0xb56 bytes) 2024-09-21T15:10:10.367 INFO:teuthology.orchestra.run.smithi161.stdout:4064 trunc from 0x57885b9 to 0x6e2593 2024-09-21T15:10:10.404 INFO:teuthology.orchestra.run.smithi161.stdout:5437 write 0xc7a27be thru 0xc7ad273 (0xaab6 bytes) 2024-09-21T15:10:10.411 INFO:teuthology.orchestra.run.smithi161.stdout:5477 read 0xc9ed9 thru 0xd52dc (0xb404 bytes) 2024-09-21T15:10:10.412 INFO:teuthology.orchestra.run.smithi161.stdout:5480 punch from 0x1067a12 to 0x1069193, (0x1781 bytes) 2024-09-21T15:10:10.412 INFO:teuthology.orchestra.run.smithi161.stdout:5481 write 0x239227 thru 0x23e2b3 (0x508d bytes) 2024-09-21T15:10:10.428 INFO:teuthology.orchestra.run.smithi161.stdout:5308 write 0x1e660e9 thru 0x1e68481 (0x2399 bytes) 2024-09-21T15:10:10.429 INFO:teuthology.orchestra.run.smithi161.stdout:5484 read 0x22582cb thru 0x225f30a (0x7040 bytes) 2024-09-21T15:10:10.461 INFO:teuthology.orchestra.run.smithi161.stdout:5438 writesame 0xcb352cd thru 0xcb3d27a data_size 0x2(0x7fae bytes) 2024-09-21T15:10:10.467 INFO:teuthology.orchestra.run.smithi161.stdout:5439 punch from 0x935cfa6 to 0x935f65d, (0x26b7 bytes) 2024-09-21T15:10:10.468 INFO:teuthology.orchestra.run.smithi161.stdout:5440 punch from 0x4fb62d7 to 0x4fc5c39, (0xf962 bytes) 2024-09-21T15:10:10.468 INFO:teuthology.orchestra.run.smithi161.stdout:5441 punch from 0x68b45fb to 0x68c27a5, (0xe1aa bytes) 2024-09-21T15:10:10.468 INFO:teuthology.orchestra.run.smithi161.stdout:5442 punch from 0xaa6f576 to 0xaa702c5, (0xd4f bytes) 2024-09-21T15:10:10.468 INFO:teuthology.orchestra.run.smithi161.stdout:5444 punch from 0x981f87c to 0x98242f6, (0x4a7a bytes) 2024-09-21T15:10:10.468 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:10.472 INFO:teuthology.orchestra.run.smithi161.stdout:4065 trunc from 0x6e2593 to 0xe879191 2024-09-21T15:10:10.488 INFO:teuthology.orchestra.run.smithi161.stdout:5485 write 0x8280387 thru 0x8280ff6 (0xc70 bytes) 2024-09-21T15:10:10.506 INFO:teuthology.orchestra.run.smithi161.stdout:5486 read 0x1b2fc0e thru 0x1b3b948 (0xbd3b bytes) 2024-09-21T15:10:10.507 INFO:teuthology.orchestra.run.smithi161.stdout:4066 write 0x572d21a thru 0x573939d (0xc184 bytes) 2024-09-21T15:10:10.509 INFO:teuthology.orchestra.run.smithi161.stdout:5309 write 0xba477f2 thru 0xba52498 (0xaca7 bytes) 2024-09-21T15:10:10.519 INFO:teuthology.orchestra.run.smithi161.stdout:5487 trunc from 0x8280ff7 to 0x23c3a1f 2024-09-21T15:10:10.524 INFO:teuthology.orchestra.run.smithi161.stdout:5448 write 0xee23866 thru 0xee3225a (0xe9f5 bytes) 2024-09-21T15:10:10.528 INFO:teuthology.orchestra.run.smithi161.stdout:5311 read 0x346b585 thru 0x347a09a (0xeb16 bytes) 2024-09-21T15:10:10.529 INFO:teuthology.orchestra.run.smithi161.stdout:5312 writesame 0x53b45a3 thru 0x53b7488 data_size 0x1d(0x2ee6 bytes) 2024-09-21T15:10:10.540 INFO:teuthology.orchestra.run.smithi161.stdout:4067 trunc from 0xe879191 to 0x7550ea0 2024-09-21T15:10:10.545 INFO:teuthology.orchestra.run.smithi161.stdout:5313 write 0x618ebf3 thru 0x6195373 (0x6781 bytes) 2024-09-21T15:10:10.562 INFO:teuthology.orchestra.run.smithi161.stdout:5316 write 0xb140127 thru 0xb14dd50 (0xdc2a bytes) 2024-09-21T15:10:10.568 INFO:teuthology.orchestra.run.smithi161.stdout:5449 trunc from 0xee3225b to 0x6936387 2024-09-21T15:10:10.582 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:10.582 INFO:teuthology.orchestra.run.smithi161.stdout:5490 read 0x1edc4a2 thru 0x1ee5394 (0x8ef3 bytes) 2024-09-21T15:10:10.582 INFO:teuthology.orchestra.run.smithi161.stdout:5491 punch from 0xe9a8ac to 0xea4835, (0x9f89 bytes) 2024-09-21T15:10:10.582 INFO:teuthology.orchestra.run.smithi161.stdout:5317 read 0x4dadc14 thru 0x4dbd987 (0xfd74 bytes) 2024-09-21T15:10:10.583 INFO:teuthology.orchestra.run.smithi161.stdout:5318 writesame 0xb96164e thru 0xb9633d4 data_size 0x1(0x1d87 bytes) 2024-09-21T15:10:10.592 INFO:teuthology.orchestra.run.smithi161.stdout:4068 trunc from 0x7550ea0 to 0x80db41f 2024-09-21T15:10:10.596 INFO:teuthology.orchestra.run.smithi161.stdout:5319 read 0x4e63e2a thru 0x4e6df33 (0xa10a bytes) 2024-09-21T15:10:10.597 INFO:teuthology.orchestra.run.smithi161.stdout:5320 write 0x31d850a thru 0x31df41a (0x6f11 bytes) 2024-09-21T15:10:10.608 INFO:teuthology.orchestra.run.smithi161.stdout:5323 read 0x73ae053 thru 0x73b5af1 (0x7a9f bytes) 2024-09-21T15:10:10.608 INFO:teuthology.orchestra.run.smithi161.stdout:5324 read 0x6031f6a thru 0x6037655 (0x56ec bytes) 2024-09-21T15:10:10.609 INFO:teuthology.orchestra.run.smithi161.stdout:5325 read 0xb873bb9 thru 0xb882a81 (0xeec9 bytes) 2024-09-21T15:10:10.611 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:10.611 INFO:teuthology.orchestra.run.smithi161.stdout:5328 punch from 0x44bbd80 to 0x44ca06b, (0xe2eb bytes) 2024-09-21T15:10:10.611 INFO:teuthology.orchestra.run.smithi161.stdout:5329 writesame 0x6691fbe thru 0x66969b3 data_size 0x1(0x49f6 bytes) 2024-09-21T15:10:10.616 INFO:teuthology.orchestra.run.smithi161.stdout:5245 write 0x2bad754 thru 0x2bb254a (0x4df7 bytes) 2024-09-21T15:10:10.634 INFO:teuthology.orchestra.run.smithi161.stdout:4069 writesame 0x6970b5a thru 0x6972b1b data_size 0xf(0x1fc2 bytes) 2024-09-21T15:10:10.651 INFO:teuthology.orchestra.run.smithi161.stdout:5330 read 0x778cabb thru 0x778dbd8 (0x111e bytes) 2024-09-21T15:10:10.651 INFO:teuthology.orchestra.run.smithi161.stdout:5331 punch from 0x6b27204 to 0x6b31958, (0xa754 bytes) 2024-09-21T15:10:10.652 INFO:teuthology.orchestra.run.smithi161.stdout:5332 writesame 0x6560369 thru 0x656dc1e data_size 0x1(0xd8b6 bytes) 2024-09-21T15:10:10.664 INFO:teuthology.orchestra.run.smithi161.stdout:5450 trunc from 0x6936387 to 0x9fc4b6f 2024-09-21T15:10:10.680 INFO:teuthology.orchestra.run.smithi161.stdout:4071 read 0x2f9604b thru 0x2fa0d15 (0xaccb bytes) 2024-09-21T15:10:10.680 INFO:teuthology.orchestra.run.smithi161.stdout:4072 read 0x19860a thru 0x1a4570 (0xbf67 bytes) 2024-09-21T15:10:10.681 INFO:teuthology.orchestra.run.smithi161.stdout:5493 write 0xed8c89d thru 0xed9a8cf (0xe033 bytes) 2024-09-21T15:10:10.683 INFO:teuthology.orchestra.run.smithi161.stdout:4075 write 0x5a1770e thru 0x5a2273a (0xb02d bytes) 2024-09-21T15:10:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:5334 punch from 0x299b8e9 to 0x299fd18, (0x442f bytes) 2024-09-21T15:10:10.721 INFO:teuthology.orchestra.run.smithi161.stdout:5335 read 0x1a81f1d thru 0x1a848d9 (0x29bd bytes) 2024-09-21T15:10:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:5336 punch from 0x5acaace to 0x5acf6c3, (0x4bf5 bytes) 2024-09-21T15:10:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:5337 punch from 0x8ef3276 to 0x8ef8934, (0x56be bytes) 2024-09-21T15:10:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:5340 punch from 0x6ca8d24 to 0x6cb87ab, (0xfa87 bytes) 2024-09-21T15:10:10.724 INFO:teuthology.orchestra.run.smithi161.stdout:5341 write 0xb59043f thru 0xb597aa8 (0x766a bytes) 2024-09-21T15:10:10.749 INFO:teuthology.orchestra.run.smithi161.stdout:5497 read 0x1d40d21 thru 0x1d4131d (0x5fd bytes) 2024-09-21T15:10:10.754 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:10.754 INFO:teuthology.orchestra.run.smithi161.stdout:5452 read 0x504d958 thru 0x504f1de (0x1887 bytes) 2024-09-21T15:10:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:5453 trunc from 0x9fc4b6f to 0x56f9de3 2024-09-21T15:10:10.847 INFO:teuthology.orchestra.run.smithi161.stdout:5499 writesame 0xed98cde thru 0xed9fe0d data_size 0x8(0x7130 bytes) 2024-09-21T15:10:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:5500 punch from 0xa9eba75 to 0xa9f12cd, (0x5858 bytes) 2024-09-21T15:10:10.863 INFO:teuthology.orchestra.run.smithi161.stdout:5501 write 0xbd5c3f9 thru 0xbd6ac42 (0xe84a bytes) 2024-09-21T15:10:10.874 INFO:teuthology.orchestra.run.smithi161.stdout:5454 read 0x301594d thru 0x302398b (0xe03f bytes) 2024-09-21T15:10:10.874 INFO:teuthology.orchestra.run.smithi161.stdout:5455 read 0x37a466d thru 0x37ab898 (0x722c bytes) 2024-09-21T15:10:10.874 INFO:teuthology.orchestra.run.smithi161.stdout:5456 read 0x126cd55 thru 0x126de0e (0x10ba bytes) 2024-09-21T15:10:10.884 INFO:teuthology.orchestra.run.smithi161.stdout:5458 trunc from 0x56f9de3 to 0x84b1781 2024-09-21T15:10:10.951 INFO:teuthology.orchestra.run.smithi161.stdout:4077 write 0xc5311e9 thru 0xc53972c (0x8544 bytes) 2024-09-21T15:10:10.969 INFO:teuthology.orchestra.run.smithi161.stdout:5459 read 0x6d730b3 thru 0x6d79484 (0x63d2 bytes) 2024-09-21T15:10:10.969 INFO:teuthology.orchestra.run.smithi161.stdout:5461 write 0xed9bbb thru 0xee562d (0xba73 bytes) 2024-09-21T15:10:10.974 INFO:teuthology.orchestra.run.smithi161.stdout:5503 read 0xce2e97b thru 0xce362a3 (0x7929 bytes) 2024-09-21T15:10:10.974 INFO:teuthology.orchestra.run.smithi161.stdout:5504 punch from 0xea5dfe5 to 0xea6bbe7, (0xdc02 bytes) 2024-09-21T15:10:10.974 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:10.974 INFO:teuthology.orchestra.run.smithi161.stdout:5506 write 0x8d4880e thru 0x8d4f0c0 (0x68b3 bytes) 2024-09-21T15:10:10.991 INFO:teuthology.orchestra.run.smithi161.stdout:5507 read 0x3c41225 thru 0x3c4acf7 (0x9ad3 bytes) 2024-09-21T15:10:10.992 INFO:teuthology.orchestra.run.smithi161.stdout:5508 punch from 0x1696172 to 0x169cf6b, (0x6df9 bytes) 2024-09-21T15:10:10.992 INFO:teuthology.orchestra.run.smithi161.stdout:5509 punch from 0x282921f to 0x282c6da, (0x34bb bytes) 2024-09-21T15:10:10.992 INFO:teuthology.orchestra.run.smithi161.stdout:5510 write 0x6bc06dd thru 0x6bc9bea (0x950e bytes) 2024-09-21T15:10:10.998 INFO:teuthology.orchestra.run.smithi161.stdout:5342 write 0xcee64bd thru 0xcef41a3 (0xdce7 bytes) 2024-09-21T15:10:11.010 INFO:teuthology.orchestra.run.smithi161.stdout:5511 write 0x24473e1 thru 0x244826a (0xe8a bytes) 2024-09-21T15:10:11.027 INFO:teuthology.orchestra.run.smithi161.stdout:5512 read 0x5278763 thru 0x527e3e2 (0x5c80 bytes) 2024-09-21T15:10:11.027 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.047 INFO:teuthology.orchestra.run.smithi161.stdout:5515 trunc from 0xed9fe0e to 0x3ae6870 2024-09-21T15:10:11.052 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.052 INFO:teuthology.orchestra.run.smithi161.stdout:5346 write 0x98f85b8 thru 0x98ff309 (0x6d52 bytes) 2024-09-21T15:10:11.055 INFO:teuthology.orchestra.run.smithi161.stdout:5462 trunc from 0x84b1781 to 0x1fd3405 2024-09-21T15:10:11.055 INFO:teuthology.orchestra.run.smithi161.stdout:5246 trunc from 0x9e0ecb8 to 0xcdefa4d 2024-09-21T15:10:11.078 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:11.074+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc13f1fba0 2024-09-21T15:10:11.086 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:11.082+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc14eecdd0 2024-09-21T15:10:11.088 INFO:teuthology.orchestra.run.smithi161.stdout:5348 trunc from 0xcef41a4 to 0x15e045e 2024-09-21T15:10:11.089 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:11.086+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc14eecea0 2024-09-21T15:10:11.089 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:11.086+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:10:11.089 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:11.086+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc15a9f380 2024-09-21T15:10:11.093 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:11.090+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc16e7a4e0 2024-09-21T15:10:11.093 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:11.090+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1766cf70 2024-09-21T15:10:11.093 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:11.090+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc18639930 2024-09-21T15:10:11.093 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:11.090+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bee4340 2024-09-21T15:10:11.094 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:11.090+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:10:11.124 INFO:teuthology.orchestra.run.smithi161.stdout:5247 clone 29 order 23 su 262144 sc 13 2024-09-21T15:10:11.128 INFO:teuthology.orchestra.run.smithi161.stdout:4079 write 0xe793c15 thru 0xe7977b1 (0x3b9d bytes) 2024-09-21T15:10:11.147 INFO:teuthology.orchestra.run.smithi161.stdout:5516 trunc from 0x3ae6870 to 0x1a17e08 2024-09-21T15:10:11.148 INFO:teuthology.orchestra.run.smithi161.stdout:4080 write 0xf06d5e thru 0xf0b0ce (0x4371 bytes) 2024-09-21T15:10:11.148 INFO:teuthology.orchestra.run.smithi161.stdout:5463 punch from 0x25ddf5 to 0x267f28, (0xa133 bytes) 2024-09-21T15:10:11.152 INFO:teuthology.orchestra.run.smithi161.stdout:5465 trunc from 0x1fd3405 to 0x1ee0ce 2024-09-21T15:10:11.157 INFO:teuthology.orchestra.run.smithi161.stdout:4082 read 0x7c87f45 thru 0x7c8a628 (0x26e4 bytes) 2024-09-21T15:10:11.157 INFO:teuthology.orchestra.run.smithi161.stdout:4083 read 0x9a74b6f thru 0x9a7f4fd (0xa98f bytes) 2024-09-21T15:10:11.157 INFO:teuthology.orchestra.run.smithi161.stdout:4084 write 0x1116d41 thru 0x111c826 (0x5ae6 bytes) 2024-09-21T15:10:11.161 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.4-clone38 intact 2024-09-21T15:10:11.191 INFO:teuthology.orchestra.run.smithi161.stdout:5518 read 0x1918649 thru 0x191c3d6 (0x3d8e bytes) 2024-09-21T15:10:11.191 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.201 INFO:teuthology.orchestra.run.smithi161.stdout:4086 trunc from 0xe7977b2 to 0x368dae 2024-09-21T15:10:11.202 INFO:teuthology.orchestra.run.smithi161.stdout:5466 write 0x177ffe thru 0x182a72 (0xaa75 bytes) 2024-09-21T15:10:11.221 INFO:teuthology.orchestra.run.smithi161.stdout:5467 punch from 0xe0410 to 0xe552b, (0x511b bytes) 2024-09-21T15:10:11.221 INFO:teuthology.orchestra.run.smithi161.stdout:5468 punch from 0x186d19 to 0x186df8, (0xdf bytes) 2024-09-21T15:10:11.221 INFO:teuthology.orchestra.run.smithi161.stdout:5470 read 0x9d66f thru 0xa89dc (0xb36e bytes) 2024-09-21T15:10:11.222 INFO:teuthology.orchestra.run.smithi161.stdout:5471 punch from 0x16d196 to 0x17312e, (0x5f98 bytes) 2024-09-21T15:10:11.222 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.222 INFO:teuthology.orchestra.run.smithi161.stdout:5474 read 0x18c905 thru 0x191962 (0x505e bytes) 2024-09-21T15:10:11.223 INFO:teuthology.orchestra.run.smithi161.stdout:5475 read 0x7ae91 thru 0x85a43 (0xabb3 bytes) 2024-09-21T15:10:11.235 INFO:teuthology.orchestra.run.smithi161.stdout:5349 write 0x65a7baa thru 0x65a9bbe (0x2015 bytes) 2024-09-21T15:10:11.237 INFO:teuthology.orchestra.run.smithi161.stdout:5521 writesame 0x4013b6f thru 0x4022903 data_size 0x1(0xed95 bytes) 2024-09-21T15:10:11.247 INFO:teuthology.orchestra.run.smithi161.stdout:5522 read 0x3405722 thru 0x340d23b (0x7b1a bytes) 2024-09-21T15:10:11.247 INFO:teuthology.orchestra.run.smithi161.stdout:5523 read 0x3dfaa97 thru 0x3e09aa9 (0xf013 bytes) 2024-09-21T15:10:11.251 INFO:teuthology.orchestra.run.smithi161.stdout:5350 read 0x119a2ea thru 0x119f42b (0x5142 bytes) 2024-09-21T15:10:11.252 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.252 INFO:teuthology.orchestra.run.smithi161.stdout:5352 read 0x30d46aa thru 0x30dc07d (0x79d4 bytes) 2024-09-21T15:10:11.258 INFO:teuthology.orchestra.run.smithi161.stdout:5525 trunc from 0x4022904 to 0x92c969d 2024-09-21T15:10:11.260 INFO:teuthology.orchestra.run.smithi161.stdout:5353 trunc from 0x65a9bbf to 0x1978b78 2024-09-21T15:10:11.292 INFO:teuthology.orchestra.run.smithi161.stdout:5476 write 0xd0e7eec thru 0xd0f0827 (0x893c bytes) 2024-09-21T15:10:11.299 INFO:teuthology.orchestra.run.smithi161.stdout:5526 read 0x543c7cf thru 0x5445fd3 (0x9805 bytes) 2024-09-21T15:10:11.299 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.299 INFO:teuthology.orchestra.run.smithi161.stdout:5529 writesame 0x6624e0b thru 0x663418e data_size 0x1e(0xf384 bytes) 2024-09-21T15:10:11.312 INFO:teuthology.orchestra.run.smithi161.stdout:5354 read 0xfa6f1e thru 0xfb2b7a (0xbc5d bytes) 2024-09-21T15:10:11.312 INFO:teuthology.orchestra.run.smithi161.stdout:5477 read 0xafc6188 thru 0xafd5e75 (0xfcee bytes) 2024-09-21T15:10:11.313 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.316 INFO:teuthology.orchestra.run.smithi161.stdout:5355 trunc from 0x1978b78 to 0x2a4754e 2024-09-21T15:10:11.319 INFO:teuthology.orchestra.run.smithi161.stdout:4089 write 0x6420579 thru 0x642c781 (0xc209 bytes) 2024-09-21T15:10:11.324 INFO:teuthology.orchestra.run.smithi161.stdout:5531 trunc from 0x92c969d to 0x74e942e 2024-09-21T15:10:11.330 INFO:teuthology.orchestra.run.smithi161.stdout:5480 trunc from 0xd0f0828 to 0x3da44eb 2024-09-21T15:10:11.331 INFO:teuthology.orchestra.run.smithi161.stdout:4090 write 0x42cb3c3 thru 0x42d537b (0x9fb9 bytes) 2024-09-21T15:10:11.352 INFO:teuthology.orchestra.run.smithi161.stdout:4091 trunc from 0x642c782 to 0x901078b 2024-09-21T15:10:11.357 INFO:teuthology.orchestra.run.smithi161.stdout:5533 read 0x5d8865f thru 0x5d94b01 (0xc4a3 bytes) 2024-09-21T15:10:11.383 INFO:teuthology.orchestra.run.smithi161.stdout:5481 clone 36 order 25 su 4194304 sc 5 2024-09-21T15:10:11.391 INFO:teuthology.orchestra.run.smithi161.stdout:5356 writesame 0x9f291c7 thru 0x9f32e40 data_size 0x1(0x9c7a bytes) 2024-09-21T15:10:11.394 INFO:teuthology.orchestra.run.smithi161.stdout:5534 write 0x8a2592c thru 0x8a26b89 (0x125e bytes) 2024-09-21T15:10:11.395 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #37, image image_cluster1.client.mirror.4-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent38 2024-09-21T15:10:11.408 INFO:teuthology.orchestra.run.smithi161.stdout:5535 punch from 0x752b7af to 0x75383b1, (0xcc02 bytes) 2024-09-21T15:10:11.408 INFO:teuthology.orchestra.run.smithi161.stdout:5536 read 0x6689af5 thru 0x669959d (0xfaa9 bytes) 2024-09-21T15:10:11.408 INFO:teuthology.orchestra.run.smithi161.stdout:5537 read 0x3a75522 thru 0x3a7b733 (0x6212 bytes) 2024-09-21T15:10:11.428 INFO:teuthology.orchestra.run.smithi161.stdout:5358 write 0xb897d23 thru 0xb89a4fe (0x27dc bytes) 2024-09-21T15:10:11.429 INFO:teuthology.orchestra.run.smithi161.stdout:4093 write 0xd17fd5b thru 0xd186134 (0x63da bytes) 2024-09-21T15:10:11.443 INFO:teuthology.orchestra.run.smithi161.stdout:4094 read 0x90aa40a thru 0x90ae6f4 (0x42eb bytes) 2024-09-21T15:10:11.443 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.443 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.443 INFO:teuthology.orchestra.run.smithi161.stdout:4099 punch from 0x6615991 to 0x661916a, (0x37d9 bytes) 2024-09-21T15:10:11.443 INFO:teuthology.orchestra.run.smithi161.stdout:4101 write 0x60f2e44 thru 0x6102438 (0xf5f5 bytes) 2024-09-21T15:10:11.452 INFO:teuthology.orchestra.run.smithi161.stdout:5540 writesame 0xe723f0e thru 0xe72a97e data_size 0x1f(0x6a71 bytes) 2024-09-21T15:10:11.457 INFO:teuthology.orchestra.run.smithi161.stdout:5542 writesame 0x7856450 thru 0x78629fc data_size 0x1d(0xc5ad bytes) 2024-09-21T15:10:11.460 INFO:teuthology.orchestra.run.smithi161.stdout:5363 trunc from 0xb89a4ff to 0x2242536 2024-09-21T15:10:11.460 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.460 INFO:teuthology.orchestra.run.smithi161.stdout:4103 read 0x7ad95 thru 0x8600d (0xb279 bytes) 2024-09-21T15:10:11.461 INFO:teuthology.orchestra.run.smithi161.stdout:4104 read 0xa66c0b7 thru 0xa673840 (0x778a bytes) 2024-09-21T15:10:11.462 INFO:teuthology.orchestra.run.smithi161.stdout:4105 punch from 0x46e12dd to 0x46e1cab, (0x9ce bytes) 2024-09-21T15:10:11.462 INFO:teuthology.orchestra.run.smithi161.stdout:4106 read 0x77ee099 thru 0x77f32f8 (0x5260 bytes) 2024-09-21T15:10:11.462 INFO:teuthology.orchestra.run.smithi161.stdout:4107 read 0x4fa8fed thru 0x4fb4a13 (0xba27 bytes) 2024-09-21T15:10:11.462 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.462 INFO:teuthology.orchestra.run.smithi161.stdout:4110 read 0x9a3ac3b thru 0x9a4812f (0xd4f5 bytes) 2024-09-21T15:10:11.462 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.462 INFO:teuthology.orchestra.run.smithi161.stdout:4114 writesame 0x311b49b thru 0x3124932 data_size 0x3c(0x9498 bytes) 2024-09-21T15:10:11.474 INFO:teuthology.orchestra.run.smithi161.stdout:5543 read 0x797cadb thru 0x797da20 (0xf46 bytes) 2024-09-21T15:10:11.474 INFO:teuthology.orchestra.run.smithi161.stdout:5544 punch from 0x9ffbb82 to 0xa00b6d6, (0xfb54 bytes) 2024-09-21T15:10:11.474 INFO:teuthology.orchestra.run.smithi161.stdout:5545 read 0xe0d59dc thru 0xe0e30f6 (0xd71b bytes) 2024-09-21T15:10:11.474 INFO:teuthology.orchestra.run.smithi161.stdout:5546 writesame 0x3c5c7ed thru 0x3c6a97c data_size 0x18(0xe190 bytes) 2024-09-21T15:10:11.476 INFO:teuthology.orchestra.run.smithi161.stdout:4115 write 0xa998fc8 thru 0xa9a338a (0xa3c3 bytes) 2024-09-21T15:10:11.492 INFO:teuthology.orchestra.run.smithi161.stdout:4116 writesame 0x6515d30 thru 0x6524c56 data_size 0x1(0xef27 bytes) 2024-09-21T15:10:11.499 INFO:teuthology.orchestra.run.smithi161.stdout:5550 punch from 0x5a0aeea to 0x5a11a9d, (0x6bb3 bytes) 2024-09-21T15:10:11.499 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.499 INFO:teuthology.orchestra.run.smithi161.stdout:5554 write 0x6f842b0 thru 0x6f89332 (0x5083 bytes) 2024-09-21T15:10:11.553 INFO:teuthology.orchestra.run.smithi161.stdout:5556 write 0x323681c thru 0x32433bb (0xcba0 bytes) 2024-09-21T15:10:11.575 INFO:teuthology.orchestra.run.smithi161.stdout:5364 writesame 0x7f299e2 thru 0x7f2ec86 data_size 0x1(0x52a5 bytes) 2024-09-21T15:10:11.575 INFO:teuthology.orchestra.run.smithi161.stdout:5558 read 0xa0b72bb thru 0xa0b76fc (0x442 bytes) 2024-09-21T15:10:11.575 INFO:teuthology.orchestra.run.smithi161.stdout:5559 read 0x7d28e02 thru 0x7d3201d (0x921c bytes) 2024-09-21T15:10:11.575 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.575 INFO:teuthology.orchestra.run.smithi161.stdout:5561 punch from 0x86724d0 to 0x8675ee2, (0x3a12 bytes) 2024-09-21T15:10:11.575 INFO:teuthology.orchestra.run.smithi161.stdout:5562 writesame 0x9d63771 thru 0x9d6853c data_size 0x1a(0x4dcc bytes) 2024-09-21T15:10:11.578 INFO:teuthology.orchestra.run.smithi161.stdout:5366 write 0x134fffa thru 0x1359a55 (0x9a5c bytes) 2024-09-21T15:10:11.590 INFO:teuthology.orchestra.run.smithi161.stdout:5367 read 0x2a67a85 thru 0x2a6be72 (0x43ee bytes) 2024-09-21T15:10:11.595 INFO:teuthology.orchestra.run.smithi161.stdout:4117 write 0xd7ce503 thru 0xd7d9f81 (0xba7f bytes) 2024-09-21T15:10:11.607 INFO:teuthology.orchestra.run.smithi161.stdout:5368 trunc from 0x7f2ec87 to 0x4d5ef3 2024-09-21T15:10:11.609 INFO:teuthology.orchestra.run.smithi161.stdout:5563 trunc from 0xe72a97f to 0x60b74ac 2024-09-21T15:10:11.610 INFO:teuthology.orchestra.run.smithi161.stdout:4118 write 0x8d493e6 thru 0x8d56e21 (0xda3c bytes) 2024-09-21T15:10:11.657 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.657 INFO:teuthology.orchestra.run.smithi161.stdout:4120 trunc from 0xd7d9f82 to 0xd5424d3 2024-09-21T15:10:11.719 INFO:teuthology.orchestra.run.smithi161.stdout:5369 read 0x199b thru 0xfaea (0xe150 bytes) 2024-09-21T15:10:11.720 INFO:teuthology.orchestra.run.smithi161.stdout:5370 read 0x16cd84 thru 0x1783b4 (0xb631 bytes) 2024-09-21T15:10:11.722 INFO:teuthology.orchestra.run.smithi161.stdout:5371 punch from 0xf0481 to 0xfd0a0, (0xcc1f bytes) 2024-09-21T15:10:11.725 INFO:teuthology.orchestra.run.smithi161.stdout:4121 trunc from 0xd5424d3 to 0xa324506 2024-09-21T15:10:11.739 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:11.738+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95a410 2024-09-21T15:10:11.740 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:11.738+0000 7f7fd044c700 -1 reset not still connected to 0x5636a0632a90 2024-09-21T15:10:11.740 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:11.738+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9636750 2024-09-21T15:10:11.740 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:11.738+0000 7f7fd044c700 -1 reset not still connected to 0x5636aebddee0 2024-09-21T15:10:11.792 INFO:teuthology.orchestra.run.smithi161.stdout:5372 write 0x1f65d6e thru 0x1f6bcfc (0x5f8f bytes) 2024-09-21T15:10:11.806 INFO:teuthology.orchestra.run.smithi161.stdout:5564 write 0xbfd2f1f thru 0xbfd52af (0x2391 bytes) 2024-09-21T15:10:11.807 INFO:teuthology.orchestra.run.smithi161.stdout:4122 punch from 0x39f56c3 to 0x39fbf71, (0x68ae bytes) 2024-09-21T15:10:11.807 INFO:teuthology.orchestra.run.smithi161.stdout:4124 punch from 0x986e536 to 0x986f615, (0x10df bytes) 2024-09-21T15:10:11.807 INFO:teuthology.orchestra.run.smithi161.stdout:4125 punch from 0x25cf665 to 0x25dd5a7, (0xdf42 bytes) 2024-09-21T15:10:11.807 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.808 INFO:teuthology.orchestra.run.smithi161.stdout:4127 write 0x2571b58 thru 0x257d47d (0xb926 bytes) 2024-09-21T15:10:11.808 INFO:teuthology.orchestra.run.smithi161.stdout:5374 punch from 0xf1a674 to 0xf1c711, (0x209d bytes) 2024-09-21T15:10:11.808 INFO:teuthology.orchestra.run.smithi161.stdout:5376 write 0x16d20ad thru 0x16e175c (0xf6b0 bytes) 2024-09-21T15:10:11.822 INFO:teuthology.orchestra.run.smithi161.stdout:5565 read 0xbaf063b thru 0xbaffd16 (0xf6dc bytes) 2024-09-21T15:10:11.823 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.823 INFO:teuthology.orchestra.run.smithi161.stdout:5568 punch from 0x9ffbc50 to 0xa007f58, (0xc308 bytes) 2024-09-21T15:10:11.823 INFO:teuthology.orchestra.run.smithi161.stdout:5569 punch from 0x31e74ea to 0x31f704f, (0xfb65 bytes) 2024-09-21T15:10:11.823 INFO:teuthology.orchestra.run.smithi161.stdout:5570 read 0x4e6afa9 thru 0x4e70240 (0x5298 bytes) 2024-09-21T15:10:11.823 INFO:teuthology.orchestra.run.smithi161.stdout:5571 read 0x5cd6cb9 thru 0x5cd9d01 (0x3049 bytes) 2024-09-21T15:10:11.824 INFO:teuthology.orchestra.run.smithi161.stdout:5572 write 0x7344266 thru 0x7352e4e (0xebe9 bytes) 2024-09-21T15:10:11.828 INFO:teuthology.orchestra.run.smithi161.stdout:4128 read 0x61f302c thru 0x61f80bf (0x5094 bytes) 2024-09-21T15:10:11.829 INFO:teuthology.orchestra.run.smithi161.stdout:4129 write 0x845e494 thru 0x8469089 (0xabf6 bytes) 2024-09-21T15:10:11.847 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.849 INFO:teuthology.orchestra.run.smithi161.stdout:5573 writesame 0x48d7286 thru 0x48e5492 data_size 0x7(0xe20d bytes) 2024-09-21T15:10:11.854 INFO:teuthology.orchestra.run.smithi161.stdout:5377 trunc from 0x1f6bcfd to 0xed0140f 2024-09-21T15:10:11.868 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:11.868 INFO:teuthology.orchestra.run.smithi161.stdout:5575 write 0x81f2d9c thru 0x81f8b6f (0x5dd4 bytes) 2024-09-21T15:10:11.877 INFO:teuthology.orchestra.run.smithi161.stdout:4915 trunc from 0xca5df5a to 0x22f6209 2024-09-21T15:10:11.890 INFO:teuthology.orchestra.run.smithi161.stdout:5576 punch from 0x49e86ec to 0x49eb4f2, (0x2e06 bytes) 2024-09-21T15:10:11.890 INFO:teuthology.orchestra.run.smithi161.stdout:5577 writesame 0x7ced7fe thru 0x7cf0fc6 data_size 0x1(0x37c9 bytes) 2024-09-21T15:10:11.894 INFO:teuthology.orchestra.run.smithi161.stdout:5378 write 0x84378a1 thru 0x84457fe (0xdf5e bytes) 2024-09-21T15:10:11.902 INFO:teuthology.orchestra.run.smithi161.stdout:4133 write 0xd7ef50c thru 0xd7fe2e5 (0xedda bytes) 2024-09-21T15:10:11.909 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.1-clone28 from 0xcdefa4d (overlap 0x9e0ecb8) to 0x0 2024-09-21T15:10:11.919 INFO:teuthology.orchestra.run.smithi161.stdout:5578 write 0x53f2274 thru 0x53fd5ee (0xb37b bytes) 2024-09-21T15:10:11.935 INFO:teuthology.orchestra.run.smithi161.stdout:4134 writesame 0xfc35fc thru 0xfd09a7 data_size 0x5c(0xd3ac bytes) 2024-09-21T15:10:11.952 INFO:teuthology.orchestra.run.smithi161.stdout:5379 trunc from 0xed0140f to 0x84e66d4 2024-09-21T15:10:11.995 INFO:teuthology.orchestra.run.smithi161.stdout:5579 trunc from 0xbfd52b0 to 0xda63e90 2024-09-21T15:10:12.005 INFO:teuthology.orchestra.run.smithi161.stdout:4135 punch from 0x53e02d0 to 0x53e5ad0, (0x5800 bytes) 2024-09-21T15:10:12.006 INFO:teuthology.orchestra.run.smithi161.stdout:4136 writesame 0x63bcd2f thru 0x63c8a8f data_size 0x1(0xbd61 bytes) 2024-09-21T15:10:12.117 INFO:teuthology.orchestra.run.smithi161.stdout:4137 write 0xc2c337a thru 0xc2c48ae (0x1535 bytes) 2024-09-21T15:10:12.183 INFO:teuthology.orchestra.run.smithi161.stdout:4139 trunc from 0xd7fe2e6 to 0x35572cc 2024-09-21T15:10:12.221 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone35 from 0x3da44eb (overlap 0x1ee0ce) to 0x159d5d 2024-09-21T15:10:12.222 INFO:teuthology.orchestra.run.smithi161.stdout:5380 punch from 0x445f62d to 0x446ca91, (0xd464 bytes) 2024-09-21T15:10:12.233 INFO:teuthology.orchestra.run.smithi161.stdout:5580 read 0x340e3fd thru 0x34125e6 (0x41ea bytes) 2024-09-21T15:10:12.233 INFO:teuthology.orchestra.run.smithi161.stdout:5581 write 0x87fde16 thru 0x87fe204 (0x3ef bytes) 2024-09-21T15:10:12.261 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:12.261 INFO:teuthology.orchestra.run.smithi161.stdout:5583 write 0x4c0b1f6 thru 0x4c15e45 (0xac50 bytes) 2024-09-21T15:10:12.326 INFO:teuthology.orchestra.run.smithi161.stdout:5584 read 0xee89e8 thru 0xef1d2c (0x9345 bytes) 2024-09-21T15:10:12.327 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:12.327 INFO:teuthology.orchestra.run.smithi161.stdout:5587 punch from 0x6a56c06 to 0x6a5b826, (0x4c20 bytes) 2024-09-21T15:10:12.327 INFO:teuthology.orchestra.run.smithi161.stdout:5589 punch from 0x6edc0b2 to 0x6ee2b3e, (0x6a8c bytes) 2024-09-21T15:10:12.327 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:12.327 INFO:teuthology.orchestra.run.smithi161.stdout:5593 writesame 0x715818b thru 0x71598bc data_size 0x1(0x1732 bytes) 2024-09-21T15:10:12.334 INFO:teuthology.orchestra.run.smithi161.stdout:5381 write 0x88687a9 thru 0x8869346 (0xb9e bytes) 2024-09-21T15:10:12.349 INFO:teuthology.orchestra.run.smithi161.stdout:5594 read 0x181d8a4 thru 0x1821ef6 (0x4653 bytes) 2024-09-21T15:10:12.351 INFO:teuthology.orchestra.run.smithi161.stdout:5597 trunc from 0xda63e90 to 0xe97f933 2024-09-21T15:10:12.375 INFO:teuthology.orchestra.run.smithi161.stdout:5382 write 0x52eb9a0 thru 0x52f50e9 (0x974a bytes) 2024-09-21T15:10:12.521 INFO:teuthology.orchestra.run.smithi161.stdout:4916 write 0x7cc573a thru 0x7ccf2f8 (0x9bbf bytes) 2024-09-21T15:10:12.555 INFO:teuthology.orchestra.run.smithi161.stdout:5383 write 0xddd40f7 thru 0xdddb075 (0x6f7f bytes) 2024-09-21T15:10:12.563 INFO:teuthology.orchestra.run.smithi161.stdout:4918 read 0x1db759e thru 0x1dc38d5 (0xc338 bytes) 2024-09-21T15:10:12.567 INFO:teuthology.orchestra.run.smithi161.stdout:4919 write 0xd577c thru 0xe5671 (0xfef6 bytes) 2024-09-21T15:10:12.570 INFO:teuthology.orchestra.run.smithi161.stdout:4140 read 0x24c9986 thru 0x24d7bee (0xe269 bytes) 2024-09-21T15:10:12.571 INFO:teuthology.orchestra.run.smithi161.stdout:4141 writesame 0x2ff019a thru 0x2ff7493 data_size 0x1(0x72fa bytes) 2024-09-21T15:10:12.593 INFO:teuthology.orchestra.run.smithi161.stdout:5598 trunc from 0xe97f933 to 0x76b5d0e 2024-09-21T15:10:12.607 INFO:teuthology.orchestra.run.smithi161.stdout:5385 trunc from 0xdddb076 to 0x25d39f4 2024-09-21T15:10:12.699 INFO:teuthology.orchestra.run.smithi161.stdout:4920 trunc from 0x7ccf2f9 to 0xa8db4a 2024-09-21T15:10:12.717 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #34, image image_cluster1.client.mirror.2-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent35 2024-09-21T15:10:12.753 INFO:teuthology.orchestra.run.smithi161.stdout:4142 write 0x486fd97 thru 0x487971a (0x9984 bytes) 2024-09-21T15:10:12.834 INFO:teuthology.orchestra.run.smithi161.stdout:4143 write 0x418967a thru 0x4195cb1 (0xc638 bytes) 2024-09-21T15:10:12.851 INFO:teuthology.orchestra.run.smithi161.stdout:5599 writesame 0xbb842b6 thru 0xbb8fcdd data_size 0xa1(0xba28 bytes) 2024-09-21T15:10:12.859 INFO:teuthology.orchestra.run.smithi161.stdout:5601 read 0xb3bcdbf thru 0xb3cc0bf (0xf301 bytes) 2024-09-21T15:10:12.859 INFO:teuthology.orchestra.run.smithi161.stdout:5602 punch from 0x78c23e0 to 0x78c305e, (0xc7e bytes) 2024-09-21T15:10:12.859 INFO:teuthology.orchestra.run.smithi161.stdout:5603 read 0xb16db44 thru 0xb1774f5 (0x99b2 bytes) 2024-09-21T15:10:12.859 INFO:teuthology.orchestra.run.smithi161.stdout:5604 writesame 0xa370d3a thru 0xa375ef9 data_size 0x30(0x51c0 bytes) 2024-09-21T15:10:12.892 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:12.905 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:12.905 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:12.970 INFO:teuthology.orchestra.run.smithi161.stdout:5606 write 0xe10df35 thru 0xe116e2f (0x8efb bytes) 2024-09-21T15:10:12.985 INFO:teuthology.orchestra.run.smithi161.stdout:5386 write 0x78bbbcc thru 0x78bdc5e (0x2093 bytes) 2024-09-21T15:10:12.998 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:12.999 INFO:teuthology.orchestra.run.smithi161.stdout:5609 read 0xa301f8b thru 0xa311e8c (0xff02 bytes) 2024-09-21T15:10:12.999 INFO:teuthology.orchestra.run.smithi161.stdout:5610 writesame 0x20f4dc7 thru 0x20fa3c3 data_size 0x1(0x55fd bytes) 2024-09-21T15:10:13.004 INFO:teuthology.orchestra.run.smithi161.stdout:5387 write 0x3713890 thru 0x372039d (0xcb0e bytes) 2024-09-21T15:10:13.030 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:13.075 INFO:teuthology.orchestra.run.smithi161.stdout:4146 write 0xc0706c4 thru 0xc071a67 (0x13a4 bytes) 2024-09-21T15:10:13.173 INFO:teuthology.orchestra.run.smithi161.stdout:4147 write 0x5f66e36 thru 0x5f7132d (0xa4f8 bytes) 2024-09-21T15:10:13.193 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:13.193 INFO:teuthology.orchestra.run.smithi161.stdout:5389 writesame 0x6c8904 thru 0x6d5dda data_size 0x17(0xd4d7 bytes) 2024-09-21T15:10:13.199 INFO:teuthology.orchestra.run.smithi161.stdout:5613 write 0xe385ed5 thru 0xe38c2c7 (0x63f3 bytes) 2024-09-21T15:10:13.219 INFO:teuthology.orchestra.run.smithi161.stdout:4921 punch from 0x172f28 to 0x17ba91, (0x8b69 bytes) 2024-09-21T15:10:13.219 INFO:teuthology.orchestra.run.smithi161.stdout:4922 trunc from 0xa8db4a to 0xcb3d73 2024-09-21T15:10:13.256 INFO:teuthology.orchestra.run.smithi161.stdout:5614 read 0x2ee9891 thru 0x2ef7ab8 (0xe228 bytes) 2024-09-21T15:10:13.258 INFO:teuthology.orchestra.run.smithi161.stdout:5615 trunc from 0xe38c2c8 to 0xd4eb34e 2024-09-21T15:10:13.301 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:13.301 INFO:teuthology.orchestra.run.smithi161.stdout:4149 write 0x8e74557 thru 0x8e7c1d6 (0x7c80 bytes) 2024-09-21T15:10:13.352 INFO:teuthology.orchestra.run.smithi161.stdout:4150 punch from 0x686aa81 to 0x6871dbf, (0x733e bytes) 2024-09-21T15:10:13.352 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:13.352 INFO:teuthology.orchestra.run.smithi161.stdout:4154 write 0x1808bfd thru 0x180e654 (0x5a58 bytes) 2024-09-21T15:10:13.360 INFO:teuthology.orchestra.run.smithi161.stdout:5390 writesame 0xa3d1570 thru 0xa3d49cd data_size 0x1(0x345e bytes) 2024-09-21T15:10:13.363 INFO:teuthology.orchestra.run.smithi161.stdout:5391 punch from 0x45befd5 to 0x45c9691, (0xa6bc bytes) 2024-09-21T15:10:13.363 INFO:teuthology.orchestra.run.smithi161.stdout:5392 read 0x62db071 thru 0x62e2c0d (0x7b9d bytes) 2024-09-21T15:10:13.363 INFO:teuthology.orchestra.run.smithi161.stdout:5394 read 0xa277f83 thru 0xa28672f (0xe7ad bytes) 2024-09-21T15:10:13.378 INFO:teuthology.orchestra.run.smithi161.stdout:5395 trunc from 0xa3d49ce to 0x3a92039 2024-09-21T15:10:13.388 INFO:teuthology.orchestra.run.smithi161.stdout:5616 read 0x8cd0873 thru 0x8cd414b (0x38d9 bytes) 2024-09-21T15:10:13.388 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:13.388 INFO:teuthology.orchestra.run.smithi161.stdout:5618 punch from 0x76a6557 to 0x76ab9f1, (0x549a bytes) 2024-09-21T15:10:13.389 INFO:teuthology.orchestra.run.smithi161.stdout:5619 write 0xa6ecced thru 0xa6f765a (0xa96e bytes) 2024-09-21T15:10:13.418 INFO:teuthology.orchestra.run.smithi161.stdout:5620 punch from 0x2498083 to 0x2498c5d, (0xbda bytes) 2024-09-21T15:10:13.418 INFO:teuthology.orchestra.run.smithi161.stdout:5621 read 0x7d44da2 thru 0x7d4611e (0x137d bytes) 2024-09-21T15:10:13.419 INFO:teuthology.orchestra.run.smithi161.stdout:5622 read 0x8f5d44b thru 0x8f657ee (0x83a4 bytes) 2024-09-21T15:10:13.419 INFO:teuthology.orchestra.run.smithi161.stdout:5624 read 0xbbfd59b thru 0xbbfffbf (0x2a25 bytes) 2024-09-21T15:10:13.419 INFO:teuthology.orchestra.run.smithi161.stdout:5626 read 0x900e191 thru 0x90115bb (0x342b bytes) 2024-09-21T15:10:13.419 INFO:teuthology.orchestra.run.smithi161.stdout:5628 read 0x61c6d9f thru 0x61c9623 (0x2885 bytes) 2024-09-21T15:10:13.419 INFO:teuthology.orchestra.run.smithi161.stdout:5629 read 0x3a88323 thru 0x3a8ef1e (0x6bfc bytes) 2024-09-21T15:10:13.420 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:13.420 INFO:teuthology.orchestra.run.smithi161.stdout:5632 read 0x1ff1981 thru 0x1ffd281 (0xb901 bytes) 2024-09-21T15:10:13.453 INFO:teuthology.orchestra.run.smithi161.stdout:4155 punch from 0x71de7a1 to 0x71df05e, (0x8bd bytes) 2024-09-21T15:10:13.453 INFO:teuthology.orchestra.run.smithi161.stdout:4157 write 0x6debba8 thru 0x6deed3d (0x3196 bytes) 2024-09-21T15:10:13.460 INFO:teuthology.orchestra.run.smithi161.stdout:4924 read 0xbad9c8 thru 0xbb5a05 (0x803e bytes) 2024-09-21T15:10:13.472 INFO:teuthology.orchestra.run.smithi161.stdout:5633 flatten 2024-09-21T15:10:13.483 INFO:teuthology.orchestra.run.smithi161.stdout:4925 writesame 0x209348 thru 0x215f50 data_size 0x17(0xcc09 bytes) 2024-09-21T15:10:13.493 INFO:teuthology.orchestra.run.smithi161.stdout:4158 writesame 0x127f622 thru 0x1285bec data_size 0x17(0x65cb bytes) 2024-09-21T15:10:13.521 INFO:teuthology.orchestra.run.smithi161.stdout:4159 punch from 0x87aa29d to 0x87b469d, (0xa400 bytes) 2024-09-21T15:10:13.521 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:13.521 INFO:teuthology.orchestra.run.smithi161.stdout:4161 read 0x93cb765 thru 0x93cca71 (0x130d bytes) 2024-09-21T15:10:13.521 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:13.522 INFO:teuthology.orchestra.run.smithi161.stdout:4163 read 0xacfd600 thru 0xacff4ca (0x1ecb bytes) 2024-09-21T15:10:13.522 INFO:teuthology.orchestra.run.smithi161.stdout:4164 read 0x6a34585 thru 0x6a398c0 (0x533c bytes) 2024-09-21T15:10:13.522 INFO:teuthology.orchestra.run.smithi161.stdout:4166 punch from 0x7cb2929 to 0x7cb6807, (0x3ede bytes) 2024-09-21T15:10:13.522 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:10:13.519+0000 7f68be626700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5581cb2ccb40 handle_clone_image: failed to clone image mirror/10b6b67bb455 to image_cluster1.client.mirror.4-clone39 2024-09-21T15:10:13.524 INFO:teuthology.orchestra.run.smithi161.stdout:4167 trunc from 0xc071a68 to 0xd3a5d4b 2024-09-21T15:10:13.535 INFO:teuthology.orchestra.run.smithi161.stdout:5397 punch from 0x1c6384f to 0x1c6ba72, (0x8223 bytes) 2024-09-21T15:10:13.545 INFO:teuthology.orchestra.run.smithi161.stdout:5634 read 0xa01d405 thru 0xa01e958 (0x1554 bytes) 2024-09-21T15:10:13.547 INFO:teuthology.orchestra.run.smithi161.stdout:5636 trunc from 0xd4eb34e to 0xe61abdb 2024-09-21T15:10:13.586 INFO:teuthology.orchestra.run.smithi161.stdout:5637 read 0x1affde3 thru 0x1b04e17 (0x5035 bytes) 2024-09-21T15:10:13.686 INFO:teuthology.orchestra.run.smithi161.stdout:5399 write 0x4a93728 thru 0x4aa1f68 (0xe841 bytes) 2024-09-21T15:10:13.730 INFO:teuthology.orchestra.run.smithi161.stdout:5638 write 0xeda21fc thru 0xeda6047 (0x3e4c bytes) 2024-09-21T15:10:13.731 INFO:teuthology.orchestra.run.smithi161.stdout:5401 punch from 0x2c4b182 to 0x2c50b63, (0x59e1 bytes) 2024-09-21T15:10:13.731 INFO:teuthology.orchestra.run.smithi161.stdout:5402 read 0x316f95 thru 0x324927 (0xd993 bytes) 2024-09-21T15:10:13.731 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:13.732 INFO:teuthology.orchestra.run.smithi161.stdout:5404 punch from 0x34e7394 to 0x34f6ab8, (0xf724 bytes) 2024-09-21T15:10:13.732 INFO:teuthology.orchestra.run.smithi161.stdout:5405 read 0x18e70d9 thru 0x18eb5f3 (0x451b bytes) 2024-09-21T15:10:13.733 INFO:teuthology.orchestra.run.smithi161.stdout:5406 clone 36 order 24 su 262144 sc 5 2024-09-21T15:10:13.754 INFO:teuthology.orchestra.run.smithi161.stdout:5639 write 0x897094c thru 0x897f30e (0xe9c3 bytes) 2024-09-21T15:10:13.768 INFO:teuthology.orchestra.run.smithi161.stdout:4927 writesame 0x2f57d0e thru 0x2f61572 data_size 0x1(0x9865 bytes) 2024-09-21T15:10:13.772 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:13.772 INFO:teuthology.orchestra.run.smithi161.stdout:4170 write 0x24bdf39 thru 0x24be42a (0x4f2 bytes) 2024-09-21T15:10:13.780 INFO:teuthology.orchestra.run.smithi161.stdout:5640 punch from 0x60413ef to 0x6050906, (0xf517 bytes) 2024-09-21T15:10:13.780 INFO:teuthology.orchestra.run.smithi161.stdout:5641 write 0x1141158 thru 0x11411d3 (0x7c bytes) 2024-09-21T15:10:13.794 INFO:teuthology.orchestra.run.smithi161.stdout:5482 clone 37 order 19 su 2048 sc 4 2024-09-21T15:10:13.795 INFO:teuthology.orchestra.run.smithi161.stdout:4171 trunc from 0xd3a5d4b to 0xab4fa39 2024-09-21T15:10:13.795 INFO:teuthology.orchestra.run.smithi161.stdout:4928 trunc from 0x2f61573 to 0x8440b43 2024-09-21T15:10:13.809 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:13.809 INFO:teuthology.orchestra.run.smithi161.stdout:5643 read 0x5839cb7 thru 0x583acf5 (0x103f bytes) 2024-09-21T15:10:13.809 INFO:teuthology.orchestra.run.smithi161.stdout:5644 writesame 0x9441ecc thru 0x9448f50 data_size 0x7(0x7085 bytes) 2024-09-21T15:10:13.824 INFO:teuthology.orchestra.run.smithi161.stdout:5646 read 0x9449a3b thru 0x9450d36 (0x72fc bytes) 2024-09-21T15:10:13.825 INFO:teuthology.orchestra.run.smithi161.stdout:5647 read 0xd2084a3 thru 0xd20a8cb (0x2429 bytes) 2024-09-21T15:10:13.825 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:13.825 INFO:teuthology.orchestra.run.smithi161.stdout:5649 writesame 0x13152c3 thru 0x131908c data_size 0x2(0x3dca bytes) 2024-09-21T15:10:13.851 INFO:teuthology.orchestra.run.smithi161.stdout:5650 write 0x7a4b40a thru 0x7a578ff (0xc4f6 bytes) 2024-09-21T15:10:13.896 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:13.916 INFO:teuthology.orchestra.run.smithi161.stdout:5652 trunc from 0xeda6048 to 0x472e523 2024-09-21T15:10:14.025 INFO:teuthology.orchestra.run.smithi161.stdout:4172 punch from 0x947fb25 to 0x9488318, (0x87f3 bytes) 2024-09-21T15:10:14.026 INFO:teuthology.orchestra.run.smithi161.stdout:4173 write 0x6a7f101 thru 0x6a87b69 (0x8a69 bytes) 2024-09-21T15:10:14.120 INFO:teuthology.orchestra.run.smithi161.stdout:4174 write 0x457edce thru 0x458b37a (0xc5ad bytes) 2024-09-21T15:10:14.165 INFO:teuthology.orchestra.run.smithi161.stdout:4175 write 0x2430840 thru 0x243577d (0x4f3e bytes) 2024-09-21T15:10:14.189 INFO:teuthology.orchestra.run.smithi161.stdout:4176 punch from 0x2963eec to 0x2972c66, (0xed7a bytes) 2024-09-21T15:10:14.189 INFO:teuthology.orchestra.run.smithi161.stdout:4177 punch from 0x8c92dce to 0x8c9f869, (0xca9b bytes) 2024-09-21T15:10:14.189 INFO:teuthology.orchestra.run.smithi161.stdout:4178 writesame 0x213eec6 thru 0x2148f3f data_size 0x7b(0xa07a bytes) 2024-09-21T15:10:14.199 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:14.199 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:14.211 INFO:teuthology.orchestra.run.smithi161.stdout:4929 punch from 0x52ff3e9 to 0x53012a7, (0x1ebe bytes) 2024-09-21T15:10:14.211 INFO:teuthology.orchestra.run.smithi161.stdout:4930 write 0x1dc6f53 thru 0x1dce05f (0x710d bytes) 2024-09-21T15:10:14.223 INFO:teuthology.orchestra.run.smithi161.stdout:5653 writesame 0x627d04f thru 0x627e313 data_size 0x5(0x12c5 bytes) 2024-09-21T15:10:14.281 INFO:teuthology.orchestra.run.smithi161.stdout:4931 writesame 0x5e06706 thru 0x5e09505 data_size 0x2e(0x2e00 bytes) 2024-09-21T15:10:14.324 INFO:teuthology.orchestra.run.smithi161.stdout:4181 write 0xb02060c thru 0xb02ed73 (0xe768 bytes) 2024-09-21T15:10:14.357 INFO:teuthology.orchestra.run.smithi161.stdout:5654 writesame 0x9b6c4f1 thru 0x9b6ffc9 data_size 0x17(0x3ad9 bytes) 2024-09-21T15:10:14.364 INFO:teuthology.orchestra.run.smithi161.stdout:5656 writesame 0x5a42727 thru 0x5a43f8f data_size 0x1(0x1869 bytes) 2024-09-21T15:10:14.365 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:14.453 INFO:teuthology.orchestra.run.smithi161.stdout:4182 trunc from 0xb02ed74 to 0x7bf707d 2024-09-21T15:10:14.453 INFO:teuthology.orchestra.run.smithi161.stdout:5658 writesame 0xc45b777 thru 0xc4675f8 data_size 0x5(0xbe82 bytes) 2024-09-21T15:10:14.458 INFO:teuthology.orchestra.run.smithi161.stdout:5659 read 0x8eedb5c thru 0x8efc6f4 (0xeb99 bytes) 2024-09-21T15:10:14.458 INFO:teuthology.orchestra.run.smithi161.stdout:5661 read 0x3fb0f1d thru 0x3fbd676 (0xc75a bytes) 2024-09-21T15:10:14.458 INFO:teuthology.orchestra.run.smithi161.stdout:5662 write 0xdcd93e thru 0xdd2e37 (0x54fa bytes) 2024-09-21T15:10:14.487 INFO:teuthology.orchestra.run.smithi161.stdout:5665 punch from 0xa439238 to 0xa43c89b, (0x3663 bytes) 2024-09-21T15:10:14.487 INFO:teuthology.orchestra.run.smithi161.stdout:5670 read 0x7368369 thru 0x7370475 (0x810d bytes) 2024-09-21T15:10:14.487 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:14.487 INFO:teuthology.orchestra.run.smithi161.stdout:5672 write 0x28423a thru 0x29396b (0xf732 bytes) 2024-09-21T15:10:14.509 INFO:teuthology.orchestra.run.smithi161.stdout:4933 write 0xdd19e44 thru 0xdd2777d (0xd93a bytes) 2024-09-21T15:10:14.554 INFO:teuthology.orchestra.run.smithi161.stdout:5673 read 0x854dd47 thru 0x8551476 (0x3730 bytes) 2024-09-21T15:10:14.554 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:14.554 INFO:teuthology.orchestra.run.smithi161.stdout:5676 read 0x7896025 thru 0x789c1d9 (0x61b5 bytes) 2024-09-21T15:10:14.554 INFO:teuthology.orchestra.run.smithi161.stdout:5677 read 0x8eee842 thru 0x8efc148 (0xd907 bytes) 2024-09-21T15:10:14.580 INFO:teuthology.orchestra.run.smithi161.stdout:4934 write 0xce850b5 thru 0xce8e6c1 (0x960d bytes) 2024-09-21T15:10:14.620 INFO:teuthology.orchestra.run.smithi161.stdout:4935 write 0x1305dc9 thru 0x1314aea (0xed22 bytes) 2024-09-21T15:10:14.660 INFO:teuthology.orchestra.run.smithi161.stdout:5678 write 0xe8537c7 thru 0xe85e608 (0xae42 bytes) 2024-09-21T15:10:14.691 INFO:teuthology.orchestra.run.smithi161.stdout:4936 write 0x4759ce9 thru 0x476761d (0xd935 bytes) 2024-09-21T15:10:14.709 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:14.709 INFO:teuthology.orchestra.run.smithi161.stdout:4184 read 0x374c36e thru 0x375bfd1 (0xfc64 bytes) 2024-09-21T15:10:14.709 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:14.709 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:14.710 INFO:teuthology.orchestra.run.smithi161.stdout:4190 read 0x6e48429 thru 0x6e57e2c (0xfa04 bytes) 2024-09-21T15:10:14.712 INFO:teuthology.orchestra.run.smithi161.stdout:4191 writesame 0x7bb7cd3 thru 0x7bc058d data_size 0x1d(0x88bb bytes) 2024-09-21T15:10:14.718 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:14.718 INFO:teuthology.orchestra.run.smithi161.stdout:5680 punch from 0x3d0ea99 to 0x3d1b2d9, (0xc840 bytes) 2024-09-21T15:10:14.718 INFO:teuthology.orchestra.run.smithi161.stdout:5681 punch from 0x233cec9 to 0x234c134, (0xf26b bytes) 2024-09-21T15:10:14.718 INFO:teuthology.orchestra.run.smithi161.stdout:5682 read 0xe44ceb0 thru 0xe458fc8 (0xc119 bytes) 2024-09-21T15:10:14.718 INFO:teuthology.orchestra.run.smithi161.stdout:5683 write 0x974bb6c thru 0x974ed9a (0x322f bytes) 2024-09-21T15:10:14.753 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:14.753 INFO:teuthology.orchestra.run.smithi161.stdout:5685 read 0xa6668f thru 0xa6f008 (0x897a bytes) 2024-09-21T15:10:14.753 INFO:teuthology.orchestra.run.smithi161.stdout:5687 read 0x23d70b thru 0x23fe32 (0x2728 bytes) 2024-09-21T15:10:14.754 INFO:teuthology.orchestra.run.smithi161.stdout:5688 punch from 0xd39b6eb to 0xd39f3d5, (0x3cea bytes) 2024-09-21T15:10:14.768 INFO:teuthology.orchestra.run.smithi161.stdout:5689 trunc from 0xe85e609 to 0x8d4e8a8 2024-09-21T15:10:14.808 INFO:teuthology.orchestra.run.smithi161.stdout:4937 write 0x82c8464 thru 0x82c887a (0x417 bytes) 2024-09-21T15:10:14.826 INFO:teuthology.orchestra.run.smithi161.stdout:4192 write 0x30dbae8 thru 0x30e3879 (0x7d92 bytes) 2024-09-21T15:10:14.860 INFO:teuthology.orchestra.run.smithi161.stdout:4939 punch from 0x2d7bbe5 to 0x2d85b27, (0x9f42 bytes) 2024-09-21T15:10:14.866 INFO:teuthology.orchestra.run.smithi161.stdout:4940 trunc from 0xdd2777e to 0xbcc5956 2024-09-21T15:10:14.884 INFO:teuthology.orchestra.run.smithi161.stdout:5690 writesame 0x4b07d8a thru 0x4b118a2 data_size 0x5(0x9b19 bytes) 2024-09-21T15:10:14.911 INFO:teuthology.orchestra.run.smithi161.stdout:5691 read 0x2ca3312 thru 0x2ca4d48 (0x1a37 bytes) 2024-09-21T15:10:14.911 INFO:teuthology.orchestra.run.smithi161.stdout:5694 punch from 0x22e8f6 to 0x22f52b, (0xc35 bytes) 2024-09-21T15:10:14.911 INFO:teuthology.orchestra.run.smithi161.stdout:5696 read 0x4dbf1ca thru 0x4dbfd16 (0xb4d bytes) 2024-09-21T15:10:14.940 INFO:teuthology.orchestra.run.smithi161.stdout:4194 write 0x79ea6e thru 0x7a0c14 (0x21a7 bytes) 2024-09-21T15:10:14.985 INFO:teuthology.orchestra.run.smithi161.stdout:5697 write 0xbe77657 thru 0xbe865b7 (0xef61 bytes) 2024-09-21T15:10:15.017 INFO:teuthology.orchestra.run.smithi161.stdout:5698 read 0xb5e675d thru 0xb5f2417 (0xbcbb bytes) 2024-09-21T15:10:15.017 INFO:teuthology.orchestra.run.smithi161.stdout:5699 write 0x99e3450 thru 0x99ecbf5 (0x97a6 bytes) 2024-09-21T15:10:15.041 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone36 from 0x3da44eb (overlap 0x3da44eb) to 0x18a81f7 2024-09-21T15:10:15.047 INFO:teuthology.orchestra.run.smithi161.stdout:5702 clone 36 order 21 su 262144 sc 5 2024-09-21T15:10:15.172 INFO:teuthology.orchestra.run.smithi161.stdout:4195 write 0xb351e64 thru 0xb35c145 (0xa2e2 bytes) 2024-09-21T15:10:15.276 INFO:teuthology.orchestra.run.smithi161.stdout:4941 write 0x3479e7c thru 0x347e70b (0x4890 bytes) 2024-09-21T15:10:15.286 INFO:teuthology.orchestra.run.smithi161.stdout:4196 read 0x4ad031f thru 0x4adc229 (0xbf0b bytes) 2024-09-21T15:10:15.286 INFO:teuthology.orchestra.run.smithi161.stdout:4197 punch from 0x8be6b1b to 0x8bf20a2, (0xb587 bytes) 2024-09-21T15:10:15.286 INFO:teuthology.orchestra.run.smithi161.stdout:4198 write 0x371d477 thru 0x372737c (0x9f06 bytes) 2024-09-21T15:10:15.359 INFO:teuthology.orchestra.run.smithi161.stdout:4199 write 0x5f7e3ae thru 0x5f81dec (0x3a3f bytes) 2024-09-21T15:10:15.372 INFO:teuthology.orchestra.run.smithi161.stdout:4943 write 0x582b8c4 thru 0x5831784 (0x5ec1 bytes) 2024-09-21T15:10:15.389 INFO:teuthology.orchestra.run.smithi161.stdout:4200 read 0x8f4ce2d thru 0x8f55953 (0x8b27 bytes) 2024-09-21T15:10:15.389 INFO:teuthology.orchestra.run.smithi161.stdout:4202 read 0xa24ffd3 thru 0xa2591ba (0x91e8 bytes) 2024-09-21T15:10:15.389 INFO:teuthology.orchestra.run.smithi161.stdout:4203 punch from 0x8008ff2 to 0x800cecb, (0x3ed9 bytes) 2024-09-21T15:10:15.453 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone35 from 0x4aa1f69 (overlap 0x4d5ef3) to 0x45a241 2024-09-21T15:10:15.507 INFO:teuthology.orchestra.run.smithi161.stdout:4204 writesame 0xcd548d3 thru 0xcd58329 data_size 0x1d(0x3a57 bytes) 2024-09-21T15:10:15.524 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:15.524 INFO:teuthology.orchestra.run.smithi161.stdout:4206 writesame 0x72a90a thru 0x73865a data_size 0x1(0xdd51 bytes) 2024-09-21T15:10:15.610 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:15.610 INFO:teuthology.orchestra.run.smithi161.stdout:4211 write 0x961e9c thru 0x969a53 (0x7bb8 bytes) 2024-09-21T15:10:15.647 INFO:teuthology.orchestra.run.smithi161.stdout:4212 read 0x16cd68d thru 0x16d1ec5 (0x4839 bytes) 2024-09-21T15:10:15.648 INFO:teuthology.orchestra.run.smithi161.stdout:4214 read 0x911235 thru 0x91ee62 (0xdc2e bytes) 2024-09-21T15:10:15.649 INFO:teuthology.orchestra.run.smithi161.stdout:4217 write 0x39d841b thru 0x39e7ad4 (0xf6ba bytes) 2024-09-21T15:10:15.732 INFO:teuthology.orchestra.run.smithi161.stdout:4944 writesame 0xe1bbadb thru 0xe1c0876 data_size 0x2(0x4d9c bytes) 2024-09-21T15:10:15.744 INFO:teuthology.orchestra.run.smithi161.stdout:4946 write 0x974e26d thru 0x97547a1 (0x6535 bytes) 2024-09-21T15:10:15.752 INFO:teuthology.orchestra.run.smithi161.stdout:4218 trunc from 0xcd5832a to 0x1bf189e 2024-09-21T15:10:15.870 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #35, image image_cluster1.client.mirror.2-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent36 2024-09-21T15:10:15.871 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:15.871 INFO:teuthology.orchestra.run.smithi161.stdout:4949 read 0xbc711c8 thru 0xbc7673a (0x5573 bytes) 2024-09-21T15:10:15.871 INFO:teuthology.orchestra.run.smithi161.stdout:4950 write 0xc0e180c thru 0xc0e604a (0x483f bytes) 2024-09-21T15:10:15.949 INFO:teuthology.orchestra.run.smithi161.stdout:4953 read 0x52610dd thru 0x526f76d (0xe691 bytes) 2024-09-21T15:10:15.950 INFO:teuthology.orchestra.run.smithi161.stdout:4956 read 0xc97319c thru 0xc982d02 (0xfb67 bytes) 2024-09-21T15:10:15.950 INFO:teuthology.orchestra.run.smithi161.stdout:4957 punch from 0x83eff59 to 0x83f118d, (0x1234 bytes) 2024-09-21T15:10:15.950 INFO:teuthology.orchestra.run.smithi161.stdout:4958 read 0x78192b2 thru 0x78249cb (0xb71a bytes) 2024-09-21T15:10:15.950 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:15.950 INFO:teuthology.orchestra.run.smithi161.stdout:4960 read 0x8276fca thru 0x8281c26 (0xac5d bytes) 2024-09-21T15:10:15.956 INFO:teuthology.orchestra.run.smithi161.stdout:4961 trunc from 0xe1c0877 to 0xb4820a5 2024-09-21T15:10:16.019 INFO:teuthology.orchestra.run.smithi161.stdout:5484 read 0x14a85c3 thru 0x14b7f88 (0xf9c6 bytes) 2024-09-21T15:10:16.020 INFO:teuthology.orchestra.run.smithi161.stdout:4219 write 0xb56859 thru 0xb5d8af (0x7057 bytes) 2024-09-21T15:10:16.062 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #34, image image_cluster1.client.mirror.5-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent35 2024-09-21T15:10:16.073 INFO:teuthology.orchestra.run.smithi161.stdout:5485 punch from 0x1f90845 to 0x1f9140b, (0xbc6 bytes) 2024-09-21T15:10:16.073 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:16.073 INFO:teuthology.orchestra.run.smithi161.stdout:5487 writesame 0x31405d3 thru 0x314346c data_size 0x5(0x2e9a bytes) 2024-09-21T15:10:16.189 INFO:teuthology.orchestra.run.smithi161.stdout:4962 punch from 0x4f9da6d to 0x4fa1d18, (0x42ab bytes) 2024-09-21T15:10:16.189 INFO:teuthology.orchestra.run.smithi161.stdout:4963 write 0x914ff42 thru 0x915afde (0xb09d bytes) 2024-09-21T15:10:16.201 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #34, image image_cluster1.client.mirror.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent35 2024-09-21T15:10:16.202 INFO:teuthology.orchestra.run.smithi161.stdout:4222 write 0xae0669a thru 0xae148e8 (0xe24f bytes) 2024-09-21T15:10:16.207 INFO:teuthology.orchestra.run.smithi161.stdout:5488 write 0x3f37c16 thru 0x3f3fb66 (0x7f51 bytes) 2024-09-21T15:10:16.229 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:16.229 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:16.241 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:16.241 INFO:teuthology.orchestra.run.smithi161.stdout:5490 read 0x12a1e49 thru 0x12a6613 (0x47cb bytes) 2024-09-21T15:10:16.242 INFO:teuthology.orchestra.run.smithi161.stdout:4964 punch from 0xae497b3 to 0xae5903e, (0xf88b bytes) 2024-09-21T15:10:16.242 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:16.242 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:16.242 INFO:teuthology.orchestra.run.smithi161.stdout:4968 read 0x4ffff0b thru 0x500a82b (0xa921 bytes) 2024-09-21T15:10:16.242 INFO:teuthology.orchestra.run.smithi161.stdout:5491 write 0x2db4ac7 thru 0x2db7638 (0x2b72 bytes) 2024-09-21T15:10:16.243 INFO:teuthology.orchestra.run.smithi161.stdout:4969 read 0x19b48d2 thru 0x19bf441 (0xab70 bytes) 2024-09-21T15:10:16.243 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:16.243 INFO:teuthology.orchestra.run.smithi161.stdout:4971 clone 40 order 18 su 16384 sc 14 2024-09-21T15:10:16.308 INFO:teuthology.orchestra.run.smithi161.stdout:4223 read 0x5b53a01 thru 0x5b5a5b4 (0x6bb4 bytes) 2024-09-21T15:10:16.308 INFO:teuthology.orchestra.run.smithi161.stdout:4224 read 0xabcc021 thru 0xabd8cf8 (0xccd8 bytes) 2024-09-21T15:10:16.308 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:16.308 INFO:teuthology.orchestra.run.smithi161.stdout:4226 punch from 0x332f4d4 to 0x3330458, (0xf84 bytes) 2024-09-21T15:10:16.308 INFO:teuthology.orchestra.run.smithi161.stdout:4228 read 0x80ba82e thru 0x80c3fe4 (0x97b7 bytes) 2024-09-21T15:10:16.412 INFO:teuthology.orchestra.run.smithi161.stdout:5492 writesame 0xbdb206b thru 0xbdb2e65 data_size 0x1(0xdfb bytes) 2024-09-21T15:10:16.419 INFO:teuthology.orchestra.run.smithi161.stdout:5493 write 0x5d6a700 thru 0x5d75ffd (0xb8fe bytes) 2024-09-21T15:10:16.533 INFO:teuthology.orchestra.run.smithi161.stdout:5494 trunc from 0xbdb2e66 to 0x289c8b4 2024-09-21T15:10:16.556 INFO:teuthology.orchestra.run.smithi161.stdout:4229 write 0xc9d23e3 thru 0xc9e016c (0xdd8a bytes) 2024-09-21T15:10:16.574 INFO:teuthology.orchestra.run.smithi161.stdout:5410 write 0xb33531a thru 0xb33e146 (0x8e2d bytes) 2024-09-21T15:10:16.645 INFO:teuthology.orchestra.run.smithi161.stdout:5412 write 0x14eab1 thru 0x158d5e (0xa2ae bytes) 2024-09-21T15:10:16.646 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:16.638+0000 7f7fd044c700 -1 reset not still connected to 0x5636aebddee0 2024-09-21T15:10:16.656 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:16.642+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7f66d00 2024-09-21T15:10:16.673 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:16.666+0000 7f7fd044c700 -1 reset not still connected to 0x5636be75ef70 2024-09-21T15:10:16.673 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:16.666+0000 7f7fd044c700 -1 reset not still connected to 0x5636be7f3d40 2024-09-21T15:10:16.673 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:16.666+0000 7f7fd044c700 -1 reset not still connected to 0x5636bef84000 2024-09-21T15:10:16.674 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:16.666+0000 7f7fd044c700 -1 reset not still connected to 0x5636bfcdb5f0 2024-09-21T15:10:16.674 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:16.670+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffba0d0 2024-09-21T15:10:16.674 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:16.670+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffba410 2024-09-21T15:10:16.674 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:16.670+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbadd0 2024-09-21T15:10:16.674 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:16.670+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074cd00 2024-09-21T15:10:16.674 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:16.670+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f89040 2024-09-21T15:10:16.676 INFO:teuthology.orchestra.run.smithi161.stdout:4231 read 0x35b6f7d thru 0x35c11a4 (0xa228 bytes) 2024-09-21T15:10:16.676 INFO:teuthology.orchestra.run.smithi161.stdout:4234 write 0x30bc7f2 thru 0x30c024e (0x3a5d bytes) 2024-09-21T15:10:16.727 INFO:teuthology.orchestra.run.smithi161.stdout:4235 trunc from 0xc9e016d to 0x7da9a77 2024-09-21T15:10:16.802 INFO:teuthology.orchestra.run.smithi161.stdout:4240 read 0x6d6464c thru 0x6d6775c (0x3111 bytes) 2024-09-21T15:10:16.803 INFO:teuthology.orchestra.run.smithi161.stdout:5414 writesame 0x5c4a643 thru 0x5c5193b data_size 0x1(0x72f9 bytes) 2024-09-21T15:10:16.854 INFO:teuthology.orchestra.run.smithi161.stdout:5415 trunc from 0xb33e147 to 0x205f5b0 2024-09-21T15:10:16.871 INFO:teuthology.orchestra.run.smithi161.stdout:4241 write 0xa655660 thru 0xa662d26 (0xd6c7 bytes) 2024-09-21T15:10:16.890 INFO:teuthology.orchestra.run.smithi161.stdout:5703 read 0x2f16ce3 thru 0x2f1bb9b (0x4eb9 bytes) 2024-09-21T15:10:16.992 INFO:teuthology.orchestra.run.smithi161.stdout:4242 read 0x39e62fa thru 0x39f39e1 (0xd6e8 bytes) 2024-09-21T15:10:16.992 INFO:teuthology.orchestra.run.smithi161.stdout:4243 writesame 0x8c1034d thru 0x8c1654f data_size 0x1(0x6203 bytes) 2024-09-21T15:10:17.002 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.995+0000 7ff753f07700 -1 reset not still connected to 0x56016a6df860 2024-09-21T15:10:17.002 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.995+0000 7ff753f07700 -1 reset not still connected to 0x56016a6dfa00 2024-09-21T15:10:17.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.999+0000 7ff753f07700 -1 reset not still connected to 0x56016a9c85b0 2024-09-21T15:10:17.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.999+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6340 2024-09-21T15:10:17.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.999+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e64e0 2024-09-21T15:10:17.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.999+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6a90 2024-09-21T15:10:17.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.999+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e72b0 2024-09-21T15:10:17.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.999+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72d00 2024-09-21T15:10:17.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.999+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72ea0 2024-09-21T15:10:17.004 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.999+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f450 2024-09-21T15:10:17.004 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.999+0000 7ff753f07700 -1 reset not still connected to 0x56016b24fee0 2024-09-21T15:10:17.004 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.999+0000 7ff753f07700 -1 reset not still connected to 0x56016bff6000 2024-09-21T15:10:17.004 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.999+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:10:17.004 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.999+0000 7ff753f07700 -1 reset not still connected to 0x56016d18f450 2024-09-21T15:10:17.004 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:16.999+0000 7ff753f07700 -1 reset not still connected to 0x56016dd771e0 2024-09-21T15:10:17.031 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x560167cc4dd0 2024-09-21T15:10:17.031 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x560167cc5380 2024-09-21T15:10:17.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:10:17.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016878a1a0 2024-09-21T15:10:17.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016878ab60 2024-09-21T15:10:17.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016878ac30 2024-09-21T15:10:17.033 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016878b1e0 2024-09-21T15:10:17.033 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016878b520 2024-09-21T15:10:17.033 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x560168802750 2024-09-21T15:10:17.033 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x5601688028f0 2024-09-21T15:10:17.033 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x560168803860 2024-09-21T15:10:17.033 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x560168803ee0 2024-09-21T15:10:17.033 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x5601692b52b0 2024-09-21T15:10:17.033 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x560169b608f0 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x560169e2eb60 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x560169ec2dd0 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x560169f100d0 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x560169f10270 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x560169f10680 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9c70 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016a38c410 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016a50a9c0 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016a50b930 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016a6df860 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016a6dfa00 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016a9c85b0 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6340 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e64e0 2024-09-21T15:10:17.034 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.027+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e6a90 2024-09-21T15:10:17.035 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.031+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e72b0 2024-09-21T15:10:17.035 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.031+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72d00 2024-09-21T15:10:17.035 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.031+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72ea0 2024-09-21T15:10:17.035 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.031+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f450 2024-09-21T15:10:17.035 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.031+0000 7ff753f07700 -1 reset not still connected to 0x56016b24fee0 2024-09-21T15:10:17.035 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.031+0000 7ff753f07700 -1 reset not still connected to 0x56016bff6000 2024-09-21T15:10:17.035 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.031+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:10:17.035 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.031+0000 7ff753f07700 -1 reset not still connected to 0x56016d18f450 2024-09-21T15:10:17.036 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.031+0000 7ff753f07700 -1 reset not still connected to 0x56016dd771e0 2024-09-21T15:10:17.041 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.038+0000 7f1e9c77a700 -1 reset not still connected to 0x562889a48750 2024-09-21T15:10:17.045 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.038+0000 7f1e9c77a700 -1 reset not still connected to 0x56288c584340 2024-09-21T15:10:17.046 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.042+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f959ba0 2024-09-21T15:10:17.054 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.042+0000 7f1e9c77a700 -1 reset not still connected to 0x562890034680 2024-09-21T15:10:17.059 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.042+0000 7f1e9c77a700 -1 reset not still connected to 0x562890035520 2024-09-21T15:10:17.064 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.054+0000 7f1e9c77a700 -1 reset not still connected to 0x562890805d40 2024-09-21T15:10:17.064 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.054+0000 7f1e9c77a700 -1 reset not still connected to 0x56289097b110 2024-09-21T15:10:17.064 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.054+0000 7f1e9c77a700 -1 reset not still connected to 0x562890d15860 2024-09-21T15:10:17.072 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.070+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5930 2024-09-21T15:10:17.072 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.070+0000 7f1e9c77a700 -1 reset not still connected to 0x562897c70ea0 2024-09-21T15:10:17.072 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.070+0000 7f1e9c77a700 -1 reset not still connected to 0x562897c71040 2024-09-21T15:10:17.072 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.070+0000 7f1e9c77a700 -1 reset not still connected to 0x562899844b60 2024-09-21T15:10:17.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.067+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72ea0 2024-09-21T15:10:17.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.067+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f450 2024-09-21T15:10:17.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.067+0000 7ff753f07700 -1 reset not still connected to 0x56016b24fee0 2024-09-21T15:10:17.078 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.067+0000 7ff753f07700 -1 reset not still connected to 0x56016bff6000 2024-09-21T15:10:17.078 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.067+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ee0 2024-09-21T15:10:17.078 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:17.067+0000 7ff753f07700 -1 reset not still connected to 0x56016d18f450 2024-09-21T15:10:17.078 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x56289c976f70 2024-09-21T15:10:17.079 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x56289c9775f0 2024-09-21T15:10:17.079 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x56289cc5f5f0 2024-09-21T15:10:17.079 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x56289e304750 2024-09-21T15:10:17.079 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x56289f998270 2024-09-21T15:10:17.079 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x56289fa76750 2024-09-21T15:10:17.079 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a22ebee0 2024-09-21T15:10:17.079 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a22ffa00 2024-09-21T15:10:17.080 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:10:17.080 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655450 2024-09-21T15:10:17.080 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2e88f70 2024-09-21T15:10:17.080 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2e89860 2024-09-21T15:10:17.080 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a40412b0 2024-09-21T15:10:17.080 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4041a00 2024-09-21T15:10:17.080 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4394340 2024-09-21T15:10:17.080 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4397d40 2024-09-21T15:10:17.080 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51481a0 2024-09-21T15:10:17.080 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a519e820 2024-09-21T15:10:17.081 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a519f5f0 2024-09-21T15:10:17.081 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a5462d00 2024-09-21T15:10:17.081 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a5fc9380 2024-09-21T15:10:17.081 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6a90 2024-09-21T15:10:17.081 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6ea0 2024-09-21T15:10:17.081 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ef1d40 2024-09-21T15:10:17.081 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780f860 2024-09-21T15:10:17.082 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e750 2024-09-21T15:10:17.082 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:17.074+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f520 2024-09-21T15:10:17.115 INFO:teuthology.orchestra.run.smithi161.stdout:4245 punch from 0x90c811b to 0x90d6bf3, (0xead8 bytes) 2024-09-21T15:10:17.115 INFO:teuthology.orchestra.run.smithi161.stdout:4246 punch from 0x1988efd to 0x198d207, (0x430a bytes) 2024-09-21T15:10:17.115 INFO:teuthology.orchestra.run.smithi161.stdout:4247 punch from 0x96638c6 to 0x967079c, (0xced6 bytes) 2024-09-21T15:10:17.115 INFO:teuthology.orchestra.run.smithi161.stdout:4249 punch from 0x215d19b to 0x215d24b, (0xb0 bytes) 2024-09-21T15:10:17.115 INFO:teuthology.orchestra.run.smithi161.stdout:4250 punch from 0x4f926cb to 0x4f95c13, (0x3548 bytes) 2024-09-21T15:10:17.235 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf4d03930 2024-09-21T15:10:17.235 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf52992b0 2024-09-21T15:10:17.249 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.238+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf560f930 2024-09-21T15:10:17.250 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.242+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf6aac680 2024-09-21T15:10:17.251 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.242+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf88a9790 2024-09-21T15:10:17.251 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.242+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf9ca4340 2024-09-21T15:10:17.251 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.242+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf9f63ba0 2024-09-21T15:10:17.251 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.246+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfb693040 2024-09-21T15:10:17.251 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.246+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfcc4d790 2024-09-21T15:10:17.251 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.246+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfddb6750 2024-09-21T15:10:17.254 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfe47d380 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbfe9d1ad0 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbff4f9c70 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbff8ca4e0 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbff8cb930 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbffbded00 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc02925d40 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc02bdec30 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0750f040 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc09d14820 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc09d725b0 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc09d73c70 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0a457ee0 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0b93aa90 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0d9d21a0 2024-09-21T15:10:17.255 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0dafcc30 2024-09-21T15:10:17.256 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0dafd040 2024-09-21T15:10:17.256 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.250+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0deabe10 2024-09-21T15:10:17.256 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.254+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc120bc4e0 2024-09-21T15:10:17.256 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.254+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc13f1fba0 2024-09-21T15:10:17.256 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.254+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc14eecdd0 2024-09-21T15:10:17.257 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.254+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc14eecea0 2024-09-21T15:10:17.257 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:17.254+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1a255860 2024-09-21T15:10:17.258 INFO:teuthology.orchestra.run.smithi161.stdout:5704 punch from 0x49a4bf1 to 0x49a8821, (0x3c30 bytes) 2024-09-21T15:10:17.267 INFO:teuthology.orchestra.run.smithi161.stdout:5705 trunc from 0xbe865b8 to 0x6c32240 2024-09-21T15:10:17.298 INFO:teuthology.orchestra.run.smithi161.stdout:5416 read 0xbbd0a2 thru 0xbbda3c (0x99b bytes) 2024-09-21T15:10:17.301 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:17.313 INFO:teuthology.orchestra.run.smithi161.stdout:5496 writesame 0x6873512 thru 0x687d16a data_size 0x5(0x9c59 bytes) 2024-09-21T15:10:17.320 INFO:teuthology.orchestra.run.smithi161.stdout:4251 write 0xd6060f2 thru 0xd60f532 (0x9441 bytes) 2024-09-21T15:10:17.331 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:17.332 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:17.369 INFO:teuthology.orchestra.run.smithi161.stdout:5419 writesame 0x740cc67 thru 0x7413d26 data_size 0x58(0x70c0 bytes) 2024-09-21T15:10:17.375 INFO:teuthology.orchestra.run.smithi161.stdout:4254 write 0x7085dd2 thru 0x70885d7 (0x2806 bytes) 2024-09-21T15:10:17.389 INFO:teuthology.orchestra.run.smithi161.stdout:5708 trunc from 0x6c32240 to 0xa1c6aea 2024-09-21T15:10:17.394 INFO:teuthology.orchestra.run.smithi161.stdout:5501 write 0x7f7aed9 thru 0x7f85f51 (0xb079 bytes) 2024-09-21T15:10:17.432 INFO:teuthology.orchestra.run.smithi161.stdout:5502 write 0x5b2ec18 thru 0x5b3b298 (0xc681 bytes) 2024-09-21T15:10:17.438 INFO:teuthology.orchestra.run.smithi161.stdout:5421 write 0x834914d thru 0x834da85 (0x4939 bytes) 2024-09-21T15:10:17.491 INFO:teuthology.orchestra.run.smithi161.stdout:5503 write 0x5735ce1 thru 0x574046e (0xa78e bytes) 2024-09-21T15:10:17.492 INFO:teuthology.orchestra.run.smithi161.stdout:4255 read 0x3940389 thru 0x394cb06 (0xc77e bytes) 2024-09-21T15:10:17.492 INFO:teuthology.orchestra.run.smithi161.stdout:4256 punch from 0x508a6cd to 0x5094ee7, (0xa81a bytes) 2024-09-21T15:10:17.499 INFO:teuthology.orchestra.run.smithi161.stdout:5709 read 0x3cc49db thru 0x3cd2b2e (0xe154 bytes) 2024-09-21T15:10:17.500 INFO:teuthology.orchestra.run.smithi161.stdout:5710 write 0x7ffa4d8 thru 0x8003bd3 (0x96fc bytes) 2024-09-21T15:10:17.503 INFO:teuthology.orchestra.run.smithi161.stdout:4257 trunc from 0xd60f533 to 0x7d76fae 2024-09-21T15:10:17.504 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone39 from 0xb4820a5 (overlap 0xa8db4a) to 0x10e2ba 2024-09-21T15:10:17.519 INFO:teuthology.orchestra.run.smithi161.stdout:5504 read 0x267a22e thru 0x2685bb0 (0xb983 bytes) 2024-09-21T15:10:17.520 INFO:teuthology.orchestra.run.smithi161.stdout:5505 read 0x5f4062f thru 0x5f484ec (0x7ebe bytes) 2024-09-21T15:10:17.520 INFO:teuthology.orchestra.run.smithi161.stdout:5507 write 0x34fcc69 thru 0x34fe130 (0x14c8 bytes) 2024-09-21T15:10:17.545 INFO:teuthology.orchestra.run.smithi161.stdout:5422 write 0xe077287 thru 0xe085d4e (0xeac8 bytes) 2024-09-21T15:10:17.555 INFO:teuthology.orchestra.run.smithi161.stdout:5508 writesame 0x756a658 thru 0x756c9c5 data_size 0x5(0x236e bytes) 2024-09-21T15:10:17.587 INFO:teuthology.orchestra.run.smithi161.stdout:5423 writesame 0xd4904f6 thru 0xd49e77d data_size 0x16(0xe288 bytes) 2024-09-21T15:10:17.590 INFO:teuthology.orchestra.run.smithi161.stdout:5509 read 0x103c3ce thru 0x1049877 (0xd4aa bytes) 2024-09-21T15:10:17.595 INFO:teuthology.orchestra.run.smithi161.stdout:5711 write 0xc316160 thru 0xc3240c4 (0xdf65 bytes) 2024-09-21T15:10:17.609 INFO:teuthology.orchestra.run.smithi161.stdout:5510 trunc from 0x7f85f52 to 0x20f937a 2024-09-21T15:10:17.610 INFO:teuthology.orchestra.run.smithi161.stdout:5424 write 0x65a00ac thru 0x65a9999 (0x98ee bytes) 2024-09-21T15:10:17.619 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:17.619 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:17.619 INFO:teuthology.orchestra.run.smithi161.stdout:5715 writesame 0x4a0fb60 thru 0x4a1148d data_size 0xb(0x192e bytes) 2024-09-21T15:10:17.645 INFO:teuthology.orchestra.run.smithi161.stdout:5716 write 0x9891f9c thru 0x98a0b31 (0xeb96 bytes) 2024-09-21T15:10:17.647 INFO:teuthology.orchestra.run.smithi161.stdout:5426 trunc from 0xe085d4f to 0x4193d75 2024-09-21T15:10:17.703 INFO:teuthology.orchestra.run.smithi161.stdout:5717 write 0x584d6f thru 0x587ac0 (0x2d52 bytes) 2024-09-21T15:10:17.708 INFO:teuthology.orchestra.run.smithi161.stdout:4259 writesame 0xbece217 thru 0xbed6662 data_size 0x2(0x844c bytes) 2024-09-21T15:10:17.744 INFO:teuthology.orchestra.run.smithi161.stdout:4261 trunc from 0xbed6663 to 0x1d4c69f 2024-09-21T15:10:17.753 INFO:teuthology.orchestra.run.smithi161.stdout:5718 punch from 0x92005c0 to 0x920e6b5, (0xe0f5 bytes) 2024-09-21T15:10:17.753 INFO:teuthology.orchestra.run.smithi161.stdout:5719 read 0x222e863 thru 0x22334ba (0x4c58 bytes) 2024-09-21T15:10:17.753 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:17.754 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:17.754 INFO:teuthology.orchestra.run.smithi161.stdout:5722 read 0x9d7e131 thru 0x9d82d4f (0x4c1f bytes) 2024-09-21T15:10:17.764 INFO:teuthology.orchestra.run.smithi161.stdout:5723 punch from 0x4d42af5 to 0x4d4817d, (0x5688 bytes) 2024-09-21T15:10:17.764 INFO:teuthology.orchestra.run.smithi161.stdout:5724 read 0x78b60c9 thru 0x78bce08 (0x6d40 bytes) 2024-09-21T15:10:17.766 INFO:teuthology.orchestra.run.smithi161.stdout:5726 write 0x27771e5 thru 0x2787135 (0xff51 bytes) 2024-09-21T15:10:17.804 INFO:teuthology.orchestra.run.smithi161.stdout:5427 read 0x2bb33ac thru 0x2bb6023 (0x2c78 bytes) 2024-09-21T15:10:17.805 INFO:teuthology.orchestra.run.smithi161.stdout:5728 writesame 0x52549df thru 0x525731c data_size 0x1(0x293e bytes) 2024-09-21T15:10:17.805 INFO:teuthology.orchestra.run.smithi161.stdout:5430 punch from 0x316cb34 to 0x317a174, (0xd640 bytes) 2024-09-21T15:10:17.810 INFO:teuthology.orchestra.run.smithi161.stdout:5431 trunc from 0x4193d75 to 0x60744dc 2024-09-21T15:10:17.834 INFO:teuthology.orchestra.run.smithi161.stdout:5729 punch from 0xbb23a7f to 0xbb242fd, (0x87e bytes) 2024-09-21T15:10:17.834 INFO:teuthology.orchestra.run.smithi161.stdout:5730 writesame 0x41ccc03 thru 0x41d0652 data_size 0x18(0x3a50 bytes) 2024-09-21T15:10:17.836 INFO:teuthology.orchestra.run.smithi161.stdout:5432 read 0x3e3d7ed thru 0x3e45bee (0x8402 bytes) 2024-09-21T15:10:17.839 INFO:teuthology.orchestra.run.smithi161.stdout:5433 writesame 0x221cfd7 thru 0x221fb64 data_size 0xa(0x2b8e bytes) 2024-09-21T15:10:17.853 INFO:teuthology.orchestra.run.smithi161.stdout:5435 read 0x42c88b3 thru 0x42cb587 (0x2cd5 bytes) 2024-09-21T15:10:17.854 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:17.854 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:17.854 INFO:teuthology.orchestra.run.smithi161.stdout:5438 read 0x3218b49 thru 0x321a111 (0x15c9 bytes) 2024-09-21T15:10:17.857 INFO:teuthology.orchestra.run.smithi161.stdout:5440 trunc from 0x60744dc to 0x5229582 2024-09-21T15:10:17.859 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:17.859 INFO:teuthology.orchestra.run.smithi161.stdout:5732 writesame 0x48ab81c thru 0x48b5c04 data_size 0x47(0xa3e9 bytes) 2024-09-21T15:10:17.895 INFO:teuthology.orchestra.run.smithi161.stdout:5511 write 0xd415ed9 thru 0xd41c645 (0x676d bytes) 2024-09-21T15:10:17.937 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:17.937 INFO:teuthology.orchestra.run.smithi161.stdout:5513 writesame 0x55a4526 thru 0x55b0bb0 data_size 0x1(0xc68b bytes) 2024-09-21T15:10:17.951 INFO:teuthology.orchestra.run.smithi161.stdout:5441 trunc from 0x5229582 to 0xcf75dd5 2024-09-21T15:10:17.967 INFO:teuthology.orchestra.run.smithi161.stdout:5733 punch from 0xbba0789 to 0xbbae379, (0xdbf0 bytes) 2024-09-21T15:10:17.967 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:17.967 INFO:teuthology.orchestra.run.smithi161.stdout:5736 read 0x16c7798 thru 0x16d2d10 (0xb579 bytes) 2024-09-21T15:10:17.967 INFO:teuthology.orchestra.run.smithi161.stdout:5737 punch from 0x4ba9264 to 0x4bab3ec, (0x2188 bytes) 2024-09-21T15:10:17.967 INFO:teuthology.orchestra.run.smithi161.stdout:5739 punch from 0x82c6c8 to 0x83b400, (0xed38 bytes) 2024-09-21T15:10:17.968 INFO:teuthology.orchestra.run.smithi161.stdout:5740 writesame 0x24ce8f2 thru 0x24ceb85 data_size 0x3(0x294 bytes) 2024-09-21T15:10:17.985 INFO:teuthology.orchestra.run.smithi161.stdout:5514 read 0x98ba552 thru 0x98bdfcd (0x3a7c bytes) 2024-09-21T15:10:17.994 INFO:teuthology.orchestra.run.smithi161.stdout:5741 write 0x783cd9a thru 0x784c128 (0xf38f bytes) 2024-09-21T15:10:18.011 INFO:teuthology.orchestra.run.smithi161.stdout:4262 trunc from 0x1d4c69f to 0x1611b93 2024-09-21T15:10:18.015 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #38, image image_cluster1.client.mirror.4-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent39 2024-09-21T15:10:18.017 INFO:teuthology.orchestra.run.smithi161.stdout:5515 trunc from 0xd41c646 to 0x4c06620 2024-09-21T15:10:18.019 INFO:teuthology.orchestra.run.smithi161.stdout:5442 read 0x6df5251 thru 0x6df737c (0x212c bytes) 2024-09-21T15:10:18.019 INFO:teuthology.orchestra.run.smithi161.stdout:5443 writesame 0x7617947 thru 0x7617c27 data_size 0x1(0x2e1 bytes) 2024-09-21T15:10:18.029 INFO:teuthology.orchestra.run.smithi161.stdout:5742 read 0xbce2e73 thru 0xbce3724 (0x8b2 bytes) 2024-09-21T15:10:18.029 INFO:teuthology.orchestra.run.smithi161.stdout:5743 read 0x6a58b52 thru 0x6a61f2c (0x93db bytes) 2024-09-21T15:10:18.034 INFO:teuthology.orchestra.run.smithi161.stdout:5744 read 0xb5a0f8f thru 0xb5a3782 (0x27f4 bytes) 2024-09-21T15:10:18.034 INFO:teuthology.orchestra.run.smithi161.stdout:5747 read 0xf0912a thru 0xf18874 (0xf74b bytes) 2024-09-21T15:10:18.035 INFO:teuthology.orchestra.run.smithi161.stdout:5748 write 0x37e313b thru 0x37e8d3d (0x5c03 bytes) 2024-09-21T15:10:18.057 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:18.051+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388fa00 2024-09-21T15:10:18.059 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:18.051+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388fd40 2024-09-21T15:10:18.061 INFO:teuthology.orchestra.run.smithi161.stdout:5444 read 0x5be392f thru 0x5be6d7f (0x3451 bytes) 2024-09-21T15:10:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:18.059+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4166f70 2024-09-21T15:10:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:18.059+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167040 2024-09-21T15:10:18.075 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:18.063+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fd40 2024-09-21T15:10:18.075 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:18.067+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eb2b0 2024-09-21T15:10:18.075 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:18.067+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebe10 2024-09-21T15:10:18.082 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:18.082 INFO:teuthology.orchestra.run.smithi161.stdout:5750 punch from 0x6683c5e to 0x6688043, (0x43e5 bytes) 2024-09-21T15:10:18.082 INFO:teuthology.orchestra.run.smithi161.stdout:5751 read 0x88682e3 thru 0x886c0ed (0x3e0b bytes) 2024-09-21T15:10:18.095 INFO:teuthology.orchestra.run.smithi161.stdout:5753 trunc from 0xc3240c5 to 0x6452e38 2024-09-21T15:10:18.102 INFO:teuthology.orchestra.run.smithi161.stdout:5446 write 0xdc7b372 thru 0xdc8854d (0xd1dc bytes) 2024-09-21T15:10:18.121 INFO:teuthology.orchestra.run.smithi161.stdout:5516 read 0x3561df5 thru 0x3567788 (0x5994 bytes) 2024-09-21T15:10:18.149 INFO:teuthology.orchestra.run.smithi161.stdout:5447 write 0x9c115a6 thru 0x9c12131 (0xb8c bytes) 2024-09-21T15:10:18.167 INFO:teuthology.orchestra.run.smithi161.stdout:5448 read 0x1183857 thru 0x1190025 (0xc7cf bytes) 2024-09-21T15:10:18.168 INFO:teuthology.orchestra.run.smithi161.stdout:5449 writesame 0x946784f thru 0x94764c4 data_size 0xab(0xec76 bytes) 2024-09-21T15:10:18.173 INFO:teuthology.orchestra.run.smithi161.stdout:4263 read 0xeac581 thru 0xeb1d7c (0x57fc bytes) 2024-09-21T15:10:18.174 INFO:teuthology.orchestra.run.smithi161.stdout:4264 punch from 0x15251da to 0x152dc36, (0x8a5c bytes) 2024-09-21T15:10:18.174 INFO:teuthology.orchestra.run.smithi161.stdout:4265 read 0xea8361 thru 0xeaa508 (0x21a8 bytes) 2024-09-21T15:10:18.177 INFO:teuthology.orchestra.run.smithi161.stdout:4266 read 0x12309a thru 0x128e57 (0x5dbe bytes) 2024-09-21T15:10:18.177 INFO:teuthology.orchestra.run.smithi161.stdout:4267 punch from 0x224887 to 0x229c56, (0x53cf bytes) 2024-09-21T15:10:18.197 INFO:teuthology.orchestra.run.smithi161.stdout:5517 write 0xbd74bf9 thru 0xbd7788d (0x2c95 bytes) 2024-09-21T15:10:18.202 INFO:teuthology.orchestra.run.smithi161.stdout:5450 read 0xd26a93b thru 0xd279267 (0xe92d bytes) 2024-09-21T15:10:18.203 INFO:teuthology.orchestra.run.smithi161.stdout:5451 writesame 0xb7597ca thru 0xb761ac3 data_size 0x23(0x82fa bytes) 2024-09-21T15:10:18.225 INFO:teuthology.orchestra.run.smithi161.stdout:5452 write 0x383610d thru 0x383c984 (0x6878 bytes) 2024-09-21T15:10:18.233 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.222+0000 7f1e9c77a700 -1 reset not still connected to 0x562874987ee0 2024-09-21T15:10:18.234 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.226+0000 7f1e9c77a700 -1 reset not still connected to 0x5628762fd6c0 2024-09-21T15:10:18.237 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.226+0000 7f1e9c77a700 -1 reset not still connected to 0x56287641fba0 2024-09-21T15:10:18.237 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.230+0000 7f1e9c77a700 -1 reset not still connected to 0x562876b275f0 2024-09-21T15:10:18.237 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.230+0000 7f1e9c77a700 -1 reset not still connected to 0x562876d89520 2024-09-21T15:10:18.237 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.230+0000 7f1e9c77a700 -1 reset not still connected to 0x562879b244e0 2024-09-21T15:10:18.240 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.238+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c23d6c0 2024-09-21T15:10:18.240 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.238+0000 7f1e9c77a700 -1 reset not still connected to 0x56287c888f70 2024-09-21T15:10:18.240 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.238+0000 7f1e9c77a700 -1 reset not still connected to 0x56287cb1c0d0 2024-09-21T15:10:18.240 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.238+0000 7f1e9c77a700 -1 reset not still connected to 0x56287ce70000 2024-09-21T15:10:18.241 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.238+0000 7f1e9c77a700 -1 reset not still connected to 0x5628828a7ba0 2024-09-21T15:10:18.243 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.238+0000 7f1e9c77a700 -1 reset not still connected to 0x56288301b2b0 2024-09-21T15:10:18.243 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.238+0000 7f1e9c77a700 -1 reset not still connected to 0x562889a48750 2024-09-21T15:10:18.253 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x562889a931e0 2024-09-21T15:10:18.253 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x56288c584340 2024-09-21T15:10:18.253 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x56288edfc9c0 2024-09-21T15:10:18.254 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f3264e0 2024-09-21T15:10:18.254 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f959ba0 2024-09-21T15:10:18.254 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x562890034680 2024-09-21T15:10:18.254 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x5628908044e0 2024-09-21T15:10:18.255 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x562890805d40 2024-09-21T15:10:18.256 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x562896af5930 2024-09-21T15:10:18.256 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x562897c70ea0 2024-09-21T15:10:18.256 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x562897c71040 2024-09-21T15:10:18.256 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x56289c9775f0 2024-09-21T15:10:18.256 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x56289c977e10 2024-09-21T15:10:18.256 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x56289cc5f5f0 2024-09-21T15:10:18.256 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.250+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a22ebee0 2024-09-21T15:10:18.262 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.258+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a22ffa00 2024-09-21T15:10:18.262 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.258+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:10:18.262 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.258+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655450 2024-09-21T15:10:18.262 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.258+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2e88f70 2024-09-21T15:10:18.262 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.258+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2e89860 2024-09-21T15:10:18.262 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.258+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a40412b0 2024-09-21T15:10:18.269 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.262+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4397d40 2024-09-21T15:10:18.269 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.262+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51481a0 2024-09-21T15:10:18.269 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.262+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a519e820 2024-09-21T15:10:18.269 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.262+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a519f6c0 2024-09-21T15:10:18.269 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.262+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a5463ee0 2024-09-21T15:10:18.270 INFO:teuthology.orchestra.run.smithi161.stdout:5453 writesame 0xa12c062 thru 0xa139faa data_size 0x1(0xdf49 bytes) 2024-09-21T15:10:18.270 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a5fc9380 2024-09-21T15:10:18.270 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6ea0 2024-09-21T15:10:18.271 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780f860 2024-09-21T15:10:18.271 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1a00 2024-09-21T15:10:18.271 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e750 2024-09-21T15:10:18.272 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:18.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f520 2024-09-21T15:10:18.282 INFO:teuthology.orchestra.run.smithi161.stdout:5519 write 0x39cc4df thru 0x39cc911 (0x433 bytes) 2024-09-21T15:10:18.332 INFO:teuthology.orchestra.run.smithi161.stdout:4268 writesame 0xc2ccde2 thru 0xc2d4cec data_size 0x25(0x7f0b bytes) 2024-09-21T15:10:18.342 INFO:teuthology.orchestra.run.smithi161.stdout:4269 read 0x15f4829 thru 0x15f5bfd (0x13d5 bytes) 2024-09-21T15:10:18.342 INFO:teuthology.orchestra.run.smithi161.stdout:4270 writesame 0x424e670 thru 0x42517be data_size 0x1(0x314f bytes) 2024-09-21T15:10:18.345 INFO:teuthology.orchestra.run.smithi161.stdout:5454 write 0x3c15bb7 thru 0x3c1ee0c (0x9256 bytes) 2024-09-21T15:10:18.367 INFO:teuthology.orchestra.run.smithi161.stdout:5455 write 0xcf1f5e8 thru 0xcf2dc9f (0xe6b8 bytes) 2024-09-21T15:10:18.400 INFO:teuthology.orchestra.run.smithi161.stdout:5456 trunc from 0xdc8854e to 0xc473053 2024-09-21T15:10:18.450 INFO:teuthology.orchestra.run.smithi161.stdout:4272 trunc from 0xc2d4ced to 0x2de0b6b 2024-09-21T15:10:18.496 INFO:teuthology.orchestra.run.smithi161.stdout:5520 writesame 0xd6f97f0 thru 0xd707862 data_size 0x3(0xe073 bytes) 2024-09-21T15:10:18.531 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:18.531 INFO:teuthology.orchestra.run.smithi161.stdout:5755 write 0x5802ab7 thru 0x580f3df (0xc929 bytes) 2024-09-21T15:10:18.561 INFO:teuthology.orchestra.run.smithi161.stdout:5521 punch from 0xa8b58a6 to 0xa8bb657, (0x5db1 bytes) 2024-09-21T15:10:18.561 INFO:teuthology.orchestra.run.smithi161.stdout:5522 read 0x42871fb thru 0x428c58a (0x5390 bytes) 2024-09-21T15:10:18.561 INFO:teuthology.orchestra.run.smithi161.stdout:5524 write 0xa0787e7 thru 0xa079db6 (0x15d0 bytes) 2024-09-21T15:10:18.586 INFO:teuthology.orchestra.run.smithi161.stdout:5457 write 0xc41bbb0 thru 0xc424f4b (0x939c bytes) 2024-09-21T15:10:18.599 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:18.599 INFO:teuthology.orchestra.run.smithi161.stdout:5758 trunc from 0x6452e38 to 0x6369468 2024-09-21T15:10:18.626 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2024-09-21T15:10:18.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2024-09-21T15:10:18.626 INFO:tasks.rbd_mirror_thrash:waiting for 3 secs before reviving daemons 2024-09-21T15:10:18.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:10:18.623+0000 7f68eb680700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 24827) UID: 1000 2024-09-21T15:10:18.664 INFO:teuthology.orchestra.run.smithi161.stdout:5525 write 0xc1875fd thru 0xc195985 (0xe389 bytes) 2024-09-21T15:10:18.740 INFO:teuthology.orchestra.run.smithi161.stdout:5458 write 0xe5843d4 thru 0xe587bf3 (0x3820 bytes) 2024-09-21T15:10:18.755 INFO:teuthology.orchestra.run.smithi161.stdout:5459 write 0xb5fd23a thru 0xb60b922 (0xe6e9 bytes) 2024-09-21T15:10:18.783 INFO:teuthology.orchestra.run.smithi161.stdout:4972 writesame 0x9ff5ca8 thru 0xa002152 data_size 0x17(0xc4ab bytes) 2024-09-21T15:10:18.795 INFO:teuthology.orchestra.run.smithi161.stdout:5526 writesame 0xa18d909 thru 0xa19c081 data_size 0x1(0xe779 bytes) 2024-09-21T15:10:18.836 INFO:teuthology.orchestra.run.smithi161.stdout:4273 write 0x378d7ec thru 0x379d1d6 (0xf9eb bytes) 2024-09-21T15:10:18.953 INFO:teuthology.orchestra.run.smithi161.stdout:5460 trunc from 0xe587bf4 to 0x7dc0668 2024-09-21T15:10:18.955 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:18.955 INFO:teuthology.orchestra.run.smithi161.stdout:5529 write 0xb0726c9 thru 0xb07d15c (0xaa94 bytes) 2024-09-21T15:10:19.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:19.015+0000 7ff753f07700 -1 reset not still connected to 0x560169f10270 2024-09-21T15:10:19.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:19.015+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e64e0 2024-09-21T15:10:19.028 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:19.023+0000 7ff753f07700 -1 reset not still connected to 0x56016ab72ea0 2024-09-21T15:10:19.029 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:19.023+0000 7ff753f07700 -1 reset not still connected to 0x56016b24fee0 2024-09-21T15:10:19.031 INFO:teuthology.orchestra.run.smithi161.stdout:4276 trunc from 0x379d1d7 to 0x35fe853 2024-09-21T15:10:19.057 INFO:teuthology.orchestra.run.smithi161.stdout:5530 writesame 0x929117a thru 0x929983d data_size 0x64(0x86c4 bytes) 2024-09-21T15:10:19.097 INFO:teuthology.orchestra.run.smithi161.stdout:5759 trunc from 0x6369468 to 0xf4b938 2024-09-21T15:10:19.101 INFO:teuthology.orchestra.run.smithi161.stdout:5461 read 0x74f161a thru 0x74f8988 (0x736f bytes) 2024-09-21T15:10:19.101 INFO:teuthology.orchestra.run.smithi161.stdout:5464 read 0x575976 thru 0x577e17 (0x24a2 bytes) 2024-09-21T15:10:19.102 INFO:teuthology.orchestra.run.smithi161.stdout:5465 read 0x24bd638 thru 0x24bf982 (0x234b bytes) 2024-09-21T15:10:19.126 INFO:teuthology.orchestra.run.smithi161.stdout:5531 trunc from 0xd707863 to 0x486e82b 2024-09-21T15:10:19.159 INFO:teuthology.orchestra.run.smithi161.stdout:5467 writesame 0xeb19509 thru 0xeb1dc64 data_size 0x2(0x475c bytes) 2024-09-21T15:10:19.171 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.171 INFO:teuthology.orchestra.run.smithi161.stdout:5475 punch from 0x4a92b5b to 0x4a944c8, (0x196d bytes) 2024-09-21T15:10:19.172 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.172 INFO:teuthology.orchestra.run.smithi161.stdout:5478 read 0xc027f83 thru 0xc037704 (0xf782 bytes) 2024-09-21T15:10:19.172 INFO:teuthology.orchestra.run.smithi161.stdout:5479 punch from 0x3aa013a to 0x3aa4e95, (0x4d5b bytes) 2024-09-21T15:10:19.172 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.172 INFO:teuthology.orchestra.run.smithi161.stdout:5481 write 0xe271a9 thru 0xe28f82 (0x1dda bytes) 2024-09-21T15:10:19.177 INFO:teuthology.orchestra.run.smithi161.stdout:4277 read 0x23663b4 thru 0x236afdc (0x4c29 bytes) 2024-09-21T15:10:19.177 INFO:teuthology.orchestra.run.smithi161.stdout:4278 read 0x282be50 thru 0x2836a39 (0xabea bytes) 2024-09-21T15:10:19.177 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.177 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.177 INFO:teuthology.orchestra.run.smithi161.stdout:4281 punch from 0xd32bdf to 0xd3a391, (0x77b2 bytes) 2024-09-21T15:10:19.191 INFO:teuthology.orchestra.run.smithi161.stdout:4283 trunc from 0x35fe853 to 0xada0f27 2024-09-21T15:10:19.198 INFO:teuthology.orchestra.run.smithi161.stdout:5486 trunc from 0xeb1dc65 to 0x7bff1dd 2024-09-21T15:10:19.201 INFO:teuthology.orchestra.run.smithi161.stdout:4973 writesame 0xec53ada thru 0xec55aca data_size 0x11(0x1ff1 bytes) 2024-09-21T15:10:19.210 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.210 INFO:teuthology.orchestra.run.smithi161.stdout:4975 write 0x6e94c0c thru 0x6e9c243 (0x7638 bytes) 2024-09-21T15:10:19.326 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:19.318+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f520 2024-09-21T15:10:19.329 INFO:teuthology.orchestra.run.smithi161.stdout:4976 punch from 0xacabb47 to 0xacb196c, (0x5e25 bytes) 2024-09-21T15:10:19.329 INFO:teuthology.orchestra.run.smithi161.stdout:4977 write 0x372d87a thru 0x37333b8 (0x5b3f bytes) 2024-09-21T15:10:19.364 INFO:teuthology.orchestra.run.smithi161.stdout:5533 writesame 0x522646d thru 0x522b139 data_size 0x1(0x4ccd bytes) 2024-09-21T15:10:19.374 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.375 INFO:teuthology.orchestra.run.smithi161.stdout:4979 write 0xccc3d9f thru 0xccc671e (0x2980 bytes) 2024-09-21T15:10:19.388 INFO:teuthology.orchestra.run.smithi161.stdout:5534 trunc from 0x522b13a to 0xe185929 2024-09-21T15:10:19.389 INFO:teuthology.orchestra.run.smithi161.stdout:5487 writesame 0xbb190f7 thru 0xbb26ef7 data_size 0x17(0xde01 bytes) 2024-09-21T15:10:19.392 INFO:teuthology.orchestra.run.smithi161.stdout:5488 punch from 0x595d040 to 0x5961e30, (0x4df0 bytes) 2024-09-21T15:10:19.392 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.392 INFO:teuthology.orchestra.run.smithi161.stdout:5491 read 0x8b974fa thru 0x8b9c482 (0x4f89 bytes) 2024-09-21T15:10:19.393 INFO:teuthology.orchestra.run.smithi161.stdout:5492 writesame 0x7fa2ab5 thru 0x7fae90e data_size 0x16(0xbe5a bytes) 2024-09-21T15:10:19.393 INFO:teuthology.orchestra.run.smithi161.stdout:4980 punch from 0x12fc36d to 0x1304c64, (0x88f7 bytes) 2024-09-21T15:10:19.393 INFO:teuthology.orchestra.run.smithi161.stdout:4981 punch from 0xde083c0 to 0xde180c8, (0xfd08 bytes) 2024-09-21T15:10:19.394 INFO:teuthology.orchestra.run.smithi161.stdout:4982 read 0xdba263b thru 0xdbae8d7 (0xc29d bytes) 2024-09-21T15:10:19.397 INFO:teuthology.orchestra.run.smithi161.stdout:4983 trunc from 0xec55acb to 0xcb8bc57 2024-09-21T15:10:19.413 INFO:teuthology.orchestra.run.smithi161.stdout:5494 punch from 0x5ca05b3 to 0x5ca27a8, (0x21f5 bytes) 2024-09-21T15:10:19.413 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.414 INFO:teuthology.orchestra.run.smithi161.stdout:5496 read 0xad69a07 thru 0xad6cd18 (0x3312 bytes) 2024-09-21T15:10:19.414 INFO:teuthology.orchestra.run.smithi161.stdout:5497 writesame 0x5f1960f thru 0x5f25272 data_size 0x6(0xbc64 bytes) 2024-09-21T15:10:19.421 INFO:teuthology.orchestra.run.smithi161.stdout:5535 write 0x5f75199 thru 0x5f7e1fd (0x9065 bytes) 2024-09-21T15:10:19.436 INFO:teuthology.orchestra.run.smithi161.stdout:5498 writesame 0x8e9a716 thru 0x8ea6ba3 data_size 0x2(0xc48e bytes) 2024-09-21T15:10:19.466 INFO:teuthology.orchestra.run.smithi161.stdout:5760 write 0x753585f thru 0x7537c29 (0x23cb bytes) 2024-09-21T15:10:19.467 INFO:teuthology.orchestra.run.smithi161.stdout:5499 read 0xfe99fc thru 0xfed2d4 (0x38d9 bytes) 2024-09-21T15:10:19.467 INFO:teuthology.orchestra.run.smithi161.stdout:5536 trunc from 0xe185929 to 0xd186ca 2024-09-21T15:10:19.468 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.468 INFO:teuthology.orchestra.run.smithi161.stdout:5501 write 0x35e854a thru 0x35e8ded (0x8a4 bytes) 2024-09-21T15:10:19.488 INFO:teuthology.orchestra.run.smithi161.stdout:4285 write 0xb9b5658 thru 0xb9b6d62 (0x170b bytes) 2024-09-21T15:10:19.489 INFO:teuthology.orchestra.run.smithi161.stdout:5502 write 0x3aae1a4 thru 0x3ab800e (0x9e6b bytes) 2024-09-21T15:10:19.497 INFO:teuthology.orchestra.run.smithi161.stdout:5761 writesame 0x71b929a thru 0x71bd32f data_size 0x7(0x4096 bytes) 2024-09-21T15:10:19.501 INFO:teuthology.orchestra.run.smithi161.stdout:5503 read 0x8c95c0e thru 0x8ca08d0 (0xacc3 bytes) 2024-09-21T15:10:19.501 INFO:teuthology.orchestra.run.smithi161.stdout:5504 read 0x9a0301b thru 0x9a0c0e7 (0x90cd bytes) 2024-09-21T15:10:19.501 INFO:teuthology.orchestra.run.smithi161.stdout:5505 read 0x4327c91 thru 0x4331ae1 (0x9e51 bytes) 2024-09-21T15:10:19.508 INFO:teuthology.orchestra.run.smithi161.stdout:4288 write 0x26a3493 thru 0x26a4589 (0x10f7 bytes) 2024-09-21T15:10:19.514 INFO:teuthology.orchestra.run.smithi161.stdout:5764 punch from 0x613b77d to 0x613d0f2, (0x1975 bytes) 2024-09-21T15:10:19.514 INFO:teuthology.orchestra.run.smithi161.stdout:5506 trunc from 0xbb26ef8 to 0x6c6216d 2024-09-21T15:10:19.526 INFO:teuthology.orchestra.run.smithi161.stdout:4289 write 0x689b885 thru 0x689e247 (0x29c3 bytes) 2024-09-21T15:10:19.585 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.590 INFO:teuthology.orchestra.run.smithi161.stdout:5507 trunc from 0x6c6216d to 0x8162936 2024-09-21T15:10:19.591 INFO:teuthology.orchestra.run.smithi161.stdout:5766 write 0xa1c8481 thru 0xa1d4525 (0xc0a5 bytes) 2024-09-21T15:10:19.607 INFO:teuthology.orchestra.run.smithi161.stdout:5767 writesame 0x3ea2958 thru 0x3eb24a7 data_size 0x8(0xfb50 bytes) 2024-09-21T15:10:19.608 INFO:teuthology.orchestra.run.smithi161.stdout:4985 write 0xdf1d9d3 thru 0xdf217b3 (0x3de1 bytes) 2024-09-21T15:10:19.626 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.626 INFO:teuthology.orchestra.run.smithi161.stdout:5770 write 0x993d08 thru 0x9975a0 (0x3899 bytes) 2024-09-21T15:10:19.629 INFO:teuthology.orchestra.run.smithi161.stdout:4291 write 0xd2a33e9 thru 0xd2aa6ad (0x72c5 bytes) 2024-09-21T15:10:19.632 INFO:teuthology.orchestra.run.smithi161.stdout:4986 read 0x8a35a3b thru 0x8a3dd5e (0x8324 bytes) 2024-09-21T15:10:19.645 INFO:teuthology.orchestra.run.smithi161.stdout:5537 read 0x30c3f5 thru 0x312629 (0x6235 bytes) 2024-09-21T15:10:19.647 INFO:teuthology.orchestra.run.smithi161.stdout:4987 trunc from 0xdf217b4 to 0x6a60b1b 2024-09-21T15:10:19.647 INFO:teuthology.orchestra.run.smithi161.stdout:5771 trunc from 0xa1d4526 to 0xa0b0e07 2024-09-21T15:10:19.647 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.648 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.660 INFO:teuthology.orchestra.run.smithi161.stdout:4292 read 0x50acacc thru 0x50b03c9 (0x38fe bytes) 2024-09-21T15:10:19.660 INFO:teuthology.orchestra.run.smithi161.stdout:4294 write 0x630f909 thru 0x631967f (0x9d77 bytes) 2024-09-21T15:10:19.667 INFO:teuthology.orchestra.run.smithi161.stdout:5540 trunc from 0xd186ca to 0xad96db0 2024-09-21T15:10:19.676 INFO:teuthology.orchestra.run.smithi161.stdout:5508 writesame 0xb6e5c2e thru 0xb6f22c4 data_size 0x1(0xc697 bytes) 2024-09-21T15:10:19.678 INFO:teuthology.orchestra.run.smithi161.stdout:4295 punch from 0xc4b5a33 to 0xc4b5ac1, (0x8e bytes) 2024-09-21T15:10:19.678 INFO:teuthology.orchestra.run.smithi161.stdout:4297 read 0x19f9a0c thru 0x1a08701 (0xecf6 bytes) 2024-09-21T15:10:19.679 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.679 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.679 INFO:teuthology.orchestra.run.smithi161.stdout:4300 read 0x336cfe3 thru 0x33796a2 (0xc6c0 bytes) 2024-09-21T15:10:19.679 INFO:teuthology.orchestra.run.smithi161.stdout:4305 writesame 0xa46497b thru 0xa4684dc data_size 0xb(0x3b62 bytes) 2024-09-21T15:10:19.687 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #27, image image_cluster1.client.mirror.1-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent28 2024-09-21T15:10:19.695 INFO:teuthology.orchestra.run.smithi161.stdout:4307 punch from 0x9246689 to 0x92486e6, (0x205d bytes) 2024-09-21T15:10:19.699 INFO:teuthology.orchestra.run.smithi161.stdout:5509 trunc from 0xb6f22c5 to 0x29ac352 2024-09-21T15:10:19.700 INFO:teuthology.orchestra.run.smithi161.stdout:5541 read 0x6738e69 thru 0x6739404 (0x59c bytes) 2024-09-21T15:10:19.700 INFO:teuthology.orchestra.run.smithi161.stdout:5543 write 0x5794a0 thru 0x585766 (0xc2c7 bytes) 2024-09-21T15:10:19.714 INFO:teuthology.orchestra.run.smithi161.stdout:5772 trunc from 0xa0b0e07 to 0x22b6ffa 2024-09-21T15:10:19.784 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.784 INFO:teuthology.orchestra.run.smithi161.stdout:5774 read 0x196b2a7 thru 0x1974889 (0x95e3 bytes) 2024-09-21T15:10:19.784 INFO:teuthology.orchestra.run.smithi161.stdout:5776 write 0x1460db1 thru 0x14632ae (0x24fe bytes) 2024-09-21T15:10:19.801 INFO:teuthology.orchestra.run.smithi161.stdout:5778 read 0x16f514e thru 0x16f71c3 (0x2076 bytes) 2024-09-21T15:10:19.810 INFO:teuthology.orchestra.run.smithi161.stdout:4308 write 0xdde4ad5 thru 0xddea051 (0x557d bytes) 2024-09-21T15:10:19.817 INFO:teuthology.orchestra.run.smithi161.stdout:5510 writesame 0x370a56f thru 0x3716b8d data_size 0x1(0xc61f bytes) 2024-09-21T15:10:19.820 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.820 INFO:teuthology.orchestra.run.smithi161.stdout:5546 read 0x1d5a108 thru 0x1d69900 (0xf7f9 bytes) 2024-09-21T15:10:19.821 INFO:teuthology.orchestra.run.smithi161.stdout:5547 write 0x928d8f1 thru 0x928e3b0 (0xac0 bytes) 2024-09-21T15:10:19.830 INFO:teuthology.orchestra.run.smithi161.stdout:4309 write 0x3917429 thru 0x391d27f (0x5e57 bytes) 2024-09-21T15:10:19.834 INFO:teuthology.orchestra.run.smithi161.stdout:4988 write 0x75b2f05 thru 0x75bf8aa (0xc9a6 bytes) 2024-09-21T15:10:19.841 INFO:teuthology.orchestra.run.smithi161.stdout:5548 read 0x4dc27cf thru 0x4dd081b (0xe04d bytes) 2024-09-21T15:10:19.841 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.841 INFO:teuthology.orchestra.run.smithi161.stdout:5553 read 0x13ee691 thru 0x13fd51a (0xee8a bytes) 2024-09-21T15:10:19.842 INFO:teuthology.orchestra.run.smithi161.stdout:5554 punch from 0x5d95dbd to 0x5d9cb43, (0x6d86 bytes) 2024-09-21T15:10:19.842 INFO:teuthology.orchestra.run.smithi161.stdout:5556 read 0x8f2702f thru 0x8f29663 (0x2635 bytes) 2024-09-21T15:10:19.842 INFO:teuthology.orchestra.run.smithi161.stdout:5557 write 0x5fe55d5 thru 0x5ff4bae (0xf5da bytes) 2024-09-21T15:10:19.851 INFO:teuthology.orchestra.run.smithi161.stdout:4310 clone 46 order 20 su 16384 sc 13 2024-09-21T15:10:19.855 INFO:teuthology.orchestra.run.smithi161.stdout:5779 writesame 0xacffe21 thru 0xad0e8ec data_size 0x6(0xeacc bytes) 2024-09-21T15:10:19.860 INFO:teuthology.orchestra.run.smithi161.stdout:4989 read 0x60b30f7 thru 0x60b9ade (0x69e8 bytes) 2024-09-21T15:10:19.861 INFO:teuthology.orchestra.run.smithi161.stdout:4990 punch from 0x6a06682 to 0x6a0d66b, (0x6fe9 bytes) 2024-09-21T15:10:19.861 INFO:teuthology.orchestra.run.smithi161.stdout:5780 read 0x42ce77a thru 0x42cf4b2 (0xd39 bytes) 2024-09-21T15:10:19.861 INFO:teuthology.orchestra.run.smithi161.stdout:4991 read 0x4bb112 thru 0x4bdee6 (0x2dd5 bytes) 2024-09-21T15:10:19.861 INFO:teuthology.orchestra.run.smithi161.stdout:5781 write 0x7f947ce thru 0x7f9f0b0 (0xa8e3 bytes) 2024-09-21T15:10:19.864 INFO:teuthology.orchestra.run.smithi161.stdout:4992 punch from 0x2fa2565 to 0x2fabe94, (0x992f bytes) 2024-09-21T15:10:19.864 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.864 INFO:teuthology.orchestra.run.smithi161.stdout:4994 punch from 0x498278a to 0x498e945, (0xc1bb bytes) 2024-09-21T15:10:19.864 INFO:teuthology.orchestra.run.smithi161.stdout:4995 read 0x23e2e51 thru 0x23e5004 (0x21b4 bytes) 2024-09-21T15:10:19.864 INFO:teuthology.orchestra.run.smithi161.stdout:4996 read 0x12fd4c1 thru 0x1304f3c (0x7a7c bytes) 2024-09-21T15:10:19.865 INFO:teuthology.orchestra.run.smithi161.stdout:4998 punch from 0x3725586 to 0x373122a, (0xbca4 bytes) 2024-09-21T15:10:19.870 INFO:teuthology.orchestra.run.smithi161.stdout:5558 write 0x4f3026d thru 0x4f3592f (0x56c3 bytes) 2024-09-21T15:10:19.877 INFO:teuthology.orchestra.run.smithi161.stdout:5511 write 0x38f1998 thru 0x38fd23a (0xb8a3 bytes) 2024-09-21T15:10:19.886 INFO:teuthology.orchestra.run.smithi161.stdout:5782 punch from 0x153d3b6 to 0x153d490, (0xda bytes) 2024-09-21T15:10:19.886 INFO:teuthology.orchestra.run.smithi161.stdout:5784 read 0xaad47dc thru 0xaadefd4 (0xa7f9 bytes) 2024-09-21T15:10:19.887 INFO:teuthology.orchestra.run.smithi161.stdout:5785 read 0x9cf2001 thru 0x9d00c86 (0xec86 bytes) 2024-09-21T15:10:19.887 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.887 INFO:teuthology.orchestra.run.smithi161.stdout:5788 write 0x164fc43 thru 0x16503c9 (0x787 bytes) 2024-09-21T15:10:19.895 INFO:teuthology.orchestra.run.smithi161.stdout:5559 read 0x3f5e280 thru 0x3f6aeb2 (0xcc33 bytes) 2024-09-21T15:10:19.896 INFO:teuthology.orchestra.run.smithi161.stdout:5560 write 0x35ad9ee thru 0x35b4f1e (0x7531 bytes) 2024-09-21T15:10:19.897 INFO:teuthology.orchestra.run.smithi161.stdout:5512 trunc from 0x38fd23b to 0x79d8ee 2024-09-21T15:10:19.911 INFO:teuthology.orchestra.run.smithi161.stdout:4999 write 0xaf86228 thru 0xaf94f63 (0xed3c bytes) 2024-09-21T15:10:19.912 INFO:teuthology.orchestra.run.smithi161.stdout:5789 trunc from 0xad0e8ed to 0x58dcd99 2024-09-21T15:10:19.924 INFO:teuthology.orchestra.run.smithi161.stdout:5561 write 0x2e517a6 thru 0x2e5ac76 (0x94d1 bytes) 2024-09-21T15:10:19.942 INFO:teuthology.orchestra.run.smithi161.stdout:5000 write 0x86f2fbf thru 0x86fc8d8 (0x991a bytes) 2024-09-21T15:10:19.955 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.955 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:19.955 INFO:teuthology.orchestra.run.smithi161.stdout:5564 read 0x4ad3331 thru 0x4ae13c0 (0xe090 bytes) 2024-09-21T15:10:19.955 INFO:teuthology.orchestra.run.smithi161.stdout:5565 punch from 0x4b9e3ac to 0x4bac5c1, (0xe215 bytes) 2024-09-21T15:10:19.968 INFO:teuthology.orchestra.run.smithi161.stdout:5566 trunc from 0xad96db0 to 0x34ea42d 2024-09-21T15:10:19.971 INFO:teuthology.orchestra.run.smithi161.stdout:5002 writesame 0x61d7f91 thru 0x61dcac0 data_size 0x18(0x4b30 bytes) 2024-09-21T15:10:19.988 INFO:teuthology.orchestra.run.smithi161.stdout:5790 writesame 0x3926782 thru 0x3928a25 data_size 0x6(0x22a4 bytes) 2024-09-21T15:10:19.992 INFO:teuthology.orchestra.run.smithi161.stdout:5513 writesame 0xa5473a4 thru 0xa549c5f data_size 0x2c(0x28bc bytes) 2024-09-21T15:10:19.993 INFO:teuthology.orchestra.run.smithi161.stdout:5003 write 0x716d635 thru 0x717cbb0 (0xf57c bytes) 2024-09-21T15:10:20.002 INFO:teuthology.orchestra.run.smithi161.stdout:5514 write 0x20fa496 thru 0x2101f61 (0x7acc bytes) 2024-09-21T15:10:20.020 INFO:teuthology.orchestra.run.smithi161.stdout:5515 writesame 0xa12a70a thru 0xa138992 data_size 0xd(0xe289 bytes) 2024-09-21T15:10:20.024 INFO:teuthology.orchestra.run.smithi161.stdout:5004 read 0x3430fa0 thru 0x343210f (0x1170 bytes) 2024-09-21T15:10:20.024 INFO:teuthology.orchestra.run.smithi161.stdout:5005 punch from 0x311d9d1 to 0x31231d4, (0x5803 bytes) 2024-09-21T15:10:20.025 INFO:teuthology.orchestra.run.smithi161.stdout:5006 write 0x48bf69e thru 0x48ceadb (0xf43e bytes) 2024-09-21T15:10:20.035 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:20.038 INFO:teuthology.orchestra.run.smithi161.stdout:5517 trunc from 0xa549c60 to 0xbd53e9d 2024-09-21T15:10:20.040 INFO:teuthology.orchestra.run.smithi161.stdout:5567 read 0x20e77a8 thru 0x20f4ee5 (0xd73e bytes) 2024-09-21T15:10:20.040 INFO:teuthology.orchestra.run.smithi161.stdout:5568 write 0xec77cc thru 0xece434 (0x6c69 bytes) 2024-09-21T15:10:20.054 INFO:teuthology.orchestra.run.smithi161.stdout:5248 read 0x66d55f4 thru 0x66e1f4f (0xc95c bytes) 2024-09-21T15:10:20.060 INFO:teuthology.orchestra.run.smithi161.stdout:5007 writesame 0x6dfad71 thru 0x6e06d32 data_size 0x5(0xbfc2 bytes) 2024-09-21T15:10:20.061 INFO:teuthology.orchestra.run.smithi161.stdout:5792 write 0x8e95d2d thru 0x8ea3e08 (0xe0dc bytes) 2024-09-21T15:10:20.080 INFO:teuthology.orchestra.run.smithi161.stdout:5518 writesame 0x497eb89 thru 0x4989e06 data_size 0x3e(0xb27e bytes) 2024-09-21T15:10:20.091 INFO:teuthology.orchestra.run.smithi161.stdout:5793 write 0x8add1e6 thru 0x8ae95e9 (0xc404 bytes) 2024-09-21T15:10:20.096 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:20.096 INFO:teuthology.orchestra.run.smithi161.stdout:5012 write 0x162e8a5 thru 0x163a505 (0xbc61 bytes) 2024-09-21T15:10:20.099 INFO:teuthology.orchestra.run.smithi161.stdout:5249 punch from 0x341c870 to 0x341f199, (0x2929 bytes) 2024-09-21T15:10:20.100 INFO:teuthology.orchestra.run.smithi161.stdout:5250 trunc from 0xcdefa4d to 0xcd9f2d8 2024-09-21T15:10:20.100 INFO:teuthology.orchestra.run.smithi161.stdout:5519 writesame 0x124f1fb thru 0x1258b20 data_size 0x1(0x9926 bytes) 2024-09-21T15:10:20.150 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:20.151 INFO:teuthology.orchestra.run.smithi161.stdout:5795 read 0x4c8bb47 thru 0x4c91150 (0x560a bytes) 2024-09-21T15:10:20.151 INFO:teuthology.orchestra.run.smithi161.stdout:5796 writesame 0x3a9638d thru 0x3a9a5b7 data_size 0x1(0x422b bytes) 2024-09-21T15:10:20.158 INFO:teuthology.orchestra.run.smithi161.stdout:5521 trunc from 0xbd53e9d to 0xc744fc2 2024-09-21T15:10:20.176 INFO:teuthology.orchestra.run.smithi161.stdout:5013 read 0x8c61db8 thru 0x8c62241 (0x48a bytes) 2024-09-21T15:10:20.176 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:20.176 INFO:teuthology.orchestra.run.smithi161.stdout:5016 read 0x19311a8 thru 0x193b2b4 (0xa10d bytes) 2024-09-21T15:10:20.177 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:20.177 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:20.177 INFO:teuthology.orchestra.run.smithi161.stdout:5021 writesame 0x82926b7 thru 0x82a1a1f data_size 0x1(0xf369 bytes) 2024-09-21T15:10:20.181 INFO:teuthology.orchestra.run.smithi161.stdout:5571 write 0x5a7f413 thru 0x5a8a9c2 (0xb5b0 bytes) 2024-09-21T15:10:20.216 INFO:teuthology.orchestra.run.smithi161.stdout:5798 write 0x82154b thru 0x82cc75 (0xb72b bytes) 2024-09-21T15:10:20.231 INFO:teuthology.orchestra.run.smithi161.stdout:5023 read 0x9e3bc6a thru 0x9e48e1d (0xd1b4 bytes) 2024-09-21T15:10:20.278 INFO:teuthology.orchestra.run.smithi161.stdout:5799 writesame 0xc829673 thru 0xc8377cb data_size 0x1(0xe159 bytes) 2024-09-21T15:10:20.281 INFO:teuthology.orchestra.run.smithi161.stdout:5800 write 0xb92f6dc thru 0xb93aa4d (0xb372 bytes) 2024-09-21T15:10:20.293 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:20.293 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:20.301 INFO:teuthology.orchestra.run.smithi161.stdout:5024 write 0xe16b056 thru 0xe16bd25 (0xcd0 bytes) 2024-09-21T15:10:20.305 INFO:teuthology.orchestra.run.smithi161.stdout:5807 trunc from 0xc8377cc to 0x70ca1ae 2024-09-21T15:10:20.311 INFO:teuthology.orchestra.run.smithi161.stdout:5025 punch from 0x958a654 to 0x9591689, (0x7035 bytes) 2024-09-21T15:10:20.311 INFO:teuthology.orchestra.run.smithi161.stdout:5026 read 0x2a8f33c thru 0x2a98ba9 (0x986e bytes) 2024-09-21T15:10:20.319 INFO:teuthology.orchestra.run.smithi161.stdout:5027 trunc from 0xe16bd26 to 0xbb8e4d0 2024-09-21T15:10:20.324 INFO:teuthology.orchestra.run.smithi161.stdout:5522 trunc from 0xc744fc2 to 0x4ce10d0 2024-09-21T15:10:20.346 INFO:teuthology.orchestra.run.smithi161.stdout:5572 write 0xcf58de8 thru 0xcf5fca6 (0x6ebf bytes) 2024-09-21T15:10:20.374 INFO:teuthology.orchestra.run.smithi161.stdout:5028 write 0x8db82bf thru 0x8dbdbac (0x58ee bytes) 2024-09-21T15:10:20.374 INFO:teuthology.orchestra.run.smithi161.stdout:5809 punch from 0x6f04ef2 to 0x6f07c1d, (0x2d2b bytes) 2024-09-21T15:10:20.374 INFO:teuthology.orchestra.run.smithi161.stdout:5811 read 0x142a32d thru 0x142d38f (0x3063 bytes) 2024-09-21T15:10:20.377 INFO:teuthology.orchestra.run.smithi161.stdout:5573 read 0x86d7e3c thru 0x86dcf76 (0x513b bytes) 2024-09-21T15:10:20.377 INFO:teuthology.orchestra.run.smithi161.stdout:5575 punch from 0x17349a0 to 0x17441c1, (0xf821 bytes) 2024-09-21T15:10:20.377 INFO:teuthology.orchestra.run.smithi161.stdout:5576 write 0x5ce69c4 thru 0x5cf47f3 (0xde30 bytes) 2024-09-21T15:10:20.395 INFO:teuthology.orchestra.run.smithi161.stdout:5029 read 0x36aa99f thru 0x36b21b4 (0x7816 bytes) 2024-09-21T15:10:20.396 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:20.396 INFO:teuthology.orchestra.run.smithi161.stdout:5033 writesame 0x34818fd thru 0x348e13f data_size 0x17(0xc843 bytes) 2024-09-21T15:10:20.398 INFO:teuthology.orchestra.run.smithi161.stdout:5251 trunc from 0xcd9f2d8 to 0x34408b0 2024-09-21T15:10:20.402 INFO:teuthology.orchestra.run.smithi161.stdout:5523 read 0x3fad36f thru 0x3fb0c80 (0x3912 bytes) 2024-09-21T15:10:20.403 INFO:teuthology.orchestra.run.smithi161.stdout:5524 punch from 0x184bd6 to 0x18801d, (0x3447 bytes) 2024-09-21T15:10:20.419 INFO:teuthology.orchestra.run.smithi161.stdout:5034 write 0x5a107c5 thru 0x5a10d55 (0x591 bytes) 2024-09-21T15:10:20.435 INFO:teuthology.orchestra.run.smithi161.stdout:5813 writesame 0xda05146 thru 0xda0ed46 data_size 0x1(0x9c01 bytes) 2024-09-21T15:10:20.523 INFO:teuthology.orchestra.run.smithi161.stdout:5036 punch from 0x16f5c68 to 0x16ff587, (0x991f bytes) 2024-09-21T15:10:20.523 INFO:teuthology.orchestra.run.smithi161.stdout:5037 write 0x1960002 thru 0x19635c5 (0x35c4 bytes) 2024-09-21T15:10:20.523 INFO:teuthology.orchestra.run.smithi161.stdout:5817 trunc from 0xda0ed47 to 0xaeb994b 2024-09-21T15:10:20.557 INFO:teuthology.orchestra.run.smithi161.stdout:5577 write 0xdd14401 thru 0xdd217bb (0xd3bb bytes) 2024-09-21T15:10:20.587 INFO:teuthology.orchestra.run.smithi161.stdout:5525 writesame 0xc846615 thru 0xc854869 data_size 0x1(0xe255 bytes) 2024-09-21T15:10:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:5578 punch from 0xcddca26 to 0xcde8bff, (0xc1d9 bytes) 2024-09-21T15:10:20.688 INFO:teuthology.orchestra.run.smithi161.stdout:5579 write 0x889c867 thru 0x88a9e5c (0xd5f6 bytes) 2024-09-21T15:10:20.709 INFO:teuthology.orchestra.run.smithi161.stdout:5526 writesame 0xd1a3a95 thru 0xd1a5283 data_size 0x1(0x17ef bytes) 2024-09-21T15:10:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:5528 read 0xa6ee100 thru 0xa6f8c96 (0xab97 bytes) 2024-09-21T15:10:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:5529 read 0xc5c5b87 thru 0xc5ccebe (0x7338 bytes) 2024-09-21T15:10:20.748 INFO:teuthology.orchestra.run.smithi161.stdout:5530 write 0x52d9236 thru 0x52e7724 (0xe4ef bytes) 2024-09-21T15:10:20.792 INFO:teuthology.orchestra.run.smithi161.stdout:5580 writesame 0x7bb129f thru 0x7bbbbb0 data_size 0x26(0xa912 bytes) 2024-09-21T15:10:20.807 INFO:teuthology.orchestra.run.smithi161.stdout:5039 write 0xd721add thru 0xd7311d6 (0xf6fa bytes) 2024-09-21T15:10:20.877 INFO:teuthology.orchestra.run.smithi161.stdout:5818 read 0x662eafd thru 0x663186c (0x2d70 bytes) 2024-09-21T15:10:20.880 INFO:teuthology.orchestra.run.smithi161.stdout:5531 trunc from 0xd1a5284 to 0xab1ef44 2024-09-21T15:10:20.894 INFO:teuthology.orchestra.run.smithi161.stdout:5819 trunc from 0xaeb994b to 0x1ef87e8 2024-09-21T15:10:20.914 INFO:teuthology.orchestra.run.smithi161.stdout:5040 write 0x4312b11 thru 0x432257e (0xfa6e bytes) 2024-09-21T15:10:20.941 INFO:teuthology.orchestra.run.smithi161.stdout:5581 write 0x5d7e13d thru 0x5d876d3 (0x9597 bytes) 2024-09-21T15:10:20.971 INFO:teuthology.orchestra.run.smithi161.stdout:5582 write 0xc70aa03 thru 0xc7156c3 (0xacc1 bytes) 2024-09-21T15:10:21.034 INFO:teuthology.orchestra.run.smithi161.stdout:5042 write 0x73dab26 thru 0x73e28ea (0x7dc5 bytes) 2024-09-21T15:10:21.053 INFO:teuthology.orchestra.run.smithi161.stdout:5584 write 0x1f2aea7 thru 0x1f2d5fd (0x2757 bytes) 2024-09-21T15:10:21.076 INFO:teuthology.orchestra.run.smithi161.stdout:5532 punch from 0x111ef9 to 0x113142, (0x1249 bytes) 2024-09-21T15:10:21.076 INFO:teuthology.orchestra.run.smithi161.stdout:5533 write 0x8573009 thru 0x857fa43 (0xca3b bytes) 2024-09-21T15:10:21.081 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.081 INFO:teuthology.orchestra.run.smithi161.stdout:5586 writesame 0xd66a2a5 thru 0xd66fe7a data_size 0x5(0x5bd6 bytes) 2024-09-21T15:10:21.082 INFO:teuthology.orchestra.run.smithi161.stdout:5043 write 0x15a11d7 thru 0x15b093b (0xf765 bytes) 2024-09-21T15:10:21.111 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.111 INFO:teuthology.orchestra.run.smithi161.stdout:5535 writesame 0x8d8cbfb thru 0x8d901bd data_size 0x1(0x35c3 bytes) 2024-09-21T15:10:21.115 INFO:teuthology.orchestra.run.smithi161.stdout:5588 read 0xd5cde70 thru 0xd5dda36 (0xfbc7 bytes) 2024-09-21T15:10:21.115 INFO:teuthology.orchestra.run.smithi161.stdout:5589 write 0x7df1304 thru 0x7dfd0e9 (0xbde6 bytes) 2024-09-21T15:10:21.138 INFO:teuthology.orchestra.run.smithi161.stdout:5044 read 0x1f12d5e thru 0x1f17bc6 (0x4e69 bytes) 2024-09-21T15:10:21.138 INFO:teuthology.orchestra.run.smithi161.stdout:5045 punch from 0x2317648 to 0x231b88b, (0x4243 bytes) 2024-09-21T15:10:21.138 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.138 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.154 INFO:teuthology.orchestra.run.smithi161.stdout:5536 trunc from 0xab1ef44 to 0x3f89c83 2024-09-21T15:10:21.159 INFO:teuthology.orchestra.run.smithi161.stdout:5591 write 0xc553357 thru 0xc560764 (0xd40e bytes) 2024-09-21T15:10:21.159 INFO:teuthology.orchestra.run.smithi161.stdout:5051 trunc from 0xd7311d7 to 0x21c221a 2024-09-21T15:10:21.185 INFO:teuthology.orchestra.run.smithi161.stdout:5820 write 0x9591d90 thru 0x959763f (0x58b0 bytes) 2024-09-21T15:10:21.230 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.230 INFO:teuthology.orchestra.run.smithi161.stdout:5822 punch from 0x8ca443a to 0x8ca5480, (0x1046 bytes) 2024-09-21T15:10:21.230 INFO:teuthology.orchestra.run.smithi161.stdout:5823 punch from 0x6a0ef4f to 0x6a165fd, (0x76ae bytes) 2024-09-21T15:10:21.230 INFO:teuthology.orchestra.run.smithi161.stdout:5824 clone 37 order 21 su 131072 sc 4 2024-09-21T15:10:21.243 INFO:teuthology.orchestra.run.smithi161.stdout:5592 read 0x5210c55 thru 0x5218bf6 (0x7fa2 bytes) 2024-09-21T15:10:21.243 INFO:teuthology.orchestra.run.smithi161.stdout:5593 read 0xa1a314c thru 0xa1abeb2 (0x8d67 bytes) 2024-09-21T15:10:21.243 INFO:teuthology.orchestra.run.smithi161.stdout:5594 writesame 0x8a9433d thru 0x8a9d83c data_size 0x80(0x9500 bytes) 2024-09-21T15:10:21.256 INFO:teuthology.orchestra.run.smithi161.stdout:5539 punch from 0x33cfe0e to 0x33d2b70, (0x2d62 bytes) 2024-09-21T15:10:21.257 INFO:teuthology.orchestra.run.smithi161.stdout:5540 trunc from 0x3f89c83 to 0x4ac0752 2024-09-21T15:10:21.315 INFO:teuthology.orchestra.run.smithi161.stdout:5596 writesame 0x6487451 thru 0x648b4d2 data_size 0x17(0x4082 bytes) 2024-09-21T15:10:21.315 INFO:teuthology.orchestra.run.smithi161.stdout:5541 trunc from 0x4ac0752 to 0xeb46146 2024-09-21T15:10:21.345 INFO:teuthology.orchestra.run.smithi161.stdout:5542 write 0x471f5ce thru 0x47275d5 (0x8008 bytes) 2024-09-21T15:10:21.358 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.358 INFO:teuthology.orchestra.run.smithi161.stdout:5544 write 0xb727a30 thru 0xb7280a9 (0x67a bytes) 2024-09-21T15:10:21.376 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.378 INFO:teuthology.orchestra.run.smithi161.stdout:5598 trunc from 0xdd217bc to 0xece108a 2024-09-21T15:10:21.391 INFO:teuthology.orchestra.run.smithi161.stdout:5545 writesame 0xafd133f thru 0xafd3566 data_size 0x4(0x2228 bytes) 2024-09-21T15:10:21.403 INFO:teuthology.orchestra.run.smithi161.stdout:5546 writesame 0x5d3c32e thru 0x5d3f759 data_size 0x3f(0x342c bytes) 2024-09-21T15:10:21.424 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.424 INFO:teuthology.orchestra.run.smithi161.stdout:5601 read 0x3ec3b79 thru 0x3ec863f (0x4ac7 bytes) 2024-09-21T15:10:21.425 INFO:teuthology.orchestra.run.smithi161.stdout:5602 writesame 0x55e7ea3 thru 0x55ed435 data_size 0x1(0x5593 bytes) 2024-09-21T15:10:21.429 INFO:teuthology.orchestra.run.smithi161.stdout:5550 read 0x85f52e7 thru 0x860256e (0xd288 bytes) 2024-09-21T15:10:21.429 INFO:teuthology.orchestra.run.smithi161.stdout:5551 read 0xa80ec9f thru 0xa81c544 (0xd8a6 bytes) 2024-09-21T15:10:21.433 INFO:teuthology.orchestra.run.smithi161.stdout:5552 writesame 0x8d665f3 thru 0x8d712b9 data_size 0x1(0xacc7 bytes) 2024-09-21T15:10:21.502 INFO:teuthology.orchestra.run.smithi161.stdout:5052 punch from 0x2d928a to 0x2df925, (0x669b bytes) 2024-09-21T15:10:21.502 INFO:teuthology.orchestra.run.smithi161.stdout:5053 punch from 0x10b263f to 0x10bf4a1, (0xce62 bytes) 2024-09-21T15:10:21.502 INFO:teuthology.orchestra.run.smithi161.stdout:5054 read 0xdb7a1 thru 0xea3b7 (0xec17 bytes) 2024-09-21T15:10:21.504 INFO:teuthology.orchestra.run.smithi161.stdout:5603 punch from 0x2e608d2 to 0x2e6d4c3, (0xcbf1 bytes) 2024-09-21T15:10:21.504 INFO:teuthology.orchestra.run.smithi161.stdout:5604 read 0xd6300fa thru 0xd63a64b (0xa552 bytes) 2024-09-21T15:10:21.506 INFO:teuthology.orchestra.run.smithi161.stdout:5057 punch from 0xf17291 to 0xf22049, (0xadb8 bytes) 2024-09-21T15:10:21.506 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.507 INFO:teuthology.orchestra.run.smithi161.stdout:5605 punch from 0x56c3fb7 to 0x56cb53a, (0x7583 bytes) 2024-09-21T15:10:21.507 INFO:teuthology.orchestra.run.smithi161.stdout:5606 writesame 0x99c11ee thru 0x99ce25e data_size 0x93(0xd071 bytes) 2024-09-21T15:10:21.539 INFO:teuthology.orchestra.run.smithi161.stdout:5553 write 0xa26e4d2 thru 0xa27bdf9 (0xd928 bytes) 2024-09-21T15:10:21.572 INFO:teuthology.orchestra.run.smithi161.stdout:5555 read 0xcaff260 thru 0xcb099b1 (0xa752 bytes) 2024-09-21T15:10:21.575 INFO:teuthology.orchestra.run.smithi161.stdout:5556 punch from 0x7409be4 to 0x740cdde, (0x31fa bytes) 2024-09-21T15:10:21.575 INFO:teuthology.orchestra.run.smithi161.stdout:5557 write 0xe2b8d96 thru 0xe2c6022 (0xd28d bytes) 2024-09-21T15:10:21.576 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.576 INFO:teuthology.orchestra.run.smithi161.stdout:5609 writesame 0x6da4238 thru 0x6da8699 data_size 0x1(0x4462 bytes) 2024-09-21T15:10:21.581 INFO:teuthology.orchestra.run.smithi161.stdout:5059 writesame 0xd829d8f thru 0xd8333e4 data_size 0x7(0x9656 bytes) 2024-09-21T15:10:21.599 INFO:teuthology.orchestra.run.smithi161.stdout:5060 punch from 0x8baa48a to 0x8baaf42, (0xab8 bytes) 2024-09-21T15:10:21.599 INFO:teuthology.orchestra.run.smithi161.stdout:5061 write 0x37a5505 thru 0x37a8ab4 (0x35b0 bytes) 2024-09-21T15:10:21.627 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2024-09-21T15:10:21.627 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:10:21.628 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.0 2024-09-21T15:10:21.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2024-09-21T15:10:21.628 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2024-09-21T15:10:21.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2024-09-21T15:10:21.630 INFO:tasks.rbd_mirror_thrash:waiting for 69 secs before thrashing 2024-09-21T15:10:21.652 INFO:teuthology.orchestra.run.smithi161.stdout:5558 writesame 0xd070c0b thru 0xd07797c data_size 0x1(0x6d72 bytes) 2024-09-21T15:10:21.658 INFO:teuthology.orchestra.run.smithi161.stdout:5062 read 0x28c8a0 thru 0x29417e (0x78df bytes) 2024-09-21T15:10:21.660 INFO:teuthology.orchestra.run.smithi161.stdout:5064 punch from 0x26c1f5c to 0x26c7987, (0x5a2b bytes) 2024-09-21T15:10:21.660 INFO:teuthology.orchestra.run.smithi161.stdout:5065 read 0x4651f48 thru 0x46568e6 (0x499f bytes) 2024-09-21T15:10:21.660 INFO:teuthology.orchestra.run.smithi161.stdout:5067 write 0x5c55b77 thru 0x5c5d4d7 (0x7961 bytes) 2024-09-21T15:10:21.673 INFO:teuthology.orchestra.run.smithi161.stdout:5610 write 0xbbf68a8 thru 0xbbfbd67 (0x54c0 bytes) 2024-09-21T15:10:21.755 INFO:teuthology.orchestra.run.smithi161.stdout:5611 writesame 0xc3655df thru 0xc36763e data_size 0x10(0x2060 bytes) 2024-09-21T15:10:21.764 INFO:teuthology.orchestra.run.smithi161.stdout:5561 trunc from 0xeb46146 to 0x6fd42d3 2024-09-21T15:10:21.768 INFO:teuthology.orchestra.run.smithi161.stdout:5069 trunc from 0xd8333e5 to 0xad482d4 2024-09-21T15:10:21.804 INFO:teuthology.orchestra.run.smithi161.stdout:5614 writesame 0x4eed2f6 thru 0x4ef8739 data_size 0x8b(0xb444 bytes) 2024-09-21T15:10:21.813 INFO:teuthology.orchestra.run.smithi161.stdout:5253 read 0x31c2793 thru 0x31cdd8f (0xb5fd bytes) 2024-09-21T15:10:21.856 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone45 from 0xddea052 (overlap 0x368dae) to 0x0 2024-09-21T15:10:21.861 INFO:teuthology.orchestra.run.smithi161.stdout:5615 write 0x1d3fcf4 thru 0x1d47ff8 (0x8305 bytes) 2024-09-21T15:10:21.901 INFO:teuthology.orchestra.run.smithi161.stdout:5071 write 0x34df935 thru 0x34ece99 (0xd565 bytes) 2024-09-21T15:10:21.902 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.902 INFO:teuthology.orchestra.run.smithi161.stdout:5619 write 0x8176181 thru 0x817e54f (0x83cf bytes) 2024-09-21T15:10:21.912 INFO:teuthology.orchestra.run.smithi161.stdout:5562 read 0x4a539d8 thru 0x4a5867c (0x4ca5 bytes) 2024-09-21T15:10:21.913 INFO:teuthology.orchestra.run.smithi161.stdout:5563 write 0x42cd3c5 thru 0x42d4b88 (0x77c4 bytes) 2024-09-21T15:10:21.940 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.940 INFO:teuthology.orchestra.run.smithi161.stdout:5565 read 0x87cfb6 thru 0x885a9d (0x8ae8 bytes) 2024-09-21T15:10:21.940 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:21.935+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b9110 2024-09-21T15:10:21.942 INFO:teuthology.orchestra.run.smithi161.stdout:5566 read 0x14413c1 thru 0x144ce0d (0xba4d bytes) 2024-09-21T15:10:21.949 INFO:teuthology.orchestra.run.smithi161.stdout:5620 trunc from 0xece108a to 0xe79c286 2024-09-21T15:10:21.951 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.951 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:21.951 INFO:teuthology.orchestra.run.smithi161.stdout:5075 writesame 0x89470bc thru 0x894d150 data_size 0x19(0x6095 bytes) 2024-09-21T15:10:21.955 INFO:teuthology.orchestra.run.smithi161.stdout:5254 write 0xafd34e9 thru 0xafd937d (0x5e95 bytes) 2024-09-21T15:10:21.990 INFO:teuthology.orchestra.run.smithi161.stdout:5255 punch from 0x2513c41 to 0x2517a9f, (0x3e5e bytes) 2024-09-21T15:10:21.990 INFO:teuthology.orchestra.run.smithi161.stdout:5256 write 0x929d81 thru 0x92cbc4 (0x2e44 bytes) 2024-09-21T15:10:21.992 INFO:teuthology.orchestra.run.smithi161.stdout:5077 punch from 0x9e6990 to 0x9f37b2, (0xce22 bytes) 2024-09-21T15:10:22.007 INFO:teuthology.orchestra.run.smithi161.stdout:5257 punch from 0x1a2e931 to 0x1a3503e, (0x670d bytes) 2024-09-21T15:10:22.007 INFO:teuthology.orchestra.run.smithi161.stdout:5258 read 0x33a771d thru 0x33ad8be (0x61a2 bytes) 2024-09-21T15:10:22.008 INFO:teuthology.orchestra.run.smithi161.stdout:5621 punch from 0xa752101 to 0xa752cbf, (0xbbe bytes) 2024-09-21T15:10:22.008 INFO:teuthology.orchestra.run.smithi161.stdout:5622 punch from 0x3c36b9a to 0x3c39afa, (0x2f60 bytes) 2024-09-21T15:10:22.008 INFO:teuthology.orchestra.run.smithi161.stdout:5623 write 0x19a2693 thru 0x19a29b3 (0x321 bytes) 2024-09-21T15:10:22.015 INFO:teuthology.orchestra.run.smithi161.stdout:5567 writesame 0x89071d7 thru 0x891171f data_size 0x13(0xa549 bytes) 2024-09-21T15:10:22.016 INFO:teuthology.orchestra.run.smithi161.stdout:5259 write 0x2f6d47 thru 0x304300 (0xd5ba bytes) 2024-09-21T15:10:22.036 INFO:teuthology.orchestra.run.smithi161.stdout:5570 trunc from 0x8911720 to 0xda0f699 2024-09-21T15:10:22.041 INFO:teuthology.orchestra.run.smithi161.stdout:5624 write 0xbbc10cc thru 0xbbcff5a (0xee8f bytes) 2024-09-21T15:10:22.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:22.055+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59ec190e0 handle_clone_image: failed to clone image mirror/10b7d05a17f9 to image_cluster1.client.mirror.5-clone34 2024-09-21T15:10:22.063 INFO:teuthology.orchestra.run.smithi161.stdout:5260 punch from 0x1c3279f to 0x1c32f42, (0x7a3 bytes) 2024-09-21T15:10:22.063 INFO:teuthology.orchestra.run.smithi161.stdout:5261 write 0x32fe88f thru 0x3309402 (0xab74 bytes) 2024-09-21T15:10:22.067 INFO:teuthology.orchestra.run.smithi161.stdout:5627 punch from 0x410e4e4 to 0x411d13f, (0xec5b bytes) 2024-09-21T15:10:22.067 INFO:teuthology.orchestra.run.smithi161.stdout:5628 write 0x582dbff thru 0x583502a (0x742c bytes) 2024-09-21T15:10:22.075 INFO:teuthology.orchestra.run.smithi161.stdout:5078 writesame 0xb4b2253 thru 0xb4b58b0 data_size 0x1(0x365e bytes) 2024-09-21T15:10:22.099 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:22.104 INFO:teuthology.orchestra.run.smithi161.stdout:5082 trunc from 0xb4b58b1 to 0x84cd4b0 2024-09-21T15:10:22.124 INFO:teuthology.orchestra.run.smithi161.stdout:5262 punch from 0x9495b91 to 0x94a58ed, (0xfd5c bytes) 2024-09-21T15:10:22.124 INFO:teuthology.orchestra.run.smithi161.stdout:5264 punch from 0x21061fa to 0x210aa07, (0x480d bytes) 2024-09-21T15:10:22.125 INFO:teuthology.orchestra.run.smithi161.stdout:5265 write 0x5e2b24b thru 0x5e36083 (0xae39 bytes) 2024-09-21T15:10:22.126 INFO:teuthology.orchestra.run.smithi161.stdout:5629 writesame 0xe090cd thru 0xe0babf data_size 0x1(0x29f3 bytes) 2024-09-21T15:10:22.149 INFO:teuthology.orchestra.run.smithi161.stdout:5266 punch from 0x62031aa to 0x620a694, (0x74ea bytes) 2024-09-21T15:10:22.150 INFO:teuthology.orchestra.run.smithi161.stdout:5267 read 0xa55cc57 thru 0xa562039 (0x53e3 bytes) 2024-09-21T15:10:22.150 INFO:teuthology.orchestra.run.smithi161.stdout:5268 writesame 0x3f57299 thru 0x3f66082 data_size 0x1(0xedea bytes) 2024-09-21T15:10:22.166 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.0-clone36 intact 2024-09-21T15:10:22.169 INFO:teuthology.orchestra.run.smithi161.stdout:5630 read 0x542bfaa thru 0x543554c (0x95a3 bytes) 2024-09-21T15:10:22.171 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:22.166+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274dd0 2024-09-21T15:10:22.190 INFO:teuthology.orchestra.run.smithi161.stdout:5571 write 0x792b2a6 thru 0x792c285 (0xfe0 bytes) 2024-09-21T15:10:22.190 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:22.191 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:22.208 INFO:teuthology.orchestra.run.smithi161.stdout:5633 trunc from 0xe79c286 to 0x5d77175 2024-09-21T15:10:22.214 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:22.206+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab156c0 2024-09-21T15:10:22.217 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:22.214+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16680 2024-09-21T15:10:22.217 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:22.214+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18d6c0 2024-09-21T15:10:22.221 INFO:teuthology.orchestra.run.smithi161.stdout:5572 writesame 0x5bc5568 thru 0x5bd52ff data_size 0x3c(0xfd98 bytes) 2024-09-21T15:10:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:5271 trunc from 0xafd937e to 0x8f8103e 2024-09-21T15:10:22.252 INFO:teuthology.orchestra.run.smithi161.stdout:5083 read 0x2691d20 thru 0x269cd0b (0xafec bytes) 2024-09-21T15:10:22.252 INFO:teuthology.orchestra.run.smithi161.stdout:5084 read 0x55692f thru 0x55a48c (0x3b5e bytes) 2024-09-21T15:10:22.254 INFO:teuthology.orchestra.run.smithi161.stdout:5085 read 0x4cdd2f8 thru 0x4ce6a9d (0x97a6 bytes) 2024-09-21T15:10:22.254 INFO:teuthology.orchestra.run.smithi161.stdout:5087 punch from 0x2e59501 to 0x2e651bb, (0xbcba bytes) 2024-09-21T15:10:22.257 INFO:teuthology.orchestra.run.smithi161.stdout:5573 punch from 0x8e2fd9f to 0x8e3c08d, (0xc2ee bytes) 2024-09-21T15:10:22.332 INFO:teuthology.orchestra.run.smithi161.stdout:5089 write 0xb7b32c5 thru 0xb7bdfe1 (0xad1d bytes) 2024-09-21T15:10:22.362 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:22.359+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a2911860 handle_clone_image: failed to clone image mirror/10b5a6f34c2 to image_cluster1.client.mirror.0-clone34 2024-09-21T15:10:22.365 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:22.362+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:10:22.368 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:22.362+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e64e0 2024-09-21T15:10:22.369 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:22.362+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc718410 2024-09-21T15:10:22.369 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:22.362+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:10:22.369 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:22.362+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1fba0 2024-09-21T15:10:22.375 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:22.370+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074dc70 2024-09-21T15:10:22.393 INFO:teuthology.orchestra.run.smithi161.stdout:5091 writesame 0x1e5d4f4 thru 0x1e673c6 data_size 0x1(0x9ed3 bytes) 2024-09-21T15:10:22.397 INFO:teuthology.orchestra.run.smithi161.stdout:5272 read 0x8b0f5f thru 0x8b11ac (0x24e bytes) 2024-09-21T15:10:22.399 INFO:teuthology.orchestra.run.smithi161.stdout:5273 read 0x71105ab thru 0x7114fb5 (0x4a0b bytes) 2024-09-21T15:10:22.399 INFO:teuthology.orchestra.run.smithi161.stdout:5274 writesame 0xb48885 thru 0xb4d523 data_size 0x1(0x4c9f bytes) 2024-09-21T15:10:22.401 INFO:teuthology.orchestra.run.smithi161.stdout:5574 write 0xeaf9220 thru 0xeafce60 (0x3c41 bytes) 2024-09-21T15:10:22.402 INFO:teuthology.orchestra.run.smithi161.stdout:5635 punch from 0x295a2a6 to 0x295f9de, (0x5738 bytes) 2024-09-21T15:10:22.403 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:22.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:22.415+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3cbba40 handle_clone_image: failed to clone image mirror/10ad4f0e6d81 to image_cluster1.client.mirror.2-clone32 2024-09-21T15:10:22.440 INFO:teuthology.orchestra.run.smithi161.stdout:5275 read 0xd5299 thru 0xe03dd (0xb145 bytes) 2024-09-21T15:10:22.455 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #35, image image_cluster1.client.mirror.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent36 2024-09-21T15:10:22.457 INFO:teuthology.orchestra.run.smithi161.stdout:5577 write 0xa877681 thru 0xa87d6f0 (0x6070 bytes) 2024-09-21T15:10:22.461 INFO:teuthology.orchestra.run.smithi161.stdout:5092 read 0x7a59679 thru 0x7a60c78 (0x7600 bytes) 2024-09-21T15:10:22.461 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:22.461 INFO:teuthology.orchestra.run.smithi161.stdout:5094 read 0x39345cc thru 0x3934969 (0x39e bytes) 2024-09-21T15:10:22.462 INFO:teuthology.orchestra.run.smithi161.stdout:5095 trunc from 0xb7bdfe2 to 0xc4db44e 2024-09-21T15:10:22.468 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:22.463+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:10:22.468 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:22.463+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:10:22.468 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:22.463+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:10:22.469 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:22.463+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:10:22.469 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:22.463+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:10:22.470 INFO:teuthology.orchestra.run.smithi161.stdout:5578 write 0x4a39f2e thru 0x4a3b80a (0x18dd bytes) 2024-09-21T15:10:22.471 INFO:teuthology.orchestra.run.smithi161.stdout:5640 write 0x685e0f7 thru 0x686d5cc (0xf4d6 bytes) 2024-09-21T15:10:22.485 INFO:teuthology.orchestra.run.smithi161.stdout:5579 read 0xb2d6376 thru 0xb2d6b00 (0x78b bytes) 2024-09-21T15:10:22.485 INFO:teuthology.orchestra.run.smithi161.stdout:5580 writesame 0x66882d8 thru 0x6689b31 data_size 0x3(0x185a bytes) 2024-09-21T15:10:22.497 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:22.498 INFO:teuthology.orchestra.run.smithi161.stdout:5582 read 0x3600da7 thru 0x360a230 (0x948a bytes) 2024-09-21T15:10:22.498 INFO:teuthology.orchestra.run.smithi161.stdout:5584 read 0x6d781fa thru 0x6d7bed5 (0x3cdc bytes) 2024-09-21T15:10:22.498 INFO:teuthology.orchestra.run.smithi161.stdout:5585 write 0x92f48ac thru 0x92f733f (0x2a94 bytes) 2024-09-21T15:10:22.503 INFO:teuthology.orchestra.run.smithi161.stdout:5276 writesame 0xd8bbffb thru 0xd8cb6cf data_size 0x3f(0xf6d5 bytes) 2024-09-21T15:10:22.507 INFO:teuthology.orchestra.run.smithi161.stdout:5641 write 0xeb1802 thru 0xebd266 (0xba65 bytes) 2024-09-21T15:10:22.513 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:22.513 INFO:teuthology.orchestra.run.smithi161.stdout:5278 writesame 0xbc7fb10 thru 0xbc8019e data_size 0x1(0x68f bytes) 2024-09-21T15:10:22.514 INFO:teuthology.orchestra.run.smithi161.stdout:5587 write 0xe1547a1 thru 0xe160f9a (0xc7fa bytes) 2024-09-21T15:10:22.520 INFO:teuthology.orchestra.run.smithi161.stdout:5096 write 0xc1354a5 thru 0xc142301 (0xce5d bytes) 2024-09-21T15:10:22.529 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:22.537 INFO:teuthology.orchestra.run.smithi161.stdout:5643 trunc from 0x686d5cd to 0xb58c564 2024-09-21T15:10:22.547 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #44, image image_cluster1.client.mirror.3-clone44 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent45 2024-09-21T15:10:22.547 INFO:teuthology.orchestra.run.smithi161.stdout:5279 writesame 0x84be866 thru 0x84c2d1e data_size 0x1(0x44b9 bytes) 2024-09-21T15:10:22.550 INFO:teuthology.orchestra.run.smithi161.stdout:5588 writesame 0x663665d thru 0x663bae2 data_size 0x1f(0x5486 bytes) 2024-09-21T15:10:22.558 INFO:teuthology.orchestra.run.smithi161.stdout:5097 trunc from 0xc4db44e to 0xde58ff1 2024-09-21T15:10:22.575 INFO:teuthology.orchestra.run.smithi161.stdout:5590 write 0x2324140 thru 0x232cb9b (0x8a5c bytes) 2024-09-21T15:10:22.579 INFO:teuthology.orchestra.run.smithi161.stdout:5280 read 0x7907d76 thru 0x7910b25 (0x8db0 bytes) 2024-09-21T15:10:22.580 INFO:teuthology.orchestra.run.smithi161.stdout:5281 read 0xb8e7319 thru 0xb8ee5af (0x7297 bytes) 2024-09-21T15:10:22.581 INFO:teuthology.orchestra.run.smithi161.stdout:5282 read 0x91fe4a3 thru 0x9200b1c (0x267a bytes) 2024-09-21T15:10:22.587 INFO:teuthology.orchestra.run.smithi161.stdout:5645 read 0x2fef25f thru 0x2ff8bba (0x995c bytes) 2024-09-21T15:10:22.588 INFO:teuthology.orchestra.run.smithi161.stdout:5591 writesame 0xc3b4ea2 thru 0xc3b6241 data_size 0x10(0x13a0 bytes) 2024-09-21T15:10:22.589 INFO:teuthology.orchestra.run.smithi161.stdout:5650 write 0x4ec781e thru 0x4ec9af0 (0x22d3 bytes) 2024-09-21T15:10:22.603 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:22.603 INFO:teuthology.orchestra.run.smithi161.stdout:5593 read 0xa06797a thru 0xa072595 (0xac1c bytes) 2024-09-21T15:10:22.604 INFO:teuthology.orchestra.run.smithi161.stdout:5098 read 0xa713e77 thru 0xa72295c (0xeae6 bytes) 2024-09-21T15:10:22.609 INFO:teuthology.orchestra.run.smithi161.stdout:5651 trunc from 0xb58c564 to 0x91a5002 2024-09-21T15:10:22.609 INFO:teuthology.orchestra.run.smithi161.stdout:5594 read 0x6e93651 thru 0x6e9e284 (0xac34 bytes) 2024-09-21T15:10:22.609 INFO:teuthology.orchestra.run.smithi161.stdout:5595 read 0xbb4a68e thru 0xbb4d9bd (0x3330 bytes) 2024-09-21T15:10:22.610 INFO:teuthology.orchestra.run.smithi161.stdout:5596 read 0x3fe4cc thru 0x40140a (0x2f3f bytes) 2024-09-21T15:10:22.610 INFO:teuthology.orchestra.run.smithi161.stdout:5597 punch from 0x1556255 to 0x156186d, (0xb618 bytes) 2024-09-21T15:10:22.610 INFO:teuthology.orchestra.run.smithi161.stdout:5598 punch from 0x99ab075 to 0x99aea39, (0x39c4 bytes) 2024-09-21T15:10:22.610 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:22.610 INFO:teuthology.orchestra.run.smithi161.stdout:5601 write 0x13c355d thru 0x13c42ad (0xd51 bytes) 2024-09-21T15:10:22.612 INFO:teuthology.orchestra.run.smithi161.stdout:5283 trunc from 0xd8cb6d0 to 0x323b623 2024-09-21T15:10:22.613 INFO:teuthology.orchestra.run.smithi161.stdout:5604 read 0xdb85e5d thru 0xdb8cf5d (0x7101 bytes) 2024-09-21T15:10:22.614 INFO:teuthology.orchestra.run.smithi161.stdout:5605 read 0x8bd1c87 thru 0x8bdaacc (0x8e46 bytes) 2024-09-21T15:10:22.619 INFO:teuthology.orchestra.run.smithi161.stdout:5606 trunc from 0xeafce61 to 0xc2e52bc 2024-09-21T15:10:22.626 INFO:teuthology.orchestra.run.smithi161.stdout:5100 trunc from 0xde58ff1 to 0x6669e25 2024-09-21T15:10:22.654 INFO:teuthology.orchestra.run.smithi161.stdout:5652 trunc from 0x91a5002 to 0xba1a487 2024-09-21T15:10:22.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:22.671+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3ec8f00 handle_clone_image: failed to clone image mirror/10b7d05a17f9 to image_cluster1.client.mirror.5-clone34 2024-09-21T15:10:22.704 INFO:teuthology.orchestra.run.smithi161.stdout:5607 punch from 0x683c81 to 0x6856a0, (0x1a1f bytes) 2024-09-21T15:10:22.704 INFO:teuthology.orchestra.run.smithi161.stdout:5608 write 0xa65086f thru 0xa653b2c (0x32be bytes) 2024-09-21T15:10:22.715 INFO:teuthology.orchestra.run.smithi161.stdout:5653 writesame 0x18d9e86 thru 0x18dcf2b data_size 0xd(0x30a6 bytes) 2024-09-21T15:10:22.717 INFO:teuthology.orchestra.run.smithi161.stdout:5101 write 0x2b24e7a thru 0x2b2df53 (0x90da bytes) 2024-09-21T15:10:22.718 INFO:teuthology.orchestra.run.smithi161.stdout:5284 trunc from 0x323b623 to 0x35182ac 2024-09-21T15:10:22.746 INFO:teuthology.orchestra.run.smithi161.stdout:5609 writesame 0xbae9f67 thru 0xbaea038 data_size 0x2(0xd2 bytes) 2024-09-21T15:10:22.750 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:22.746+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc15a9f380 2024-09-21T15:10:22.750 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:22.746+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939ef70 2024-09-21T15:10:22.750 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:22.746+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1940f520 2024-09-21T15:10:22.751 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:22.746+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bcf12b0 2024-09-21T15:10:22.751 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:22.746+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c383e10 2024-09-21T15:10:22.751 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:22.746+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e351930 2024-09-21T15:10:22.763 INFO:teuthology.orchestra.run.smithi161.stdout:5654 punch from 0x421ac06 to 0x42237d7, (0x8bd1 bytes) 2024-09-21T15:10:22.763 INFO:teuthology.orchestra.run.smithi161.stdout:5656 punch from 0xb0c573f to 0xb0cafdb, (0x589c bytes) 2024-09-21T15:10:22.763 INFO:teuthology.orchestra.run.smithi161.stdout:5658 punch from 0x8bb1fb6 to 0x8bb306f, (0x10b9 bytes) 2024-09-21T15:10:22.763 INFO:teuthology.orchestra.run.smithi161.stdout:5659 write 0x61a4ea7 thru 0x61a5c27 (0xd81 bytes) 2024-09-21T15:10:22.763 INFO:teuthology.orchestra.run.smithi161.stdout:5102 write 0x5553478 thru 0x55604e9 (0xd072 bytes) 2024-09-21T15:10:22.770 INFO:teuthology.orchestra.run.smithi161.stdout:5610 punch from 0x31aa160 to 0x31aa816, (0x6b6 bytes) 2024-09-21T15:10:22.784 INFO:teuthology.orchestra.run.smithi161.stdout:5611 trunc from 0xc2e52bc to 0x4c0471c 2024-09-21T15:10:22.802 INFO:teuthology.orchestra.run.smithi161.stdout:5286 read 0x1e436c4 thru 0x1e535cd (0xff0a bytes) 2024-09-21T15:10:22.803 INFO:teuthology.orchestra.run.smithi161.stdout:5660 write 0x1671b5d thru 0x167a17c (0x8620 bytes) 2024-09-21T15:10:22.806 INFO:teuthology.orchestra.run.smithi161.stdout:5288 read 0xafac8 thru 0xb37ab (0x3ce4 bytes) 2024-09-21T15:10:22.838 INFO:teuthology.orchestra.run.smithi161.stdout:5662 read 0x249fa60 thru 0x24a6444 (0x69e5 bytes) 2024-09-21T15:10:22.839 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:22.839 INFO:teuthology.orchestra.run.smithi161.stdout:5664 writesame 0x26e73f5 thru 0x26e9ff7 data_size 0x1(0x2c03 bytes) 2024-09-21T15:10:22.860 INFO:teuthology.orchestra.run.smithi161.stdout:5104 writesame 0x738de38 thru 0x7393ba8 data_size 0x1(0x5d71 bytes) 2024-09-21T15:10:22.869 INFO:teuthology.orchestra.run.smithi161.stdout:5290 write 0x7f0dd0a thru 0x7f16277 (0x856e bytes) 2024-09-21T15:10:22.874 INFO:teuthology.orchestra.run.smithi161.stdout:5108 punch from 0x2bda4a1 to 0x2be9313, (0xee72 bytes) 2024-09-21T15:10:22.874 INFO:teuthology.orchestra.run.smithi161.stdout:5109 punch from 0x170e9c0 to 0x17101fa, (0x183a bytes) 2024-09-21T15:10:22.885 INFO:teuthology.orchestra.run.smithi161.stdout:truncating to largest ever: 0xee542d7 2024-09-21T15:10:22.891 INFO:teuthology.orchestra.run.smithi161.stdout:5665 trunc from 0xba1a487 to 0xee542d7 2024-09-21T15:10:22.908 INFO:teuthology.orchestra.run.smithi161.stdout:5612 read 0x11b4cf4 thru 0x11b5865 (0xb72 bytes) 2024-09-21T15:10:22.915 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:22.911+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3ec83c0 handle_clone_image: failed to clone image mirror/10b66f932aa5 to image_cluster1.client.mirror.4-clone33 2024-09-21T15:10:22.924 INFO:teuthology.orchestra.run.smithi161.stdout:5110 writesame 0x7b73296 thru 0x7b7b829 data_size 0x53(0x8594 bytes) 2024-09-21T15:10:22.933 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:22.933 INFO:teuthology.orchestra.run.smithi161.stdout:5114 write 0xb8c66e thru 0xb94150 (0x7ae3 bytes) 2024-09-21T15:10:22.939 INFO:teuthology.orchestra.run.smithi161.stdout:5666 write 0x995ec86 thru 0x996983b (0xabb6 bytes) 2024-09-21T15:10:22.965 INFO:teuthology.orchestra.run.smithi161.stdout:5291 write 0xa0817a5 thru 0xa08ee85 (0xd6e1 bytes) 2024-09-21T15:10:22.971 INFO:teuthology.orchestra.run.smithi161.stdout:5115 write 0x1109924 thru 0x1110f40 (0x761d bytes) 2024-09-21T15:10:22.973 INFO:teuthology.orchestra.run.smithi161.stdout:5613 write 0x708a203 thru 0x70965ec (0xc3ea bytes) 2024-09-21T15:10:22.983 INFO:teuthology.orchestra.run.smithi161.stdout:5667 punch from 0x50d5778 to 0x50e25c4, (0xce4c bytes) 2024-09-21T15:10:22.999 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:22.999 INFO:teuthology.orchestra.run.smithi161.stdout:5117 read 0x228c48e thru 0x228f227 (0x2d9a bytes) 2024-09-21T15:10:23.000 INFO:teuthology.orchestra.run.smithi161.stdout:5118 read 0x1a28cac thru 0x1a2ec17 (0x5f6c bytes) 2024-09-21T15:10:23.000 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.000 INFO:teuthology.orchestra.run.smithi161.stdout:5120 writesame 0x366d9e thru 0x36e97c data_size 0x1(0x7bdf bytes) 2024-09-21T15:10:23.003 INFO:teuthology.orchestra.run.smithi161.stdout:5614 read 0x1b6b8cb thru 0x1b6e0e4 (0x281a bytes) 2024-09-21T15:10:23.004 INFO:teuthology.orchestra.run.smithi161.stdout:5615 punch from 0xf4358a to 0xf4775c, (0x41d2 bytes) 2024-09-21T15:10:23.004 INFO:teuthology.orchestra.run.smithi161.stdout:5616 punch from 0x26600f3 to 0x266e08d, (0xdf9a bytes) 2024-09-21T15:10:23.004 INFO:teuthology.orchestra.run.smithi161.stdout:5617 write 0x19d13e thru 0x1a78bd (0xa780 bytes) 2024-09-21T15:10:23.007 INFO:teuthology.orchestra.run.smithi161.stdout:5668 trunc from 0xee542d7 to 0x487f534 2024-09-21T15:10:23.049 INFO:teuthology.orchestra.run.smithi161.stdout:5121 trunc from 0x7b7b82a to 0xccfdf2a 2024-09-21T15:10:23.073 INFO:teuthology.orchestra.run.smithi161.stdout:5292 writesame 0xc9590df thru 0xc96097b data_size 0xb(0x789d bytes) 2024-09-21T15:10:23.089 INFO:teuthology.orchestra.run.smithi161.stdout:5293 punch from 0x21bc031 to 0x21cbf4d, (0xff1c bytes) 2024-09-21T15:10:23.090 INFO:teuthology.orchestra.run.smithi161.stdout:5294 writesame 0xbcbde1 thru 0xbd8880 data_size 0x10(0xcaa0 bytes) 2024-09-21T15:10:23.101 INFO:teuthology.orchestra.run.smithi161.stdout:5669 trunc from 0x487f534 to 0x491a981 2024-09-21T15:10:23.102 INFO:teuthology.orchestra.run.smithi161.stdout:5122 read 0x512f552 thru 0x513d8f9 (0xe3a8 bytes) 2024-09-21T15:10:23.103 INFO:teuthology.orchestra.run.smithi161.stdout:5126 write 0xad78dd4 thru 0xad87da9 (0xefd6 bytes) 2024-09-21T15:10:23.103 INFO:teuthology.orchestra.run.smithi161.stdout:5618 write 0xe01a199 thru 0xe020997 (0x67ff bytes) 2024-09-21T15:10:23.109 INFO:teuthology.orchestra.run.smithi161.stdout:5295 trunc from 0xc96097c to 0x66fa751 2024-09-21T15:10:23.134 INFO:teuthology.orchestra.run.smithi161.stdout:5621 read 0x3e7aa01 thru 0x3e88b28 (0xe128 bytes) 2024-09-21T15:10:23.136 INFO:teuthology.orchestra.run.smithi161.stdout:5670 write 0x198076f thru 0x1980ad8 (0x36a bytes) 2024-09-21T15:10:23.148 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.148 INFO:teuthology.orchestra.run.smithi161.stdout:5672 read 0x44011c3 thru 0x4410148 (0xef86 bytes) 2024-09-21T15:10:23.148 INFO:teuthology.orchestra.run.smithi161.stdout:5127 read 0x32cef5 thru 0x33b4e2 (0xe5ee bytes) 2024-09-21T15:10:23.153 INFO:teuthology.orchestra.run.smithi161.stdout:5622 trunc from 0xe020998 to 0x8b19489 2024-09-21T15:10:23.159 INFO:teuthology.orchestra.run.smithi161.stdout:5673 trunc from 0x491a981 to 0x8911140 2024-09-21T15:10:23.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:23.163+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59fbbcd20 handle_clone_image: failed to clone image mirror/10ad4f0e6d81 to image_cluster1.client.mirror.2-clone32 2024-09-21T15:10:23.176 INFO:teuthology.orchestra.run.smithi161.stdout:5129 trunc from 0xccfdf2a to 0x38fb165 2024-09-21T15:10:23.213 INFO:teuthology.orchestra.run.smithi161.stdout:5296 read 0xc94f70 thru 0xc9c15d (0x71ee bytes) 2024-09-21T15:10:23.221 INFO:teuthology.orchestra.run.smithi161.stdout:5297 trunc from 0x66fa751 to 0x2b2c9a8 2024-09-21T15:10:23.240 INFO:teuthology.orchestra.run.smithi161.stdout:5623 read 0xb4f38b thru 0xb59f5a (0xabd0 bytes) 2024-09-21T15:10:23.241 INFO:teuthology.orchestra.run.smithi161.stdout:5624 writesame 0x7abd986 thru 0x7ac039d data_size 0xc(0x2a18 bytes) 2024-09-21T15:10:23.261 INFO:teuthology.orchestra.run.smithi161.stdout:4311 write 0xe8288f9 thru 0xe838529 (0xfc31 bytes) 2024-09-21T15:10:23.272 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:23.267+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3ec74a0 handle_clone_image: failed to clone image mirror/10b45e4f27e2 to image_cluster1.client.mirror.3-clone34 2024-09-21T15:10:23.296 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.296 INFO:teuthology.orchestra.run.smithi161.stdout:5674 write 0xd7792f2 thru 0xd77bb0a (0x2819 bytes) 2024-09-21T15:10:23.302 INFO:teuthology.orchestra.run.smithi161.stdout:4312 writesame 0xe072ca0 thru 0xe07d5cc data_size 0x7(0xa92d bytes) 2024-09-21T15:10:23.312 INFO:teuthology.orchestra.run.smithi161.stdout:5131 trunc from 0x38fb165 to 0x8da45e1 2024-09-21T15:10:23.318 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.318 INFO:teuthology.orchestra.run.smithi161.stdout:4315 read 0x2c50916 thru 0x2c5617e (0x5869 bytes) 2024-09-21T15:10:23.322 INFO:teuthology.orchestra.run.smithi161.stdout:4316 trunc from 0xe83852a to 0xc857a27 2024-09-21T15:10:23.324 INFO:teuthology.orchestra.run.smithi161.stdout:5675 write 0x5af9f94 thru 0x5b011a4 (0x7211 bytes) 2024-09-21T15:10:23.332 INFO:teuthology.orchestra.run.smithi161.stdout:5625 write 0xb7be1dc thru 0xb7c6a8e (0x88b3 bytes) 2024-09-21T15:10:23.361 INFO:teuthology.orchestra.run.smithi161.stdout:5677 write 0x454b3ab thru 0x4552f65 (0x7bbb bytes) 2024-09-21T15:10:23.362 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.362 INFO:teuthology.orchestra.run.smithi161.stdout:5629 writesame 0x70f2099 thru 0x70fe23a data_size 0x5(0xc1a2 bytes) 2024-09-21T15:10:23.365 INFO:teuthology.orchestra.run.smithi161.stdout:5825 writesame 0x378766b thru 0x3791778 data_size 0x13(0xa10e bytes) 2024-09-21T15:10:23.368 INFO:teuthology.orchestra.run.smithi161.stdout:5133 punch from 0x83904f6 to 0x839058f, (0x99 bytes) 2024-09-21T15:10:23.368 INFO:teuthology.orchestra.run.smithi161.stdout:5134 writesame 0x8130556 thru 0x8136772 data_size 0x1(0x621d bytes) 2024-09-21T15:10:23.376 INFO:teuthology.orchestra.run.smithi161.stdout:5298 write 0xa968223 thru 0xa973af1 (0xb8cf bytes) 2024-09-21T15:10:23.397 INFO:teuthology.orchestra.run.smithi161.stdout:5631 writesame 0x7ece3f9 thru 0x7ed817e data_size 0x8d(0x9d86 bytes) 2024-09-21T15:10:23.398 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:23.395+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a37acd20 handle_clone_image: failed to clone image mirror/10b6d956b9b to image_cluster1.client.mirror.4-clone24 2024-09-21T15:10:23.423 INFO:teuthology.orchestra.run.smithi161.stdout:5135 trunc from 0x8da45e1 to 0xa0fbb8f 2024-09-21T15:10:23.440 INFO:teuthology.orchestra.run.smithi161.stdout:5679 read 0x87ff4b1 thru 0x8807d3a (0x888a bytes) 2024-09-21T15:10:23.441 INFO:teuthology.orchestra.run.smithi161.stdout:5300 read 0x9ac76e0 thru 0x9ad0105 (0x8a26 bytes) 2024-09-21T15:10:23.441 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.441 INFO:teuthology.orchestra.run.smithi161.stdout:5302 write 0x43839de thru 0x4388dad (0x53d0 bytes) 2024-09-21T15:10:23.441 INFO:teuthology.orchestra.run.smithi161.stdout:5681 trunc from 0xd77bb0b to 0xe8be63c 2024-09-21T15:10:23.457 INFO:teuthology.orchestra.run.smithi161.stdout:5827 read 0x749aad2 thru 0x74a95b9 (0xeae8 bytes) 2024-09-21T15:10:23.457 INFO:teuthology.orchestra.run.smithi161.stdout:5829 read 0x5545711 thru 0x55489c4 (0x32b4 bytes) 2024-09-21T15:10:23.457 INFO:teuthology.orchestra.run.smithi161.stdout:5830 writesame 0x4c37391 thru 0x4c41497 data_size 0x27(0xa107 bytes) 2024-09-21T15:10:23.458 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.458 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.458 INFO:teuthology.orchestra.run.smithi161.stdout:5633 trunc from 0xb7c6a8f to 0x6a2483d 2024-09-21T15:10:23.465 INFO:teuthology.orchestra.run.smithi161.stdout:5306 trunc from 0xa973af2 to 0x731fe95 2024-09-21T15:10:23.476 INFO:teuthology.orchestra.run.smithi161.stdout:5831 write 0x6a0ebac thru 0x6a18c94 (0xa0e9 bytes) 2024-09-21T15:10:23.486 INFO:teuthology.orchestra.run.smithi161.stdout:4318 read 0x24ae7c1 thru 0x24b430d (0x5b4d bytes) 2024-09-21T15:10:23.486 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.487 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.487 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.487 INFO:teuthology.orchestra.run.smithi161.stdout:4323 write 0x70e40ca thru 0x70e5ed6 (0x1e0d bytes) 2024-09-21T15:10:23.487 INFO:teuthology.orchestra.run.smithi161.stdout:5682 write 0x56ffe2e thru 0x570cf62 (0xd135 bytes) 2024-09-21T15:10:23.515 INFO:teuthology.orchestra.run.smithi161.stdout:4324 write 0x5329043 thru 0x532f6d5 (0x6693 bytes) 2024-09-21T15:10:23.520 INFO:teuthology.orchestra.run.smithi161.stdout:5832 punch from 0x845bf11 to 0x8468737, (0xc826 bytes) 2024-09-21T15:10:23.523 INFO:teuthology.orchestra.run.smithi161.stdout:5835 trunc from 0x9597640 to 0xb367227 2024-09-21T15:10:23.540 INFO:teuthology.orchestra.run.smithi161.stdout:5683 punch from 0xa386dad to 0xa389cfd, (0x2f50 bytes) 2024-09-21T15:10:23.546 INFO:teuthology.orchestra.run.smithi161.stdout:5684 trunc from 0xe8be63c to 0xa3382b8 2024-09-21T15:10:23.552 INFO:teuthology.orchestra.run.smithi161.stdout:5136 write 0xc52fef4 thru 0xc53ca6d (0xcb7a bytes) 2024-09-21T15:10:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:4325 read 0x7ec5b85 thru 0x7ed2ede (0xd35a bytes) 2024-09-21T15:10:23.553 INFO:teuthology.orchestra.run.smithi161.stdout:4326 writesame 0x3c43a4a thru 0x3c4f669 data_size 0xac(0xbc20 bytes) 2024-09-21T15:10:23.587 INFO:teuthology.orchestra.run.smithi161.stdout:5836 write 0x31dd68d thru 0x31e6683 (0x8ff7 bytes) 2024-09-21T15:10:23.603 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.603 INFO:teuthology.orchestra.run.smithi161.stdout:5139 writesame 0x4c8023e thru 0x4c88b01 data_size 0x2(0x88c4 bytes) 2024-09-21T15:10:23.627 INFO:teuthology.orchestra.run.smithi161.stdout:5308 write 0xaf19aec thru 0xaf22f9b (0x94b0 bytes) 2024-09-21T15:10:23.643 INFO:teuthology.orchestra.run.smithi161.stdout:5837 writesame 0x9685a2d thru 0x9686e46 data_size 0x1f(0x141a bytes) 2024-09-21T15:10:23.654 INFO:teuthology.orchestra.run.smithi161.stdout:5140 read 0x7352155 thru 0x7354118 (0x1fc4 bytes) 2024-09-21T15:10:23.654 INFO:teuthology.orchestra.run.smithi161.stdout:5143 write 0xc536c87 thru 0xc537de3 (0x115d bytes) 2024-09-21T15:10:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:4327 write 0xdc14ecc thru 0xdc20d0f (0xbe44 bytes) 2024-09-21T15:10:23.670 INFO:teuthology.orchestra.run.smithi161.stdout:5838 read 0x9b45c39 thru 0x9b4a19e (0x4566 bytes) 2024-09-21T15:10:23.670 INFO:teuthology.orchestra.run.smithi161.stdout:5839 punch from 0x69f6a35 to 0x69f8258, (0x1823 bytes) 2024-09-21T15:10:23.670 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:5841 read 0x8517dec thru 0x8519858 (0x1a6d bytes) 2024-09-21T15:10:23.671 INFO:teuthology.orchestra.run.smithi161.stdout:5842 clone 38 order 23 su 4194304 sc 9 2024-09-21T15:10:23.672 INFO:teuthology.orchestra.run.smithi161.stdout:5309 writesame 0x13254a9 thru 0x1331d7c data_size 0x2(0xc8d4 bytes) 2024-09-21T15:10:23.674 INFO:teuthology.orchestra.run.smithi161.stdout:5144 writesame 0x57db93c thru 0x57e16cf data_size 0x35(0x5d94 bytes) 2024-09-21T15:10:23.678 INFO:teuthology.orchestra.run.smithi161.stdout:5685 writesame 0xa3b3f4 thru 0xa3f8a2 data_size 0x1(0x44af bytes) 2024-09-21T15:10:23.681 INFO:teuthology.orchestra.run.smithi161.stdout:5635 writesame 0x8c77514 thru 0x8c7e378 data_size 0x1(0x6e65 bytes) 2024-09-21T15:10:23.713 INFO:teuthology.orchestra.run.smithi161.stdout:5637 writesame 0x731f026 thru 0x7329afa data_size 0x1(0xaad5 bytes) 2024-09-21T15:10:23.730 INFO:teuthology.orchestra.run.smithi161.stdout:5145 punch from 0x86907d6 to 0x869426c, (0x3a96 bytes) 2024-09-21T15:10:23.741 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:23.735+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc8cb60 2024-09-21T15:10:23.741 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:23.735+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:10:23.742 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:23.735+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:10:23.742 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:23.735+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:10:23.742 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:23.735+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:10:23.742 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:23.735+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:10:23.742 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:23.735+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:10:23.747 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.747 INFO:teuthology.orchestra.run.smithi161.stdout:4329 writesame 0x7a5996 thru 0x7a6e51 data_size 0x2(0x14bc bytes) 2024-09-21T15:10:23.761 INFO:teuthology.orchestra.run.smithi161.stdout:5147 trunc from 0xc53ca6e to 0x134dc47 2024-09-21T15:10:23.781 INFO:teuthology.orchestra.run.smithi161.stdout:5639 read 0x5d8c543 thru 0x5d906ad (0x416b bytes) 2024-09-21T15:10:23.782 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.782 INFO:teuthology.orchestra.run.smithi161.stdout:4334 punch from 0xb18caca to 0xb1999cd, (0xcf03 bytes) 2024-09-21T15:10:23.783 INFO:teuthology.orchestra.run.smithi161.stdout:4336 write 0x29fd652 thru 0x2a0b369 (0xdd18 bytes) 2024-09-21T15:10:23.806 INFO:teuthology.orchestra.run.smithi161.stdout:5312 write 0xddb6ac1 thru 0xddba4af (0x39ef bytes) 2024-09-21T15:10:23.825 INFO:teuthology.orchestra.run.smithi161.stdout:5686 trunc from 0xa3382b8 to 0x2f2269d 2024-09-21T15:10:23.853 INFO:teuthology.orchestra.run.smithi161.stdout:5313 punch from 0x258e5c5 to 0x258eb29, (0x564 bytes) 2024-09-21T15:10:23.871 INFO:teuthology.orchestra.run.smithi161.stdout:5314 trunc from 0xddba4b0 to 0x4d7e9ef 2024-09-21T15:10:23.889 INFO:teuthology.orchestra.run.smithi161.stdout:4337 write 0x94da82e thru 0x94dd438 (0x2c0b bytes) 2024-09-21T15:10:23.895 INFO:teuthology.orchestra.run.smithi161.stdout:5640 write 0x9da920e thru 0x9db7849 (0xe63c bytes) 2024-09-21T15:10:23.915 INFO:teuthology.orchestra.run.smithi161.stdout:5641 read 0x2631ce1 thru 0x2632520 (0x840 bytes) 2024-09-21T15:10:23.916 INFO:teuthology.orchestra.run.smithi161.stdout:5642 write 0x300cee8 thru 0x3014e95 (0x7fae bytes) 2024-09-21T15:10:23.933 INFO:teuthology.orchestra.run.smithi161.stdout:4338 trunc from 0xdc20d10 to 0xbf6e77a 2024-09-21T15:10:23.941 INFO:teuthology.orchestra.run.smithi161.stdout:5643 trunc from 0x9db784a to 0x8b04676 2024-09-21T15:10:23.949 INFO:teuthology.orchestra.run.smithi161.stdout:5687 punch from 0x2ef6610 to 0x2f0304c, (0xca3c bytes) 2024-09-21T15:10:23.949 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:23.949 INFO:teuthology.orchestra.run.smithi161.stdout:5690 read 0x2a084cf thru 0x2a0fdc8 (0x78fa bytes) 2024-09-21T15:10:23.950 INFO:teuthology.orchestra.run.smithi161.stdout:5691 read 0x1d75091 thru 0x1d7752a (0x249a bytes) 2024-09-21T15:10:24.030 INFO:teuthology.orchestra.run.smithi161.stdout:5693 write 0xb80771f thru 0xb8098ab (0x218d bytes) 2024-09-21T15:10:24.030 INFO:teuthology.orchestra.run.smithi161.stdout:5315 punch from 0x96197f to 0x964047, (0x26c8 bytes) 2024-09-21T15:10:24.039 INFO:teuthology.orchestra.run.smithi161.stdout:5148 trunc from 0x134dc47 to 0x26298db 2024-09-21T15:10:24.064 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:24.064 INFO:teuthology.orchestra.run.smithi161.stdout:5695 write 0x2a16baf thru 0x2a1c2c3 (0x5715 bytes) 2024-09-21T15:10:24.094 INFO:teuthology.orchestra.run.smithi161.stdout:5696 write 0x3c494bc thru 0x3c56e38 (0xd97d bytes) 2024-09-21T15:10:24.101 INFO:teuthology.orchestra.run.smithi161.stdout:5644 write 0xb98ca44 thru 0xb9907a3 (0x3d60 bytes) 2024-09-21T15:10:24.102 INFO:teuthology.orchestra.run.smithi161.stdout:5316 write 0xbd27c7d thru 0xbd37486 (0xf80a bytes) 2024-09-21T15:10:24.111 INFO:teuthology.orchestra.run.smithi161.stdout:5149 trunc from 0x26298db to 0xe891c87 2024-09-21T15:10:24.123 INFO:teuthology.orchestra.run.smithi161.stdout:5646 write 0xd4e3e1 thru 0xd56696 (0x82b6 bytes) 2024-09-21T15:10:24.136 INFO:teuthology.orchestra.run.smithi161.stdout:4339 trunc from 0xbf6e77a to 0x147896f 2024-09-21T15:10:24.140 INFO:teuthology.orchestra.run.smithi161.stdout:5317 read 0x4fddeb1 thru 0x4fec1d0 (0xe320 bytes) 2024-09-21T15:10:24.140 INFO:teuthology.orchestra.run.smithi161.stdout:5318 writesame 0x32d1212 thru 0x32ddeb9 data_size 0x4a(0xcca8 bytes) 2024-09-21T15:10:24.155 INFO:teuthology.orchestra.run.smithi161.stdout:5697 trunc from 0xb8098ac to 0x2b6b663 2024-09-21T15:10:24.165 INFO:teuthology.orchestra.run.smithi161.stdout:5647 write 0x6f47160 thru 0x6f52bc3 (0xba64 bytes) 2024-09-21T15:10:24.187 INFO:teuthology.orchestra.run.smithi161.stdout:5648 read 0xa603d3d thru 0xa606d3f (0x3003 bytes) 2024-09-21T15:10:24.187 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:24.187 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:24.187 INFO:teuthology.orchestra.run.smithi161.stdout:5651 write 0xbeab3 thru 0xc445f (0x59ad bytes) 2024-09-21T15:10:24.196 INFO:teuthology.orchestra.run.smithi161.stdout:5150 writesame 0x61a33aa thru 0x61af4f4 data_size 0x1(0xc14b bytes) 2024-09-21T15:10:24.198 INFO:teuthology.orchestra.run.smithi161.stdout:5320 trunc from 0xbd37487 to 0x473b7e3 2024-09-21T15:10:24.211 INFO:teuthology.orchestra.run.smithi161.stdout:5652 write 0x43712a2 thru 0x43737eb (0x254a bytes) 2024-09-21T15:10:24.271 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:24.266+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e0d0 2024-09-21T15:10:24.271 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:24.266+0000 7f7fd044c700 -1 reset not still connected to 0x5636bfcda340 2024-09-21T15:10:24.279 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:24.278+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffba750 2024-09-21T15:10:24.280 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:24.278+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbaea0 2024-09-21T15:10:24.280 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:24.278+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f880d0 2024-09-21T15:10:24.280 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:24.278+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3110 2024-09-21T15:10:24.280 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:24.278+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54410 2024-09-21T15:10:24.295 INFO:teuthology.orchestra.run.smithi161.stdout:5151 punch from 0xb30d7c2 to 0xb317fa5, (0xa7e3 bytes) 2024-09-21T15:10:24.295 INFO:teuthology.orchestra.run.smithi161.stdout:5153 write 0x25a279b thru 0x25a60cb (0x3931 bytes) 2024-09-21T15:10:24.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.454+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59fbda500 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:10:24.677 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.670+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c4000 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:10:24.677 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.670+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c4000 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:10:24.677 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.670+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7ca00 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:10:24.677 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.670+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7ca00 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:10:24.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4ea00 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:10:24.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4ea00 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:10:24.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c5900 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:10:24.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c5900 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c4780 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c4780 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796a00 [3/2936d0d6-bde0-48c6-807a-b5288242b35d] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796a00 [3/2936d0d6-bde0-48c6-807a-b5288242b35d] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796780 [3/2799bff6-159c-4fac-9ff0-10626f02c84d] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796780 [3/2799bff6-159c-4fac-9ff0-10626f02c84d] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796000 [3/2356d978-bbcf-4641-a1a5-fa6a827028ca] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796000 [3/2356d978-bbcf-4641-a1a5-fa6a827028ca] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796280 [3/270edf45-6738-4fd2-95f6-31351dcf77ee] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796280 [3/270edf45-6738-4fd2-95f6-31351dcf77ee] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c4c80 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c4c80 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796c80 [3/2b696388-ccf4-4874-ae7a-646ab0d69446] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796c80 [3/2b696388-ccf4-4874-ae7a-646ab0d69446] start: already running 2024-09-21T15:10:24.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797180 [3/2e0d532d-d0fa-46dd-8ea2-5577312481b6] start: already running 2024-09-21T15:10:24.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797180 [3/2e0d532d-d0fa-46dd-8ea2-5577312481b6] start: already running 2024-09-21T15:10:24.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c500 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:10:24.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c500 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:10:24.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a258cc80 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:10:24.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a258cc80 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:10:24.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4ec80 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:10:24.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4ec80 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:10:24.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c000 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:10:24.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c000 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:10:24.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4ef00 [3/24b4fbb0-7c7f-43b3-8add-fc2245c3b143] start: already running 2024-09-21T15:10:24.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.674+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4ef00 [3/24b4fbb0-7c7f-43b3-8add-fc2245c3b143] start: already running 2024-09-21T15:10:24.712 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.706+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258ca00 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:10:24.712 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.706+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258ca00 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:10:24.761 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.754+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f900 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] start: already running 2024-09-21T15:10:24.761 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.754+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f900 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] start: already running 2024-09-21T15:10:24.761 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.754+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f900 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] start: already running 2024-09-21T15:10:24.761 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.754+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f900 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] start: already running 2024-09-21T15:10:24.761 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.754+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f900 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] start: already running 2024-09-21T15:10:24.761 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.754+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59c9e6f00 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:10:24.761 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.754+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59c9e6f00 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:10:24.761 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.754+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59c9e6f00 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:10:24.761 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.754+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59c9e6f00 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:10:24.761 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.754+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59c9e6f00 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:10:24.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.766+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796f00 [3/2c920b45-e415-4127-8e5e-84e50ed4265e] start: already running 2024-09-21T15:10:24.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.766+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796f00 [3/2c920b45-e415-4127-8e5e-84e50ed4265e] start: already running 2024-09-21T15:10:24.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.766+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796f00 [3/2c920b45-e415-4127-8e5e-84e50ed4265e] start: already running 2024-09-21T15:10:24.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.766+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796f00 [3/2c920b45-e415-4127-8e5e-84e50ed4265e] start: already running 2024-09-21T15:10:24.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.766+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796f00 [3/2c920b45-e415-4127-8e5e-84e50ed4265e] start: already running 2024-09-21T15:10:24.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.766+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7b80 [3/5372d49a-7f62-4cee-a4e4-61183f5854a0] start: already running 2024-09-21T15:10:24.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.766+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7b80 [3/5372d49a-7f62-4cee-a4e4-61183f5854a0] start: already running 2024-09-21T15:10:24.774 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.766+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7b80 [3/5372d49a-7f62-4cee-a4e4-61183f5854a0] start: already running 2024-09-21T15:10:24.792 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797900 [3/31e98e64-d9b2-447d-bce9-435d3d7cef3a] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797900 [3/31e98e64-d9b2-447d-bce9-435d3d7cef3a] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797900 [3/31e98e64-d9b2-447d-bce9-435d3d7cef3a] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797900 [3/31e98e64-d9b2-447d-bce9-435d3d7cef3a] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797900 [3/31e98e64-d9b2-447d-bce9-435d3d7cef3a] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f400 [3/2b6dc334-3fe0-49f9-81e0-cb6bcee84c98] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f400 [3/2b6dc334-3fe0-49f9-81e0-cb6bcee84c98] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f400 [3/2b6dc334-3fe0-49f9-81e0-cb6bcee84c98] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f400 [3/2b6dc334-3fe0-49f9-81e0-cb6bcee84c98] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f400 [3/2b6dc334-3fe0-49f9-81e0-cb6bcee84c98] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d400 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d400 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d400 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d400 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:10:24.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d400 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:10:24.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4fb80 [3/3d2cada1-cdba-4793-9a15-f743b41bee74] start: already running 2024-09-21T15:10:24.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4fb80 [3/3d2cada1-cdba-4793-9a15-f743b41bee74] start: already running 2024-09-21T15:10:24.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4fb80 [3/3d2cada1-cdba-4793-9a15-f743b41bee74] start: already running 2024-09-21T15:10:24.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4fb80 [3/3d2cada1-cdba-4793-9a15-f743b41bee74] start: already running 2024-09-21T15:10:24.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4fb80 [3/3d2cada1-cdba-4793-9a15-f743b41bee74] start: already running 2024-09-21T15:10:24.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7900 [3/536a1fc6-237a-4cc9-9799-f875bd685121] start: already running 2024-09-21T15:10:24.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7900 [3/536a1fc6-237a-4cc9-9799-f875bd685121] start: already running 2024-09-21T15:10:24.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7900 [3/536a1fc6-237a-4cc9-9799-f875bd685121] start: already running 2024-09-21T15:10:24.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6780 [3/43a73e62-4bcf-4dbf-97f4-0fa9db2adcba] start: already running 2024-09-21T15:10:24.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6780 [3/43a73e62-4bcf-4dbf-97f4-0fa9db2adcba] start: already running 2024-09-21T15:10:24.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6780 [3/43a73e62-4bcf-4dbf-97f4-0fa9db2adcba] start: already running 2024-09-21T15:10:24.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.786+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6780 [3/43a73e62-4bcf-4dbf-97f4-0fa9db2adcba] start: already running 2024-09-21T15:10:24.808 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.802+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7400 [3/4f24f6f0-5be2-4ea3-af4f-83dbaa368544] start: already running 2024-09-21T15:10:24.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.802+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7400 [3/4f24f6f0-5be2-4ea3-af4f-83dbaa368544] start: already running 2024-09-21T15:10:24.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.802+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7400 [3/4f24f6f0-5be2-4ea3-af4f-83dbaa368544] start: already running 2024-09-21T15:10:24.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.802+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6280 [3/3fdcc685-72aa-4afe-9cdb-1ad60b962a91] start: already running 2024-09-21T15:10:24.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.802+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6280 [3/3fdcc685-72aa-4afe-9cdb-1ad60b962a91] start: already running 2024-09-21T15:10:24.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.802+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6280 [3/3fdcc685-72aa-4afe-9cdb-1ad60b962a91] start: already running 2024-09-21T15:10:24.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.802+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6280 [3/3fdcc685-72aa-4afe-9cdb-1ad60b962a91] start: already running 2024-09-21T15:10:24.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6f00 [3/4d33624c-dcd8-4157-891c-5b117dfa1f81] start: already running 2024-09-21T15:10:24.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6f00 [3/4d33624c-dcd8-4157-891c-5b117dfa1f81] start: already running 2024-09-21T15:10:24.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6f00 [3/4d33624c-dcd8-4157-891c-5b117dfa1f81] start: already running 2024-09-21T15:10:24.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6f00 [3/4d33624c-dcd8-4157-891c-5b117dfa1f81] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f008000 [3/363b13b9-82c8-4420-bc7f-68b6bbdb20b8] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f008000 [3/363b13b9-82c8-4420-bc7f-68b6bbdb20b8] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f008000 [3/363b13b9-82c8-4420-bc7f-68b6bbdb20b8] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f008000 [3/363b13b9-82c8-4420-bc7f-68b6bbdb20b8] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f008000 [3/363b13b9-82c8-4420-bc7f-68b6bbdb20b8] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59c9e6780 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59c9e6780 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59c9e6780 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59c9e6780 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59c9e6780 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f680 [3/32979c40-b09e-47fb-96bc-99dc3f3188ed] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f680 [3/32979c40-b09e-47fb-96bc-99dc3f3188ed] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f680 [3/32979c40-b09e-47fb-96bc-99dc3f3188ed] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f680 [3/32979c40-b09e-47fb-96bc-99dc3f3188ed] start: already running 2024-09-21T15:10:24.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.806+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f680 [3/32979c40-b09e-47fb-96bc-99dc3f3188ed] start: already running 2024-09-21T15:10:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c280 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:10:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c280 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:10:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c280 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:10:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c280 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:10:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c280 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:10:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7c500 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:10:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7c500 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:10:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7c500 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:10:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7c500 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:10:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7c500 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:10:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d900 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:10:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d900 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:10:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d900 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:10:24.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d900 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:10:24.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d900 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:10:24.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7c780 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:10:24.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7c780 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:10:24.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7c780 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:10:24.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7c780 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:10:24.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7c780 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:10:24.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796500 [3/27657923-4991-47a3-8bed-28264b9e04a1] start: already running 2024-09-21T15:10:24.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796500 [3/27657923-4991-47a3-8bed-28264b9e04a1] start: already running 2024-09-21T15:10:24.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796500 [3/27657923-4991-47a3-8bed-28264b9e04a1] start: already running 2024-09-21T15:10:24.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796500 [3/27657923-4991-47a3-8bed-28264b9e04a1] start: already running 2024-09-21T15:10:24.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.834+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796500 [3/27657923-4991-47a3-8bed-28264b9e04a1] start: already running 2024-09-21T15:10:24.921 INFO:teuthology.orchestra.run.smithi161.stdout:5154 writesame 0x5d34d61 thru 0x5d3c367 data_size 0x1(0x7607 bytes) 2024-09-21T15:10:24.943 INFO:teuthology.orchestra.run.smithi161.stdout:5698 trunc from 0x2b6b663 to 0x37a9adf 2024-09-21T15:10:24.954 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.950+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f180 [3/293432f7-5a81-4489-9831-906269d79354] start: already running 2024-09-21T15:10:24.954 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.950+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f180 [3/293432f7-5a81-4489-9831-906269d79354] start: already running 2024-09-21T15:10:24.954 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.950+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f180 [3/293432f7-5a81-4489-9831-906269d79354] start: already running 2024-09-21T15:10:24.954 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.950+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f180 [3/293432f7-5a81-4489-9831-906269d79354] start: already running 2024-09-21T15:10:24.954 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:24.950+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4f180 [3/293432f7-5a81-4489-9831-906269d79354] start: already running 2024-09-21T15:10:24.963 INFO:teuthology.orchestra.run.smithi161.stdout:5322 trunc from 0x473b7e3 to 0xa0560a8 2024-09-21T15:10:24.970 INFO:teuthology.orchestra.run.smithi161.stdout:5156 read 0xcce5ce4 thru 0xccf34a1 (0xd7be bytes) 2024-09-21T15:10:24.971 INFO:teuthology.orchestra.run.smithi161.stdout:5158 punch from 0x695e3b7 to 0x6960ecb, (0x2b14 bytes) 2024-09-21T15:10:24.971 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:24.971 INFO:teuthology.orchestra.run.smithi161.stdout:5160 write 0x9d98eee thru 0x9d9dba3 (0x4cb6 bytes) 2024-09-21T15:10:24.978 INFO:teuthology.orchestra.run.smithi161.stdout:5653 write 0xdafbe0e thru 0xdafec5d (0x2e50 bytes) 2024-09-21T15:10:24.985 INFO:teuthology.orchestra.run.smithi161.stdout:5699 punch from 0x2494451 to 0x249b9b0, (0x755f bytes) 2024-09-21T15:10:24.986 INFO:teuthology.orchestra.run.smithi161.stdout:5700 write 0x1a776cc thru 0x1a8147d (0x9db2 bytes) 2024-09-21T15:10:24.986 INFO:teuthology.orchestra.run.smithi161.stdout:4340 punch from 0xaa8732 to 0xaa97ad, (0x107b bytes) 2024-09-21T15:10:24.986 INFO:teuthology.orchestra.run.smithi161.stdout:4341 punch from 0x5956fd to 0x5a0ca1, (0xb5a4 bytes) 2024-09-21T15:10:25.003 INFO:teuthology.orchestra.run.smithi161.stdout:5654 writesame 0x9284c76 thru 0x9290097 data_size 0x1(0xb422 bytes) 2024-09-21T15:10:25.011 INFO:teuthology.orchestra.run.smithi161.stdout:5323 read 0x5c487ef thru 0x5c5185e (0x9070 bytes) 2024-09-21T15:10:25.013 INFO:teuthology.orchestra.run.smithi161.stdout:5324 punch from 0x67d299e to 0x67d4341, (0x19a3 bytes) 2024-09-21T15:10:25.017 INFO:teuthology.orchestra.run.smithi161.stdout:5702 write 0x2461bbd thru 0x246d88f (0xbcd3 bytes) 2024-09-21T15:10:25.055 INFO:teuthology.orchestra.run.smithi161.stdout:5656 punch from 0xc1c213d to 0xc1ca69f, (0x8562 bytes) 2024-09-21T15:10:25.055 INFO:teuthology.orchestra.run.smithi161.stdout:5657 read 0xa6a551e thru 0xa6ad035 (0x7b18 bytes) 2024-09-21T15:10:25.055 INFO:teuthology.orchestra.run.smithi161.stdout:5658 punch from 0x72467d6 to 0x724f1dc, (0x8a06 bytes) 2024-09-21T15:10:25.056 INFO:teuthology.orchestra.run.smithi161.stdout:5659 writesame 0x1583194 thru 0x158e115 data_size 0x5(0xaf82 bytes) 2024-09-21T15:10:25.056 INFO:teuthology.orchestra.run.smithi161.stdout:5161 writesame 0xe8f3d61 thru 0xe8fce3a data_size 0x1(0x90da bytes) 2024-09-21T15:10:25.062 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4280 [3/637122ca-60c4-4992-9f94-ae01ebaccd0e] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4280 [3/637122ca-60c4-4992-9f94-ae01ebaccd0e] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4280 [3/637122ca-60c4-4992-9f94-ae01ebaccd0e] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4280 [3/637122ca-60c4-4992-9f94-ae01ebaccd0e] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7180 [3/4db41bcc-01af-44fc-9cb1-aedfd7a02660] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7180 [3/4db41bcc-01af-44fc-9cb1-aedfd7a02660] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7180 [3/4db41bcc-01af-44fc-9cb1-aedfd7a02660] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7180 [3/4db41bcc-01af-44fc-9cb1-aedfd7a02660] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f008c80 [3/5d512263-1e55-4555-80ca-62bb3f5592fb] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f008c80 [3/5d512263-1e55-4555-80ca-62bb3f5592fb] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f008c80 [3/5d512263-1e55-4555-80ca-62bb3f5592fb] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f008c80 [3/5d512263-1e55-4555-80ca-62bb3f5592fb] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5180 [3/6db0eab9-313d-45bf-828c-bf42d15aefce] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5180 [3/6db0eab9-313d-45bf-828c-bf42d15aefce] start: already running 2024-09-21T15:10:25.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5180 [3/6db0eab9-313d-45bf-828c-bf42d15aefce] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5180 [3/6db0eab9-313d-45bf-828c-bf42d15aefce] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e000 [3/791a4288-2321-4776-a51f-ba5428b8b556] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e000 [3/791a4288-2321-4776-a51f-ba5428b8b556] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e000 [3/791a4288-2321-4776-a51f-ba5428b8b556] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e000 [3/791a4288-2321-4776-a51f-ba5428b8b556] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6000 [3/3e87a2ed-dc29-47ec-976a-1a33bfabf914] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6000 [3/3e87a2ed-dc29-47ec-976a-1a33bfabf914] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6000 [3/3e87a2ed-dc29-47ec-976a-1a33bfabf914] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6000 [3/3e87a2ed-dc29-47ec-976a-1a33bfabf914] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd4a00 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd4a00 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd4a00 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd4a00 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd4a00 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f009400 [3/616a1e50-ff37-4e76-b4b1-0f051d7e5ca3] start: already running 2024-09-21T15:10:25.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f009400 [3/616a1e50-ff37-4e76-b4b1-0f051d7e5ca3] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f009400 [3/616a1e50-ff37-4e76-b4b1-0f051d7e5ca3] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f009400 [3/616a1e50-ff37-4e76-b4b1-0f051d7e5ca3] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2567400 [3/a886c6ec-95d5-4bec-95d6-90b535ab9694] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2567400 [3/a886c6ec-95d5-4bec-95d6-90b535ab9694] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2567400 [3/a886c6ec-95d5-4bec-95d6-90b535ab9694] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f008f00 [3/5e8b4579-81b1-4cbb-a0ef-7f96494cfc61] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f008f00 [3/5e8b4579-81b1-4cbb-a0ef-7f96494cfc61] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f008f00 [3/5e8b4579-81b1-4cbb-a0ef-7f96494cfc61] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f008f00 [3/5e8b4579-81b1-4cbb-a0ef-7f96494cfc61] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2567180 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2567180 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2567180 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f009680 [3/61e40bd2-a6f8-4810-904b-d9763ddf6fd0] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f009680 [3/61e40bd2-a6f8-4810-904b-d9763ddf6fd0] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f009680 [3/61e40bd2-a6f8-4810-904b-d9763ddf6fd0] start: already running 2024-09-21T15:10:25.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f009680 [3/61e40bd2-a6f8-4810-904b-d9763ddf6fd0] start: already running 2024-09-21T15:10:25.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4780 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:10:25.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.054+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4780 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:10:25.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.058+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4780 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:10:25.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.058+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4780 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:10:25.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.058+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f009b80 [3/3e3bdb4c-3bdb-49bc-8680-3d524894c052] start: already running 2024-09-21T15:10:25.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.058+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f009b80 [3/3e3bdb4c-3bdb-49bc-8680-3d524894c052] start: already running 2024-09-21T15:10:25.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.058+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f009b80 [3/3e3bdb4c-3bdb-49bc-8680-3d524894c052] start: already running 2024-09-21T15:10:25.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.058+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f009b80 [3/3e3bdb4c-3bdb-49bc-8680-3d524894c052] start: already running 2024-09-21T15:10:25.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.058+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f59f009b80 [3/3e3bdb4c-3bdb-49bc-8680-3d524894c052] start: already running 2024-09-21T15:10:25.067 INFO:teuthology.orchestra.run.smithi161.stdout:5163 write 0x353df93 thru 0x3545068 (0x70d6 bytes) 2024-09-21T15:10:25.069 INFO:teuthology.orchestra.run.smithi161.stdout:5703 trunc from 0x37a9adf to 0x8867ce6 2024-09-21T15:10:25.069 INFO:teuthology.orchestra.run.smithi161.stdout:5661 write 0x821ab64 thru 0x8222e71 (0x830e bytes) 2024-09-21T15:10:25.077 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.070+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:10:25.077 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.070+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b861520 2024-09-21T15:10:25.077 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.070+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:10:25.077 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.070+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:10:25.077 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.070+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:10:25.077 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.070+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e2f71e0 2024-09-21T15:10:25.077 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.070+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:10:25.079 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.074+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:10:25.079 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.074+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16c30 2024-09-21T15:10:25.079 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.074+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17ee0 2024-09-21T15:10:25.079 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.074+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:10:25.081 INFO:teuthology.orchestra.run.smithi161.stdout:5663 writesame 0x68d2455 thru 0x68dc269 data_size 0xd(0x9e15 bytes) 2024-09-21T15:10:25.081 INFO:teuthology.orchestra.run.smithi161.stdout:5325 write 0xa8eb4a1 thru 0xa8f0d3d (0x589d bytes) 2024-09-21T15:10:25.081 INFO:teuthology.orchestra.run.smithi161.stdout:4342 writesame 0xec9e0e5 thru 0xeca3adc data_size 0x4(0x59f8 bytes) 2024-09-21T15:10:25.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.086+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f008500 [3/58968828-f010-4fe8-9cec-0eac08331be4] start: already running 2024-09-21T15:10:25.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.086+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f008500 [3/58968828-f010-4fe8-9cec-0eac08331be4] start: already running 2024-09-21T15:10:25.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.086+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f008500 [3/58968828-f010-4fe8-9cec-0eac08331be4] start: already running 2024-09-21T15:10:25.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.086+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f008500 [3/58968828-f010-4fe8-9cec-0eac08331be4] start: already running 2024-09-21T15:10:25.096 INFO:teuthology.orchestra.run.smithi161.stdout:4343 read 0x4fb14c4 thru 0x4fc01e0 (0xed1d bytes) 2024-09-21T15:10:25.096 INFO:teuthology.orchestra.run.smithi161.stdout:4344 write 0x4c87a3d thru 0x4c88971 (0xf35 bytes) 2024-09-21T15:10:25.110 INFO:teuthology.orchestra.run.smithi161.stdout:5165 read 0x52ec3aa thru 0x52f6d96 (0xa9ed bytes) 2024-09-21T15:10:25.110 INFO:teuthology.orchestra.run.smithi161.stdout:5167 write 0xc27af80 thru 0xc283cbb (0x8d3c bytes) 2024-09-21T15:10:25.121 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f008780 [3/59c93a57-c7d1-4245-95e1-c3b4a05e2c1a] start: already running 2024-09-21T15:10:25.121 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f008780 [3/59c93a57-c7d1-4245-95e1-c3b4a05e2c1a] start: already running 2024-09-21T15:10:25.121 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f008780 [3/59c93a57-c7d1-4245-95e1-c3b4a05e2c1a] start: already running 2024-09-21T15:10:25.121 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f008780 [3/59c93a57-c7d1-4245-95e1-c3b4a05e2c1a] start: already running 2024-09-21T15:10:25.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797400 [3/2ecbd40e-3deb-400c-92b4-6c441ce7dbae] start: already running 2024-09-21T15:10:25.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797400 [3/2ecbd40e-3deb-400c-92b4-6c441ce7dbae] start: already running 2024-09-21T15:10:25.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797400 [3/2ecbd40e-3deb-400c-92b4-6c441ce7dbae] start: already running 2024-09-21T15:10:25.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797400 [3/2ecbd40e-3deb-400c-92b4-6c441ce7dbae] start: already running 2024-09-21T15:10:25.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797400 [3/2ecbd40e-3deb-400c-92b4-6c441ce7dbae] start: already running 2024-09-21T15:10:25.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566500 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:10:25.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566500 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:10:25.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566500 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:10:25.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566500 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:10:25.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.114+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566500 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:10:25.130 INFO:teuthology.orchestra.run.smithi161.stdout:4345 read 0xccc7071 thru 0xccd3208 (0xc198 bytes) 2024-09-21T15:10:25.130 INFO:teuthology.orchestra.run.smithi161.stdout:4346 write 0x8781ed4 thru 0x87874a4 (0x55d1 bytes) 2024-09-21T15:10:25.131 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.126+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a498ac80 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:10:25.133 INFO:teuthology.orchestra.run.smithi161.stdout:5326 trunc from 0xa8f0d3e to 0x3cc07a4 2024-09-21T15:10:25.134 INFO:teuthology.orchestra.run.smithi161.stdout:5704 writesame 0x3578aa9 thru 0x358443b data_size 0x1(0xb993 bytes) 2024-09-21T15:10:25.144 INFO:teuthology.orchestra.run.smithi161.stdout:5664 trunc from 0xdafec5e to 0x49e8797 2024-09-21T15:10:25.148 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:25.148 INFO:teuthology.orchestra.run.smithi161.stdout:5170 writesame 0x285262f thru 0x285d027 data_size 0x1(0xa9f9 bytes) 2024-09-21T15:10:25.164 INFO:teuthology.orchestra.run.smithi161.stdout:4347 read 0xd87f084 thru 0xd881112 (0x208f bytes) 2024-09-21T15:10:25.164 INFO:teuthology.orchestra.run.smithi161.stdout:4348 read 0xd9bf843 thru 0xd9c756b (0x7d29 bytes) 2024-09-21T15:10:25.164 INFO:teuthology.orchestra.run.smithi161.stdout:4349 read 0xd835c89 thru 0xd83f88a (0x9c02 bytes) 2024-09-21T15:10:25.176 INFO:teuthology.orchestra.run.smithi161.stdout:4353 flatten 2024-09-21T15:10:25.185 INFO:teuthology.orchestra.run.smithi161.stdout:5706 write 0x6e669a3 thru 0x6e67648 (0xca6 bytes) 2024-09-21T15:10:25.218 INFO:teuthology.orchestra.run.smithi161.stdout:5171 writesame 0xa4fc394 thru 0xa5075ac data_size 0x1(0xb219 bytes) 2024-09-21T15:10:25.218 INFO:teuthology.orchestra.run.smithi161.stdout:5707 read 0x5fc90e8 thru 0x5fd4344 (0xb25d bytes) 2024-09-21T15:10:25.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7cc80 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:10:25.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7cc80 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:10:25.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7cc80 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:10:25.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7cc80 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:10:25.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7cc80 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:10:25.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258db80 [3/2037df74-ba68-4814-bebc-291884a396bb] start: already running 2024-09-21T15:10:25.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258db80 [3/2037df74-ba68-4814-bebc-291884a396bb] start: already running 2024-09-21T15:10:25.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258db80 [3/2037df74-ba68-4814-bebc-291884a396bb] start: already running 2024-09-21T15:10:25.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258db80 [3/2037df74-ba68-4814-bebc-291884a396bb] start: already running 2024-09-21T15:10:25.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258db80 [3/2037df74-ba68-4814-bebc-291884a396bb] start: already running 2024-09-21T15:10:25.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c780 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:10:25.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c780 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:10:25.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c780 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:10:25.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c780 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:10:25.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c780 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:10:25.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7d680 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:10:25.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7d680 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:10:25.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7d680 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:10:25.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7d680 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:10:25.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7d680 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:10:25.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6500 [3/43028d32-4202-4ac6-b083-241946f596da] start: already running 2024-09-21T15:10:25.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6500 [3/43028d32-4202-4ac6-b083-241946f596da] start: already running 2024-09-21T15:10:25.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6500 [3/43028d32-4202-4ac6-b083-241946f596da] start: already running 2024-09-21T15:10:25.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.250+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6500 [3/43028d32-4202-4ac6-b083-241946f596da] start: already running 2024-09-21T15:10:25.285 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.278+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258cf00 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:10:25.285 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.278+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258cf00 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:10:25.285 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.278+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258cf00 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:10:25.285 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.278+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258cf00 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:10:25.285 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.278+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258cf00 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:10:25.312 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.302+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:10:25.312 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:10:25.312 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:10:25.312 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:10:25.312 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x560169dbca90 2024-09-21T15:10:25.312 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016a9c8dd0 2024-09-21T15:10:25.312 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:10:25.313 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:10:25.313 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:10:25.313 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbba00 2024-09-21T15:10:25.313 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbbc70 2024-09-21T15:10:25.313 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:10:25.313 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:10:25.313 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6d5f0 2024-09-21T15:10:25.313 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016ebec680 2024-09-21T15:10:25.313 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:10:25.313 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:10:25.313 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:10:25.313 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56016fefea90 2024-09-21T15:10:25.313 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.306+0000 7ff753f07700 -1 reset not still connected to 0x56017063e1a0 2024-09-21T15:10:25.314 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.0-clone37 2024-09-21T15:10:25.314 INFO:teuthology.orchestra.run.smithi161.stdout:5173 write 0xe14e184 thru 0xe151c2d (0x3aaa bytes) 2024-09-21T15:10:25.328 INFO:teuthology.orchestra.run.smithi161.stdout:5709 writesame 0xbf53ebb thru 0xbf633b4 data_size 0x1(0xf4fa bytes) 2024-09-21T15:10:25.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f008280 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] start: already running 2024-09-21T15:10:25.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f008280 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] start: already running 2024-09-21T15:10:25.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f008280 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] start: already running 2024-09-21T15:10:25.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f008280 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] start: already running 2024-09-21T15:10:25.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f008280 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] start: already running 2024-09-21T15:10:25.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6a00 [3/4a9de63d-2d57-4edb-9b9f-67ede03fdec6] start: already running 2024-09-21T15:10:25.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6a00 [3/4a9de63d-2d57-4edb-9b9f-67ede03fdec6] start: already running 2024-09-21T15:10:25.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6a00 [3/4a9de63d-2d57-4edb-9b9f-67ede03fdec6] start: already running 2024-09-21T15:10:25.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6a00 [3/4a9de63d-2d57-4edb-9b9f-67ede03fdec6] start: already running 2024-09-21T15:10:25.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d180 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:10:25.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d180 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:10:25.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d180 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:10:25.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d180 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:10:25.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.326+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d180 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:10:25.335 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.310+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:10:25.335 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.310+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:10:25.335 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.314+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:10:25.336 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.314+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:10:25.336 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.314+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8d00 2024-09-21T15:10:25.336 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.314+0000 7ff753f07700 -1 reset not still connected to 0x560170f64750 2024-09-21T15:10:25.336 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.314+0000 7ff753f07700 -1 reset not still connected to 0x560170f65790 2024-09-21T15:10:25.336 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:25.314+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:10:25.342 INFO:teuthology.orchestra.run.smithi161.stdout:5711 write 0x60bbcdf thru 0x60c662f (0xa951 bytes) 2024-09-21T15:10:25.356 INFO:teuthology.orchestra.run.smithi161.stdout:5174 read 0x11361cd thru 0x113ca66 (0x689a bytes) 2024-09-21T15:10:25.356 INFO:teuthology.orchestra.run.smithi161.stdout:5181 write 0x18e4d89 thru 0x18f386b (0xeae3 bytes) 2024-09-21T15:10:25.412 INFO:teuthology.orchestra.run.smithi161.stdout:5182 write 0xd7fcd78 thru 0xd805279 (0x8502 bytes) 2024-09-21T15:10:25.422 INFO:teuthology.orchestra.run.smithi161.stdout:5713 writesame 0x592fbfe thru 0x593acdb data_size 0x1(0xb0de bytes) 2024-09-21T15:10:25.442 INFO:teuthology.orchestra.run.smithi161.stdout:5666 writesame 0x817033f thru 0x8173213 data_size 0x1(0x2ed5 bytes) 2024-09-21T15:10:25.445 INFO:teuthology.orchestra.run.smithi161.stdout:5183 read 0xd12aea thru 0xd172db (0x47f2 bytes) 2024-09-21T15:10:25.447 INFO:teuthology.orchestra.run.smithi161.stdout:5184 read 0x3ac4c2a thru 0x3ac7285 (0x265c bytes) 2024-09-21T15:10:25.447 INFO:teuthology.orchestra.run.smithi161.stdout:5185 read 0x2b2c557 thru 0x2b2e6b5 (0x215f bytes) 2024-09-21T15:10:25.447 INFO:teuthology.orchestra.run.smithi161.stdout:5188 writesame 0x8068a92 thru 0x8069dfb data_size 0xe(0x136a bytes) 2024-09-21T15:10:25.466 INFO:teuthology.orchestra.run.smithi161.stdout:5715 clone 38 order 21 su 1048576 sc 13 2024-09-21T15:10:25.468 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:25.468 INFO:teuthology.orchestra.run.smithi161.stdout:4356 read 0xc42acc4 thru 0xc4359a3 (0xace0 bytes) 2024-09-21T15:10:25.471 INFO:teuthology.orchestra.run.smithi161.stdout:5327 write 0x6153ded thru 0x615d018 (0x922c bytes) 2024-09-21T15:10:25.471 INFO:teuthology.orchestra.run.smithi161.stdout:4359 trunc from 0xeca3add to 0xd1ab3c9 2024-09-21T15:10:25.472 INFO:teuthology.orchestra.run.smithi161.stdout:5189 read 0x403bb67 thru 0x40474f3 (0xb98d bytes) 2024-09-21T15:10:25.472 INFO:teuthology.orchestra.run.smithi161.stdout:5190 write 0xdc02400 thru 0xdc0e42e (0xc02f bytes) 2024-09-21T15:10:25.486 INFO:teuthology.orchestra.run.smithi161.stdout:5328 read 0x55add5b thru 0x55b66bc (0x8962 bytes) 2024-09-21T15:10:25.487 INFO:teuthology.orchestra.run.smithi161.stdout:5329 read 0x202fa26 thru 0x2034132 (0x470d bytes) 2024-09-21T15:10:25.507 INFO:teuthology.orchestra.run.smithi161.stdout:5192 trunc from 0xe8fce3b to 0xabeb129 2024-09-21T15:10:25.507 INFO:teuthology.orchestra.run.smithi161.stdout:5669 write 0xe4b3143 thru 0xe4c20bf (0xef7d bytes) 2024-09-21T15:10:25.526 INFO:teuthology.orchestra.run.smithi161.stdout:4360 trunc from 0xd1ab3c9 to 0x164bb7c 2024-09-21T15:10:25.529 INFO:teuthology.orchestra.run.smithi161.stdout:5670 read 0xa86bf3f thru 0xa86dcd9 (0x1d9b bytes) 2024-09-21T15:10:25.529 INFO:teuthology.orchestra.run.smithi161.stdout:5671 read 0xe099ca5 thru 0xe0a8b32 (0xee8e bytes) 2024-09-21T15:10:25.530 INFO:teuthology.orchestra.run.smithi161.stdout:5672 read 0x4db488b thru 0x4db81c5 (0x393b bytes) 2024-09-21T15:10:25.535 INFO:teuthology.orchestra.run.smithi161.stdout:5673 read 0xd1c73de thru 0xd1d5c1e (0xe841 bytes) 2024-09-21T15:10:25.536 INFO:teuthology.orchestra.run.smithi161.stdout:5674 write 0x53b22ec thru 0x53b6e0a (0x4b1f bytes) 2024-09-21T15:10:25.551 INFO:teuthology.orchestra.run.smithi161.stdout:5330 write 0xaddec7d thru 0xade2863 (0x3be7 bytes) 2024-09-21T15:10:25.559 INFO:teuthology.orchestra.run.smithi161.stdout:5675 write 0x2bc48b7 thru 0x2bc7ef8 (0x3642 bytes) 2024-09-21T15:10:25.568 INFO:teuthology.orchestra.run.smithi161.stdout:5331 read 0xf1f79f thru 0xf28706 (0x8f68 bytes) 2024-09-21T15:10:25.569 INFO:teuthology.orchestra.run.smithi161.stdout:5332 read 0x2cd420a thru 0x2ce2a1a (0xe811 bytes) 2024-09-21T15:10:25.570 INFO:teuthology.orchestra.run.smithi161.stdout:5676 write 0xc68959e thru 0xc696329 (0xcd8c bytes) 2024-09-21T15:10:25.570 INFO:teuthology.orchestra.run.smithi161.stdout:5333 punch from 0x715854b to 0x7160d9b, (0x8850 bytes) 2024-09-21T15:10:25.572 INFO:teuthology.orchestra.run.smithi161.stdout:5334 flatten 2024-09-21T15:10:25.582 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.578+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a498b400 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:10:25.582 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.578+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9ea00 [3/8319ade8-0cb1-4b7e-98ca-ced578aceb3e] start: already running 2024-09-21T15:10:25.582 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.578+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9ea00 [3/8319ade8-0cb1-4b7e-98ca-ced578aceb3e] start: already running 2024-09-21T15:10:25.582 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.578+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9ea00 [3/8319ade8-0cb1-4b7e-98ca-ced578aceb3e] start: already running 2024-09-21T15:10:25.582 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.578+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9ea00 [3/8319ade8-0cb1-4b7e-98ca-ced578aceb3e] start: already running 2024-09-21T15:10:25.582 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.578+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a498a500 [3/afce2605-a8db-416c-a324-7471613e476c] start: already running 2024-09-21T15:10:25.582 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.578+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a49b6500 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:10:25.582 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.578+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566a00 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:10:25.582 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.578+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566a00 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:10:25.582 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.578+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566a00 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:10:25.583 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.578+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566a00 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:10:25.583 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.578+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566a00 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:10:25.583 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.578+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a498a780 [3/aff5f3bc-3e8e-4a66-b089-b2f57573290a] start: already running 2024-09-21T15:10:25.583 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:25.578+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505a00 2024-09-21T15:10:25.583 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:25.578+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505ba0 2024-09-21T15:10:25.595 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:25.590+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54410 2024-09-21T15:10:25.606 INFO:teuthology.orchestra.run.smithi161.stdout:5193 trunc from 0xabeb129 to 0x4ba09c6 2024-09-21T15:10:25.614 INFO:teuthology.orchestra.run.smithi161.stdout:4361 punch from 0x15a0950 to 0x15ab4db, (0xab8b bytes) 2024-09-21T15:10:25.614 INFO:teuthology.orchestra.run.smithi161.stdout:4363 read 0x155c5ec thru 0x155f7ff (0x3214 bytes) 2024-09-21T15:10:25.616 INFO:teuthology.orchestra.run.smithi161.stdout:5677 punch from 0x3984162 to 0x398e6de, (0xa57c bytes) 2024-09-21T15:10:25.617 INFO:teuthology.orchestra.run.smithi161.stdout:5678 write 0x82ec31 thru 0x83555d (0x692d bytes) 2024-09-21T15:10:25.618 INFO:teuthology.orchestra.run.smithi161.stdout:4364 read 0x1213f07 thru 0x121d3b7 (0x94b1 bytes) 2024-09-21T15:10:25.636 INFO:teuthology.orchestra.run.smithi161.stdout:5679 clone 37 order 18 su 4096 sc 2 2024-09-21T15:10:25.688 INFO:teuthology.orchestra.run.smithi161.stdout:4365 writesame 0xb534a67 thru 0xb5353dc data_size 0x1(0x976 bytes) 2024-09-21T15:10:25.717 INFO:teuthology.orchestra.run.smithi161.stdout:4366 read 0x3884d2d thru 0x3888bf6 (0x3eca bytes) 2024-09-21T15:10:25.717 INFO:teuthology.orchestra.run.smithi161.stdout:4367 punch from 0xe10a7a to 0xe127cd, (0x1d53 bytes) 2024-09-21T15:10:25.717 INFO:teuthology.orchestra.run.smithi161.stdout:4369 read 0x76c467a thru 0x76c7356 (0x2cdd bytes) 2024-09-21T15:10:25.717 INFO:teuthology.orchestra.run.smithi161.stdout:4371 read 0x2f0f4f2 thru 0x2f11885 (0x2394 bytes) 2024-09-21T15:10:25.717 INFO:teuthology.orchestra.run.smithi161.stdout:4373 write 0x3909916 thru 0x390b687 (0x1d72 bytes) 2024-09-21T15:10:25.718 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.714+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf49c3a00 2024-09-21T15:10:25.724 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.714+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc08b86820 2024-09-21T15:10:25.724 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.714+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc08b86d00 2024-09-21T15:10:25.748 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.734+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc08b87e10 2024-09-21T15:10:25.749 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.738+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4820 2024-09-21T15:10:25.749 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.738+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff48f0 2024-09-21T15:10:25.750 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.746+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4d00 2024-09-21T15:10:25.754 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:25.742+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:25.754 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:25.742+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac876ea0 2024-09-21T15:10:25.774 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.762+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5040 2024-09-21T15:10:25.774 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.762+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff51e0 2024-09-21T15:10:25.776 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.766+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc15458410 2024-09-21T15:10:25.776 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.766+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:10:25.776 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.766+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939ef70 2024-09-21T15:10:25.777 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.766+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939f1e0 2024-09-21T15:10:25.777 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.766+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939f930 2024-09-21T15:10:25.777 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.766+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fa00 2024-09-21T15:10:25.777 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.766+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1940f520 2024-09-21T15:10:25.777 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.766+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bcf09c0 2024-09-21T15:10:25.777 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.766+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bcf12b0 2024-09-21T15:10:25.777 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.766+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c07e410 2024-09-21T15:10:25.777 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.766+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c07e680 2024-09-21T15:10:25.778 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.774+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c07f040 2024-09-21T15:10:25.778 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.774+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c07f450 2024-09-21T15:10:25.778 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.774+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c383e10 2024-09-21T15:10:25.778 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.774+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf59790 2024-09-21T15:10:25.778 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.774+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e8221a0 2024-09-21T15:10:25.779 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:25.774+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822820 2024-09-21T15:10:25.789 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.786+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a498bb80 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:10:25.790 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.786+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a498af00 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:10:25.809 INFO:teuthology.orchestra.run.smithi161.stdout:5194 read 0x2799aa7 thru 0x279eddb (0x5335 bytes) 2024-09-21T15:10:25.818 INFO:teuthology.orchestra.run.smithi161.stdout:5335 write 0xd85afd4 thru 0xd869277 (0xe2a4 bytes) 2024-09-21T15:10:25.826 INFO:teuthology.orchestra.run.smithi161.stdout:4374 write 0x3c08eaf thru 0x3c109b4 (0x7b06 bytes) 2024-09-21T15:10:25.836 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #36, image image_cluster1.client.mirror.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent37 2024-09-21T15:10:25.851 INFO:teuthology.orchestra.run.smithi161.stdout:5336 read 0x68f53ad thru 0x68f9e8d (0x4ae1 bytes) 2024-09-21T15:10:25.851 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:25.851 INFO:teuthology.orchestra.run.smithi161.stdout:5338 punch from 0x1fb33ee to 0x1fba8f6, (0x7508 bytes) 2024-09-21T15:10:25.851 INFO:teuthology.orchestra.run.smithi161.stdout:5339 writesame 0xd78a048 thru 0xd78f5f7 data_size 0x18(0x55b0 bytes) 2024-09-21T15:10:25.865 INFO:teuthology.orchestra.run.smithi161.stdout:5195 write 0xb8acc74 thru 0xb8b1089 (0x4416 bytes) 2024-09-21T15:10:25.869 INFO:teuthology.orchestra.run.smithi161.stdout:5341 write 0x25c4c72 thru 0x25c5fb7 (0x1346 bytes) 2024-09-21T15:10:25.880 INFO:teuthology.orchestra.run.smithi161.stdout:5343 punch from 0x264050c to 0x264e449, (0xdf3d bytes) 2024-09-21T15:10:25.881 INFO:teuthology.orchestra.run.smithi161.stdout:5198 writesame 0x6d3456a thru 0x6d3e213 data_size 0x1(0x9caa bytes) 2024-09-21T15:10:25.892 INFO:teuthology.orchestra.run.smithi161.stdout:4376 write 0xc2a87c3 thru 0xc2ae8d9 (0x6117 bytes) 2024-09-21T15:10:25.896 INFO:teuthology.orchestra.run.smithi161.stdout:5344 trunc from 0xd869278 to 0x504d292 2024-09-21T15:10:25.914 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:25.910+0000 7f4810899700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f59ec54000 get_replay_status: replay not running 2024-09-21T15:10:25.927 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.918+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:10:25.927 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.918+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:10:25.929 INFO:teuthology.orchestra.run.smithi161.stdout:4377 read 0x44fde23 thru 0x450b84a (0xda28 bytes) 2024-09-21T15:10:25.929 INFO:teuthology.orchestra.run.smithi161.stdout:4379 read 0xa70a24b thru 0xa7130f5 (0x8eab bytes) 2024-09-21T15:10:25.929 INFO:teuthology.orchestra.run.smithi161.stdout:4381 read 0x4ea4829 thru 0x4eac487 (0x7c5f bytes) 2024-09-21T15:10:25.930 INFO:teuthology.orchestra.run.smithi161.stdout:4382 write 0xf23279 thru 0xf250e7 (0x1e6f bytes) 2024-09-21T15:10:25.932 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.922+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc8cb60 2024-09-21T15:10:25.932 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c10d110 2024-09-21T15:10:25.933 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c10d790 2024-09-21T15:10:25.933 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c10d930 2024-09-21T15:10:25.933 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c7b6410 2024-09-21T15:10:25.933 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf0cb60 2024-09-21T15:10:25.933 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55713d822820 2024-09-21T15:10:25.933 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:10:25.933 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80b60 2024-09-21T15:10:25.934 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:10:25.934 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81860 2024-09-21T15:10:25.934 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:10:25.934 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e7ea270 2024-09-21T15:10:25.934 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25790 2024-09-21T15:10:25.934 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:10:25.934 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0680 2024-09-21T15:10:25.934 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d16c0 2024-09-21T15:10:25.934 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:10:25.934 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17110 2024-09-21T15:10:25.934 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17860 2024-09-21T15:10:25.935 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17930 2024-09-21T15:10:25.935 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:10:25.935 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:25.926+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232bee0 2024-09-21T15:10:25.955 INFO:teuthology.orchestra.run.smithi161.stdout:4383 write 0x2ba58d9 thru 0x2baad76 (0x549e bytes) 2024-09-21T15:10:25.981 INFO:teuthology.orchestra.run.smithi161.stdout:4384 clone 47 order 18 su 8192 sc 7 2024-09-21T15:10:25.982 INFO:teuthology.orchestra.run.smithi161.stdout:5200 write 0xbee955e thru 0xbee9815 (0x2b8 bytes) 2024-09-21T15:10:26.007 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.002+0000 7f1e9c77a700 -1 reset not still connected to 0x5628751c3e10 2024-09-21T15:10:26.007 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.002+0000 7f1e9c77a700 -1 reset not still connected to 0x56288e0c35f0 2024-09-21T15:10:26.008 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.002+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28eea0 2024-09-21T15:10:26.008 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.002+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d28f0 2024-09-21T15:10:26.008 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.002+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3c70 2024-09-21T15:10:26.008 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.002+0000 7f1e9c77a700 -1 reset not still connected to 0x562890805d40 2024-09-21T15:10:26.010 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x56289c976340 2024-09-21T15:10:26.010 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a1f75110 2024-09-21T15:10:26.010 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2e88340 2024-09-21T15:10:26.010 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:10:26.010 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3323a00 2024-09-21T15:10:26.010 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4581e10 2024-09-21T15:10:26.011 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a5fc9380 2024-09-21T15:10:26.011 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec69c0 2024-09-21T15:10:26.011 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ef01a0 2024-09-21T15:10:26.011 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f400d0 2024-09-21T15:10:26.011 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7161520 2024-09-21T15:10:26.011 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e1a0 2024-09-21T15:10:26.011 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809b6c0 2024-09-21T15:10:26.011 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198410 2024-09-21T15:10:26.011 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1c70 2024-09-21T15:10:26.011 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0b60 2024-09-21T15:10:26.011 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0c30 2024-09-21T15:10:26.011 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0ea0 2024-09-21T15:10:26.012 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0f70 2024-09-21T15:10:26.012 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1380 2024-09-21T15:10:26.013 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:10:26.013 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14c30 2024-09-21T15:10:26.013 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab156c0 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab168f0 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1ef70 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f040 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0fad0 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18cea0 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2344e0 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275380 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2755f0 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.006+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275e10 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.010+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.010+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49450 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.010+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49e10 2024-09-21T15:10:26.014 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.010+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac876c30 2024-09-21T15:10:26.015 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.010+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac876ea0 2024-09-21T15:10:26.015 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.010+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877380 2024-09-21T15:10:26.015 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.010+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877930 2024-09-21T15:10:26.015 INFO:teuthology.orchestra.run.smithi161.stdout:5345 read 0x1437cce thru 0x14403d5 (0x8708 bytes) 2024-09-21T15:10:26.017 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:26.018 INFO:teuthology.orchestra.run.smithi161.stdout:5348 trunc from 0x504d292 to 0x6653a6f 2024-09-21T15:10:26.032 INFO:teuthology.orchestra.run.smithi161.stdout:5201 write 0xbb1a06 thru 0xbbc192 (0xa78d bytes) 2024-09-21T15:10:26.073 INFO:teuthology.orchestra.run.smithi161.stdout:5202 read 0x2047a75 thru 0x2047e43 (0x3cf bytes) 2024-09-21T15:10:26.074 INFO:teuthology.orchestra.run.smithi161.stdout:5203 write 0xa1a397b thru 0xa1b1f29 (0xe5af bytes) 2024-09-21T15:10:26.078 INFO:teuthology.orchestra.run.smithi161.stdout:5349 punch from 0x224f417 to 0x225635d, (0x6f46 bytes) 2024-09-21T15:10:26.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.074+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4000 [3/62263722-a51f-40ca-9cc5-1ab605e9bb14] start: already running 2024-09-21T15:10:26.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.074+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4000 [3/62263722-a51f-40ca-9cc5-1ab605e9bb14] start: already running 2024-09-21T15:10:26.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.074+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4000 [3/62263722-a51f-40ca-9cc5-1ab605e9bb14] start: already running 2024-09-21T15:10:26.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.074+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4000 [3/62263722-a51f-40ca-9cc5-1ab605e9bb14] start: already running 2024-09-21T15:10:26.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.082+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6c80 [3/4b9face3-5cac-4c8c-ab5f-f75cbc0915bc] start: already running 2024-09-21T15:10:26.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.082+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6c80 [3/4b9face3-5cac-4c8c-ab5f-f75cbc0915bc] start: already running 2024-09-21T15:10:26.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.082+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6c80 [3/4b9face3-5cac-4c8c-ab5f-f75cbc0915bc] start: already running 2024-09-21T15:10:26.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.082+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b6c80 [3/4b9face3-5cac-4c8c-ab5f-f75cbc0915bc] start: already running 2024-09-21T15:10:26.109 INFO:teuthology.orchestra.run.smithi161.stdout:5205 writesame 0x65e9ba8 thru 0x65ea767 data_size 0x2(0xbc0 bytes) 2024-09-21T15:10:26.121 INFO:teuthology.orchestra.run.smithi161.stdout:5350 write 0xb15de74 thru 0xb15f980 (0x1b0d bytes) 2024-09-21T15:10:26.126 INFO:teuthology.orchestra.run.smithi161.stdout:5207 read 0x7306077 thru 0x7310894 (0xa81e bytes) 2024-09-21T15:10:26.126 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:26.126 INFO:teuthology.orchestra.run.smithi161.stdout:5209 write 0xa04fd93 thru 0xa050c0a (0xe78 bytes) 2024-09-21T15:10:26.135 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.126+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5400 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:10:26.135 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.126+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5400 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:10:26.135 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.126+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5400 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:10:26.135 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.126+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5400 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:10:26.135 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.126+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5400 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:10:26.135 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.126+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2567900 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:10:26.135 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.126+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2567900 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:10:26.135 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.126+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2567900 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:10:26.135 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.130+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4f00 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:10:26.136 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.130+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4f00 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:10:26.136 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.130+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4f00 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:10:26.136 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.130+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4f00 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:10:26.149 INFO:teuthology.orchestra.run.smithi161.stdout:5210 read 0x7e48482 thru 0x7e539c3 (0xb542 bytes) 2024-09-21T15:10:26.149 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:26.150 INFO:teuthology.orchestra.run.smithi161.stdout:5212 punch from 0x703e98 to 0x710260, (0xc3c8 bytes) 2024-09-21T15:10:26.150 INFO:teuthology.orchestra.run.smithi161.stdout:5213 punch from 0xab05fc0 to 0xab15d84, (0xfdc4 bytes) 2024-09-21T15:10:26.150 INFO:teuthology.orchestra.run.smithi161.stdout:5214 read 0x919ec66 thru 0x91ad69f (0xea3a bytes) 2024-09-21T15:10:26.150 INFO:teuthology.orchestra.run.smithi161.stdout:5215 punch from 0x4d9851e to 0x4da6124, (0xdc06 bytes) 2024-09-21T15:10:26.150 INFO:teuthology.orchestra.run.smithi161.stdout:5216 write 0x7628405 thru 0x762f735 (0x7331 bytes) 2024-09-21T15:10:26.150 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone36 from 0xe4c20c0 (overlap 0x79d8ee) to 0xc2f4b 2024-09-21T15:10:26.169 INFO:teuthology.orchestra.run.smithi161.stdout:5351 trunc from 0xb15f981 to 0x1210b8 2024-09-21T15:10:26.175 INFO:teuthology.orchestra.run.smithi161.stdout:5218 read 0xae696b6 thru 0xae788f6 (0xf241 bytes) 2024-09-21T15:10:26.175 INFO:teuthology.orchestra.run.smithi161.stdout:5220 read 0x113bbc0 thru 0x113ec29 (0x306a bytes) 2024-09-21T15:10:26.182 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone37 from 0xbf633b5 (overlap 0xd186ca) to 0xbc92e9 2024-09-21T15:10:26.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797680 [3/30daac8e-2d9f-4da1-a5a1-1fa7d734a3e5] start: already running 2024-09-21T15:10:26.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797680 [3/30daac8e-2d9f-4da1-a5a1-1fa7d734a3e5] start: already running 2024-09-21T15:10:26.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797680 [3/30daac8e-2d9f-4da1-a5a1-1fa7d734a3e5] start: already running 2024-09-21T15:10:26.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797680 [3/30daac8e-2d9f-4da1-a5a1-1fa7d734a3e5] start: already running 2024-09-21T15:10:26.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797680 [3/30daac8e-2d9f-4da1-a5a1-1fa7d734a3e5] start: already running 2024-09-21T15:10:26.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2567680 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:10:26.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2567680 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:10:26.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2567680 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:10:26.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f900 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:10:26.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f900 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:10:26.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f900 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f900 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f900 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f009180 [3/6019fe59-e961-41f3-881e-27522f0e43d6] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f009180 [3/6019fe59-e961-41f3-881e-27522f0e43d6] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f009180 [3/6019fe59-e961-41f3-881e-27522f0e43d6] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f009180 [3/6019fe59-e961-41f3-881e-27522f0e43d6] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566780 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566780 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566780 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566780 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566780 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a49b6f00 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566280 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:10:26.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566280 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:10:26.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566280 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:10:26.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566280 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:10:26.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566280 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:10:26.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a49b6000 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:10:26.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.202+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a498b900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:10:26.258 INFO:teuthology.orchestra.run.smithi161.stdout:5221 writesame 0xd2b2059 thru 0xd2b3025 data_size 0x1(0xfcd bytes) 2024-09-21T15:10:26.268 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.254+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f89520 2024-09-21T15:10:26.272 INFO:teuthology.orchestra.run.smithi161.stdout:5222 write 0x6303ff0 thru 0x630bd6a (0x7d7b bytes) 2024-09-21T15:10:26.281 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.270+0000 7f7fd044c700 -1 reset not still connected to 0x5636c28b8f70 2024-09-21T15:10:26.287 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.282+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54410 2024-09-21T15:10:26.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.282+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:10:26.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.282+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:10:26.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.282+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:10:26.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.282+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:10:26.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.282+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:10:26.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.282+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:10:26.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.282+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:10:26.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.282+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc60d0 2024-09-21T15:10:26.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.282+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f6c0 2024-09-21T15:10:26.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.282+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d31e0 2024-09-21T15:10:26.294 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.282+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3860 2024-09-21T15:10:26.294 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.282+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3ba0 2024-09-21T15:10:26.294 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.282+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:10:26.298 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.286+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:10:26.298 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.286+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:10:26.302 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.290+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:10:26.302 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.290+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:10:26.302 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.290+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:10:26.302 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.290+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:10:26.303 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.294+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:10:26.303 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.294+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:10:26.304 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.294+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:10:26.305 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.298+0000 7ff753f07700 -1 reset not still connected to 0x56017219f040 2024-09-21T15:10:26.305 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.298+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:10:26.305 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.298+0000 7ff753f07700 -1 reset not still connected to 0x56017219f5f0 2024-09-21T15:10:26.305 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.298+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:10:26.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.310+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59fbda500 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:10:26.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.310+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59fbda500 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:10:26.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.310+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59fbda500 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:10:26.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.310+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a49b6c80 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:10:26.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.310+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a498aa00 [3/b0925bf1-5012-45a2-afe9-91608ced3c6a] start: already running 2024-09-21T15:10:26.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.310+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a49b6a00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:10:26.348 INFO:teuthology.orchestra.run.smithi161.stdout:5844 trunc from 0xb367227 to 0x9ee390d 2024-09-21T15:10:26.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2567b80 [3/ab585917-bbfb-41ce-a268-5e9596e12ef3] start: already running 2024-09-21T15:10:26.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566c80 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:10:26.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566c80 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:10:26.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566c80 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:10:26.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566c80 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:10:26.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566c80 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:10:26.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5680 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:10:26.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5680 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:10:26.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5680 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:10:26.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5680 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:10:26.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5680 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:10:26.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f400 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:10:26.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f400 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:10:26.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f400 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:10:26.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f400 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:10:26.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.350+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f400 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:10:26.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.354+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566f00 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:10:26.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.354+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566f00 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:10:26.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.354+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566f00 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:10:26.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.354+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566f00 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:10:26.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.354+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566f00 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:10:26.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.354+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a498b680 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:10:26.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.354+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f59f009900 [3/3dc01151-5655-47e1-a307-fa2b690265ce] start: already running 2024-09-21T15:10:26.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.354+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f59f009900 [3/3dc01151-5655-47e1-a307-fa2b690265ce] start: already running 2024-09-21T15:10:26.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.354+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f59f009900 [3/3dc01151-5655-47e1-a307-fa2b690265ce] start: already running 2024-09-21T15:10:26.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.354+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f59f009900 [3/3dc01151-5655-47e1-a307-fa2b690265ce] start: already running 2024-09-21T15:10:26.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.354+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f59f009900 [3/3dc01151-5655-47e1-a307-fa2b690265ce] start: already running 2024-09-21T15:10:26.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.378+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c500 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:10:26.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.378+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c500 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:10:26.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.378+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a498b180 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:10:26.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.378+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c4000 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:10:26.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.378+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c4000 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:10:26.394 INFO:teuthology.orchestra.run.smithi161.stdout:5223 write 0xb3a65f6 thru 0xb3b3f36 (0xd941 bytes) 2024-09-21T15:10:26.423 INFO:teuthology.orchestra.run.smithi161.stdout:5353 punch from 0x34133 to 0x34e2f, (0xcfc bytes) 2024-09-21T15:10:26.423 INFO:teuthology.orchestra.run.smithi161.stdout:5355 read 0x35bbe thru 0x3647a (0x8bd bytes) 2024-09-21T15:10:26.428 INFO:teuthology.orchestra.run.smithi161.stdout:5356 trunc from 0x1210b8 to 0x10690fb 2024-09-21T15:10:26.431 INFO:teuthology.orchestra.run.smithi161.stdout:5224 writesame 0x85c012d thru 0x85c0e5e data_size 0x3(0xd32 bytes) 2024-09-21T15:10:26.456 INFO:teuthology.orchestra.run.smithi161.stdout:5225 write 0x2f3a380 thru 0x2f3f8c2 (0x5543 bytes) 2024-09-21T15:10:26.465 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.458+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796a00 [3/2936d0d6-bde0-48c6-807a-b5288242b35d] start: already running 2024-09-21T15:10:26.465 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.458+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796a00 [3/2936d0d6-bde0-48c6-807a-b5288242b35d] start: already running 2024-09-21T15:10:26.466 INFO:teuthology.orchestra.run.smithi161.stdout:5845 punch from 0x10d8ccd to 0x10e0617, (0x794a bytes) 2024-09-21T15:10:26.466 INFO:teuthology.orchestra.run.smithi161.stdout:5846 punch from 0x50db354 to 0x50dc9bd, (0x1669 bytes) 2024-09-21T15:10:26.466 INFO:teuthology.orchestra.run.smithi161.stdout:5847 punch from 0x38b9e45 to 0x38bd45b, (0x3616 bytes) 2024-09-21T15:10:26.466 INFO:teuthology.orchestra.run.smithi161.stdout:5848 write 0x27fd6b9 thru 0x2802db6 (0x56fe bytes) 2024-09-21T15:10:26.489 INFO:teuthology.orchestra.run.smithi161.stdout:5226 writesame 0x2bdca0f thru 0x2be872a data_size 0xe(0xbd1c bytes) 2024-09-21T15:10:26.497 INFO:teuthology.orchestra.run.smithi161.stdout:5357 trunc from 0x10690fb to 0xdc91fdf 2024-09-21T15:10:26.536 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.530+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:10:26.537 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.530+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1fa00 2024-09-21T15:10:26.537 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.530+0000 7f7fd044c700 -1 reset not still connected to 0x5636be16a4e0 2024-09-21T15:10:26.537 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.530+0000 7f7fd044c700 -1 reset not still connected to 0x5636bfcdbc70 2024-09-21T15:10:26.537 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.530+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbaea0 2024-09-21T15:10:26.537 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.530+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f880d0 2024-09-21T15:10:26.538 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.534+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f89520 2024-09-21T15:10:26.538 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.534+0000 7f7fd044c700 -1 reset not still connected to 0x5636c28b8f70 2024-09-21T15:10:26.538 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.534+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45045b0 2024-09-21T15:10:26.538 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.534+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54410 2024-09-21T15:10:26.542 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796280 [3/270edf45-6738-4fd2-95f6-31351dcf77ee] start: already running 2024-09-21T15:10:26.543 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796280 [3/270edf45-6738-4fd2-95f6-31351dcf77ee] start: already running 2024-09-21T15:10:26.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a498a000 [3/af7bb590-faa2-4f57-80f6-c5ab02216567] start: already running 2024-09-21T15:10:26.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5b80 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] start: already running 2024-09-21T15:10:26.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5b80 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] start: already running 2024-09-21T15:10:26.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5b80 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] start: already running 2024-09-21T15:10:26.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5b80 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] start: already running 2024-09-21T15:10:26.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd5b80 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:10:26.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd5b80 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:10:26.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd5b80 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:10:26.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd5b80 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:10:26.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd5b80 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:10:26.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c5900 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:10:26.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c5900 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:10:26.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4ec80 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:10:26.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4ec80 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:10:26.565 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:26.565 INFO:teuthology.orchestra.run.smithi161.stdout:5851 writesame 0x2920f27 thru 0x292c7fd data_size 0x1(0xb8d7 bytes) 2024-09-21T15:10:26.571 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.566+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796c80 [3/2b696388-ccf4-4874-ae7a-646ab0d69446] start: already running 2024-09-21T15:10:26.571 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.566+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796c80 [3/2b696388-ccf4-4874-ae7a-646ab0d69446] start: already running 2024-09-21T15:10:26.572 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.566+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c4780 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:10:26.572 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.566+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c4780 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:10:26.572 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.566+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4500 [3/639e7549-39e6-4963-86db-7a414ac8d909] start: already running 2024-09-21T15:10:26.572 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.566+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4500 [3/639e7549-39e6-4963-86db-7a414ac8d909] start: already running 2024-09-21T15:10:26.572 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.566+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4500 [3/639e7549-39e6-4963-86db-7a414ac8d909] start: already running 2024-09-21T15:10:26.572 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.566+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4500 [3/639e7549-39e6-4963-86db-7a414ac8d909] start: already running 2024-09-21T15:10:26.633 INFO:teuthology.orchestra.run.smithi161.stdout:5227 write 0x38132ff thru 0x3818179 (0x4e7b bytes) 2024-09-21T15:10:26.639 INFO:teuthology.orchestra.run.smithi161.stdout:5852 trunc from 0x9ee390d to 0x56cc7ca 2024-09-21T15:10:26.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c000 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:10:26.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258c000 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:10:26.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258cc80 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:10:26.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258cc80 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:10:26.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a49b7180 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:10:26.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d680 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:10:26.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d680 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:10:26.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d680 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:10:26.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d680 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:10:26.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a258d680 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:10:26.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4ef00 [3/24b4fbb0-7c7f-43b3-8add-fc2245c3b143] start: already running 2024-09-21T15:10:26.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4ef00 [3/24b4fbb0-7c7f-43b3-8add-fc2245c3b143] start: already running 2024-09-21T15:10:26.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4ea00 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:10:26.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a1a4ea00 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:10:26.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796780 [3/2799bff6-159c-4fac-9ff0-10626f02c84d] start: already running 2024-09-21T15:10:26.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.642+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796780 [3/2799bff6-159c-4fac-9ff0-10626f02c84d] start: already running 2024-09-21T15:10:26.650 INFO:teuthology.orchestra.run.smithi161.stdout:5229 read 0x6607f2c thru 0x660b1b7 (0x328c bytes) 2024-09-21T15:10:26.654 INFO:teuthology.orchestra.run.smithi161.stdout:5358 trunc from 0xdc91fdf to 0x433fc46 2024-09-21T15:10:26.675 INFO:teuthology.orchestra.run.smithi161.stdout:5230 trunc from 0xd2b3026 to 0x23efa9d 2024-09-21T15:10:26.703 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.698+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28f110 2024-09-21T15:10:26.703 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.698+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d25b0 2024-09-21T15:10:26.704 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.702+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d2ea0 2024-09-21T15:10:26.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.702+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3c70 2024-09-21T15:10:26.715 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.710+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a1f75110 2024-09-21T15:10:26.716 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.710+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2e88340 2024-09-21T15:10:26.716 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.710+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:10:26.717 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016bff69c0 2024-09-21T15:10:26.719 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:10:26.719 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbba00 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f6c0 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:10:26.720 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:10:26.721 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9520 2024-09-21T15:10:26.721 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x5601709b95f0 2024-09-21T15:10:26.721 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:10:26.721 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:10:26.721 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:10:26.721 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:10:26.721 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:10:26.721 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:10:26.721 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:10:26.721 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.710+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:10:26.725 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3323a00 2024-09-21T15:10:26.725 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4073d40 2024-09-21T15:10:26.725 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:10:26.725 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4581e10 2024-09-21T15:10:26.725 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a54631e0 2024-09-21T15:10:26.725 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a5fc9380 2024-09-21T15:10:26.725 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec69c0 2024-09-21T15:10:26.725 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:10:26.725 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ef01a0 2024-09-21T15:10:26.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f400d0 2024-09-21T15:10:26.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e1a0 2024-09-21T15:10:26.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780ea90 2024-09-21T15:10:26.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809b6c0 2024-09-21T15:10:26.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198410 2024-09-21T15:10:26.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1c70 2024-09-21T15:10:26.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0270 2024-09-21T15:10:26.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0410 2024-09-21T15:10:26.727 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f08f0 2024-09-21T15:10:26.728 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0b60 2024-09-21T15:10:26.728 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0c30 2024-09-21T15:10:26.728 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1110 2024-09-21T15:10:26.728 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.714+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1380 2024-09-21T15:10:26.728 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.718+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:10:26.728 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.718+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab156c0 2024-09-21T15:10:26.728 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.722+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18cea0 2024-09-21T15:10:26.728 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.722+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18d930 2024-09-21T15:10:26.728 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.722+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2340d0 2024-09-21T15:10:26.728 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.722+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2344e0 2024-09-21T15:10:26.728 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.722+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:26.728 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.722+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48ea0 2024-09-21T15:10:26.728 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.722+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:10:26.729 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.726+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49e10 2024-09-21T15:10:26.729 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.726+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac876340 2024-09-21T15:10:26.729 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.726+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac876c30 2024-09-21T15:10:26.757 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #35, image image_cluster1.client.mirror.5-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent36 2024-09-21T15:10:26.772 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.766+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:10:26.772 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.766+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:10:26.772 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.766+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:10:26.772 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.766+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9520 2024-09-21T15:10:26.773 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.766+0000 7ff753f07700 -1 reset not still connected to 0x5601709b95f0 2024-09-21T15:10:26.773 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.766+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:10:26.773 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.766+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:10:26.773 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.766+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:10:26.773 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.766+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:10:26.773 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.766+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:10:26.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.778+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:10:26.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.778+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:10:26.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.778+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:10:26.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.778+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:10:26.786 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:26.778+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:10:26.802 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.798+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797180 [3/2e0d532d-d0fa-46dd-8ea2-5577312481b6] start: already running 2024-09-21T15:10:26.802 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.798+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797180 [3/2e0d532d-d0fa-46dd-8ea2-5577312481b6] start: already running 2024-09-21T15:10:26.848 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.842+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:10:26.848 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.846+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9636750 2024-09-21T15:10:26.849 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.846+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7148b60 2024-09-21T15:10:26.849 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.846+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7149040 2024-09-21T15:10:26.849 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.846+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb8c30 2024-09-21T15:10:26.850 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.846+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:10:26.853 INFO:teuthology.orchestra.run.smithi161.stdout:5853 trunc from 0x56cc7ca to 0x959081b 2024-09-21T15:10:26.855 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:10:26.855 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1fa00 2024-09-21T15:10:26.855 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636be16a4e0 2024-09-21T15:10:26.855 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeb380 2024-09-21T15:10:26.855 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636bfcda820 2024-09-21T15:10:26.856 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbaea0 2024-09-21T15:10:26.857 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbbc70 2024-09-21T15:10:26.857 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f880d0 2024-09-21T15:10:26.857 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f89520 2024-09-21T15:10:26.857 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636c1522340 2024-09-21T15:10:26.857 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636c28b8f70 2024-09-21T15:10:26.857 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45045b0 2024-09-21T15:10:26.857 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.850+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbab60 2024-09-21T15:10:26.857 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.854+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54410 2024-09-21T15:10:26.857 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.854+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f551e0 2024-09-21T15:10:26.859 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.854+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66900d0 2024-09-21T15:10:26.861 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.858+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690410 2024-09-21T15:10:26.861 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.858+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:10:26.867 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.862+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:10:26.867 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.862+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690c30 2024-09-21T15:10:26.867 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.862+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690dd0 2024-09-21T15:10:26.867 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.862+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690f70 2024-09-21T15:10:26.867 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:26.862+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ad0 2024-09-21T15:10:26.891 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.886+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:10:26.897 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.894+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3323a00 2024-09-21T15:10:26.897 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.894+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4073d40 2024-09-21T15:10:26.897 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.894+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:10:26.897 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.894+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4581e10 2024-09-21T15:10:26.908 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.898+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a54631e0 2024-09-21T15:10:26.912 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.902+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:10:26.912 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.906+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ef01a0 2024-09-21T15:10:26.916 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.906+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a71612b0 2024-09-21T15:10:26.916 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.906+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e1a0 2024-09-21T15:10:26.916 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.906+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780ea90 2024-09-21T15:10:26.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.906+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809b6c0 2024-09-21T15:10:26.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.906+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198410 2024-09-21T15:10:26.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1c70 2024-09-21T15:10:26.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0270 2024-09-21T15:10:26.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0410 2024-09-21T15:10:26.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f08f0 2024-09-21T15:10:26.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0b60 2024-09-21T15:10:26.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0c30 2024-09-21T15:10:26.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1110 2024-09-21T15:10:26.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1380 2024-09-21T15:10:26.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:10:26.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab156c0 2024-09-21T15:10:26.920 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab165b0 2024-09-21T15:10:26.920 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e8f0 2024-09-21T15:10:26.920 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c5b0 2024-09-21T15:10:26.920 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18cea0 2024-09-21T15:10:26.920 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18d930 2024-09-21T15:10:26.921 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2340d0 2024-09-21T15:10:26.921 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2344e0 2024-09-21T15:10:26.921 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235ba0 2024-09-21T15:10:26.921 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274750 2024-09-21T15:10:26.921 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:10:26.921 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:26.924 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48ea0 2024-09-21T15:10:26.924 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:10:26.924 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49e10 2024-09-21T15:10:26.924 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.918+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac876340 2024-09-21T15:10:26.924 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.922+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac876d00 2024-09-21T15:10:26.925 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.922+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877450 2024-09-21T15:10:26.925 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.922+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8776c0 2024-09-21T15:10:26.925 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.922+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877790 2024-09-21T15:10:26.925 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.922+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877ba0 2024-09-21T15:10:26.925 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:26.922+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c0d0 2024-09-21T15:10:26.947 INFO:teuthology.orchestra.run.smithi161.stdout:5854 read 0x8d602f9 thru 0x8d6ee8d (0xeb95 bytes) 2024-09-21T15:10:26.947 INFO:teuthology.orchestra.run.smithi161.stdout:5857 write 0x6fd3bcc thru 0x6fd4059 (0x48e bytes) 2024-09-21T15:10:26.953 INFO:teuthology.orchestra.run.smithi161.stdout:5231 writesame 0x34336 thru 0x35af2 data_size 0x1(0x17bd bytes) 2024-09-21T15:10:26.959 INFO:teuthology.orchestra.run.smithi161.stdout:5680 writesame 0xb8bd6ab thru 0xb8c8cfb data_size 0x1(0xb651 bytes) 2024-09-21T15:10:26.959 INFO:teuthology.orchestra.run.smithi161.stdout:5858 punch from 0x2b680e4 to 0x2b6f9b3, (0x78cf bytes) 2024-09-21T15:10:26.960 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:26.960 INFO:teuthology.orchestra.run.smithi161.stdout:5861 write 0x8fe7e31 thru 0x8ff7592 (0xf762 bytes) 2024-09-21T15:10:26.960 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.950+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a258ca00 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:10:26.960 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.950+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a258ca00 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:10:26.960 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.950+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796000 [3/2356d978-bbcf-4641-a1a5-fa6a827028ca] start: already running 2024-09-21T15:10:26.960 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:26.950+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2796000 [3/2356d978-bbcf-4641-a1a5-fa6a827028ca] start: already running 2024-09-21T15:10:26.966 INFO:teuthology.orchestra.run.smithi161.stdout:5359 write 0x7b4b5d7 thru 0x7b574ee (0xbf18 bytes) 2024-09-21T15:10:26.985 INFO:teuthology.orchestra.run.smithi161.stdout:5232 punch from 0x17bd5ea to 0x17ccfc4, (0xf9da bytes) 2024-09-21T15:10:26.985 INFO:teuthology.orchestra.run.smithi161.stdout:5233 clone 41 order 23 su 65536 sc 8 2024-09-21T15:10:27.050 INFO:teuthology.orchestra.run.smithi161.stdout:5681 read 0x3d586 thru 0x45efd (0x8978 bytes) 2024-09-21T15:10:27.053 INFO:teuthology.orchestra.run.smithi161.stdout:5862 write 0xe6ddae1 thru 0xe6dfbf9 (0x2119 bytes) 2024-09-21T15:10:27.059 INFO:teuthology.orchestra.run.smithi161.stdout:5360 write 0xa08da02 thru 0xa0962a8 (0x88a7 bytes) 2024-09-21T15:10:27.071 INFO:teuthology.orchestra.run.smithi161.stdout:5682 trunc from 0xe4c20c0 to 0x77ed112 2024-09-21T15:10:27.073 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:27.066+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:10:27.073 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:10:27.066+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:10:27.077 INFO:teuthology.orchestra.run.smithi161.stdout:5866 writesame 0x68324 thru 0x6fbb5 data_size 0x3d(0x7892 bytes) 2024-09-21T15:10:27.087 INFO:teuthology.orchestra.run.smithi161.stdout:5869 read 0x639883f thru 0x639dda5 (0x5567 bytes) 2024-09-21T15:10:27.088 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #36, image image_cluster1.client.mirror.2-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent37 2024-09-21T15:10:27.090 INFO:teuthology.orchestra.run.smithi161.stdout:5872 read 0x9212608 thru 0x9213dce (0x17c7 bytes) 2024-09-21T15:10:27.091 INFO:teuthology.orchestra.run.smithi161.stdout:5873 write 0x276d7bc thru 0x27782ef (0xab34 bytes) 2024-09-21T15:10:27.099 INFO:teuthology.orchestra.run.smithi161.stdout:5361 trunc from 0xa0962a9 to 0x3d6bae0 2024-09-21T15:10:27.110 INFO:teuthology.orchestra.run.smithi161.stdout:5874 read 0x56f03b0 thru 0x56f311d (0x2d6e bytes) 2024-09-21T15:10:27.119 INFO:teuthology.orchestra.run.smithi161.stdout:5875 writesame 0x75fbb65 thru 0x75fea94 data_size 0x14(0x2f30 bytes) 2024-09-21T15:10:27.119 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.110+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:10:27.133 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.130+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7ca00 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:10:27.134 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.130+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a0b7ca00 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:10:27.134 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.130+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c4c80 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:10:27.134 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.130+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a19c4c80 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:10:27.134 INFO:teuthology.orchestra.run.smithi161.stdout:5876 read 0x94e910e thru 0x94eab9e (0x1a91 bytes) 2024-09-21T15:10:27.134 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:27.135 INFO:teuthology.orchestra.run.smithi161.stdout:5878 punch from 0x676688f to 0x676d215, (0x6986 bytes) 2024-09-21T15:10:27.135 INFO:teuthology.orchestra.run.smithi161.stdout:5881 trunc from 0xe6dfbfa to 0xe03431e 2024-09-21T15:10:27.137 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.126+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:10:27.137 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.126+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:10:27.141 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.130+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:10:27.141 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.134+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:10:27.144 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.134+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:10:27.144 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.134+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:10:27.144 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.134+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:10:27.144 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.134+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:10:27.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.134+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:10:27.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.134+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:10:27.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.134+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:10:27.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.134+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:10:27.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.134+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fa750 2024-09-21T15:10:27.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.134+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:10:27.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.134+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb56c0 2024-09-21T15:10:27.153 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.138+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:10:27.153 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.138+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:10:27.153 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.138+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:10:27.153 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.138+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:10:27.153 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.138+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:10:27.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.138+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:10:27.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.138+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:10:27.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.138+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:10:27.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:10:27.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76820 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe5b0 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d84e0 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:10:27.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:10:27.163 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:10:27.163 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:27.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:10:27.163 INFO:teuthology.orchestra.run.smithi161.stdout:5683 punch from 0x761cdd0 to 0x761fc2e, (0x2e5e bytes) 2024-09-21T15:10:27.170 INFO:teuthology.orchestra.run.smithi161.stdout:5684 trunc from 0x77ed112 to 0xebb917c 2024-09-21T15:10:27.197 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.190+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566000 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:10:27.197 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.190+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566000 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:10:27.197 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.190+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566000 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:10:27.198 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.194+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566000 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:10:27.198 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.194+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a2566000 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:10:27.199 INFO:teuthology.orchestra.run.smithi161.stdout:5362 read 0x139c02e thru 0x13a044b (0x441e bytes) 2024-09-21T15:10:27.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.222+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e780 [3/8025792e-3904-4159-9de2-729ebbf24852] start: already running 2024-09-21T15:10:27.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.222+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e780 [3/8025792e-3904-4159-9de2-729ebbf24852] start: already running 2024-09-21T15:10:27.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.222+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e780 [3/8025792e-3904-4159-9de2-729ebbf24852] start: already running 2024-09-21T15:10:27.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.222+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e780 [3/8025792e-3904-4159-9de2-729ebbf24852] start: already running 2024-09-21T15:10:27.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.222+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e280 [3/7a09179e-ea78-49c4-ab31-16f3fb8ff4df] start: already running 2024-09-21T15:10:27.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.222+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e280 [3/7a09179e-ea78-49c4-ab31-16f3fb8ff4df] start: already running 2024-09-21T15:10:27.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.222+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e280 [3/7a09179e-ea78-49c4-ab31-16f3fb8ff4df] start: already running 2024-09-21T15:10:27.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.222+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e280 [3/7a09179e-ea78-49c4-ab31-16f3fb8ff4df] start: already running 2024-09-21T15:10:27.243 INFO:teuthology.orchestra.run.smithi161.stdout:5685 writesame 0x488c979 thru 0x4895fd3 data_size 0x1(0x965b bytes) 2024-09-21T15:10:27.255 INFO:teuthology.orchestra.run.smithi161.stdout:5882 trunc from 0xe03431e to 0xd4f113f 2024-09-21T15:10:27.259 INFO:teuthology.orchestra.run.smithi161.stdout:5716 writesame 0x11c5db7 thru 0x11d1cbf data_size 0x1(0xbf09 bytes) 2024-09-21T15:10:27.306 INFO:teuthology.orchestra.run.smithi161.stdout:5688 write 0x7fd901 thru 0x7ff0d1 (0x17d1 bytes) 2024-09-21T15:10:27.308 INFO:teuthology.orchestra.run.smithi161.stdout:5364 writesame 0x5b022a5 thru 0x5b0e7e4 data_size 0x60(0xc540 bytes) 2024-09-21T15:10:27.310 INFO:teuthology.orchestra.run.smithi161.stdout:5884 write 0x848efbf thru 0x84995f2 (0xa634 bytes) 2024-09-21T15:10:27.320 INFO:teuthology.orchestra.run.smithi161.stdout:5365 writesame 0x15c2137 thru 0x15d0e7c data_size 0x79(0xed46 bytes) 2024-09-21T15:10:27.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.314+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f59f008a00 [3/5d24c14f-898d-40de-9618-1f90e4165f5d] start: already running 2024-09-21T15:10:27.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.314+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f59f008a00 [3/5d24c14f-898d-40de-9618-1f90e4165f5d] start: already running 2024-09-21T15:10:27.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.314+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f59f008a00 [3/5d24c14f-898d-40de-9618-1f90e4165f5d] start: already running 2024-09-21T15:10:27.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.314+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f59f008a00 [3/5d24c14f-898d-40de-9618-1f90e4165f5d] start: already running 2024-09-21T15:10:27.343 INFO:teuthology.orchestra.run.smithi161.stdout:5885 flatten 2024-09-21T15:10:27.349 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:27.366 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #45, image image_cluster1.client.mirror.3-clone45 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent46 2024-09-21T15:10:27.366 INFO:teuthology.orchestra.run.smithi161.stdout:5694 trunc from 0xebb917c to 0x35e4afc 2024-09-21T15:10:27.367 INFO:teuthology.orchestra.run.smithi161.stdout:5717 punch from 0x31796d9 to 0x3185f20, (0xc847 bytes) 2024-09-21T15:10:27.367 INFO:teuthology.orchestra.run.smithi161.stdout:5719 writesame 0x995207a thru 0x995a70e data_size 0x1(0x8695 bytes) 2024-09-21T15:10:27.412 INFO:teuthology.orchestra.run.smithi161.stdout:5720 writesame 0xb9b557d thru 0xb9c271e data_size 0x1(0xd1a2 bytes) 2024-09-21T15:10:27.443 INFO:teuthology.orchestra.run.smithi161.stdout:5368 write 0x890e124 thru 0x891d97e (0xf85b bytes) 2024-09-21T15:10:27.448 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.442+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7680 [3/533f49cb-9e85-487d-a73d-6b891eb8fdc6] start: already running 2024-09-21T15:10:27.448 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.442+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7680 [3/533f49cb-9e85-487d-a73d-6b891eb8fdc6] start: already running 2024-09-21T15:10:27.448 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.442+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7680 [3/533f49cb-9e85-487d-a73d-6b891eb8fdc6] start: already running 2024-09-21T15:10:27.448 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.442+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f59f6b7680 [3/533f49cb-9e85-487d-a73d-6b891eb8fdc6] start: already running 2024-09-21T15:10:27.483 INFO:teuthology.orchestra.run.smithi161.stdout:5721 write 0x42be369 thru 0x42c7d41 (0x99d9 bytes) 2024-09-21T15:10:27.487 INFO:teuthology.orchestra.run.smithi161.stdout:5369 trunc from 0x891d97f to 0x221e6b5 2024-09-21T15:10:27.500 INFO:teuthology.orchestra.run.smithi161.stdout:4386 read 0x2d4e705 thru 0x2d5ac3d (0xc539 bytes) 2024-09-21T15:10:27.504 INFO:teuthology.orchestra.run.smithi161.stdout:5886 trunc from 0xd4f113f to 0x365b646 2024-09-21T15:10:27.506 INFO:teuthology.orchestra.run.smithi161.stdout:5722 write 0x7aae422 thru 0x7abd1e1 (0xedc0 bytes) 2024-09-21T15:10:27.531 INFO:teuthology.orchestra.run.smithi161.stdout:5723 punch from 0x6be6354 to 0x6bf5d27, (0xf9d3 bytes) 2024-09-21T15:10:27.531 INFO:teuthology.orchestra.run.smithi161.stdout:5725 read 0x3571f20 thru 0x35720ff (0x1e0 bytes) 2024-09-21T15:10:27.531 INFO:teuthology.orchestra.run.smithi161.stdout:5726 write 0x2b99a1d thru 0x2ba7e30 (0xe414 bytes) 2024-09-21T15:10:27.542 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.538+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a498a280 [3/af962aab-237c-497b-989c-5a6f03523f73] start: already running 2024-09-21T15:10:27.552 INFO:teuthology.orchestra.run.smithi161.stdout:5696 write 0x88556d2 thru 0x88605ab (0xaeda bytes) 2024-09-21T15:10:27.592 INFO:teuthology.orchestra.run.smithi161.stdout:5727 trunc from 0xbf633b5 to 0x92c0cbc 2024-09-21T15:10:27.603 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:27.603 INFO:teuthology.orchestra.run.smithi161.stdout:5889 write 0x10e17ff thru 0x10e578f (0x3f91 bytes) 2024-09-21T15:10:27.610 INFO:teuthology.orchestra.run.smithi161.stdout:4387 write 0xd842b4a thru 0xd84425d (0x1714 bytes) 2024-09-21T15:10:27.620 INFO:teuthology.orchestra.run.smithi161.stdout:5890 read 0x3625168 thru 0x3625641 (0x4da bytes) 2024-09-21T15:10:27.622 INFO:teuthology.orchestra.run.smithi161.stdout:5891 read 0x20a721b thru 0x20ade6b (0x6c51 bytes) 2024-09-21T15:10:27.622 INFO:teuthology.orchestra.run.smithi161.stdout:5892 read 0xaedc43 thru 0xaf2d4d (0x510b bytes) 2024-09-21T15:10:27.633 INFO:teuthology.orchestra.run.smithi161.stdout:4388 write 0xbd32ddf thru 0xbd3f516 (0xc738 bytes) 2024-09-21T15:10:27.642 INFO:teuthology.orchestra.run.smithi161.stdout:5893 trunc from 0x365b646 to 0xa181608 2024-09-21T15:10:27.643 INFO:teuthology.orchestra.run.smithi161.stdout:5697 write 0xc76804d thru 0xc76dcb3 (0x5c67 bytes) 2024-09-21T15:10:27.706 INFO:teuthology.orchestra.run.smithi161.stdout:4391 write 0x62d0892 thru 0x62d296d (0x20dc bytes) 2024-09-21T15:10:27.727 INFO:teuthology.orchestra.run.smithi161.stdout:5895 punch from 0x9611c95 to 0x961d1b1, (0xb51c bytes) 2024-09-21T15:10:27.727 INFO:teuthology.orchestra.run.smithi161.stdout:5896 read 0x29a0128 thru 0x29a9831 (0x970a bytes) 2024-09-21T15:10:27.727 INFO:teuthology.orchestra.run.smithi161.stdout:5897 read 0x882cb15 thru 0x882e200 (0x16ec bytes) 2024-09-21T15:10:27.728 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:27.728 INFO:teuthology.orchestra.run.smithi161.stdout:5901 read 0x887cb2a thru 0x887cd93 (0x26a bytes) 2024-09-21T15:10:27.728 INFO:teuthology.orchestra.run.smithi161.stdout:5903 read 0x12d0912 thru 0x12da1cb (0x98ba bytes) 2024-09-21T15:10:27.728 INFO:teuthology.orchestra.run.smithi161.stdout:5371 write 0xb232874 thru 0xb23e8e1 (0xc06e bytes) 2024-09-21T15:10:27.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.722+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e500 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] start: already running 2024-09-21T15:10:27.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.722+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e500 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] start: already running 2024-09-21T15:10:27.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.722+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e500 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] start: already running 2024-09-21T15:10:27.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.722+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9e500 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] start: already running 2024-09-21T15:10:27.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.722+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4a00 [3/6af429ba-f735-4db2-8ce0-990e9e419129] start: already running 2024-09-21T15:10:27.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.722+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4a00 [3/6af429ba-f735-4db2-8ce0-990e9e419129] start: already running 2024-09-21T15:10:27.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.722+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4a00 [3/6af429ba-f735-4db2-8ce0-990e9e419129] start: already running 2024-09-21T15:10:27.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.722+0000 7f481109a700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4a00 [3/6af429ba-f735-4db2-8ce0-990e9e419129] start: already running 2024-09-21T15:10:27.734 INFO:teuthology.orchestra.run.smithi161.stdout:5729 writesame 0x46fef4e thru 0x4707f82 data_size 0x13(0x9035 bytes) 2024-09-21T15:10:27.738 INFO:teuthology.orchestra.run.smithi161.stdout:5905 read 0x33cf750 thru 0x33d7ae2 (0x8393 bytes) 2024-09-21T15:10:27.738 INFO:teuthology.orchestra.run.smithi161.stdout:5906 punch from 0x4817f64 to 0x4826f47, (0xefe3 bytes) 2024-09-21T15:10:27.739 INFO:teuthology.orchestra.run.smithi161.stdout:5907 read 0x7cae0dc thru 0x7cb2269 (0x418e bytes) 2024-09-21T15:10:27.739 INFO:teuthology.orchestra.run.smithi161.stdout:5908 punch from 0x8f5ae84 to 0x8f66b69, (0xbce5 bytes) 2024-09-21T15:10:27.740 INFO:teuthology.orchestra.run.smithi161.stdout:5909 trunc from 0xa181608 to 0xababa54 2024-09-21T15:10:27.742 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:27.738+0000 7f4810899700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a8b52700 get_replay_status: replay not running 2024-09-21T15:10:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:4392 punch from 0xa9eb174 to 0xa9ef05c, (0x3ee8 bytes) 2024-09-21T15:10:27.781 INFO:teuthology.orchestra.run.smithi161.stdout:5698 writesame 0xdac36db thru 0xdad31c7 data_size 0x1(0xfaed bytes) 2024-09-21T15:10:27.784 INFO:teuthology.orchestra.run.smithi161.stdout:4393 trunc from 0xd84425e to 0x2bfc4be 2024-09-21T15:10:27.791 INFO:teuthology.orchestra.run.smithi161.stdout:5373 trunc from 0xb23e8e2 to 0x1732ae9 2024-09-21T15:10:27.791 INFO:teuthology.orchestra.run.smithi161.stdout:5699 write 0x816bf24 thru 0x817b3dd (0xf4ba bytes) 2024-09-21T15:10:27.828 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95a410 2024-09-21T15:10:27.829 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:10:27.829 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636a946e680 2024-09-21T15:10:27.829 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9636750 2024-09-21T15:10:27.829 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:10:27.829 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:10:27.829 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7148b60 2024-09-21T15:10:27.829 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7149040 2024-09-21T15:10:27.831 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:10:27.831 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e000 2024-09-21T15:10:27.831 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:10:27.831 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e5b0 2024-09-21T15:10:27.831 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1fa00 2024-09-21T15:10:27.831 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:10:27.831 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636bfcda410 2024-09-21T15:10:27.831 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636bfcdb110 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636bfcdb6c0 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbaea0 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc49c0 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f880d0 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636c1522dd0 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636c28b8f70 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45041a0 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504680 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45052b0 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5520 2024-09-21T15:10:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:10:27.833 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.826+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:10:27.833 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54410 2024-09-21T15:10:27.833 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:10:27.833 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690410 2024-09-21T15:10:27.833 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:10:27.833 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:10:27.834 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690dd0 2024-09-21T15:10:27.834 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:10:27.834 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ad0 2024-09-21T15:10:27.834 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:27.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:10:27.841 INFO:teuthology.orchestra.run.smithi161.stdout:5910 trunc from 0xababa54 to 0x6b11143 2024-09-21T15:10:27.848 INFO:teuthology.orchestra.run.smithi161.stdout:5700 punch from 0x10159c7 to 0x1018f7f, (0x35b8 bytes) 2024-09-21T15:10:27.849 INFO:teuthology.orchestra.run.smithi161.stdout:5702 read 0xc4841cf thru 0xc48d45d (0x928f bytes) 2024-09-21T15:10:27.849 INFO:teuthology.orchestra.run.smithi161.stdout:5703 read 0xd823c1d thru 0xd827614 (0x39f8 bytes) 2024-09-21T15:10:27.849 INFO:teuthology.orchestra.run.smithi161.stdout:5708 writesame 0x439705 thru 0x43a717 data_size 0x1(0x1013 bytes) 2024-09-21T15:10:27.884 INFO:teuthology.orchestra.run.smithi161.stdout:5730 write 0xd59a094 thru 0xd59bd28 (0x1c95 bytes) 2024-09-21T15:10:27.888 INFO:teuthology.orchestra.run.smithi161.stdout:5912 write 0x3de5e39 thru 0x3df3c40 (0xde08 bytes) 2024-09-21T15:10:27.897 INFO:teuthology.orchestra.run.smithi161.stdout:5709 read 0x864b065 thru 0x8653497 (0x8433 bytes) 2024-09-21T15:10:27.909 INFO:teuthology.orchestra.run.smithi161.stdout:5733 punch from 0xb270291 to 0xb27c9dd, (0xc74c bytes) 2024-09-21T15:10:27.909 INFO:teuthology.orchestra.run.smithi161.stdout:5913 read 0x1057d58 thru 0x10598c3 (0x1b6c bytes) 2024-09-21T15:10:27.910 INFO:teuthology.orchestra.run.smithi161.stdout:5735 read 0x9ac2921 thru 0x9ad06af (0xdd8f bytes) 2024-09-21T15:10:27.911 INFO:teuthology.orchestra.run.smithi161.stdout:5737 read 0xa390d41 thru 0xa39d45b (0xc71b bytes) 2024-09-21T15:10:27.911 INFO:teuthology.orchestra.run.smithi161.stdout:5738 read 0x2638052 thru 0x2647df2 (0xfda1 bytes) 2024-09-21T15:10:27.913 INFO:teuthology.orchestra.run.smithi161.stdout:5739 writesame 0xd12338f thru 0xd132e1a data_size 0x1e(0xfa8c bytes) 2024-09-21T15:10:27.919 INFO:teuthology.orchestra.run.smithi161.stdout:5914 trunc from 0x6b11143 to 0x9ceb242 2024-09-21T15:10:27.922 INFO:teuthology.orchestra.run.smithi161.stdout:5710 trunc from 0xdad31c8 to 0x2d840dd 2024-09-21T15:10:27.922 INFO:teuthology.orchestra.run.smithi161.stdout:5374 punch from 0x1252d6e to 0x125416d, (0x13ff bytes) 2024-09-21T15:10:27.934 INFO:teuthology.orchestra.run.smithi161.stdout:5740 write 0x8cf73e1 thru 0x8cf78d2 (0x4f2 bytes) 2024-09-21T15:10:27.946 INFO:teuthology.orchestra.run.smithi161.stdout:5741 punch from 0x12e021a to 0x12e0e5a, (0xc40 bytes) 2024-09-21T15:10:27.946 INFO:teuthology.orchestra.run.smithi161.stdout:5742 write 0x505557 thru 0x50916b (0x3c15 bytes) 2024-09-21T15:10:27.947 INFO:teuthology.orchestra.run.smithi161.stdout:4395 read 0x2461d23 thru 0x2463267 (0x1545 bytes) 2024-09-21T15:10:27.993 INFO:teuthology.orchestra.run.smithi161.stdout:5744 read 0x2f3f46c thru 0x2f3fadd (0x672 bytes) 2024-09-21T15:10:27.993 INFO:teuthology.orchestra.run.smithi161.stdout:5745 punch from 0x7791e14 to 0x7798e72, (0x705e bytes) 2024-09-21T15:10:27.993 INFO:teuthology.orchestra.run.smithi161.stdout:5746 write 0xca25497 thru 0xca31d96 (0xc900 bytes) 2024-09-21T15:10:28.003 INFO:teuthology.orchestra.run.smithi161.stdout:5915 read 0x533bcb0 thru 0x5348c37 (0xcf88 bytes) 2024-09-21T15:10:28.003 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.003 INFO:teuthology.orchestra.run.smithi161.stdout:5918 read 0x1f87cb4 thru 0x1f8bfdd (0x432a bytes) 2024-09-21T15:10:28.003 INFO:teuthology.orchestra.run.smithi161.stdout:5919 punch from 0x2021dc4 to 0x202e49f, (0xc6db bytes) 2024-09-21T15:10:28.006 INFO:teuthology.orchestra.run.smithi161.stdout:5921 trunc from 0x9ceb242 to 0xc05c314 2024-09-21T15:10:28.007 INFO:teuthology.orchestra.run.smithi161.stdout:4396 write 0x4184643 thru 0x41939a5 (0xf363 bytes) 2024-09-21T15:10:28.013 INFO:teuthology.orchestra.run.smithi161.stdout:5375 write 0xda01131 thru 0xda06a99 (0x5969 bytes) 2024-09-21T15:10:28.022 INFO:teuthology.orchestra.run.smithi161.stdout:5748 write 0x6aa5005 thru 0x6aaa969 (0x5965 bytes) 2024-09-21T15:10:28.047 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.047 INFO:teuthology.orchestra.run.smithi161.stdout:5751 punch from 0xc2ab4b5 to 0xc2ba761, (0xf2ac bytes) 2024-09-21T15:10:28.048 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.048 INFO:teuthology.orchestra.run.smithi161.stdout:5752 read 0x1f92938 thru 0x1fa09dd (0xe0a6 bytes) 2024-09-21T15:10:28.051 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.051 INFO:teuthology.orchestra.run.smithi161.stdout:5755 writesame 0xa80197b thru 0xa803135 data_size 0x2d(0x17bb bytes) 2024-09-21T15:10:28.057 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.054+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab156c0 2024-09-21T15:10:28.064 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.062+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:28.066 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.062+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49e10 2024-09-21T15:10:28.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.066+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4c80 [3/6c3b3b70-9cbd-4de9-9ecc-2955d67c515d] start: already running 2024-09-21T15:10:28.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.066+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4c80 [3/6c3b3b70-9cbd-4de9-9ecc-2955d67c515d] start: already running 2024-09-21T15:10:28.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.066+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4c80 [3/6c3b3b70-9cbd-4de9-9ecc-2955d67c515d] start: already running 2024-09-21T15:10:28.072 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.066+0000 7f4810899700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c4c80 [3/6c3b3b70-9cbd-4de9-9ecc-2955d67c515d] start: already running 2024-09-21T15:10:28.074 INFO:teuthology.orchestra.run.smithi161.stdout:5756 writesame 0x355ab90 thru 0x35693d9 data_size 0x9f(0xe84a bytes) 2024-09-21T15:10:28.075 INFO:teuthology.orchestra.run.smithi161.stdout:5922 punch from 0x576e141 to 0x577a16e, (0xc02d bytes) 2024-09-21T15:10:28.076 INFO:teuthology.orchestra.run.smithi161.stdout:5923 write 0x29a2157 thru 0x29aae73 (0x8d1d bytes) 2024-09-21T15:10:28.090 INFO:teuthology.orchestra.run.smithi161.stdout:5757 read 0x1dcfe2d thru 0x1dde0f6 (0xe2ca bytes) 2024-09-21T15:10:28.099 INFO:teuthology.orchestra.run.smithi161.stdout:5925 trunc from 0xc05c314 to 0x9afaae3 2024-09-21T15:10:28.107 INFO:teuthology.orchestra.run.smithi161.stdout:4398 write 0x8078fa1 thru 0x8081081 (0x80e1 bytes) 2024-09-21T15:10:28.111 INFO:teuthology.orchestra.run.smithi161.stdout:5711 write 0x65af52a thru 0x65b5424 (0x5efb bytes) 2024-09-21T15:10:28.116 INFO:teuthology.orchestra.run.smithi161.stdout:5758 trunc from 0xd59bd29 to 0xcbbe33 2024-09-21T15:10:28.128 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.126+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab156c0 2024-09-21T15:10:28.130 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.126+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:28.130 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.126+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49e10 2024-09-21T15:10:28.134 INFO:teuthology.orchestra.run.smithi161.stdout:5376 writesame 0xddec71e thru 0xdded097 data_size 0x1(0x97a bytes) 2024-09-21T15:10:28.146 INFO:teuthology.orchestra.run.smithi161.stdout:5378 read 0x6b58741 thru 0x6b5c2fc (0x3bbc bytes) 2024-09-21T15:10:28.146 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.146 INFO:teuthology.orchestra.run.smithi161.stdout:5381 write 0x295f339 thru 0x2968201 (0x8ec9 bytes) 2024-09-21T15:10:28.150 INFO:teuthology.orchestra.run.smithi161.stdout:4399 trunc from 0x8081082 to 0xaaaffa5 2024-09-21T15:10:28.184 INFO:teuthology.orchestra.run.smithi161.stdout:5712 read 0x4afd977 thru 0x4b02908 (0x4f92 bytes) 2024-09-21T15:10:28.184 INFO:teuthology.orchestra.run.smithi161.stdout:5713 punch from 0x30ad7f9 to 0x30b5219, (0x7a20 bytes) 2024-09-21T15:10:28.184 INFO:teuthology.orchestra.run.smithi161.stdout:5714 read 0x58e0a2b thru 0x58edbd5 (0xd1ab bytes) 2024-09-21T15:10:28.184 INFO:teuthology.orchestra.run.smithi161.stdout:5715 read 0x2b527c9 thru 0x2b53b60 (0x1398 bytes) 2024-09-21T15:10:28.195 INFO:teuthology.orchestra.run.smithi161.stdout:5382 read 0x2ca65f thru 0x2cf1e9 (0x4b8b bytes) 2024-09-21T15:10:28.196 INFO:teuthology.orchestra.run.smithi161.stdout:5386 read 0x4b85612 thru 0x4b86710 (0x10ff bytes) 2024-09-21T15:10:28.196 INFO:teuthology.orchestra.run.smithi161.stdout:5716 clone 38 order 22 su 131072 sc 14 2024-09-21T15:10:28.197 INFO:teuthology.orchestra.run.smithi161.stdout:5389 writesame 0x512e58a thru 0x51371a3 data_size 0x4f(0x8c1a bytes) 2024-09-21T15:10:28.209 INFO:teuthology.orchestra.run.smithi161.stdout:5926 read 0x4125e17 thru 0x4131e2c (0xc016 bytes) 2024-09-21T15:10:28.209 INFO:teuthology.orchestra.run.smithi161.stdout:5927 read 0x8f070f9 thru 0x8f13134 (0xc03c bytes) 2024-09-21T15:10:28.209 INFO:teuthology.orchestra.run.smithi161.stdout:5928 read 0x53bdc45 thru 0x53cb683 (0xda3f bytes) 2024-09-21T15:10:28.213 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.202+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab156c0 2024-09-21T15:10:28.213 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.206+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18cea0 2024-09-21T15:10:28.215 INFO:teuthology.orchestra.run.smithi161.stdout:5930 trunc from 0x9afaae3 to 0x53e319b 2024-09-21T15:10:28.216 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2344e0 2024-09-21T15:10:28.217 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.214+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235ba0 2024-09-21T15:10:28.224 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.218+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:28.224 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.218+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49e10 2024-09-21T15:10:28.224 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.218+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877450 2024-09-21T15:10:28.225 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.218+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8776c0 2024-09-21T15:10:28.225 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.218+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877ba0 2024-09-21T15:10:28.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.222+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:10:28.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.222+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:10:28.226 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.222+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:10:28.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.226+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:10:28.234 INFO:teuthology.orchestra.run.smithi161.stdout:4400 punch from 0x6219acc to 0x621eed8, (0x540c bytes) 2024-09-21T15:10:28.234 INFO:teuthology.orchestra.run.smithi161.stdout:4402 read 0x38bc53f thru 0x38c4287 (0x7d49 bytes) 2024-09-21T15:10:28.234 INFO:teuthology.orchestra.run.smithi161.stdout:4403 write 0x75d6da9 thru 0x75e1c78 (0xaed0 bytes) 2024-09-21T15:10:28.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.230+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:10:28.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.230+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:10:28.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.230+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:10:28.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.230+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:10:28.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.230+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:10:28.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.238+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:10:28.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.242+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:10:28.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.242+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:10:28.250 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.246+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:10:28.251 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.246+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:10:28.251 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.246+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:10:28.258 INFO:teuthology.orchestra.run.smithi161.stdout:5391 clone 30 order 18 su 16384 sc 15 2024-09-21T15:10:28.267 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.262+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:10:28.268 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.262+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:10:28.268 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.262+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:10:28.268 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.262+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:10:28.268 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.262+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:10:28.268 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.262+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:10:28.268 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.262+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:10:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:10:28.274 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:10:28.274 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016f1629c0 2024-09-21T15:10:28.274 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:10:28.274 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:10:28.274 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:10:28.275 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:10:28.275 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:10:28.275 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:10:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:10:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:10:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:10:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:10:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:10:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:10:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.266+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:10:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:10:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:10:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99860 2024-09-21T15:10:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:10:28.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56016feb4270 2024-09-21T15:10:28.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:10:28.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:10:28.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:10:28.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:10:28.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:10:28.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:10:28.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:10:28.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:10:28.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:10:28.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x560171d000d0 2024-09-21T15:10:28.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:10:28.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:10:28.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:10:28.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:10:28.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:10:28.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:10:28.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:10:28.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:28.270+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:10:28.318 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.318 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.318 INFO:teuthology.orchestra.run.smithi161.stdout:5933 punch from 0x4c687d7 to 0x4c76331, (0xdb5a bytes) 2024-09-21T15:10:28.318 INFO:teuthology.orchestra.run.smithi161.stdout:5935 read 0x4860372 thru 0x48640a4 (0x3d33 bytes) 2024-09-21T15:10:28.318 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.318 INFO:teuthology.orchestra.run.smithi161.stdout:5937 read 0x1963dcd thru 0x196aef1 (0x7125 bytes) 2024-09-21T15:10:28.318 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.327 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone40 from 0x23efa9d (overlap 0x134dc47) to 0xf7169f 2024-09-21T15:10:28.334 INFO:teuthology.orchestra.run.smithi161.stdout:5940 trunc from 0x53e319b to 0xc2b53c5 2024-09-21T15:10:28.353 INFO:teuthology.orchestra.run.smithi161.stdout:4405 write 0xd18c65d thru 0xd195baa (0x954e bytes) 2024-09-21T15:10:28.400 INFO:teuthology.orchestra.run.smithi161.stdout:5941 punch from 0x1426bee to 0x142901c, (0x242e bytes) 2024-09-21T15:10:28.400 INFO:teuthology.orchestra.run.smithi161.stdout:5942 write 0x8c3f838 thru 0x8c4497a (0x5143 bytes) 2024-09-21T15:10:28.424 INFO:teuthology.orchestra.run.smithi161.stdout:5943 read 0x925b43 thru 0x9344da (0xe998 bytes) 2024-09-21T15:10:28.427 INFO:teuthology.orchestra.run.smithi161.stdout:5944 write 0xb4ea652 thru 0xb4ed51d (0x2ecc bytes) 2024-09-21T15:10:28.433 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.430+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab156c0 2024-09-21T15:10:28.434 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:28.430+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49e10 2024-09-21T15:10:28.443 INFO:teuthology.orchestra.run.smithi161.stdout:4406 write 0xe418b1c thru 0xe4222eb (0x97d0 bytes) 2024-09-21T15:10:28.448 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.448 INFO:teuthology.orchestra.run.smithi161.stdout:5947 write 0x2db9f9d thru 0x2dbba4e (0x1ab2 bytes) 2024-09-21T15:10:28.528 INFO:teuthology.orchestra.run.smithi161.stdout:5948 read 0x8d3cbaf thru 0x8d44d89 (0x81db bytes) 2024-09-21T15:10:28.543 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.543 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.543 INFO:teuthology.orchestra.run.smithi161.stdout:4409 read 0x56ae1f5 thru 0x56b7bf6 (0x9a02 bytes) 2024-09-21T15:10:28.543 INFO:teuthology.orchestra.run.smithi161.stdout:4410 read 0xa1643a2 thru 0xa166cb6 (0x2915 bytes) 2024-09-21T15:10:28.544 INFO:teuthology.orchestra.run.smithi161.stdout:4412 read 0x4a147a thru 0x4acb82 (0xb709 bytes) 2024-09-21T15:10:28.553 INFO:teuthology.orchestra.run.smithi161.stdout:4413 trunc from 0xe4222ec to 0xcd56171 2024-09-21T15:10:28.562 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.558+0000 7f481109a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f59f5be700 get_replay_status: replay not running 2024-09-21T15:10:28.563 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.558+0000 7f481109a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a9ed0700 get_replay_status: replay not running 2024-09-21T15:10:28.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.614+0000 7f481109a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a71bbc00 get_replay_status: replay not running 2024-09-21T15:10:28.619 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.614+0000 7f481109a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f59eda9880 get_replay_status: replay not running 2024-09-21T15:10:28.657 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.662 INFO:teuthology.orchestra.run.smithi161.stdout:4415 trunc from 0xcd56171 to 0x46bdd05 2024-09-21T15:10:28.698 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.694+0000 7f4810899700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a6676380 get_replay_status: replay not running 2024-09-21T15:10:28.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.722+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a49b6280 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:10:28.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.730+0000 7f4810899700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a6677180 get_replay_status: replay not running 2024-09-21T15:10:28.809 INFO:teuthology.orchestra.run.smithi161.stdout:4416 trunc from 0x46bdd05 to 0xca7bbc0 2024-09-21T15:10:28.836 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.830+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a49b6780 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:10:28.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.830+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9fb80 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:10:28.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.830+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9fb80 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:10:28.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.830+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9fb80 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:10:28.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.830+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9fb80 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:10:28.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.830+0000 7f480387f700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9fb80 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:10:28.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.830+0000 7f481109a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a4602700 get_replay_status: replay not running 2024-09-21T15:10:28.859 INFO:teuthology.orchestra.run.smithi161.stdout:5950 write 0xdd9c4fe thru 0xdda11d6 (0x4cd9 bytes) 2024-09-21T15:10:28.863 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.858+0000 7f481109a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5ace88a80 get_replay_status: replay not running 2024-09-21T15:10:28.863 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.858+0000 7f481109a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a66f6000 get_replay_status: replay not running 2024-09-21T15:10:28.863 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.858+0000 7f481109a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a32cf500 get_replay_status: replay not running 2024-09-21T15:10:28.863 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.858+0000 7f4810899700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a799ea80 get_replay_status: replay not running 2024-09-21T15:10:28.864 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.858+0000 7f481109a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a32ce700 get_replay_status: replay not running 2024-09-21T15:10:28.864 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.858+0000 7f4810899700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a79a8e00 get_replay_status: replay not running 2024-09-21T15:10:28.872 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.866+0000 7f481109a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f59ec68380 get_replay_status: replay not running 2024-09-21T15:10:28.886 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.882+0000 7f4810899700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a6370e00 get_replay_status: replay not running 2024-09-21T15:10:28.907 INFO:teuthology.orchestra.run.smithi161.stdout:4417 write 0x21dcea1 thru 0x21eae37 (0xdf97 bytes) 2024-09-21T15:10:28.908 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:28.902+0000 7f4810899700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a82d2380 get_replay_status: replay not running 2024-09-21T15:10:28.961 INFO:teuthology.orchestra.run.smithi161.stdout:5951 read 0x7644db7 thru 0x764596d (0xbb7 bytes) 2024-09-21T15:10:28.961 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:28.978 INFO:teuthology.orchestra.run.smithi161.stdout:5955 trunc from 0xdda11d7 to 0x34a174e 2024-09-21T15:10:29.019 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.014+0000 7f481109a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a71bae00 get_replay_status: replay not running 2024-09-21T15:10:29.022 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.018+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd4c80 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:10:29.022 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.018+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd4c80 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:10:29.022 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.018+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd4c80 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:10:29.022 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.018+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd4c80 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:10:29.022 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.018+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f59fbd4c80 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:10:29.035 INFO:teuthology.orchestra.run.smithi161.stdout:4418 write 0x401aaa6 thru 0x4022027 (0x7582 bytes) 2024-09-21T15:10:29.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a05e8000 [3/55c2a1c2-e5de-4bcb-8d07-45955fdc4e18] start: already running 2024-09-21T15:10:29.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a05e8000 [3/55c2a1c2-e5de-4bcb-8d07-45955fdc4e18] start: already running 2024-09-21T15:10:29.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a05e8000 [3/55c2a1c2-e5de-4bcb-8d07-45955fdc4e18] start: already running 2024-09-21T15:10:29.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a05e8000 [3/55c2a1c2-e5de-4bcb-8d07-45955fdc4e18] start: already running 2024-09-21T15:10:29.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f680 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:10:29.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f680 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:10:29.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f680 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:10:29.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f680 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:10:29.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2f9f680 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:10:29.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797b80 [3/33006863-7504-40fd-b7bf-bdaf3c7c6daa] start: already running 2024-09-21T15:10:29.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797b80 [3/33006863-7504-40fd-b7bf-bdaf3c7c6daa] start: already running 2024-09-21T15:10:29.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797b80 [3/33006863-7504-40fd-b7bf-bdaf3c7c6daa] start: already running 2024-09-21T15:10:29.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797b80 [3/33006863-7504-40fd-b7bf-bdaf3c7c6daa] start: already running 2024-09-21T15:10:29.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.074+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a2797b80 [3/33006863-7504-40fd-b7bf-bdaf3c7c6daa] start: already running 2024-09-21T15:10:29.088 INFO:teuthology.orchestra.run.smithi161.stdout:4419 writesame 0x4cff78e thru 0x4d0291c data_size 0x1(0x318f bytes) 2024-09-21T15:10:29.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.106+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5900 [3/73b4e1fe-3f10-4db7-b803-aa7461633260] start: already running 2024-09-21T15:10:29.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.106+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5900 [3/73b4e1fe-3f10-4db7-b803-aa7461633260] start: already running 2024-09-21T15:10:29.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.106+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5900 [3/73b4e1fe-3f10-4db7-b803-aa7461633260] start: already running 2024-09-21T15:10:29.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.106+0000 7f4804080700 -1 rbd::mirror::ImageReplayer: 0x55f5a29c5900 [3/73b4e1fe-3f10-4db7-b803-aa7461633260] start: already running 2024-09-21T15:10:29.121 INFO:teuthology.orchestra.run.smithi161.stdout:4421 trunc from 0xca7bbc0 to 0x887116b 2024-09-21T15:10:29.163 INFO:teuthology.orchestra.run.smithi161.stdout:4423 read 0x15fb8b5 thru 0x15fe4e9 (0x2c35 bytes) 2024-09-21T15:10:29.164 INFO:teuthology.orchestra.run.smithi161.stdout:4424 read 0x830d480 thru 0x8310c1c (0x379d bytes) 2024-09-21T15:10:29.164 INFO:teuthology.orchestra.run.smithi161.stdout:4425 write 0x57ead13 thru 0x57eb89c (0xb8a bytes) 2024-09-21T15:10:29.184 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:29.191 INFO:teuthology.orchestra.run.smithi161.stdout:4429 trunc from 0x887116b to 0x41fcf3e 2024-09-21T15:10:29.208 INFO:teuthology.orchestra.run.smithi161.stdout:5956 write 0xd4b037e thru 0xd4bf410 (0xf093 bytes) 2024-09-21T15:10:29.248 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:29.248 INFO:teuthology.orchestra.run.smithi161.stdout:5958 read 0xba8a1ba thru 0xba958a8 (0xb6ef bytes) 2024-09-21T15:10:29.248 INFO:teuthology.orchestra.run.smithi161.stdout:5959 write 0x4e18703 thru 0x4e1b6d9 (0x2fd7 bytes) 2024-09-21T15:10:29.251 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #39, image image_cluster1.client.mirror.4-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent40 2024-09-21T15:10:29.260 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:29.254+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab156c0 2024-09-21T15:10:29.260 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:29.258+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49e10 2024-09-21T15:10:29.307 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.290+0000 7f7fd044c700 -1 reset not still connected to 0x56369e619520 2024-09-21T15:10:29.325 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.314+0000 7f7fd044c700 -1 reset not still connected to 0x56369e6196c0 2024-09-21T15:10:29.326 INFO:teuthology.orchestra.run.smithi161.stdout:5759 write 0xe1ae045 thru 0xe1b3b29 (0x5ae5 bytes) 2024-09-21T15:10:29.332 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.322+0000 7f7fd044c700 -1 reset not still connected to 0x56369f5dc000 2024-09-21T15:10:29.332 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.322+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:10:29.332 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.322+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:10:29.332 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.322+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:10:29.332 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.322+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:10:29.333 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.322+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7148b60 2024-09-21T15:10:29.333 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.322+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7149040 2024-09-21T15:10:29.333 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.322+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb9930 2024-09-21T15:10:29.336 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.322+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:10:29.338 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.322+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e000 2024-09-21T15:10:29.338 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.322+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:10:29.338 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.322+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e5b0 2024-09-21T15:10:29.338 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.322+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:10:29.343 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbaea0 2024-09-21T15:10:29.344 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbb2b0 2024-09-21T15:10:29.344 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc40d0 2024-09-21T15:10:29.344 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:10:29.345 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:10:29.345 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4340 2024-09-21T15:10:29.345 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4750 2024-09-21T15:10:29.345 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4f70 2024-09-21T15:10:29.345 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:10:29.345 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:10:29.345 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f880d0 2024-09-21T15:10:29.345 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:10:29.345 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:10:29.345 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:10:29.346 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.342+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:10:29.346 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.342+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:10:29.346 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.342+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:10:29.347 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.342+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45052b0 2024-09-21T15:10:29.347 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.342+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:10:29.347 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.342+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e0d0 2024-09-21T15:10:29.347 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.342+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:10:29.347 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.342+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:10:29.348 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.342+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483edd0 2024-09-21T15:10:29.348 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.342+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:10:29.348 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.342+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:10:29.348 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.342+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb110 2024-09-21T15:10:29.348 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.342+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:10:29.352 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.350+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:10:29.353 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.350+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbba00 2024-09-21T15:10:29.353 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.350+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:10:29.353 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.350+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54410 2024-09-21T15:10:29.353 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.350+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:10:29.353 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.350+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690410 2024-09-21T15:10:29.353 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.350+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:10:29.353 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.350+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:10:29.353 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.350+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:10:29.355 INFO:teuthology.orchestra.run.smithi161.stdout:5960 writesame 0x27fed5e thru 0x2805b08 data_size 0x5(0x6dab bytes) 2024-09-21T15:10:29.355 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.350+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:10:29.355 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.350+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:10:29.358 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:29.354+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:10:29.373 INFO:teuthology.orchestra.run.smithi161.stdout:5962 read 0x329c47c thru 0x32a7e80 (0xba05 bytes) 2024-09-21T15:10:29.373 INFO:teuthology.orchestra.run.smithi161.stdout:5966 read 0x3622abd thru 0x362de55 (0xb399 bytes) 2024-09-21T15:10:29.373 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:29.373 INFO:teuthology.orchestra.run.smithi161.stdout:5968 read 0x186751f thru 0x186951d (0x1fff bytes) 2024-09-21T15:10:29.373 INFO:teuthology.orchestra.run.smithi161.stdout:5969 write 0xd20582d thru 0xd20d1ff (0x79d3 bytes) 2024-09-21T15:10:29.380 INFO:teuthology.orchestra.run.smithi161.stdout:5760 trunc from 0xe1b3b2a to 0x7e83f02 2024-09-21T15:10:29.397 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone37 from 0x65b5425 (overlap 0x2d840dd) to 0x1fdc701 2024-09-21T15:10:29.407 INFO:teuthology.orchestra.run.smithi161.stdout:5970 trunc from 0xd4bf411 to 0x216cc36 2024-09-21T15:10:29.409 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:29.423 INFO:teuthology.orchestra.run.smithi161.stdout:5235 trunc from 0x23efa9d to 0xbbb0469 2024-09-21T15:10:29.447 INFO:teuthology.orchestra.run.smithi161.stdout:4431 write 0xa4c7d42 thru 0xa4cb923 (0x3be2 bytes) 2024-09-21T15:10:29.479 INFO:teuthology.orchestra.run.smithi161.stdout:4432 read 0x4aeee1 thru 0x4b7f51 (0x9071 bytes) 2024-09-21T15:10:29.562 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.558+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a7b110e0 handle_clone_image: failed to clone image mirror/10b4f8bf0758 to image_cluster1.client.mirror.3-clone39 2024-09-21T15:10:29.565 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.562+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a2ba54a0 handle_clone_image: failed to clone image mirror/10b4237f429b to image_cluster1.client.mirror.3-clone47 2024-09-21T15:10:29.597 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #28, image image_cluster1.client.mirror.1-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent29 2024-09-21T15:10:29.617 INFO:teuthology.orchestra.run.smithi161.stdout:4433 write 0xc090c72 thru 0xc09de49 (0xd1d8 bytes) 2024-09-21T15:10:29.634 INFO:teuthology.orchestra.run.smithi161.stdout:5761 punch from 0x4475041 to 0x4477a08, (0x29c7 bytes) 2024-09-21T15:10:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:4434 trunc from 0xc09de4a to 0xaf16658 2024-09-21T15:10:29.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.782+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a0e6b4a0 handle_clone_image: failed to clone image mirror/10b45f98d0cb to image_cluster1.client.mirror.3-clone19 2024-09-21T15:10:29.802 INFO:teuthology.orchestra.run.smithi161.stdout:5763 write 0x9bfd0cc thru 0x9bff180 (0x20b5 bytes) 2024-09-21T15:10:29.822 INFO:teuthology.orchestra.run.smithi161.stdout:5392 trunc from 0xdded098 to 0x9ccf0a2 2024-09-21T15:10:29.846 INFO:teuthology.orchestra.run.smithi161.stdout:5237 writesame 0xb5d2bcb thru 0xb5e1152 data_size 0x41(0xe588 bytes) 2024-09-21T15:10:29.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.878+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a1e1b0e0 handle_clone_image: failed to clone image mirror/10ae42ef5c32 to image_cluster1.client.mirror.1-clone22 2024-09-21T15:10:29.909 INFO:teuthology.orchestra.run.smithi161.stdout:5764 trunc from 0x9bff181 to 0xc4ca47a 2024-09-21T15:10:29.944 INFO:teuthology.orchestra.run.smithi161.stdout:5238 clone 42 order 24 su 8388608 sc 4 2024-09-21T15:10:29.956 INFO:teuthology.orchestra.run.smithi161.stdout:4435 trunc from 0xaf16658 to 0x7e14dc2 2024-09-21T15:10:29.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:29.966+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59fbbd0e0 handle_clone_image: failed to clone image mirror/10b68cf3daf7 to image_cluster1.client.mirror.4-clone28 2024-09-21T15:10:30.069 INFO:teuthology.orchestra.run.smithi161.stdout:4436 read 0x4d356ab thru 0x4d43e9b (0xe7f1 bytes) 2024-09-21T15:10:30.069 INFO:teuthology.orchestra.run.smithi161.stdout:4437 read 0x293b9a2 thru 0x293d7c0 (0x1e1f bytes) 2024-09-21T15:10:30.141 INFO:teuthology.orchestra.run.smithi161.stdout:5393 punch from 0x95729cb to 0x957f0ae, (0xc6e3 bytes) 2024-09-21T15:10:30.141 INFO:teuthology.orchestra.run.smithi161.stdout:5394 write 0x76f5d92 thru 0x76fe228 (0x8497 bytes) 2024-09-21T15:10:30.194 INFO:teuthology.orchestra.run.smithi161.stdout:5765 read 0x9cae99 thru 0x9cf5f1 (0x4759 bytes) 2024-09-21T15:10:30.195 INFO:teuthology.orchestra.run.smithi161.stdout:5766 punch from 0x1a04789 to 0x1a070d5, (0x294c bytes) 2024-09-21T15:10:30.196 INFO:teuthology.orchestra.run.smithi161.stdout:5767 punch from 0x4fc9b89 to 0x4fd4cd8, (0xb14f bytes) 2024-09-21T15:10:30.196 INFO:teuthology.orchestra.run.smithi161.stdout:5768 write 0x75e8aab thru 0x75f0731 (0x7c87 bytes) 2024-09-21T15:10:30.211 INFO:teuthology.orchestra.run.smithi161.stdout:4438 writesame 0xe32d080 thru 0xe333efa data_size 0x1(0x6e7b bytes) 2024-09-21T15:10:30.215 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.202+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:10:30.215 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.202+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:10:30.215 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.206+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:10:30.215 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.206+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:10:30.215 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.206+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:10:30.215 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.206+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:10:30.216 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.206+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:10:30.216 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.210+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:10:30.222 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:10:30.222 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:10:30.222 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:10:30.222 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:10:30.222 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:10:30.222 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:10:30.222 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:10:30.222 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:10:30.222 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:10:30.222 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:10:30.222 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:10:30.222 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:10:30.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:10:30.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:10:30.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:10:30.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:10:30.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:10:30.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:10:30.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:10:30.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:10:30.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:10:30.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:10:30.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.214+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:10:30.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:10:30.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:10:30.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:10:30.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:10:30.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:10:30.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:10:30.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:10:30.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:10:30.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:10:30.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:10:30.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:10:30.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:10:30.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:10:30.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:10:30.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:10:30.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:10:30.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:10:30.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:30.218+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:10:30.226 INFO:teuthology.orchestra.run.smithi161.stdout:5770 punch from 0x4519278 to 0x452271b, (0x94a3 bytes) 2024-09-21T15:10:30.226 INFO:teuthology.orchestra.run.smithi161.stdout:5771 write 0xc49a399 thru 0xc4a5eca (0xbb32 bytes) 2024-09-21T15:10:30.226 INFO:teuthology.orchestra.run.smithi161.stdout:4439 write 0x1a63cb thru 0x1b0c0a (0xa840 bytes) 2024-09-21T15:10:30.311 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:30.302+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:10:30.314 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:30.302+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4410 2024-09-21T15:10:30.317 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:30.310+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f51e0 2024-09-21T15:10:30.319 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:30.310+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:10:30.320 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:10:30.348 INFO:teuthology.orchestra.run.smithi161.stdout:5772 write 0x6d250dd thru 0x6d34374 (0xf298 bytes) 2024-09-21T15:10:30.398 INFO:teuthology.orchestra.run.smithi161.stdout:5972 write 0x60a85ed thru 0x60b1623 (0x9037 bytes) 2024-09-21T15:10:30.398 INFO:teuthology.orchestra.run.smithi161.stdout:4441 writesame 0x5ad8790 thru 0x5ade1e8 data_size 0x1(0x5a59 bytes) 2024-09-21T15:10:30.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:30.398+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a41f10e0 handle_clone_image: failed to clone image mirror/10b5e1573da2 to image_cluster1.client.mirror.0-clone20 2024-09-21T15:10:30.406 INFO:teuthology.orchestra.run.smithi161.stdout:5395 write 0xa6b5b1e thru 0xa6b73bc (0x189f bytes) 2024-09-21T15:10:30.455 INFO:teuthology.orchestra.run.smithi161.stdout:5396 trunc from 0xa6b73bd to 0x9f5c943 2024-09-21T15:10:30.475 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:30.475 INFO:teuthology.orchestra.run.smithi161.stdout:5775 punch from 0x23c3ade to 0x23c8b81, (0x50a3 bytes) 2024-09-21T15:10:30.475 INFO:teuthology.orchestra.run.smithi161.stdout:5776 write 0x95c2d6 thru 0x960332 (0x405d bytes) 2024-09-21T15:10:30.482 INFO:teuthology.orchestra.run.smithi161.stdout:4442 write 0x64e2d4f thru 0x64e65f2 (0x38a4 bytes) 2024-09-21T15:10:30.494 INFO:teuthology.orchestra.run.smithi161.stdout:5974 read 0xd8801b thru 0xd97633 (0xf619 bytes) 2024-09-21T15:10:30.494 INFO:teuthology.orchestra.run.smithi161.stdout:5777 read 0x22b5421 thru 0x22c25da (0xd1ba bytes) 2024-09-21T15:10:30.495 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:30.495 INFO:teuthology.orchestra.run.smithi161.stdout:5779 punch from 0xbefd00c to 0xbf02c90, (0x5c84 bytes) 2024-09-21T15:10:30.495 INFO:teuthology.orchestra.run.smithi161.stdout:5781 write 0x1ba14cd thru 0x1bacda5 (0xb8d9 bytes) 2024-09-21T15:10:30.495 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:30.504 INFO:teuthology.orchestra.run.smithi161.stdout:5977 trunc from 0x60b1624 to 0x1557966 2024-09-21T15:10:30.512 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:30.506+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a181cd20 handle_clone_image: failed to clone image mirror/10b45e4f27e2 to image_cluster1.client.mirror.3-clone34 2024-09-21T15:10:30.519 INFO:teuthology.orchestra.run.smithi161.stdout:5784 punch from 0xbf6e40b to 0xbf73eed, (0x5ae2 bytes) 2024-09-21T15:10:30.519 INFO:teuthology.orchestra.run.smithi161.stdout:5785 write 0x196a556 thru 0x196e7f6 (0x42a1 bytes) 2024-09-21T15:10:30.519 INFO:teuthology.orchestra.run.smithi161.stdout:4443 writesame 0x37ec3f thru 0x389445 data_size 0x7(0xa807 bytes) 2024-09-21T15:10:30.545 INFO:teuthology.orchestra.run.smithi161.stdout:5788 writesame 0x89c5cda thru 0x89d5cc5 data_size 0x16(0xffec bytes) 2024-09-21T15:10:30.581 INFO:teuthology.orchestra.run.smithi161.stdout:4444 read 0x71a7f41 thru 0x71b58ae (0xd96e bytes) 2024-09-21T15:10:30.582 INFO:teuthology.orchestra.run.smithi161.stdout:4445 read 0x8203d3c thru 0x8212760 (0xea25 bytes) 2024-09-21T15:10:30.582 INFO:teuthology.orchestra.run.smithi161.stdout:4446 punch from 0x527e27c to 0x5289a6d, (0xb7f1 bytes) 2024-09-21T15:10:30.583 INFO:teuthology.orchestra.run.smithi161.stdout:4447 read 0x5551824 thru 0x5554f24 (0x3701 bytes) 2024-09-21T15:10:30.583 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:30.584 INFO:teuthology.orchestra.run.smithi161.stdout:5791 read 0x4e819d4 thru 0x4e86301 (0x492e bytes) 2024-09-21T15:10:30.584 INFO:teuthology.orchestra.run.smithi161.stdout:5792 write 0x261a9d3 thru 0x262a129 (0xf757 bytes) 2024-09-21T15:10:30.590 INFO:teuthology.orchestra.run.smithi161.stdout:5397 trunc from 0x9f5c943 to 0x81fc92 2024-09-21T15:10:30.594 INFO:teuthology.orchestra.run.smithi161.stdout:4448 trunc from 0xe333efb to 0x9a9a5f5 2024-09-21T15:10:30.611 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:30.611 INFO:teuthology.orchestra.run.smithi161.stdout:5794 read 0x61c6892 thru 0x61c712f (0x89e bytes) 2024-09-21T15:10:30.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:30.618+0000 7f4810899700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5ab000700 get_replay_status: replay not running 2024-09-21T15:10:30.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:30.638+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59fa56780 handle_clone_image: failed to clone image mirror/10b5ad42318c to image_cluster1.client.mirror.0-clone31 2024-09-21T15:10:30.664 INFO:teuthology.orchestra.run.smithi161.stdout:5795 write 0xe25e1f1 thru 0xe2615f6 (0x3406 bytes) 2024-09-21T15:10:30.666 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.658+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:10:30.667 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.658+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:10:30.667 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.658+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:10:30.669 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.662+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:10:30.670 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.666+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:10:30.684 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.678+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:10:30.684 INFO:teuthology.orchestra.run.smithi161.stdout:5978 write 0x3693c6c thru 0x36a0d53 (0xd0e8 bytes) 2024-09-21T15:10:30.690 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:10:30.690 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:10:30.690 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:10:30.690 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:10:30.690 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:10:30.690 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:10:30.691 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:10:30.692 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:10:30.692 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:10:30.692 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:10:30.692 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:10:30.692 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:10:30.692 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:10:30.693 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:10:30.693 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.682+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:10:30.693 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.686+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:10:30.693 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.686+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:10:30.693 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.686+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:10:30.693 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.686+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:10:30.699 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.690+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:10:30.699 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.690+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:10:30.699 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.690+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:10:30.699 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.690+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:10:30.699 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.690+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:10:30.699 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:30.690+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:10:30.700 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:30.694+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a1e16780 handle_clone_image: failed to clone image mirror/10b677af84f0 to image_cluster1.client.mirror.4-clone14 2024-09-21T15:10:30.725 INFO:teuthology.orchestra.run.smithi161.stdout:5796 trunc from 0xe2615f7 to 0x8eb07e5 2024-09-21T15:10:30.750 INFO:teuthology.orchestra.run.smithi161.stdout:4449 write 0x9ab5b63 thru 0x9ac2da0 (0xd23e bytes) 2024-09-21T15:10:30.772 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:30.789 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:30.786+0000 7f481109a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5a4daf180 get_replay_status: replay not running 2024-09-21T15:10:30.791 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:30.786+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59f8ea960 handle_clone_image: failed to clone image mirror/10aef40d4ad1 to image_cluster1.client.mirror.1-clone13 2024-09-21T15:10:30.792 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.786+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:10:30.816 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4581e10 2024-09-21T15:10:30.817 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.814+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51484e0 2024-09-21T15:10:30.817 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.814+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:10:30.817 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.814+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:10:30.817 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.814+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ef01a0 2024-09-21T15:10:30.818 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.814+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:10:30.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.814+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:10:30.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.814+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:10:30.824 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.822+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e8f0 2024-09-21T15:10:30.824 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.822+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780ed00 2024-09-21T15:10:30.825 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.822+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:10:30.827 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.822+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:10:30.827 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.822+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:10:30.828 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1ad0 2024-09-21T15:10:30.829 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:10:30.829 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:10:30.829 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:10:30.829 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:10:30.830 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:10:30.830 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:10:30.835 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:10:30.835 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab156c0 2024-09-21T15:10:30.835 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab15d40 2024-09-21T15:10:30.835 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:10:30.835 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:10:30.835 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:10:30.835 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1ea90 2024-09-21T15:10:30.835 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.830+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:10:30.835 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.830+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:10:30.835 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.830+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:10:30.835 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.830+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:10:30.844 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.842+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e8410 2024-09-21T15:10:30.845 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.842+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:10:30.845 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.842+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:10:30.846 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.842+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:10:30.846 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.842+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:10:30.850 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:10:30.851 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:10:30.851 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:10:30.851 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:30.851 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:10:30.851 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:10:30.851 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:10:30.851 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:10:30.851 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:10:30.851 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c680 2024-09-21T15:10:30.851 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:10:30.851 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:10:30.851 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:10:30.852 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:10:30.856 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:30.850+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3ec74a0 handle_clone_image: failed to clone image mirror/10ae802c3dc0 to image_cluster1.client.mirror.1-clone30 2024-09-21T15:10:30.908 INFO:teuthology.orchestra.run.smithi161.stdout:5982 writesame 0x7599458 thru 0x75a548d data_size 0x6(0xc036 bytes) 2024-09-21T15:10:30.913 INFO:teuthology.orchestra.run.smithi161.stdout:5797 writesame 0x2405805 thru 0x241171f data_size 0x1d(0xbf1b bytes) 2024-09-21T15:10:30.918 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:30.918 INFO:teuthology.orchestra.run.smithi161.stdout:5984 read 0x609a66c thru 0x60a3c26 (0x95bb bytes) 2024-09-21T15:10:30.918 INFO:teuthology.orchestra.run.smithi161.stdout:5986 punch from 0x4de5311 to 0x4deec27, (0x9916 bytes) 2024-09-21T15:10:30.918 INFO:teuthology.orchestra.run.smithi161.stdout:5988 clone 39 order 22 su 32768 sc 2 2024-09-21T15:10:30.927 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:30.922+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3cbb4a0 handle_clone_image: failed to clone image mirror/10b6d956b9b to image_cluster1.client.mirror.4-clone24 2024-09-21T15:10:30.933 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.926+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:10:30.937 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.930+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3c70 2024-09-21T15:10:30.937 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.930+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3ee0 2024-09-21T15:10:30.937 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.930+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:10:30.958 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:10:30.958 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2e88340 2024-09-21T15:10:30.959 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:10:30.959 INFO:teuthology.orchestra.run.smithi161.stdout:4450 write 0xa5441ca thru 0xa54c920 (0x8757 bytes) 2024-09-21T15:10:30.960 INFO:teuthology.orchestra.run.smithi161.stdout:5398 write 0xac73a01 thru 0xac7c023 (0x8623 bytes) 2024-09-21T15:10:30.961 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:10:30.961 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a40415f0 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4581e10 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51484e0 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a519f6c0 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ef01a0 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.950+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.954+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.954+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.954+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780ed00 2024-09-21T15:10:30.962 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.954+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:10:30.963 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.954+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:10:30.963 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.954+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:10:30.963 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.958+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1ad0 2024-09-21T15:10:30.963 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.958+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:10:30.963 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.958+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:10:30.972 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.970+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:10:30.972 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.970+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:10:30.972 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.970+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:10:30.975 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.970+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:10:30.975 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.970+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:10:30.979 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:10:30.979 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab156c0 2024-09-21T15:10:30.979 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab15d40 2024-09-21T15:10:30.979 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:10:30.979 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:10:30.979 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17790 2024-09-21T15:10:30.979 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:10:30.979 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f2b0 2024-09-21T15:10:30.979 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:10:30.979 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:10:30.979 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:10:30.980 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:10:30.980 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c4e0 2024-09-21T15:10:30.980 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e8410 2024-09-21T15:10:30.980 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:10:30.980 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:10:30.980 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:10:30.980 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9790 2024-09-21T15:10:30.980 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.974+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:10:30.981 INFO:teuthology.orchestra.run.smithi161.stdout:5798 write 0x55927e4 thru 0x5598e00 (0x661d bytes) 2024-09-21T15:10:30.984 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:10:30.984 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:10:30.984 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:10:30.984 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:10:30.984 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:30.984 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:10:30.984 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:10:30.984 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:10:30.984 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:10:30.984 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:10:30.984 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:10:30.984 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:10:30.985 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:10:30.985 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:30.978+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:10:30.993 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:30.986+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a57a3680 handle_clone_image: failed to clone image mirror/10adeb3aef10 to image_cluster1.client.mirror.2-clone18 2024-09-21T15:10:31.006 INFO:teuthology.orchestra.run.smithi161.stdout:5400 punch from 0x3e6ab03 to 0x3e76704, (0xbc01 bytes) 2024-09-21T15:10:31.006 INFO:teuthology.orchestra.run.smithi161.stdout:5401 read 0x17c491 thru 0x188940 (0xc4b0 bytes) 2024-09-21T15:10:31.007 INFO:teuthology.orchestra.run.smithi161.stdout:5407 read 0x17ff757 thru 0x1807f10 (0x87ba bytes) 2024-09-21T15:10:31.007 INFO:teuthology.orchestra.run.smithi161.stdout:5408 read 0xc74e16 thru 0xc77543 (0x272e bytes) 2024-09-21T15:10:31.007 INFO:teuthology.orchestra.run.smithi161.stdout:4451 read 0x17bddc9 thru 0x17c6a36 (0x8c6e bytes) 2024-09-21T15:10:31.012 INFO:teuthology.orchestra.run.smithi161.stdout:4453 write 0x2793185 thru 0x2794126 (0xfa2 bytes) 2024-09-21T15:10:31.036 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:31.036 INFO:teuthology.orchestra.run.smithi161.stdout:5801 read 0x77c0557 thru 0x77cd9a5 (0xd44f bytes) 2024-09-21T15:10:31.042 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #36, image image_cluster1.client.mirror.5-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent37 2024-09-21T15:10:31.054 INFO:teuthology.orchestra.run.smithi161.stdout:5803 trunc from 0x8eb07e5 to 0x64c419 2024-09-21T15:10:31.069 INFO:teuthology.orchestra.run.smithi161.stdout:4454 write 0x9e19af thru 0x9e39fa (0x204c bytes) 2024-09-21T15:10:31.085 INFO:teuthology.orchestra.run.smithi161.stdout:5409 write 0xe055564 thru 0xe0603ec (0xae89 bytes) 2024-09-21T15:10:31.104 INFO:teuthology.orchestra.run.smithi161.stdout:4455 read 0xba5821 thru 0xba99c5 (0x41a5 bytes) 2024-09-21T15:10:31.106 INFO:teuthology.orchestra.run.smithi161.stdout:4456 trunc from 0xa54c921 to 0xa68a8c0 2024-09-21T15:10:31.120 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:31.120 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:31.120 INFO:teuthology.orchestra.run.smithi161.stdout:5417 read 0x47c564 thru 0x489065 (0xcb02 bytes) 2024-09-21T15:10:31.120 INFO:teuthology.orchestra.run.smithi161.stdout:5418 punch from 0xd0ae352 to 0xd0bdf7e, (0xfc2c bytes) 2024-09-21T15:10:31.121 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:31.121 INFO:teuthology.orchestra.run.smithi161.stdout:5420 write 0xb0b6ee0 thru 0xb0b7e91 (0xfb2 bytes) 2024-09-21T15:10:31.140 INFO:teuthology.orchestra.run.smithi161.stdout:5421 read 0x89675a4 thru 0x896f157 (0x7bb4 bytes) 2024-09-21T15:10:31.141 INFO:teuthology.orchestra.run.smithi161.stdout:5423 write 0x59a19a7 thru 0x59a9a42 (0x809c bytes) 2024-09-21T15:10:31.162 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:31.162 INFO:teuthology.orchestra.run.smithi161.stdout:5425 writesame 0x9e4a712 thru 0x9e50704 data_size 0x4d(0x5ff3 bytes) 2024-09-21T15:10:31.165 INFO:teuthology.orchestra.run.smithi161.stdout:4458 read 0x5ed34ef thru 0x5ee0b51 (0xd663 bytes) 2024-09-21T15:10:31.165 INFO:teuthology.orchestra.run.smithi161.stdout:4460 read 0x58de4b2 thru 0x58ea0a3 (0xbbf2 bytes) 2024-09-21T15:10:31.174 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:31.182 INFO:teuthology.orchestra.run.smithi161.stdout:5427 writesame 0x3db77dc thru 0x3dc3003 data_size 0x8e(0xb828 bytes) 2024-09-21T15:10:31.186 INFO:teuthology.orchestra.run.smithi161.stdout:4461 trunc from 0xa68a8c0 to 0x1c72b1 2024-09-21T15:10:31.186 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone41 from 0xbbb0469 (overlap 0x23efa9d) to 0x72feec 2024-09-21T15:10:31.225 INFO:teuthology.orchestra.run.smithi161.stdout:5717 writesame 0x666b834 thru 0x6675aeb data_size 0x29(0xa2b8 bytes) 2024-09-21T15:10:31.231 INFO:teuthology.orchestra.run.smithi161.stdout:5805 write 0x45b20d5 thru 0x45b5708 (0x3634 bytes) 2024-09-21T15:10:31.251 INFO:teuthology.orchestra.run.smithi161.stdout:5429 trunc from 0xe0603ed to 0xd29ca 2024-09-21T15:10:31.291 INFO:teuthology.orchestra.run.smithi161.stdout:5806 punch from 0x22bbca4 to 0x22cb5f7, (0xf953 bytes) 2024-09-21T15:10:31.291 INFO:teuthology.orchestra.run.smithi161.stdout:5808 punch from 0x419468a to 0x419691b, (0x2291 bytes) 2024-09-21T15:10:31.313 INFO:teuthology.orchestra.run.smithi161.stdout:5718 write 0x470084b thru 0x470d18d (0xc943 bytes) 2024-09-21T15:10:31.367 INFO:teuthology.orchestra.run.smithi161.stdout:5719 trunc from 0x6675aec to 0x4097ddf 2024-09-21T15:10:31.395 INFO:teuthology.orchestra.run.smithi161.stdout:4462 punch from 0x131b61 to 0x138dd0, (0x726f bytes) 2024-09-21T15:10:31.395 INFO:teuthology.orchestra.run.smithi161.stdout:4463 read 0x4d516 thru 0x4f1bf (0x1caa bytes) 2024-09-21T15:10:31.396 INFO:teuthology.orchestra.run.smithi161.stdout:4464 read 0x1a9e69 thru 0x1a9ffd (0x195 bytes) 2024-09-21T15:10:31.397 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:31.397 INFO:teuthology.orchestra.run.smithi161.stdout:4467 punch from 0xc414f to 0xcd64e, (0x94ff bytes) 2024-09-21T15:10:31.397 INFO:teuthology.orchestra.run.smithi161.stdout:4469 punch from 0x1be254 to 0x1c7193, (0x8f3f bytes) 2024-09-21T15:10:31.397 INFO:teuthology.orchestra.run.smithi161.stdout:4471 read 0xf2833 thru 0xfd8b3 (0xb081 bytes) 2024-09-21T15:10:31.405 INFO:teuthology.orchestra.run.smithi161.stdout:5809 write 0xd134914 thru 0xd143373 (0xea60 bytes) 2024-09-21T15:10:31.423 INFO:teuthology.orchestra.run.smithi161.stdout:4472 read 0x44cde thru 0x4ca3a (0x7d5d bytes) 2024-09-21T15:10:31.437 INFO:teuthology.orchestra.run.smithi161.stdout:5810 read 0xc8246ca thru 0xc826361 (0x1c98 bytes) 2024-09-21T15:10:31.447 INFO:teuthology.orchestra.run.smithi161.stdout:5811 trunc from 0xd143374 to 0x963c2ec 2024-09-21T15:10:31.478 INFO:teuthology.orchestra.run.smithi161.stdout:5720 write 0x39d843c thru 0x39dd27f (0x4e44 bytes) 2024-09-21T15:10:31.483 INFO:teuthology.orchestra.run.smithi161.stdout:4473 write 0x8c99a09 thru 0x8ca6d4e (0xd346 bytes) 2024-09-21T15:10:31.516 INFO:teuthology.orchestra.run.smithi161.stdout:4474 write 0x1483b3d thru 0x1489c5c (0x6120 bytes) 2024-09-21T15:10:31.517 INFO:teuthology.orchestra.run.smithi161.stdout:5812 read 0x501b707 thru 0x5020c3a (0x5534 bytes) 2024-09-21T15:10:31.543 INFO:teuthology.orchestra.run.smithi161.stdout:5430 write 0x84764b9 thru 0x8486110 (0xfc58 bytes) 2024-09-21T15:10:31.544 INFO:teuthology.orchestra.run.smithi161.stdout:4477 punch from 0x493fd7f to 0x4949864, (0x9ae5 bytes) 2024-09-21T15:10:31.544 INFO:teuthology.orchestra.run.smithi161.stdout:4478 read 0x17bdf7f thru 0x17bf79d (0x181f bytes) 2024-09-21T15:10:31.544 INFO:teuthology.orchestra.run.smithi161.stdout:4479 writesame 0x235b5fb thru 0x236a208 data_size 0x5(0xec0e bytes) 2024-09-21T15:10:31.564 INFO:teuthology.orchestra.run.smithi161.stdout:5721 write 0x66a2613 thru 0x66a2d32 (0x720 bytes) 2024-09-21T15:10:31.582 INFO:teuthology.orchestra.run.smithi161.stdout:5722 punch from 0x53107e7 to 0x53144ff, (0x3d18 bytes) 2024-09-21T15:10:31.582 INFO:teuthology.orchestra.run.smithi161.stdout:5723 read 0x6573e1 thru 0x65fa9e (0x86be bytes) 2024-09-21T15:10:31.585 INFO:teuthology.orchestra.run.smithi161.stdout:5724 punch from 0x6686890 to 0x668b427, (0x4b97 bytes) 2024-09-21T15:10:31.585 INFO:teuthology.orchestra.run.smithi161.stdout:5725 read 0x51310b3 thru 0x513a5c9 (0x9517 bytes) 2024-09-21T15:10:31.585 INFO:teuthology.orchestra.run.smithi161.stdout:5726 write 0x1e56eae thru 0x1e5ee57 (0x7faa bytes) 2024-09-21T15:10:31.586 INFO:teuthology.orchestra.run.smithi161.stdout:5814 write 0xc1a050a thru 0xc1a0cbb (0x7b2 bytes) 2024-09-21T15:10:31.590 INFO:teuthology.orchestra.run.smithi161.stdout:4480 read 0x81c782f thru 0x81d1c09 (0xa3db bytes) 2024-09-21T15:10:31.590 INFO:teuthology.orchestra.run.smithi161.stdout:4482 punch from 0x845d7e4 to 0x845ddc9, (0x5e5 bytes) 2024-09-21T15:10:31.591 INFO:teuthology.orchestra.run.smithi161.stdout:4483 punch from 0xeed9ef to 0xef125a, (0x386b bytes) 2024-09-21T15:10:31.591 INFO:teuthology.orchestra.run.smithi161.stdout:4484 read 0x5950781 thru 0x595711b (0x699b bytes) 2024-09-21T15:10:31.591 INFO:teuthology.orchestra.run.smithi161.stdout:4485 punch from 0x30477a2 to 0x304d536, (0x5d94 bytes) 2024-09-21T15:10:31.591 INFO:teuthology.orchestra.run.smithi161.stdout:4486 punch from 0x88e5eca to 0x88e9871, (0x39a7 bytes) 2024-09-21T15:10:31.594 INFO:teuthology.orchestra.run.smithi161.stdout:5432 trunc from 0x8486111 to 0x3130cdc 2024-09-21T15:10:31.608 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:31.617 INFO:teuthology.orchestra.run.smithi161.stdout:5818 trunc from 0xc1a0cbc to 0x7158793 2024-09-21T15:10:31.632 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #40, image image_cluster1.client.mirror.4-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent41 2024-09-21T15:10:31.649 INFO:teuthology.orchestra.run.smithi161.stdout:4487 write 0xc738cc6 thru 0xc7406f3 (0x7a2e bytes) 2024-09-21T15:10:31.676 INFO:teuthology.orchestra.run.smithi161.stdout:4488 write 0x6a500c9 thru 0x6a5687e (0x67b6 bytes) 2024-09-21T15:10:31.688 INFO:teuthology.orchestra.run.smithi161.stdout:5435 punch from 0x9ab711 to 0x9bb5e2, (0xfed1 bytes) 2024-09-21T15:10:31.688 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:31.702 INFO:teuthology.orchestra.run.smithi161.stdout:4489 punch from 0x36c4f53 to 0x36d37ba, (0xe867 bytes) 2024-09-21T15:10:31.702 INFO:teuthology.orchestra.run.smithi161.stdout:4490 punch from 0x2ef11b2 to 0x2ef5023, (0x3e71 bytes) 2024-09-21T15:10:31.702 INFO:teuthology.orchestra.run.smithi161.stdout:4491 writesame 0x806eb4 thru 0x8085ea data_size 0x7(0x1737 bytes) 2024-09-21T15:10:31.711 INFO:teuthology.orchestra.run.smithi161.stdout:5819 writesame 0x3e400be thru 0x3e4f800 data_size 0x1(0xf743 bytes) 2024-09-21T15:10:31.749 INFO:teuthology.orchestra.run.smithi161.stdout:5728 punch from 0x48fb945 to 0x490105d, (0x5718 bytes) 2024-09-21T15:10:31.750 INFO:teuthology.orchestra.run.smithi161.stdout:5729 write 0x6128e59 thru 0x6136ff5 (0xe19d bytes) 2024-09-21T15:10:31.758 INFO:teuthology.orchestra.run.smithi161.stdout:4492 read 0xe28eba thru 0xe37374 (0xe4bb bytes) 2024-09-21T15:10:31.758 INFO:teuthology.orchestra.run.smithi161.stdout:4493 punch from 0x1cf7fd1 to 0x1d06fb6, (0xefe5 bytes) 2024-09-21T15:10:31.765 INFO:teuthology.orchestra.run.smithi161.stdout:5730 punch from 0xdac553 to 0xdb3067, (0x6b14 bytes) 2024-09-21T15:10:31.768 INFO:teuthology.orchestra.run.smithi161.stdout:4494 trunc from 0xc7406f4 to 0x8dfecb5 2024-09-21T15:10:31.785 INFO:teuthology.orchestra.run.smithi161.stdout:5437 writesame 0x8b86a4e thru 0x8b927d6 data_size 0xb(0xbd89 bytes) 2024-09-21T15:10:31.820 INFO:teuthology.orchestra.run.smithi161.stdout:5239 writesame 0xb43db1a thru 0xb44146c data_size 0x5(0x3953 bytes) 2024-09-21T15:10:31.826 INFO:teuthology.orchestra.run.smithi161.stdout:5731 write 0x71cff9d thru 0x71d3caf (0x3d13 bytes) 2024-09-21T15:10:31.827 INFO:teuthology.orchestra.run.smithi161.stdout:5820 trunc from 0x7158793 to 0xb5c824a 2024-09-21T15:10:31.835 INFO:teuthology.orchestra.run.smithi161.stdout:4495 read 0x19f1c06 thru 0x1a011ee (0xf5e9 bytes) 2024-09-21T15:10:31.836 INFO:teuthology.orchestra.run.smithi161.stdout:4496 read 0x80a3450 thru 0x80ae876 (0xb427 bytes) 2024-09-21T15:10:31.836 INFO:teuthology.orchestra.run.smithi161.stdout:4498 punch from 0x799b272 to 0x79a7fbc, (0xcd4a bytes) 2024-09-21T15:10:31.836 INFO:teuthology.orchestra.run.smithi161.stdout:4499 writesame 0x313ec7c thru 0x31410ac data_size 0x11(0x2431 bytes) 2024-09-21T15:10:31.841 INFO:teuthology.orchestra.run.smithi161.stdout:5440 write 0xee065f7 thru 0xee0ba73 (0x547d bytes) 2024-09-21T15:10:31.852 INFO:teuthology.orchestra.run.smithi161.stdout:5732 trunc from 0x71d3cb0 to 0x86b07a 2024-09-21T15:10:31.863 INFO:teuthology.orchestra.run.smithi161.stdout:4500 trunc from 0x8dfecb5 to 0x7631786 2024-09-21T15:10:31.874 INFO:teuthology.orchestra.run.smithi161.stdout:5441 punch from 0x5875b05 to 0x587f1b7, (0x96b2 bytes) 2024-09-21T15:10:31.874 INFO:teuthology.orchestra.run.smithi161.stdout:5443 write 0x1958793 thru 0x195ce17 (0x4685 bytes) 2024-09-21T15:10:31.891 INFO:teuthology.orchestra.run.smithi161.stdout:5821 trunc from 0xb5c824a to 0x9c4f2c0 2024-09-21T15:10:31.899 INFO:teuthology.orchestra.run.smithi161.stdout:5240 trunc from 0xbbb0469 to 0x5d302a2 2024-09-21T15:10:31.917 INFO:teuthology.orchestra.run.smithi161.stdout:5444 write 0x5576712 thru 0x5576da4 (0x693 bytes) 2024-09-21T15:10:31.939 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.930+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:10:31.948 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.942+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:10:31.953 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.946+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:10:31.954 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.946+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:10:31.954 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.946+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:10:31.955 INFO:teuthology.orchestra.run.smithi161.stdout:5446 writesame 0x780d6e3 thru 0x781709c data_size 0x15(0x99ba bytes) 2024-09-21T15:10:31.963 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.954+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:10:31.963 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.954+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:10:31.963 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.954+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:10:31.966 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.954+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:10:31.967 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.954+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:10:31.967 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.954+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:10:31.967 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.954+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:10:31.967 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.954+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:10:31.967 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.954+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:10:31.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:10:31.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:10:31.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:10:31.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:10:31.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:10:31.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:10:31.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:10:31.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:10:31.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:10:31.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:10:31.970 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:10:31.970 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:10:31.970 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:10:31.970 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:10:31.970 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:10:31.970 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:10:31.970 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.958+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:10:31.983 INFO:teuthology.orchestra.run.smithi161.stdout:5447 writesame 0x219767e thru 0x2199c32 data_size 0x7(0x25b5 bytes) 2024-09-21T15:10:31.992 INFO:teuthology.orchestra.run.smithi161.stdout:5822 clone 39 order 22 su 524288 sc 9 2024-09-21T15:10:31.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.982+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:10:31.996 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.990+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:10:31.996 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.990+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:10:31.997 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:31.990+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:10:32.007 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.002+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:10:32.007 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.002+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:10:32.007 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.002+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:10:32.007 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.002+0000 7ff753f07700 -1 reset not still connected to 0x560169e2fa00 2024-09-21T15:10:32.007 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.002+0000 7ff753f07700 -1 reset not still connected to 0x560169eaa0d0 2024-09-21T15:10:32.007 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.002+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:10:32.007 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.002+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f7040 2024-09-21T15:10:32.008 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.002+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:10:32.008 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.002+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:10:32.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.002+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:10:32.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.002+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:10:32.030 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.022+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:10:32.030 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.022+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:10:32.031 INFO:teuthology.orchestra.run.smithi161.stdout:4502 writesame 0xbdb9b9d thru 0xbdc669c data_size 0x80(0xcb00 bytes) 2024-09-21T15:10:32.031 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.026+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba4e0 2024-09-21T15:10:32.031 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.026+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:10:32.031 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.026+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:10:32.031 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.026+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:10:32.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.026+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:10:32.033 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.026+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:10:32.037 INFO:teuthology.orchestra.run.smithi161.stdout:5448 write 0xd558292 thru 0xd55d035 (0x4da4 bytes) 2024-09-21T15:10:32.040 INFO:teuthology.orchestra.run.smithi161.stdout:4503 write 0xa10c987 thru 0xa113fa4 (0x761e bytes) 2024-09-21T15:10:32.042 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.034+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:10:32.044 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.038+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:10:32.044 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.038+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:10:32.044 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.038+0000 7ff753f07700 -1 reset not still connected to 0x56016e36eb60 2024-09-21T15:10:32.045 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.038+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:10:32.045 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.038+0000 7ff753f07700 -1 reset not still connected to 0x56016e36fc70 2024-09-21T15:10:32.045 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.038+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:10:32.056 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.046+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:10:32.056 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.046+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:10:32.056 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:10:32.056 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3790 2024-09-21T15:10:32.063 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f162000 2024-09-21T15:10:32.063 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:10:32.063 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:10:32.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.054+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:10:32.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.054+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:10:32.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.054+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:10:32.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.054+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:10:32.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.054+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:10:32.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.054+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:10:32.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.054+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:10:32.069 INFO:teuthology.orchestra.run.smithi161.stdout:5452 punch from 0x92c8da8 to 0x92cd33e, (0x4596 bytes) 2024-09-21T15:10:32.069 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:32.069 INFO:teuthology.orchestra.run.smithi161.stdout:4506 write 0x7e86232 thru 0x7e86579 (0x348 bytes) 2024-09-21T15:10:32.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:10:32.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:10:32.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:10:32.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:10:32.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:10:32.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:10:32.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:10:32.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:10:32.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:10:32.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:10:32.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:10:32.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:10:32.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:10:32.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:10:32.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:10:32.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:10:32.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99d40 2024-09-21T15:10:32.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:10:32.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:10:32.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:10:32.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:10:32.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:10:32.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:10:32.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.066+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:10:32.079 INFO:teuthology.orchestra.run.smithi161.stdout:5241 read 0x5199a17 thru 0x51a557c (0xbb66 bytes) 2024-09-21T15:10:32.080 INFO:teuthology.orchestra.run.smithi161.stdout:5242 read 0x24e81cf thru 0x24f2024 (0x9e56 bytes) 2024-09-21T15:10:32.080 INFO:teuthology.orchestra.run.smithi161.stdout:4508 write 0x73051d8 thru 0x730cf2e (0x7d57 bytes) 2024-09-21T15:10:32.092 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.086+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:10:32.092 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.086+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:10:32.092 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.086+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:10:32.097 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.090+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:10:32.097 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.090+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:10:32.098 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.090+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:10:32.098 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.090+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:10:32.098 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.090+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:10:32.098 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.090+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:10:32.102 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x560168574270 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:10:32.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:10:32.104 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:10:32.104 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:10:32.104 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:10:32.104 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x560169e2fa00 2024-09-21T15:10:32.104 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x560169eaa0d0 2024-09-21T15:10:32.104 INFO:teuthology.orchestra.run.smithi161.stdout:5455 trunc from 0xee0ba74 to 0xc71292 2024-09-21T15:10:32.106 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:10:32.106 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f7040 2024-09-21T15:10:32.106 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:10:32.106 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:10:32.106 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:10:32.106 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:10:32.106 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:10:32.106 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:10:32.106 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:10:32.106 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:10:32.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:10:32.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:10:32.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:10:32.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:10:32.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:10:32.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:10:32.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:10:32.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:10:32.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:10:32.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:10:32.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:10:32.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:10:32.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.094+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:10:32.108 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:10:32.108 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:10:32.108 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:10:32.108 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:10:32.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:10:32.110 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:32.102+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:10:32.117 INFO:teuthology.orchestra.run.smithi161.stdout:4509 trunc from 0xbdc669d to 0x992db9c 2024-09-21T15:10:32.118 INFO:teuthology.orchestra.run.smithi161.stdout:5244 write 0x5da3037 thru 0x5daeb01 (0xbacb bytes) 2024-09-21T15:10:32.133 INFO:teuthology.orchestra.run.smithi161.stdout:5245 punch from 0xf25b5 to 0xf3b01, (0x154c bytes) 2024-09-21T15:10:32.143 INFO:teuthology.orchestra.run.smithi161.stdout:5246 trunc from 0x5daeb02 to 0x9cfdca 2024-09-21T15:10:32.192 INFO:teuthology.orchestra.run.smithi161.stdout:5456 trunc from 0xc71292 to 0x101308 2024-09-21T15:10:32.194 INFO:teuthology.orchestra.run.smithi161.stdout:4511 punch from 0x372ea09 to 0x373b102, (0xc6f9 bytes) 2024-09-21T15:10:32.194 INFO:teuthology.orchestra.run.smithi161.stdout:4512 read 0x2591683 thru 0x2593fec (0x296a bytes) 2024-09-21T15:10:32.194 INFO:teuthology.orchestra.run.smithi161.stdout:4513 read 0x872a38d thru 0x872b0f3 (0xd67 bytes) 2024-09-21T15:10:32.194 INFO:teuthology.orchestra.run.smithi161.stdout:4514 read 0x6467ff8 thru 0x646b578 (0x3581 bytes) 2024-09-21T15:10:32.230 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #37, image image_cluster1.client.mirror.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent38 2024-09-21T15:10:32.232 INFO:teuthology.orchestra.run.smithi161.stdout:4515 writesame 0xc724f6b thru 0xc728777 data_size 0x1(0x380d bytes) 2024-09-21T15:10:32.236 INFO:teuthology.orchestra.run.smithi161.stdout:5457 trunc from 0x101308 to 0x74bcfe 2024-09-21T15:10:32.239 INFO:teuthology.orchestra.run.smithi161.stdout:4516 write 0x20ca82f thru 0x20d136d (0x6b3f bytes) 2024-09-21T15:10:32.267 INFO:teuthology.orchestra.run.smithi161.stdout:4518 read 0xada7089 thru 0xadb374f (0xc6c7 bytes) 2024-09-21T15:10:32.267 INFO:teuthology.orchestra.run.smithi161.stdout:4519 punch from 0x6b7a32 to 0x6bc86f, (0x4e3d bytes) 2024-09-21T15:10:32.268 INFO:teuthology.orchestra.run.smithi161.stdout:4521 writesame 0x2ca8e53 thru 0x2cae91c data_size 0x1(0x5aca bytes) 2024-09-21T15:10:32.278 INFO:teuthology.orchestra.run.smithi161.stdout:5458 punch from 0x3995bf to 0x39e098, (0x4ad9 bytes) 2024-09-21T15:10:32.279 INFO:teuthology.orchestra.run.smithi161.stdout:5460 read 0x514548 thru 0x5145f7 (0xb0 bytes) 2024-09-21T15:10:32.279 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:32.279 INFO:teuthology.orchestra.run.smithi161.stdout:5462 read 0x40705c thru 0x410c78 (0x9c1d bytes) 2024-09-21T15:10:32.291 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:32.291 INFO:teuthology.orchestra.run.smithi161.stdout:4523 read 0x4bec083 thru 0x4becb25 (0xaa3 bytes) 2024-09-21T15:10:32.313 INFO:teuthology.orchestra.run.smithi161.stdout:4524 trunc from 0xc728778 to 0x246f5a 2024-09-21T15:10:32.316 INFO:teuthology.orchestra.run.smithi161.stdout:5465 writesame 0x537fc3f thru 0x53813d5 data_size 0x21(0x1797 bytes) 2024-09-21T15:10:32.320 INFO:teuthology.orchestra.run.smithi161.stdout:5466 punch from 0x4f1a367 to 0x4f21751, (0x73ea bytes) 2024-09-21T15:10:32.320 INFO:teuthology.orchestra.run.smithi161.stdout:5467 read 0x4c8f4 thru 0x4dc5d (0x136a bytes) 2024-09-21T15:10:32.322 INFO:teuthology.orchestra.run.smithi161.stdout:5248 write 0xe5da35c thru 0xe5df2d0 (0x4f75 bytes) 2024-09-21T15:10:32.345 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:32.345 INFO:teuthology.orchestra.run.smithi161.stdout:5253 write 0x8c185a4 thru 0x8c260c1 (0xdb1e bytes) 2024-09-21T15:10:32.370 INFO:teuthology.orchestra.run.smithi161.stdout:5257 write 0x290bc4 thru 0x29395e (0x2d9b bytes) 2024-09-21T15:10:32.382 INFO:teuthology.orchestra.run.smithi161.stdout:5258 write 0x6628913 thru 0x662eaed (0x61db bytes) 2024-09-21T15:10:32.396 INFO:teuthology.orchestra.run.smithi161.stdout:5468 write 0x8508e59 thru 0x85185b8 (0xf760 bytes) 2024-09-21T15:10:32.403 INFO:teuthology.orchestra.run.smithi161.stdout:5259 write 0x5b98aa thru 0x5c56f2 (0xbe49 bytes) 2024-09-21T15:10:32.423 INFO:teuthology.orchestra.run.smithi161.stdout:5260 clone 43 order 23 su 524288 sc 10 2024-09-21T15:10:32.464 INFO:teuthology.orchestra.run.smithi161.stdout:5469 punch from 0x1b07c27 to 0x1b08bdd, (0xfb6 bytes) 2024-09-21T15:10:32.464 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:32.482 INFO:teuthology.orchestra.run.smithi161.stdout:4525 write 0x28a1317 thru 0x28a41b1 (0x2e9b bytes) 2024-09-21T15:10:32.503 INFO:teuthology.orchestra.run.smithi161.stdout:4526 read 0x1ce14d8 thru 0x1cefe80 (0xe9a9 bytes) 2024-09-21T15:10:32.509 INFO:teuthology.orchestra.run.smithi161.stdout:5471 write 0x8e70437 thru 0x8e7214f (0x1d19 bytes) 2024-09-21T15:10:32.521 INFO:teuthology.orchestra.run.smithi161.stdout:5472 punch from 0x30ff1a6 to 0x310d4f0, (0xe34a bytes) 2024-09-21T15:10:32.521 INFO:teuthology.orchestra.run.smithi161.stdout:5473 read 0x24cab4c thru 0x24d422e (0x96e3 bytes) 2024-09-21T15:10:32.521 INFO:teuthology.orchestra.run.smithi161.stdout:5474 writesame 0x8a19d6d thru 0x8a1d5c8 data_size 0x2(0x385c bytes) 2024-09-21T15:10:32.532 INFO:teuthology.orchestra.run.smithi161.stdout:4528 write 0x3a2e51e thru 0x3a3068e (0x2171 bytes) 2024-09-21T15:10:32.536 INFO:teuthology.orchestra.run.smithi161.stdout:5476 writesame 0x63e684e thru 0x63e8aca data_size 0x1b(0x227d bytes) 2024-09-21T15:10:32.549 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:32.562 INFO:teuthology.orchestra.run.smithi161.stdout:5479 trunc from 0x8e72150 to 0x22b548b 2024-09-21T15:10:32.598 INFO:teuthology.orchestra.run.smithi161.stdout:4529 writesame 0xd850048 thru 0xd852d72 data_size 0x1(0x2d2b bytes) 2024-09-21T15:10:32.602 INFO:teuthology.orchestra.run.smithi161.stdout:4531 write 0x3f64eb5 thru 0x3f6e8bc (0x9a08 bytes) 2024-09-21T15:10:32.629 INFO:teuthology.orchestra.run.smithi161.stdout:5480 trunc from 0x22b548b to 0x8862f67 2024-09-21T15:10:32.633 INFO:teuthology.orchestra.run.smithi161.stdout:4532 read 0xa8bc6a6 thru 0xa8cb7a7 (0xf102 bytes) 2024-09-21T15:10:32.633 INFO:teuthology.orchestra.run.smithi161.stdout:4533 read 0xb41c531 thru 0xb425e3d (0x990d bytes) 2024-09-21T15:10:32.634 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:32.634 INFO:teuthology.orchestra.run.smithi161.stdout:4535 write 0xa181ff6 thru 0xa18d3df (0xb3ea bytes) 2024-09-21T15:10:32.658 INFO:teuthology.orchestra.run.smithi161.stdout:5990 trunc from 0x75a548e to 0x536e95 2024-09-21T15:10:32.667 INFO:teuthology.orchestra.run.smithi161.stdout:4538 write 0x2c180e thru 0x2c4514 (0x2d07 bytes) 2024-09-21T15:10:32.671 INFO:teuthology.orchestra.run.smithi161.stdout:5481 write 0x2521358 thru 0x25277ad (0x6456 bytes) 2024-09-21T15:10:32.681 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:32.681 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:32.681 INFO:teuthology.orchestra.run.smithi161.stdout:4541 writesame 0x7ac63d thru 0x7b1565 data_size 0x23(0x4f29 bytes) 2024-09-21T15:10:32.701 INFO:teuthology.orchestra.run.smithi161.stdout:5482 trunc from 0x8862f67 to 0xb459b61 2024-09-21T15:10:32.704 INFO:teuthology.orchestra.run.smithi161.stdout:4544 write 0xc654b97 thru 0xc6563d9 (0x1843 bytes) 2024-09-21T15:10:32.744 INFO:teuthology.orchestra.run.smithi161.stdout:4545 read 0x9beff2a thru 0x9bf61af (0x6286 bytes) 2024-09-21T15:10:32.744 INFO:teuthology.orchestra.run.smithi161.stdout:4546 write 0xa9c2494 thru 0xa9cf50b (0xd078 bytes) 2024-09-21T15:10:32.808 INFO:teuthology.orchestra.run.smithi161.stdout:5484 writesame 0x9393037 thru 0x9399d3e data_size 0xc(0x6d08 bytes) 2024-09-21T15:10:32.831 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:32.831 INFO:teuthology.orchestra.run.smithi161.stdout:4548 read 0x4b25360 thru 0x4b3500b (0xfcac bytes) 2024-09-21T15:10:32.847 INFO:teuthology.orchestra.run.smithi161.stdout:4549 trunc from 0xd852d73 to 0x51b6595 2024-09-21T15:10:32.870 INFO:teuthology.orchestra.run.smithi161.stdout:5485 read 0x6702e3a thru 0x67115c1 (0xe788 bytes) 2024-09-21T15:10:32.873 INFO:teuthology.orchestra.run.smithi161.stdout:5486 trunc from 0xb459b61 to 0x9ac78cb 2024-09-21T15:10:32.920 INFO:teuthology.orchestra.run.smithi161.stdout:5487 punch from 0x5f2d9f7 to 0x5f360e5, (0x86ee bytes) 2024-09-21T15:10:32.920 INFO:teuthology.orchestra.run.smithi161.stdout:5488 read 0x1499461 thru 0x14a48e6 (0xb486 bytes) 2024-09-21T15:10:32.920 INFO:teuthology.orchestra.run.smithi161.stdout:5489 write 0x1b1c10b thru 0x1b1ea3d (0x2933 bytes) 2024-09-21T15:10:32.930 INFO:teuthology.orchestra.run.smithi161.stdout:5490 read 0x81bd82a thru 0x81c2470 (0x4c47 bytes) 2024-09-21T15:10:32.930 INFO:teuthology.orchestra.run.smithi161.stdout:5491 read 0x5bd9655 thru 0x5be79f2 (0xe39e bytes) 2024-09-21T15:10:32.930 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:32.977 INFO:teuthology.orchestra.run.smithi161.stdout:5991 write 0x2c42bb5 thru 0x2c48ecb (0x6317 bytes) 2024-09-21T15:10:32.977 INFO:teuthology.orchestra.run.smithi161.stdout:4550 read 0x36ba707 thru 0x36bf54f (0x4e49 bytes) 2024-09-21T15:10:32.981 INFO:teuthology.orchestra.run.smithi161.stdout:5494 write 0xc3bcd77 thru 0xc3bf33d (0x25c7 bytes) 2024-09-21T15:10:33.000 INFO:teuthology.orchestra.run.smithi161.stdout:5495 punch from 0x9a6a356 to 0x9a73e3e, (0x9ae8 bytes) 2024-09-21T15:10:33.000 INFO:teuthology.orchestra.run.smithi161.stdout:5496 write 0x458e811 thru 0x4599c10 (0xb400 bytes) 2024-09-21T15:10:33.005 INFO:teuthology.orchestra.run.smithi161.stdout:5995 punch from 0x11053b7 to 0x1108380, (0x2fc9 bytes) 2024-09-21T15:10:33.026 INFO:teuthology.orchestra.run.smithi161.stdout:5996 trunc from 0x2c48ecc to 0xc295174 2024-09-21T15:10:33.033 INFO:teuthology.orchestra.run.smithi161.stdout:5497 read 0x65dc552 thru 0x65e747e (0xaf2d bytes) 2024-09-21T15:10:33.034 INFO:teuthology.orchestra.run.smithi161.stdout:5498 writesame 0x2caa518 thru 0x2cb4541 data_size 0xd(0xa02a bytes) 2024-09-21T15:10:33.044 INFO:teuthology.orchestra.run.smithi161.stdout:4552 write 0x9ee1719 thru 0x9ee89d5 (0x72bd bytes) 2024-09-21T15:10:33.081 INFO:teuthology.orchestra.run.smithi161.stdout:4553 read 0x7eab0b4 thru 0x7eb61b0 (0xb0fd bytes) 2024-09-21T15:10:33.081 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:33.081 INFO:teuthology.orchestra.run.smithi161.stdout:4555 punch from 0x454340 to 0x45703f, (0x2cff bytes) 2024-09-21T15:10:33.084 INFO:teuthology.orchestra.run.smithi161.stdout:4560 trunc from 0x9ee89d6 to 0xbde7c7e 2024-09-21T15:10:33.117 INFO:teuthology.orchestra.run.smithi161.stdout:5499 write 0xd732550 thru 0xd73a6b0 (0x8161 bytes) 2024-09-21T15:10:33.132 INFO:teuthology.orchestra.run.smithi161.stdout:4561 read 0x67092df thru 0x67101df (0x6f01 bytes) 2024-09-21T15:10:33.132 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:33.132 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:33.133 INFO:teuthology.orchestra.run.smithi161.stdout:4566 write 0x330635e thru 0x33140f2 (0xdd95 bytes) 2024-09-21T15:10:33.157 INFO:teuthology.orchestra.run.smithi161.stdout:5997 write 0xc8770da thru 0xc87f755 (0x867c bytes) 2024-09-21T15:10:33.183 INFO:teuthology.orchestra.run.smithi161.stdout:5500 write 0x2cea81b thru 0x2cf220f (0x79f5 bytes) 2024-09-21T15:10:33.198 INFO:teuthology.orchestra.run.smithi161.stdout:4568 write 0x5fb9d1 thru 0x60ad66 (0xf396 bytes) 2024-09-21T15:10:33.205 INFO:teuthology.orchestra.run.smithi161.stdout:5501 read 0x6cc8760 thru 0x6cd1c51 (0x94f2 bytes) 2024-09-21T15:10:33.205 INFO:teuthology.orchestra.run.smithi161.stdout:5503 read 0x1f6c858 thru 0x1f760c0 (0x9869 bytes) 2024-09-21T15:10:33.205 INFO:teuthology.orchestra.run.smithi161.stdout:5504 writesame 0x301d8bb thru 0x301e198 data_size 0x5(0x8de bytes) 2024-09-21T15:10:33.223 INFO:teuthology.orchestra.run.smithi161.stdout:5998 punch from 0xbd2c088 to 0xbd39c0e, (0xdb86 bytes) 2024-09-21T15:10:33.223 INFO:teuthology.orchestra.run.smithi161.stdout:5505 read 0x7428f20 thru 0x742cfde (0x40bf bytes) 2024-09-21T15:10:33.223 INFO:teuthology.orchestra.run.smithi161.stdout:5999 punch from 0x228f26e to 0x2294b20, (0x58b2 bytes) 2024-09-21T15:10:33.224 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:33.224 INFO:teuthology.orchestra.run.smithi161.stdout:5506 writesame 0x2f72ab2 thru 0x2f7b1d7 data_size 0x1(0x8726 bytes) 2024-09-21T15:10:33.272 INFO:teuthology.orchestra.run.smithi161.stdout:leaving image image_cluster1.client.mirror.4-clone42 intact 2024-09-21T15:10:33.314 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #38, image image_cluster1.client.mirror.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent39 2024-09-21T15:10:33.316 INFO:teuthology.orchestra.run.smithi161.stdout:4569 clone 48 order 19 su 4096 sc 13 2024-09-21T15:10:33.337 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:33.337 INFO:teuthology.orchestra.run.smithi161.stdout:5509 read 0x5a9922f thru 0x5aa6b40 (0xd912 bytes) 2024-09-21T15:10:33.337 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:33.338 INFO:teuthology.orchestra.run.smithi161.stdout:5511 read 0xc6e5c5 thru 0xc7b78d (0xd1c9 bytes) 2024-09-21T15:10:33.338 INFO:teuthology.orchestra.run.smithi161.stdout:5513 writesame 0xd623d20 thru 0xd6320d7 data_size 0x54(0xe3b8 bytes) 2024-09-21T15:10:33.339 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:33.334+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a666f4a0 handle_clone_image: failed to clone image mirror/10b56c103baf to image_cluster1.client.mirror.0-clone39 2024-09-21T15:10:33.367 INFO:teuthology.orchestra.run.smithi161.stdout:5514 punch from 0xc8a4849 to 0xc8b2472, (0xdc29 bytes) 2024-09-21T15:10:33.367 INFO:teuthology.orchestra.run.smithi161.stdout:5516 punch from 0x846e612 to 0x847477a, (0x6168 bytes) 2024-09-21T15:10:33.392 INFO:teuthology.orchestra.run.smithi161.stdout:5517 trunc from 0xd73a6b1 to 0xa89ec1 2024-09-21T15:10:33.648 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:33.648 INFO:teuthology.orchestra.run.smithi161.stdout:5523 read 0x6a8efb thru 0x6aeab9 (0x5bbf bytes) 2024-09-21T15:10:33.648 INFO:teuthology.orchestra.run.smithi161.stdout:5524 read 0x870ce7 thru 0x8766d6 (0x59f0 bytes) 2024-09-21T15:10:33.648 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:33.648 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:33.648 INFO:teuthology.orchestra.run.smithi161.stdout:5528 read 0x2d5364 thru 0x2e2c0e (0xd8ab bytes) 2024-09-21T15:10:33.651 INFO:teuthology.orchestra.run.smithi161.stdout:5529 trunc from 0xa89ec1 to 0x121dc27 2024-09-21T15:10:33.662 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.2-clone38 from 0x9c4f2c0 (overlap 0x64c419) to 0x0 2024-09-21T15:10:33.732 INFO:teuthology.orchestra.run.smithi161.stdout:5531 writesame 0xb9ac47d thru 0xb9b99c0 data_size 0x2(0xd544 bytes) 2024-09-21T15:10:33.739 INFO:teuthology.orchestra.run.smithi161.stdout:5532 write 0x3568b84 thru 0x356a9c5 (0x1e42 bytes) 2024-09-21T15:10:33.757 INFO:teuthology.orchestra.run.smithi161.stdout:5533 read 0x248b5dc thru 0x248c493 (0xeb8 bytes) 2024-09-21T15:10:33.757 INFO:teuthology.orchestra.run.smithi161.stdout:5534 read 0x24c23fc thru 0x24ce513 (0xc118 bytes) 2024-09-21T15:10:33.785 INFO:teuthology.orchestra.run.smithi161.stdout:5535 writesame 0xd69372a thru 0xd69c20a data_size 0x7(0x8ae1 bytes) 2024-09-21T15:10:33.788 INFO:teuthology.orchestra.run.smithi161.stdout:5536 read 0x4bdb181 thru 0x4be4a4f (0x98cf bytes) 2024-09-21T15:10:33.802 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #41, image image_cluster1.client.mirror.4-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent42 2024-09-21T15:10:33.805 INFO:teuthology.orchestra.run.smithi161.stdout:5537 trunc from 0xd69c20b to 0x410064c 2024-09-21T15:10:33.841 INFO:teuthology.orchestra.run.smithi161.stdout:5538 read 0x19ef708 thru 0x19ff060 (0xf959 bytes) 2024-09-21T15:10:33.842 INFO:teuthology.orchestra.run.smithi161.stdout:5539 writesame 0x3f31595 thru 0x3f40e02 data_size 0x1(0xf86e bytes) 2024-09-21T15:10:33.879 INFO:teuthology.orchestra.run.smithi161.stdout:5261 read 0xb59d46b thru 0xb5a1b9c (0x4732 bytes) 2024-09-21T15:10:33.880 INFO:teuthology.orchestra.run.smithi161.stdout:All operations completed A-OK! 2024-09-21T15:10:33.910 INFO:teuthology.orchestra.run.smithi161.stdout:5540 trunc from 0x410064c to 0x264584a 2024-09-21T15:10:33.913 DEBUG:teuthology.parallel:result is None 2024-09-21T15:10:33.942 INFO:teuthology.orchestra.run.smithi161.stdout:5262 punch from 0x3598691 to 0x359f039, (0x69a8 bytes) 2024-09-21T15:10:33.943 INFO:teuthology.orchestra.run.smithi161.stdout:5263 write 0xbb5a051 thru 0xbb66d5a (0xcd0a bytes) 2024-09-21T15:10:33.959 INFO:teuthology.orchestra.run.smithi161.stdout:5264 write 0x4ef4a41 thru 0x4f02bcd (0xe18d bytes) 2024-09-21T15:10:33.968 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone47 from 0xbde7c7e (overlap 0x1c72b1) to 0x16c227 2024-09-21T15:10:33.981 INFO:teuthology.orchestra.run.smithi161.stdout:5266 read 0xc9405c2 thru 0xc949fe0 (0x9a1f bytes) 2024-09-21T15:10:33.982 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:33.982 INFO:teuthology.orchestra.run.smithi161.stdout:5268 write 0xd71248e thru 0xd721c2b (0xf79e bytes) 2024-09-21T15:10:34.028 INFO:teuthology.orchestra.run.smithi161.stdout:5269 writesame 0xaa466a0 thru 0xaa4e7c5 data_size 0x2(0x8126 bytes) 2024-09-21T15:10:34.028 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #37, image image_cluster1.client.mirror.2-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent38 2024-09-21T15:10:34.031 INFO:teuthology.orchestra.run.smithi161.stdout:5541 write 0x95209bf thru 0x952d10e (0xc750 bytes) 2024-09-21T15:10:34.039 INFO:teuthology.orchestra.run.smithi161.stdout:5733 writesame 0xc780287 thru 0xc78c921 data_size 0x1(0xc69b bytes) 2024-09-21T15:10:34.049 INFO:teuthology.orchestra.run.smithi161.stdout:5735 read 0x4923f4b thru 0x492a249 (0x62ff bytes) 2024-09-21T15:10:34.063 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:34.063 INFO:teuthology.orchestra.run.smithi161.stdout:5271 writesame 0x4fbb0b6 thru 0x4fca0ed data_size 0x4(0xf038 bytes) 2024-09-21T15:10:34.100 INFO:teuthology.orchestra.run.smithi161.stdout:5542 writesame 0x42efd17 thru 0x42f4ea4 data_size 0x49(0x518e bytes) 2024-09-21T15:10:34.146 INFO:teuthology.orchestra.run.smithi161.stdout:5272 read 0x1773658 thru 0x177b552 (0x7efb bytes) 2024-09-21T15:10:34.146 INFO:teuthology.orchestra.run.smithi161.stdout:5273 clone 44 order 24 su 4194304 sc 11 2024-09-21T15:10:34.161 INFO:teuthology.orchestra.run.smithi161.stdout:5544 read 0x2117cb9 thru 0x211eacb (0x6e13 bytes) 2024-09-21T15:10:34.161 INFO:teuthology.orchestra.run.smithi161.stdout:5546 read 0x479a5c thru 0x480c16 (0x71bb bytes) 2024-09-21T15:10:34.161 INFO:teuthology.orchestra.run.smithi161.stdout:5547 write 0x70c0756 thru 0x70cbc10 (0xb4bb bytes) 2024-09-21T15:10:34.183 INFO:teuthology.orchestra.run.smithi161.stdout:5548 read 0x1caffed thru 0x1cbe2b8 (0xe2cc bytes) 2024-09-21T15:10:34.185 INFO:teuthology.orchestra.run.smithi161.stdout:5736 writesame 0xecaf26b thru 0xecbc1d6 data_size 0x76(0xcf6c bytes) 2024-09-21T15:10:34.189 INFO:teuthology.orchestra.run.smithi161.stdout:5739 punch from 0x2bd171a to 0x2bd2dc5, (0x16ab bytes) 2024-09-21T15:10:34.189 INFO:teuthology.orchestra.run.smithi161.stdout:5740 write 0xb66085d thru 0xb66489a (0x403e bytes) 2024-09-21T15:10:34.217 INFO:teuthology.orchestra.run.smithi161.stdout:5741 read 0x4911d5a thru 0x49143d7 (0x267e bytes) 2024-09-21T15:10:34.217 INFO:teuthology.orchestra.run.smithi161.stdout:5742 writesame 0x50665d thru 0x50fb62 data_size 0xe(0x9506 bytes) 2024-09-21T15:10:34.220 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #46, image image_cluster1.client.mirror.3-clone46 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent47 2024-09-21T15:10:34.227 INFO:teuthology.orchestra.run.smithi161.stdout:5744 writesame 0xe0ff989 thru 0xe1029c4 data_size 0x54(0x303c bytes) 2024-09-21T15:10:34.229 INFO:teuthology.orchestra.run.smithi161.stdout:5549 writesame 0xeb9a431 thru 0xeba7405 data_size 0x5(0xcfd5 bytes) 2024-09-21T15:10:34.233 INFO:teuthology.orchestra.run.smithi161.stdout:5550 write 0x27d65e5 thru 0x27e4387 (0xdda3 bytes) 2024-09-21T15:10:34.260 INFO:teuthology.orchestra.run.smithi161.stdout:5551 write 0x9b64b37 thru 0x9b684aa (0x3974 bytes) 2024-09-21T15:10:34.275 INFO:teuthology.orchestra.run.smithi161.stdout:5552 write 0xc490855 thru 0xc492d51 (0x24fd bytes) 2024-09-21T15:10:34.293 INFO:teuthology.orchestra.run.smithi161.stdout:5745 write 0x8d5a8ea thru 0x8d64067 (0x977e bytes) 2024-09-21T15:10:34.293 INFO:teuthology.orchestra.run.smithi161.stdout:5553 write 0x36d1792 thru 0x36df92c (0xe19b bytes) 2024-09-21T15:10:34.321 INFO:teuthology.orchestra.run.smithi161.stdout:5554 read 0xdcabf8 thru 0xdd2585 (0x798e bytes) 2024-09-21T15:10:34.321 INFO:teuthology.orchestra.run.smithi161.stdout:5746 read 0x3b760d6 thru 0x3b7c32b (0x6256 bytes) 2024-09-21T15:10:34.321 INFO:teuthology.orchestra.run.smithi161.stdout:5555 read 0x8c8fd13 thru 0x8c90bd6 (0xec4 bytes) 2024-09-21T15:10:34.321 INFO:teuthology.orchestra.run.smithi161.stdout:5557 read 0x628da97 thru 0x628ea75 (0xfdf bytes) 2024-09-21T15:10:34.322 INFO:teuthology.orchestra.run.smithi161.stdout:5558 read 0x917d73c thru 0x917ef9e (0x1863 bytes) 2024-09-21T15:10:34.322 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:34.329 INFO:teuthology.orchestra.run.smithi161.stdout:5562 trunc from 0xeba7406 to 0xb6010ac 2024-09-21T15:10:34.342 INFO:teuthology.orchestra.run.smithi161.stdout:5748 trunc from 0xecbc1d7 to 0x1552be3 2024-09-21T15:10:34.378 INFO:teuthology.orchestra.run.smithi161.stdout:5563 write 0x520749a thru 0x520f5a0 (0x8107 bytes) 2024-09-21T15:10:34.408 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:34.408 INFO:teuthology.orchestra.run.smithi161.stdout:5565 writesame 0x81edb76 thru 0x81f044f data_size 0x3f(0x28da bytes) 2024-09-21T15:10:34.428 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:34.428 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:34.474 INFO:teuthology.orchestra.run.smithi161.stdout:5568 write 0xe9dcb13 thru 0xe9ded86 (0x2274 bytes) 2024-09-21T15:10:34.487 INFO:teuthology.orchestra.run.smithi161.stdout:5569 punch from 0x5f5be94 to 0x5f5ffdb, (0x4147 bytes) 2024-09-21T15:10:34.487 INFO:teuthology.orchestra.run.smithi161.stdout:5570 read 0xd275e57 thru 0xd282a43 (0xcbed bytes) 2024-09-21T15:10:34.488 INFO:teuthology.orchestra.run.smithi161.stdout:5571 writesame 0x6f563e4 thru 0x6f6473c data_size 0xd(0xe359 bytes) 2024-09-21T15:10:34.563 INFO:teuthology.orchestra.run.smithi161.stdout:5572 write 0x2c99e10 thru 0x2ca09d8 (0x6bc9 bytes) 2024-09-21T15:10:34.584 INFO:teuthology.orchestra.run.smithi161.stdout:5574 write 0xb386afd thru 0xb387a83 (0xf87 bytes) 2024-09-21T15:10:34.594 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:34.609 INFO:teuthology.orchestra.run.smithi161.stdout:5576 trunc from 0xe9ded87 to 0x52dc48b 2024-09-21T15:10:34.622 INFO:teuthology.orchestra.run.smithi161.stdout:5749 write 0xe08fbf7 thru 0xe0930e7 (0x34f1 bytes) 2024-09-21T15:10:34.664 INFO:teuthology.orchestra.run.smithi161.stdout:5750 punch from 0x45d0bd0 to 0x45e004b, (0xf47b bytes) 2024-09-21T15:10:34.664 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:34.665 INFO:teuthology.orchestra.run.smithi161.stdout:5752 writesame 0x19b1922 thru 0x19c0f3b data_size 0x22(0xf61a bytes) 2024-09-21T15:10:34.674 INFO:teuthology.orchestra.run.smithi161.stdout:5754 write 0xb05461 thru 0xb05b92 (0x732 bytes) 2024-09-21T15:10:34.683 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:34.707 INFO:teuthology.orchestra.run.smithi161.stdout:5756 trunc from 0xe0930e8 to 0xff9a19 2024-09-21T15:10:34.711 INFO:teuthology.orchestra.run.smithi161.stdout:4572 writesame 0x6ebc4eb thru 0x6ec2cf1 data_size 0x21(0x6807 bytes) 2024-09-21T15:10:34.714 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:34.714 INFO:teuthology.orchestra.run.smithi161.stdout:5824 punch from 0x7725a46 to 0x773507a, (0xf634 bytes) 2024-09-21T15:10:34.733 INFO:teuthology.orchestra.run.smithi161.stdout:5578 writesame 0xa6eac68 thru 0xa6fa0de data_size 0x17(0xf477 bytes) 2024-09-21T15:10:34.747 INFO:teuthology.orchestra.run.smithi161.stdout:5579 trunc from 0xa6fa0df to 0x53ec332 2024-09-21T15:10:34.752 INFO:teuthology.orchestra.run.smithi161.stdout:5826 read 0x6b396f5 thru 0x6b3dae0 (0x43ec bytes) 2024-09-21T15:10:34.752 INFO:teuthology.orchestra.run.smithi161.stdout:5828 write 0x5729853 thru 0x5736505 (0xccb3 bytes) 2024-09-21T15:10:34.776 INFO:teuthology.orchestra.run.smithi161.stdout:5829 read 0x4924094 thru 0x4927501 (0x346e bytes) 2024-09-21T15:10:34.776 INFO:teuthology.orchestra.run.smithi161.stdout:5830 write 0x4ae6bfe thru 0x4aec77e (0x5b81 bytes) 2024-09-21T15:10:34.786 INFO:teuthology.orchestra.run.smithi161.stdout:4573 read 0x504b66 thru 0x51265a (0xdaf5 bytes) 2024-09-21T15:10:34.795 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:34.796 INFO:teuthology.orchestra.run.smithi161.stdout:5832 punch from 0x7b37f91 to 0x7b39449, (0x14b8 bytes) 2024-09-21T15:10:34.796 INFO:teuthology.orchestra.run.smithi161.stdout:5833 read 0x327ff56 thru 0x328ac6c (0xad17 bytes) 2024-09-21T15:10:34.805 INFO:teuthology.orchestra.run.smithi161.stdout:4574 trunc from 0xbde7c7e to 0x3e52a74 2024-09-21T15:10:34.815 INFO:teuthology.orchestra.run.smithi161.stdout:5758 trunc from 0xff9a19 to 0xb64da7f 2024-09-21T15:10:34.816 INFO:teuthology.orchestra.run.smithi161.stdout:5836 trunc from 0x9c4f2c0 to 0xc9f6e1 2024-09-21T15:10:34.863 INFO:teuthology.orchestra.run.smithi161.stdout:5580 write 0x749a3ed thru 0x74a2e4c (0x8a60 bytes) 2024-09-21T15:10:34.904 INFO:teuthology.orchestra.run.smithi161.stdout:5759 read 0x8af71ff thru 0x8b05d9b (0xeb9d bytes) 2024-09-21T15:10:34.904 INFO:teuthology.orchestra.run.smithi161.stdout:5760 write 0x1203e4b thru 0x120523a (0x13f0 bytes) 2024-09-21T15:10:34.913 INFO:teuthology.orchestra.run.smithi161.stdout:5581 read 0x67dba26 thru 0x67dd1ce (0x17a9 bytes) 2024-09-21T15:10:34.913 INFO:teuthology.orchestra.run.smithi161.stdout:5582 write 0x5b767f0 thru 0x5b7d32e (0x6b3f bytes) 2024-09-21T15:10:34.915 INFO:teuthology.orchestra.run.smithi161.stdout:5761 read 0x888e546 thru 0x88989ae (0xa469 bytes) 2024-09-21T15:10:34.915 INFO:teuthology.orchestra.run.smithi161.stdout:5765 read 0x36f8772 thru 0x36fef5b (0x67ea bytes) 2024-09-21T15:10:34.915 INFO:teuthology.orchestra.run.smithi161.stdout:5766 write 0x68452b5 thru 0x684f0da (0x9e26 bytes) 2024-09-21T15:10:34.936 INFO:teuthology.orchestra.run.smithi161.stdout:5767 read 0x434daa5 thru 0x434eba2 (0x10fe bytes) 2024-09-21T15:10:34.936 INFO:teuthology.orchestra.run.smithi161.stdout:5768 read 0x3526a5 thru 0x358280 (0x5bdc bytes) 2024-09-21T15:10:34.937 INFO:teuthology.orchestra.run.smithi161.stdout:5583 read 0x1730091 thru 0x173af7e (0xaeee bytes) 2024-09-21T15:10:34.937 INFO:teuthology.orchestra.run.smithi161.stdout:5584 write 0x42fc8b7 thru 0x430b0e6 (0xe830 bytes) 2024-09-21T15:10:34.937 INFO:teuthology.orchestra.run.smithi161.stdout:4575 read 0x3923692 thru 0x3930977 (0xd2e6 bytes) 2024-09-21T15:10:34.937 INFO:teuthology.orchestra.run.smithi161.stdout:5769 read 0x2f9eeb1 thru 0x2fa8c30 (0x9d80 bytes) 2024-09-21T15:10:34.938 INFO:teuthology.orchestra.run.smithi161.stdout:4576 read 0x6e29ce thru 0x6eaa71 (0x80a4 bytes) 2024-09-21T15:10:34.940 INFO:teuthology.orchestra.run.smithi161.stdout:5771 write 0xa0bfac1 thru 0xa0c4e46 (0x5386 bytes) 2024-09-21T15:10:34.951 INFO:teuthology.orchestra.run.smithi161.stdout:5837 trunc from 0xc9f6e1 to 0x5c6cfe9 2024-09-21T15:10:34.967 INFO:teuthology.orchestra.run.smithi161.stdout:5586 punch from 0x1bb6390 to 0x1bbce54, (0x6ac4 bytes) 2024-09-21T15:10:34.967 INFO:teuthology.orchestra.run.smithi161.stdout:5590 read 0x1b87b0 thru 0x1b8ad0 (0x321 bytes) 2024-09-21T15:10:34.967 INFO:teuthology.orchestra.run.smithi161.stdout:5773 writesame 0x9d19e7e thru 0x9d231c4 data_size 0x1(0x9347 bytes) 2024-09-21T15:10:34.978 INFO:teuthology.orchestra.run.smithi161.stdout:5593 trunc from 0x74a2e4d to 0xc8aa4a2 2024-09-21T15:10:35.001 INFO:teuthology.orchestra.run.smithi161.stdout:5774 write 0x11d8dd3 thru 0x11e0c2a (0x7e58 bytes) 2024-09-21T15:10:35.001 INFO:teuthology.orchestra.run.smithi161.stdout:4577 write 0x5af6450 thru 0x5b03fea (0xdb9b bytes) 2024-09-21T15:10:35.011 INFO:teuthology.orchestra.run.smithi161.stdout:5838 trunc from 0x5c6cfe9 to 0x9fe5db5 2024-09-21T15:10:35.015 INFO:teuthology.orchestra.run.smithi161.stdout:5775 read 0xe7722a thru 0xe7fd9b (0x8b72 bytes) 2024-09-21T15:10:35.029 INFO:teuthology.orchestra.run.smithi161.stdout:5595 read 0x727d38 thru 0x735091 (0xd35a bytes) 2024-09-21T15:10:35.030 INFO:teuthology.orchestra.run.smithi161.stdout:5596 read 0x7db54fb thru 0x7dbe0e6 (0x8bec bytes) 2024-09-21T15:10:35.030 INFO:teuthology.orchestra.run.smithi161.stdout:5597 punch from 0x78b2028 to 0x78b23f3, (0x3cb bytes) 2024-09-21T15:10:35.030 INFO:teuthology.orchestra.run.smithi161.stdout:5598 writesame 0xacb60fe thru 0xacbacb5 data_size 0x4(0x4bb8 bytes) 2024-09-21T15:10:35.064 INFO:teuthology.orchestra.run.smithi161.stdout:4578 write 0x4674215 thru 0x4680215 (0xc001 bytes) 2024-09-21T15:10:35.064 INFO:teuthology.orchestra.run.smithi161.stdout:5601 write 0x8f4eb29 thru 0x8f55a63 (0x6f3b bytes) 2024-09-21T15:10:35.090 INFO:teuthology.orchestra.run.smithi161.stdout:5602 punch from 0x325b65c to 0x325c774, (0x1118 bytes) 2024-09-21T15:10:35.090 INFO:teuthology.orchestra.run.smithi161.stdout:5603 punch from 0xafe2a64 to 0xaff04b2, (0xda4e bytes) 2024-09-21T15:10:35.090 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.096 INFO:teuthology.orchestra.run.smithi161.stdout:5841 trunc from 0x9fe5db5 to 0x19d9875 2024-09-21T15:10:35.103 INFO:teuthology.orchestra.run.smithi161.stdout:5605 trunc from 0xc8aa4a2 to 0x4dfe7f0 2024-09-21T15:10:35.118 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone43 from 0xe5df2d1 (overlap 0xe5df2d1) to 0x89ec4e3 2024-09-21T15:10:35.121 INFO:teuthology.orchestra.run.smithi161.stdout:4580 punch from 0x198be0e to 0x198c690, (0x882 bytes) 2024-09-21T15:10:35.124 INFO:teuthology.orchestra.run.smithi161.stdout:5776 writesame 0xec18c96 thru 0xec20a8b data_size 0x17(0x7df6 bytes) 2024-09-21T15:10:35.128 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.128 INFO:teuthology.orchestra.run.smithi161.stdout:5780 write 0xd786027 thru 0xd790d1f (0xacf9 bytes) 2024-09-21T15:10:35.160 INFO:teuthology.orchestra.run.smithi161.stdout:5842 punch from 0x2da3be to 0x2e37d4, (0x9416 bytes) 2024-09-21T15:10:35.160 INFO:teuthology.orchestra.run.smithi161.stdout:5844 read 0xdd8c19 thru 0xde8954 (0xfd3c bytes) 2024-09-21T15:10:35.160 INFO:teuthology.orchestra.run.smithi161.stdout:5781 write 0xb034533 thru 0xb04281e (0xe2ec bytes) 2024-09-21T15:10:35.161 INFO:teuthology.orchestra.run.smithi161.stdout:5845 read 0x96cfa thru 0xa1107 (0xa40e bytes) 2024-09-21T15:10:35.195 INFO:teuthology.orchestra.run.smithi161.stdout:5606 trunc from 0x4dfe7f0 to 0x2599462 2024-09-21T15:10:35.197 INFO:teuthology.orchestra.run.smithi161.stdout:5846 write 0x2008eab thru 0x200f177 (0x62cd bytes) 2024-09-21T15:10:35.198 INFO:teuthology.orchestra.run.smithi161.stdout:5783 read 0xc1cc953 thru 0xc1daef2 (0xe5a0 bytes) 2024-09-21T15:10:35.199 INFO:teuthology.orchestra.run.smithi161.stdout:5786 punch from 0x5d1d120 to 0x5d1e82d, (0x170d bytes) 2024-09-21T15:10:35.200 INFO:teuthology.orchestra.run.smithi161.stdout:5787 write 0x9921615 thru 0x992cba5 (0xb591 bytes) 2024-09-21T15:10:35.200 INFO:teuthology.orchestra.run.smithi161.stdout:4581 writesame 0xd2feac0 thru 0xd303bde data_size 0x1(0x511f bytes) 2024-09-21T15:10:35.209 INFO:teuthology.orchestra.run.smithi161.stdout:4583 read 0xbe79f99 thru 0xbe83fcb (0xa033 bytes) 2024-09-21T15:10:35.209 INFO:teuthology.orchestra.run.smithi161.stdout:4584 write 0x78dcd07 thru 0x78e4d50 (0x804a bytes) 2024-09-21T15:10:35.220 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.220 INFO:teuthology.orchestra.run.smithi161.stdout:5791 read 0x89459c0 thru 0x8948293 (0x28d4 bytes) 2024-09-21T15:10:35.236 INFO:teuthology.orchestra.run.smithi161.stdout:5792 trunc from 0xec20a8c to 0x8a269a0 2024-09-21T15:10:35.263 INFO:teuthology.orchestra.run.smithi161.stdout:4587 read 0x32b4a78 thru 0x32c18eb (0xce74 bytes) 2024-09-21T15:10:35.264 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.264 INFO:teuthology.orchestra.run.smithi161.stdout:4589 write 0x8bed5eb thru 0x8bee079 (0xa8f bytes) 2024-09-21T15:10:35.279 INFO:teuthology.orchestra.run.smithi161.stdout:5847 write 0x704c847 thru 0x705282b (0x5fe5 bytes) 2024-09-21T15:10:35.286 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.304 INFO:teuthology.orchestra.run.smithi161.stdout:4591 trunc from 0xd303bdf to 0x5276a5d 2024-09-21T15:10:35.308 INFO:teuthology.orchestra.run.smithi161.stdout:5793 writesame 0x1428e8d thru 0x143383f data_size 0x9(0xa9b3 bytes) 2024-09-21T15:10:35.325 INFO:teuthology.orchestra.run.smithi161.stdout:5794 writesame 0x5e6d5c thru 0x5f595a data_size 0x2b(0xebff bytes) 2024-09-21T15:10:35.343 INFO:teuthology.orchestra.run.smithi161.stdout:5796 punch from 0x7cb766a to 0x7cb9611, (0x1fa7 bytes) 2024-09-21T15:10:35.343 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.343 INFO:teuthology.orchestra.run.smithi161.stdout:5798 punch from 0x73c66b3 to 0x73c7d16, (0x1663 bytes) 2024-09-21T15:10:35.343 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.343 INFO:teuthology.orchestra.run.smithi161.stdout:5800 write 0x4ff76ce thru 0x4ffc8a2 (0x51d5 bytes) 2024-09-21T15:10:35.356 INFO:teuthology.orchestra.run.smithi161.stdout:5608 write 0xdc870c8 thru 0xdc8dfdd (0x6f16 bytes) 2024-09-21T15:10:35.362 INFO:teuthology.orchestra.run.smithi161.stdout:5801 write 0x48ef60a thru 0x48f6297 (0x6c8e bytes) 2024-09-21T15:10:35.363 INFO:teuthology.orchestra.run.smithi161.stdout:5848 write 0xd09b5ae thru 0xd0ab22f (0xfc82 bytes) 2024-09-21T15:10:35.376 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.376 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.376 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.376 INFO:teuthology.orchestra.run.smithi161.stdout:5806 write 0x850a948 thru 0x850f069 (0x4722 bytes) 2024-09-21T15:10:35.382 INFO:teuthology.orchestra.run.smithi161.stdout:5612 read 0xbb5123c thru 0xbb5ae05 (0x9bca bytes) 2024-09-21T15:10:35.382 INFO:teuthology.orchestra.run.smithi161.stdout:5614 writesame 0xda5c3fe thru 0xda6800d data_size 0x88(0xbc10 bytes) 2024-09-21T15:10:35.386 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.387 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.387 INFO:teuthology.orchestra.run.smithi161.stdout:5853 read 0x48ce5d7 thru 0x48d04a2 (0x1ecc bytes) 2024-09-21T15:10:35.391 INFO:teuthology.orchestra.run.smithi161.stdout:5807 write 0xc9c0d4 thru 0xca70ae (0xafdb bytes) 2024-09-21T15:10:35.393 INFO:teuthology.orchestra.run.smithi161.stdout:4592 read 0x20e89e7 thru 0x20f041d (0x7a37 bytes) 2024-09-21T15:10:35.393 INFO:teuthology.orchestra.run.smithi161.stdout:4595 clone 49 order 22 su 32768 sc 3 2024-09-21T15:10:35.400 INFO:teuthology.orchestra.run.smithi161.stdout:5855 trunc from 0xd0ab230 to 0x63ceebf 2024-09-21T15:10:35.407 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.407 INFO:teuthology.orchestra.run.smithi161.stdout:5810 write 0x7c7f6b thru 0x7d5f23 (0xdfb9 bytes) 2024-09-21T15:10:35.416 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.417 INFO:teuthology.orchestra.run.smithi161.stdout:5618 read 0x718c20b thru 0x7191fb4 (0x5daa bytes) 2024-09-21T15:10:35.417 INFO:teuthology.orchestra.run.smithi161.stdout:5619 read 0xe39d17 thru 0xe49740 (0xfa2a bytes) 2024-09-21T15:10:35.417 INFO:teuthology.orchestra.run.smithi161.stdout:5622 punch from 0xd0e8139 to 0xd0eee6f, (0x6d36 bytes) 2024-09-21T15:10:35.417 INFO:teuthology.orchestra.run.smithi161.stdout:5623 write 0x5a03c8a thru 0x5a0e458 (0xa7cf bytes) 2024-09-21T15:10:35.463 INFO:teuthology.orchestra.run.smithi161.stdout:5624 write 0x34b64d2 thru 0x34c2f12 (0xca41 bytes) 2024-09-21T15:10:35.494 INFO:teuthology.orchestra.run.smithi161.stdout:5625 punch from 0xc6164b0 to 0xc61f2fa, (0x8e4a bytes) 2024-09-21T15:10:35.494 INFO:teuthology.orchestra.run.smithi161.stdout:5626 read 0xbcbc53e thru 0xbcc92f8 (0xcdbb bytes) 2024-09-21T15:10:35.494 INFO:teuthology.orchestra.run.smithi161.stdout:5628 writesame 0x94014ca thru 0x940bd7b data_size 0x8f(0xa8b2 bytes) 2024-09-21T15:10:35.498 INFO:teuthology.orchestra.run.smithi161.stdout:5811 write 0xb9c431a thru 0xb9cd34f (0x9036 bytes) 2024-09-21T15:10:35.504 INFO:teuthology.orchestra.run.smithi161.stdout:5856 trunc from 0x63ceebf to 0x4876d6a 2024-09-21T15:10:35.518 INFO:teuthology.orchestra.run.smithi161.stdout:5630 trunc from 0xdc8dfde to 0xbd374ce 2024-09-21T15:10:35.522 INFO:teuthology.orchestra.run.smithi161.stdout:5812 trunc from 0xb9cd350 to 0x749f11c 2024-09-21T15:10:35.531 INFO:teuthology.orchestra.run.smithi161.stdout:5857 read 0x2a44997 thru 0x2a4625e (0x18c8 bytes) 2024-09-21T15:10:35.568 INFO:teuthology.orchestra.run.smithi161.stdout:5858 write 0x5b0d51b thru 0x5b10291 (0x2d77 bytes) 2024-09-21T15:10:35.572 INFO:teuthology.orchestra.run.smithi161.stdout:5631 write 0x931315 thru 0x93ca0f (0xb6fb bytes) 2024-09-21T15:10:35.588 INFO:teuthology.orchestra.run.smithi161.stdout:5859 trunc from 0x5b10292 to 0x5d6b7dd 2024-09-21T15:10:35.602 INFO:teuthology.orchestra.run.smithi161.stdout:5632 read 0x15adc6d thru 0x15aff97 (0x232b bytes) 2024-09-21T15:10:35.602 INFO:teuthology.orchestra.run.smithi161.stdout:5634 write 0x4d9cce thru 0x4e1b1c (0x7e4f bytes) 2024-09-21T15:10:35.626 INFO:teuthology.orchestra.run.smithi161.stdout:5635 writesame 0x80bba6a thru 0x80c09e1 data_size 0x4(0x4f78 bytes) 2024-09-21T15:10:35.639 INFO:teuthology.orchestra.run.smithi161.stdout:5813 write 0x9906329 thru 0x99106f6 (0xa3ce bytes) 2024-09-21T15:10:35.645 INFO:teuthology.orchestra.run.smithi161.stdout:5860 trunc from 0x5d6b7dd to 0xa17ee13 2024-09-21T15:10:35.657 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #42, image image_cluster1.client.mirror.4-clone42 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent43 2024-09-21T15:10:35.664 INFO:teuthology.orchestra.run.smithi161.stdout:5636 trunc from 0xbd374ce to 0x74ac250 2024-09-21T15:10:35.672 INFO:teuthology.orchestra.run.smithi161.stdout:5814 trunc from 0x99106f7 to 0xe8a4673 2024-09-21T15:10:35.682 INFO:teuthology.orchestra.run.smithi161.stdout:5861 write 0x8240ce0 thru 0x82467b8 (0x5ad9 bytes) 2024-09-21T15:10:35.697 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.697 INFO:teuthology.orchestra.run.smithi161.stdout:5863 read 0x6103fdc thru 0x6110964 (0xc989 bytes) 2024-09-21T15:10:35.698 INFO:teuthology.orchestra.run.smithi161.stdout:5864 flatten 2024-09-21T15:10:35.709 INFO:teuthology.orchestra.run.smithi161.stdout:5815 writesame 0xc018570 thru 0xc01a3d4 data_size 0x1(0x1e65 bytes) 2024-09-21T15:10:35.716 INFO:teuthology.orchestra.run.smithi161.stdout:5637 read 0x425d58b thru 0x425f187 (0x1bfd bytes) 2024-09-21T15:10:35.716 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.722 INFO:teuthology.orchestra.run.smithi161.stdout:5640 trunc from 0x74ac250 to 0xa36f6e6 2024-09-21T15:10:35.726 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.726 INFO:teuthology.orchestra.run.smithi161.stdout:5817 write 0x4f835bd thru 0x4f8f1c3 (0xbc07 bytes) 2024-09-21T15:10:35.733 INFO:teuthology.orchestra.run.smithi161.stdout:5865 writesame 0x55a5f45 thru 0x55aaead data_size 0x1(0x4f69 bytes) 2024-09-21T15:10:35.739 INFO:teuthology.orchestra.run.smithi161.stdout:5818 read 0x8e15b08 thru 0x8e1e029 (0x8522 bytes) 2024-09-21T15:10:35.745 INFO:teuthology.orchestra.run.smithi161.stdout:5819 trunc from 0xe8a4673 to 0xb7763bb 2024-09-21T15:10:35.756 INFO:teuthology.orchestra.run.smithi161.stdout:5642 writesame 0xd524e8 thru 0xd604e9 data_size 0x35(0xe002 bytes) 2024-09-21T15:10:35.778 INFO:teuthology.orchestra.run.smithi161.stdout:5866 read 0x9ff9a6e thru 0xa0093db (0xf96e bytes) 2024-09-21T15:10:35.782 INFO:teuthology.orchestra.run.smithi161.stdout:5867 writesame 0x184aa53 thru 0x1855f6a data_size 0x3d(0xb518 bytes) 2024-09-21T15:10:35.798 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.798 INFO:teuthology.orchestra.run.smithi161.stdout:5869 punch from 0x16474e9 to 0x164be76, (0x498d bytes) 2024-09-21T15:10:35.798 INFO:teuthology.orchestra.run.smithi161.stdout:5870 writesame 0x1d42956 thru 0x1d4ed7a data_size 0x1(0xc425 bytes) 2024-09-21T15:10:35.801 INFO:teuthology.orchestra.run.smithi161.stdout:5643 punch from 0x2c647a5 to 0x2c6ffc0, (0xb81b bytes) 2024-09-21T15:10:35.802 INFO:teuthology.orchestra.run.smithi161.stdout:5644 punch from 0x408826e to 0x4094ca5, (0xca37 bytes) 2024-09-21T15:10:35.802 INFO:teuthology.orchestra.run.smithi161.stdout:5645 write 0x914540a thru 0x915464c (0xf243 bytes) 2024-09-21T15:10:35.821 INFO:teuthology.orchestra.run.smithi161.stdout:5820 writesame 0x122d1fd thru 0x123d003 data_size 0x35(0xfe07 bytes) 2024-09-21T15:10:35.834 INFO:teuthology.orchestra.run.smithi161.stdout:5821 write 0x522449d thru 0x5229227 (0x4d8b bytes) 2024-09-21T15:10:35.850 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.850 INFO:teuthology.orchestra.run.smithi161.stdout:5650 read 0x79a2873 thru 0x79af31d (0xcaab bytes) 2024-09-21T15:10:35.850 INFO:teuthology.orchestra.run.smithi161.stdout:5652 punch from 0x644988d to 0x645841b, (0xeb8e bytes) 2024-09-21T15:10:35.851 INFO:teuthology.orchestra.run.smithi161.stdout:5872 read 0x1a7d67d thru 0x1a8a08e (0xca12 bytes) 2024-09-21T15:10:35.852 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.852 INFO:teuthology.orchestra.run.smithi161.stdout:5874 punch from 0x9655349 to 0x96620d5, (0xcd8c bytes) 2024-09-21T15:10:35.853 INFO:teuthology.orchestra.run.smithi161.stdout:5875 read 0x1854800 thru 0x185768f (0x2e90 bytes) 2024-09-21T15:10:35.853 INFO:teuthology.orchestra.run.smithi161.stdout:5876 read 0xd8a29c thru 0xd957b9 (0xb51e bytes) 2024-09-21T15:10:35.854 INFO:teuthology.orchestra.run.smithi161.stdout:5877 write 0x6602d24 thru 0x660627d (0x355a bytes) 2024-09-21T15:10:35.864 INFO:teuthology.orchestra.run.smithi161.stdout:5822 read 0xb46ab4b thru 0xb47712d (0xc5e3 bytes) 2024-09-21T15:10:35.868 INFO:teuthology.orchestra.run.smithi161.stdout:5879 write 0x197825c thru 0x197ebe6 (0x698b bytes) 2024-09-21T15:10:35.870 INFO:teuthology.orchestra.run.smithi161.stdout:5823 trunc from 0xb7763bb to 0xdc4ab34 2024-09-21T15:10:35.881 INFO:teuthology.orchestra.run.smithi161.stdout:5881 trunc from 0xa17ee13 to 0xb89875a 2024-09-21T15:10:35.898 INFO:teuthology.orchestra.run.smithi161.stdout:5653 writesame 0xd6c4259 thru 0xd6ca9a8 data_size 0x1(0x6750 bytes) 2024-09-21T15:10:35.902 INFO:teuthology.orchestra.run.smithi161.stdout:5655 writesame 0xa756dcb thru 0xa75aa7e data_size 0x15(0x3cb4 bytes) 2024-09-21T15:10:35.902 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.902 INFO:teuthology.orchestra.run.smithi161.stdout:5825 read 0x4463a3d thru 0x44697f0 (0x5db4 bytes) 2024-09-21T15:10:35.917 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:35.917 INFO:teuthology.orchestra.run.smithi161.stdout:5658 read 0xac42bda thru 0xac519d0 (0xedf7 bytes) 2024-09-21T15:10:35.917 INFO:teuthology.orchestra.run.smithi161.stdout:5659 write 0xade5305 thru 0xadf3401 (0xe0fd bytes) 2024-09-21T15:10:35.926 INFO:teuthology.orchestra.run.smithi161.stdout:5828 trunc from 0xdc4ab34 to 0xd53462 2024-09-21T15:10:35.947 INFO:teuthology.orchestra.run.smithi161.stdout:5882 writesame 0xbae0ed1 thru 0xbaebc93 data_size 0x1(0xadc3 bytes) 2024-09-21T15:10:35.960 INFO:teuthology.orchestra.run.smithi161.stdout:5660 write 0xa5879cf thru 0xa58f46e (0x7aa0 bytes) 2024-09-21T15:10:35.976 INFO:teuthology.orchestra.run.smithi161.stdout:5884 trunc from 0xbaebc94 to 0xf7a7 2024-09-21T15:10:35.995 INFO:teuthology.orchestra.run.smithi161.stdout:5661 writesame 0xc3fa364 thru 0xc40062a data_size 0x1(0x62c7 bytes) 2024-09-21T15:10:36.039 INFO:teuthology.orchestra.run.smithi161.stdout:5663 read 0x45e4ed5 thru 0x45e9ffe (0x512a bytes) 2024-09-21T15:10:36.040 INFO:teuthology.orchestra.run.smithi161.stdout:5664 writesame 0x585195d thru 0x5855b54 data_size 0x4(0x41f8 bytes) 2024-09-21T15:10:36.058 INFO:teuthology.orchestra.run.smithi161.stdout:5665 read 0x992261b thru 0x99267f1 (0x41d7 bytes) 2024-09-21T15:10:36.058 INFO:teuthology.orchestra.run.smithi161.stdout:5666 read 0xd5f8bd8 thru 0xd5fc4c0 (0x38e9 bytes) 2024-09-21T15:10:36.058 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.058 INFO:teuthology.orchestra.run.smithi161.stdout:5668 writesame 0x469d274 thru 0x46a3424 data_size 0x1(0x61b1 bytes) 2024-09-21T15:10:36.060 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone48 from 0x5276a5d (overlap 0x3e52a74) to 0x1f2953a 2024-09-21T15:10:36.071 INFO:teuthology.orchestra.run.smithi161.stdout:5829 write 0xcba89fe thru 0xcbaa2b6 (0x18b9 bytes) 2024-09-21T15:10:36.091 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.091 INFO:teuthology.orchestra.run.smithi161.stdout:5671 writesame 0xd232153 thru 0xd234439 data_size 0x5(0x22e7 bytes) 2024-09-21T15:10:36.109 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.109 INFO:teuthology.orchestra.run.smithi161.stdout:5886 read 0x7068 thru 0xb8a7 (0x4840 bytes) 2024-09-21T15:10:36.111 INFO:teuthology.orchestra.run.smithi161.stdout:5887 read 0x4810 thru 0x8950 (0x4141 bytes) 2024-09-21T15:10:36.111 INFO:teuthology.orchestra.run.smithi161.stdout:5832 writesame 0x92c8190 thru 0x92d01bd data_size 0x9(0x802e bytes) 2024-09-21T15:10:36.111 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.135 INFO:teuthology.orchestra.run.smithi161.stdout:5673 writesame 0x6f67053 thru 0x6f72c6e data_size 0x6(0xbc1c bytes) 2024-09-21T15:10:36.143 INFO:teuthology.orchestra.run.smithi161.stdout:5833 writesame 0x15aaed5 thru 0x15abaef data_size 0x1(0xc1b bytes) 2024-09-21T15:10:36.167 INFO:teuthology.orchestra.run.smithi161.stdout:5834 read 0x18761f8 thru 0x1880a89 (0xa892 bytes) 2024-09-21T15:10:36.169 INFO:teuthology.orchestra.run.smithi161.stdout:5835 read 0x996088a thru 0x996c836 (0xbfad bytes) 2024-09-21T15:10:36.169 INFO:teuthology.orchestra.run.smithi161.stdout:5836 punch from 0x402d20b to 0x4030156, (0x2f4b bytes) 2024-09-21T15:10:36.169 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.169 INFO:teuthology.orchestra.run.smithi161.stdout:5838 punch from 0x6e6baee to 0x6e6f311, (0x3823 bytes) 2024-09-21T15:10:36.181 INFO:teuthology.orchestra.run.smithi161.stdout:5840 trunc from 0xcbaa2b7 to 0x5c7bf91 2024-09-21T15:10:36.187 INFO:teuthology.orchestra.run.smithi161.stdout:5889 write 0xa6f42aa thru 0xa704167 (0xfebe bytes) 2024-09-21T15:10:36.191 INFO:teuthology.orchestra.run.smithi161.stdout:5676 trunc from 0xd6ca9a9 to 0x86b4d16 2024-09-21T15:10:36.200 INFO:teuthology.orchestra.run.smithi161.stdout:5274 punch from 0x4546682 to 0x4554dcc, (0xe74a bytes) 2024-09-21T15:10:36.237 INFO:teuthology.orchestra.run.smithi161.stdout:5890 write 0x8452d5e thru 0x845937e (0x6621 bytes) 2024-09-21T15:10:36.262 INFO:teuthology.orchestra.run.smithi161.stdout:5891 writesame 0x565905b thru 0x565bf09 data_size 0x13(0x2eaf bytes) 2024-09-21T15:10:36.284 INFO:teuthology.orchestra.run.smithi161.stdout:5892 write 0x5f9defe thru 0x5fa5a6f (0x7b72 bytes) 2024-09-21T15:10:36.304 INFO:teuthology.orchestra.run.smithi161.stdout:5275 write 0x32e0ac9 thru 0x32ec86d (0xbda5 bytes) 2024-09-21T15:10:36.305 INFO:teuthology.orchestra.run.smithi161.stdout:5841 read 0x4c12a02 thru 0x4c142e9 (0x18e8 bytes) 2024-09-21T15:10:36.305 INFO:teuthology.orchestra.run.smithi161.stdout:5842 read 0x2c2932 thru 0x2c96fb (0x6dca bytes) 2024-09-21T15:10:36.305 INFO:teuthology.orchestra.run.smithi161.stdout:5843 punch from 0x1667c23 to 0x166920f, (0x15ec bytes) 2024-09-21T15:10:36.305 INFO:teuthology.orchestra.run.smithi161.stdout:5844 punch from 0x4d6e6a2 to 0x4d6ff1f, (0x187d bytes) 2024-09-21T15:10:36.305 INFO:teuthology.orchestra.run.smithi161.stdout:5678 read 0x65fafc thru 0x66c178 (0xc67d bytes) 2024-09-21T15:10:36.305 INFO:teuthology.orchestra.run.smithi161.stdout:5679 writesame 0x3829c2 thru 0x3863df data_size 0x2b(0x3a1e bytes) 2024-09-21T15:10:36.309 INFO:teuthology.orchestra.run.smithi161.stdout:5893 read 0xd256a5 thru 0xd3120c (0xbb68 bytes) 2024-09-21T15:10:36.309 INFO:teuthology.orchestra.run.smithi161.stdout:5894 write 0x7b8cb30 thru 0x7b96e47 (0xa318 bytes) 2024-09-21T15:10:36.316 INFO:teuthology.orchestra.run.smithi161.stdout:5680 punch from 0x77ddc20 to 0x77ea860, (0xcc40 bytes) 2024-09-21T15:10:36.316 INFO:teuthology.orchestra.run.smithi161.stdout:5681 read 0x7e8d820 thru 0x7e9684c (0x902d bytes) 2024-09-21T15:10:36.316 INFO:teuthology.orchestra.run.smithi161.stdout:5682 read 0x1432bc4 thru 0x1442978 (0xfdb5 bytes) 2024-09-21T15:10:36.316 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.316 INFO:teuthology.orchestra.run.smithi161.stdout:5684 punch from 0x26a3959 to 0x26b30e4, (0xf78b bytes) 2024-09-21T15:10:36.319 INFO:teuthology.orchestra.run.smithi161.stdout:5685 trunc from 0x86b4d16 to 0x9db2a21 2024-09-21T15:10:36.336 INFO:teuthology.orchestra.run.smithi161.stdout:5895 punch from 0x529ed8b to 0x52a23e9, (0x365e bytes) 2024-09-21T15:10:36.337 INFO:teuthology.orchestra.run.smithi161.stdout:5896 read 0x3ce0ed5 thru 0x3ce423f (0x336b bytes) 2024-09-21T15:10:36.337 INFO:teuthology.orchestra.run.smithi161.stdout:5897 writesame 0x6307635 thru 0x6315d02 data_size 0x1f(0xe6ce bytes) 2024-09-21T15:10:36.353 INFO:teuthology.orchestra.run.smithi161.stdout:5845 writesame 0x8776a4d thru 0x877b06a data_size 0xa(0x461e bytes) 2024-09-21T15:10:36.358 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.358 INFO:teuthology.orchestra.run.smithi161.stdout:5847 write 0x15c3096 thru 0x15c359b (0x506 bytes) 2024-09-21T15:10:36.358 INFO:teuthology.orchestra.run.smithi161.stdout:5276 write 0x87ad966 thru 0x87b0b94 (0x322f bytes) 2024-09-21T15:10:36.369 INFO:teuthology.orchestra.run.smithi161.stdout:5898 write 0x63f870b thru 0x6404bcf (0xc4c5 bytes) 2024-09-21T15:10:36.397 INFO:teuthology.orchestra.run.smithi161.stdout:5899 trunc from 0xa704168 to 0x1f6421b 2024-09-21T15:10:36.398 INFO:teuthology.orchestra.run.smithi161.stdout:5686 write 0xb646056 thru 0xb647bcf (0x1b7a bytes) 2024-09-21T15:10:36.417 INFO:teuthology.orchestra.run.smithi161.stdout:5687 punch from 0x4d4b01b to 0x4d53b37, (0x8b1c bytes) 2024-09-21T15:10:36.417 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.417 INFO:teuthology.orchestra.run.smithi161.stdout:5689 read 0x5f47637 thru 0x5f54d68 (0xd732 bytes) 2024-09-21T15:10:36.417 INFO:teuthology.orchestra.run.smithi161.stdout:5690 write 0x76280bb thru 0x762a25e (0x21a4 bytes) 2024-09-21T15:10:36.427 INFO:teuthology.orchestra.run.smithi161.stdout:5277 writesame 0x57252b7 thru 0x572d91c data_size 0x1(0x8666 bytes) 2024-09-21T15:10:36.435 INFO:teuthology.orchestra.run.smithi161.stdout:5849 writesame 0xdef76f7 thru 0xdf042ad data_size 0xb(0xcbb7 bytes) 2024-09-21T15:10:36.439 INFO:teuthology.orchestra.run.smithi161.stdout:5853 read 0x211069c thru 0x211d710 (0xd075 bytes) 2024-09-21T15:10:36.440 INFO:teuthology.orchestra.run.smithi161.stdout:5855 punch from 0x4d8e356 to 0x4d988d6, (0xa580 bytes) 2024-09-21T15:10:36.440 INFO:teuthology.orchestra.run.smithi161.stdout:5857 read 0x26410ec thru 0x26428fe (0x1813 bytes) 2024-09-21T15:10:36.440 INFO:teuthology.orchestra.run.smithi161.stdout:5858 writesame 0x4945b2e thru 0x494d93a data_size 0x17(0x7e0d bytes) 2024-09-21T15:10:36.453 INFO:teuthology.orchestra.run.smithi161.stdout:5859 writesame 0x101b330 thru 0x1021443 data_size 0x6d(0x6114 bytes) 2024-09-21T15:10:36.473 INFO:teuthology.orchestra.run.smithi161.stdout:5279 write 0xd68b288 thru 0xd691768 (0x64e1 bytes) 2024-09-21T15:10:36.478 INFO:teuthology.orchestra.run.smithi161.stdout:5860 trunc from 0xdf042ae to 0xb73dce5 2024-09-21T15:10:36.491 INFO:teuthology.orchestra.run.smithi161.stdout:5691 write 0xb906f98 thru 0xb90a224 (0x328d bytes) 2024-09-21T15:10:36.498 INFO:teuthology.orchestra.run.smithi161.stdout:5901 read 0xe746ca thru 0xe7a5b0 (0x5ee7 bytes) 2024-09-21T15:10:36.538 INFO:teuthology.orchestra.run.smithi161.stdout:5280 trunc from 0xe5df2d1 to 0x8dad5fe 2024-09-21T15:10:36.549 INFO:teuthology.orchestra.run.smithi161.stdout:5692 write 0x2c1b1dc thru 0x2c21967 (0x678c bytes) 2024-09-21T15:10:36.565 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #47, image image_cluster1.client.mirror.3-clone47 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent48 2024-09-21T15:10:36.587 INFO:teuthology.orchestra.run.smithi161.stdout:5904 writesame 0xa031bb0 thru 0xa0352f1 data_size 0xb(0x3742 bytes) 2024-09-21T15:10:36.591 INFO:teuthology.orchestra.run.smithi161.stdout:5693 punch from 0x1c7577d to 0x1c82cda, (0xd55d bytes) 2024-09-21T15:10:36.591 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.593 INFO:teuthology.orchestra.run.smithi161.stdout:5861 punch from 0x97b2bac to 0x97c1d53, (0xf1a7 bytes) 2024-09-21T15:10:36.594 INFO:teuthology.orchestra.run.smithi161.stdout:5905 write 0x51140e9 thru 0x5119825 (0x573d bytes) 2024-09-21T15:10:36.652 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.666 INFO:teuthology.orchestra.run.smithi161.stdout:5695 write 0xc2d9760 thru 0xc2e656e (0xce0f bytes) 2024-09-21T15:10:36.686 INFO:teuthology.orchestra.run.smithi161.stdout:4598 punch from 0x1815ba5 to 0x1819fac, (0x4407 bytes) 2024-09-21T15:10:36.693 INFO:teuthology.orchestra.run.smithi161.stdout:5863 writesame 0xde356e9 thru 0xde3b9e5 data_size 0x1(0x62fd bytes) 2024-09-21T15:10:36.700 INFO:teuthology.orchestra.run.smithi161.stdout:5865 clone 39 order 25 su 8388608 sc 6 2024-09-21T15:10:36.715 INFO:teuthology.orchestra.run.smithi161.stdout:5910 write 0xa704c21 thru 0xa7066d6 (0x1ab6 bytes) 2024-09-21T15:10:36.720 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.722 INFO:teuthology.orchestra.run.smithi161.stdout:4599 read 0x2b97b29 thru 0x2ba638c (0xe864 bytes) 2024-09-21T15:10:36.723 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.723 INFO:teuthology.orchestra.run.smithi161.stdout:4601 punch from 0x1e09f1c to 0x1e0d478, (0x355c bytes) 2024-09-21T15:10:36.724 INFO:teuthology.orchestra.run.smithi161.stdout:4603 read 0x1704d8d thru 0x170fb85 (0xadf9 bytes) 2024-09-21T15:10:36.727 INFO:teuthology.orchestra.run.smithi161.stdout:5911 read 0x8c6f5ac thru 0x8c7ca66 (0xd4bb bytes) 2024-09-21T15:10:36.730 INFO:teuthology.orchestra.run.smithi161.stdout:5281 read 0x87b0c1b thru 0x87b2f67 (0x234d bytes) 2024-09-21T15:10:36.731 INFO:teuthology.orchestra.run.smithi161.stdout:5283 punch from 0x1d3e568 to 0x1d47617, (0x90af bytes) 2024-09-21T15:10:36.731 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.731 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.740 INFO:teuthology.orchestra.run.smithi161.stdout:5697 trunc from 0xc2e656f to 0x461b350 2024-09-21T15:10:36.741 INFO:teuthology.orchestra.run.smithi161.stdout:5286 trunc from 0x8dad5fe to 0x57b761d 2024-09-21T15:10:36.741 INFO:teuthology.orchestra.run.smithi161.stdout:4604 trunc from 0x5276a5d to 0xb9b35f9 2024-09-21T15:10:36.792 INFO:teuthology.orchestra.run.smithi161.stdout:4605 read 0xd77a15 thru 0xd80ac7 (0x90b3 bytes) 2024-09-21T15:10:36.792 INFO:teuthology.orchestra.run.smithi161.stdout:5912 write 0xd1bde98 thru 0xd1c23a6 (0x450f bytes) 2024-09-21T15:10:36.793 INFO:teuthology.orchestra.run.smithi161.stdout:4606 writesame 0x3a3f7d4 thru 0x3a41c49 data_size 0xd(0x2476 bytes) 2024-09-21T15:10:36.798 INFO:teuthology.orchestra.run.smithi161.stdout:5287 read 0x3ee8876 thru 0x3ef3e60 (0xb5eb bytes) 2024-09-21T15:10:36.802 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.802 INFO:teuthology.orchestra.run.smithi161.stdout:5290 read 0x527cba0 thru 0x528c714 (0xfb75 bytes) 2024-09-21T15:10:36.814 INFO:teuthology.orchestra.run.smithi161.stdout:5293 trunc from 0x57b761d to 0xb451fc2 2024-09-21T15:10:36.816 INFO:teuthology.orchestra.run.smithi161.stdout:5913 writesame 0x6093bf5 thru 0x609910d data_size 0x1(0x5519 bytes) 2024-09-21T15:10:36.870 INFO:teuthology.orchestra.run.smithi161.stdout:5698 read 0x28dfaed thru 0x28e4222 (0x4736 bytes) 2024-09-21T15:10:36.871 INFO:teuthology.orchestra.run.smithi161.stdout:5699 write 0x3d575c8 thru 0x3d5c1b7 (0x4bf0 bytes) 2024-09-21T15:10:36.885 INFO:teuthology.orchestra.run.smithi161.stdout:5914 writesame 0xc034323 thru 0xc03508d data_size 0x5(0xd6b bytes) 2024-09-21T15:10:36.886 INFO:teuthology.orchestra.run.smithi161.stdout:5294 punch from 0x4a7d19f to 0x4a8c390, (0xf1f1 bytes) 2024-09-21T15:10:36.886 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.886 INFO:teuthology.orchestra.run.smithi161.stdout:5296 write 0x6e1fcec thru 0x6e20fe8 (0x12fd bytes) 2024-09-21T15:10:36.907 INFO:teuthology.orchestra.run.smithi161.stdout:5915 read 0xc2511de thru 0xc257c6a (0x6a8d bytes) 2024-09-21T15:10:36.907 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.907 INFO:teuthology.orchestra.run.smithi161.stdout:5919 write 0xa7b588 thru 0xa7c70b (0x1184 bytes) 2024-09-21T15:10:36.909 INFO:teuthology.orchestra.run.smithi161.stdout:5700 trunc from 0x461b350 to 0x8fb5a35 2024-09-21T15:10:36.910 INFO:teuthology.orchestra.run.smithi161.stdout:4607 read 0x3a87816 thru 0x3a8cfbb (0x57a6 bytes) 2024-09-21T15:10:36.911 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.911 INFO:teuthology.orchestra.run.smithi161.stdout:4610 write 0x403a90 thru 0x40c984 (0x8ef5 bytes) 2024-09-21T15:10:36.923 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.923 INFO:teuthology.orchestra.run.smithi161.stdout:5922 read 0x758ce41 thru 0x759c1a6 (0xf366 bytes) 2024-09-21T15:10:36.923 INFO:teuthology.orchestra.run.smithi161.stdout:5923 write 0x3e52932 thru 0x3e531e8 (0x8b7 bytes) 2024-09-21T15:10:36.964 INFO:teuthology.orchestra.run.smithi161.stdout:5924 write 0x1ed4d47 thru 0x1ee337f (0xe639 bytes) 2024-09-21T15:10:36.966 INFO:teuthology.orchestra.run.smithi161.stdout:5297 writesame 0xbef15b0 thru 0xbefc25a data_size 0x1(0xacab bytes) 2024-09-21T15:10:36.971 INFO:teuthology.orchestra.run.smithi161.stdout:5299 read 0x9bf821f thru 0x9c00295 (0x8077 bytes) 2024-09-21T15:10:36.972 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:36.972 INFO:teuthology.orchestra.run.smithi161.stdout:5301 read 0x2fa223b thru 0x2fad95a (0xb720 bytes) 2024-09-21T15:10:36.984 INFO:teuthology.orchestra.run.smithi161.stdout:5702 trunc from 0x8fb5a35 to 0xdd00658 2024-09-21T15:10:36.991 INFO:teuthology.orchestra.run.smithi161.stdout:5302 trunc from 0xbefc25b to 0x213fa47 2024-09-21T15:10:37.019 INFO:teuthology.orchestra.run.smithi161.stdout:5925 writesame 0x26d1cae thru 0x26d3439 data_size 0xb(0x178c bytes) 2024-09-21T15:10:37.029 INFO:teuthology.orchestra.run.smithi161.stdout:5703 write 0xb9c1718 thru 0xb9d0e3d (0xf726 bytes) 2024-09-21T15:10:37.036 INFO:teuthology.orchestra.run.smithi161.stdout:5926 punch from 0x5e031ed to 0x5e11380, (0xe193 bytes) 2024-09-21T15:10:37.036 INFO:teuthology.orchestra.run.smithi161.stdout:5928 punch from 0xe9de81 to 0xeab5ed, (0xd76c bytes) 2024-09-21T15:10:37.036 INFO:teuthology.orchestra.run.smithi161.stdout:5930 punch from 0xb280b17 to 0xb28d37e, (0xc867 bytes) 2024-09-21T15:10:37.068 INFO:teuthology.orchestra.run.smithi161.stdout:5704 write 0x5e59f88 thru 0x5e5e2b6 (0x432f bytes) 2024-09-21T15:10:37.071 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.072 INFO:teuthology.orchestra.run.smithi161.stdout:4613 write 0x563443 thru 0x56cab4 (0x9672 bytes) 2024-09-21T15:10:37.086 INFO:teuthology.orchestra.run.smithi161.stdout:5303 trunc from 0x213fa47 to 0xc15aa7f 2024-09-21T15:10:37.090 INFO:teuthology.orchestra.run.smithi161.stdout:5931 write 0xeb5d570 thru 0xeb6092e (0x33bf bytes) 2024-09-21T15:10:37.094 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.094 INFO:teuthology.orchestra.run.smithi161.stdout:5706 punch from 0x5405dac to 0x540d076, (0x72ca bytes) 2024-09-21T15:10:37.095 INFO:teuthology.orchestra.run.smithi161.stdout:5707 punch from 0xa5a02d9 to 0xa5ad389, (0xd0b0 bytes) 2024-09-21T15:10:37.095 INFO:teuthology.orchestra.run.smithi161.stdout:5708 write 0x80d3403 thru 0x80db712 (0x8310 bytes) 2024-09-21T15:10:37.132 INFO:teuthology.orchestra.run.smithi161.stdout:5709 write 0x72b35df thru 0x72b57d9 (0x21fb bytes) 2024-09-21T15:10:37.134 INFO:teuthology.orchestra.run.smithi161.stdout:5306 read 0x6277ffe thru 0x627d71e (0x5721 bytes) 2024-09-21T15:10:37.134 INFO:teuthology.orchestra.run.smithi161.stdout:5307 write 0x1ebc6ad thru 0x1ebe7d8 (0x212c bytes) 2024-09-21T15:10:37.142 INFO:teuthology.orchestra.run.smithi161.stdout:5932 trunc from 0xeb6092f to 0x232a12f 2024-09-21T15:10:37.145 INFO:teuthology.orchestra.run.smithi161.stdout:5308 write 0x8bd3f1b thru 0x8be292d (0xea13 bytes) 2024-09-21T15:10:37.149 INFO:teuthology.orchestra.run.smithi161.stdout:5712 read 0xa0611ad thru 0xa061f6b (0xdbf bytes) 2024-09-21T15:10:37.149 INFO:teuthology.orchestra.run.smithi161.stdout:5714 read 0x9e47ccd thru 0x9e565c8 (0xe8fc bytes) 2024-09-21T15:10:37.150 INFO:teuthology.orchestra.run.smithi161.stdout:5716 read 0x6a2c42 thru 0x6a7e75 (0x5234 bytes) 2024-09-21T15:10:37.150 INFO:teuthology.orchestra.run.smithi161.stdout:5717 read 0x3074c3b thru 0x307e48b (0x9851 bytes) 2024-09-21T15:10:37.150 INFO:teuthology.orchestra.run.smithi161.stdout:5718 write 0xab96e7d thru 0xab9b53f (0x46c3 bytes) 2024-09-21T15:10:37.163 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.163 INFO:teuthology.orchestra.run.smithi161.stdout:4616 writesame 0x7cbbcd0 thru 0x7cc5524 data_size 0x15(0x9855 bytes) 2024-09-21T15:10:37.164 INFO:teuthology.orchestra.run.smithi161.stdout:5309 read 0x2576f9d thru 0x2579d13 (0x2d77 bytes) 2024-09-21T15:10:37.164 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.165 INFO:teuthology.orchestra.run.smithi161.stdout:5311 write 0x4901a4c thru 0x4901b41 (0xf6 bytes) 2024-09-21T15:10:37.177 INFO:teuthology.orchestra.run.smithi161.stdout:5719 read 0x408ffff thru 0x4090fb0 (0xfb2 bytes) 2024-09-21T15:10:37.177 INFO:teuthology.orchestra.run.smithi161.stdout:5720 write 0x4c034b6 thru 0x4c0c280 (0x8dcb bytes) 2024-09-21T15:10:37.179 INFO:teuthology.orchestra.run.smithi161.stdout:5312 write 0x61c0cce thru 0x61c63ae (0x56e1 bytes) 2024-09-21T15:10:37.184 INFO:teuthology.orchestra.run.smithi161.stdout:4617 punch from 0x8387ab1 to 0x8389118, (0x1667 bytes) 2024-09-21T15:10:37.184 INFO:teuthology.orchestra.run.smithi161.stdout:4618 punch from 0x965f06 to 0x96d5cd, (0x76c7 bytes) 2024-09-21T15:10:37.185 INFO:teuthology.orchestra.run.smithi161.stdout:4619 write 0x14c151e thru 0x14c1c34 (0x717 bytes) 2024-09-21T15:10:37.192 INFO:teuthology.orchestra.run.smithi161.stdout:5313 write 0x3041b3b thru 0x304dc1b (0xc0e1 bytes) 2024-09-21T15:10:37.208 INFO:teuthology.orchestra.run.smithi161.stdout:5314 write 0xa6276b5 thru 0xa634a5a (0xd3a6 bytes) 2024-09-21T15:10:37.214 INFO:teuthology.orchestra.run.smithi161.stdout:5721 write 0x9cebfbf thru 0x9cf5e2c (0x9e6e bytes) 2024-09-21T15:10:37.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.214+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e618600 finish: resending after timeout 2024-09-21T15:10:37.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.214+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e807740 finish: resending after timeout 2024-09-21T15:10:37.217 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.214+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f9ec0 finish: resending after timeout 2024-09-21T15:10:37.218 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.218+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e4fdd40 finish: resending after timeout 2024-09-21T15:10:37.218 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.218+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f8d80 finish: resending after timeout 2024-09-21T15:10:37.219 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.218+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a7980 finish: resending after timeout 2024-09-21T15:10:37.219 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.218+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e6183c0 finish: resending after timeout 2024-09-21T15:10:37.220 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.218+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a5520300 finish: resending after timeout 2024-09-21T15:10:37.220 INFO:teuthology.orchestra.run.smithi161.stdout:5933 read 0x1759a79 thru 0x176316b (0x96f3 bytes) 2024-09-21T15:10:37.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.226+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560b40 finish: resending after timeout 2024-09-21T15:10:37.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.226+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc6c0 finish: resending after timeout 2024-09-21T15:10:37.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.226+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0d80 finish: resending after timeout 2024-09-21T15:10:37.231 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.230+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a69c0 finish: resending after timeout 2024-09-21T15:10:37.231 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.230+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:10:37.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.230+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a6480 finish: resending after timeout 2024-09-21T15:10:37.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.230+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a55206c0 finish: resending after timeout 2024-09-21T15:10:37.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.230+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ab14b680 finish: resending after timeout 2024-09-21T15:10:37.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bd800 finish: resending after timeout 2024-09-21T15:10:37.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc300 finish: resending after timeout 2024-09-21T15:10:37.234 INFO:teuthology.orchestra.run.smithi161.stdout:5934 trunc from 0x232a12f to 0x8269c10 2024-09-21T15:10:37.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43a40 finish: resending after timeout 2024-09-21T15:10:37.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c420c0 finish: resending after timeout 2024-09-21T15:10:37.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:37.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43140 finish: resending after timeout 2024-09-21T15:10:37.247 INFO:teuthology.orchestra.run.smithi161.stdout:5722 read 0x399afee thru 0x39a767b (0xc68e bytes) 2024-09-21T15:10:37.248 INFO:teuthology.orchestra.run.smithi161.stdout:5723 punch from 0x95d53 to 0x9a3ee, (0x469b bytes) 2024-09-21T15:10:37.248 INFO:teuthology.orchestra.run.smithi161.stdout:5724 read 0x5bccf10 thru 0x5bd39b9 (0x6aaa bytes) 2024-09-21T15:10:37.248 INFO:teuthology.orchestra.run.smithi161.stdout:5725 read 0x34a757d thru 0x34aa7e8 (0x326c bytes) 2024-09-21T15:10:37.248 INFO:teuthology.orchestra.run.smithi161.stdout:5726 writesame 0x11f2a82 thru 0x11f521b data_size 0x2(0x279a bytes) 2024-09-21T15:10:37.254 INFO:teuthology.orchestra.run.smithi161.stdout:4621 writesame 0x5c2a859 thru 0x5c39965 data_size 0x1(0xf10d bytes) 2024-09-21T15:10:37.271 INFO:teuthology.orchestra.run.smithi161.stdout:5729 write 0x63f3c7c thru 0x6402793 (0xeb18 bytes) 2024-09-21T15:10:37.279 INFO:teuthology.orchestra.run.smithi161.stdout:5315 write 0xc5dd7ac thru 0xc5e0f52 (0x37a7 bytes) 2024-09-21T15:10:37.280 INFO:teuthology.orchestra.run.smithi161.stdout:5935 read 0x6fed0f3 thru 0x6ff41ee (0x70fc bytes) 2024-09-21T15:10:37.280 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.291 INFO:teuthology.orchestra.run.smithi161.stdout:5937 trunc from 0x8269c10 to 0xd783992 2024-09-21T15:10:37.301 INFO:teuthology.orchestra.run.smithi161.stdout:5316 read 0x29f18c7 thru 0x29f5f69 (0x46a3 bytes) 2024-09-21T15:10:37.302 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.315 INFO:teuthology.orchestra.run.smithi161.stdout:4623 punch from 0x8cae490 to 0x8cbbed0, (0xda40 bytes) 2024-09-21T15:10:37.315 INFO:teuthology.orchestra.run.smithi161.stdout:4626 read 0x23df0e5 thru 0x23eb70c (0xc628 bytes) 2024-09-21T15:10:37.316 INFO:teuthology.orchestra.run.smithi161.stdout:4627 writesame 0x719ace0 thru 0x71a3d1b data_size 0x33(0x903c bytes) 2024-09-21T15:10:37.321 INFO:teuthology.orchestra.run.smithi161.stdout:5731 writesame 0x6b53f4c thru 0x6b554e1 data_size 0x3(0x1596 bytes) 2024-09-21T15:10:37.334 INFO:teuthology.orchestra.run.smithi161.stdout:5938 writesame 0x436351 thru 0x43a943 data_size 0x3(0x45f3 bytes) 2024-09-21T15:10:37.335 INFO:teuthology.orchestra.run.smithi161.stdout:4628 write 0xa2c1450 thru 0xa2c1c11 (0x7c2 bytes) 2024-09-21T15:10:37.342 INFO:teuthology.orchestra.run.smithi161.stdout:5732 punch from 0x68a09d0 to 0x68a2ab3, (0x20e3 bytes) 2024-09-21T15:10:37.342 INFO:teuthology.orchestra.run.smithi161.stdout:5733 read 0x3388fec thru 0x338b4b5 (0x24ca bytes) 2024-09-21T15:10:37.345 INFO:teuthology.orchestra.run.smithi161.stdout:5734 trunc from 0xdd00658 to 0xcc1925e 2024-09-21T15:10:37.346 INFO:teuthology.orchestra.run.smithi161.stdout:5318 writesame 0xd17e50a thru 0xd1838d2 data_size 0x1(0x53c9 bytes) 2024-09-21T15:10:37.351 INFO:teuthology.orchestra.run.smithi161.stdout:5319 write 0x6142077 thru 0x61466c0 (0x464a bytes) 2024-09-21T15:10:37.355 INFO:teuthology.orchestra.run.smithi161.stdout:5939 read 0xa258ae7 thru 0xa264af7 (0xc011 bytes) 2024-09-21T15:10:37.367 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.367 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.368 INFO:teuthology.orchestra.run.smithi161.stdout:5322 write 0xc47f5a2 thru 0xc4855f6 (0x6055 bytes) 2024-09-21T15:10:37.370 INFO:teuthology.orchestra.run.smithi161.stdout:5940 trunc from 0xd783992 to 0x6b7035c 2024-09-21T15:10:37.378 INFO:teuthology.orchestra.run.smithi161.stdout:5323 punch from 0x3c221fa to 0x3c23a41, (0x1847 bytes) 2024-09-21T15:10:37.380 INFO:teuthology.orchestra.run.smithi161.stdout:5736 read 0x3feb477 thru 0x3ff1f7f (0x6b09 bytes) 2024-09-21T15:10:37.380 INFO:teuthology.orchestra.run.smithi161.stdout:5737 punch from 0x23640b4 to 0x2372bf2, (0xeb3e bytes) 2024-09-21T15:10:37.388 INFO:teuthology.orchestra.run.smithi161.stdout:5324 trunc from 0xd1838d3 to 0x8c4a17f 2024-09-21T15:10:37.406 INFO:teuthology.orchestra.run.smithi161.stdout:4629 write 0xce17912 thru 0xce205c0 (0x8caf bytes) 2024-09-21T15:10:37.414 INFO:teuthology.orchestra.run.smithi161.stdout:5941 punch from 0x24758bd to 0x24764c7, (0xc0a bytes) 2024-09-21T15:10:37.418 INFO:teuthology.orchestra.run.smithi161.stdout:5738 writesame 0xde6e8ce thru 0xde7bca4 data_size 0x1(0xd3d7 bytes) 2024-09-21T15:10:37.435 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.448 INFO:teuthology.orchestra.run.smithi161.stdout:5739 trunc from 0xde7bca5 to 0x454863d 2024-09-21T15:10:37.451 INFO:teuthology.orchestra.run.smithi161.stdout:4631 trunc from 0xce205c1 to 0x4e50a82 2024-09-21T15:10:37.456 INFO:teuthology.orchestra.run.smithi161.stdout:5326 punch from 0x7edc6c7 to 0x7ee378c, (0x70c5 bytes) 2024-09-21T15:10:37.456 INFO:teuthology.orchestra.run.smithi161.stdout:5327 read 0x257b09 thru 0x266c40 (0xf138 bytes) 2024-09-21T15:10:37.458 INFO:teuthology.orchestra.run.smithi161.stdout:5328 punch from 0x85d1e37 to 0x85d69e1, (0x4baa bytes) 2024-09-21T15:10:37.458 INFO:teuthology.orchestra.run.smithi161.stdout:5330 write 0x7b4d6ac thru 0x7b550d3 (0x7a28 bytes) 2024-09-21T15:10:37.459 INFO:teuthology.orchestra.run.smithi161.stdout:5943 writesame 0xa7f909d thru 0xa808db9 data_size 0x1(0xfd1d bytes) 2024-09-21T15:10:37.468 INFO:teuthology.orchestra.run.smithi161.stdout:5944 punch from 0x1396536 to 0x13a43ad, (0xde77 bytes) 2024-09-21T15:10:37.468 INFO:teuthology.orchestra.run.smithi161.stdout:5949 read 0x7afbd7f thru 0x7aff607 (0x3889 bytes) 2024-09-21T15:10:37.477 INFO:teuthology.orchestra.run.smithi161.stdout:5950 trunc from 0xa808dba to 0x5e21a6d 2024-09-21T15:10:37.484 INFO:teuthology.orchestra.run.smithi161.stdout:5331 write 0xe0326e thru 0xe08e12 (0x5ba5 bytes) 2024-09-21T15:10:37.525 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.526 INFO:teuthology.orchestra.run.smithi161.stdout:5953 writesame 0xa89e51 thru 0xa96770 data_size 0x1(0xc920 bytes) 2024-09-21T15:10:37.541 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.541 INFO:teuthology.orchestra.run.smithi161.stdout:5741 punch from 0x30023ab to 0x3007f47, (0x5b9c bytes) 2024-09-21T15:10:37.541 INFO:teuthology.orchestra.run.smithi161.stdout:5742 punch from 0x37b9246 to 0x37bf3cf, (0x6189 bytes) 2024-09-21T15:10:37.541 INFO:teuthology.orchestra.run.smithi161.stdout:5744 write 0x2cb1261 thru 0x2cc0d34 (0xfad4 bytes) 2024-09-21T15:10:37.571 INFO:teuthology.orchestra.run.smithi161.stdout:5954 read 0x41e44b9 thru 0x41e6b1e (0x2666 bytes) 2024-09-21T15:10:37.571 INFO:teuthology.orchestra.run.smithi161.stdout:5955 read 0xdcf0 thru 0xef46 (0x1257 bytes) 2024-09-21T15:10:37.572 INFO:teuthology.orchestra.run.smithi161.stdout:5957 write 0x5d3bc1f thru 0x5d48142 (0xc524 bytes) 2024-09-21T15:10:37.597 INFO:teuthology.orchestra.run.smithi161.stdout:5333 writesame 0xc7cca15 thru 0xc7d24b0 data_size 0x6(0x5a9c bytes) 2024-09-21T15:10:37.597 INFO:teuthology.orchestra.run.smithi161.stdout:5746 write 0x3472239 thru 0x347fd43 (0xdb0b bytes) 2024-09-21T15:10:37.618 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.618 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.632 INFO:teuthology.orchestra.run.smithi161.stdout:5748 trunc from 0x454863d to 0x2baf15d 2024-09-21T15:10:37.640 INFO:teuthology.orchestra.run.smithi161.stdout:5959 writesame 0x70ba58e thru 0x70c6045 data_size 0x32(0xbab8 bytes) 2024-09-21T15:10:37.662 INFO:teuthology.orchestra.run.smithi161.stdout:4634 write 0x8a479bb thru 0x8a54578 (0xcbbe bytes) 2024-09-21T15:10:37.667 INFO:teuthology.orchestra.run.smithi161.stdout:5334 write 0xeca0165 thru 0xeca04a8 (0x344 bytes) 2024-09-21T15:10:37.685 INFO:teuthology.orchestra.run.smithi161.stdout:5335 writesame 0x96586bc thru 0x965ecbc data_size 0x1(0x6601 bytes) 2024-09-21T15:10:37.691 INFO:teuthology.orchestra.run.smithi161.stdout:4635 punch from 0x61c4e0f to 0x61d2f00, (0xe0f1 bytes) 2024-09-21T15:10:37.692 INFO:teuthology.orchestra.run.smithi161.stdout:4636 read 0x6a48c22 thru 0x6a4b2cd (0x26ac bytes) 2024-09-21T15:10:37.704 INFO:teuthology.orchestra.run.smithi161.stdout:5960 writesame 0x7cedbc3 thru 0x7cf9785 data_size 0x1(0xbbc3 bytes) 2024-09-21T15:10:37.714 INFO:teuthology.orchestra.run.smithi161.stdout:5336 read 0x5cc3afd thru 0x5cce9de (0xaee2 bytes) 2024-09-21T15:10:37.716 INFO:teuthology.orchestra.run.smithi161.stdout:5337 flatten 2024-09-21T15:10:37.740 INFO:teuthology.orchestra.run.smithi161.stdout:4637 write 0xa32365a thru 0xa32bf68 (0x890f bytes) 2024-09-21T15:10:37.762 INFO:teuthology.orchestra.run.smithi161.stdout:4638 trunc from 0xa32bf69 to 0x9d10114 2024-09-21T15:10:37.766 INFO:teuthology.orchestra.run.smithi161.stdout:5962 write 0x888c420 thru 0x889a411 (0xdff2 bytes) 2024-09-21T15:10:37.785 INFO:teuthology.orchestra.run.smithi161.stdout:5963 read 0x79f17ed thru 0x79f2ccd (0x14e1 bytes) 2024-09-21T15:10:37.804 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.804 INFO:teuthology.orchestra.run.smithi161.stdout:5339 read 0x7437373 thru 0x74457e9 (0xe477 bytes) 2024-09-21T15:10:37.807 INFO:teuthology.orchestra.run.smithi161.stdout:5341 write 0xabea957 thru 0xabedc77 (0x3321 bytes) 2024-09-21T15:10:37.808 INFO:teuthology.orchestra.run.smithi161.stdout:5749 write 0x77f2213 thru 0x77f95b7 (0x73a5 bytes) 2024-09-21T15:10:37.813 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:37.806+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:10:37.813 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:37.806+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:10:37.813 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:37.810+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:10:37.814 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:37.810+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:10:37.814 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:37.810+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:10:37.814 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:37.810+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:10:37.814 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:37.810+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:10:37.814 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:37.810+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:10:37.814 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:37.810+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:10:37.814 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:37.810+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:10:37.814 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:37.810+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:10:37.830 INFO:teuthology.orchestra.run.smithi161.stdout:5342 trunc from 0xeca04a9 to 0xc5b179d 2024-09-21T15:10:37.834 INFO:teuthology.orchestra.run.smithi161.stdout:5964 write 0x8f4e16f thru 0x8f5cac6 (0xe958 bytes) 2024-09-21T15:10:37.850 INFO:teuthology.orchestra.run.smithi161.stdout:5750 writesame 0x238d8b6 thru 0x2396b0e data_size 0x3b(0x9259 bytes) 2024-09-21T15:10:37.852 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone38 from 0xde3b9e6 (overlap 0x86b07a) to 0x6bc061 2024-09-21T15:10:37.862 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.854+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:10:37.876 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.870+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:10:37.876 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.870+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:10:37.876 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.874+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:10:37.876 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.874+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:10:37.876 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.874+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:10:37.876 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.874+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:10:37.877 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.874+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:10:37.877 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.874+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:10:37.877 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.874+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:10:37.877 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.874+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:10:37.877 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.874+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:10:37.877 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.887 INFO:teuthology.orchestra.run.smithi161.stdout:5344 read 0x26004c1 thru 0x260ce31 (0xc971 bytes) 2024-09-21T15:10:37.889 INFO:teuthology.orchestra.run.smithi161.stdout:5345 writesame 0xc007a15 thru 0xc012ea5 data_size 0x2b(0xb491 bytes) 2024-09-21T15:10:37.890 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.882+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:10:37.890 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.882+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:10:37.890 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.882+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:10:37.890 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.882+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:10:37.890 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.882+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:10:37.890 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.882+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:10:37.890 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.882+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:10:37.890 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.882+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:10:37.890 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.882+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:10:37.891 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.882+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:10:37.891 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.882+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:10:37.891 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.882+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:10:37.891 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.882+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:10:37.891 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.886+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:10:37.891 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.886+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:10:37.892 INFO:teuthology.orchestra.run.smithi161.stdout:5752 trunc from 0x77f95b8 to 0xa618f3c 2024-09-21T15:10:37.892 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:10:37.893 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:10:37.893 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:10:37.893 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:10:37.893 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:10:37.893 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:10:37.893 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:10:37.893 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:10:37.893 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:10:37.893 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:10:37.893 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:10:37.893 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:10:37.893 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:10:37.893 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:10:37.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:10:37.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:10:37.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:10:37.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:10:37.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:10:37.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:10:37.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:10:37.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:10:37.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:10:37.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:37.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:10:37.898 INFO:teuthology.orchestra.run.smithi161.stdout:5968 writesame 0xaf8304e thru 0xaf89a39 data_size 0x2(0x69ec bytes) 2024-09-21T15:10:37.908 INFO:teuthology.orchestra.run.smithi161.stdout:5346 punch from 0x71f30ea to 0x71f95af, (0x64c5 bytes) 2024-09-21T15:10:37.908 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.927 INFO:teuthology.orchestra.run.smithi161.stdout:5349 trunc from 0xc5b179d to 0x12b5b80 2024-09-21T15:10:37.931 INFO:teuthology.orchestra.run.smithi161.stdout:5970 read 0x1613208 thru 0x1619ddb (0x6bd4 bytes) 2024-09-21T15:10:37.934 INFO:teuthology.orchestra.run.smithi161.stdout:5971 clone 40 order 21 su 131072 sc 14 2024-09-21T15:10:37.935 INFO:teuthology.orchestra.run.smithi161.stdout:4639 writesame 0xa36ddca thru 0xa37b183 data_size 0x29(0xd3ba bytes) 2024-09-21T15:10:37.950 INFO:teuthology.orchestra.run.smithi161.stdout:5753 punch from 0x2cb5cd to 0x2d63ad, (0xade0 bytes) 2024-09-21T15:10:37.990 INFO:teuthology.orchestra.run.smithi161.stdout:4640 write 0xa5c43e6 thru 0xa5cd21e (0x8e39 bytes) 2024-09-21T15:10:37.990 INFO:teuthology.orchestra.run.smithi161.stdout:5755 writesame 0xd53df5b thru 0xd543523 data_size 0x1(0x55c9 bytes) 2024-09-21T15:10:37.999 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:37.999 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:38.004 INFO:teuthology.orchestra.run.smithi161.stdout:4641 punch from 0x44646f7 to 0x447080b, (0xc114 bytes) 2024-09-21T15:10:38.004 INFO:teuthology.orchestra.run.smithi161.stdout:4642 write 0x2696e5a thru 0x269f3a0 (0x8547 bytes) 2024-09-21T15:10:38.011 INFO:teuthology.orchestra.run.smithi161.stdout:5758 trunc from 0xd543524 to 0x5f8ad31 2024-09-21T15:10:38.032 INFO:teuthology.orchestra.run.smithi161.stdout:5352 punch from 0x8fcfec to 0x90a42e, (0xd442 bytes) 2024-09-21T15:10:38.085 INFO:teuthology.orchestra.run.smithi161.stdout:5353 writesame 0xbd41bc5 thru 0xbd4d0aa data_size 0x37(0xb4e6 bytes) 2024-09-21T15:10:38.092 INFO:teuthology.orchestra.run.smithi161.stdout:5354 punch from 0xb57a65d to 0xb584e8e, (0xa831 bytes) 2024-09-21T15:10:38.092 INFO:teuthology.orchestra.run.smithi161.stdout:5355 writesame 0x7d4151 thru 0x7d928d data_size 0x1(0x513d bytes) 2024-09-21T15:10:38.116 INFO:teuthology.orchestra.run.smithi161.stdout:5357 read 0x82c002a thru 0x82c7878 (0x784f bytes) 2024-09-21T15:10:38.116 INFO:teuthology.orchestra.run.smithi161.stdout:5358 clone 45 order 22 su 32768 sc 8 2024-09-21T15:10:38.126 INFO:teuthology.orchestra.run.smithi161.stdout:5759 write 0xea31cce thru 0xea38a7b (0x6dae bytes) 2024-09-21T15:10:38.150 INFO:teuthology.orchestra.run.smithi161.stdout:5760 write 0x58f76a3 thru 0x5905e67 (0xe7c5 bytes) 2024-09-21T15:10:38.177 INFO:teuthology.orchestra.run.smithi161.stdout:5761 write 0xbd9b1e6 thru 0xbda4256 (0x9071 bytes) 2024-09-21T15:10:38.200 INFO:teuthology.orchestra.run.smithi161.stdout:5762 punch from 0x2362f37 to 0x23659e2, (0x2aab bytes) 2024-09-21T15:10:38.200 INFO:teuthology.orchestra.run.smithi161.stdout:5764 writesame 0x6849876 thru 0x6852b05 data_size 0x86(0x9290 bytes) 2024-09-21T15:10:38.203 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #37, image image_cluster1.client.mirror.5-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent38 2024-09-21T15:10:38.217 INFO:teuthology.orchestra.run.smithi161.stdout:5765 read 0x64279ee thru 0x6428417 (0xa2a bytes) 2024-09-21T15:10:38.217 INFO:teuthology.orchestra.run.smithi161.stdout:5768 read 0x7c5c90e thru 0x7c65447 (0x8b3a bytes) 2024-09-21T15:10:38.217 INFO:teuthology.orchestra.run.smithi161.stdout:5769 write 0x688df66 thru 0x689934c (0xb3e7 bytes) 2024-09-21T15:10:38.238 INFO:teuthology.orchestra.run.smithi161.stdout:5771 read 0x1ebf58d thru 0x1ec4655 (0x50c9 bytes) 2024-09-21T15:10:38.238 INFO:teuthology.orchestra.run.smithi161.stdout:5772 punch from 0x572493 to 0x57ad8d, (0x88fa bytes) 2024-09-21T15:10:38.238 INFO:teuthology.orchestra.run.smithi161.stdout:5773 read 0x3fd42c3 thru 0x3fd4470 (0x1ae bytes) 2024-09-21T15:10:38.241 INFO:teuthology.orchestra.run.smithi161.stdout:5775 trunc from 0xea38a7c to 0xdb57013 2024-09-21T15:10:38.264 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.261+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4581e10 2024-09-21T15:10:38.267 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.261+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:10:38.267 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.261+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ef01a0 2024-09-21T15:10:38.272 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.265+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:10:38.272 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.265+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:10:38.273 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.265+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:38.276 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.273+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4581e10 2024-09-21T15:10:38.276 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.273+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:10:38.276 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.273+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ef01a0 2024-09-21T15:10:38.276 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.273+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:10:38.276 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.273+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:38.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.329+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:10:38.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.329+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:10:38.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.329+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4581e10 2024-09-21T15:10:38.334 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.329+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:10:38.341 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.337+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:10:38.341 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.337+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:10:38.341 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.337+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ef01a0 2024-09-21T15:10:38.341 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.337+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:10:38.341 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.337+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:10:38.347 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:10:38.347 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:10:38.347 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:10:38.347 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:10:38.347 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:10:38.347 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:10:38.347 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:10:38.348 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:10:38.361 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.353+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:10:38.361 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.353+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:10:38.361 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.353+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:38.361 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.353+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:10:38.361 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.353+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:10:38.361 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.353+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:10:38.361 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.353+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:10:38.366 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:38.366 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:38.366 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:38.366 INFO:teuthology.orchestra.run.smithi161.stdout:4649 write 0x8d598ed thru 0x8d5b3e3 (0x1af7 bytes) 2024-09-21T15:10:38.368 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.361+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:10:38.368 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.361+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:10:38.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.373+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:10:38.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.373+0000 7f1e9c77a700 -1 reset not still connected to 0x562872bb89c0 2024-09-21T15:10:38.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.373+0000 7f1e9c77a700 -1 reset not still connected to 0x562876d89520 2024-09-21T15:10:38.380 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.373+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:10:38.380 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.373+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3ee0 2024-09-21T15:10:38.380 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.373+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:10:38.381 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.373+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:10:38.381 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.373+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:10:38.381 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.373+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a40415f0 2024-09-21T15:10:38.393 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.385+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:10:38.393 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.385+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:10:38.393 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.385+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4581e10 2024-09-21T15:10:38.393 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.385+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:10:38.393 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.385+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51484e0 2024-09-21T15:10:38.393 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.385+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:10:38.393 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.385+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:10:38.393 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.385+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ef01a0 2024-09-21T15:10:38.394 INFO:teuthology.orchestra.run.smithi161.stdout:4650 read 0x8cb7679 thru 0x8cc5e3a (0xe7c2 bytes) 2024-09-21T15:10:38.394 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:10:38.395 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:10:38.397 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e8f0 2024-09-21T15:10:38.397 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:10:38.397 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:10:38.397 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:10:38.397 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:10:38.397 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:10:38.397 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:10:38.398 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:10:38.398 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:10:38.398 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:10:38.398 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab15d40 2024-09-21T15:10:38.398 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:10:38.398 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:10:38.398 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:10:38.398 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:10:38.398 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:10:38.399 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:10:38.399 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.393+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:10:38.399 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.393+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:10:38.399 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.393+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:10:38.399 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.393+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:38.399 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.393+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:10:38.399 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.393+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:10:38.399 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.393+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:10:38.399 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.393+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:10:38.399 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.393+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:10:38.399 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.393+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:10:38.399 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.393+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:10:38.400 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:38.393+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:10:38.400 INFO:teuthology.orchestra.run.smithi161.stdout:5776 read 0x5f51154 thru 0x5f52715 (0x15c2 bytes) 2024-09-21T15:10:38.424 INFO:teuthology.orchestra.run.smithi161.stdout:5779 trunc from 0xdb57013 to 0x2d68f4e 2024-09-21T15:10:38.428 INFO:teuthology.orchestra.run.smithi161.stdout:4651 clone 50 order 21 su 8192 sc 10 2024-09-21T15:10:38.498 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:38.503 INFO:teuthology.orchestra.run.smithi161.stdout:5781 trunc from 0x2d68f4e to 0x8be1b9 2024-09-21T15:10:38.635 INFO:teuthology.orchestra.run.smithi161.stdout:5782 punch from 0x577603 to 0x579664, (0x2061 bytes) 2024-09-21T15:10:38.696 INFO:teuthology.orchestra.run.smithi161.stdout:5784 write 0xd383603 thru 0xd385ee6 (0x28e4 bytes) 2024-09-21T15:10:38.738 INFO:teuthology.orchestra.run.smithi161.stdout:5785 trunc from 0xd385ee7 to 0x21364b5 2024-09-21T15:10:38.885 INFO:teuthology.orchestra.run.smithi161.stdout:5786 write 0x7854775 thru 0x7858b25 (0x43b1 bytes) 2024-09-21T15:10:38.902 INFO:teuthology.orchestra.run.smithi161.stdout:5788 write 0x369b27c thru 0x369db85 (0x290a bytes) 2024-09-21T15:10:38.930 INFO:teuthology.orchestra.run.smithi161.stdout:5789 punch from 0x1927f82 to 0x192e8bc, (0x693a bytes) 2024-09-21T15:10:38.930 INFO:teuthology.orchestra.run.smithi161.stdout:5790 write 0x761313d thru 0x7615cc6 (0x2b8a bytes) 2024-09-21T15:10:38.994 INFO:teuthology.orchestra.run.smithi161.stdout:5791 write 0xa051caf thru 0xa05963d (0x798f bytes) 2024-09-21T15:10:39.019 INFO:teuthology.orchestra.run.smithi161.stdout:5792 write 0x90579e6 thru 0x9057bdc (0x1f7 bytes) 2024-09-21T15:10:39.031 INFO:teuthology.orchestra.run.smithi161.stdout:5794 read 0x7e2c28c thru 0x7e34c1c (0x8991 bytes) 2024-09-21T15:10:39.032 INFO:teuthology.orchestra.run.smithi161.stdout:5797 read 0x2cd0a00 thru 0x2cd2521 (0x1b22 bytes) 2024-09-21T15:10:39.032 INFO:teuthology.orchestra.run.smithi161.stdout:5799 writesame 0x403b97e thru 0x40435f7 data_size 0x6(0x7c7a bytes) 2024-09-21T15:10:39.075 INFO:teuthology.orchestra.run.smithi161.stdout:5800 trunc from 0xa05963e to 0xb5ffe1 2024-09-21T15:10:39.113 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone49 from 0xa5cd21f (overlap 0x4e50a82) to 0x36d20f4 2024-09-21T15:10:39.219 INFO:teuthology.orchestra.run.smithi161.stdout:5801 read 0x2d7d1f thru 0x2dc6c1 (0x49a3 bytes) 2024-09-21T15:10:39.236 INFO:teuthology.orchestra.run.smithi161.stdout:5802 trunc from 0xb5ffe1 to 0x93147dd 2024-09-21T15:10:39.349 INFO:teuthology.orchestra.run.smithi161.stdout:5866 read 0x9a6570b thru 0x9a70be7 (0xb4dd bytes) 2024-09-21T15:10:39.353 INFO:teuthology.orchestra.run.smithi161.stdout:5803 punch from 0xccbfb0 to 0xcda38a, (0xe3da bytes) 2024-09-21T15:10:39.353 INFO:teuthology.orchestra.run.smithi161.stdout:5805 write 0x5bc502f thru 0x5bc8af6 (0x3ac8 bytes) 2024-09-21T15:10:39.374 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #38, image image_cluster1.client.mirror.2-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent39 2024-09-21T15:10:39.382 INFO:teuthology.orchestra.run.smithi161.stdout:5867 write 0x7d94c41 thru 0x7da0749 (0xbb09 bytes) 2024-09-21T15:10:39.392 INFO:teuthology.orchestra.run.smithi161.stdout:5806 read 0x453649f thru 0x453f405 (0x8f67 bytes) 2024-09-21T15:10:39.392 INFO:teuthology.orchestra.run.smithi161.stdout:5807 write 0x91cb9cd thru 0x91d0336 (0x496a bytes) 2024-09-21T15:10:39.413 INFO:teuthology.orchestra.run.smithi161.stdout:5868 read 0x8dcbb25 thru 0x8dd03da (0x48b6 bytes) 2024-09-21T15:10:39.413 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:39.413 INFO:teuthology.orchestra.run.smithi161.stdout:5871 punch from 0x5cc137e to 0x5ccc315, (0xaf97 bytes) 2024-09-21T15:10:39.414 INFO:teuthology.orchestra.run.smithi161.stdout:5873 writesame 0xb745d09 thru 0xb7521a5 data_size 0x1(0xc49d bytes) 2024-09-21T15:10:39.431 INFO:teuthology.orchestra.run.smithi161.stdout:5808 read 0x571f587 thru 0x5722945 (0x33bf bytes) 2024-09-21T15:10:39.431 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:39.432 INFO:teuthology.orchestra.run.smithi161.stdout:5810 writesame 0x50ed869 thru 0x50ee1d7 data_size 0x17(0x96f bytes) 2024-09-21T15:10:39.460 INFO:teuthology.orchestra.run.smithi161.stdout:5811 read 0x31a83aa thru 0x31b461b (0xc272 bytes) 2024-09-21T15:10:39.461 INFO:teuthology.orchestra.run.smithi161.stdout:5812 read 0x33847d3 thru 0x33931ee (0xea1c bytes) 2024-09-21T15:10:39.461 INFO:teuthology.orchestra.run.smithi161.stdout:5813 write 0x76452a7 thru 0x7649b91 (0x48eb bytes) 2024-09-21T15:10:39.478 INFO:teuthology.orchestra.run.smithi161.stdout:5874 trunc from 0xde3b9e6 to 0x8d2e646 2024-09-21T15:10:39.482 INFO:teuthology.orchestra.run.smithi161.stdout:5814 read 0x20f2289 thru 0x20fe7db (0xc553 bytes) 2024-09-21T15:10:39.482 INFO:teuthology.orchestra.run.smithi161.stdout:5815 punch from 0xcfc1c2 to 0xcfc23a, (0x78 bytes) 2024-09-21T15:10:39.490 INFO:teuthology.orchestra.run.smithi161.stdout:5818 trunc from 0x93147dd to 0x50f5a99 2024-09-21T15:10:39.540 INFO:teuthology.orchestra.run.smithi161.stdout:5972 write 0xe74228a thru 0xe74b54f (0x92c6 bytes) 2024-09-21T15:10:39.547 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #43, image image_cluster1.client.mirror.4-clone43 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent44 2024-09-21T15:10:39.560 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:39.560 INFO:teuthology.orchestra.run.smithi161.stdout:5975 read 0x69d41a8 thru 0x69df5ab (0xb404 bytes) 2024-09-21T15:10:39.560 INFO:teuthology.orchestra.run.smithi161.stdout:5976 write 0x7e4e9f8 thru 0x7e4f847 (0xe50 bytes) 2024-09-21T15:10:39.565 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:39.575 INFO:teuthology.orchestra.run.smithi161.stdout:5820 trunc from 0x50f5a99 to 0x98aaad5 2024-09-21T15:10:39.575 INFO:teuthology.orchestra.run.smithi161.stdout:5977 read 0xa011725 thru 0xa016def (0x56cb bytes) 2024-09-21T15:10:39.575 INFO:teuthology.orchestra.run.smithi161.stdout:5979 write 0xdee90e0 thru 0xdeef6a9 (0x65ca bytes) 2024-09-21T15:10:39.598 INFO:teuthology.orchestra.run.smithi161.stdout:5980 write 0x6112c13 thru 0x6112e54 (0x242 bytes) 2024-09-21T15:10:39.611 INFO:teuthology.orchestra.run.smithi161.stdout:5875 write 0xa3f679e thru 0xa3fbff4 (0x5857 bytes) 2024-09-21T15:10:39.612 INFO:teuthology.orchestra.run.smithi161.stdout:5981 write 0x2426d18 thru 0x2434d3e (0xe027 bytes) 2024-09-21T15:10:39.614 INFO:teuthology.orchestra.run.smithi161.stdout:5821 trunc from 0x98aaad5 to 0x68c218a 2024-09-21T15:10:39.625 INFO:teuthology.orchestra.run.smithi161.stdout:5876 read 0x58514c3 thru 0x5856075 (0x4bb3 bytes) 2024-09-21T15:10:39.635 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:39.635 INFO:teuthology.orchestra.run.smithi161.stdout:5983 punch from 0xadebad9 to 0xadee74e, (0x2c75 bytes) 2024-09-21T15:10:39.635 INFO:teuthology.orchestra.run.smithi161.stdout:5984 read 0x974c437 thru 0x975ad0f (0xe8d9 bytes) 2024-09-21T15:10:39.654 INFO:teuthology.orchestra.run.smithi161.stdout:5822 punch from 0x7536f7 to 0x756ed1, (0x37da bytes) 2024-09-21T15:10:39.654 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:39.656 INFO:teuthology.orchestra.run.smithi161.stdout:5985 trunc from 0xe74b550 to 0x21d3ea9 2024-09-21T15:10:39.668 INFO:teuthology.orchestra.run.smithi161.stdout:5877 write 0xd6a8678 thru 0xd6ae175 (0x5afe bytes) 2024-09-21T15:10:39.668 INFO:teuthology.orchestra.run.smithi161.stdout:5824 trunc from 0x68c218a to 0xc0ed485 2024-09-21T15:10:39.682 INFO:teuthology.orchestra.run.smithi161.stdout:5878 read 0x474703d thru 0x47513d1 (0xa395 bytes) 2024-09-21T15:10:39.683 INFO:teuthology.orchestra.run.smithi161.stdout:5879 punch from 0x7444bf7 to 0x74519ac, (0xcdb5 bytes) 2024-09-21T15:10:39.683 INFO:teuthology.orchestra.run.smithi161.stdout:5880 write 0x1d5ac91 thru 0x1d6a6f6 (0xfa66 bytes) 2024-09-21T15:10:39.696 INFO:teuthology.orchestra.run.smithi161.stdout:5881 writesame 0x2fc5f0 thru 0x305697 data_size 0xc(0x90a8 bytes) 2024-09-21T15:10:39.711 INFO:teuthology.orchestra.run.smithi161.stdout:5882 writesame 0x6906df9 thru 0x69148e5 data_size 0xb(0xdaed bytes) 2024-09-21T15:10:39.717 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #48, image image_cluster1.client.mirror.3-clone48 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent49 2024-09-21T15:10:39.723 INFO:teuthology.orchestra.run.smithi161.stdout:5883 read 0xc4c6808 thru 0xc4c9189 (0x2982 bytes) 2024-09-21T15:10:39.724 INFO:teuthology.orchestra.run.smithi161.stdout:5884 read 0x8d2bede thru 0x8d389cc (0xcaef bytes) 2024-09-21T15:10:39.725 INFO:teuthology.orchestra.run.smithi161.stdout:5885 read 0xc7141b7 thru 0xc723eee (0xfd38 bytes) 2024-09-21T15:10:39.725 INFO:teuthology.orchestra.run.smithi161.stdout:5888 writesame 0x3610900 thru 0x361542d data_size 0x1(0x4b2e bytes) 2024-09-21T15:10:39.731 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:39.731 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:39.731 INFO:teuthology.orchestra.run.smithi161.stdout:5891 punch from 0x2cef2e5 to 0x2cfbced, (0xca08 bytes) 2024-09-21T15:10:39.731 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:39.735 INFO:teuthology.orchestra.run.smithi161.stdout:5825 trunc from 0xc0ed485 to 0x2ad50bd 2024-09-21T15:10:39.739 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:39.739 INFO:teuthology.orchestra.run.smithi161.stdout:5990 read 0x12dbf93 thru 0x12dfdf1 (0x3e5f bytes) 2024-09-21T15:10:39.748 INFO:teuthology.orchestra.run.smithi161.stdout:5893 trunc from 0xd6ae176 to 0x3099830 2024-09-21T15:10:39.817 INFO:teuthology.orchestra.run.smithi161.stdout:5991 writesame 0xb23f877 thru 0xb241946 data_size 0x46(0x20d0 bytes) 2024-09-21T15:10:39.822 INFO:teuthology.orchestra.run.smithi161.stdout:5992 read 0x859db4b thru 0x85abc76 (0xe12c bytes) 2024-09-21T15:10:39.825 INFO:teuthology.orchestra.run.smithi161.stdout:5993 punch from 0x684a384 to 0x6851a63, (0x76df bytes) 2024-09-21T15:10:39.831 INFO:teuthology.orchestra.run.smithi161.stdout:5995 trunc from 0xb241947 to 0xe38a8fa 2024-09-21T15:10:39.849 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:39.860 INFO:teuthology.orchestra.run.smithi161.stdout:5997 writesame 0xc1bc2e0 thru 0xc1c3a97 data_size 0x4(0x77b8 bytes) 2024-09-21T15:10:39.862 INFO:teuthology.orchestra.run.smithi161.stdout:5895 trunc from 0x3099830 to 0xbaeae67 2024-09-21T15:10:39.870 INFO:teuthology.orchestra.run.smithi161.stdout:5826 writesame 0x5e868f7 thru 0x5e8c7db data_size 0x1(0x5ee5 bytes) 2024-09-21T15:10:39.875 INFO:teuthology.orchestra.run.smithi161.stdout:5828 read 0x47cb2a0 thru 0x47d09e5 (0x5746 bytes) 2024-09-21T15:10:39.875 INFO:teuthology.orchestra.run.smithi161.stdout:5829 punch from 0x32cb9b0 to 0x32d85c2, (0xcc12 bytes) 2024-09-21T15:10:39.876 INFO:teuthology.orchestra.run.smithi161.stdout:5998 write 0x4ec4275 thru 0x4ed2de1 (0xeb6d bytes) 2024-09-21T15:10:39.889 INFO:teuthology.orchestra.run.smithi161.stdout:5897 read 0x407dcc2 thru 0x40804cf (0x280e bytes) 2024-09-21T15:10:39.889 INFO:teuthology.orchestra.run.smithi161.stdout:6000 read 0xa26926 thru 0xa293da (0x2ab5 bytes) 2024-09-21T15:10:39.892 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:39.892 INFO:teuthology.orchestra.run.smithi161.stdout:5899 write 0x3442981 thru 0x344f338 (0xc9b8 bytes) 2024-09-21T15:10:39.902 INFO:teuthology.orchestra.run.smithi161.stdout:5900 punch from 0x9e7bd95 to 0x9e825d1, (0x683c bytes) 2024-09-21T15:10:39.902 INFO:teuthology.orchestra.run.smithi161.stdout:5901 write 0x5f6e487 thru 0x5f77ff4 (0x9b6e bytes) 2024-09-21T15:10:39.915 INFO:teuthology.orchestra.run.smithi161.stdout:5903 read 0x380b18b thru 0x38194ee (0xe364 bytes) 2024-09-21T15:10:39.915 INFO:teuthology.orchestra.run.smithi161.stdout:5904 write 0x57c2ab7 thru 0x57c89fd (0x5f47 bytes) 2024-09-21T15:10:39.919 INFO:teuthology.orchestra.run.smithi161.stdout:5359 writesame 0x8ca0a88 thru 0x8cadbfa data_size 0x3d(0xd173 bytes) 2024-09-21T15:10:39.926 INFO:teuthology.orchestra.run.smithi161.stdout:4653 trunc from 0xa5cd21f to 0x1bbba38 2024-09-21T15:10:39.929 INFO:teuthology.orchestra.run.smithi161.stdout:5831 write 0xeaa5a5b thru 0xeaae96d (0x8f13 bytes) 2024-09-21T15:10:39.937 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #39, image image_cluster1.client.mirror.2-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent40 2024-09-21T15:10:39.965 INFO:teuthology.orchestra.run.smithi161.stdout:5832 writesame 0x70c22d6 thru 0x70cdcdc data_size 0x1(0xba07 bytes) 2024-09-21T15:10:40.005 INFO:teuthology.orchestra.run.smithi161.stdout:5905 writesame 0xea7f18d thru 0xea8b77f data_size 0x5(0xc5f3 bytes) 2024-09-21T15:10:40.009 INFO:teuthology.orchestra.run.smithi161.stdout:5361 write 0x3c9a40 thru 0x3d7b6a (0xe12b bytes) 2024-09-21T15:10:40.014 INFO:teuthology.orchestra.run.smithi161.stdout:5834 write 0x7aedff5 thru 0x7afb6de (0xd6ea bytes) 2024-09-21T15:10:40.016 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:40.016 INFO:teuthology.orchestra.run.smithi161.stdout:5907 punch from 0x2912dc2 to 0x2919a13, (0x6c51 bytes) 2024-09-21T15:10:40.016 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:40.016 INFO:teuthology.orchestra.run.smithi161.stdout:5911 write 0x71bf30b thru 0x71c416f (0x4e65 bytes) 2024-09-21T15:10:40.041 INFO:teuthology.orchestra.run.smithi161.stdout:5912 punch from 0x5e0bc7b to 0x5e13d62, (0x80e7 bytes) 2024-09-21T15:10:40.041 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:40.041 INFO:teuthology.orchestra.run.smithi161.stdout:5916 clone 40 order 22 su 524288 sc 10 2024-09-21T15:10:40.045 INFO:teuthology.orchestra.run.smithi161.stdout:5835 read 0xdda440b thru 0xdda9ce9 (0x58df bytes) 2024-09-21T15:10:40.045 INFO:teuthology.orchestra.run.smithi161.stdout:5836 punch from 0xb9f3d67 to 0xb9f83a9, (0x4642 bytes) 2024-09-21T15:10:40.046 INFO:teuthology.orchestra.run.smithi161.stdout:5837 flatten 2024-09-21T15:10:40.080 INFO:teuthology.orchestra.run.smithi161.stdout:5838 write 0x8d89218 thru 0x8d91f41 (0x8d2a bytes) 2024-09-21T15:10:40.098 INFO:teuthology.orchestra.run.smithi161.stdout:5362 punch from 0x6b2f476 to 0x6b3b3e7, (0xbf71 bytes) 2024-09-21T15:10:40.098 INFO:teuthology.orchestra.run.smithi161.stdout:5363 punch from 0x32b4a37 to 0x32bd970, (0x8f39 bytes) 2024-09-21T15:10:40.098 INFO:teuthology.orchestra.run.smithi161.stdout:5364 read 0xae51139 thru 0xae592f5 (0x81bd bytes) 2024-09-21T15:10:40.100 INFO:teuthology.orchestra.run.smithi161.stdout:5365 flatten 2024-09-21T15:10:40.103 INFO:teuthology.orchestra.run.smithi161.stdout:5840 write 0x2497d37 thru 0x249b657 (0x3921 bytes) 2024-09-21T15:10:40.133 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:40.133 INFO:teuthology.orchestra.run.smithi161.stdout:5842 writesame 0x32663b0 thru 0x32760df data_size 0x8(0xfd30 bytes) 2024-09-21T15:10:40.172 INFO:teuthology.orchestra.run.smithi161.stdout:5843 punch from 0x965dde0 to 0x9663ab0, (0x5cd0 bytes) 2024-09-21T15:10:40.172 INFO:teuthology.orchestra.run.smithi161.stdout:5844 write 0x44c8025 thru 0x44d564f (0xd62b bytes) 2024-09-21T15:10:40.235 INFO:teuthology.orchestra.run.smithi161.stdout:5845 trunc from 0xeaae96e to 0xaa54130 2024-09-21T15:10:40.292 INFO:teuthology.orchestra.run.smithi161.stdout:5847 write 0x956d0ff thru 0x956dcd3 (0xbd5 bytes) 2024-09-21T15:10:40.310 INFO:teuthology.orchestra.run.smithi161.stdout:5850 trunc from 0xaa54130 to 0xdd06e31 2024-09-21T15:10:40.334 INFO:teuthology.orchestra.run.smithi161.stdout:4654 punch from 0xf0c209 to 0xf15447, (0x923e bytes) 2024-09-21T15:10:40.341 INFO:teuthology.orchestra.run.smithi161.stdout:5851 read 0x4efee34 thru 0x4f047d9 (0x59a6 bytes) 2024-09-21T15:10:40.351 INFO:teuthology.orchestra.run.smithi161.stdout:5367 write 0x6fa3bff thru 0x6fb1a7a (0xde7c bytes) 2024-09-21T15:10:40.356 INFO:teuthology.orchestra.run.smithi161.stdout:5852 trunc from 0xdd06e31 to 0x513a669 2024-09-21T15:10:40.362 INFO:teuthology.orchestra.run.smithi161.stdout:4656 write 0x2a61b32 thru 0x2a6d4b0 (0xb97f bytes) 2024-09-21T15:10:40.381 INFO:teuthology.orchestra.run.smithi161.stdout:5368 write 0x2f3fcd7 thru 0x2f45a60 (0x5d8a bytes) 2024-09-21T15:10:40.385 INFO:teuthology.orchestra.run.smithi161.stdout:All operations completed A-OK! 2024-09-21T15:10:40.402 INFO:teuthology.orchestra.run.smithi161.stdout:5369 read 0x3cc435a thru 0x3cc7be2 (0x3889 bytes) 2024-09-21T15:10:40.403 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:40.403 INFO:teuthology.orchestra.run.smithi161.stdout:5371 write 0x1895fe thru 0x196ce9 (0xd6ec bytes) 2024-09-21T15:10:40.416 DEBUG:teuthology.parallel:result is None 2024-09-21T15:10:40.417 INFO:teuthology.orchestra.run.smithi161.stdout:5373 trunc from 0xbd4d0ab to 0xa98e2fe 2024-09-21T15:10:40.439 INFO:teuthology.orchestra.run.smithi161.stdout:4658 write 0x5eeaa59 thru 0x5ef8093 (0xd63b bytes) 2024-09-21T15:10:40.449 INFO:teuthology.orchestra.run.smithi161.stdout:5374 read 0x4d1a570 thru 0x4d2332e (0x8dbf bytes) 2024-09-21T15:10:40.449 INFO:teuthology.orchestra.run.smithi161.stdout:5375 write 0x5587aad thru 0x5589002 (0x1556 bytes) 2024-09-21T15:10:40.463 INFO:teuthology.orchestra.run.smithi161.stdout:5854 writesame 0xb2f149e thru 0xb2fee32 data_size 0x9(0xd995 bytes) 2024-09-21T15:10:40.466 INFO:teuthology.orchestra.run.smithi161.stdout:5377 writesame 0x4047987 thru 0x404f92d data_size 0x3(0x7fa7 bytes) 2024-09-21T15:10:40.470 INFO:teuthology.orchestra.run.smithi161.stdout:5855 read 0x13fdcb4 thru 0x1407380 (0x96cd bytes) 2024-09-21T15:10:40.471 INFO:teuthology.orchestra.run.smithi161.stdout:5857 read 0x8a80726 thru 0x8a8e2f3 (0xdbce bytes) 2024-09-21T15:10:40.471 INFO:teuthology.orchestra.run.smithi161.stdout:5858 write 0x4c2b477 thru 0x4c399a3 (0xe52d bytes) 2024-09-21T15:10:40.484 INFO:teuthology.orchestra.run.smithi161.stdout:5378 write 0x6fd7ad2 thru 0x6fe6855 (0xed84 bytes) 2024-09-21T15:10:40.485 INFO:teuthology.orchestra.run.smithi161.stdout:4659 trunc from 0x5ef8094 to 0xd236ca6 2024-09-21T15:10:40.500 INFO:teuthology.orchestra.run.smithi161.stdout:5859 trunc from 0xb2fee33 to 0xc431243 2024-09-21T15:10:40.513 INFO:teuthology.orchestra.run.smithi161.stdout:5380 punch from 0x6178fae to 0x617bc44, (0x2c96 bytes) 2024-09-21T15:10:40.513 INFO:teuthology.orchestra.run.smithi161.stdout:5382 read 0x7ca6afe thru 0x7ca7197 (0x69a bytes) 2024-09-21T15:10:40.527 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:40.527 INFO:teuthology.orchestra.run.smithi161.stdout:4662 write 0x3ab5e22 thru 0x3ab7fd7 (0x21b6 bytes) 2024-09-21T15:10:40.539 INFO:teuthology.orchestra.run.smithi161.stdout:5861 write 0x60f76fe thru 0x60fbfe4 (0x48e7 bytes) 2024-09-21T15:10:40.539 INFO:teuthology.orchestra.run.smithi161.stdout:4663 punch from 0xc16a240 to 0xc177ddd, (0xdb9d bytes) 2024-09-21T15:10:40.539 INFO:teuthology.orchestra.run.smithi161.stdout:4664 read 0x42e9c5a thru 0x42eb72c (0x1ad3 bytes) 2024-09-21T15:10:40.540 INFO:teuthology.orchestra.run.smithi161.stdout:4665 write 0x31374e thru 0x31a9c9 (0x727c bytes) 2024-09-21T15:10:40.563 INFO:teuthology.orchestra.run.smithi161.stdout:5385 write 0xeabbd48 thru 0xeacb8bd (0xfb76 bytes) 2024-09-21T15:10:40.588 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:40.588 INFO:teuthology.orchestra.run.smithi161.stdout:5864 read 0x958a187 thru 0x9590ba0 (0x6a1a bytes) 2024-09-21T15:10:40.588 INFO:teuthology.orchestra.run.smithi161.stdout:5865 read 0xfde52d thru 0xfee223 (0xfcf7 bytes) 2024-09-21T15:10:40.588 INFO:teuthology.orchestra.run.smithi161.stdout:5867 write 0x5be7112 thru 0x5bec600 (0x54ef bytes) 2024-09-21T15:10:40.598 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:40.598 INFO:teuthology.orchestra.run.smithi161.stdout:5388 punch from 0xb3645fa to 0xb36c928, (0x832e bytes) 2024-09-21T15:10:40.598 INFO:teuthology.orchestra.run.smithi161.stdout:5390 read 0x483da88 thru 0x4844475 (0x69ee bytes) 2024-09-21T15:10:40.629 INFO:teuthology.orchestra.run.smithi161.stdout:5869 write 0x542a01e thru 0x5437959 (0xd93c bytes) 2024-09-21T15:10:40.639 INFO:teuthology.orchestra.run.smithi161.stdout:5391 read 0xc57e110 thru 0xc585396 (0x7287 bytes) 2024-09-21T15:10:40.639 INFO:teuthology.orchestra.run.smithi161.stdout:5392 writesame 0x936b877 thru 0x93789b6 data_size 0x7c(0xd140 bytes) 2024-09-21T15:10:40.657 INFO:teuthology.orchestra.run.smithi161.stdout:5393 write 0x3fe6bbb thru 0x3fe921f (0x2665 bytes) 2024-09-21T15:10:40.676 INFO:teuthology.orchestra.run.smithi161.stdout:4668 writesame 0x437851a thru 0x4384a4e data_size 0x17(0xc535 bytes) 2024-09-21T15:10:40.690 INFO:teuthology.orchestra.run.smithi161.stdout:5870 trunc from 0xc431243 to 0x1a34201 2024-09-21T15:10:40.701 INFO:teuthology.orchestra.run.smithi161.stdout:4669 read 0xb0a1721 thru 0xb0a794b (0x622b bytes) 2024-09-21T15:10:40.701 INFO:teuthology.orchestra.run.smithi161.stdout:4670 punch from 0x9141cb7 to 0x9145bca, (0x3f13 bytes) 2024-09-21T15:10:40.702 INFO:teuthology.orchestra.run.smithi161.stdout:4671 writesame 0x9ce1367 thru 0x9ce7c47 data_size 0x1(0x68e1 bytes) 2024-09-21T15:10:40.703 INFO:teuthology.orchestra.run.smithi161.stdout:5394 trunc from 0xeacb8be to 0x1476104 2024-09-21T15:10:40.756 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:40.756 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:40.756 INFO:teuthology.orchestra.run.smithi161.stdout:4674 write 0x1809c92 thru 0x1817ea0 (0xe20f bytes) 2024-09-21T15:10:40.781 INFO:teuthology.orchestra.run.smithi161.stdout:4675 write 0x82e81ee thru 0x82f3d9f (0xbbb2 bytes) 2024-09-21T15:10:40.808 INFO:teuthology.orchestra.run.smithi161.stdout:5395 clone 46 order 21 su 32768 sc 5 2024-09-21T15:10:40.810 INFO:teuthology.orchestra.run.smithi161.stdout:4676 write 0x36d9e36 thru 0x36e3383 (0x954e bytes) 2024-09-21T15:10:40.814 INFO:teuthology.orchestra.run.smithi161.stdout:5871 read 0xfc3980 thru 0xfce7c1 (0xae42 bytes) 2024-09-21T15:10:40.814 INFO:teuthology.orchestra.run.smithi161.stdout:5873 read 0x1739df9 thru 0x17477a5 (0xd9ad bytes) 2024-09-21T15:10:40.832 INFO:teuthology.orchestra.run.smithi161.stdout:4677 write 0x2ea12 thru 0x30549 (0x1b38 bytes) 2024-09-21T15:10:40.849 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:40.849 INFO:teuthology.orchestra.run.smithi161.stdout:4679 read 0x5630675 thru 0x563e095 (0xda21 bytes) 2024-09-21T15:10:40.851 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:10:40.850+0000 7f2fd757f700 -1 rbd::mirror::ImageReplayer: 0x55f20dfb8a00 [3/50a1f802-df95-4e98-8630-fafd576b3b77] start: already running 2024-09-21T15:10:40.851 INFO:teuthology.orchestra.run.smithi161.stdout:4680 write 0x4cc25e0 thru 0x4ccffe5 (0xda06 bytes) 2024-09-21T15:10:40.873 INFO:teuthology.orchestra.run.smithi161.stdout:5875 write 0x8537bc7 thru 0x853850b (0x945 bytes) 2024-09-21T15:10:40.874 INFO:teuthology.orchestra.run.smithi161.stdout:4684 read 0x3e7b513 thru 0x3e7fe5d (0x494b bytes) 2024-09-21T15:10:40.875 INFO:teuthology.orchestra.run.smithi161.stdout:4685 read 0x3f74957 thru 0x3f7f855 (0xaeff bytes) 2024-09-21T15:10:40.876 INFO:teuthology.orchestra.run.smithi161.stdout:4686 write 0x943d641 thru 0x94454d9 (0x7e99 bytes) 2024-09-21T15:10:40.902 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:40.905 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:40.905 INFO:teuthology.orchestra.run.smithi161.stdout:4689 write 0xb57b391 thru 0xb58087c (0x54ec bytes) 2024-09-21T15:10:40.949 INFO:teuthology.orchestra.run.smithi161.stdout:4690 writesame 0x6bd4756 thru 0x6be028f data_size 0x5(0xbb3a bytes) 2024-09-21T15:10:40.992 INFO:teuthology.orchestra.run.smithi161.stdout:5877 write 0xdc194b3 thru 0xdc26389 (0xced7 bytes) 2024-09-21T15:10:40.999 INFO:teuthology.orchestra.run.smithi161.stdout:4691 trunc from 0xd236ca6 to 0x8a82854 2024-09-21T15:10:41.018 INFO:teuthology.orchestra.run.smithi161.stdout:5879 writesame 0x6131ee1 thru 0x613d837 data_size 0x1(0xb957 bytes) 2024-09-21T15:10:41.061 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.053+0000 7f7fd044c700 -1 reset not still connected to 0x56369e619520 2024-09-21T15:10:41.062 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.053+0000 7f7fd044c700 -1 reset not still connected to 0x56369e6196c0 2024-09-21T15:10:41.062 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.053+0000 7f7fd044c700 -1 reset not still connected to 0x56369f5dc000 2024-09-21T15:10:41.062 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.053+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:10:41.062 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.053+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:10:41.063 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.057+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:10:41.063 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.057+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:10:41.063 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.057+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7148b60 2024-09-21T15:10:41.063 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.057+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7149040 2024-09-21T15:10:41.064 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.061+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb9930 2024-09-21T15:10:41.077 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.061+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:10:41.077 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.061+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e000 2024-09-21T15:10:41.077 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.065+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:10:41.077 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.065+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e5b0 2024-09-21T15:10:41.077 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.065+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:10:41.077 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.065+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbaea0 2024-09-21T15:10:41.077 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.065+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbb2b0 2024-09-21T15:10:41.078 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc40d0 2024-09-21T15:10:41.078 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:10:41.078 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:10:41.078 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4340 2024-09-21T15:10:41.078 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4750 2024-09-21T15:10:41.078 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4f70 2024-09-21T15:10:41.078 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:10:41.078 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:10:41.078 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f880d0 2024-09-21T15:10:41.079 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:10:41.079 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:10:41.079 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:10:41.079 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:10:41.079 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.069+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:10:41.080 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.073+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:10:41.080 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.073+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45052b0 2024-09-21T15:10:41.080 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.073+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:10:41.082 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.077+0000 7f7fd044c700 -1 reset not still connected to 0x5636c47091e0 2024-09-21T15:10:41.082 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.077+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:10:41.082 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.077+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:10:41.084 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.077+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483edd0 2024-09-21T15:10:41.089 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:10:41.090 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:10:41.090 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb110 2024-09-21T15:10:41.090 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:10:41.092 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:10:41.092 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbba00 2024-09-21T15:10:41.092 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbbba0 2024-09-21T15:10:41.092 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:10:41.092 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54410 2024-09-21T15:10:41.093 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:10:41.093 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3040 2024-09-21T15:10:41.093 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3a00 2024-09-21T15:10:41.093 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3ad0 2024-09-21T15:10:41.093 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:10:41.093 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:10:41.093 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:10:41.094 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:10:41.094 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:10:41.094 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:41.085+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:10:41.094 INFO:teuthology.orchestra.run.smithi161.stdout:5880 writesame 0x437a13e thru 0x4389ef6 data_size 0x15(0xfdb9 bytes) 2024-09-21T15:10:41.121 INFO:teuthology.orchestra.run.smithi161.stdout:5881 read 0xce221e9 thru 0xce258ae (0x36c6 bytes) 2024-09-21T15:10:41.133 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:41.133 INFO:teuthology.orchestra.run.smithi161.stdout:4694 writesame 0x682c6a thru 0x68933c data_size 0x1(0x66d3 bytes) 2024-09-21T15:10:41.149 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.5-clone39 from 0xea8b780 (overlap 0x3099830) to 0x13709ac 2024-09-21T15:10:41.152 INFO:teuthology.orchestra.run.smithi161.stdout:4695 punch from 0x4c622d5 to 0x4c632f9, (0x1024 bytes) 2024-09-21T15:10:41.153 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:41.181 INFO:teuthology.orchestra.run.smithi161.stdout:5882 write 0xea03e99 thru 0xea0a9fe (0x6b66 bytes) 2024-09-21T15:10:41.198 INFO:teuthology.orchestra.run.smithi161.stdout:4699 write 0xa268117 thru 0xa2729c0 (0xa8aa bytes) 2024-09-21T15:10:41.209 INFO:teuthology.orchestra.run.smithi161.stdout:5883 read 0xa5b7c94 thru 0xa5c33c6 (0xb733 bytes) 2024-09-21T15:10:41.210 INFO:teuthology.orchestra.run.smithi161.stdout:5884 read 0x18d2f71 thru 0x18de3a9 (0xb439 bytes) 2024-09-21T15:10:41.210 INFO:teuthology.orchestra.run.smithi161.stdout:5886 writesame 0xd56c4db thru 0xd56f15a data_size 0x10(0x2c80 bytes) 2024-09-21T15:10:41.228 INFO:teuthology.orchestra.run.smithi161.stdout:5887 writesame 0x21a87f5 thru 0x21b6a24 data_size 0x9a(0xe230 bytes) 2024-09-21T15:10:41.231 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:41.231 INFO:teuthology.orchestra.run.smithi161.stdout:4703 read 0x6d58820 thru 0x6d63f19 (0xb6fa bytes) 2024-09-21T15:10:41.232 INFO:teuthology.orchestra.run.smithi161.stdout:4704 read 0x89c813c thru 0x89d1cb1 (0x9b76 bytes) 2024-09-21T15:10:41.256 INFO:teuthology.orchestra.run.smithi161.stdout:5888 write 0xaa9124d thru 0xaa9ac3e (0x99f2 bytes) 2024-09-21T15:10:41.281 INFO:teuthology.orchestra.run.smithi161.stdout:4705 write 0xabb1375 thru 0xabbf1c0 (0xde4c bytes) 2024-09-21T15:10:41.282 INFO:teuthology.orchestra.run.smithi161.stdout:5890 punch from 0xb5994c3 to 0xb599d74, (0x8b1 bytes) 2024-09-21T15:10:41.282 INFO:teuthology.orchestra.run.smithi161.stdout:5892 read 0xc010949 thru 0xc01db16 (0xd1ce bytes) 2024-09-21T15:10:41.283 INFO:teuthology.orchestra.run.smithi161.stdout:5893 write 0x7b7a275 thru 0x7b80297 (0x6023 bytes) 2024-09-21T15:10:41.308 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:41.308 INFO:teuthology.orchestra.run.smithi161.stdout:4707 write 0x2989af6 thru 0x298ac56 (0x1161 bytes) 2024-09-21T15:10:41.308 INFO:teuthology.orchestra.run.smithi161.stdout:5897 read 0xa1f1745 thru 0xa1f7778 (0x6034 bytes) 2024-09-21T15:10:41.309 INFO:teuthology.orchestra.run.smithi161.stdout:5898 write 0x526d86c thru 0x527c05a (0xe7ef bytes) 2024-09-21T15:10:41.320 INFO:teuthology.orchestra.run.smithi161.stdout:4708 trunc from 0xabbf1c1 to 0x9b28a92 2024-09-21T15:10:41.335 INFO:teuthology.orchestra.run.smithi161.stdout:5899 read 0x3d613ed thru 0x3d686cd (0x72e1 bytes) 2024-09-21T15:10:41.336 INFO:teuthology.orchestra.run.smithi161.stdout:5900 writesame 0x45082af thru 0x4518260 data_size 0x1(0xffb2 bytes) 2024-09-21T15:10:41.383 INFO:teuthology.orchestra.run.smithi161.stdout:5901 write 0x3f017aa thru 0x3f10057 (0xe8ae bytes) 2024-09-21T15:10:41.392 INFO:teuthology.orchestra.run.smithi161.stdout:4709 punch from 0x70543d0 to 0x705f677, (0xb2a7 bytes) 2024-09-21T15:10:41.396 INFO:teuthology.orchestra.run.smithi161.stdout:4710 trunc from 0x9b28a92 to 0x8412f37 2024-09-21T15:10:41.413 INFO:teuthology.orchestra.run.smithi161.stdout:5902 punch from 0x63cd2df to 0x63d62ad, (0x8fce bytes) 2024-09-21T15:10:41.413 INFO:teuthology.orchestra.run.smithi161.stdout:5903 read 0xb2fa26b thru 0xb30154c (0x72e2 bytes) 2024-09-21T15:10:41.414 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:41.414 INFO:teuthology.orchestra.run.smithi161.stdout:5905 punch from 0x1343aed to 0x1349691, (0x5ba4 bytes) 2024-09-21T15:10:41.433 INFO:teuthology.orchestra.run.smithi161.stdout:4711 read 0x739de79 thru 0x73a6115 (0x829d bytes) 2024-09-21T15:10:41.436 INFO:teuthology.orchestra.run.smithi161.stdout:5906 trunc from 0xea0a9ff to 0x334f30a 2024-09-21T15:10:41.439 INFO:teuthology.orchestra.run.smithi161.stdout:4712 trunc from 0x8412f37 to 0x5b42c3e 2024-09-21T15:10:41.503 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #38, image image_cluster1.client.mirror.5-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent39 2024-09-21T15:10:41.527 INFO:teuthology.orchestra.run.smithi161.stdout:5909 trunc from 0x334f30a to 0x1606c2d 2024-09-21T15:10:41.529 INFO:teuthology.orchestra.run.smithi161.stdout:4714 trunc from 0x5b42c3e to 0xac33418 2024-09-21T15:10:41.560 INFO:teuthology.orchestra.run.smithi161.stdout:4715 read 0x14c2ab8 thru 0x14d138a (0xe8d3 bytes) 2024-09-21T15:10:41.561 INFO:teuthology.orchestra.run.smithi161.stdout:4716 write 0x6db36a0 thru 0x6dba93e (0x729f bytes) 2024-09-21T15:10:41.578 INFO:teuthology.orchestra.run.smithi161.stdout:5917 punch from 0x1085624 to 0x10867b7, (0x1193 bytes) 2024-09-21T15:10:41.589 INFO:teuthology.orchestra.run.smithi161.stdout:4717 write 0x2fb36ce thru 0x2fbec72 (0xb5a5 bytes) 2024-09-21T15:10:41.608 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:41.608 INFO:teuthology.orchestra.run.smithi161.stdout:4720 flatten 2024-09-21T15:10:41.615 INFO:teuthology.orchestra.run.smithi161.stdout:5918 write 0x7cedefc thru 0x7cf02ad (0x23b2 bytes) 2024-09-21T15:10:41.618 INFO:teuthology.orchestra.run.smithi161.stdout:5911 write 0x1724460 thru 0x172f88b (0xb42c bytes) 2024-09-21T15:10:41.634 INFO:teuthology.orchestra.run.smithi161.stdout:5922 punch from 0x490da91 to 0x491246e, (0x49dd bytes) 2024-09-21T15:10:41.634 INFO:teuthology.orchestra.run.smithi161.stdout:5924 write 0x5a7b7b2 thru 0x5a7f8cf (0x411e bytes) 2024-09-21T15:10:41.673 INFO:teuthology.orchestra.run.smithi161.stdout:5926 read 0x90ea626 thru 0x90eacdc (0x6b7 bytes) 2024-09-21T15:10:41.674 INFO:teuthology.orchestra.run.smithi161.stdout:5927 punch from 0x4c5de46 to 0x4c62a7f, (0x4c39 bytes) 2024-09-21T15:10:41.674 INFO:teuthology.orchestra.run.smithi161.stdout:5928 write 0xb5319d8 thru 0xb53b939 (0x9f62 bytes) 2024-09-21T15:10:41.708 INFO:teuthology.orchestra.run.smithi161.stdout:5929 write 0x5bf0473 thru 0x5bf4a19 (0x45a7 bytes) 2024-09-21T15:10:41.725 INFO:teuthology.orchestra.run.smithi161.stdout:5930 writesame 0x91d0879 thru 0x91dd7cc data_size 0x6(0xcf54 bytes) 2024-09-21T15:10:41.737 INFO:teuthology.orchestra.run.smithi161.stdout:5912 write 0x4cac9a3 thru 0x4cb9b98 (0xd1f6 bytes) 2024-09-21T15:10:41.741 INFO:teuthology.orchestra.run.smithi161.stdout:5934 read 0x37c9260 thru 0x37cdbd8 (0x4979 bytes) 2024-09-21T15:10:41.742 INFO:teuthology.orchestra.run.smithi161.stdout:5935 writesame 0x256756c thru 0x256b546 data_size 0x1(0x3fdb bytes) 2024-09-21T15:10:41.749 INFO:teuthology.orchestra.run.smithi161.stdout:4721 writesame 0x6eacbc thru 0x6f0fb8 data_size 0x1(0x62fd bytes) 2024-09-21T15:10:41.775 INFO:teuthology.orchestra.run.smithi161.stdout:5936 read 0x365ae0f thru 0x3664fee (0xa1e0 bytes) 2024-09-21T15:10:41.783 INFO:teuthology.orchestra.run.smithi161.stdout:4722 trunc from 0xac33418 to 0x5958524 2024-09-21T15:10:41.787 INFO:teuthology.orchestra.run.smithi161.stdout:5937 punch from 0xc814781 to 0xc821803, (0xd082 bytes) 2024-09-21T15:10:41.787 INFO:teuthology.orchestra.run.smithi161.stdout:5938 punch from 0x6b9ee6d to 0x6ba669b, (0x782e bytes) 2024-09-21T15:10:41.787 INFO:teuthology.orchestra.run.smithi161.stdout:5939 write 0xc49db8 thru 0xc503cd (0x6616 bytes) 2024-09-21T15:10:41.812 INFO:teuthology.orchestra.run.smithi161.stdout:5940 write 0xaef6998 thru 0xaeffc7b (0x92e4 bytes) 2024-09-21T15:10:41.832 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:41.832 INFO:teuthology.orchestra.run.smithi161.stdout:5943 writesame 0x21d403d thru 0x21dba09 data_size 0x1(0x79cd bytes) 2024-09-21T15:10:41.842 INFO:teuthology.orchestra.run.smithi161.stdout:5913 writesame 0xc6bc337 thru 0xc6c064f data_size 0x1(0x4319 bytes) 2024-09-21T15:10:41.864 INFO:teuthology.orchestra.run.smithi161.stdout:5914 trunc from 0xc6c0650 to 0x4fc7dcf 2024-09-21T15:10:41.866 INFO:teuthology.orchestra.run.smithi161.stdout:4724 read 0x405b28a thru 0x4065e50 (0xabc7 bytes) 2024-09-21T15:10:41.895 INFO:teuthology.orchestra.run.smithi161.stdout:5944 trunc from 0xea8b780 to 0x582d1d6 2024-09-21T15:10:41.896 INFO:teuthology.orchestra.run.smithi161.stdout:5915 writesame 0x4583c7 thru 0x46599a data_size 0x23(0xd5d4 bytes) 2024-09-21T15:10:41.903 INFO:teuthology.orchestra.run.smithi161.stdout:4725 write 0x97f3657 thru 0x9800285 (0xcc2f bytes) 2024-09-21T15:10:41.926 INFO:teuthology.orchestra.run.smithi161.stdout:5916 punch from 0x4bd2916 to 0x4bdf0b6, (0xc7a0 bytes) 2024-09-21T15:10:41.926 INFO:teuthology.orchestra.run.smithi161.stdout:5918 write 0x3be5b11 thru 0x3bea63b (0x4b2b bytes) 2024-09-21T15:10:41.944 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:41.958 INFO:teuthology.orchestra.run.smithi161.stdout:4727 trunc from 0x9800286 to 0x2b431ad 2024-09-21T15:10:41.961 INFO:teuthology.orchestra.run.smithi161.stdout:5919 write 0xc3ba2 thru 0xc5367 (0x17c6 bytes) 2024-09-21T15:10:41.976 INFO:teuthology.orchestra.run.smithi161.stdout:5922 read 0x18442bb thru 0x1850ebf (0xcc05 bytes) 2024-09-21T15:10:41.976 INFO:teuthology.orchestra.run.smithi161.stdout:5924 punch from 0xf29634 to 0xf35e90, (0xc85c bytes) 2024-09-21T15:10:41.977 INFO:teuthology.orchestra.run.smithi161.stdout:5925 writesame 0x18f4ed8 thru 0x18f6b3e data_size 0x1(0x1c67 bytes) 2024-09-21T15:10:42.044 INFO:teuthology.orchestra.run.smithi161.stdout:5945 write 0x88fdca8 thru 0x8908b84 (0xaedd bytes) 2024-09-21T15:10:42.061 INFO:teuthology.orchestra.run.smithi161.stdout:5926 write 0xc594638 thru 0xc594927 (0x2f0 bytes) 2024-09-21T15:10:42.063 INFO:teuthology.orchestra.run.smithi161.stdout:5946 trunc from 0x8908b85 to 0x9f70fcc 2024-09-21T15:10:42.082 INFO:teuthology.orchestra.run.smithi161.stdout:4729 writesame 0x8974509 thru 0x89815d5 data_size 0x1(0xd0cd bytes) 2024-09-21T15:10:42.087 INFO:teuthology.orchestra.run.smithi161.stdout:4730 read 0x6b9f0f3 thru 0x6baa8ca (0xb7d8 bytes) 2024-09-21T15:10:42.087 INFO:teuthology.orchestra.run.smithi161.stdout:4731 write 0x378546e thru 0x37879b8 (0x254b bytes) 2024-09-21T15:10:42.097 INFO:teuthology.orchestra.run.smithi161.stdout:4732 read 0x864aaf4 thru 0x864b0db (0x5e8 bytes) 2024-09-21T15:10:42.112 INFO:teuthology.orchestra.run.smithi161.stdout:5927 writesame 0xcd5c38f thru 0xcd63dc9 data_size 0x1d(0x7a3b bytes) 2024-09-21T15:10:42.116 INFO:teuthology.orchestra.run.smithi161.stdout:5928 read 0x958529d thru 0x958f4ed (0xa251 bytes) 2024-09-21T15:10:42.116 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:42.117 INFO:teuthology.orchestra.run.smithi161.stdout:5930 writesame 0xa826d6b thru 0xa8308cd data_size 0x1(0x9b63 bytes) 2024-09-21T15:10:42.122 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #44, image image_cluster1.client.mirror.4-clone44 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent45 2024-09-21T15:10:42.130 INFO:teuthology.orchestra.run.smithi161.stdout:5947 write 0xc07be5c thru 0xc086336 (0xa4db bytes) 2024-09-21T15:10:42.136 INFO:teuthology.orchestra.run.smithi161.stdout:4733 write 0x92b0cbe thru 0x92b6653 (0x5996 bytes) 2024-09-21T15:10:42.164 INFO:teuthology.orchestra.run.smithi161.stdout:5948 read 0x185bda7 thru 0x185eeba (0x3114 bytes) 2024-09-21T15:10:42.165 INFO:teuthology.orchestra.run.smithi161.stdout:5949 read 0x2dcba77 thru 0x2dd2be6 (0x7170 bytes) 2024-09-21T15:10:42.166 INFO:teuthology.orchestra.run.smithi161.stdout:5950 punch from 0x6a12e86 to 0x6a182a1, (0x541b bytes) 2024-09-21T15:10:42.167 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:42.167 INFO:teuthology.orchestra.run.smithi161.stdout:5952 punch from 0x7e6ee7c to 0x7e7351e, (0x46a2 bytes) 2024-09-21T15:10:42.167 INFO:teuthology.orchestra.run.smithi161.stdout:5953 write 0x5766747 thru 0x5770f94 (0xa84e bytes) 2024-09-21T15:10:42.167 INFO:teuthology.orchestra.run.smithi161.stdout:5932 writesame 0xa369f9d thru 0xa36a8a0 data_size 0x2(0x904 bytes) 2024-09-21T15:10:42.171 INFO:teuthology.orchestra.run.smithi161.stdout:4734 writesame 0x78b0359 thru 0x78bc700 data_size 0xc(0xc3a8 bytes) 2024-09-21T15:10:42.189 INFO:teuthology.orchestra.run.smithi161.stdout:5954 trunc from 0xc086337 to 0xd6ef3ba 2024-09-21T15:10:42.192 INFO:teuthology.orchestra.run.smithi161.stdout:5933 write 0xb8870c8 thru 0xb88e1aa (0x70e3 bytes) 2024-09-21T15:10:42.211 INFO:teuthology.orchestra.run.smithi161.stdout:4735 read 0x438db69 thru 0x43961ed (0x8685 bytes) 2024-09-21T15:10:42.218 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.218+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f9ec0 finish: resending after timeout 2024-09-21T15:10:42.219 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.218+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e4fdd40 finish: resending after timeout 2024-09-21T15:10:42.220 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.218+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f8d80 finish: resending after timeout 2024-09-21T15:10:42.220 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.218+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a7980 finish: resending after timeout 2024-09-21T15:10:42.220 INFO:teuthology.orchestra.run.smithi161.stdout:4736 trunc from 0x92b6654 to 0x4e7116d 2024-09-21T15:10:42.220 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.218+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e6183c0 finish: resending after timeout 2024-09-21T15:10:42.222 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.222+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a5520300 finish: resending after timeout 2024-09-21T15:10:42.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.226+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560b40 finish: resending after timeout 2024-09-21T15:10:42.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.226+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc6c0 finish: resending after timeout 2024-09-21T15:10:42.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.230+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0d80 finish: resending after timeout 2024-09-21T15:10:42.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.230+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a69c0 finish: resending after timeout 2024-09-21T15:10:42.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.230+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:10:42.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.230+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a6480 finish: resending after timeout 2024-09-21T15:10:42.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.230+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a55206c0 finish: resending after timeout 2024-09-21T15:10:42.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ab14b680 finish: resending after timeout 2024-09-21T15:10:42.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bd800 finish: resending after timeout 2024-09-21T15:10:42.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc300 finish: resending after timeout 2024-09-21T15:10:42.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43a40 finish: resending after timeout 2024-09-21T15:10:42.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c420c0 finish: resending after timeout 2024-09-21T15:10:42.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:42.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43140 finish: resending after timeout 2024-09-21T15:10:42.237 INFO:teuthology.orchestra.run.smithi161.stdout:5934 trunc from 0xcd63dca to 0x13b4c49 2024-09-21T15:10:42.246 INFO:teuthology.orchestra.run.smithi161.stdout:5955 flatten 2024-09-21T15:10:42.335 INFO:teuthology.orchestra.run.smithi161.stdout:5935 trunc from 0x13b4c49 to 0x7582686 2024-09-21T15:10:42.340 INFO:teuthology.orchestra.run.smithi161.stdout:5956 write 0x5e7240a thru 0x5e770a3 (0x4c9a bytes) 2024-09-21T15:10:42.340 INFO:teuthology.orchestra.run.smithi161.stdout:4737 writesame 0xaa637e9 thru 0xaa6727e data_size 0x1(0x3a96 bytes) 2024-09-21T15:10:42.345 INFO:teuthology.orchestra.run.smithi161.stdout:4738 punch from 0x406caa6 to 0x4079665, (0xcbbf bytes) 2024-09-21T15:10:42.352 INFO:teuthology.orchestra.run.smithi161.stdout:5957 writesame 0x8c65075 thru 0x8c6e7a5 data_size 0x1(0x9731 bytes) 2024-09-21T15:10:42.354 INFO:teuthology.orchestra.run.smithi161.stdout:4739 trunc from 0xaa6727f to 0x644c0c2 2024-09-21T15:10:42.398 INFO:teuthology.orchestra.run.smithi161.stdout:5958 write 0x69a10e5 thru 0x69a9597 (0x84b3 bytes) 2024-09-21T15:10:42.412 INFO:teuthology.orchestra.run.smithi161.stdout:5959 punch from 0x432df11 to 0x43361b5, (0x82a4 bytes) 2024-09-21T15:10:42.412 INFO:teuthology.orchestra.run.smithi161.stdout:5961 read 0x98a24c1 thru 0x98ab92d (0x946d bytes) 2024-09-21T15:10:42.412 INFO:teuthology.orchestra.run.smithi161.stdout:5963 writesame 0x3c8c9c8 thru 0x3c8d637 data_size 0x8(0xc70 bytes) 2024-09-21T15:10:42.418 INFO:teuthology.orchestra.run.smithi161.stdout:5936 write 0x973cd61 thru 0x9748a70 (0xbd10 bytes) 2024-09-21T15:10:42.432 INFO:teuthology.orchestra.run.smithi161.stdout:5966 writesame 0x9cfb88a thru 0x9cfd95a data_size 0x1(0x20d1 bytes) 2024-09-21T15:10:42.447 INFO:teuthology.orchestra.run.smithi161.stdout:5967 writesame 0x88aba8c thru 0x88b69c8 data_size 0x1(0xaf3d bytes) 2024-09-21T15:10:42.448 INFO:teuthology.orchestra.run.smithi161.stdout:5937 punch from 0x71eab71 to 0x71f7420, (0xc8af bytes) 2024-09-21T15:10:42.448 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:42.448 INFO:teuthology.orchestra.run.smithi161.stdout:5942 write 0xb8667 thru 0xc5160 (0xcafa bytes) 2024-09-21T15:10:42.453 INFO:teuthology.orchestra.run.smithi161.stdout:4741 write 0xe869c24 thru 0xe87184d (0x7c2a bytes) 2024-09-21T15:10:42.467 INFO:teuthology.orchestra.run.smithi161.stdout:5944 read 0x7d777cf thru 0x7d78e96 (0x16c8 bytes) 2024-09-21T15:10:42.471 INFO:teuthology.orchestra.run.smithi161.stdout:5945 trunc from 0x9748a71 to 0x76d1b89 2024-09-21T15:10:42.495 INFO:teuthology.orchestra.run.smithi161.stdout:4742 punch from 0x745e4f2 to 0x746df01, (0xfa0f bytes) 2024-09-21T15:10:42.496 INFO:teuthology.orchestra.run.smithi161.stdout:5968 writesame 0x5e1aa2b thru 0x5e1f9a6 data_size 0x2(0x4f7c bytes) 2024-09-21T15:10:42.496 INFO:teuthology.orchestra.run.smithi161.stdout:4743 write 0xa1566ee thru 0xa15c009 (0x591c bytes) 2024-09-21T15:10:42.515 INFO:teuthology.orchestra.run.smithi161.stdout:5969 writesame 0x797cb52 thru 0x79810ec data_size 0x1(0x459b bytes) 2024-09-21T15:10:42.543 INFO:teuthology.orchestra.run.smithi161.stdout:5970 read 0x3229d9e thru 0x3239400 (0xf663 bytes) 2024-09-21T15:10:42.550 INFO:teuthology.orchestra.run.smithi161.stdout:5946 trunc from 0x76d1b89 to 0xd250aa 2024-09-21T15:10:42.557 INFO:teuthology.orchestra.run.smithi161.stdout:4744 writesame 0xec74981 thru 0xec83956 data_size 0x51(0xefd6 bytes) 2024-09-21T15:10:42.562 INFO:teuthology.orchestra.run.smithi161.stdout:5971 trunc from 0xd6ef3ba to 0x2f23d04 2024-09-21T15:10:42.575 INFO:teuthology.orchestra.run.smithi161.stdout:4748 read 0x7693378 thru 0x769594d (0x25d6 bytes) 2024-09-21T15:10:42.575 INFO:teuthology.orchestra.run.smithi161.stdout:4752 write 0xac42d15 thru 0xac440ce (0x13ba bytes) 2024-09-21T15:10:42.584 INFO:teuthology.orchestra.run.smithi161.stdout:5947 punch from 0x42f2af to 0x43b12a, (0xbe7b bytes) 2024-09-21T15:10:42.584 INFO:teuthology.orchestra.run.smithi161.stdout:5948 read 0xb629f7 thru 0xb64f5f (0x2569 bytes) 2024-09-21T15:10:42.584 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:42.607 INFO:teuthology.orchestra.run.smithi161.stdout:4754 read 0x5a9691f thru 0x5a9a7e9 (0x3ecb bytes) 2024-09-21T15:10:42.607 INFO:teuthology.orchestra.run.smithi161.stdout:4755 punch from 0x275fed2 to 0x276fc8d, (0xfdbb bytes) 2024-09-21T15:10:42.607 INFO:teuthology.orchestra.run.smithi161.stdout:4756 write 0xd464f23 thru 0xd473df9 (0xeed7 bytes) 2024-09-21T15:10:42.636 INFO:teuthology.orchestra.run.smithi161.stdout:5953 write 0x2f28e32 thru 0x2f2d4ff (0x46ce bytes) 2024-09-21T15:10:42.645 INFO:teuthology.orchestra.run.smithi161.stdout:4758 punch from 0xd035fe1 to 0xd03759b, (0x15ba bytes) 2024-09-21T15:10:42.645 INFO:teuthology.orchestra.run.smithi161.stdout:4759 write 0x1872794 thru 0x1876384 (0x3bf1 bytes) 2024-09-21T15:10:42.657 INFO:teuthology.orchestra.run.smithi161.stdout:4760 read 0x3450f01 thru 0x3456584 (0x5684 bytes) 2024-09-21T15:10:42.658 INFO:teuthology.orchestra.run.smithi161.stdout:4761 write 0xa10610f thru 0xa114533 (0xe425 bytes) 2024-09-21T15:10:42.658 INFO:teuthology.orchestra.run.smithi161.stdout:5954 punch from 0x1c17c2c to 0x1c1bc76, (0x404a bytes) 2024-09-21T15:10:42.658 INFO:teuthology.orchestra.run.smithi161.stdout:5957 punch from 0xaee0a to 0xb4d9c, (0x5f92 bytes) 2024-09-21T15:10:42.676 INFO:teuthology.orchestra.run.smithi161.stdout:5398 writesame 0xd30e647 thru 0xd3139ad data_size 0xb(0x5367 bytes) 2024-09-21T15:10:42.679 INFO:teuthology.orchestra.run.smithi161.stdout:4763 read 0x81b012e thru 0x81b93ed (0x92c0 bytes) 2024-09-21T15:10:42.680 INFO:teuthology.orchestra.run.smithi161.stdout:4766 punch from 0x1bc6bc2 to 0x1bce1f3, (0x7631 bytes) 2024-09-21T15:10:42.680 INFO:teuthology.orchestra.run.smithi161.stdout:5399 punch from 0x9848a9f to 0x984f927, (0x6e88 bytes) 2024-09-21T15:10:42.680 INFO:teuthology.orchestra.run.smithi161.stdout:5400 read 0xadf0323 thru 0xadf4b4a (0x4828 bytes) 2024-09-21T15:10:42.681 INFO:teuthology.orchestra.run.smithi161.stdout:4767 read 0x9c8cfc6 thru 0x9c967a1 (0x97dc bytes) 2024-09-21T15:10:42.681 INFO:teuthology.orchestra.run.smithi161.stdout:5401 punch from 0x8de9383 to 0x8df41d4, (0xae51 bytes) 2024-09-21T15:10:42.681 INFO:teuthology.orchestra.run.smithi161.stdout:5403 write 0x9f33500 thru 0x9f3748d (0x3f8e bytes) 2024-09-21T15:10:42.681 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:42.682 INFO:teuthology.orchestra.run.smithi161.stdout:4770 read 0x1ef4643 thru 0x1ef8c70 (0x462e bytes) 2024-09-21T15:10:42.682 INFO:teuthology.orchestra.run.smithi161.stdout:4771 read 0x6b3bbde thru 0x6b3e00d (0x2430 bytes) 2024-09-21T15:10:42.682 INFO:teuthology.orchestra.run.smithi161.stdout:4772 write 0x6c56488 thru 0x6c5cd3d (0x68b6 bytes) 2024-09-21T15:10:42.695 INFO:teuthology.orchestra.run.smithi161.stdout:5405 punch from 0x18b7e09 to 0x18c1e98, (0xa08f bytes) 2024-09-21T15:10:42.695 INFO:teuthology.orchestra.run.smithi161.stdout:5406 punch from 0xcb941a0 to 0xcb9957d, (0x53dd bytes) 2024-09-21T15:10:42.695 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:42.695 INFO:teuthology.orchestra.run.smithi161.stdout:5409 write 0x1fdde8b thru 0x1fe321f (0x5395 bytes) 2024-09-21T15:10:42.712 INFO:teuthology.orchestra.run.smithi161.stdout:4774 read 0xa931731 thru 0xa936669 (0x4f39 bytes) 2024-09-21T15:10:42.715 INFO:teuthology.orchestra.run.smithi161.stdout:5972 write 0xdc06f6b thru 0xdc14dae (0xde44 bytes) 2024-09-21T15:10:42.720 INFO:teuthology.orchestra.run.smithi161.stdout:5410 write 0xa7b5c58 thru 0xa7bf4b3 (0x985c bytes) 2024-09-21T15:10:42.722 INFO:teuthology.orchestra.run.smithi161.stdout:4775 trunc from 0xec83957 to 0xa8f86c2 2024-09-21T15:10:42.727 INFO:teuthology.orchestra.run.smithi161.stdout:5958 write 0xcb13c9f thru 0xcb199be (0x5d20 bytes) 2024-09-21T15:10:42.746 INFO:teuthology.orchestra.run.smithi161.stdout:5974 read 0x7e3a0c8 thru 0x7e492e0 (0xf219 bytes) 2024-09-21T15:10:42.747 INFO:teuthology.orchestra.run.smithi161.stdout:5975 read 0xbc93ed5 thru 0xbc9aa2d (0x6b59 bytes) 2024-09-21T15:10:42.755 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:42.755 INFO:teuthology.orchestra.run.smithi161.stdout:5412 read 0x6a4c674 thru 0x6a54113 (0x7aa0 bytes) 2024-09-21T15:10:42.755 INFO:teuthology.orchestra.run.smithi161.stdout:5413 punch from 0xb00506 to 0xb0bae6, (0xb5e0 bytes) 2024-09-21T15:10:42.755 INFO:teuthology.orchestra.run.smithi161.stdout:5415 read 0x7985885 thru 0x798a485 (0x4c01 bytes) 2024-09-21T15:10:42.756 INFO:teuthology.orchestra.run.smithi161.stdout:5419 writesame 0x6e893ce thru 0x6e97fa2 data_size 0x1(0xebd5 bytes) 2024-09-21T15:10:42.764 INFO:teuthology.orchestra.run.smithi161.stdout:5959 read 0x6131764 thru 0x6140c80 (0xf51d bytes) 2024-09-21T15:10:42.794 INFO:teuthology.orchestra.run.smithi161.stdout:5960 trunc from 0xcb199bf to 0x3540dd2 2024-09-21T15:10:42.801 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:42.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:10:42.801 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:42.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:10:42.801 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:42.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:42.856 INFO:teuthology.orchestra.run.smithi161.stdout:5421 write 0x19df77a thru 0x19e8ac4 (0x934b bytes) 2024-09-21T15:10:42.864 INFO:teuthology.orchestra.run.smithi161.stdout:4777 punch from 0x5a4fc3f to 0x5a52fe2, (0x33a3 bytes) 2024-09-21T15:10:42.864 INFO:teuthology.orchestra.run.smithi161.stdout:4778 punch from 0x7483a08 to 0x748bc91, (0x8289 bytes) 2024-09-21T15:10:42.877 INFO:teuthology.orchestra.run.smithi161.stdout:4780 trunc from 0xa8f86c2 to 0x5408f22 2024-09-21T15:10:42.877 INFO:teuthology.orchestra.run.smithi161.stdout:5976 write 0xe4edf9f thru 0xe4fbcb8 (0xdd1a bytes) 2024-09-21T15:10:42.888 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:42.888 INFO:teuthology.orchestra.run.smithi161.stdout:5424 punch from 0x8f7c0b5 to 0x8f85fff, (0x9f4a bytes) 2024-09-21T15:10:42.888 INFO:teuthology.orchestra.run.smithi161.stdout:5425 punch from 0x16380a to 0x16817e, (0x4974 bytes) 2024-09-21T15:10:42.889 INFO:teuthology.orchestra.run.smithi161.stdout:5426 write 0x6e7c258 thru 0x6e818b1 (0x565a bytes) 2024-09-21T15:10:42.908 INFO:teuthology.orchestra.run.smithi161.stdout:5978 read 0x2a7400f thru 0x2a7ddbe (0x9db0 bytes) 2024-09-21T15:10:42.910 INFO:teuthology.orchestra.run.smithi161.stdout:5979 write 0x2d6da4a thru 0x2d79934 (0xbeeb bytes) 2024-09-21T15:10:42.917 INFO:teuthology.orchestra.run.smithi161.stdout:5961 punch from 0x178454e to 0x178b6f2, (0x71a4 bytes) 2024-09-21T15:10:42.919 INFO:teuthology.orchestra.run.smithi161.stdout:5963 trunc from 0x3540dd2 to 0x27ad735 2024-09-21T15:10:42.921 INFO:teuthology.orchestra.run.smithi161.stdout:5427 write 0xa998a03 thru 0xa99d561 (0x4b5f bytes) 2024-09-21T15:10:42.932 INFO:teuthology.orchestra.run.smithi161.stdout:5980 write 0x9a8d5b7 thru 0x9a8f8bd (0x2307 bytes) 2024-09-21T15:10:42.955 INFO:teuthology.orchestra.run.smithi161.stdout:5428 trunc from 0xd3139ae to 0x1ff8dd7 2024-09-21T15:10:42.963 INFO:teuthology.orchestra.run.smithi161.stdout:5981 trunc from 0xe4fbcb9 to 0x902074b 2024-09-21T15:10:42.963 INFO:teuthology.orchestra.run.smithi161.stdout:4781 trunc from 0x5408f22 to 0x5fba325 2024-09-21T15:10:42.988 INFO:teuthology.orchestra.run.smithi161.stdout:5964 read 0xafe830 thru 0xb0c65c (0xde2d bytes) 2024-09-21T15:10:43.008 INFO:teuthology.orchestra.run.smithi161.stdout:5430 read 0x101fdcf thru 0x10200be (0x2f0 bytes) 2024-09-21T15:10:43.023 INFO:teuthology.orchestra.run.smithi161.stdout:5982 read 0x309e0e8 thru 0x30a089e (0x27b7 bytes) 2024-09-21T15:10:43.023 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:43.023 INFO:teuthology.orchestra.run.smithi161.stdout:5988 writesame 0x814434a thru 0x8151440 data_size 0xd(0xd0f7 bytes) 2024-09-21T15:10:43.038 INFO:teuthology.orchestra.run.smithi161.stdout:5965 write 0xc43f10f thru 0xc444860 (0x5752 bytes) 2024-09-21T15:10:43.042 INFO:teuthology.orchestra.run.smithi161.stdout:5431 write 0x2e97f4c thru 0x2e9e8f0 (0x69a5 bytes) 2024-09-21T15:10:43.047 INFO:teuthology.orchestra.run.smithi161.stdout:4782 writesame 0xc80518b thru 0xc811f1e data_size 0x3b(0xcd94 bytes) 2024-09-21T15:10:43.052 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:43.053 INFO:teuthology.orchestra.run.smithi161.stdout:4785 write 0xc569762 thru 0xc573d2a (0xa5c9 bytes) 2024-09-21T15:10:43.070 INFO:teuthology.orchestra.run.smithi161.stdout:5433 punch from 0x2720ca9 to 0x272e004, (0xd35b bytes) 2024-09-21T15:10:43.070 INFO:teuthology.orchestra.run.smithi161.stdout:5434 writesame 0x18af9ed thru 0x18b1228 data_size 0x16(0x183c bytes) 2024-09-21T15:10:43.095 INFO:teuthology.orchestra.run.smithi161.stdout:4786 write 0xc42c15b thru 0xc434802 (0x86a8 bytes) 2024-09-21T15:10:43.108 INFO:teuthology.orchestra.run.smithi161.stdout:5991 write 0xe736a1f thru 0xe73b5c0 (0x4ba2 bytes) 2024-09-21T15:10:43.120 INFO:teuthology.orchestra.run.smithi161.stdout:5966 write 0xd9797b0 thru 0xd98123b (0x7a8c bytes) 2024-09-21T15:10:43.123 INFO:teuthology.orchestra.run.smithi161.stdout:5992 write 0xb80a4ed thru 0xb80d74e (0x3262 bytes) 2024-09-21T15:10:43.130 INFO:teuthology.orchestra.run.smithi161.stdout:4787 trunc from 0xc811f1f to 0x5c98e80 2024-09-21T15:10:43.142 INFO:teuthology.orchestra.run.smithi161.stdout:5967 punch from 0x8cc17e5 to 0x8ccaa9f, (0x92ba bytes) 2024-09-21T15:10:43.143 INFO:teuthology.orchestra.run.smithi161.stdout:5993 read 0x56dd733 thru 0x56e81b4 (0xaa82 bytes) 2024-09-21T15:10:43.144 INFO:teuthology.orchestra.run.smithi161.stdout:5968 write 0x29c22a3 thru 0x29c3158 (0xeb6 bytes) 2024-09-21T15:10:43.145 INFO:teuthology.orchestra.run.smithi161.stdout:5994 read 0xba22f79 thru 0xba24604 (0x168c bytes) 2024-09-21T15:10:43.145 INFO:teuthology.orchestra.run.smithi161.stdout:5995 read 0x96fffee thru 0x97099b8 (0x99cb bytes) 2024-09-21T15:10:43.146 INFO:teuthology.orchestra.run.smithi161.stdout:5996 write 0x8a3fcdb thru 0x8a4f080 (0xf3a6 bytes) 2024-09-21T15:10:43.150 INFO:teuthology.orchestra.run.smithi161.stdout:5435 writesame 0xc9eab9d thru 0xc9ed3c2 data_size 0x9(0x2826 bytes) 2024-09-21T15:10:43.159 INFO:teuthology.orchestra.run.smithi161.stdout:5970 punch from 0x9761072 to 0x9766c36, (0x5bc4 bytes) 2024-09-21T15:10:43.160 INFO:teuthology.orchestra.run.smithi161.stdout:5437 writesame 0x8d5d64f thru 0x8d603d7 data_size 0x1(0x2d89 bytes) 2024-09-21T15:10:43.160 INFO:teuthology.orchestra.run.smithi161.stdout:5971 trunc from 0xd98123c to 0xdd83ecf 2024-09-21T15:10:43.163 INFO:teuthology.orchestra.run.smithi161.stdout:5998 write 0xc3815 thru 0xd0283 (0xca6f bytes) 2024-09-21T15:10:43.189 INFO:teuthology.orchestra.run.smithi161.stdout:5999 write 0x97021a7 thru 0x970d1ea (0xb044 bytes) 2024-09-21T15:10:43.189 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:43.181+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:10:43.189 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:43.181+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:10:43.212 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:43.205+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab275110 2024-09-21T15:10:43.213 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:43.205+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:10:43.213 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:43.205+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:10:43.213 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:43.205+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:10:43.213 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:43.205+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:10:43.213 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:43.205+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:10:43.213 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:43.205+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:10:43.213 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:43.205+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:10:43.213 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:43.205+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:10:43.214 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:43.214 INFO:teuthology.orchestra.run.smithi161.stdout:5439 read 0xe04768 thru 0xe12bac (0xe445 bytes) 2024-09-21T15:10:43.214 INFO:teuthology.orchestra.run.smithi161.stdout:5440 punch from 0x80a5560 to 0x80a918d, (0x3c2d bytes) 2024-09-21T15:10:43.218 INFO:teuthology.orchestra.run.smithi161.stdout:5443 trunc from 0xc9ed3c3 to 0xe89cc22 2024-09-21T15:10:43.223 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:43.213+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:10:43.223 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:43.213+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:10:43.239 INFO:teuthology.orchestra.run.smithi161.stdout:4789 read 0x37e6442 thru 0x37eaec5 (0x4a84 bytes) 2024-09-21T15:10:43.240 INFO:teuthology.orchestra.run.smithi161.stdout:4791 write 0x2d5f89f thru 0x2d6a96b (0xb0cd bytes) 2024-09-21T15:10:43.249 INFO:teuthology.orchestra.run.smithi161.stdout:6000 read 0x3443907 thru 0x3448b05 (0x51ff bytes) 2024-09-21T15:10:43.263 INFO:teuthology.orchestra.run.smithi161.stdout:5972 punch from 0xa3b9cd6 to 0xa3be578, (0x48a2 bytes) 2024-09-21T15:10:43.263 INFO:teuthology.orchestra.run.smithi161.stdout:5973 read 0x4893fdc thru 0x4896c7c (0x2ca1 bytes) 2024-09-21T15:10:43.264 INFO:teuthology.orchestra.run.smithi161.stdout:5974 trunc from 0xdd83ecf to 0xd36da8d 2024-09-21T15:10:43.265 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:43.292 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:43.290+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a666eb40 handle_clone_image: failed to clone image mirror/10b65af4931e to image_cluster1.client.mirror.4-clone46 2024-09-21T15:10:43.307 INFO:teuthology.orchestra.run.smithi161.stdout:5444 trunc from 0xe89cc22 to 0x2578555 2024-09-21T15:10:43.308 INFO:teuthology.orchestra.run.smithi161.stdout:4794 write 0xa88fb56 thru 0xa88ffbe (0x469 bytes) 2024-09-21T15:10:43.316 INFO:teuthology.orchestra.run.smithi161.stdout:5975 punch from 0x530c6cc to 0x531c679, (0xffad bytes) 2024-09-21T15:10:43.318 INFO:teuthology.orchestra.run.smithi161.stdout:5976 trunc from 0xd36da8d to 0xc10cf6a 2024-09-21T15:10:43.322 INFO:teuthology.orchestra.run.smithi161.stdout:4795 punch from 0x3ef0e54 to 0x3ef2f41, (0x20ed bytes) 2024-09-21T15:10:43.361 INFO:teuthology.orchestra.run.smithi161.stdout:5977 punch from 0x4ce665e to 0x4cebb14, (0x54b6 bytes) 2024-09-21T15:10:43.361 INFO:teuthology.orchestra.run.smithi161.stdout:5978 writesame 0x7d513ed thru 0x7d5d9f3 data_size 0x1(0xc607 bytes) 2024-09-21T15:10:43.364 INFO:teuthology.orchestra.run.smithi161.stdout:4796 write 0xb1140ca thru 0xb11cd74 (0x8cab bytes) 2024-09-21T15:10:43.386 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #39, image image_cluster1.client.mirror.5-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent40 2024-09-21T15:10:43.413 INFO:teuthology.orchestra.run.smithi161.stdout:5979 writesame 0xb933c93 thru 0xb938677 data_size 0x1(0x49e5 bytes) 2024-09-21T15:10:43.420 INFO:teuthology.orchestra.run.smithi161.stdout:4797 trunc from 0xb11cd75 to 0xab3436d 2024-09-21T15:10:43.435 INFO:teuthology.orchestra.run.smithi161.stdout:5445 writesame 0x8cbbd70 thru 0x8cca22c data_size 0x3(0xe4bd bytes) 2024-09-21T15:10:43.445 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:43.445 INFO:teuthology.orchestra.run.smithi161.stdout:5447 writesame 0x3d5526d thru 0x3d5e051 data_size 0x5(0x8de5 bytes) 2024-09-21T15:10:43.460 INFO:teuthology.orchestra.run.smithi161.stdout:5980 trunc from 0xc10cf6a to 0x89abd12 2024-09-21T15:10:43.467 INFO:teuthology.orchestra.run.smithi161.stdout:5449 read 0x15d601a thru 0x15d8463 (0x244a bytes) 2024-09-21T15:10:43.468 INFO:teuthology.orchestra.run.smithi161.stdout:5450 write 0x72a5f0a thru 0x72a95a6 (0x369d bytes) 2024-09-21T15:10:43.473 INFO:teuthology.orchestra.run.smithi161.stdout:4798 write 0x38a6785 thru 0x38a6a5f (0x2db bytes) 2024-09-21T15:10:43.491 INFO:teuthology.orchestra.run.smithi161.stdout:All operations completed A-OK! 2024-09-21T15:10:43.492 INFO:teuthology.orchestra.run.smithi161.stdout:5451 read 0x72d3c48 thru 0x72dfa2b (0xbde4 bytes) 2024-09-21T15:10:43.495 INFO:teuthology.orchestra.run.smithi161.stdout:5454 trunc from 0x8cca22d to 0x9b47f00 2024-09-21T15:10:43.525 INFO:teuthology.orchestra.run.smithi161.stdout:4799 write 0xb08dbfe thru 0xb090806 (0x2c09 bytes) 2024-09-21T15:10:43.526 DEBUG:teuthology.parallel:result is None 2024-09-21T15:10:43.531 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:43.532 INFO:teuthology.orchestra.run.smithi161.stdout:5456 write 0x776f9d0 thru 0x777d109 (0xd73a bytes) 2024-09-21T15:10:43.551 INFO:teuthology.orchestra.run.smithi161.stdout:5983 writesame 0x8bafcd2 thru 0x8bb96d1 data_size 0x80(0x9a00 bytes) 2024-09-21T15:10:43.556 INFO:teuthology.orchestra.run.smithi161.stdout:5984 read 0x7c6c4e7 thru 0x7c6ef92 (0x2aac bytes) 2024-09-21T15:10:43.557 INFO:teuthology.orchestra.run.smithi161.stdout:5985 writesame 0x53df041 thru 0x53e4c8b data_size 0x1(0x5c4b bytes) 2024-09-21T15:10:43.562 INFO:teuthology.orchestra.run.smithi161.stdout:5458 trunc from 0x9b47f00 to 0xd587c0c 2024-09-21T15:10:43.585 INFO:teuthology.orchestra.run.smithi161.stdout:4800 write 0xe3223d8 thru 0xe32d54b (0xb174 bytes) 2024-09-21T15:10:43.612 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:43.615 INFO:teuthology.orchestra.run.smithi161.stdout:4801 read 0xdf96fcd thru 0xdf99200 (0x2234 bytes) 2024-09-21T15:10:43.615 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:43.616 INFO:teuthology.orchestra.run.smithi161.stdout:4804 read 0xe1e40a4 thru 0xe1e51cc (0x1129 bytes) 2024-09-21T15:10:43.616 INFO:teuthology.orchestra.run.smithi161.stdout:4805 punch from 0xe1fa6a5 to 0xe1feb80, (0x44db bytes) 2024-09-21T15:10:43.627 INFO:teuthology.orchestra.run.smithi161.stdout:5460 trunc from 0xd587c0c to 0x6ac6601 2024-09-21T15:10:43.638 INFO:teuthology.orchestra.run.smithi161.stdout:4807 trunc from 0xe32d54c to 0x2a1a703 2024-09-21T15:10:43.644 INFO:teuthology.orchestra.run.smithi161.stdout:5986 write 0xc5778f1 thru 0xc5791be (0x18ce bytes) 2024-09-21T15:10:43.674 INFO:teuthology.orchestra.run.smithi161.stdout:5987 punch from 0x57ca7fd to 0x57d02c3, (0x5ac6 bytes) 2024-09-21T15:10:43.675 INFO:teuthology.orchestra.run.smithi161.stdout:5988 writesame 0x835dec4 thru 0x83680dd data_size 0x1(0xa21a bytes) 2024-09-21T15:10:43.682 INFO:teuthology.orchestra.run.smithi161.stdout:5461 trunc from 0x6ac6601 to 0x61e7412 2024-09-21T15:10:43.717 INFO:teuthology.orchestra.run.smithi161.stdout:5989 read 0xb952b44 thru 0xb958483 (0x5940 bytes) 2024-09-21T15:10:43.717 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:43.718 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:43.720 INFO:teuthology.orchestra.run.smithi161.stdout:5464 trunc from 0x61e7412 to 0x561b35c 2024-09-21T15:10:43.720 INFO:teuthology.orchestra.run.smithi161.stdout:5991 trunc from 0xc5791bf to 0xb58ba01 2024-09-21T15:10:43.724 INFO:teuthology.orchestra.run.smithi161.stdout:4808 punch from 0xa7f5ad to 0xa8924b, (0x9c9e bytes) 2024-09-21T15:10:43.724 INFO:teuthology.orchestra.run.smithi161.stdout:4809 clone 51 order 21 su 1048576 sc 4 2024-09-21T15:10:43.747 INFO:teuthology.orchestra.run.smithi161.stdout:5465 read 0x3eaa5cb thru 0x3eb3d1e (0x9754 bytes) 2024-09-21T15:10:43.747 INFO:teuthology.orchestra.run.smithi161.stdout:5466 read 0x16edf21 thru 0x16f000b (0x20eb bytes) 2024-09-21T15:10:43.748 INFO:teuthology.orchestra.run.smithi161.stdout:5467 write 0x5592e23 thru 0x559fdeb (0xcfc9 bytes) 2024-09-21T15:10:43.768 INFO:teuthology.orchestra.run.smithi161.stdout:5468 read 0x1938d0b thru 0x193c21e (0x3514 bytes) 2024-09-21T15:10:43.769 INFO:teuthology.orchestra.run.smithi161.stdout:5469 read 0x190d852 thru 0x191740e (0x9bbd bytes) 2024-09-21T15:10:43.770 INFO:teuthology.orchestra.run.smithi161.stdout:5471 read 0x3b12fd2 thru 0x3b1c2e8 (0x9317 bytes) 2024-09-21T15:10:43.770 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:43.770 INFO:teuthology.orchestra.run.smithi161.stdout:5476 read 0xbe7b2a thru 0xbf6dff (0xf2d6 bytes) 2024-09-21T15:10:43.772 INFO:teuthology.orchestra.run.smithi161.stdout:5477 writesame 0x353a209 thru 0x353e443 data_size 0x1(0x423b bytes) 2024-09-21T15:10:43.772 INFO:teuthology.orchestra.run.smithi161.stdout:5992 read 0x34d6796 thru 0x34da3ce (0x3c39 bytes) 2024-09-21T15:10:43.772 INFO:teuthology.orchestra.run.smithi161.stdout:5993 read 0x6abfe5e thru 0x6ac4f47 (0x50ea bytes) 2024-09-21T15:10:43.773 INFO:teuthology.orchestra.run.smithi161.stdout:5994 read 0x82ade10 thru 0x82b98be (0xbaaf bytes) 2024-09-21T15:10:43.773 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:43.773 INFO:teuthology.orchestra.run.smithi161.stdout:5996 read 0x8c30ecc thru 0x8c3a576 (0x96ab bytes) 2024-09-21T15:10:43.774 INFO:teuthology.orchestra.run.smithi161.stdout:5999 write 0x89eecd7 thru 0x89efe1e (0x1148 bytes) 2024-09-21T15:10:43.836 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #29, image image_cluster1.client.mirror.1-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent30 2024-09-21T15:10:43.845 INFO:teuthology.orchestra.run.smithi161.stdout:5478 writesame 0x897316a thru 0x897b6bf data_size 0x3(0x8556 bytes) 2024-09-21T15:10:43.850 INFO:teuthology.orchestra.run.smithi161.stdout:5480 punch from 0x661978f to 0x6624ad5, (0xb346 bytes) 2024-09-21T15:10:43.850 INFO:teuthology.orchestra.run.smithi161.stdout:5483 read 0x2ab5dd thru 0x2add26 (0x274a bytes) 2024-09-21T15:10:43.866 INFO:teuthology.orchestra.run.smithi161.stdout:5484 trunc from 0x897b6c0 to 0x2f70c3e 2024-09-21T15:10:43.949 INFO:teuthology.orchestra.run.smithi161.stdout:5486 read 0xb9e3b thru 0xc70e1 (0xd2a7 bytes) 2024-09-21T15:10:43.954 INFO:teuthology.orchestra.run.smithi161.stdout:5487 trunc from 0x2f70c3e to 0x45f6dd9 2024-09-21T15:10:44.025 INFO:teuthology.orchestra.run.smithi161.stdout:5488 writesame 0xb70d270 thru 0xb71544f data_size 0x10(0x81e0 bytes) 2024-09-21T15:10:44.043 INFO:teuthology.orchestra.run.smithi161.stdout:5490 trunc from 0xb715450 to 0x5335d3f 2024-09-21T15:10:44.081 INFO:teuthology.orchestra.run.smithi161.stdout:5491 trunc from 0x5335d3f to 0x59cf3a6 2024-09-21T15:10:44.104 INFO:teuthology.orchestra.run.smithi161.stdout:5494 read 0x1401e2d thru 0x1405cf6 (0x3eca bytes) 2024-09-21T15:10:44.105 INFO:teuthology.orchestra.run.smithi161.stdout:5495 writesame 0x111c922 thru 0x1121ab1 data_size 0xc(0x5190 bytes) 2024-09-21T15:10:44.140 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #49, image image_cluster1.client.mirror.3-clone49 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent50 2024-09-21T15:10:44.141 INFO:teuthology.orchestra.run.smithi161.stdout:5496 punch from 0x4d051ee to 0x4d0c55d, (0x736f bytes) 2024-09-21T15:10:44.141 INFO:teuthology.orchestra.run.smithi161.stdout:5499 read 0x49a4303 thru 0x49a7e00 (0x3afe bytes) 2024-09-21T15:10:44.141 INFO:teuthology.orchestra.run.smithi161.stdout:5500 read 0x580f807 thru 0x5811554 (0x1d4e bytes) 2024-09-21T15:10:44.149 INFO:teuthology.orchestra.run.smithi161.stdout:5501 trunc from 0x59cf3a6 to 0x1e5a59e 2024-09-21T15:10:44.195 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:44.195 INFO:teuthology.orchestra.run.smithi161.stdout:5503 read 0x40b686 thru 0x411be4 (0x655f bytes) 2024-09-21T15:10:44.196 INFO:teuthology.orchestra.run.smithi161.stdout:5504 punch from 0x1415ae4 to 0x141c757, (0x6c73 bytes) 2024-09-21T15:10:44.253 INFO:teuthology.orchestra.run.smithi161.stdout:5505 write 0xae4c01b thru 0xae508c6 (0x48ac bytes) 2024-09-21T15:10:44.269 INFO:teuthology.orchestra.run.smithi161.stdout:5506 writesame 0x1dfec71 thru 0x1e0da5d data_size 0x4f(0xeded bytes) 2024-09-21T15:10:44.283 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:44.283 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:44.283 INFO:teuthology.orchestra.run.smithi161.stdout:5511 read 0x35e089 thru 0x35f0b8 (0x1030 bytes) 2024-09-21T15:10:44.286 INFO:teuthology.orchestra.run.smithi161.stdout:5512 trunc from 0xae508c7 to 0xb6a4dda 2024-09-21T15:10:44.327 INFO:teuthology.orchestra.run.smithi161.stdout:5513 trunc from 0xb6a4dda to 0xc244f16 2024-09-21T15:10:44.354 INFO:teuthology.orchestra.run.smithi161.stdout:5514 punch from 0x68d6e23 to 0x68d9d6a, (0x2f47 bytes) 2024-09-21T15:10:44.354 INFO:teuthology.orchestra.run.smithi161.stdout:5516 punch from 0xa598d71 to 0xa59bf38, (0x31c7 bytes) 2024-09-21T15:10:44.354 INFO:teuthology.orchestra.run.smithi161.stdout:5517 write 0x1880eaa thru 0x188b316 (0xa46d bytes) 2024-09-21T15:10:44.368 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:44.368 INFO:teuthology.orchestra.run.smithi161.stdout:5519 read 0xa1be6ed thru 0xa1c8e97 (0xa7ab bytes) 2024-09-21T15:10:44.368 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:44.368 INFO:teuthology.orchestra.run.smithi161.stdout:5521 write 0x9e26ff7 thru 0x9e33496 (0xc4a0 bytes) 2024-09-21T15:10:44.379 INFO:teuthology.orchestra.run.smithi161.stdout:All operations completed A-OK! 2024-09-21T15:10:44.390 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:44.390 INFO:teuthology.orchestra.run.smithi161.stdout:5523 write 0x183425c thru 0x18363b1 (0x2156 bytes) 2024-09-21T15:10:44.397 INFO:teuthology.orchestra.run.smithi161.stdout:5524 write 0x56478a thru 0x565628 (0xe9f bytes) 2024-09-21T15:10:44.423 DEBUG:teuthology.parallel:result is None 2024-09-21T15:10:44.430 INFO:teuthology.orchestra.run.smithi161.stdout:5525 read 0x850884 thru 0x858ab3 (0x8230 bytes) 2024-09-21T15:10:44.435 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:44.435 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:44.435 INFO:teuthology.orchestra.run.smithi161.stdout:5528 read 0x5945b3f thru 0x59511c9 (0xb68b bytes) 2024-09-21T15:10:44.435 INFO:teuthology.orchestra.run.smithi161.stdout:5529 writesame 0x1f1a318 thru 0x1f27385 data_size 0x3(0xd06e bytes) 2024-09-21T15:10:44.452 INFO:teuthology.orchestra.run.smithi161.stdout:5530 punch from 0x2aeb32 to 0x2b02c8, (0x1796 bytes) 2024-09-21T15:10:44.492 INFO:teuthology.orchestra.run.smithi161.stdout:5532 write 0xe4c1572 thru 0xe4cd2a2 (0xbd31 bytes) 2024-09-21T15:10:44.495 INFO:teuthology.orchestra.run.smithi161.stdout:4810 read 0x1b121a5 thru 0x1b1dd3a (0xbb96 bytes) 2024-09-21T15:10:44.509 INFO:teuthology.orchestra.run.smithi161.stdout:5533 writesame 0x6eb53a4 thru 0x6ebc631 data_size 0x3e(0x728e bytes) 2024-09-21T15:10:44.524 INFO:teuthology.orchestra.run.smithi161.stdout:5535 read 0x528596 thru 0x52e231 (0x5c9c bytes) 2024-09-21T15:10:44.525 INFO:teuthology.orchestra.run.smithi161.stdout:5536 read 0x366d7ce thru 0x367c3db (0xec0e bytes) 2024-09-21T15:10:44.525 INFO:teuthology.orchestra.run.smithi161.stdout:5537 read 0x1c1919b thru 0x1c246bb (0xb521 bytes) 2024-09-21T15:10:44.527 INFO:teuthology.orchestra.run.smithi161.stdout:5539 read 0x67cd0e0 thru 0x67d6a05 (0x9926 bytes) 2024-09-21T15:10:44.534 INFO:teuthology.orchestra.run.smithi161.stdout:5540 trunc from 0xe4cd2a3 to 0xba42420 2024-09-21T15:10:44.562 INFO:teuthology.orchestra.run.smithi161.stdout:4811 write 0x5a44cfd thru 0x5a47dd7 (0x30db bytes) 2024-09-21T15:10:44.578 INFO:teuthology.orchestra.run.smithi161.stdout:4812 read 0x193bc1b thru 0x19458d3 (0x9cb9 bytes) 2024-09-21T15:10:44.589 INFO:teuthology.orchestra.run.smithi161.stdout:5541 read 0xe59e57 thru 0xe6262b (0x87d5 bytes) 2024-09-21T15:10:44.590 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:44.590 INFO:teuthology.orchestra.run.smithi161.stdout:5543 write 0x483dd thru 0x51a95 (0x96b9 bytes) 2024-09-21T15:10:44.632 INFO:teuthology.orchestra.run.smithi161.stdout:4813 write 0x7da8455 thru 0x7dab04f (0x2bfb bytes) 2024-09-21T15:10:44.634 INFO:teuthology.orchestra.run.smithi161.stdout:5544 write 0x90d2d1 thru 0x914f6e (0x7c9e bytes) 2024-09-21T15:10:44.647 INFO:teuthology.orchestra.run.smithi161.stdout:5546 read 0x7efa6a thru 0x7f1470 (0x1a07 bytes) 2024-09-21T15:10:44.650 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:44.650 INFO:teuthology.orchestra.run.smithi161.stdout:5549 writesame 0x8075f42 thru 0x8080a6c data_size 0x1(0xab2b bytes) 2024-09-21T15:10:44.693 INFO:teuthology.orchestra.run.smithi161.stdout:5551 write 0x9b5ac8c thru 0x9b653bf (0xa734 bytes) 2024-09-21T15:10:44.704 INFO:teuthology.orchestra.run.smithi161.stdout:5554 write 0x66c605a thru 0x66ca693 (0x463a bytes) 2024-09-21T15:10:44.708 INFO:teuthology.orchestra.run.smithi161.stdout:4814 write 0xda9a11d thru 0xdaa2c16 (0x8afa bytes) 2024-09-21T15:10:44.729 INFO:teuthology.orchestra.run.smithi161.stdout:4815 write 0xcf61fae thru 0xcf6df4a (0xbf9d bytes) 2024-09-21T15:10:44.742 INFO:teuthology.orchestra.run.smithi161.stdout:5555 trunc from 0xba42420 to 0x479b1f6 2024-09-21T15:10:44.748 INFO:teuthology.orchestra.run.smithi161.stdout:4817 flatten 2024-09-21T15:10:44.855 INFO:teuthology.orchestra.run.smithi161.stdout:5556 read 0x1420b79 thru 0x14285b8 (0x7a40 bytes) 2024-09-21T15:10:44.856 INFO:teuthology.orchestra.run.smithi161.stdout:5559 punch from 0xced49f to 0xcefcec, (0x284d bytes) 2024-09-21T15:10:44.870 INFO:teuthology.orchestra.run.smithi161.stdout:4818 punch from 0xc2dfc53 to 0xc2e2b28, (0x2ed5 bytes) 2024-09-21T15:10:44.870 INFO:teuthology.orchestra.run.smithi161.stdout:4819 read 0x2a1cba thru 0x2aaa2e (0x8d75 bytes) 2024-09-21T15:10:44.872 INFO:teuthology.orchestra.run.smithi161.stdout:4820 write 0x7d5c051 thru 0x7d62284 (0x6234 bytes) 2024-09-21T15:10:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:4822 read 0x7273d0a thru 0x7277358 (0x364f bytes) 2024-09-21T15:10:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:4823 punch from 0x5018283 to 0x50220dd, (0x9e5a bytes) 2024-09-21T15:10:44.884 INFO:teuthology.orchestra.run.smithi161.stdout:4825 writesame 0x3893b65 thru 0x38a13a8 data_size 0x2(0xd844 bytes) 2024-09-21T15:10:44.910 INFO:teuthology.orchestra.run.smithi161.stdout:5562 write 0xbd2c818 thru 0xbd30ced (0x44d6 bytes) 2024-09-21T15:10:44.924 INFO:teuthology.orchestra.run.smithi161.stdout:4826 punch from 0x98cecf7 to 0x98cfb15, (0xe1e bytes) 2024-09-21T15:10:44.924 INFO:teuthology.orchestra.run.smithi161.stdout:4827 write 0x6985eb8 thru 0x69916c9 (0xb812 bytes) 2024-09-21T15:10:44.939 INFO:teuthology.orchestra.run.smithi161.stdout:5563 write 0x362f51c thru 0x363cdb7 (0xd89c bytes) 2024-09-21T15:10:44.941 INFO:teuthology.orchestra.run.smithi161.stdout:4828 read 0xb51f04b thru 0xb52af27 (0xbedd bytes) 2024-09-21T15:10:44.941 INFO:teuthology.orchestra.run.smithi161.stdout:4829 writesame 0xbef6fb0 thru 0xbf06d8a data_size 0x1(0xfddb bytes) 2024-09-21T15:10:44.984 INFO:teuthology.orchestra.run.smithi161.stdout:4830 writesame 0x166630e thru 0x16676df data_size 0x2b(0x13d2 bytes) 2024-09-21T15:10:44.984 INFO:teuthology.orchestra.run.smithi161.stdout:5564 read 0xb2b8af2 thru 0xb2c07f7 (0x7d06 bytes) 2024-09-21T15:10:44.985 INFO:teuthology.orchestra.run.smithi161.stdout:5565 read 0x35d632 thru 0x36adcb (0xd79a bytes) 2024-09-21T15:10:44.986 INFO:teuthology.orchestra.run.smithi161.stdout:5566 write 0x285dae9 thru 0x286ba4c (0xdf64 bytes) 2024-09-21T15:10:44.999 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:44.999 INFO:teuthology.orchestra.run.smithi161.stdout:4835 punch from 0x3cf085b to 0x3cf12db, (0xa80 bytes) 2024-09-21T15:10:44.999 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:44.999 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:44.999 INFO:teuthology.orchestra.run.smithi161.stdout:4839 write 0x35c83d2 thru 0x35cd390 (0x4fbf bytes) 2024-09-21T15:10:45.011 INFO:teuthology.orchestra.run.smithi161.stdout:5568 read 0x55cba05 thru 0x55cc751 (0xd4d bytes) 2024-09-21T15:10:45.011 INFO:teuthology.orchestra.run.smithi161.stdout:5569 writesame 0x206f0a4 thru 0x207e9b1 data_size 0x47(0xf90e bytes) 2024-09-21T15:10:45.017 INFO:teuthology.orchestra.run.smithi161.stdout:4840 punch from 0x7a15efc to 0x7a23d6a, (0xde6e bytes) 2024-09-21T15:10:45.027 INFO:teuthology.orchestra.run.smithi161.stdout:4842 trunc from 0xdaa2c17 to 0x9ffc5f7 2024-09-21T15:10:45.029 INFO:teuthology.orchestra.run.smithi161.stdout:5571 read 0x574d635 thru 0x575070c (0x30d8 bytes) 2024-09-21T15:10:45.041 INFO:teuthology.orchestra.run.smithi161.stdout:5573 trunc from 0xbd30cee to 0x621f7da 2024-09-21T15:10:45.080 INFO:teuthology.orchestra.run.smithi161.stdout:4843 punch from 0xb941bb to 0xb9db1f, (0x9964 bytes) 2024-09-21T15:10:45.080 INFO:teuthology.orchestra.run.smithi161.stdout:4845 read 0xd24d4 thru 0xd8b7e (0x66ab bytes) 2024-09-21T15:10:45.081 INFO:teuthology.orchestra.run.smithi161.stdout:4846 read 0x568ce09 thru 0x5695a54 (0x8c4c bytes) 2024-09-21T15:10:45.081 INFO:teuthology.orchestra.run.smithi161.stdout:4848 read 0x231c072 thru 0x23244ae (0x843d bytes) 2024-09-21T15:10:45.082 INFO:teuthology.orchestra.run.smithi161.stdout:4849 read 0x32b90e6 thru 0x32c2b01 (0x9a1c bytes) 2024-09-21T15:10:45.082 INFO:teuthology.orchestra.run.smithi161.stdout:4850 writesame 0x97cb894 thru 0x97d9dfb data_size 0xc(0xe568 bytes) 2024-09-21T15:10:45.099 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:45.102 INFO:teuthology.orchestra.run.smithi161.stdout:5575 trunc from 0x621f7da to 0x2df2ee6 2024-09-21T15:10:45.151 INFO:teuthology.orchestra.run.smithi161.stdout:4856 write 0xa8364e6 thru 0xa8367ad (0x2c8 bytes) 2024-09-21T15:10:45.164 INFO:teuthology.orchestra.run.smithi161.stdout:4858 read 0x91489ec thru 0x9154740 (0xbd55 bytes) 2024-09-21T15:10:45.165 INFO:teuthology.orchestra.run.smithi161.stdout:4859 write 0x1a531f thru 0x1af819 (0xa4fb bytes) 2024-09-21T15:10:45.180 INFO:teuthology.orchestra.run.smithi161.stdout:4862 trunc from 0xa8367ae to 0xbf43af3 2024-09-21T15:10:45.212 INFO:teuthology.orchestra.run.smithi161.stdout:4863 read 0x7a8d480 thru 0x7a8e337 (0xeb8 bytes) 2024-09-21T15:10:45.213 INFO:teuthology.orchestra.run.smithi161.stdout:5576 writesame 0x93ca216 thru 0x93cecc4 data_size 0x1(0x4aaf bytes) 2024-09-21T15:10:45.217 INFO:teuthology.orchestra.run.smithi161.stdout:5577 read 0x4ab6cf4 thru 0x4ac1f65 (0xb272 bytes) 2024-09-21T15:10:45.218 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:45.218 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:45.218 INFO:teuthology.orchestra.run.smithi161.stdout:5580 read 0x547ad72 thru 0x5480644 (0x58d3 bytes) 2024-09-21T15:10:45.218 INFO:teuthology.orchestra.run.smithi161.stdout:5581 read 0x341ad50 thru 0x342420d (0x94be bytes) 2024-09-21T15:10:45.233 INFO:teuthology.orchestra.run.smithi161.stdout:4865 trunc from 0xbf43af3 to 0x12b244f 2024-09-21T15:10:45.235 INFO:teuthology.orchestra.run.smithi161.stdout:5583 trunc from 0x93cecc5 to 0xbe99d8 2024-09-21T15:10:45.378 INFO:teuthology.orchestra.run.smithi161.stdout:4867 write 0xcd3cbba thru 0xcd42e7f (0x62c6 bytes) 2024-09-21T15:10:45.385 INFO:teuthology.orchestra.run.smithi161.stdout:5584 write 0xdeb9c33 thru 0xdebbc1b (0x1fe9 bytes) 2024-09-21T15:10:45.390 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:45.390 INFO:teuthology.orchestra.run.smithi161.stdout:4870 read 0x6c759a5 thru 0x6c82038 (0xc694 bytes) 2024-09-21T15:10:45.395 INFO:teuthology.orchestra.run.smithi161.stdout:4871 trunc from 0xcd42e80 to 0xaceea39 2024-09-21T15:10:45.435 INFO:teuthology.orchestra.run.smithi161.stdout:5585 write 0xec92094 thru 0xec98abc (0x6a29 bytes) 2024-09-21T15:10:45.441 INFO:teuthology.orchestra.run.smithi161.stdout:4873 write 0x4c7fff8 thru 0x4c8faaf (0xfab8 bytes) 2024-09-21T15:10:45.453 INFO:teuthology.orchestra.run.smithi161.stdout:5586 write 0x276f30a thru 0x2776f63 (0x7c5a bytes) 2024-09-21T15:10:45.457 INFO:teuthology.orchestra.run.smithi161.stdout:4874 writesame 0x5b4b517 thru 0x5b5474c data_size 0x5f(0x9236 bytes) 2024-09-21T15:10:45.467 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:45.467 INFO:teuthology.orchestra.run.smithi161.stdout:5588 write 0x37190c2 thru 0x3724fba (0xbef9 bytes) 2024-09-21T15:10:45.479 INFO:teuthology.orchestra.run.smithi161.stdout:4875 trunc from 0xaceea39 to 0x78e6d52 2024-09-21T15:10:45.484 INFO:teuthology.orchestra.run.smithi161.stdout:5589 writesame 0xcfd2369 thru 0xcfd7489 data_size 0x15(0x5121 bytes) 2024-09-21T15:10:45.497 INFO:teuthology.orchestra.run.smithi161.stdout:5590 writesame 0x70fa0df thru 0x7101ef8 data_size 0x1(0x7e1a bytes) 2024-09-21T15:10:45.527 INFO:teuthology.orchestra.run.smithi161.stdout:5591 writesame 0x668b769 thru 0x6698734 data_size 0x5d(0xcfcc bytes) 2024-09-21T15:10:45.550 INFO:teuthology.orchestra.run.smithi161.stdout:5592 writesame 0x6fa26ff thru 0x6fa287b data_size 0x1(0x17d bytes) 2024-09-21T15:10:45.558 INFO:teuthology.orchestra.run.smithi161.stdout:4876 write 0xab61f2a thru 0xab6c190 (0xa267 bytes) 2024-09-21T15:10:45.568 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:45.568 INFO:teuthology.orchestra.run.smithi161.stdout:5594 read 0x801a4ea thru 0x80216c9 (0x71e0 bytes) 2024-09-21T15:10:45.568 INFO:teuthology.orchestra.run.smithi161.stdout:5595 writesame 0x8e5ba49 thru 0x8e654bf data_size 0x31(0x9a77 bytes) 2024-09-21T15:10:45.581 INFO:teuthology.orchestra.run.smithi161.stdout:4877 read 0x165fdba thru 0x166ab72 (0xadb9 bytes) 2024-09-21T15:10:45.582 INFO:teuthology.orchestra.run.smithi161.stdout:4879 read 0x2a4a95a thru 0x2a4fc20 (0x52c7 bytes) 2024-09-21T15:10:45.583 INFO:teuthology.orchestra.run.smithi161.stdout:4880 write 0x7248200 thru 0x7257314 (0xf115 bytes) 2024-09-21T15:10:45.587 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:45.588 INFO:teuthology.orchestra.run.smithi161.stdout:5598 punch from 0x9073fcc to 0x907c68a, (0x86be bytes) 2024-09-21T15:10:45.588 INFO:teuthology.orchestra.run.smithi161.stdout:5599 read 0xc0d79fd thru 0xc0dbac3 (0x40c7 bytes) 2024-09-21T15:10:45.592 INFO:teuthology.orchestra.run.smithi161.stdout:5601 trunc from 0xec98abd to 0xd543f94 2024-09-21T15:10:45.599 INFO:teuthology.orchestra.run.smithi161.stdout:4882 read 0x796a026 thru 0x797063d (0x6618 bytes) 2024-09-21T15:10:45.599 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:45.599 INFO:teuthology.orchestra.run.smithi161.stdout:4885 writesame 0x9a153a1 thru 0x9a1fd85 data_size 0x1(0xa9e5 bytes) 2024-09-21T15:10:45.643 INFO:teuthology.orchestra.run.smithi161.stdout:4886 punch from 0x67c17ca to 0x67c5bcf, (0x4405 bytes) 2024-09-21T15:10:45.647 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:45.647 INFO:teuthology.orchestra.run.smithi161.stdout:5603 read 0x256f711 thru 0x257040e (0xcfe bytes) 2024-09-21T15:10:45.648 INFO:teuthology.orchestra.run.smithi161.stdout:5604 write 0x599cdf7 thru 0x59a26fa (0x5904 bytes) 2024-09-21T15:10:45.661 INFO:teuthology.orchestra.run.smithi161.stdout:4887 trunc from 0xab6c191 to 0x3d26abf 2024-09-21T15:10:45.668 INFO:teuthology.orchestra.run.smithi161.stdout:5606 write 0x8d4ef1d thru 0x8d53f06 (0x4fea bytes) 2024-09-21T15:10:45.689 INFO:teuthology.orchestra.run.smithi161.stdout:5607 write 0x25f2f42 thru 0x25fbcaf (0x8d6e bytes) 2024-09-21T15:10:45.713 INFO:teuthology.orchestra.run.smithi161.stdout:5608 read 0x223831c thru 0x2245bbc (0xd8a1 bytes) 2024-09-21T15:10:45.714 INFO:teuthology.orchestra.run.smithi161.stdout:5609 write 0x7b184ea thru 0x7b21c2e (0x9745 bytes) 2024-09-21T15:10:45.732 INFO:teuthology.orchestra.run.smithi161.stdout:5610 punch from 0x97b0524 to 0x97bfd3b, (0xf817 bytes) 2024-09-21T15:10:45.732 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:45.732 INFO:teuthology.orchestra.run.smithi161.stdout:5612 read 0x78b87a8 thru 0x78c518c (0xc9e5 bytes) 2024-09-21T15:10:45.733 INFO:teuthology.orchestra.run.smithi161.stdout:5613 read 0x11e9b8c thru 0x11f465a (0xaacf bytes) 2024-09-21T15:10:45.734 INFO:teuthology.orchestra.run.smithi161.stdout:5615 read 0xa1299e thru 0xa1b464 (0x8ac7 bytes) 2024-09-21T15:10:45.735 INFO:teuthology.orchestra.run.smithi161.stdout:5617 writesame 0x4ef9a7e thru 0x4efc724 data_size 0x17(0x2ca7 bytes) 2024-09-21T15:10:45.747 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:45.774 INFO:teuthology.orchestra.run.smithi161.stdout:4888 write 0xbc104c5 thru 0xbc1e75e (0xe29a bytes) 2024-09-21T15:10:45.792 INFO:teuthology.orchestra.run.smithi161.stdout:4889 read 0x3953d73 thru 0x395e943 (0xabd1 bytes) 2024-09-21T15:10:45.792 INFO:teuthology.orchestra.run.smithi161.stdout:4890 writesame 0x58e16ed thru 0x58e1c7c data_size 0x8(0x590 bytes) 2024-09-21T15:10:45.806 INFO:teuthology.orchestra.run.smithi161.stdout:5620 write 0xeb5f9da thru 0xeb621a5 (0x27cc bytes) 2024-09-21T15:10:45.814 INFO:teuthology.orchestra.run.smithi161.stdout:4891 read 0x5aa6c96 thru 0x5aa9275 (0x25e0 bytes) 2024-09-21T15:10:45.829 INFO:teuthology.orchestra.run.smithi161.stdout:5622 writesame 0x999261e thru 0x99a152a data_size 0x1(0xef0d bytes) 2024-09-21T15:10:45.835 INFO:teuthology.orchestra.run.smithi161.stdout:4892 trunc from 0xbc1e75f to 0x18b0fbf 2024-09-21T15:10:45.875 INFO:teuthology.orchestra.run.smithi161.stdout:5623 write 0x1ae00ba thru 0x1aef7e3 (0xf72a bytes) 2024-09-21T15:10:45.896 INFO:teuthology.orchestra.run.smithi161.stdout:5624 read 0x80dd9ac thru 0x80e8f04 (0xb559 bytes) 2024-09-21T15:10:45.897 INFO:teuthology.orchestra.run.smithi161.stdout:5625 punch from 0x39156aa to 0x391a614, (0x4f6a bytes) 2024-09-21T15:10:45.932 INFO:teuthology.orchestra.run.smithi161.stdout:5627 trunc from 0xeb621a6 to 0x5bbdfa 2024-09-21T15:10:45.960 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:45.958+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad140 finish: resending after timeout 2024-09-21T15:10:45.968 INFO:teuthology.orchestra.run.smithi161.stdout:4893 writesame 0x8455e22 thru 0x845a30e data_size 0x1(0x44ed bytes) 2024-09-21T15:10:45.983 INFO:teuthology.orchestra.run.smithi161.stdout:4894 trunc from 0x845a30f to 0xbd42c80 2024-09-21T15:10:46.029 INFO:teuthology.orchestra.run.smithi161.stdout:4895 read 0xaee1165 thru 0xaee6578 (0x5414 bytes) 2024-09-21T15:10:46.029 INFO:teuthology.orchestra.run.smithi161.stdout:4896 write 0x6e83877 thru 0x6e8fd8e (0xc518 bytes) 2024-09-21T15:10:46.047 INFO:teuthology.orchestra.run.smithi161.stdout:4897 trunc from 0xbd42c80 to 0xc51b663 2024-09-21T15:10:46.077 INFO:teuthology.orchestra.run.smithi161.stdout:4898 write 0xe51e73 thru 0xe57d0a (0x5e98 bytes) 2024-09-21T15:10:46.088 INFO:teuthology.orchestra.run.smithi161.stdout:5629 write 0xba99de7 thru 0xba9ebed (0x4e07 bytes) 2024-09-21T15:10:46.096 INFO:teuthology.orchestra.run.smithi161.stdout:4899 trunc from 0xc51b663 to 0xaaa6911 2024-09-21T15:10:46.104 INFO:teuthology.orchestra.run.smithi161.stdout:5630 write 0x25bab6a thru 0x25c568b (0xab22 bytes) 2024-09-21T15:10:46.121 INFO:teuthology.orchestra.run.smithi161.stdout:5632 punch from 0x27bc3f to 0x28206a, (0x642b bytes) 2024-09-21T15:10:46.128 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:46.128 INFO:teuthology.orchestra.run.smithi161.stdout:4901 read 0x707d5da thru 0x707ef6b (0x1992 bytes) 2024-09-21T15:10:46.128 INFO:teuthology.orchestra.run.smithi161.stdout:4902 punch from 0x589a5fa to 0x58a31e2, (0x8be8 bytes) 2024-09-21T15:10:46.128 INFO:teuthology.orchestra.run.smithi161.stdout:4903 writesame 0x9494a9f thru 0x94968cf data_size 0x1(0x1e31 bytes) 2024-09-21T15:10:46.137 INFO:teuthology.orchestra.run.smithi161.stdout:5633 trunc from 0xba9ebee to 0x531f7a4 2024-09-21T15:10:46.145 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:46.145 INFO:teuthology.orchestra.run.smithi161.stdout:4907 punch from 0x7cb13b7 to 0x7cbed48, (0xd991 bytes) 2024-09-21T15:10:46.145 INFO:teuthology.orchestra.run.smithi161.stdout:4908 clone 52 order 18 su 2048 sc 3 2024-09-21T15:10:46.183 INFO:teuthology.orchestra.run.smithi161.stdout:5634 punch from 0x4280537 to 0x4289928, (0x93f1 bytes) 2024-09-21T15:10:46.183 INFO:teuthology.orchestra.run.smithi161.stdout:5635 writesame 0x46945b7 thru 0x469c5fe data_size 0x14(0x8048 bytes) 2024-09-21T15:10:46.205 INFO:teuthology.orchestra.run.smithi161.stdout:5636 read 0x276908e thru 0x277517e (0xc0f1 bytes) 2024-09-21T15:10:46.206 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:46.257 INFO:teuthology.orchestra.run.smithi161.stdout:5638 write 0x81c8caa thru 0x81d48c1 (0xbc18 bytes) 2024-09-21T15:10:46.281 INFO:teuthology.orchestra.run.smithi161.stdout:5639 clone 47 order 22 su 524288 sc 11 2024-09-21T15:10:46.710 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone46 from 0x81d48c2 (overlap 0x5bbdfa) to 0x0 2024-09-21T15:10:46.853 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #45, image image_cluster1.client.mirror.4-clone45 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent46 2024-09-21T15:10:46.915 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #50, image image_cluster1.client.mirror.3-clone50 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent51 2024-09-21T15:10:47.030 INFO:teuthology.orchestra.run.smithi161.stdout:5641 punch from 0xfc616c to 0xfce306, (0x819a bytes) 2024-09-21T15:10:47.057 INFO:teuthology.orchestra.run.smithi161.stdout:5642 write 0x37f42b thru 0x387bca (0x87a0 bytes) 2024-09-21T15:10:47.087 INFO:teuthology.orchestra.run.smithi161.stdout:5643 trunc from 0x81d48c2 to 0x357d784 2024-09-21T15:10:47.090 INFO:teuthology.orchestra.run.smithi161.stdout:4910 read 0x355bda7 thru 0x3561a8e (0x5ce8 bytes) 2024-09-21T15:10:47.125 INFO:teuthology.orchestra.run.smithi161.stdout:4912 read 0x5f668f7 thru 0x5f6a819 (0x3f23 bytes) 2024-09-21T15:10:47.125 INFO:teuthology.orchestra.run.smithi161.stdout:4913 punch from 0x8535d30 to 0x8544e4b, (0xf11b bytes) 2024-09-21T15:10:47.125 INFO:teuthology.orchestra.run.smithi161.stdout:4914 writesame 0x67671a4 thru 0x676d2ca data_size 0x13(0x6127 bytes) 2024-09-21T15:10:47.155 INFO:teuthology.orchestra.run.smithi161.stdout:4916 write 0x6352eb9 thru 0x6356689 (0x37d1 bytes) 2024-09-21T15:10:47.170 INFO:teuthology.orchestra.run.smithi161.stdout:5645 read 0x12cd861 thru 0x12d21c3 (0x4963 bytes) 2024-09-21T15:10:47.171 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:47.171 INFO:teuthology.orchestra.run.smithi161.stdout:5650 punch from 0x2a31083 to 0x2a341d6, (0x3153 bytes) 2024-09-21T15:10:47.171 INFO:teuthology.orchestra.run.smithi161.stdout:5651 punch from 0x6db4ff to 0x6e47a3, (0x92a4 bytes) 2024-09-21T15:10:47.171 INFO:teuthology.orchestra.run.smithi161.stdout:5652 writesame 0x3145acd thru 0x3147339 data_size 0xd(0x186d bytes) 2024-09-21T15:10:47.179 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:47.179 INFO:teuthology.orchestra.run.smithi161.stdout:4920 punch from 0x723732b to 0x724448d, (0xd162 bytes) 2024-09-21T15:10:47.179 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:47.179 INFO:teuthology.orchestra.run.smithi161.stdout:4922 writesame 0x5198001 thru 0x519d520 data_size 0x30(0x5520 bytes) 2024-09-21T15:10:47.182 INFO:teuthology.orchestra.run.smithi161.stdout:5653 punch from 0x292eaab to 0x29372fc, (0x8851 bytes) 2024-09-21T15:10:47.182 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:47.182 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:47.186 INFO:teuthology.orchestra.run.smithi161.stdout:5656 trunc from 0x357d784 to 0x1af70c9 2024-09-21T15:10:47.201 INFO:teuthology.orchestra.run.smithi161.stdout:4923 write 0x4a0dfcf thru 0x4a1289a (0x48cc bytes) 2024-09-21T15:10:47.220 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.218+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e4fdd40 finish: resending after timeout 2024-09-21T15:10:47.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.218+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f8d80 finish: resending after timeout 2024-09-21T15:10:47.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.222+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a7980 finish: resending after timeout 2024-09-21T15:10:47.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.222+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e6183c0 finish: resending after timeout 2024-09-21T15:10:47.222 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.222+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a5520300 finish: resending after timeout 2024-09-21T15:10:47.224 INFO:teuthology.orchestra.run.smithi161.stdout:4924 writesame 0x39f2290 thru 0x39f642d data_size 0x25(0x419e bytes) 2024-09-21T15:10:47.230 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.230+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560b40 finish: resending after timeout 2024-09-21T15:10:47.231 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.230+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc6c0 finish: resending after timeout 2024-09-21T15:10:47.231 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.230+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0d80 finish: resending after timeout 2024-09-21T15:10:47.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.230+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a69c0 finish: resending after timeout 2024-09-21T15:10:47.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.230+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:10:47.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a6480 finish: resending after timeout 2024-09-21T15:10:47.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a55206c0 finish: resending after timeout 2024-09-21T15:10:47.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ab14b680 finish: resending after timeout 2024-09-21T15:10:47.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bd800 finish: resending after timeout 2024-09-21T15:10:47.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc300 finish: resending after timeout 2024-09-21T15:10:47.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43a40 finish: resending after timeout 2024-09-21T15:10:47.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c420c0 finish: resending after timeout 2024-09-21T15:10:47.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:47.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43140 finish: resending after timeout 2024-09-21T15:10:47.263 INFO:teuthology.orchestra.run.smithi161.stdout:4926 trunc from 0xaaa6911 to 0xd966c76 2024-09-21T15:10:47.295 INFO:teuthology.orchestra.run.smithi161.stdout:4928 write 0x3f134a1 thru 0x3f15468 (0x1fc8 bytes) 2024-09-21T15:10:47.321 INFO:teuthology.orchestra.run.smithi161.stdout:4929 write 0xaede7fe thru 0xaee60b3 (0x78b6 bytes) 2024-09-21T15:10:47.328 INFO:teuthology.orchestra.run.smithi161.stdout:5658 write 0x6558ffd thru 0x655e393 (0x5397 bytes) 2024-09-21T15:10:47.339 INFO:teuthology.orchestra.run.smithi161.stdout:4930 write 0x5cab4d2 thru 0x5cae720 (0x324f bytes) 2024-09-21T15:10:47.344 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:47.344 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:47.362 INFO:teuthology.orchestra.run.smithi161.stdout:5662 trunc from 0x655e394 to 0xe0e6f9f 2024-09-21T15:10:47.397 INFO:teuthology.orchestra.run.smithi161.stdout:5665 read 0x814231b thru 0x814e382 (0xc068 bytes) 2024-09-21T15:10:47.397 INFO:teuthology.orchestra.run.smithi161.stdout:5666 read 0x5c38d7e thru 0x5c3f861 (0x6ae4 bytes) 2024-09-21T15:10:47.397 INFO:teuthology.orchestra.run.smithi161.stdout:5667 write 0x10d0cc1 thru 0x10d9ea5 (0x91e5 bytes) 2024-09-21T15:10:47.401 INFO:teuthology.orchestra.run.smithi161.stdout:4931 write 0xe9a463b thru 0xe9ae755 (0xa11b bytes) 2024-09-21T15:10:47.414 INFO:teuthology.orchestra.run.smithi161.stdout:5668 writesame 0x65180b1 thru 0x65209f6 data_size 0x3(0x8946 bytes) 2024-09-21T15:10:47.430 INFO:teuthology.orchestra.run.smithi161.stdout:5669 read 0x21dabb1 thru 0x21e0aa3 (0x5ef3 bytes) 2024-09-21T15:10:47.432 INFO:teuthology.orchestra.run.smithi161.stdout:4932 read 0xc8dcced thru 0xc8ea9d1 (0xdce5 bytes) 2024-09-21T15:10:47.441 INFO:teuthology.orchestra.run.smithi161.stdout:4933 trunc from 0xe9ae756 to 0xce67165 2024-09-21T15:10:47.456 INFO:teuthology.orchestra.run.smithi161.stdout:5670 trunc from 0xe0e6f9f to 0x4099701 2024-09-21T15:10:47.507 INFO:teuthology.orchestra.run.smithi161.stdout:4934 trunc from 0xce67165 to 0x9c0a35e 2024-09-21T15:10:47.513 INFO:teuthology.orchestra.run.smithi161.stdout:5671 punch from 0x19d7bb1 to 0x19d8aa4, (0xef3 bytes) 2024-09-21T15:10:47.513 INFO:teuthology.orchestra.run.smithi161.stdout:5673 read 0x338d6dd thru 0x339bbaf (0xe4d3 bytes) 2024-09-21T15:10:47.513 INFO:teuthology.orchestra.run.smithi161.stdout:5674 read 0x19d1317 thru 0x19d8378 (0x7062 bytes) 2024-09-21T15:10:47.514 INFO:teuthology.orchestra.run.smithi161.stdout:5675 read 0x286b7a9 thru 0x287320a (0x7a62 bytes) 2024-09-21T15:10:47.554 INFO:teuthology.orchestra.run.smithi161.stdout:5676 writesame 0x69e99d4 thru 0x69f6948 data_size 0x1b(0xcf75 bytes) 2024-09-21T15:10:47.560 INFO:teuthology.orchestra.run.smithi161.stdout:5677 read 0x193c22b thru 0x1943d00 (0x7ad6 bytes) 2024-09-21T15:10:47.561 INFO:teuthology.orchestra.run.smithi161.stdout:5678 read 0x667ddf4 thru 0x6688da7 (0xafb4 bytes) 2024-09-21T15:10:47.569 INFO:teuthology.orchestra.run.smithi161.stdout:4935 write 0x7bfd346 thru 0x7c093eb (0xc0a6 bytes) 2024-09-21T15:10:47.616 INFO:teuthology.orchestra.run.smithi161.stdout:5679 writesame 0xa12d03e thru 0xa13ce02 data_size 0x47(0xfdc5 bytes) 2024-09-21T15:10:47.628 INFO:teuthology.orchestra.run.smithi161.stdout:5681 trunc from 0xa13ce03 to 0xd320e93 2024-09-21T15:10:47.635 INFO:teuthology.orchestra.run.smithi161.stdout:4936 write 0xbb9b442 thru 0xbba0fbd (0x5b7c bytes) 2024-09-21T15:10:47.664 INFO:teuthology.orchestra.run.smithi161.stdout:4937 trunc from 0xbba0fbe to 0xa8d4914 2024-09-21T15:10:47.672 INFO:teuthology.orchestra.run.smithi161.stdout:5683 write 0x6ea46e1 thru 0x6eb114d (0xca6d bytes) 2024-09-21T15:10:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:5684 trunc from 0xd320e93 to 0xa66583e 2024-09-21T15:10:47.713 INFO:teuthology.orchestra.run.smithi161.stdout:4938 punch from 0x7d1db05 to 0x7d23800, (0x5cfb bytes) 2024-09-21T15:10:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:4939 punch from 0x2f1458c to 0x2f1f2ad, (0xad21 bytes) 2024-09-21T15:10:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:4940 read 0x4c08188 thru 0x4c13e2d (0xbca6 bytes) 2024-09-21T15:10:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:4941 writesame 0x7e91bae thru 0x7e984ce data_size 0x1(0x6921 bytes) 2024-09-21T15:10:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:5685 trunc from 0xa66583e to 0xbd8fabd 2024-09-21T15:10:47.757 INFO:teuthology.orchestra.run.smithi161.stdout:4942 trunc from 0xa8d4914 to 0x77ed613 2024-09-21T15:10:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:5686 punch from 0xb8e4048 to 0xb8edf75, (0x9f2d bytes) 2024-09-21T15:10:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:5688 write 0x35509a6 thru 0x3550bd2 (0x22d bytes) 2024-09-21T15:10:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:5689 punch from 0xbddb97 to 0xbe9f47, (0xc3b0 bytes) 2024-09-21T15:10:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:47.794 INFO:teuthology.orchestra.run.smithi161.stdout:5693 read 0xa7f2a91 thru 0xa7fe0a7 (0xb617 bytes) 2024-09-21T15:10:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:5695 trunc from 0xbd8fabd to 0x64298bc 2024-09-21T15:10:47.909 INFO:teuthology.orchestra.run.smithi161.stdout:4943 write 0x24c5138 thru 0x24cc3f3 (0x72bc bytes) 2024-09-21T15:10:47.909 INFO:teuthology.orchestra.run.smithi161.stdout:5696 write 0x33e0b1d thru 0x33e9592 (0x8a76 bytes) 2024-09-21T15:10:47.945 INFO:teuthology.orchestra.run.smithi161.stdout:4947 punch from 0x391d245 to 0x39250ec, (0x7ea7 bytes) 2024-09-21T15:10:47.949 INFO:teuthology.orchestra.run.smithi161.stdout:5698 trunc from 0x64298bc to 0xe633154 2024-09-21T15:10:47.959 INFO:teuthology.orchestra.run.smithi161.stdout:4948 trunc from 0x77ed613 to 0xedd21c5 2024-09-21T15:10:47.988 INFO:teuthology.orchestra.run.smithi161.stdout:5699 write 0xd3f7179 thru 0xd3fcc89 (0x5b11 bytes) 2024-09-21T15:10:47.996 INFO:teuthology.orchestra.run.smithi161.stdout:4949 write 0x8d63e0e thru 0x8d6c272 (0x8465 bytes) 2024-09-21T15:10:48.010 INFO:teuthology.orchestra.run.smithi161.stdout:5700 write 0x53c6428 thru 0x53c6617 (0x1f0 bytes) 2024-09-21T15:10:48.019 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:48.023 INFO:teuthology.orchestra.run.smithi161.stdout:4951 trunc from 0xedd21c5 to 0xd67377b 2024-09-21T15:10:48.023 INFO:teuthology.orchestra.run.smithi161.stdout:5702 write 0xc1e33b4 thru 0xc1ec4f2 (0x913f bytes) 2024-09-21T15:10:48.037 INFO:teuthology.orchestra.run.smithi161.stdout:5703 clone 48 order 20 su 524288 sc 14 2024-09-21T15:10:48.068 INFO:teuthology.orchestra.run.smithi161.stdout:4953 trunc from 0xd67377b to 0xb4609cc 2024-09-21T15:10:48.102 INFO:teuthology.orchestra.run.smithi161.stdout:4954 flatten 2024-09-21T15:10:48.292 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:48.290+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560540 finish: resending after timeout 2024-09-21T15:10:48.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:48.878+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a45963c0 handle_clone_image: failed to clone image mirror/10b4ec8d522b to image_cluster1.client.mirror.3-clone52 2024-09-21T15:10:49.017 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone47 from 0xe633154 (overlap 0x1af70c9) to 0x1844be8 2024-09-21T15:10:49.155 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:49.149+0000 7f7fd044c700 -1 reset not still connected to 0x56369f5dc000 2024-09-21T15:10:49.158 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:49.153+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:10:49.158 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:49.153+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7149040 2024-09-21T15:10:49.167 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:49.161+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:10:49.171 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:49.161+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbaea0 2024-09-21T15:10:49.277 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #46, image image_cluster1.client.mirror.4-clone46 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent47 2024-09-21T15:10:49.317 INFO:teuthology.orchestra.run.smithi161.stdout:5704 write 0x9d43c2 thru 0x9d5e03 (0x1a42 bytes) 2024-09-21T15:10:49.363 INFO:teuthology.orchestra.run.smithi161.stdout:5706 punch from 0xb832e4c to 0xb833871, (0xa25 bytes) 2024-09-21T15:10:49.396 INFO:teuthology.orchestra.run.smithi161.stdout:5707 write 0xeb3dd7d thru 0xeb49280 (0xb504 bytes) 2024-09-21T15:10:49.411 INFO:teuthology.orchestra.run.smithi161.stdout:5708 write 0xa46f4b6 thru 0xa477679 (0x81c4 bytes) 2024-09-21T15:10:49.424 INFO:teuthology.orchestra.run.smithi161.stdout:5709 writesame 0xc5554c5 thru 0xc5626d7 data_size 0x1(0xd213 bytes) 2024-09-21T15:10:49.471 INFO:teuthology.orchestra.run.smithi161.stdout:4955 punch from 0x5d53824 to 0x5d559b8, (0x2194 bytes) 2024-09-21T15:10:49.477 INFO:teuthology.orchestra.run.smithi161.stdout:5710 writesame 0xb17bcf2 thru 0xb17c698 data_size 0x1(0x9a7 bytes) 2024-09-21T15:10:49.479 INFO:teuthology.orchestra.run.smithi161.stdout:4956 trunc from 0xb4609cc to 0x8b28a8b 2024-09-21T15:10:49.493 INFO:teuthology.orchestra.run.smithi161.stdout:5711 write 0x8fb04f9 thru 0x8fbbe42 (0xb94a bytes) 2024-09-21T15:10:49.509 INFO:teuthology.orchestra.run.smithi161.stdout:5712 read 0x8beeb5d thru 0x8bfbfea (0xd48e bytes) 2024-09-21T15:10:49.510 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:49.510 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:49.510 INFO:teuthology.orchestra.run.smithi161.stdout:5716 writesame 0x128d081 thru 0x129a907 data_size 0x9(0xd887 bytes) 2024-09-21T15:10:49.520 INFO:teuthology.orchestra.run.smithi161.stdout:4957 write 0x419e7f thru 0x41f85a (0x59dc bytes) 2024-09-21T15:10:49.527 INFO:teuthology.orchestra.run.smithi161.stdout:5718 read 0x6a9532 thru 0x6b8f10 (0xf9df bytes) 2024-09-21T15:10:49.528 INFO:teuthology.orchestra.run.smithi161.stdout:5719 read 0x1e9ff98 thru 0x1eabd99 (0xbe02 bytes) 2024-09-21T15:10:49.530 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:49.530 INFO:teuthology.orchestra.run.smithi161.stdout:5726 write 0xda733d9 thru 0xda78ea1 (0x5ac9 bytes) 2024-09-21T15:10:49.537 INFO:teuthology.orchestra.run.smithi161.stdout:4958 read 0x380e6fc thru 0x3813e2d (0x5732 bytes) 2024-09-21T15:10:49.537 INFO:teuthology.orchestra.run.smithi161.stdout:4960 write 0x86aa806 thru 0x86ab97e (0x1179 bytes) 2024-09-21T15:10:49.545 INFO:teuthology.orchestra.run.smithi161.stdout:5728 punch from 0x6875e42 to 0x6876004, (0x1c2 bytes) 2024-09-21T15:10:49.545 INFO:teuthology.orchestra.run.smithi161.stdout:5730 read 0x76c7941 thru 0x76cf0c9 (0x7789 bytes) 2024-09-21T15:10:49.545 INFO:teuthology.orchestra.run.smithi161.stdout:5731 read 0x7a21387 thru 0x7a23050 (0x1cca bytes) 2024-09-21T15:10:49.545 INFO:teuthology.orchestra.run.smithi161.stdout:5732 read 0x2f6294e thru 0x2f66b2a (0x41dd bytes) 2024-09-21T15:10:49.554 INFO:teuthology.orchestra.run.smithi161.stdout:5733 trunc from 0xeb49281 to 0xbdb7e54 2024-09-21T15:10:49.555 INFO:teuthology.orchestra.run.smithi161.stdout:4961 write 0x14046d0 thru 0x1404ab9 (0x3ea bytes) 2024-09-21T15:10:49.569 INFO:teuthology.orchestra.run.smithi161.stdout:4962 read 0x748a656 thru 0x7495a39 (0xb3e4 bytes) 2024-09-21T15:10:49.569 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:49.570 INFO:teuthology.orchestra.run.smithi161.stdout:4964 write 0x8351317 thru 0x8355316 (0x4000 bytes) 2024-09-21T15:10:49.637 INFO:teuthology.orchestra.run.smithi161.stdout:4965 write 0x9fe4f86 thru 0x9ff2ead (0xdf28 bytes) 2024-09-21T15:10:49.643 INFO:teuthology.orchestra.run.smithi161.stdout:5734 punch from 0x33183b2 to 0x3326f61, (0xebaf bytes) 2024-09-21T15:10:49.644 INFO:teuthology.orchestra.run.smithi161.stdout:5736 write 0x55d2fe8 thru 0x55d69ba (0x39d3 bytes) 2024-09-21T15:10:49.656 INFO:teuthology.orchestra.run.smithi161.stdout:5738 punch from 0xbbaabb1 to 0xbbb494e, (0x9d9d bytes) 2024-09-21T15:10:49.656 INFO:teuthology.orchestra.run.smithi161.stdout:5739 trunc from 0xbdb7e54 to 0xbc9348f 2024-09-21T15:10:49.659 INFO:teuthology.orchestra.run.smithi161.stdout:4966 read 0x43fccc5 thru 0x4405b65 (0x8ea1 bytes) 2024-09-21T15:10:49.660 INFO:teuthology.orchestra.run.smithi161.stdout:4969 read 0x7d543b0 thru 0x7d64061 (0xfcb2 bytes) 2024-09-21T15:10:49.660 INFO:teuthology.orchestra.run.smithi161.stdout:4971 read 0x3900de3 thru 0x3907877 (0x6a95 bytes) 2024-09-21T15:10:49.660 INFO:teuthology.orchestra.run.smithi161.stdout:4972 read 0x8c2a0a3 thru 0x8c2b62d (0x158b bytes) 2024-09-21T15:10:49.678 INFO:teuthology.orchestra.run.smithi161.stdout:4973 trunc from 0x9ff2eae to 0x322970e 2024-09-21T15:10:49.722 INFO:teuthology.orchestra.run.smithi161.stdout:5740 punch from 0x3a15486 to 0x3a21448, (0xbfc2 bytes) 2024-09-21T15:10:49.722 INFO:teuthology.orchestra.run.smithi161.stdout:5741 read 0x9779638 thru 0x977f864 (0x622d bytes) 2024-09-21T15:10:49.723 INFO:teuthology.orchestra.run.smithi161.stdout:5742 write 0x4d09d6 thru 0x4d16c6 (0xcf1 bytes) 2024-09-21T15:10:49.743 INFO:teuthology.orchestra.run.smithi161.stdout:5743 write 0x77c2915 thru 0x77c7ca1 (0x538d bytes) 2024-09-21T15:10:49.758 INFO:teuthology.orchestra.run.smithi161.stdout:5744 write 0x4692988 thru 0x469927c (0x68f5 bytes) 2024-09-21T15:10:49.770 INFO:teuthology.orchestra.run.smithi161.stdout:5745 write 0xa623cb1 thru 0xa62f051 (0xb3a1 bytes) 2024-09-21T15:10:49.787 INFO:teuthology.orchestra.run.smithi161.stdout:5746 read 0x923f5d3 thru 0x9247058 (0x7a86 bytes) 2024-09-21T15:10:49.787 INFO:teuthology.orchestra.run.smithi161.stdout:5747 read 0x544edf8 thru 0x545b7b3 (0xc9bc bytes) 2024-09-21T15:10:49.788 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:49.788 INFO:teuthology.orchestra.run.smithi161.stdout:5749 read 0x9eff750 thru 0x9f0c1e5 (0xca96 bytes) 2024-09-21T15:10:49.789 INFO:teuthology.orchestra.run.smithi161.stdout:5752 write 0xb76514c thru 0xb767576 (0x242b bytes) 2024-09-21T15:10:49.802 INFO:teuthology.orchestra.run.smithi161.stdout:5753 read 0xabb6208 thru 0xabb638f (0x188 bytes) 2024-09-21T15:10:49.802 INFO:teuthology.orchestra.run.smithi161.stdout:5754 read 0x4c8248a thru 0x4c8d09f (0xac16 bytes) 2024-09-21T15:10:49.802 INFO:teuthology.orchestra.run.smithi161.stdout:5755 write 0x6feea54 thru 0x6fef90d (0xeba bytes) 2024-09-21T15:10:49.816 INFO:teuthology.orchestra.run.smithi161.stdout:4974 writesame 0x9394fda thru 0x939aa5a data_size 0x1(0x5a81 bytes) 2024-09-21T15:10:49.825 INFO:teuthology.orchestra.run.smithi161.stdout:4976 trunc from 0x939aa5b to 0x75851dd 2024-09-21T15:10:49.854 INFO:teuthology.orchestra.run.smithi161.stdout:5756 writesame 0xbeb7fd8 thru 0xbebf431 data_size 0x2(0x745a bytes) 2024-09-21T15:10:49.868 INFO:teuthology.orchestra.run.smithi161.stdout:4977 punch from 0x6e737a9 to 0x6e7c935, (0x918c bytes) 2024-09-21T15:10:49.868 INFO:teuthology.orchestra.run.smithi161.stdout:4978 read 0x3de9375 thru 0x3df6c16 (0xd8a2 bytes) 2024-09-21T15:10:49.871 INFO:teuthology.orchestra.run.smithi161.stdout:5758 trunc from 0xbebf432 to 0x9f682f1 2024-09-21T15:10:49.921 INFO:teuthology.orchestra.run.smithi161.stdout:4979 writesame 0xaf447ab thru 0xaf456f2 data_size 0xc(0xf48 bytes) 2024-09-21T15:10:49.939 INFO:teuthology.orchestra.run.smithi161.stdout:4980 trunc from 0xaf456f3 to 0x4146c7a 2024-09-21T15:10:49.972 INFO:teuthology.orchestra.run.smithi161.stdout:5759 write 0x4d17124 thru 0x4d1e349 (0x7226 bytes) 2024-09-21T15:10:49.976 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:49.976 INFO:teuthology.orchestra.run.smithi161.stdout:4982 trunc from 0x4146c7a to 0x40cf1ba 2024-09-21T15:10:49.991 INFO:teuthology.orchestra.run.smithi161.stdout:5760 writesame 0x6b47997 thru 0x6b47cdc data_size 0x1(0x346 bytes) 2024-09-21T15:10:50.002 INFO:teuthology.orchestra.run.smithi161.stdout:4983 read 0x3ab4a68 thru 0x3abed5d (0xa2f6 bytes) 2024-09-21T15:10:50.002 INFO:teuthology.orchestra.run.smithi161.stdout:4985 write 0x210075d thru 0x2104c02 (0x44a6 bytes) 2024-09-21T15:10:50.005 INFO:teuthology.orchestra.run.smithi161.stdout:5761 punch from 0x194b76d to 0x1958005, (0xc898 bytes) 2024-09-21T15:10:50.005 INFO:teuthology.orchestra.run.smithi161.stdout:5762 read 0x645d382 thru 0x646b371 (0xdff0 bytes) 2024-09-21T15:10:50.006 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:50.006 INFO:teuthology.orchestra.run.smithi161.stdout:5767 read 0x1f7c36f thru 0x1f83bc1 (0x7853 bytes) 2024-09-21T15:10:50.007 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:50.007 INFO:teuthology.orchestra.run.smithi161.stdout:5769 punch from 0x8d7d8e5 to 0x8d8b38a, (0xdaa5 bytes) 2024-09-21T15:10:50.007 INFO:teuthology.orchestra.run.smithi161.stdout:5770 punch from 0x90a6e3f to 0x90b02b4, (0x9475 bytes) 2024-09-21T15:10:50.007 INFO:teuthology.orchestra.run.smithi161.stdout:5771 read 0x2dced92 thru 0x2dd0105 (0x1374 bytes) 2024-09-21T15:10:50.007 INFO:teuthology.orchestra.run.smithi161.stdout:5772 read 0xdfd1b6 thru 0xe0168d (0x44d8 bytes) 2024-09-21T15:10:50.008 INFO:teuthology.orchestra.run.smithi161.stdout:5774 punch from 0x12770a8 to 0x1286c42, (0xfb9a bytes) 2024-09-21T15:10:50.008 INFO:teuthology.orchestra.run.smithi161.stdout:5775 write 0x7da2693 thru 0x7da53d9 (0x2d47 bytes) 2024-09-21T15:10:50.021 INFO:teuthology.orchestra.run.smithi161.stdout:5776 writesame 0x8ffd3e thru 0x90b217 data_size 0x7(0xb4da bytes) 2024-09-21T15:10:50.069 INFO:teuthology.orchestra.run.smithi161.stdout:4986 writesame 0xd5d40e4 thru 0xd5d5564 data_size 0x1(0x1481 bytes) 2024-09-21T15:10:50.077 INFO:teuthology.orchestra.run.smithi161.stdout:5777 write 0xd928c00 thru 0xd92f070 (0x6471 bytes) 2024-09-21T15:10:50.083 INFO:teuthology.orchestra.run.smithi161.stdout:4988 trunc from 0xd5d5565 to 0x79327c3 2024-09-21T15:10:50.096 INFO:teuthology.orchestra.run.smithi161.stdout:5778 write 0xbc4c8ad thru 0xbc54769 (0x7ebd bytes) 2024-09-21T15:10:50.110 INFO:teuthology.orchestra.run.smithi161.stdout:5782 punch from 0x550728d to 0x550e2a3, (0x7016 bytes) 2024-09-21T15:10:50.111 INFO:teuthology.orchestra.run.smithi161.stdout:5783 write 0xafaefc1 thru 0xafb6a2c (0x7a6c bytes) 2024-09-21T15:10:50.122 INFO:teuthology.orchestra.run.smithi161.stdout:4989 read 0x426d4b4 thru 0x4273ac7 (0x6614 bytes) 2024-09-21T15:10:50.124 INFO:teuthology.orchestra.run.smithi161.stdout:5784 write 0x141455d thru 0x141fb2a (0xb5ce bytes) 2024-09-21T15:10:50.144 INFO:teuthology.orchestra.run.smithi161.stdout:5786 punch from 0x5b0c97 to 0x5b6e80, (0x61e9 bytes) 2024-09-21T15:10:50.145 INFO:teuthology.orchestra.run.smithi161.stdout:5787 writesame 0x678a151 thru 0x678a75a data_size 0x1(0x60a bytes) 2024-09-21T15:10:50.160 INFO:teuthology.orchestra.run.smithi161.stdout:5789 punch from 0xd446097 to 0xd44bd5b, (0x5cc4 bytes) 2024-09-21T15:10:50.168 INFO:teuthology.orchestra.run.smithi161.stdout:5791 trunc from 0xd92f071 to 0xaa8bdae 2024-09-21T15:10:50.176 INFO:teuthology.orchestra.run.smithi161.stdout:4991 write 0xebf0c22 thru 0xebff72c (0xeb0b bytes) 2024-09-21T15:10:50.203 INFO:teuthology.orchestra.run.smithi161.stdout:4992 write 0xbf98f32 thru 0xbf99acf (0xb9e bytes) 2024-09-21T15:10:50.221 INFO:teuthology.orchestra.run.smithi161.stdout:4993 punch from 0x18c349c to 0x18c571a, (0x227e bytes) 2024-09-21T15:10:50.228 INFO:teuthology.orchestra.run.smithi161.stdout:5792 punch from 0x12a12bb to 0x12a687f, (0x55c4 bytes) 2024-09-21T15:10:50.228 INFO:teuthology.orchestra.run.smithi161.stdout:5794 punch from 0x359802e to 0x35a5024, (0xcff6 bytes) 2024-09-21T15:10:50.240 INFO:teuthology.orchestra.run.smithi161.stdout:5795 trunc from 0xaa8bdae to 0xd23f062 2024-09-21T15:10:50.254 INFO:teuthology.orchestra.run.smithi161.stdout:4996 trunc from 0xebff72d to 0x56d513 2024-09-21T15:10:50.276 INFO:teuthology.orchestra.run.smithi161.stdout:5796 trunc from 0xd23f062 to 0xd236b3f 2024-09-21T15:10:50.312 INFO:teuthology.orchestra.run.smithi161.stdout:5798 read 0xcc436f thru 0xcc7beb (0x387d bytes) 2024-09-21T15:10:50.312 INFO:teuthology.orchestra.run.smithi161.stdout:5799 read 0xb6c9088 thru 0xb6d731f (0xe298 bytes) 2024-09-21T15:10:50.313 INFO:teuthology.orchestra.run.smithi161.stdout:5800 read 0x1ae116f thru 0x1aed866 (0xc6f8 bytes) 2024-09-21T15:10:50.328 INFO:teuthology.orchestra.run.smithi161.stdout:4997 read 0x2eda42 thru 0x2f40bb (0x667a bytes) 2024-09-21T15:10:50.343 INFO:teuthology.orchestra.run.smithi161.stdout:5802 write 0xe43f287 thru 0xe447d7d (0x8af7 bytes) 2024-09-21T15:10:50.359 INFO:teuthology.orchestra.run.smithi161.stdout:5804 write 0x70f565 thru 0x715cd7 (0x6773 bytes) 2024-09-21T15:10:50.372 INFO:teuthology.orchestra.run.smithi161.stdout:4999 writesame 0x2e34c19 thru 0x2e372b8 data_size 0x10(0x26a0 bytes) 2024-09-21T15:10:50.379 INFO:teuthology.orchestra.run.smithi161.stdout:5805 write 0xb8c0940 thru 0xb8ce707 (0xddc8 bytes) 2024-09-21T15:10:50.396 INFO:teuthology.orchestra.run.smithi161.stdout:5806 write 0x1ca5555 thru 0x1cae01c (0x8ac8 bytes) 2024-09-21T15:10:50.401 INFO:teuthology.orchestra.run.smithi161.stdout:5001 trunc from 0x2e372b9 to 0xebd51b2 2024-09-21T15:10:50.437 INFO:teuthology.orchestra.run.smithi161.stdout:5002 punch from 0x99cfc21 to 0x99de371, (0xe750 bytes) 2024-09-21T15:10:50.442 INFO:teuthology.orchestra.run.smithi161.stdout:5808 trunc from 0xe447d7e to 0xb7225a 2024-09-21T15:10:50.443 INFO:teuthology.orchestra.run.smithi161.stdout:5003 trunc from 0xebd51b2 to 0xcc16975 2024-09-21T15:10:50.488 INFO:teuthology.orchestra.run.smithi161.stdout:5004 read 0x877f8e thru 0x879648 (0x16bb bytes) 2024-09-21T15:10:50.503 INFO:teuthology.orchestra.run.smithi161.stdout:5006 trunc from 0xcc16975 to 0x5d92688 2024-09-21T15:10:50.537 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:50.537 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:50.539 INFO:teuthology.orchestra.run.smithi161.stdout:5809 read 0x89f0ac thru 0x8a30d2 (0x4027 bytes) 2024-09-21T15:10:50.566 INFO:teuthology.orchestra.run.smithi161.stdout:5011 writesame 0x6322d95 thru 0x632945b data_size 0x1(0x66c7 bytes) 2024-09-21T15:10:50.570 INFO:teuthology.orchestra.run.smithi161.stdout:5012 punch from 0x15f87cc to 0x16006ea, (0x7f1e bytes) 2024-09-21T15:10:50.575 INFO:teuthology.orchestra.run.smithi161.stdout:5810 write 0x101d8b7 thru 0x101d90a (0x54 bytes) 2024-09-21T15:10:50.589 INFO:teuthology.orchestra.run.smithi161.stdout:5811 punch from 0x1a9437 to 0x1b16dc, (0x82a5 bytes) 2024-09-21T15:10:50.589 INFO:teuthology.orchestra.run.smithi161.stdout:5812 read 0x8382e4 thru 0x83aa95 (0x27b2 bytes) 2024-09-21T15:10:50.590 INFO:teuthology.orchestra.run.smithi161.stdout:5813 read 0x34eff5 thru 0x35b755 (0xc761 bytes) 2024-09-21T15:10:50.591 INFO:teuthology.orchestra.run.smithi161.stdout:5814 read 0x6f590a thru 0x703a67 (0xe15e bytes) 2024-09-21T15:10:50.592 INFO:teuthology.orchestra.run.smithi161.stdout:5815 punch from 0xb741fa to 0xb74e11, (0xc17 bytes) 2024-09-21T15:10:50.593 INFO:teuthology.orchestra.run.smithi161.stdout:5817 read 0x17db9 thru 0x1c78f (0x49d7 bytes) 2024-09-21T15:10:50.594 INFO:teuthology.orchestra.run.smithi161.stdout:5818 read 0x6e16ea thru 0x6e5b89 (0x44a0 bytes) 2024-09-21T15:10:50.595 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:50.599 INFO:teuthology.orchestra.run.smithi161.stdout:5821 trunc from 0x101d90b to 0x257c757 2024-09-21T15:10:50.609 INFO:teuthology.orchestra.run.smithi161.stdout:5014 write 0x6a76e5e thru 0x6a7a2bc (0x345f bytes) 2024-09-21T15:10:50.645 INFO:teuthology.orchestra.run.smithi161.stdout:5822 read 0x145aa67 thru 0x1469708 (0xeca2 bytes) 2024-09-21T15:10:50.676 INFO:teuthology.orchestra.run.smithi161.stdout:5015 writesame 0x9b8c7df thru 0x9b99e76 data_size 0x15(0xd698 bytes) 2024-09-21T15:10:50.680 INFO:teuthology.orchestra.run.smithi161.stdout:5823 writesame 0x36b39d4 thru 0x36bb26c data_size 0x29(0x7899 bytes) 2024-09-21T15:10:50.680 INFO:teuthology.orchestra.run.smithi161.stdout:5016 read 0x95786d1 thru 0x95824b7 (0x9de7 bytes) 2024-09-21T15:10:50.680 INFO:teuthology.orchestra.run.smithi161.stdout:5017 read 0x69e0608 thru 0x69ec873 (0xc26c bytes) 2024-09-21T15:10:50.682 INFO:teuthology.orchestra.run.smithi161.stdout:5023 write 0x29a685b thru 0x29a78a6 (0x104c bytes) 2024-09-21T15:10:50.703 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:50.703 INFO:teuthology.orchestra.run.smithi161.stdout:5027 punch from 0x80602a6 to 0x80623ed, (0x2147 bytes) 2024-09-21T15:10:50.703 INFO:teuthology.orchestra.run.smithi161.stdout:5029 read 0x7976cef thru 0x7984094 (0xd3a6 bytes) 2024-09-21T15:10:50.709 INFO:teuthology.orchestra.run.smithi161.stdout:5030 trunc from 0x9b99e77 to 0x790359e 2024-09-21T15:10:50.742 INFO:teuthology.orchestra.run.smithi161.stdout:5824 writesame 0x8a9c9c1 thru 0x8aa1ded data_size 0xb(0x542d bytes) 2024-09-21T15:10:50.748 INFO:teuthology.orchestra.run.smithi161.stdout:5825 write 0xb58aeb thru 0xb5b7e5 (0x2cfb bytes) 2024-09-21T15:10:50.783 INFO:teuthology.orchestra.run.smithi161.stdout:5031 write 0x9ca7357 thru 0x9cb0f95 (0x9c3f bytes) 2024-09-21T15:10:50.808 INFO:teuthology.orchestra.run.smithi161.stdout:5826 writesame 0xbab9e9a thru 0xbabc3d9 data_size 0x20(0x2540 bytes) 2024-09-21T15:10:50.809 INFO:teuthology.orchestra.run.smithi161.stdout:5032 write 0x70de6c2 thru 0x70e0836 (0x2175 bytes) 2024-09-21T15:10:50.860 INFO:teuthology.orchestra.run.smithi161.stdout:5827 write 0xbb6a634 thru 0xbb72751 (0x811e bytes) 2024-09-21T15:10:50.892 INFO:teuthology.orchestra.run.smithi161.stdout:5036 write 0xe2308af thru 0xe2335c3 (0x2d15 bytes) 2024-09-21T15:10:50.916 INFO:teuthology.orchestra.run.smithi161.stdout:5037 read 0x49ba7ce thru 0x49c0a7e (0x62b1 bytes) 2024-09-21T15:10:50.916 INFO:teuthology.orchestra.run.smithi161.stdout:5038 write 0xa539a27 thru 0xa5459a1 (0xbf7b bytes) 2024-09-21T15:10:50.934 INFO:teuthology.orchestra.run.smithi161.stdout:5828 writesame 0xe4c3af1 thru 0xe4d238f data_size 0x1f(0xe89f bytes) 2024-09-21T15:10:50.946 INFO:teuthology.orchestra.run.smithi161.stdout:5829 read 0xc32ad24 thru 0xc3343c2 (0x969f bytes) 2024-09-21T15:10:50.947 INFO:teuthology.orchestra.run.smithi161.stdout:5830 write 0xad30bb8 thru 0xad34f0b (0x4354 bytes) 2024-09-21T15:10:50.950 INFO:teuthology.orchestra.run.smithi161.stdout:5040 write 0xca3c31d thru 0xca4b7bf (0xf4a3 bytes) 2024-09-21T15:10:50.961 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:50.962+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad140 finish: resending after timeout 2024-09-21T15:10:50.983 INFO:teuthology.orchestra.run.smithi161.stdout:5831 trunc from 0xe4d2390 to 0x78882ec 2024-09-21T15:10:51.004 INFO:teuthology.orchestra.run.smithi161.stdout:5041 write 0xeadf024 thru 0xeae7801 (0x87de bytes) 2024-09-21T15:10:51.027 INFO:teuthology.orchestra.run.smithi161.stdout:5042 punch from 0x7b58cd1 to 0x7b5d58c, (0x48bb bytes) 2024-09-21T15:10:51.027 INFO:teuthology.orchestra.run.smithi161.stdout:5043 punch from 0xb42c49 to 0xb47d2c, (0x50e3 bytes) 2024-09-21T15:10:51.027 INFO:teuthology.orchestra.run.smithi161.stdout:5044 write 0x327913a thru 0x327f94d (0x6814 bytes) 2024-09-21T15:10:51.048 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:51.055 INFO:teuthology.orchestra.run.smithi161.stdout:5048 trunc from 0xeae7802 to 0xc5d8f75 2024-09-21T15:10:51.068 INFO:teuthology.orchestra.run.smithi161.stdout:5833 write 0x7db6088 thru 0x7dbdc64 (0x7bdd bytes) 2024-09-21T15:10:51.088 INFO:teuthology.orchestra.run.smithi161.stdout:5834 read 0x146704 thru 0x155014 (0xe911 bytes) 2024-09-21T15:10:51.099 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:51.098+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588b40 finish: resending after timeout 2024-09-21T15:10:51.110 INFO:teuthology.orchestra.run.smithi161.stdout:5049 punch from 0x922d059 to 0x922f60f, (0x25b6 bytes) 2024-09-21T15:10:51.110 INFO:teuthology.orchestra.run.smithi161.stdout:5051 read 0x11425a3 thru 0x1145f6f (0x39cd bytes) 2024-09-21T15:10:51.111 INFO:teuthology.orchestra.run.smithi161.stdout:5054 writesame 0x35e8c29 thru 0x35eccd5 data_size 0x1(0x40ad bytes) 2024-09-21T15:10:51.134 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:51.135 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:51.138 INFO:teuthology.orchestra.run.smithi161.stdout:5835 write 0x9479ea5 thru 0x947cd12 (0x2e6e bytes) 2024-09-21T15:10:51.153 INFO:teuthology.orchestra.run.smithi161.stdout:5836 punch from 0x55115ae to 0x551d0c3, (0xbb15 bytes) 2024-09-21T15:10:51.154 INFO:teuthology.orchestra.run.smithi161.stdout:5837 write 0x908bbc9 thru 0x908f249 (0x3681 bytes) 2024-09-21T15:10:51.175 INFO:teuthology.orchestra.run.smithi161.stdout:5838 trunc from 0x947cd13 to 0x7366838 2024-09-21T15:10:51.180 INFO:teuthology.orchestra.run.smithi161.stdout:5058 write 0xecde3c2 thru 0xece76a1 (0x92e0 bytes) 2024-09-21T15:10:51.203 INFO:teuthology.orchestra.run.smithi161.stdout:5059 writesame 0xa81794e thru 0xa81bf80 data_size 0x1(0x4633 bytes) 2024-09-21T15:10:51.241 INFO:teuthology.orchestra.run.smithi161.stdout:5061 trunc from 0xece76a2 to 0x86b9ef6 2024-09-21T15:10:51.252 INFO:teuthology.orchestra.run.smithi161.stdout:5841 trunc from 0x7366838 to 0xe3371bf 2024-09-21T15:10:51.287 INFO:teuthology.orchestra.run.smithi161.stdout:5842 trunc from 0xe3371bf to 0xe2bfc6f 2024-09-21T15:10:51.308 INFO:teuthology.orchestra.run.smithi161.stdout:5062 trunc from 0x86b9ef6 to 0xca80fb8 2024-09-21T15:10:51.314 INFO:teuthology.orchestra.run.smithi161.stdout:5843 punch from 0x52b7ff4 to 0x52c037c, (0x8388 bytes) 2024-09-21T15:10:51.314 INFO:teuthology.orchestra.run.smithi161.stdout:5844 punch from 0x7b2e175 to 0x7b3692e, (0x87b9 bytes) 2024-09-21T15:10:51.314 INFO:teuthology.orchestra.run.smithi161.stdout:5845 writesame 0x33dc824 thru 0x33e2ef6 data_size 0x1(0x66d3 bytes) 2024-09-21T15:10:51.338 INFO:teuthology.orchestra.run.smithi161.stdout:5063 writesame 0x8abcfa thru 0x8bb4c1 data_size 0x18(0xf7c8 bytes) 2024-09-21T15:10:51.349 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:51.349 INFO:teuthology.orchestra.run.smithi161.stdout:5850 punch from 0x6078f04 to 0x607c73e, (0x383a bytes) 2024-09-21T15:10:51.349 INFO:teuthology.orchestra.run.smithi161.stdout:5855 write 0xb390702 thru 0xb39cea6 (0xc7a5 bytes) 2024-09-21T15:10:51.363 INFO:teuthology.orchestra.run.smithi161.stdout:5064 writesame 0xb8632a6 thru 0xb868403 data_size 0x5(0x515e bytes) 2024-09-21T15:10:51.367 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:51.367 INFO:teuthology.orchestra.run.smithi161.stdout:5858 read 0x382b0cf thru 0x38377a4 (0xc6d6 bytes) 2024-09-21T15:10:51.395 INFO:teuthology.orchestra.run.smithi161.stdout:5065 trunc from 0xca80fb8 to 0x6c3e0f1 2024-09-21T15:10:51.403 INFO:teuthology.orchestra.run.smithi161.stdout:5859 write 0xe7c7a4b thru 0xe7d0729 (0x8cdf bytes) 2024-09-21T15:10:51.422 INFO:teuthology.orchestra.run.smithi161.stdout:5860 write 0x14887dc thru 0x148fa51 (0x7276 bytes) 2024-09-21T15:10:51.441 INFO:teuthology.orchestra.run.smithi161.stdout:5862 punch from 0x7ae8132 to 0x7aecc70, (0x4b3e bytes) 2024-09-21T15:10:51.441 INFO:teuthology.orchestra.run.smithi161.stdout:5863 read 0x1f0b3cd thru 0x1f12710 (0x7344 bytes) 2024-09-21T15:10:51.441 INFO:teuthology.orchestra.run.smithi161.stdout:5864 read 0x4653048 thru 0x4662b06 (0xfabf bytes) 2024-09-21T15:10:51.441 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:51.443 INFO:teuthology.orchestra.run.smithi161.stdout:5866 trunc from 0xe7d072a to 0xd94bb37 2024-09-21T15:10:51.450 INFO:teuthology.orchestra.run.smithi161.stdout:5066 write 0x2753fcc thru 0x275849b (0x44d0 bytes) 2024-09-21T15:10:51.471 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:51.471 INFO:teuthology.orchestra.run.smithi161.stdout:5068 read 0x4c8e915 thru 0x4c9a326 (0xba12 bytes) 2024-09-21T15:10:51.471 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:51.471 INFO:teuthology.orchestra.run.smithi161.stdout:5071 punch from 0xdfe24 to 0xe71ff, (0x73db bytes) 2024-09-21T15:10:51.471 INFO:teuthology.orchestra.run.smithi161.stdout:5072 punch from 0x3bf2b84 to 0x3c01642, (0xeabe bytes) 2024-09-21T15:10:51.471 INFO:teuthology.orchestra.run.smithi161.stdout:5074 punch from 0x3198d53 to 0x319d677, (0x4924 bytes) 2024-09-21T15:10:51.486 INFO:teuthology.orchestra.run.smithi161.stdout:5075 trunc from 0x6c3e0f1 to 0x30dce8 2024-09-21T15:10:51.499 INFO:teuthology.orchestra.run.smithi161.stdout:5867 punch from 0xb17afa to 0xb1e80c, (0x6d12 bytes) 2024-09-21T15:10:51.499 INFO:teuthology.orchestra.run.smithi161.stdout:5868 read 0x3224a7d thru 0x3224b24 (0xa8 bytes) 2024-09-21T15:10:51.500 INFO:teuthology.orchestra.run.smithi161.stdout:5871 write 0x4f4e7d1 thru 0x4f5cb95 (0xe3c5 bytes) 2024-09-21T15:10:51.528 INFO:teuthology.orchestra.run.smithi161.stdout:5872 writesame 0x46019e2 thru 0x4606ccc data_size 0x1(0x52eb bytes) 2024-09-21T15:10:51.554 INFO:teuthology.orchestra.run.smithi161.stdout:5873 write 0x926ac72 thru 0x926d7ab (0x2b3a bytes) 2024-09-21T15:10:51.565 INFO:teuthology.orchestra.run.smithi161.stdout:5874 punch from 0xa84c5b4 to 0xa84ed46, (0x2792 bytes) 2024-09-21T15:10:51.565 INFO:teuthology.orchestra.run.smithi161.stdout:5875 read 0x79403f5 thru 0x79419d1 (0x15dd bytes) 2024-09-21T15:10:51.565 INFO:teuthology.orchestra.run.smithi161.stdout:5876 punch from 0xcf5040f to 0xcf53d37, (0x3928 bytes) 2024-09-21T15:10:51.565 INFO:teuthology.orchestra.run.smithi161.stdout:5877 punch from 0x21ee9ab to 0x21f4432, (0x5a87 bytes) 2024-09-21T15:10:51.566 INFO:teuthology.orchestra.run.smithi161.stdout:5881 write 0x81d6e04 thru 0x81e58a2 (0xea9f bytes) 2024-09-21T15:10:51.566 INFO:teuthology.orchestra.run.smithi161.stdout:5076 read 0x23c022 thru 0x243d3d (0x7d1c bytes) 2024-09-21T15:10:51.569 INFO:teuthology.orchestra.run.smithi161.stdout:5077 read 0x1b8125 thru 0x1c54ed (0xd3c9 bytes) 2024-09-21T15:10:51.571 INFO:teuthology.orchestra.run.smithi161.stdout:5078 punch from 0x2c28e3 to 0x2c5b90, (0x32ad bytes) 2024-09-21T15:10:51.571 INFO:teuthology.orchestra.run.smithi161.stdout:5079 read 0x13002e thru 0x1354cc (0x549f bytes) 2024-09-21T15:10:51.572 INFO:teuthology.orchestra.run.smithi161.stdout:5080 read 0x96eae thru 0xa51ef (0xe342 bytes) 2024-09-21T15:10:51.573 INFO:teuthology.orchestra.run.smithi161.stdout:5082 read 0x2c245c thru 0x2cea62 (0xc607 bytes) 2024-09-21T15:10:51.579 INFO:teuthology.orchestra.run.smithi161.stdout:5883 read 0x19897a2 thru 0x1995a00 (0xc25f bytes) 2024-09-21T15:10:51.579 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:51.579 INFO:teuthology.orchestra.run.smithi161.stdout:5886 read 0x2832cd2 thru 0x283c112 (0x9441 bytes) 2024-09-21T15:10:51.603 INFO:teuthology.orchestra.run.smithi161.stdout:5887 trunc from 0xd94bb37 to 0x605fa85 2024-09-21T15:10:51.629 INFO:teuthology.orchestra.run.smithi161.stdout:5083 write 0x633d25b thru 0x634cf30 (0xfcd6 bytes) 2024-09-21T15:10:51.653 INFO:teuthology.orchestra.run.smithi161.stdout:5084 punch from 0x1744549 to 0x174b5e0, (0x7097 bytes) 2024-09-21T15:10:51.654 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:51.705 INFO:teuthology.orchestra.run.smithi161.stdout:5089 write 0xc31aaf0 thru 0xc325a43 (0xaf54 bytes) 2024-09-21T15:10:51.715 INFO:teuthology.orchestra.run.smithi161.stdout:5888 write 0xd522413 thru 0xd530dca (0xe9b8 bytes) 2024-09-21T15:10:51.735 INFO:teuthology.orchestra.run.smithi161.stdout:5893 write 0x80cf1ff thru 0x80d7dc2 (0x8bc4 bytes) 2024-09-21T15:10:51.752 INFO:teuthology.orchestra.run.smithi161.stdout:5895 writesame 0x4651bfb thru 0x465b2a1 data_size 0x1(0x96a7 bytes) 2024-09-21T15:10:51.768 INFO:teuthology.orchestra.run.smithi161.stdout:5090 write 0xd802382 thru 0xd808cde (0x695d bytes) 2024-09-21T15:10:51.791 INFO:teuthology.orchestra.run.smithi161.stdout:5896 writesame 0x73342d6 thru 0x733a7c4 data_size 0x57(0x64ef bytes) 2024-09-21T15:10:51.803 INFO:teuthology.orchestra.run.smithi161.stdout:5897 read 0x8ef7873 thru 0x8ef960a (0x1d98 bytes) 2024-09-21T15:10:51.804 INFO:teuthology.orchestra.run.smithi161.stdout:5091 trunc from 0xd808cdf to 0xab3092f 2024-09-21T15:10:51.805 INFO:teuthology.orchestra.run.smithi161.stdout:5899 trunc from 0xd530dcb to 0xe0f0a9a 2024-09-21T15:10:51.848 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:51.848 INFO:teuthology.orchestra.run.smithi161.stdout:5903 write 0x6be6517 thru 0x6bedaa2 (0x758c bytes) 2024-09-21T15:10:51.862 INFO:teuthology.orchestra.run.smithi161.stdout:5906 read 0x274a64c thru 0x2758ba0 (0xe555 bytes) 2024-09-21T15:10:51.862 INFO:teuthology.orchestra.run.smithi161.stdout:5907 write 0x6c6597f thru 0x6c6f900 (0x9f82 bytes) 2024-09-21T15:10:51.865 INFO:teuthology.orchestra.run.smithi161.stdout:5092 writesame 0x26ec776 thru 0x26f1e8e data_size 0x1(0x5719 bytes) 2024-09-21T15:10:51.879 INFO:teuthology.orchestra.run.smithi161.stdout:5908 write 0xa2e3071 thru 0xa2ec053 (0x8fe3 bytes) 2024-09-21T15:10:51.895 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:51.896 INFO:teuthology.orchestra.run.smithi161.stdout:5094 write 0x2e3af0 thru 0x2eeb1c (0xb02d bytes) 2024-09-21T15:10:51.904 INFO:teuthology.orchestra.run.smithi161.stdout:5909 punch from 0x75fa2fd to 0x7607f8d, (0xdc90 bytes) 2024-09-21T15:10:51.905 INFO:teuthology.orchestra.run.smithi161.stdout:5910 punch from 0xb0518d2 to 0xb05f3db, (0xdb09 bytes) 2024-09-21T15:10:51.905 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:51.905 INFO:teuthology.orchestra.run.smithi161.stdout:5912 punch from 0x809d109 to 0x809ed5c, (0x1c53 bytes) 2024-09-21T15:10:51.909 INFO:teuthology.orchestra.run.smithi161.stdout:5095 read 0x5edecfb thru 0x5ee6b27 (0x7e2d bytes) 2024-09-21T15:10:51.914 INFO:teuthology.orchestra.run.smithi161.stdout:5096 trunc from 0xab3092f to 0x903f1cd 2024-09-21T15:10:51.925 INFO:teuthology.orchestra.run.smithi161.stdout:5913 trunc from 0xe0f0a9a to 0x3d43d94 2024-09-21T15:10:51.956 INFO:teuthology.orchestra.run.smithi161.stdout:5098 read 0x46c5eb9 thru 0x46c88b2 (0x29fa bytes) 2024-09-21T15:10:51.956 INFO:teuthology.orchestra.run.smithi161.stdout:5100 write 0x3b98915 thru 0x3ba67f3 (0xdedf bytes) 2024-09-21T15:10:51.983 INFO:teuthology.orchestra.run.smithi161.stdout:5101 punch from 0x17e93df to 0x17efacc, (0x66ed bytes) 2024-09-21T15:10:51.989 INFO:teuthology.orchestra.run.smithi161.stdout:5914 read 0x3c4307 thru 0x3cf9bf (0xb6b9 bytes) 2024-09-21T15:10:51.999 INFO:teuthology.orchestra.run.smithi161.stdout:5102 trunc from 0x903f1cd to 0xc129b9 2024-09-21T15:10:52.028 INFO:teuthology.orchestra.run.smithi161.stdout:5915 write 0x4fadb66 thru 0x4fb9dda (0xc275 bytes) 2024-09-21T15:10:52.051 INFO:teuthology.orchestra.run.smithi161.stdout:5916 read 0xaf244f thru 0xaf2e68 (0xa1a bytes) 2024-09-21T15:10:52.052 INFO:teuthology.orchestra.run.smithi161.stdout:5917 punch from 0x33d0679 to 0x33de849, (0xe1d0 bytes) 2024-09-21T15:10:52.092 INFO:teuthology.orchestra.run.smithi161.stdout:5918 write 0x621d18d thru 0x6226778 (0x95ec bytes) 2024-09-21T15:10:52.171 INFO:teuthology.orchestra.run.smithi161.stdout:5919 clone 49 order 20 su 8192 sc 7 2024-09-21T15:10:52.180 INFO:teuthology.orchestra.run.smithi161.stdout:5103 write 0x7526da6 thru 0x752fcb2 (0x8f0d bytes) 2024-09-21T15:10:52.206 INFO:teuthology.orchestra.run.smithi161.stdout:5105 write 0x29f8b4f thru 0x29fdbe4 (0x5096 bytes) 2024-09-21T15:10:52.222 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.222+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a7980 finish: resending after timeout 2024-09-21T15:10:52.222 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.222+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e6183c0 finish: resending after timeout 2024-09-21T15:10:52.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.222+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a5520300 finish: resending after timeout 2024-09-21T15:10:52.225 INFO:teuthology.orchestra.run.smithi161.stdout:5106 write 0x6110cd7 thru 0x611304f (0x2379 bytes) 2024-09-21T15:10:52.231 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.230+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560b40 finish: resending after timeout 2024-09-21T15:10:52.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.230+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc6c0 finish: resending after timeout 2024-09-21T15:10:52.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.230+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0d80 finish: resending after timeout 2024-09-21T15:10:52.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a69c0 finish: resending after timeout 2024-09-21T15:10:52.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:10:52.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a6480 finish: resending after timeout 2024-09-21T15:10:52.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a55206c0 finish: resending after timeout 2024-09-21T15:10:52.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ab14b680 finish: resending after timeout 2024-09-21T15:10:52.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bd800 finish: resending after timeout 2024-09-21T15:10:52.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc300 finish: resending after timeout 2024-09-21T15:10:52.238 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.238+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43a40 finish: resending after timeout 2024-09-21T15:10:52.238 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.238+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c420c0 finish: resending after timeout 2024-09-21T15:10:52.239 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:52.238+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43140 finish: resending after timeout 2024-09-21T15:10:52.241 INFO:teuthology.orchestra.run.smithi161.stdout:5108 read 0x33f029e thru 0x33f8328 (0x808b bytes) 2024-09-21T15:10:52.276 INFO:teuthology.orchestra.run.smithi161.stdout:5109 write 0x773cf20 thru 0x773f9fa (0x2adb bytes) 2024-09-21T15:10:52.353 INFO:teuthology.orchestra.run.smithi161.stdout:5110 writesame 0xc657ec3 thru 0xc66605d data_size 0x1(0xe19b bytes) 2024-09-21T15:10:52.359 INFO:teuthology.orchestra.run.smithi161.stdout:5111 read 0x1540ebc thru 0x154c358 (0xb49d bytes) 2024-09-21T15:10:52.359 INFO:teuthology.orchestra.run.smithi161.stdout:5112 punch from 0x7ee1f98 to 0x7ee4488, (0x24f0 bytes) 2024-09-21T15:10:52.359 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:52.372 INFO:teuthology.orchestra.run.smithi161.stdout:5114 trunc from 0xc66605e to 0x77a529a 2024-09-21T15:10:52.418 INFO:teuthology.orchestra.run.smithi161.stdout:5116 read 0x7d9ace thru 0x7d9e8c (0x3bf bytes) 2024-09-21T15:10:52.455 INFO:teuthology.orchestra.run.smithi161.stdout:5117 writesame 0x8edb1a5 thru 0x8ee1945 data_size 0x25(0x67a1 bytes) 2024-09-21T15:10:52.460 INFO:teuthology.orchestra.run.smithi161.stdout:5118 read 0x63efa6e thru 0x63f71e8 (0x777b bytes) 2024-09-21T15:10:52.460 INFO:teuthology.orchestra.run.smithi161.stdout:5119 read 0x62c78db thru 0x62cde83 (0x65a9 bytes) 2024-09-21T15:10:52.461 INFO:teuthology.orchestra.run.smithi161.stdout:5120 write 0x27fd96 thru 0x28b685 (0xb8f0 bytes) 2024-09-21T15:10:52.520 INFO:teuthology.orchestra.run.smithi161.stdout:5121 writesame 0xaaf8313 thru 0xab03c48 data_size 0x2(0xb936 bytes) 2024-09-21T15:10:52.525 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:52.573 INFO:teuthology.orchestra.run.smithi161.stdout:5124 write 0xbedf5b2 thru 0xbee5c00 (0x664f bytes) 2024-09-21T15:10:52.621 INFO:teuthology.orchestra.run.smithi161.stdout:5126 trunc from 0xbee5c01 to 0x2dc5040 2024-09-21T15:10:52.687 INFO:teuthology.orchestra.run.smithi161.stdout:5127 write 0x26c1d26 thru 0x26c6123 (0x43fe bytes) 2024-09-21T15:10:52.709 INFO:teuthology.orchestra.run.smithi161.stdout:5128 write 0x43c36f thru 0x447585 (0xb217 bytes) 2024-09-21T15:10:52.734 INFO:teuthology.orchestra.run.smithi161.stdout:5129 read 0x1c1098 thru 0x1ce96d (0xd8d6 bytes) 2024-09-21T15:10:52.735 INFO:teuthology.orchestra.run.smithi161.stdout:5130 punch from 0x1a2b703 to 0x1a3242b, (0x6d28 bytes) 2024-09-21T15:10:52.736 INFO:teuthology.orchestra.run.smithi161.stdout:5132 clone 53 order 20 su 4096 sc 13 2024-09-21T15:10:53.040 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.4-clone48 2024-09-21T15:10:53.102 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #51, image image_cluster1.client.mirror.3-clone51 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent52 2024-09-21T15:10:53.288 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #47, image image_cluster1.client.mirror.4-clone47 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent48 2024-09-21T15:10:53.293 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:53.290+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560540 finish: resending after timeout 2024-09-21T15:10:53.393 INFO:teuthology.orchestra.run.smithi161.stdout:5921 writesame 0x784d04 thru 0x7887da data_size 0x1(0x3ad7 bytes) 2024-09-21T15:10:53.466 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:53.488 INFO:teuthology.orchestra.run.smithi161.stdout:5133 read 0x19ca408 thru 0x19cdff2 (0x3beb bytes) 2024-09-21T15:10:53.506 INFO:teuthology.orchestra.run.smithi161.stdout:5926 writesame 0x9c12a7a thru 0x9c1c7f7 data_size 0x13(0x9d7e bytes) 2024-09-21T15:10:53.513 INFO:teuthology.orchestra.run.smithi161.stdout:5927 read 0x7f9ac61 thru 0x7fa059a (0x593a bytes) 2024-09-21T15:10:53.514 INFO:teuthology.orchestra.run.smithi161.stdout:5134 read 0x11fac35 thru 0x12096c7 (0xea93 bytes) 2024-09-21T15:10:53.524 INFO:teuthology.orchestra.run.smithi161.stdout:5928 trunc from 0x9c1c7f8 to 0x6db1a38 2024-09-21T15:10:53.563 INFO:teuthology.orchestra.run.smithi161.stdout:5136 write 0x8ceae4b thru 0x8ceb28b (0x441 bytes) 2024-09-21T15:10:53.570 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:53.570 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:53.570 INFO:teuthology.orchestra.run.smithi161.stdout:5932 punch from 0x23c7817 to 0x23c9266, (0x1a4f bytes) 2024-09-21T15:10:53.570 INFO:teuthology.orchestra.run.smithi161.stdout:5934 read 0x32bc24f thru 0x32ca492 (0xe244 bytes) 2024-09-21T15:10:53.570 INFO:teuthology.orchestra.run.smithi161.stdout:5935 punch from 0x3aff11 to 0x3bd60c, (0xd6fb bytes) 2024-09-21T15:10:53.579 INFO:teuthology.orchestra.run.smithi161.stdout:5137 read 0x30de8f1 thru 0x30e0050 (0x1760 bytes) 2024-09-21T15:10:53.579 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:53.579 INFO:teuthology.orchestra.run.smithi161.stdout:5140 punch from 0x7293332 to 0x72a2ab2, (0xf780 bytes) 2024-09-21T15:10:53.579 INFO:teuthology.orchestra.run.smithi161.stdout:5141 read 0x72eba90 thru 0x72f0b67 (0x50d8 bytes) 2024-09-21T15:10:53.625 INFO:teuthology.orchestra.run.smithi161.stdout:5936 writesame 0xec4e880 thru 0xec5e68c data_size 0x85(0xfe0d bytes) 2024-09-21T15:10:53.631 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:53.631 INFO:teuthology.orchestra.run.smithi161.stdout:5938 read 0x49a818 thru 0x4a5063 (0xa84c bytes) 2024-09-21T15:10:53.634 INFO:teuthology.orchestra.run.smithi161.stdout:5142 write 0xd1e5dec thru 0xd1efb38 (0x9d4d bytes) 2024-09-21T15:10:53.634 INFO:teuthology.orchestra.run.smithi161.stdout:5939 read 0x79e1612 thru 0x79f0c5b (0xf64a bytes) 2024-09-21T15:10:53.634 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:53.635 INFO:teuthology.orchestra.run.smithi161.stdout:5941 writesame 0x5d5a4b7 thru 0x5d62b24 data_size 0x1(0x866e bytes) 2024-09-21T15:10:53.687 INFO:teuthology.orchestra.run.smithi161.stdout:5943 read 0xca42dc5 thru 0xca4c47a (0x96b6 bytes) 2024-09-21T15:10:53.693 INFO:teuthology.orchestra.run.smithi161.stdout:5143 write 0x24f571a thru 0x24fb6f7 (0x5fde bytes) 2024-09-21T15:10:53.712 INFO:teuthology.orchestra.run.smithi161.stdout:5944 trunc from 0xec5e68d to 0x358afd7 2024-09-21T15:10:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:5146 writesame 0x5006363 thru 0x500c21e data_size 0x81(0x5ebc bytes) 2024-09-21T15:10:53.799 INFO:teuthology.orchestra.run.smithi161.stdout:5148 punch from 0xb6eb772 to 0xb6f4098, (0x8926 bytes) 2024-09-21T15:10:53.799 INFO:teuthology.orchestra.run.smithi161.stdout:5149 punch from 0xcaa75c9 to 0xcaafc0a, (0x8641 bytes) 2024-09-21T15:10:53.799 INFO:teuthology.orchestra.run.smithi161.stdout:5152 write 0x4fb508f thru 0x4fbfe8a (0xadfc bytes) 2024-09-21T15:10:53.804 INFO:teuthology.orchestra.run.smithi161.stdout:5945 write 0x17e0fe0 thru 0x17ed334 (0xc355 bytes) 2024-09-21T15:10:53.860 INFO:teuthology.orchestra.run.smithi161.stdout:5153 read 0x7650ffd thru 0x7654021 (0x3025 bytes) 2024-09-21T15:10:53.860 INFO:teuthology.orchestra.run.smithi161.stdout:5154 write 0x50be972 thru 0x50c54cc (0x6b5b bytes) 2024-09-21T15:10:53.899 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:53.899 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:53.902 INFO:teuthology.orchestra.run.smithi161.stdout:5157 trunc from 0xd1efb39 to 0xec1bb6f 2024-09-21T15:10:53.926 INFO:teuthology.orchestra.run.smithi161.stdout:5946 writesame 0x8f20a85 thru 0x8f20cd5 data_size 0x1(0x251 bytes) 2024-09-21T15:10:53.933 INFO:teuthology.orchestra.run.smithi161.stdout:5947 write 0x29bb24c thru 0x29c233b (0x70f0 bytes) 2024-09-21T15:10:53.946 INFO:teuthology.orchestra.run.smithi161.stdout:5159 write 0xb94b2ae thru 0xb94bea0 (0xbf3 bytes) 2024-09-21T15:10:53.962 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:53.962 INFO:teuthology.orchestra.run.smithi161.stdout:5161 write 0x8f991c1 thru 0x8f9f899 (0x66d9 bytes) 2024-09-21T15:10:53.966 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:53.966 INFO:teuthology.orchestra.run.smithi161.stdout:5949 write 0x5f22d15 thru 0x5f30c30 (0xdf1c bytes) 2024-09-21T15:10:53.997 INFO:teuthology.orchestra.run.smithi161.stdout:5164 read 0x66fc777 thru 0x6708590 (0xbe1a bytes) 2024-09-21T15:10:53.998 INFO:teuthology.orchestra.run.smithi161.stdout:5166 write 0x5754c24 thru 0x5762939 (0xdd16 bytes) 2024-09-21T15:10:54.006 INFO:teuthology.orchestra.run.smithi161.stdout:5950 read 0x8d9c0c4 thru 0x8da83a2 (0xc2df bytes) 2024-09-21T15:10:54.006 INFO:teuthology.orchestra.run.smithi161.stdout:5951 read 0x384dc6a thru 0x3853b7b (0x5f12 bytes) 2024-09-21T15:10:54.006 INFO:teuthology.orchestra.run.smithi161.stdout:5952 read 0x62ebcd2 thru 0x62ee997 (0x2cc6 bytes) 2024-09-21T15:10:54.007 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:54.007 INFO:teuthology.orchestra.run.smithi161.stdout:5954 read 0x6eb65c3 thru 0x6ebf1cd (0x8c0b bytes) 2024-09-21T15:10:54.007 INFO:teuthology.orchestra.run.smithi161.stdout:5955 punch from 0x5c30686 to 0x5c37a6d, (0x73e7 bytes) 2024-09-21T15:10:54.007 INFO:teuthology.orchestra.run.smithi161.stdout:5956 read 0x2b9bb98 thru 0x2baa280 (0xe6e9 bytes) 2024-09-21T15:10:54.008 INFO:teuthology.orchestra.run.smithi161.stdout:5959 writesame 0x50b2c5 thru 0x518960 data_size 0x52(0xd69c bytes) 2024-09-21T15:10:54.016 INFO:teuthology.orchestra.run.smithi161.stdout:5167 read 0xd3017cd thru 0xd30ce78 (0xb6ac bytes) 2024-09-21T15:10:54.030 INFO:teuthology.orchestra.run.smithi161.stdout:5168 read 0xa2081f6 thru 0xa2120a3 (0x9eae bytes) 2024-09-21T15:10:54.030 INFO:teuthology.orchestra.run.smithi161.stdout:5169 read 0x19480f1 thru 0x19483eb (0x2fb bytes) 2024-09-21T15:10:54.030 INFO:teuthology.orchestra.run.smithi161.stdout:5170 read 0xe8f36e3 thru 0xe8fbdd3 (0x86f1 bytes) 2024-09-21T15:10:54.031 INFO:teuthology.orchestra.run.smithi161.stdout:5171 write 0x6e93cdc thru 0x6e97932 (0x3c57 bytes) 2024-09-21T15:10:54.081 INFO:teuthology.orchestra.run.smithi161.stdout:5172 punch from 0x36943b0 to 0x3696328, (0x1f78 bytes) 2024-09-21T15:10:54.081 INFO:teuthology.orchestra.run.smithi161.stdout:5173 read 0xe6987db thru 0xe6a6cf3 (0xe519 bytes) 2024-09-21T15:10:54.088 INFO:teuthology.orchestra.run.smithi161.stdout:5176 trunc from 0xec1bb6f to 0xc825e54 2024-09-21T15:10:54.105 INFO:teuthology.orchestra.run.smithi161.stdout:5960 write 0x51a7daa thru 0x51b533c (0xd593 bytes) 2024-09-21T15:10:54.149 INFO:teuthology.orchestra.run.smithi161.stdout:5177 read 0xb8ea39f thru 0xb8f9181 (0xede3 bytes) 2024-09-21T15:10:54.150 INFO:teuthology.orchestra.run.smithi161.stdout:5178 read 0x7690be1 thru 0x76985d4 (0x79f4 bytes) 2024-09-21T15:10:54.151 INFO:teuthology.orchestra.run.smithi161.stdout:5181 read 0x2570f13 thru 0x25794d0 (0x85be bytes) 2024-09-21T15:10:54.152 INFO:teuthology.orchestra.run.smithi161.stdout:5186 punch from 0x9c77012 to 0x9c7f471, (0x845f bytes) 2024-09-21T15:10:54.177 INFO:teuthology.orchestra.run.smithi161.stdout:5961 writesame 0xa5ba266 thru 0xa5c80a3 data_size 0x1(0xde3e bytes) 2024-09-21T15:10:54.187 INFO:teuthology.orchestra.run.smithi161.stdout:5187 writesame 0xe7ac3c4 thru 0xe7b5054 data_size 0x1(0x8c91 bytes) 2024-09-21T15:10:54.192 INFO:teuthology.orchestra.run.smithi161.stdout:5188 write 0x1c42b8 thru 0x1cc260 (0x7fa9 bytes) 2024-09-21T15:10:54.274 INFO:teuthology.orchestra.run.smithi161.stdout:5963 write 0xe8ae476 thru 0xe8b3eae (0x5a39 bytes) 2024-09-21T15:10:54.327 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:54.327 INFO:teuthology.orchestra.run.smithi161.stdout:5965 write 0x94ee07a thru 0x94f659d (0x8524 bytes) 2024-09-21T15:10:54.352 INFO:teuthology.orchestra.run.smithi161.stdout:5189 writesame 0x433c0c4 thru 0x4344146 data_size 0x1(0x8083 bytes) 2024-09-21T15:10:54.360 INFO:teuthology.orchestra.run.smithi161.stdout:5966 clone 50 order 22 su 1048576 sc 2 2024-09-21T15:10:54.392 INFO:teuthology.orchestra.run.smithi161.stdout:5190 read 0x5936ea2 thru 0x5942285 (0xb3e4 bytes) 2024-09-21T15:10:54.414 INFO:teuthology.orchestra.run.smithi161.stdout:5191 trunc from 0xe7b5055 to 0x3cebced 2024-09-21T15:10:54.491 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:54.544 INFO:teuthology.orchestra.run.smithi161.stdout:5195 write 0xdce729f thru 0xdce9b66 (0x28c8 bytes) 2024-09-21T15:10:54.565 INFO:teuthology.orchestra.run.smithi161.stdout:5196 writesame 0xb933abb thru 0xb93bb16 data_size 0x14(0x805c bytes) 2024-09-21T15:10:54.601 INFO:teuthology.orchestra.run.smithi161.stdout:5200 punch from 0x52a4ca1 to 0x52afe26, (0xb185 bytes) 2024-09-21T15:10:54.601 INFO:teuthology.orchestra.run.smithi161.stdout:5201 read 0x7dbf2c3 thru 0x7dc8ebc (0x9bfa bytes) 2024-09-21T15:10:54.602 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:54.602 INFO:teuthology.orchestra.run.smithi161.stdout:5203 writesame 0xcae7c50 thru 0xcaef32b data_size 0x2(0x76dc bytes) 2024-09-21T15:10:54.636 INFO:teuthology.orchestra.run.smithi161.stdout:5204 write 0x2d5d514 thru 0x2d62332 (0x4e1f bytes) 2024-09-21T15:10:54.698 INFO:teuthology.orchestra.run.smithi161.stdout:5205 trunc from 0xdce9b67 to 0x31f5da7 2024-09-21T15:10:54.814 INFO:teuthology.orchestra.run.smithi161.stdout:5206 write 0x14e0642 thru 0x14e0987 (0x346 bytes) 2024-09-21T15:10:54.850 INFO:teuthology.orchestra.run.smithi161.stdout:5207 read 0x1b120a3 thru 0x1b17a5f (0x59bd bytes) 2024-09-21T15:10:54.854 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:54.854 INFO:teuthology.orchestra.run.smithi161.stdout:5211 read 0x1b53f65 thru 0x1b55f23 (0x1fbf bytes) 2024-09-21T15:10:54.856 INFO:teuthology.orchestra.run.smithi161.stdout:5212 read 0x1f776cd thru 0x1f7e872 (0x71a6 bytes) 2024-09-21T15:10:54.857 INFO:teuthology.orchestra.run.smithi161.stdout:5215 writesame 0x268c2ed thru 0x26976d7 data_size 0xd(0xb3eb bytes) 2024-09-21T15:10:54.917 INFO:teuthology.orchestra.run.smithi161.stdout:5217 read 0x152e873 thru 0x1537da4 (0x9532 bytes) 2024-09-21T15:10:54.917 INFO:teuthology.orchestra.run.smithi161.stdout:5218 punch from 0xb09121 to 0xb16588, (0xd467 bytes) 2024-09-21T15:10:54.918 INFO:teuthology.orchestra.run.smithi161.stdout:5219 read 0x13a43fa thru 0x13ac02f (0x7c36 bytes) 2024-09-21T15:10:54.918 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:54.919 INFO:teuthology.orchestra.run.smithi161.stdout:5222 writesame 0x1b3b290 thru 0x1b4abe2 data_size 0x1(0xf953 bytes) 2024-09-21T15:10:54.952 INFO:teuthology.orchestra.run.smithi161.stdout:5223 read 0x243f997 thru 0x24427c8 (0x2e32 bytes) 2024-09-21T15:10:54.969 INFO:teuthology.orchestra.run.smithi161.stdout:5224 trunc from 0x31f5da7 to 0x527d26f 2024-09-21T15:10:55.001 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:55.001 INFO:teuthology.orchestra.run.smithi161.stdout:5227 flatten 2024-09-21T15:10:55.053 INFO:teuthology.orchestra.run.smithi161.stdout:flattening image image_cluster1.client.mirror.4-clone49 2024-09-21T15:10:55.210 INFO:teuthology.orchestra.run.smithi161.stdout:5228 write 0xc75acce thru 0xc76117e (0x64b1 bytes) 2024-09-21T15:10:55.244 INFO:teuthology.orchestra.run.smithi161.stdout:5229 punch from 0x4b9405f to 0x4b9b39a, (0x733b bytes) 2024-09-21T15:10:55.277 INFO:teuthology.orchestra.run.smithi161.stdout:5231 writesame 0xe82efd3 thru 0xe837b50 data_size 0x5(0x8b7e bytes) 2024-09-21T15:10:55.283 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:55.283 INFO:teuthology.orchestra.run.smithi161.stdout:5233 write 0x71b63aa thru 0x71c0334 (0x9f8b bytes) 2024-09-21T15:10:55.326 INFO:teuthology.orchestra.run.smithi161.stdout:5236 write 0xcbe332e thru 0xcbea2f6 (0x6fc9 bytes) 2024-09-21T15:10:55.353 INFO:teuthology.orchestra.run.smithi161.stdout:5237 read 0x1ba0925 thru 0x1bab6ba (0xad96 bytes) 2024-09-21T15:10:55.356 INFO:teuthology.orchestra.run.smithi161.stdout:5238 trunc from 0xe837b51 to 0xdd3a275 2024-09-21T15:10:55.394 INFO:teuthology.orchestra.run.smithi161.stdout:5240 writesame 0xa626ae9 thru 0xa627962 data_size 0x11(0xe7a bytes) 2024-09-21T15:10:55.396 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #48, image image_cluster1.client.mirror.4-clone48 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent49 2024-09-21T15:10:55.413 INFO:teuthology.orchestra.run.smithi161.stdout:5241 write 0x41b999 thru 0x425720 (0x9d88 bytes) 2024-09-21T15:10:55.435 INFO:teuthology.orchestra.run.smithi161.stdout:5242 writesame 0xa56b40e thru 0xa570833 data_size 0x1(0x5426 bytes) 2024-09-21T15:10:55.470 INFO:teuthology.orchestra.run.smithi161.stdout:5243 write 0x3e8f2c thru 0x3f643e (0xd513 bytes) 2024-09-21T15:10:55.490 INFO:teuthology.orchestra.run.smithi161.stdout:5245 punch from 0xd403426 to 0xd40ab01, (0x76db bytes) 2024-09-21T15:10:55.490 INFO:teuthology.orchestra.run.smithi161.stdout:5247 write 0x3fb636c thru 0x3fc534d (0xefe2 bytes) 2024-09-21T15:10:55.537 INFO:teuthology.orchestra.run.smithi161.stdout:5248 writesame 0x1f2baab thru 0x1f2eb95 data_size 0x7(0x30eb bytes) 2024-09-21T15:10:55.593 INFO:teuthology.orchestra.run.smithi161.stdout:5250 writesame 0xe6f257d thru 0xe6f5f3d data_size 0x1(0x39c1 bytes) 2024-09-21T15:10:55.598 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:55.598 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:55.598 INFO:teuthology.orchestra.run.smithi161.stdout:5256 read 0xe42a173 thru 0xe43165a (0x74e8 bytes) 2024-09-21T15:10:55.623 INFO:teuthology.orchestra.run.smithi161.stdout:5257 trunc from 0xe6f5f3e to 0xb88c8c 2024-09-21T15:10:55.662 INFO:teuthology.orchestra.run.smithi161.stdout:5967 read 0x660b922 thru 0x6616b82 (0xb261 bytes) 2024-09-21T15:10:55.709 INFO:teuthology.orchestra.run.smithi161.stdout:5968 write 0x788c74e thru 0x789c65e (0xff11 bytes) 2024-09-21T15:10:55.730 INFO:teuthology.orchestra.run.smithi161.stdout:5969 read 0x338fbd6 thru 0x339e1ab (0xe5d6 bytes) 2024-09-21T15:10:55.734 INFO:teuthology.orchestra.run.smithi161.stdout:5970 read 0x69131d1 thru 0x6919cab (0x6adb bytes) 2024-09-21T15:10:55.756 INFO:teuthology.orchestra.run.smithi161.stdout:5971 trunc from 0xe8b3eaf to 0x83c18dc 2024-09-21T15:10:55.784 INFO:teuthology.orchestra.run.smithi161.stdout:5258 write 0x37aa8f2 thru 0x37b4328 (0x9a37 bytes) 2024-09-21T15:10:55.805 INFO:teuthology.orchestra.run.smithi161.stdout:5972 clone 51 order 22 su 32768 sc 13 2024-09-21T15:10:55.827 INFO:teuthology.orchestra.run.smithi161.stdout:5259 read 0x24cd064 thru 0x24dcba3 (0xfb40 bytes) 2024-09-21T15:10:55.891 INFO:teuthology.orchestra.run.smithi161.stdout:5260 write 0xa2f9b55 thru 0xa2fdaf0 (0x3f9c bytes) 2024-09-21T15:10:55.922 INFO:teuthology.orchestra.run.smithi161.stdout:5261 read 0x39ed192 thru 0x39efb64 (0x29d3 bytes) 2024-09-21T15:10:55.923 INFO:teuthology.orchestra.run.smithi161.stdout:5263 read 0x61bea2a thru 0x61bf4b1 (0xa88 bytes) 2024-09-21T15:10:55.937 INFO:teuthology.orchestra.run.smithi161.stdout:5264 trunc from 0xa2fdaf1 to 0x3d2b073 2024-09-21T15:10:55.962 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:55.962+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad140 finish: resending after timeout 2024-09-21T15:10:56.004 INFO:teuthology.orchestra.run.smithi161.stdout:5265 write 0x363b612 thru 0x363f1d8 (0x3bc7 bytes) 2024-09-21T15:10:56.049 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.4-clone50 from 0x83c18dc (overlap 0x83c18dc) to 0x6967a49 2024-09-21T15:10:56.063 INFO:teuthology.orchestra.run.smithi161.stdout:5271 write 0x791d541 thru 0x792b660 (0xe120 bytes) 2024-09-21T15:10:56.100 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:56.098+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588b40 finish: resending after timeout 2024-09-21T15:10:56.111 INFO:teuthology.orchestra.run.smithi161.stdout:5273 write 0x73eecf2 thru 0x73f3b16 (0x4e25 bytes) 2024-09-21T15:10:56.149 INFO:teuthology.orchestra.run.smithi161.stdout:5274 punch from 0x6324025 to 0x6326828, (0x2803 bytes) 2024-09-21T15:10:56.149 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:56.149 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:56.149 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:56.150 INFO:teuthology.orchestra.run.smithi161.stdout:5280 read 0x67ec1d6 thru 0x67f2b5f (0x698a bytes) 2024-09-21T15:10:56.191 INFO:teuthology.orchestra.run.smithi161.stdout:5281 write 0x9cdb84c thru 0x9ce2627 (0x6ddc bytes) 2024-09-21T15:10:56.232 INFO:teuthology.orchestra.run.smithi161.stdout:5282 write 0x9ae536c thru 0x9aecf37 (0x7bcc bytes) 2024-09-21T15:10:56.262 INFO:teuthology.orchestra.run.smithi161.stdout:5283 read 0x8961293 thru 0x8967f8a (0x6cf8 bytes) 2024-09-21T15:10:56.283 INFO:teuthology.orchestra.run.smithi161.stdout:5284 trunc from 0x9ce2628 to 0x1fe158 2024-09-21T15:10:56.334 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #49, image image_cluster1.client.mirror.4-clone49 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent50 2024-09-21T15:10:56.390 INFO:teuthology.orchestra.run.smithi161.stdout:5285 read 0x154f8 thru 0x212af (0xbdb8 bytes) 2024-09-21T15:10:56.392 INFO:teuthology.orchestra.run.smithi161.stdout:5286 read 0x3ea85 thru 0x45a05 (0x6f81 bytes) 2024-09-21T15:10:56.394 INFO:teuthology.orchestra.run.smithi161.stdout:5287 read 0x148682 thru 0x156fae (0xe92d bytes) 2024-09-21T15:10:56.396 INFO:teuthology.orchestra.run.smithi161.stdout:5288 read 0x493a thru 0xc2c9 (0x7990 bytes) 2024-09-21T15:10:56.398 INFO:teuthology.orchestra.run.smithi161.stdout:5290 read 0x356bf thru 0x3c7f0 (0x7132 bytes) 2024-09-21T15:10:56.448 INFO:teuthology.orchestra.run.smithi161.stdout:5291 writesame 0x6ba5df7 thru 0x6baeed3 data_size 0x1(0x90dd bytes) 2024-09-21T15:10:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:56.456 INFO:teuthology.orchestra.run.smithi161.stdout:5293 read 0x1d1c6f8 thru 0x1d29ce6 (0xd5ef bytes) 2024-09-21T15:10:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:5295 read 0x3bc16ee thru 0x3bcdb64 (0xc477 bytes) 2024-09-21T15:10:56.459 INFO:teuthology.orchestra.run.smithi161.stdout:5296 read 0x4067bae thru 0x406d8c5 (0x5d18 bytes) 2024-09-21T15:10:56.501 INFO:teuthology.orchestra.run.smithi161.stdout:5299 writesame 0x7388dea thru 0x7390816 data_size 0x1(0x7a2d bytes) 2024-09-21T15:10:56.505 INFO:teuthology.orchestra.run.smithi161.stdout:5300 punch from 0x530342c to 0x5304c2e, (0x1802 bytes) 2024-09-21T15:10:56.505 INFO:teuthology.orchestra.run.smithi161.stdout:5302 read 0xa2b73 thru 0xaa6bb (0x7b49 bytes) 2024-09-21T15:10:56.505 INFO:teuthology.orchestra.run.smithi161.stdout:5303 read 0x6d70e7 thru 0x6de1ea (0x7104 bytes) 2024-09-21T15:10:56.507 INFO:teuthology.orchestra.run.smithi161.stdout:5304 read 0x331f0f9 thru 0x33223a3 (0x32ab bytes) 2024-09-21T15:10:56.507 INFO:teuthology.orchestra.run.smithi161.stdout:5305 read 0x2cbcb89 thru 0x2cc4367 (0x77df bytes) 2024-09-21T15:10:56.507 INFO:teuthology.orchestra.run.smithi161.stdout:5306 punch from 0x48a7816 to 0x48ac3df, (0x4bc9 bytes) 2024-09-21T15:10:56.507 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:56.507 INFO:teuthology.orchestra.run.smithi161.stdout:5308 punch from 0x5530377 to 0x5532f50, (0x2bd9 bytes) 2024-09-21T15:10:56.507 INFO:teuthology.orchestra.run.smithi161.stdout:5309 read 0x441ddf1 thru 0x4427591 (0x97a1 bytes) 2024-09-21T15:10:56.507 INFO:teuthology.orchestra.run.smithi161.stdout:5311 write 0x681bb3d thru 0x682656d (0xaa31 bytes) 2024-09-21T15:10:56.549 INFO:teuthology.orchestra.run.smithi161.stdout:5312 writesame 0x34a1570 thru 0x34ac2ce data_size 0x1(0xad5f bytes) 2024-09-21T15:10:56.592 INFO:teuthology.orchestra.run.smithi161.stdout:5314 read 0x3fde23a thru 0x3fe8a9d (0xa864 bytes) 2024-09-21T15:10:56.593 INFO:teuthology.orchestra.run.smithi161.stdout:5315 read 0x19b5dc4 thru 0x19b7c2c (0x1e69 bytes) 2024-09-21T15:10:56.595 INFO:teuthology.orchestra.run.smithi161.stdout:5316 trunc from 0x7390817 to 0x657203a 2024-09-21T15:10:56.698 INFO:teuthology.orchestra.run.smithi161.stdout:5317 writesame 0xbf3a2a3 thru 0xbf3a30f data_size 0x1(0x6d bytes) 2024-09-21T15:10:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:5318 read 0x2e9071d thru 0x2e9b0ec (0xa9d0 bytes) 2024-09-21T15:10:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:5319 punch from 0x8d9fcef to 0x8daa520, (0xa831 bytes) 2024-09-21T15:10:56.703 INFO:teuthology.orchestra.run.smithi161.stdout:5320 write 0x3757f68 thru 0x375a3ac (0x2445 bytes) 2024-09-21T15:10:56.717 INFO:teuthology.orchestra.run.smithi161.stdout:5321 read 0x34e4fea thru 0x34eec73 (0x9c8a bytes) 2024-09-21T15:10:56.719 INFO:teuthology.orchestra.run.smithi161.stdout:5323 read 0x1bb48f5 thru 0x1bbe5cf (0x9cdb bytes) 2024-09-21T15:10:56.725 INFO:teuthology.orchestra.run.smithi161.stdout:5324 trunc from 0xbf3a310 to 0x9605038 2024-09-21T15:10:56.779 INFO:teuthology.orchestra.run.smithi161.stdout:5326 trunc from 0x9605038 to 0xe428988 2024-09-21T15:10:56.813 INFO:teuthology.orchestra.run.smithi161.stdout:5328 write 0x425db4f thru 0x426a670 (0xcb22 bytes) 2024-09-21T15:10:56.880 INFO:teuthology.orchestra.run.smithi161.stdout:5330 read 0x261326 thru 0x26df69 (0xcc44 bytes) 2024-09-21T15:10:56.882 INFO:teuthology.orchestra.run.smithi161.stdout:5333 read 0x6762333 thru 0x676f498 (0xd166 bytes) 2024-09-21T15:10:56.883 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:56.883 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:56.883 INFO:teuthology.orchestra.run.smithi161.stdout:5337 writesame 0x20c9235 thru 0x20d8f6a data_size 0x1(0xfd36 bytes) 2024-09-21T15:10:56.946 INFO:teuthology.orchestra.run.smithi161.stdout:5339 read 0x5020e66 thru 0x502633f (0x54da bytes) 2024-09-21T15:10:56.946 INFO:teuthology.orchestra.run.smithi161.stdout:5342 read 0x2ed4f7b thru 0x2edf310 (0xa396 bytes) 2024-09-21T15:10:56.947 INFO:teuthology.orchestra.run.smithi161.stdout:5343 writesame 0x75ef2e9 thru 0x75f43ce data_size 0x5f(0x50e6 bytes) 2024-09-21T15:10:56.954 INFO:teuthology.orchestra.run.smithi161.stdout:5974 write 0x8e90fb7 thru 0x8e95833 (0x487d bytes) 2024-09-21T15:10:56.979 INFO:teuthology.orchestra.run.smithi161.stdout:5975 punch from 0x4b06193 to 0x4b0dbc4, (0x7a31 bytes) 2024-09-21T15:10:56.979 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:56.979 INFO:teuthology.orchestra.run.smithi161.stdout:5977 punch from 0x5e9a355 to 0x5ea5683, (0xb32e bytes) 2024-09-21T15:10:56.979 INFO:teuthology.orchestra.run.smithi161.stdout:5978 writesame 0x3b5fa54 thru 0x3b67bc7 data_size 0xa(0x8174 bytes) 2024-09-21T15:10:56.990 INFO:teuthology.orchestra.run.smithi161.stdout:5344 trunc from 0xe428988 to 0x681aeb2 2024-09-21T15:10:57.040 INFO:teuthology.orchestra.run.smithi161.stdout:5980 writesame 0x818793f thru 0x8191299 data_size 0x2b(0x995b bytes) 2024-09-21T15:10:57.081 INFO:teuthology.orchestra.run.smithi161.stdout:5982 read 0x8a59112 thru 0x8a5c9d3 (0x38c2 bytes) 2024-09-21T15:10:57.101 INFO:teuthology.orchestra.run.smithi161.stdout:5347 write 0xe6131d6 thru 0xe616fcc (0x3df7 bytes) 2024-09-21T15:10:57.128 INFO:teuthology.orchestra.run.smithi161.stdout:5348 writesame 0xd632cb6 thru 0xd636db7 data_size 0x35(0x4102 bytes) 2024-09-21T15:10:57.129 INFO:teuthology.orchestra.run.smithi161.stdout:5984 writesame 0xa69f4a7 thru 0xa6ac38b data_size 0x6b(0xcee5 bytes) 2024-09-21T15:10:57.135 INFO:teuthology.orchestra.run.smithi161.stdout:5985 writesame 0x534530b thru 0x534fdd4 data_size 0x3f(0xaaca bytes) 2024-09-21T15:10:57.197 INFO:teuthology.orchestra.run.smithi161.stdout:5986 write 0x9a6474f thru 0x9a69302 (0x4bb4 bytes) 2024-09-21T15:10:57.207 INFO:teuthology.orchestra.run.smithi161.stdout:5349 write 0xe89c8e6 thru 0xe8a9d9d (0xd4b8 bytes) 2024-09-21T15:10:57.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.222+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a5520300 finish: resending after timeout 2024-09-21T15:10:57.229 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:57.229 INFO:teuthology.orchestra.run.smithi161.stdout:5988 read 0xa686e80 thru 0xa68e806 (0x7987 bytes) 2024-09-21T15:10:57.229 INFO:teuthology.orchestra.run.smithi161.stdout:5991 read 0x1d82329 thru 0x1d85cbb (0x3993 bytes) 2024-09-21T15:10:57.229 INFO:teuthology.orchestra.run.smithi161.stdout:5992 write 0x7b1f038 thru 0x7b2e605 (0xf5ce bytes) 2024-09-21T15:10:57.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.230+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560b40 finish: resending after timeout 2024-09-21T15:10:57.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc6c0 finish: resending after timeout 2024-09-21T15:10:57.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0d80 finish: resending after timeout 2024-09-21T15:10:57.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a69c0 finish: resending after timeout 2024-09-21T15:10:57.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.234+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:10:57.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a6480 finish: resending after timeout 2024-09-21T15:10:57.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.234+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a55206c0 finish: resending after timeout 2024-09-21T15:10:57.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.238+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ab14b680 finish: resending after timeout 2024-09-21T15:10:57.238 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.238+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bd800 finish: resending after timeout 2024-09-21T15:10:57.239 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.238+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc300 finish: resending after timeout 2024-09-21T15:10:57.240 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.238+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43a40 finish: resending after timeout 2024-09-21T15:10:57.240 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.238+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c420c0 finish: resending after timeout 2024-09-21T15:10:57.242 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:57.238+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43140 finish: resending after timeout 2024-09-21T15:10:57.253 INFO:teuthology.orchestra.run.smithi161.stdout:5993 read 0x7ab59 thru 0x81337 (0x67df bytes) 2024-09-21T15:10:57.254 INFO:teuthology.orchestra.run.smithi161.stdout:5994 punch from 0x89da25c to 0x89ddf47, (0x3ceb bytes) 2024-09-21T15:10:57.254 INFO:teuthology.orchestra.run.smithi161.stdout:5996 read 0xbcaaaf thru 0xbd5319 (0xa86b bytes) 2024-09-21T15:10:57.255 INFO:teuthology.orchestra.run.smithi161.stdout:5997 writesame 0x73e7474 thru 0x73e79c8 data_size 0x7(0x555 bytes) 2024-09-21T15:10:57.255 INFO:teuthology.orchestra.run.smithi161.stdout:5351 read 0xbd9e534 thru 0xbda7095 (0x8b62 bytes) 2024-09-21T15:10:57.256 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:57.256 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:57.256 INFO:teuthology.orchestra.run.smithi161.stdout:5355 writesame 0x60f0678 thru 0x60f4a7f data_size 0x1c(0x4408 bytes) 2024-09-21T15:10:57.278 INFO:teuthology.orchestra.run.smithi161.stdout:5356 write 0xe5cfcfc thru 0xe5d6510 (0x6815 bytes) 2024-09-21T15:10:57.278 INFO:teuthology.orchestra.run.smithi161.stdout:6000 punch from 0xb0717c to 0xb10fac, (0x9e30 bytes) 2024-09-21T15:10:57.298 INFO:teuthology.orchestra.run.smithi161.stdout:5357 punch from 0xbb458b2 to 0xbb54d46, (0xf494 bytes) 2024-09-21T15:10:57.298 INFO:teuthology.orchestra.run.smithi161.stdout:5358 punch from 0x410e28c to 0x410fa91, (0x1805 bytes) 2024-09-21T15:10:57.298 INFO:teuthology.orchestra.run.smithi161.stdout:5359 read 0xaf26909 thru 0xaf3400b (0xd703 bytes) 2024-09-21T15:10:57.299 INFO:teuthology.orchestra.run.smithi161.stdout:5361 punch from 0xe38258e to 0xe38a3b9, (0x7e2b bytes) 2024-09-21T15:10:57.299 INFO:teuthology.orchestra.run.smithi161.stdout:5363 punch from 0xaa8debb to 0xaa923a2, (0x44e7 bytes) 2024-09-21T15:10:57.302 INFO:teuthology.orchestra.run.smithi161.stdout:5364 trunc from 0xe8a9d9e to 0xd6bf54b 2024-09-21T15:10:57.353 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #50, image image_cluster1.client.mirror.4-clone50 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent51 2024-09-21T15:10:57.371 INFO:teuthology.orchestra.run.smithi161.stdout:5365 write 0x18c818f thru 0x18ccfb7 (0x4e29 bytes) 2024-09-21T15:10:57.405 INFO:teuthology.orchestra.run.smithi161.stdout:5368 write 0xc46bd6 thru 0xc5383f (0xcc6a bytes) 2024-09-21T15:10:57.480 INFO:teuthology.orchestra.run.smithi161.stdout:5369 write 0xec3f1d5 thru 0xec4b0b5 (0xbee1 bytes) 2024-09-21T15:10:57.529 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:57.554 INFO:teuthology.orchestra.run.smithi161.stdout:5371 trunc from 0xec4b0b6 to 0xb7a749 2024-09-21T15:10:57.638 INFO:teuthology.orchestra.run.smithi161.stdout:All operations completed A-OK! 2024-09-21T15:10:57.672 DEBUG:teuthology.parallel:result is None 2024-09-21T15:10:57.730 INFO:teuthology.orchestra.run.smithi161.stdout:5372 write 0x9b8b5cc thru 0x9b949f4 (0x9429 bytes) 2024-09-21T15:10:57.817 INFO:teuthology.orchestra.run.smithi161.stdout:5373 write 0x606c831 thru 0x606ff00 (0x36d0 bytes) 2024-09-21T15:10:57.837 INFO:teuthology.orchestra.run.smithi161.stdout:5374 writesame 0x6d945b6 thru 0x6da2db0 data_size 0x1(0xe7fb bytes) 2024-09-21T15:10:57.928 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.913+0000 7f7fd044c700 -1 reset not still connected to 0x56369e6196c0 2024-09-21T15:10:57.928 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.913+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:10:57.929 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.913+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:10:57.929 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.917+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:10:57.929 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.917+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7149040 2024-09-21T15:10:57.929 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.917+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb9930 2024-09-21T15:10:57.930 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.917+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:10:57.932 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.921+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:10:57.932 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.921+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e5b0 2024-09-21T15:10:57.932 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.921+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:10:57.932 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.921+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbaea0 2024-09-21T15:10:57.932 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.921+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:10:57.933 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.929+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4340 2024-09-21T15:10:57.933 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.929+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:10:57.933 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.929+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:10:57.933 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.929+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:10:57.933 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.929+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:10:57.938 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.929+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:10:57.938 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.929+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:10:57.964 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45052b0 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483edd0 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:10:57.965 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:57.945+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:10:57.983 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:57.973+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:10:58.006 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.001+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:10:58.009 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:57.997+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf6aac680 2024-09-21T15:10:58.009 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:57.997+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff41a0 2024-09-21T15:10:58.009 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:57.997+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4680 2024-09-21T15:10:58.009 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:57.997+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4c30 2024-09-21T15:10:58.010 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.001+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff52b0 2024-09-21T15:10:58.010 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.001+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:10:58.010 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.001+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:10:58.010 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.001+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a40415f0 2024-09-21T15:10:58.010 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.001+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5d40 2024-09-21T15:10:58.011 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.001+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5ee0 2024-09-21T15:10:58.011 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.001+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0ee7b450 2024-09-21T15:10:58.015 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:10:58.017 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc15459450 2024-09-21T15:10:58.017 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc15459520 2024-09-21T15:10:58.017 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc154595f0 2024-09-21T15:10:58.017 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546c750 2024-09-21T15:10:58.017 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546c820 2024-09-21T15:10:58.017 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546cea0 2024-09-21T15:10:58.018 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc157fc000 2024-09-21T15:10:58.018 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:10:58.018 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc16e7b5f0 2024-09-21T15:10:58.018 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1753d450 2024-09-21T15:10:58.018 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939edd0 2024-09-21T15:10:58.018 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939ef70 2024-09-21T15:10:58.018 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fc70 2024-09-21T15:10:58.018 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.009+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc19691790 2024-09-21T15:10:58.018 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.013+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfcedd0 2024-09-21T15:10:58.018 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.013+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c383040 2024-09-21T15:10:58.018 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.013+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf58410 2024-09-21T15:10:58.019 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.013+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4581e10 2024-09-21T15:10:58.019 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.013+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:10:58.028 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51484e0 2024-09-21T15:10:58.028 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a59a2dd0 2024-09-21T15:10:58.028 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec61a0 2024-09-21T15:10:58.028 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:10:58.028 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:10:58.028 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:10:58.028 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160680 2024-09-21T15:10:58.028 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:10:58.028 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:10:58.031 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e8f0 2024-09-21T15:10:58.035 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:10:58.035 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf592b0 2024-09-21T15:10:58.035 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3508f0 2024-09-21T15:10:58.035 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822680 2024-09-21T15:10:58.035 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822b60 2024-09-21T15:10:58.035 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e823ad0 2024-09-21T15:10:58.035 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:10:58.035 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4410 2024-09-21T15:10:58.035 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f51e0 2024-09-21T15:10:58.035 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:10:58.035 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:10:58.021+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:10:58.037 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.029+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:10:58.038 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.029+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:10:58.039 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1ad0 2024-09-21T15:10:58.039 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0dd0 2024-09-21T15:10:58.039 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:10:58.039 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:10:58.039 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:10:58.039 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:10:58.040 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:10:58.040 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:10:58.040 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:10:58.040 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:10:58.040 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab15d40 2024-09-21T15:10:58.040 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:10:58.040 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:10:58.040 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.033+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:10:58.040 INFO:teuthology.orchestra.run.smithi161.stdout:5375 write 0xffa36 thru 0x10a828 (0xadf3 bytes) 2024-09-21T15:10:58.054 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.045+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:10:58.054 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.045+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:10:58.055 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.049+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:10:58.055 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.049+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:10:58.055 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.049+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e8410 2024-09-21T15:10:58.055 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.049+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:10:58.056 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.049+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:10:58.056 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.049+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:10:58.056 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.049+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:10:58.056 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.049+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:10:58.058 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.053+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:10:58.058 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.053+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:10:58.058 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.053+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:10:58.058 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.053+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:10:58.058 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.053+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:10:58.058 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.053+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf8750 2024-09-21T15:10:58.058 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.053+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:10:58.059 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.053+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:10:58.059 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.053+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:10:58.059 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.053+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:10:58.059 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.053+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:10:58.059 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.053+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af311c70 2024-09-21T15:10:58.059 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.053+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe411e0 2024-09-21T15:10:58.060 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.057+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a4e0 2024-09-21T15:10:58.067 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.057+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:10:58.081 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.077+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4581e10 2024-09-21T15:10:58.092 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.085+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:10:58.096 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.085+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:10:58.096 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.085+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:10:58.096 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.085+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:10:58.111 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.101+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:10:58.117 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:58.118+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a34eda40 handle_clone_image: failed to clone image mirror/10b56c103baf to image_cluster1.client.mirror.0-clone39 2024-09-21T15:10:58.129 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:10:58.129 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:10:58.129 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:10:58.146 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.141+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:10:58.149 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.145+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:10:58.150 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.145+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:10:58.150 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.145+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:10:58.150 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.145+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:10:58.150 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.145+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab15d40 2024-09-21T15:10:58.150 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.145+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:10:58.150 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.145+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:10:58.150 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.145+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:10:58.150 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.145+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:10:58.150 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.145+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:10:58.150 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.145+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:10:58.150 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.145+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:10:58.151 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.145+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e8410 2024-09-21T15:10:58.155 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:10:58.157 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:10:58.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:10:58.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:10:58.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:10:58.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:10:58.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:10:58.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:10:58.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:10:58.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:10:58.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:10:58.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf8750 2024-09-21T15:10:58.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:10:58.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:10:58.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:10:58.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:10:58.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:10:58.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af311c70 2024-09-21T15:10:58.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe411e0 2024-09-21T15:10:58.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a4e0 2024-09-21T15:10:58.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a8f0 2024-09-21T15:10:58.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:10:58.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.153+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56750 2024-09-21T15:10:58.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:10:58.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:10:58.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:10:58.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.162+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:10:58.163 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.162+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:10:58.163 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.162+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:10:58.163 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.162+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:10:58.163 INFO:teuthology.orchestra.run.smithi161.stdout:5378 write 0x45598c9 thru 0x45610f0 (0x7828 bytes) 2024-09-21T15:10:58.245 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:58.242+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a0d114a0 handle_clone_image: failed to clone image mirror/10b4237f429b to image_cluster1.client.mirror.3-clone47 2024-09-21T15:10:58.299 INFO:teuthology.orchestra.run.smithi161.stdout:5382 trunc from 0x9b949f5 to 0x5a027b2 2024-09-21T15:10:58.299 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:58.298+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560540 finish: resending after timeout 2024-09-21T15:10:58.342 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7149040 2024-09-21T15:10:58.342 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:10:58.342 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbaea0 2024-09-21T15:10:58.356 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:10:58.356 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:10:58.356 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:10:58.356 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:10:58.356 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45052b0 2024-09-21T15:10:58.357 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:10:58.357 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:10:58.357 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:10:58.357 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:10:58.357 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:10:58.407 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.406+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:10:58.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.410+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:10:58.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.410+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:10:58.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.410+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:10:58.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:10:58.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.430+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:10:58.435 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.430+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76c30 2024-09-21T15:10:58.441 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:10:58.441 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:10:58.441 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd2ea0 2024-09-21T15:10:58.441 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:10:58.441 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:10:58.441 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:10:58.441 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:10:58.441 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:10:58.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:10:58.443 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:10:58.443 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:10:58.449 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.446+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:10:58.450 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.446+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d85b0 2024-09-21T15:10:58.450 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.446+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:10:58.451 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.446+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:10:58.451 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:10:58.451 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:10:58.451 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:10:58.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:10:58.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:10:58.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782410 2024-09-21T15:10:58.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:10:58.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:10:58.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782820 2024-09-21T15:10:58.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782a90 2024-09-21T15:10:58.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782d00 2024-09-21T15:10:58.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:10:58.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783040 2024-09-21T15:10:58.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:10:58.453 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:10:58.453 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783380 2024-09-21T15:10:58.453 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:10:58.453 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783520 2024-09-21T15:10:58.453 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:10:58.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:10:58.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:10:58.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783e10 2024-09-21T15:10:58.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:10:58.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:10:58.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:10:58.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:10:58.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47040 2024-09-21T15:10:58.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:10:58.450+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:10:58.541 INFO:teuthology.orchestra.run.smithi161.stdout:5383 punch from 0x499dc00 to 0x49a9220, (0xb620 bytes) 2024-09-21T15:10:58.561 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.558+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:10:58.562 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.562+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:10:58.562 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.562+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:10:58.562 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.562+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:10:58.563 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.562+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:10:58.572 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.565+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:10:58.578 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.574+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:10:58.578 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.574+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:10:58.578 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.574+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:10:58.578 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.574+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:10:58.578 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.574+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:10:58.578 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.574+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:10:58.578 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.574+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:10:58.578 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.574+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:10:58.582 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.578+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:10:58.582 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.578+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:10:58.582 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.578+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:10:58.582 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.578+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:10:58.582 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.578+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:10:58.582 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.578+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:10:58.582 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.578+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:10:58.582 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.578+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:10:58.582 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.578+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:10:58.582 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.578+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:10:58.582 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.578+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:10:58.583 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.582+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:10:58.583 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.582+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:10:58.583 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.582+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:10:58.584 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.582+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:10:58.584 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.582+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:10:58.584 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.582+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:10:58.584 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:10:58.582+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:10:58.613 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.601+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:10:58.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:58.618+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a41f1860 handle_clone_image: failed to clone image mirror/10ad336bb776 to image_cluster1.client.mirror.2-clone40 2024-09-21T15:10:58.631 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.617+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:10:58.637 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.629+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:10:58.638 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.629+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:10:58.639 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.633+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab15d40 2024-09-21T15:10:58.639 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.633+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:10:58.640 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.633+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:10:58.652 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.649+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:10:58.661 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f2b0 2024-09-21T15:10:58.661 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:10:58.661 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:10:58.661 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:10:58.662 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:10:58.662 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e8410 2024-09-21T15:10:58.662 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:10:58.662 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:10:58.662 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:10:58.662 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:10:58.662 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:10:58.662 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:10:58.662 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:10:58.662 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:10:58.662 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:10:58.662 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:10:58.662 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf8750 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af311c70 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe411e0 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a000 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a4e0 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a8f0 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0c30 2024-09-21T15:10:58.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4581e10 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x562876d89520 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4581e10 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:10:58.664 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:10:58.665 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:10:58.653+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:10:58.687 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:58.686+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a57a2780 handle_clone_image: failed to clone image mirror/10b7124093bf to image_cluster1.client.mirror.5-clone35 2024-09-21T15:10:58.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:58.762+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59fbbda40 handle_clone_image: failed to clone image mirror/10b6c945d42f to image_cluster1.client.mirror.4-clone50 2024-09-21T15:10:58.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:58.786+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59f9f10e0 handle_clone_image: failed to clone image mirror/10b65af4931e to image_cluster1.client.mirror.4-clone46 2024-09-21T15:10:58.803 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.793+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbaea0 2024-09-21T15:10:58.804 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.793+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:10:58.804 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.793+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:10:58.804 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:58.793+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:10:58.850 INFO:teuthology.orchestra.run.smithi161.stdout:5384 write 0x8e878b3 thru 0x8e943ca (0xcb18 bytes) 2024-09-21T15:10:58.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:58.954+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a41f0780 handle_clone_image: failed to clone image mirror/10b5e1573da2 to image_cluster1.client.mirror.0-clone20 2024-09-21T15:10:59.006 INFO:teuthology.orchestra.run.smithi161.stdout:5386 write 0x8b43a3f thru 0x8b4d4d1 (0x9a93 bytes) 2024-09-21T15:10:59.079 INFO:teuthology.orchestra.run.smithi161.stdout:5387 write 0xbff6890 thru 0xc00200b (0xb77c bytes) 2024-09-21T15:10:59.117 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:59.118+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a0a125a0 handle_clone_image: failed to clone image mirror/10b71b385b9c to image_cluster1.client.mirror.5-clone25 2024-09-21T15:10:59.124 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.117+0000 7f7fd044c700 -1 reset not still connected to 0x56369e02d6c0 2024-09-21T15:10:59.124 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.117+0000 7f7fd044c700 -1 reset not still connected to 0x56369e5756c0 2024-09-21T15:10:59.137 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.121+0000 7f7fd044c700 -1 reset not still connected to 0x56369e619520 2024-09-21T15:10:59.137 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.121+0000 7f7fd044c700 -1 reset not still connected to 0x56369f5dc000 2024-09-21T15:10:59.140 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.125+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:10:59.140 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.125+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:10:59.140 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.125+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:10:59.140 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.125+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7149040 2024-09-21T15:10:59.140 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.125+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb9930 2024-09-21T15:10:59.140 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.125+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:10:59.140 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.125+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:10:59.141 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.125+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:10:59.141 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.125+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbaea0 2024-09-21T15:10:59.146 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.129+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:10:59.146 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.129+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:10:59.146 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.129+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:10:59.146 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.129+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:10:59.147 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:10:59.147 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:10:59.147 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:10:59.147 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45052b0 2024-09-21T15:10:59.147 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:10:59.148 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:10:59.148 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:10:59.148 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a750 2024-09-21T15:10:59.148 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:10:59.148 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:10:59.148 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:10:59.148 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:10:59.149 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:10:59.149 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:10:59.133+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:10:59.203 INFO:teuthology.orchestra.run.smithi161.stdout:5388 write 0x2809636 thru 0x2818b6c (0xf537 bytes) 2024-09-21T15:10:59.261 INFO:teuthology.orchestra.run.smithi161.stdout:5389 punch from 0x4e0be48 to 0x4e1a9c3, (0xeb7b bytes) 2024-09-21T15:10:59.261 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:59.302 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:10:59.302+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59f2bfe00 handle_clone_image: failed to clone image mirror/10b677af84f0 to image_cluster1.client.mirror.4-clone14 2024-09-21T15:10:59.320 INFO:teuthology.orchestra.run.smithi161.stdout:5391 write 0xd5c32f3 thru 0xd5d1706 (0xe414 bytes) 2024-09-21T15:10:59.384 INFO:teuthology.orchestra.run.smithi161.stdout:5392 writesame 0x32be8ac thru 0x32c46f6 data_size 0x1(0x5e4b bytes) 2024-09-21T15:10:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:5393 punch from 0x2066c5d to 0x20676e4, (0xa87 bytes) 2024-09-21T15:10:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:5397 punch from 0xa855969 to 0xa8611b0, (0xb847 bytes) 2024-09-21T15:10:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:5399 read 0x7baf89f thru 0x7bb6974 (0x70d6 bytes) 2024-09-21T15:10:59.404 INFO:teuthology.orchestra.run.smithi161.stdout:5401 write 0x5950d4e thru 0x59521fd (0x14b0 bytes) 2024-09-21T15:10:59.428 INFO:teuthology.orchestra.run.smithi161.stdout:5403 punch from 0xa0929f7 to 0xa09e9a1, (0xbfaa bytes) 2024-09-21T15:10:59.428 INFO:teuthology.orchestra.run.smithi161.stdout:5405 write 0x5931f61 thru 0x5938143 (0x61e3 bytes) 2024-09-21T15:10:59.454 INFO:teuthology.orchestra.run.smithi161.stdout:5406 write 0x89e7111 thru 0x89ed3a2 (0x6292 bytes) 2024-09-21T15:10:59.465 INFO:teuthology.orchestra.run.smithi161.stdout:5407 writesame 0xbfa4f9f thru 0xbfa6df2 data_size 0x1(0x1e54 bytes) 2024-09-21T15:10:59.474 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:59.474 INFO:teuthology.orchestra.run.smithi161.stdout:5410 write 0x32e8177 thru 0x32ee5a0 (0x642a bytes) 2024-09-21T15:10:59.492 INFO:teuthology.orchestra.run.smithi161.stdout:5412 trunc from 0xd5d1707 to 0x841e957 2024-09-21T15:10:59.558 INFO:teuthology.orchestra.run.smithi161.stdout:5413 write 0x3505cdc thru 0x350c9bb (0x6ce0 bytes) 2024-09-21T15:10:59.597 INFO:teuthology.orchestra.run.smithi161.stdout:5414 trunc from 0x841e957 to 0x42b1738 2024-09-21T15:10:59.658 INFO:teuthology.orchestra.run.smithi161.stdout:5415 punch from 0x21c88cc to 0x21d779d, (0xeed1 bytes) 2024-09-21T15:10:59.669 INFO:teuthology.orchestra.run.smithi161.stdout:5416 trunc from 0x42b1738 to 0xa5a33a0 2024-09-21T15:10:59.729 INFO:teuthology.orchestra.run.smithi161.stdout:5417 write 0xd5c56af thru 0xd5cef0b (0x985d bytes) 2024-09-21T15:10:59.766 INFO:teuthology.orchestra.run.smithi161.stdout:5418 read 0xc91361a thru 0xc917db8 (0x479f bytes) 2024-09-21T15:10:59.766 INFO:teuthology.orchestra.run.smithi161.stdout:5419 read 0x804de27 thru 0x8058b04 (0xacde bytes) 2024-09-21T15:10:59.778 INFO:teuthology.orchestra.run.smithi161.stdout:5420 trunc from 0xd5cef0c to 0x7b03427 2024-09-21T15:10:59.828 INFO:teuthology.orchestra.run.smithi161.stdout:5421 punch from 0x6ad1e96 to 0x6adb095, (0x91ff bytes) 2024-09-21T15:10:59.835 INFO:teuthology.orchestra.run.smithi161.stdout:5423 trunc from 0x7b03427 to 0x55cd310 2024-09-21T15:10:59.915 INFO:teuthology.orchestra.run.smithi161.stdout:5424 write 0xb3274db thru 0xb32e4a5 (0x6fcb bytes) 2024-09-21T15:10:59.948 INFO:teuthology.orchestra.run.smithi161.stdout:5425 read 0x2976f56 thru 0x2980a34 (0x9adf bytes) 2024-09-21T15:10:59.949 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:10:59.994 INFO:teuthology.orchestra.run.smithi161.stdout:5427 writesame 0xc5ce922 thru 0xc5d4596 data_size 0x1(0x5c75 bytes) 2024-09-21T15:10:59.999 INFO:teuthology.orchestra.run.smithi161.stdout:5428 write 0x2830b46 thru 0x283e103 (0xd5be bytes) 2024-09-21T15:11:00.023 INFO:teuthology.orchestra.run.smithi161.stdout:5429 read 0x83ec31e thru 0x83fa3ec (0xe0cf bytes) 2024-09-21T15:11:00.039 INFO:teuthology.orchestra.run.smithi161.stdout:5430 trunc from 0xc5d4597 to 0x462288e 2024-09-21T15:11:00.104 INFO:teuthology.orchestra.run.smithi161.stdout:5431 read 0x21f0efc thru 0x22000cc (0xf1d1 bytes) 2024-09-21T15:11:00.104 INFO:teuthology.orchestra.run.smithi161.stdout:5433 read 0x3df3880 thru 0x3dfcf95 (0x9716 bytes) 2024-09-21T15:11:00.122 INFO:teuthology.orchestra.run.smithi161.stdout:5435 trunc from 0x462288e to 0xda07fd1 2024-09-21T15:11:00.154 INFO:teuthology.orchestra.run.smithi161.stdout:5436 write 0x82afff4 thru 0x82b5718 (0x5725 bytes) 2024-09-21T15:11:00.190 INFO:teuthology.orchestra.run.smithi161.stdout:5437 write 0x8a53c0 thru 0x8a8254 (0x2e95 bytes) 2024-09-21T15:11:00.198 INFO:teuthology.orchestra.run.smithi161.stdout:5439 clone 54 order 18 su 65536 sc 9 2024-09-21T15:11:01.424 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #52, image image_cluster1.client.mirror.3-clone52 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent53 2024-09-21T15:11:01.589 INFO:teuthology.orchestra.run.smithi161.stdout:5440 read 0x25c9312 thru 0x25d697c (0xd66b bytes) 2024-09-21T15:11:01.620 INFO:teuthology.orchestra.run.smithi161.stdout:5441 read 0x4f89983 thru 0x4f9057a (0x6bf8 bytes) 2024-09-21T15:11:01.621 INFO:teuthology.orchestra.run.smithi161.stdout:5442 write 0xb9ef4c4 thru 0xb9f1f52 (0x2a8f bytes) 2024-09-21T15:11:01.644 INFO:teuthology.orchestra.run.smithi161.stdout:5444 write 0xca7c447 thru 0xca8aa54 (0xe60e bytes) 2024-09-21T15:11:01.673 INFO:teuthology.orchestra.run.smithi161.stdout:5445 read 0x99bf371 thru 0x99c3b72 (0x4802 bytes) 2024-09-21T15:11:01.673 INFO:teuthology.orchestra.run.smithi161.stdout:5446 read 0x57a4207 thru 0x57b39d7 (0xf7d1 bytes) 2024-09-21T15:11:01.674 INFO:teuthology.orchestra.run.smithi161.stdout:5448 read 0x397ea59 thru 0x398b17e (0xc726 bytes) 2024-09-21T15:11:01.675 INFO:teuthology.orchestra.run.smithi161.stdout:5449 write 0x7dbabf1 thru 0x7dbcbde (0x1fee bytes) 2024-09-21T15:11:01.693 INFO:teuthology.orchestra.run.smithi161.stdout:5450 read 0xb88a219 thru 0xb88d9b5 (0x379d bytes) 2024-09-21T15:11:01.693 INFO:teuthology.orchestra.run.smithi161.stdout:5453 punch from 0x23dbac1 to 0x23e1f88, (0x64c7 bytes) 2024-09-21T15:11:01.709 INFO:teuthology.orchestra.run.smithi161.stdout:5455 trunc from 0xda07fd1 to 0x66ac8be 2024-09-21T15:11:01.849 INFO:teuthology.orchestra.run.smithi161.stdout:5456 write 0xc32f76b thru 0xc33f727 (0xffbd bytes) 2024-09-21T15:11:01.874 INFO:teuthology.orchestra.run.smithi161.stdout:5458 read 0xc1afabe thru 0xc1b40c5 (0x4608 bytes) 2024-09-21T15:11:01.874 INFO:teuthology.orchestra.run.smithi161.stdout:5459 punch from 0x8eb40c to 0x8ee2ed, (0x2ee1 bytes) 2024-09-21T15:11:01.875 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:01.875 INFO:teuthology.orchestra.run.smithi161.stdout:5461 write 0x42e4f70 thru 0x42e8c70 (0x3d01 bytes) 2024-09-21T15:11:01.908 INFO:teuthology.orchestra.run.smithi161.stdout:5462 trunc from 0xc33f728 to 0x5b777d1 2024-09-21T15:11:02.011 INFO:teuthology.orchestra.run.smithi161.stdout:5464 writesame 0x4d3a2b8 thru 0x4d41ac9 data_size 0x2f(0x7812 bytes) 2024-09-21T15:11:02.041 INFO:teuthology.orchestra.run.smithi161.stdout:5465 write 0x185cda5 thru 0x1865f0e (0x916a bytes) 2024-09-21T15:11:02.062 INFO:teuthology.orchestra.run.smithi161.stdout:5467 trunc from 0x5b777d1 to 0x74147f8 2024-09-21T15:11:02.102 INFO:teuthology.orchestra.run.smithi161.stdout:5468 punch from 0x1a39b51 to 0x1a39e59, (0x308 bytes) 2024-09-21T15:11:02.102 INFO:teuthology.orchestra.run.smithi161.stdout:5472 read 0x66b5b86 thru 0x66bfc84 (0xa0ff bytes) 2024-09-21T15:11:02.102 INFO:teuthology.orchestra.run.smithi161.stdout:5473 writesame 0x4315662 thru 0x4318bae data_size 0x1(0x354d bytes) 2024-09-21T15:11:02.133 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:02.133 INFO:teuthology.orchestra.run.smithi161.stdout:5475 read 0x5ee48ff thru 0x5ee8583 (0x3c85 bytes) 2024-09-21T15:11:02.133 INFO:teuthology.orchestra.run.smithi161.stdout:5477 read 0x5d2f8a2 thru 0x5d3d001 (0xd760 bytes) 2024-09-21T15:11:02.185 INFO:teuthology.orchestra.run.smithi161.stdout:5478 writesame 0xc42da79 thru 0xc4304b6 data_size 0x1(0x2a3e bytes) 2024-09-21T15:11:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:5479 write 0xc6f89fb thru 0xc6fe3fe (0x5a04 bytes) 2024-09-21T15:11:02.246 INFO:teuthology.orchestra.run.smithi161.stdout:5480 punch from 0x6c00f56 to 0x6c083aa, (0x7454 bytes) 2024-09-21T15:11:02.246 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:02.246 INFO:teuthology.orchestra.run.smithi161.stdout:5482 punch from 0xab95d9d to 0xab9e5b4, (0x8817 bytes) 2024-09-21T15:11:02.247 INFO:teuthology.orchestra.run.smithi161.stdout:5483 writesame 0x70db776 thru 0x70e8352 data_size 0x1(0xcbdd bytes) 2024-09-21T15:11:02.290 INFO:teuthology.orchestra.run.smithi161.stdout:5486 read 0x1b7fdb3 thru 0x1b870b7 (0x7305 bytes) 2024-09-21T15:11:02.292 INFO:teuthology.orchestra.run.smithi161.stdout:5487 trunc from 0xc6fe3ff to 0xcf95083 2024-09-21T15:11:02.333 INFO:teuthology.orchestra.run.smithi161.stdout:5488 read 0x14c01c3 thru 0x14c9597 (0x93d5 bytes) 2024-09-21T15:11:02.334 INFO:teuthology.orchestra.run.smithi161.stdout:5489 read 0x7a2b214 thru 0x7a2f337 (0x4124 bytes) 2024-09-21T15:11:02.358 INFO:teuthology.orchestra.run.smithi161.stdout:5491 trunc from 0xcf95083 to 0x2753b3e 2024-09-21T15:11:02.461 INFO:teuthology.orchestra.run.smithi161.stdout:5492 punch from 0x26b02c9 to 0x26bc992, (0xc6c9 bytes) 2024-09-21T15:11:02.472 INFO:teuthology.orchestra.run.smithi161.stdout:5493 trunc from 0x2753b3e to 0x63dce8f 2024-09-21T15:11:02.544 INFO:teuthology.orchestra.run.smithi161.stdout:5496 writesame 0x6e07703 thru 0x6e16ad0 data_size 0xb(0xf3ce bytes) 2024-09-21T15:11:02.548 INFO:teuthology.orchestra.run.smithi161.stdout:5498 punch from 0x223b16e to 0x2241906, (0x6798 bytes) 2024-09-21T15:11:02.548 INFO:teuthology.orchestra.run.smithi161.stdout:5500 write 0x365586a thru 0x3661628 (0xbdbf bytes) 2024-09-21T15:11:02.572 INFO:teuthology.orchestra.run.smithi161.stdout:5501 write 0x63f64c8 thru 0x63f759a (0x10d3 bytes) 2024-09-21T15:11:02.633 INFO:teuthology.orchestra.run.smithi161.stdout:5502 writesame 0x7419a22 thru 0x7426137 data_size 0x11(0xc716 bytes) 2024-09-21T15:11:02.633 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.0 2024-09-21T15:11:02.633 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Sent signal 15 2024-09-21T15:11:02.634 INFO:tasks.rbd_mirror_thrash:waiting for 6 secs before reviving daemons 2024-09-21T15:11:02.635 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:11:02.634+0000 7f2fd8581700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 (PID: 25661) UID: 1000 2024-09-21T15:11:02.641 INFO:teuthology.orchestra.run.smithi161.stdout:5504 punch from 0x356249b to 0x356338e, (0xef3 bytes) 2024-09-21T15:11:02.694 INFO:teuthology.orchestra.run.smithi161.stdout:5505 write 0x795da26 thru 0x795f4c9 (0x1aa4 bytes) 2024-09-21T15:11:02.706 INFO:teuthology.orchestra.run.smithi161.stdout:5506 read 0x6a100a8 thru 0x6a1965e (0x95b7 bytes) 2024-09-21T15:11:02.706 INFO:teuthology.orchestra.run.smithi161.stdout:5508 read 0x61275db thru 0x6131c6c (0xa692 bytes) 2024-09-21T15:11:02.715 INFO:teuthology.orchestra.run.smithi161.stdout:5509 trunc from 0x795f4ca to 0xaedb5f7 2024-09-21T15:11:02.758 INFO:teuthology.orchestra.run.smithi161.stdout:5510 punch from 0x4181e2f to 0x418a0d0, (0x82a1 bytes) 2024-09-21T15:11:02.758 INFO:teuthology.orchestra.run.smithi161.stdout:5512 write 0x65eac55 thru 0x65f263b (0x79e7 bytes) 2024-09-21T15:11:02.774 INFO:teuthology.orchestra.run.smithi161.stdout:5513 punch from 0x8bd2c37 to 0x8bda257, (0x7620 bytes) 2024-09-21T15:11:02.774 INFO:teuthology.orchestra.run.smithi161.stdout:5514 punch from 0x60db943 to 0x60e2657, (0x6d14 bytes) 2024-09-21T15:11:02.837 INFO:teuthology.orchestra.run.smithi161.stdout:5515 write 0xe46e148 thru 0xe46fd2f (0x1be8 bytes) 2024-09-21T15:11:02.848 INFO:teuthology.orchestra.run.smithi161.stdout:5516 read 0xca2302f thru 0xca2f28c (0xc25e bytes) 2024-09-21T15:11:02.848 INFO:teuthology.orchestra.run.smithi161.stdout:5518 writesame 0x3bcfd85 thru 0x3bd72eb data_size 0x1(0x7567 bytes) 2024-09-21T15:11:02.919 INFO:teuthology.orchestra.run.smithi161.stdout:5519 trunc from 0xe46fd30 to 0x291b1eb 2024-09-21T15:11:02.987 INFO:teuthology.orchestra.run.smithi161.stdout:5520 write 0xf8dabd thru 0xf982aa (0xa7ee bytes) 2024-09-21T15:11:03.061 INFO:teuthology.orchestra.run.smithi161.stdout:5521 writesame 0x6883ec3 thru 0x688868f data_size 0xb(0x47cd bytes) 2024-09-21T15:11:03.106 INFO:teuthology.orchestra.run.smithi161.stdout:5522 write 0x9ebaf69 thru 0x9ebd7f2 (0x288a bytes) 2024-09-21T15:11:03.118 INFO:teuthology.orchestra.run.smithi161.stdout:5523 read 0x4608973 thru 0x460a371 (0x19ff bytes) 2024-09-21T15:11:03.119 INFO:teuthology.orchestra.run.smithi161.stdout:5525 punch from 0x6f4e0b to 0x6f86bb, (0x38b0 bytes) 2024-09-21T15:11:03.119 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:03.119 INFO:teuthology.orchestra.run.smithi161.stdout:5527 write 0x3bb7798 thru 0x3bbc598 (0x4e01 bytes) 2024-09-21T15:11:03.146 INFO:teuthology.orchestra.run.smithi161.stdout:5528 trunc from 0x9ebd7f3 to 0x4b313a9 2024-09-21T15:11:03.199 INFO:teuthology.orchestra.run.smithi161.stdout:5529 read 0x337e54c thru 0x337f13e (0xbf3 bytes) 2024-09-21T15:11:03.199 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:03.199 INFO:teuthology.orchestra.run.smithi161.stdout:5531 read 0xe40194 thru 0xe436fe (0x356b bytes) 2024-09-21T15:11:03.220 INFO:teuthology.orchestra.run.smithi161.stdout:5533 trunc from 0x4b313a9 to 0xe02b176 2024-09-21T15:11:03.253 INFO:teuthology.orchestra.run.smithi161.stdout:5534 writesame 0xdf7ba29 thru 0xdf83058 data_size 0x7a(0x7630 bytes) 2024-09-21T15:11:03.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:03.266+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a1eca000 handle_clone_image: failed to clone image mirror/10b4d9576c9f to image_cluster1.client.mirror.3-clone54 2024-09-21T15:11:03.268 INFO:teuthology.orchestra.run.smithi161.stdout:5535 punch from 0x69c8283 to 0x69d5e4e, (0xdbcb bytes) 2024-09-21T15:11:03.268 INFO:teuthology.orchestra.run.smithi161.stdout:5536 read 0x7185414 thru 0x7191ed2 (0xcabf bytes) 2024-09-21T15:11:03.269 INFO:teuthology.orchestra.run.smithi161.stdout:5537 flatten 2024-09-21T15:11:03.528 INFO:teuthology.orchestra.run.smithi161.stdout:5538 punch from 0x351ff21 to 0x352d0ba, (0xd199 bytes) 2024-09-21T15:11:03.528 INFO:teuthology.orchestra.run.smithi161.stdout:5539 punch from 0x76c9b6e to 0x76ca75c, (0xbee bytes) 2024-09-21T15:11:03.528 INFO:teuthology.orchestra.run.smithi161.stdout:5540 punch from 0x26092ca to 0x260baea, (0x2820 bytes) 2024-09-21T15:11:03.528 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:03.528 INFO:teuthology.orchestra.run.smithi161.stdout:5543 writesame 0xc5788e1 thru 0xc584b6f data_size 0x1(0xc28f bytes) 2024-09-21T15:11:03.577 INFO:teuthology.orchestra.run.smithi161.stdout:5544 punch from 0xb3c138b to 0xb3ceffa, (0xdc6f bytes) 2024-09-21T15:11:03.577 INFO:teuthology.orchestra.run.smithi161.stdout:5545 punch from 0x77bd6d8 to 0x77c9d1d, (0xc645 bytes) 2024-09-21T15:11:03.577 INFO:teuthology.orchestra.run.smithi161.stdout:5546 punch from 0x4a4620e to 0x4a4c347, (0x6139 bytes) 2024-09-21T15:11:03.577 INFO:teuthology.orchestra.run.smithi161.stdout:5547 read 0x3291694 thru 0x329767a (0x5fe7 bytes) 2024-09-21T15:11:03.577 INFO:teuthology.orchestra.run.smithi161.stdout:5548 write 0xcb89cef thru 0xcb8b137 (0x1449 bytes) 2024-09-21T15:11:03.590 INFO:teuthology.orchestra.run.smithi161.stdout:5550 write 0x398a9e7 thru 0x3990250 (0x586a bytes) 2024-09-21T15:11:03.626 INFO:teuthology.orchestra.run.smithi161.stdout:5551 trunc from 0xe02b176 to 0x678adfc 2024-09-21T15:11:03.727 INFO:teuthology.orchestra.run.smithi161.stdout:5552 writesame 0x7637c61 thru 0x763a504 data_size 0x12(0x28a4 bytes) 2024-09-21T15:11:03.732 INFO:teuthology.orchestra.run.smithi161.stdout:5554 read 0x4eeff60 thru 0x4ef35f5 (0x3696 bytes) 2024-09-21T15:11:03.732 INFO:teuthology.orchestra.run.smithi161.stdout:5555 read 0x708419d thru 0x708c8da (0x873e bytes) 2024-09-21T15:11:03.795 INFO:teuthology.orchestra.run.smithi161.stdout:5557 write 0xc90bd02 thru 0xc9137cd (0x7acc bytes) 2024-09-21T15:11:03.816 INFO:teuthology.orchestra.run.smithi161.stdout:5558 read 0xa0d44f7 thru 0xa0d5078 (0xb82 bytes) 2024-09-21T15:11:03.817 INFO:teuthology.orchestra.run.smithi161.stdout:5559 read 0x157784b thru 0x157e897 (0x704d bytes) 2024-09-21T15:11:03.817 INFO:teuthology.orchestra.run.smithi161.stdout:5560 writesame 0x5b60635 thru 0x5b646ca data_size 0x7(0x4096 bytes) 2024-09-21T15:11:03.829 INFO:teuthology.orchestra.run.smithi161.stdout:5561 write 0x461a031 thru 0x4622c12 (0x8be2 bytes) 2024-09-21T15:11:03.850 INFO:teuthology.orchestra.run.smithi161.stdout:5562 read 0x31826cd thru 0x318aa04 (0x8338 bytes) 2024-09-21T15:11:03.850 INFO:teuthology.orchestra.run.smithi161.stdout:5563 write 0x5a18091 thru 0x5a261f9 (0xe169 bytes) 2024-09-21T15:11:03.900 INFO:teuthology.orchestra.run.smithi161.stdout:5564 trunc from 0xc9137ce to 0x6f5b9e 2024-09-21T15:11:04.019 INFO:teuthology.orchestra.run.smithi161.stdout:5565 writesame 0x65e349c thru 0x65edccd data_size 0x1(0xa832 bytes) 2024-09-21T15:11:04.035 INFO:teuthology.orchestra.run.smithi161.stdout:5566 trunc from 0x65edcce to 0xb22ee84 2024-09-21T15:11:04.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.070+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad140 finish: resending after timeout 2024-09-21T15:11:04.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.070+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588b40 finish: resending after timeout 2024-09-21T15:11:04.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.070+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc6c0 finish: resending after timeout 2024-09-21T15:11:04.072 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.070+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0d80 finish: resending after timeout 2024-09-21T15:11:04.072 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.070+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a69c0 finish: resending after timeout 2024-09-21T15:11:04.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.074+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:11:04.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.074+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a6480 finish: resending after timeout 2024-09-21T15:11:04.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.074+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a55206c0 finish: resending after timeout 2024-09-21T15:11:04.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.074+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ab14b680 finish: resending after timeout 2024-09-21T15:11:04.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.074+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bd800 finish: resending after timeout 2024-09-21T15:11:04.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.074+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc300 finish: resending after timeout 2024-09-21T15:11:04.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.074+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43a40 finish: resending after timeout 2024-09-21T15:11:04.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.078+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c420c0 finish: resending after timeout 2024-09-21T15:11:04.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.078+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43140 finish: resending after timeout 2024-09-21T15:11:04.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.078+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e561140 finish: resending after timeout 2024-09-21T15:11:04.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.078+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad9095c0 finish: resending after timeout 2024-09-21T15:11:04.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.078+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59edea6c0 finish: resending after timeout 2024-09-21T15:11:04.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.078+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908fc0 finish: resending after timeout 2024-09-21T15:11:04.080 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:04.080 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:04.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.078+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560540 finish: resending after timeout 2024-09-21T15:11:04.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.082+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909a40 finish: resending after timeout 2024-09-21T15:11:04.082 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.082+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c780 finish: resending after timeout 2024-09-21T15:11:04.082 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.082+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a3de5bc0 finish: resending after timeout 2024-09-21T15:11:04.083 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.082+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0c00 finish: resending after timeout 2024-09-21T15:11:04.120 INFO:teuthology.orchestra.run.smithi161.stdout:5571 writesame 0xe497b9d thru 0xe4a538d data_size 0x1(0xd7f1 bytes) 2024-09-21T15:11:04.125 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:04.125 INFO:teuthology.orchestra.run.smithi161.stdout:5573 write 0x6a194bb thru 0x6a200cf (0x6c15 bytes) 2024-09-21T15:11:04.143 INFO:teuthology.orchestra.run.smithi161.stdout:5574 punch from 0xc41087d to 0xc41899b, (0x811e bytes) 2024-09-21T15:11:04.144 INFO:teuthology.orchestra.run.smithi161.stdout:5575 trunc from 0xe4a538e to 0xde5382a 2024-09-21T15:11:04.181 INFO:teuthology.orchestra.run.smithi161.stdout:5576 punch from 0x9884d88 to 0x98862f6, (0x156e bytes) 2024-09-21T15:11:04.182 INFO:teuthology.orchestra.run.smithi161.stdout:5578 writesame 0xaa9623 thru 0xab67e7 data_size 0x1(0xd1c5 bytes) 2024-09-21T15:11:04.228 INFO:teuthology.orchestra.run.smithi161.stdout:5580 punch from 0x5a7f6d to 0x5aa5ea, (0x267d bytes) 2024-09-21T15:11:04.228 INFO:teuthology.orchestra.run.smithi161.stdout:5581 writesame 0xb812c6e thru 0xb821382 data_size 0x3f(0xe715 bytes) 2024-09-21T15:11:04.242 INFO:teuthology.orchestra.run.smithi161.stdout:5582 writesame 0x70070c0 thru 0x7008587 data_size 0x38(0x14c8 bytes) 2024-09-21T15:11:04.255 INFO:teuthology.orchestra.run.smithi161.stdout:5583 read 0x70c18f thru 0x71120c (0x507e bytes) 2024-09-21T15:11:04.255 INFO:teuthology.orchestra.run.smithi161.stdout:5584 punch from 0x706cb88 to 0x706cfab, (0x423 bytes) 2024-09-21T15:11:04.255 INFO:teuthology.orchestra.run.smithi161.stdout:5585 write 0x8a18e9b thru 0x8a28cec (0xfe52 bytes) 2024-09-21T15:11:04.275 INFO:teuthology.orchestra.run.smithi161.stdout:5586 writesame 0x935fc7e thru 0x936d8f3 data_size 0x1(0xdc76 bytes) 2024-09-21T15:11:04.285 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.282+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b18c0 finish: resending after timeout 2024-09-21T15:11:04.333 INFO:teuthology.orchestra.run.smithi161.stdout:5587 read 0x2d313e6 thru 0x2d332c9 (0x1ee4 bytes) 2024-09-21T15:11:04.333 INFO:teuthology.orchestra.run.smithi161.stdout:5588 writesame 0x125913a thru 0x125d32c data_size 0x1(0x41f3 bytes) 2024-09-21T15:11:04.356 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:04.356 INFO:teuthology.orchestra.run.smithi161.stdout:5590 punch from 0xc65328b to 0xc658458, (0x51cd bytes) 2024-09-21T15:11:04.356 INFO:teuthology.orchestra.run.smithi161.stdout:5591 read 0x73ac8f0 thru 0x73bb94f (0xf060 bytes) 2024-09-21T15:11:04.357 INFO:teuthology.orchestra.run.smithi161.stdout:5592 punch from 0x8c235bc to 0x8c31d51, (0xe795 bytes) 2024-09-21T15:11:04.367 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.366+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cadec0 finish: resending after timeout 2024-09-21T15:11:04.375 INFO:teuthology.orchestra.run.smithi161.stdout:5594 trunc from 0xde5382a to 0x69576d4 2024-09-21T15:11:04.432 INFO:teuthology.orchestra.run.smithi161.stdout:5597 write 0x2f69270 thru 0x2f70066 (0x6df7 bytes) 2024-09-21T15:11:04.452 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.450+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e618fc0 finish: resending after timeout 2024-09-21T15:11:04.452 INFO:teuthology.orchestra.run.smithi161.stdout:5603 read 0x3b3c067 thru 0x3b494a3 (0xd43d bytes) 2024-09-21T15:11:04.452 INFO:teuthology.orchestra.run.smithi161.stdout:5605 read 0x47edc66 thru 0x47efc78 (0x2013 bytes) 2024-09-21T15:11:04.500 INFO:teuthology.orchestra.run.smithi161.stdout:5608 write 0x910b4ee thru 0x9111399 (0x5eac bytes) 2024-09-21T15:11:04.521 INFO:teuthology.orchestra.run.smithi161.stdout:5609 read 0x37c4000 thru 0x37d15fd (0xd5fe bytes) 2024-09-21T15:11:04.523 INFO:teuthology.orchestra.run.smithi161.stdout:5610 trunc from 0x911139a to 0x8687dbd 2024-09-21T15:11:04.525 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.526+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1fbc0 finish: resending after timeout 2024-09-21T15:11:04.531 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.530+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461ec0 finish: resending after timeout 2024-09-21T15:11:04.562 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.562+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43980 finish: resending after timeout 2024-09-21T15:11:04.576 INFO:teuthology.orchestra.run.smithi161.stdout:5611 read 0x5fa4cc2 thru 0x5fac9e5 (0x7d24 bytes) 2024-09-21T15:11:04.576 INFO:teuthology.orchestra.run.smithi161.stdout:5612 read 0x7759cfc thru 0x77652e7 (0xb5ec bytes) 2024-09-21T15:11:04.591 INFO:teuthology.orchestra.run.smithi161.stdout:5613 trunc from 0x8687dbd to 0x1d5d893 2024-09-21T15:11:04.616 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.614+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae988300 finish: resending after timeout 2024-09-21T15:11:04.646 INFO:teuthology.orchestra.run.smithi161.stdout:5614 trunc from 0x1d5d893 to 0x3489ff8 2024-09-21T15:11:04.683 INFO:teuthology.orchestra.run.smithi161.stdout:5615 read 0x328a486 thru 0x3292e6c (0x89e7 bytes) 2024-09-21T15:11:04.683 INFO:teuthology.orchestra.run.smithi161.stdout:5616 write 0x2719b40 thru 0x2719c3c (0xfd bytes) 2024-09-21T15:11:04.697 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:04.697 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:04.704 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.702+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61e840 finish: resending after timeout 2024-09-21T15:11:04.738 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.738+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9bc80 finish: resending after timeout 2024-09-21T15:11:04.741 INFO:teuthology.orchestra.run.smithi161.stdout:5620 write 0x41659a4 thru 0x416a65e (0x4cbb bytes) 2024-09-21T15:11:04.760 INFO:teuthology.orchestra.run.smithi161.stdout:5624 write 0x8cf268 thru 0x8d9b60 (0xa8f9 bytes) 2024-09-21T15:11:04.799 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:04.798+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f380 finish: resending after timeout 2024-09-21T15:11:04.830 INFO:teuthology.orchestra.run.smithi161.stdout:5625 write 0x5f7bc09 thru 0x5f7cefe (0x12f6 bytes) 2024-09-21T15:11:04.893 INFO:teuthology.orchestra.run.smithi161.stdout:5626 write 0x64feb82 thru 0x650b0c6 (0xc545 bytes) 2024-09-21T15:11:04.921 INFO:teuthology.orchestra.run.smithi161.stdout:5627 trunc from 0x650b0c7 to 0xb2f011f 2024-09-21T15:11:04.960 INFO:teuthology.orchestra.run.smithi161.stdout:5628 punch from 0xaa0be75 to 0xaa18962, (0xcaed bytes) 2024-09-21T15:11:04.960 INFO:teuthology.orchestra.run.smithi161.stdout:5629 write 0x9a0165d thru 0x9a04836 (0x31da bytes) 2024-09-21T15:11:04.974 INFO:teuthology.orchestra.run.smithi161.stdout:5630 read 0x3b27f7e thru 0x3b2cc44 (0x4cc7 bytes) 2024-09-21T15:11:04.974 INFO:teuthology.orchestra.run.smithi161.stdout:5631 write 0x6c0acc2 thru 0x6c154c3 (0xa802 bytes) 2024-09-21T15:11:05.052 INFO:teuthology.orchestra.run.smithi161.stdout:5632 writesame 0xe343726 thru 0xe3525af data_size 0x13(0xee8a bytes) 2024-09-21T15:11:05.059 INFO:teuthology.orchestra.run.smithi161.stdout:5633 punch from 0x5bd9f2d to 0x5bda76a, (0x83d bytes) 2024-09-21T15:11:05.059 INFO:teuthology.orchestra.run.smithi161.stdout:5634 read 0xa1dde7c thru 0xa1e63c6 (0x854b bytes) 2024-09-21T15:11:05.059 INFO:teuthology.orchestra.run.smithi161.stdout:5635 punch from 0x7d9f9c5 to 0x7daa1ce, (0xa809 bytes) 2024-09-21T15:11:05.059 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:05.059 INFO:teuthology.orchestra.run.smithi161.stdout:5637 punch from 0xe3002c6 to 0xe304a58, (0x4792 bytes) 2024-09-21T15:11:05.070 INFO:teuthology.orchestra.run.smithi161.stdout:5638 trunc from 0xe3525b0 to 0x965b3b4 2024-09-21T15:11:05.135 INFO:teuthology.orchestra.run.smithi161.stdout:5639 read 0x65d201d thru 0x65daf34 (0x8f18 bytes) 2024-09-21T15:11:05.135 INFO:teuthology.orchestra.run.smithi161.stdout:5641 read 0x417e7ba thru 0x4182228 (0x3a6f bytes) 2024-09-21T15:11:05.135 INFO:teuthology.orchestra.run.smithi161.stdout:5642 read 0x3810be5 thru 0x381c8e6 (0xbd02 bytes) 2024-09-21T15:11:05.136 INFO:teuthology.orchestra.run.smithi161.stdout:5643 read 0x355e18f thru 0x3562178 (0x3fea bytes) 2024-09-21T15:11:05.136 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:05.136 INFO:teuthology.orchestra.run.smithi161.stdout:5646 read 0x4d18f2 thru 0x4d5760 (0x3e6f bytes) 2024-09-21T15:11:05.136 INFO:teuthology.orchestra.run.smithi161.stdout:5647 write 0x90a7be5 thru 0x90aceaa (0x52c6 bytes) 2024-09-21T15:11:05.157 INFO:teuthology.orchestra.run.smithi161.stdout:5648 read 0x7ce4853 thru 0x7cee8b2 (0xa060 bytes) 2024-09-21T15:11:05.157 INFO:teuthology.orchestra.run.smithi161.stdout:5649 write 0x483f4b thru 0x488144 (0x41fa bytes) 2024-09-21T15:11:05.175 INFO:teuthology.orchestra.run.smithi161.stdout:5650 punch from 0xa10fe7 to 0xa16813, (0x582c bytes) 2024-09-21T15:11:05.175 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:05.175 INFO:teuthology.orchestra.run.smithi161.stdout:5653 read 0x597981c thru 0x597b743 (0x1f28 bytes) 2024-09-21T15:11:05.175 INFO:teuthology.orchestra.run.smithi161.stdout:5654 write 0x29de4f7 thru 0x29ebeec (0xd9f6 bytes) 2024-09-21T15:11:05.203 INFO:teuthology.orchestra.run.smithi161.stdout:5655 trunc from 0x965b3b4 to 0x9cbcb6d 2024-09-21T15:11:05.242 INFO:teuthology.orchestra.run.smithi161.stdout:5656 read 0x6f97880 thru 0x6f9cfef (0x5770 bytes) 2024-09-21T15:11:05.242 INFO:teuthology.orchestra.run.smithi161.stdout:5658 read 0x1700ee0 thru 0x170cb82 (0xbca3 bytes) 2024-09-21T15:11:05.242 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:05.242 INFO:teuthology.orchestra.run.smithi161.stdout:5660 read 0x1806f49 thru 0x1816830 (0xf8e8 bytes) 2024-09-21T15:11:05.242 INFO:teuthology.orchestra.run.smithi161.stdout:5661 read 0x7897486 thru 0x789ec97 (0x7812 bytes) 2024-09-21T15:11:05.243 INFO:teuthology.orchestra.run.smithi161.stdout:5662 clone 55 order 20 su 16384 sc 3 2024-09-21T15:11:06.280 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #53, image image_cluster1.client.mirror.3-clone53 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent54 2024-09-21T15:11:06.847 INFO:teuthology.orchestra.run.smithi161.stdout:5663 write 0xbcff63e thru 0xbd05dc8 (0x678b bytes) 2024-09-21T15:11:06.927 INFO:teuthology.orchestra.run.smithi161.stdout:5665 write 0x1266876 thru 0x126e1cb (0x7956 bytes) 2024-09-21T15:11:06.971 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:06.972 INFO:teuthology.orchestra.run.smithi161.stdout:5667 read 0x421f737 thru 0x4228ae3 (0x93ad bytes) 2024-09-21T15:11:06.972 INFO:teuthology.orchestra.run.smithi161.stdout:5668 writesame 0x2718ad thru 0x27aeff data_size 0x1(0x9653 bytes) 2024-09-21T15:11:07.034 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.034+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce9458280 [3/96bdba02-bf8c-4de9-8b36-c42ccdad5cf0] start: already running 2024-09-21T15:11:07.734 INFO:teuthology.orchestra.run.smithi161.stdout:5669 write 0x68ad0e1 thru 0x68b5b81 (0x8aa1 bytes) 2024-09-21T15:11:07.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce9459400 [3/9c634cdf-a6f6-482b-a85c-0d163bc3d079] start: already running 2024-09-21T15:11:07.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce9458500 [3/96f7130e-627f-496e-8a7c-886f81d92e20] start: already running 2024-09-21T15:11:07.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce94c0000 [3/ab9322e9-f0d3-4e57-ba54-faf9cbd16ee7] start: already running 2024-09-21T15:11:07.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce94c0280 [3/ace09410-303f-4cc6-8fa7-c5190a4c62e6] start: already running 2024-09-21T15:11:07.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce94c0280 [3/ace09410-303f-4cc6-8fa7-c5190a4c62e6] start: already running 2024-09-21T15:11:07.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce94c1180 [3/b0959eb5-273e-4f52-8a00-24247f1f87d2] start: already running 2024-09-21T15:11:07.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce94c1180 [3/b0959eb5-273e-4f52-8a00-24247f1f87d2] start: already running 2024-09-21T15:11:07.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce94c1900 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:11:07.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce94c1900 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:11:07.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4780 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:11:07.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4780 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:11:07.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce9520280 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:11:07.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce9520280 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:11:07.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4a00 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:11:07.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4a00 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:11:07.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce9520a00 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:11:07.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.054+0000 7f8d31ddc700 -1 rbd::mirror::ImageReplayer: 0x55bce9520a00 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:11:07.736 INFO:teuthology.orchestra.run.smithi161.stdout:5670 write 0xa83d20d thru 0xa84801f (0xae13 bytes) 2024-09-21T15:11:07.738 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9482280 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:11:07.738 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9459b80 [3/a15513b2-9cf9-4c80-b9b1-ea6973791935] start: already running 2024-09-21T15:11:07.738 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9521b80 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:11:07.738 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce93ebb80 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] start: already running 2024-09-21T15:11:07.738 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9458a00 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:11:07.738 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9458780 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:11:07.738 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9458000 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:11:07.738 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9458c80 [3/9899b7e1-7c24-4bdd-b213-241bfd0956fd] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9459900 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce92b7680 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9458f00 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce92b7400 [3/a88a0c18-875d-4624-b7df-602dca14305c] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce92b7900 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c0780 [3/af962aab-237c-497b-989c-5a6f03523f73] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c0780 [3/af962aab-237c-497b-989c-5a6f03523f73] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c0500 [3/af7bb590-faa2-4f57-80f6-c5ab02216567] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c0500 [3/af7bb590-faa2-4f57-80f6-c5ab02216567] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce92b7b80 [3/ab585917-bbfb-41ce-a268-5e9596e12ef3] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce92b7180 [3/a886c6ec-95d5-4bec-95d6-90b535ab9694] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c0a00 [3/afce2605-a8db-416c-a324-7471613e476c] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c0a00 [3/afce2605-a8db-416c-a324-7471613e476c] start: already running 2024-09-21T15:11:07.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9459680 [3/9f1ae171-c261-402d-a90a-2b4cca77a51c] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c0c80 [3/aff5f3bc-3e8e-4a66-b089-b2f57573290a] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c0c80 [3/aff5f3bc-3e8e-4a66-b089-b2f57573290a] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c0f00 [3/b0925bf1-5012-45a2-afe9-91608ced3c6a] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c0f00 [3/b0925bf1-5012-45a2-afe9-91608ced3c6a] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c1680 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c1680 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9482000 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4000 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4000 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4f00 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4f00 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9520000 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9520000 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:11:07.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9520c80 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4c80 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4c80 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c1b80 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c1b80 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9520780 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9520780 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9521180 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9521400 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9521900 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.074+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9520f00 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.082+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e5180 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.082+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e5180 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.082+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c1400 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.082+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94c1400 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:11:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.082+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e5400 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:11:07.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.082+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e5400 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:11:07.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.082+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4500 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:11:07.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.082+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4500 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:11:07.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.082+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e5900 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:11:07.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.082+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce94e5900 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:11:07.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.082+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9521680 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:11:07.742 INFO:teuthology.orchestra.run.smithi161.stdout:5671 writesame 0x71dfe09 thru 0x71e13e7 data_size 0x1(0x15df bytes) 2024-09-21T15:11:07.743 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.102+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce9459180 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:11:07.743 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.102+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce9459180 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:11:07.743 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.102+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce94e5b80 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:11:07.743 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.102+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce94e5b80 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:11:07.743 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.102+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce94e5b80 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:11:07.744 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.102+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4280 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:11:07.744 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.102+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4280 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:11:07.744 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.102+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce94e4280 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:11:07.744 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.102+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce9520500 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:11:07.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.102+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce9520500 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:11:07.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.102+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce94e5680 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:11:07.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.102+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce94e5680 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:11:07.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.102+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce94e5680 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:11:07.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.110+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce95c6f00 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:11:07.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.122+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce9483900 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:11:07.745 INFO:teuthology.orchestra.run.smithi161.stdout:5672 trunc from 0xbd05dc9 to 0x8819aec 2024-09-21T15:11:07.746 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.186+0000 7f8d315db700 -1 rbd::mirror::ImageReplayer: 0x55bce9520c80 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:11:07.746 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.202+0000 7f8d3edf6700 -1 rbd::mirror::ImageReplayer: 0x55bce8aca280 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:11:07.746 INFO:teuthology.orchestra.run.smithi161.stdout:5673 read 0x831b2c3 thru 0x8329f80 (0xecbe bytes) 2024-09-21T15:11:07.746 INFO:teuthology.orchestra.run.smithi161.stdout:5674 read 0xdf7100 thru 0xdf77c8 (0x6c9 bytes) 2024-09-21T15:11:07.746 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:07.747 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:07.206+0000 7ff753f07700 -1 reset not still connected to 0x5601694015f0 2024-09-21T15:11:07.747 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:07.206+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e36c0 2024-09-21T15:11:07.747 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.222+0000 7f8d3e5f5700 -1 rbd::mirror::ImageReplayer: 0x55bce8aca000 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:11:07.747 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:11:07.222+0000 7f8d3e5f5700 -1 rbd::mirror::ImageReplayer: 0x55bce9639680 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:11:07.749 INFO:teuthology.orchestra.run.smithi161.stdout:5676 write 0x9482a1d thru 0x9488de5 (0x63c9 bytes) 2024-09-21T15:11:07.749 INFO:teuthology.orchestra.run.smithi161.stdout:5679 punch from 0x486e4cc to 0x4879f18, (0xba4c bytes) 2024-09-21T15:11:07.749 INFO:teuthology.orchestra.run.smithi161.stdout:5680 punch from 0x7d4d85a to 0x7d51364, (0x3b0a bytes) 2024-09-21T15:11:07.749 INFO:teuthology.orchestra.run.smithi161.stdout:5681 flatten 2024-09-21T15:11:07.749 INFO:teuthology.orchestra.run.smithi161.stdout:5682 write 0xbb153ab thru 0xbb174f3 (0x2149 bytes) 2024-09-21T15:11:07.749 INFO:teuthology.orchestra.run.smithi161.stdout:5683 trunc from 0xbb174f4 to 0x8fb900b 2024-09-21T15:11:07.749 INFO:teuthology.orchestra.run.smithi161.stdout:5685 trunc from 0x8fb900b to 0x6e82c01 2024-09-21T15:11:07.749 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:07.749 INFO:teuthology.orchestra.run.smithi161.stdout:5687 read 0x1c7367c thru 0x1c78751 (0x50d6 bytes) 2024-09-21T15:11:07.749 INFO:teuthology.orchestra.run.smithi161.stdout:5689 writesame 0xc2d6a20 thru 0xc2e016b data_size 0x4(0x974c bytes) 2024-09-21T15:11:07.750 INFO:teuthology.orchestra.run.smithi161.stdout:5690 punch from 0x6930a32 to 0x6931d56, (0x1324 bytes) 2024-09-21T15:11:07.750 INFO:teuthology.orchestra.run.smithi161.stdout:5691 trunc from 0xc2e016c to 0xb9cde46 2024-09-21T15:11:07.750 INFO:teuthology.orchestra.run.smithi161.stdout:5692 write 0x217eb27 thru 0x217fef0 (0x13ca bytes) 2024-09-21T15:11:07.750 INFO:teuthology.orchestra.run.smithi161.stdout:5694 read 0x7fa66cb thru 0x7fb0baa (0xa4e0 bytes) 2024-09-21T15:11:07.750 INFO:teuthology.orchestra.run.smithi161.stdout:5695 write 0x4f8978e thru 0x4f91e11 (0x8684 bytes) 2024-09-21T15:11:07.750 INFO:teuthology.orchestra.run.smithi161.stdout:5696 punch from 0x4a33312 to 0x4a3cf65, (0x9c53 bytes) 2024-09-21T15:11:07.750 INFO:teuthology.orchestra.run.smithi161.stdout:5697 writesame 0x700bb2e thru 0x700fca8 data_size 0x1(0x417b bytes) 2024-09-21T15:11:07.786 INFO:teuthology.orchestra.run.smithi161.stdout:5698 write 0xd86cd67 thru 0xd87ba76 (0xed10 bytes) 2024-09-21T15:11:07.833 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:07.860 INFO:teuthology.orchestra.run.smithi161.stdout:5700 trunc from 0xd87ba77 to 0x294eed 2024-09-21T15:11:07.975 INFO:teuthology.orchestra.run.smithi161.stdout:5701 write 0x1624f9d thru 0x162e5dc (0x9640 bytes) 2024-09-21T15:11:08.065 INFO:teuthology.orchestra.run.smithi161.stdout:5702 write 0xc42a149 thru 0xc438a4f (0xe907 bytes) 2024-09-21T15:11:08.093 INFO:teuthology.orchestra.run.smithi161.stdout:5704 punch from 0x3af1751 to 0x3afad1a, (0x95c9 bytes) 2024-09-21T15:11:08.093 INFO:teuthology.orchestra.run.smithi161.stdout:5705 read 0x9684779 thru 0x968cd7a (0x8602 bytes) 2024-09-21T15:11:08.093 INFO:teuthology.orchestra.run.smithi161.stdout:5707 write 0x1c6258d thru 0x1c65312 (0x2d86 bytes) 2024-09-21T15:11:08.111 INFO:teuthology.orchestra.run.smithi161.stdout:5708 write 0x7d955ae thru 0x7d9f119 (0x9b6c bytes) 2024-09-21T15:11:08.129 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:08.130 INFO:teuthology.orchestra.run.smithi161.stdout:5712 read 0x933bc78 thru 0x934aed0 (0xf259 bytes) 2024-09-21T15:11:08.130 INFO:teuthology.orchestra.run.smithi161.stdout:5713 read 0x7913cfa thru 0x79161f3 (0x24fa bytes) 2024-09-21T15:11:08.130 INFO:teuthology.orchestra.run.smithi161.stdout:5715 writesame 0x97d223d thru 0x97d6496 data_size 0x39(0x425a bytes) 2024-09-21T15:11:08.143 INFO:teuthology.orchestra.run.smithi161.stdout:5716 write 0x5959ae4 thru 0x5968da2 (0xf2bf bytes) 2024-09-21T15:11:08.176 INFO:teuthology.orchestra.run.smithi161.stdout:5718 write 0x4ed516e thru 0x4ee3ed8 (0xed6b bytes) 2024-09-21T15:11:08.203 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:08.203 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:08.210 INFO:teuthology.orchestra.run.smithi161.stdout:5722 trunc from 0xc438a50 to 0x9086b21 2024-09-21T15:11:08.264 INFO:teuthology.orchestra.run.smithi161.stdout:5724 write 0x1cbaeb0 thru 0x1cc1f53 (0x70a4 bytes) 2024-09-21T15:11:08.334 INFO:teuthology.orchestra.run.smithi161.stdout:5727 writesame 0xd9a62b9 thru 0xd9b4065 data_size 0x4d(0xddad bytes) 2024-09-21T15:11:08.339 INFO:teuthology.orchestra.run.smithi161.stdout:5728 write 0x5de2785 thru 0x5de4c5c (0x24d8 bytes) 2024-09-21T15:11:08.360 INFO:teuthology.orchestra.run.smithi161.stdout:5730 read 0x7cb197a thru 0x7cc0d85 (0xf40c bytes) 2024-09-21T15:11:08.361 INFO:teuthology.orchestra.run.smithi161.stdout:5732 punch from 0x1119487 to 0x111c847, (0x33c0 bytes) 2024-09-21T15:11:08.361 INFO:teuthology.orchestra.run.smithi161.stdout:5733 writesame 0x3bc1c02 thru 0x3bd0775 data_size 0x6(0xeb74 bytes) 2024-09-21T15:11:08.389 INFO:teuthology.orchestra.run.smithi161.stdout:5734 writesame 0x1c93eaa thru 0x1c9b2c2 data_size 0x1(0x7419 bytes) 2024-09-21T15:11:08.413 INFO:teuthology.orchestra.run.smithi161.stdout:5736 write 0x6a7c786 thru 0x6a82eed (0x6768 bytes) 2024-09-21T15:11:08.429 INFO:teuthology.orchestra.run.smithi161.stdout:5737 punch from 0x92fedf5 to 0x930d354, (0xe55f bytes) 2024-09-21T15:11:08.430 INFO:teuthology.orchestra.run.smithi161.stdout:5738 read 0x5539360 thru 0x5540398 (0x7039 bytes) 2024-09-21T15:11:08.430 INFO:teuthology.orchestra.run.smithi161.stdout:5739 read 0x4e0bcb7 thru 0x4e11d16 (0x6060 bytes) 2024-09-21T15:11:08.431 INFO:teuthology.orchestra.run.smithi161.stdout:5742 read 0xbeb4ae9 thru 0xbec47d2 (0xfcea bytes) 2024-09-21T15:11:08.431 INFO:teuthology.orchestra.run.smithi161.stdout:5743 writesame 0xc2e81bd thru 0xc2f463a data_size 0x7(0xc47e bytes) 2024-09-21T15:11:08.453 INFO:teuthology.orchestra.run.smithi161.stdout:5745 punch from 0xb40cf3a to 0xb418a63, (0xbb29 bytes) 2024-09-21T15:11:08.473 INFO:teuthology.orchestra.run.smithi161.stdout:5746 trunc from 0xd9b4066 to 0x4e18de4 2024-09-21T15:11:08.546 INFO:teuthology.orchestra.run.smithi161.stdout:5748 read 0x1223ace thru 0x1229885 (0x5db8 bytes) 2024-09-21T15:11:08.546 INFO:teuthology.orchestra.run.smithi161.stdout:5749 read 0x23fb706 thru 0x240b68c (0xff87 bytes) 2024-09-21T15:11:08.603 INFO:teuthology.orchestra.run.smithi161.stdout:5750 write 0xdf84d0f thru 0xdf92246 (0xd538 bytes) 2024-09-21T15:11:08.627 INFO:teuthology.orchestra.run.smithi161.stdout:5752 clone 56 order 21 su 8192 sc 6 2024-09-21T15:11:08.634 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.0 2024-09-21T15:11:08.635 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:11:08.635 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.0 2024-09-21T15:11:08.635 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Restarting daemon 2024-09-21T15:11:08.635 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 2024-09-21T15:11:08.637 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Started 2024-09-21T15:11:08.637 INFO:tasks.rbd_mirror_thrash:waiting for 94 secs before thrashing 2024-09-21T15:11:09.345 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #54, image image_cluster1.client.mirror.3-clone54 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent55 2024-09-21T15:11:09.700 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:09.700 INFO:teuthology.orchestra.run.smithi161.stdout:5756 read 0x664c918 thru 0x6655822 (0x8f0b bytes) 2024-09-21T15:11:09.737 INFO:teuthology.orchestra.run.smithi161.stdout:5757 write 0x9f02d7a thru 0x9f08102 (0x5389 bytes) 2024-09-21T15:11:09.771 INFO:teuthology.orchestra.run.smithi161.stdout:5759 punch from 0xd400c18 to 0xd406b52, (0x5f3a bytes) 2024-09-21T15:11:09.771 INFO:teuthology.orchestra.run.smithi161.stdout:5760 writesame 0x51b1388 thru 0x51b26e6 data_size 0x1d(0x135f bytes) 2024-09-21T15:11:09.821 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:09.821 INFO:teuthology.orchestra.run.smithi161.stdout:5763 punch from 0xd10a10c to 0xd10f012, (0x4f06 bytes) 2024-09-21T15:11:09.821 INFO:teuthology.orchestra.run.smithi161.stdout:5764 read 0xc9ee9e thru 0xca4268 (0x53cb bytes) 2024-09-21T15:11:09.821 INFO:teuthology.orchestra.run.smithi161.stdout:5765 write 0x4c0e947 thru 0x4c135dc (0x4c96 bytes) 2024-09-21T15:11:09.853 INFO:teuthology.orchestra.run.smithi161.stdout:5766 write 0x6d4447f thru 0x6d4d80b (0x938d bytes) 2024-09-21T15:11:09.900 INFO:teuthology.orchestra.run.smithi161.stdout:5767 punch from 0x6ecb550 to 0x6ecf477, (0x3f27 bytes) 2024-09-21T15:11:09.900 INFO:teuthology.orchestra.run.smithi161.stdout:5768 read 0xce2304d thru 0xce28c9a (0x5c4e bytes) 2024-09-21T15:11:09.900 INFO:teuthology.orchestra.run.smithi161.stdout:5769 writesame 0x8302ee thru 0x83f8b3 data_size 0x2(0xf5c6 bytes) 2024-09-21T15:11:10.022 INFO:teuthology.orchestra.run.smithi161.stdout:5770 trunc from 0xdf92247 to 0x6b1c214 2024-09-21T15:11:10.115 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:10.155 INFO:teuthology.orchestra.run.smithi161.stdout:5774 write 0x8d9c2c8 thru 0x8da067d (0x43b6 bytes) 2024-09-21T15:11:10.180 INFO:teuthology.orchestra.run.smithi161.stdout:5775 punch from 0x6565342 to 0x6569606, (0x42c4 bytes) 2024-09-21T15:11:10.180 INFO:teuthology.orchestra.run.smithi161.stdout:5777 write 0x474fab1 thru 0x4757133 (0x7683 bytes) 2024-09-21T15:11:10.226 INFO:teuthology.orchestra.run.smithi161.stdout:5778 read 0x2563379 thru 0x2567dce (0x4a56 bytes) 2024-09-21T15:11:10.226 INFO:teuthology.orchestra.run.smithi161.stdout:5779 read 0x60d2e49 thru 0x60dfa92 (0xcc4a bytes) 2024-09-21T15:11:10.232 INFO:teuthology.orchestra.run.smithi161.stdout:5781 trunc from 0x8da067e to 0xb21c203 2024-09-21T15:11:10.286 INFO:teuthology.orchestra.run.smithi161.stdout:5782 trunc from 0xb21c203 to 0x5fc2457 2024-09-21T15:11:10.379 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:10.379 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:10.391 INFO:teuthology.orchestra.run.smithi161.stdout:5787 trunc from 0x5fc2457 to 0xb1e6dd3 2024-09-21T15:11:10.425 INFO:teuthology.orchestra.run.smithi161.stdout:5788 read 0x1df8cba thru 0x1e02047 (0x938e bytes) 2024-09-21T15:11:10.470 INFO:teuthology.orchestra.run.smithi161.stdout:5789 write 0xd39ab59 thru 0xd3a2cda (0x8182 bytes) 2024-09-21T15:11:10.501 INFO:teuthology.orchestra.run.smithi161.stdout:5791 punch from 0xb9c3160 to 0xb9d0673, (0xd513 bytes) 2024-09-21T15:11:10.501 INFO:teuthology.orchestra.run.smithi161.stdout:5792 writesame 0xcac57e3 thru 0xcad1002 data_size 0x30(0xb820 bytes) 2024-09-21T15:11:10.531 INFO:teuthology.orchestra.run.smithi161.stdout:5795 punch from 0xa881888 to 0xa88b27f, (0x99f7 bytes) 2024-09-21T15:11:10.532 INFO:teuthology.orchestra.run.smithi161.stdout:5796 writesame 0xa214786 thru 0xa21daf0 data_size 0x1(0x936b bytes) 2024-09-21T15:11:10.568 INFO:teuthology.orchestra.run.smithi161.stdout:5797 write 0x3eb5f2a thru 0x3eb90b9 (0x3190 bytes) 2024-09-21T15:11:10.588 INFO:teuthology.orchestra.run.smithi161.stdout:5798 read 0x69c104c thru 0x69c5f24 (0x4ed9 bytes) 2024-09-21T15:11:10.592 INFO:teuthology.orchestra.run.smithi161.stdout:5800 trunc from 0xd3a2cdb to 0xb5cf53c 2024-09-21T15:11:10.651 INFO:teuthology.orchestra.run.smithi161.stdout:5801 write 0x55fda24 thru 0x55ff486 (0x1a63 bytes) 2024-09-21T15:11:10.679 INFO:teuthology.orchestra.run.smithi161.stdout:5803 trunc from 0xb5cf53c to 0x32949be 2024-09-21T15:11:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:5805 read 0x288129a thru 0x2883fad (0x2d14 bytes) 2024-09-21T15:11:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:5806 punch from 0x1c91da9 to 0x1c92712, (0x969 bytes) 2024-09-21T15:11:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:5807 read 0x840c94 thru 0x84ce84 (0xc1f1 bytes) 2024-09-21T15:11:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:5808 punch from 0x802e6c to 0x805a2c, (0x2bc0 bytes) 2024-09-21T15:11:10.802 INFO:teuthology.orchestra.run.smithi161.stdout:5809 read 0x10f5252 thru 0x10f9acc (0x487b bytes) 2024-09-21T15:11:10.803 INFO:teuthology.orchestra.run.smithi161.stdout:5812 read 0x2d5e55 thru 0x2e36ab (0xd857 bytes) 2024-09-21T15:11:10.861 INFO:teuthology.orchestra.run.smithi161.stdout:5813 write 0xe0fe647 thru 0xe109402 (0xadbc bytes) 2024-09-21T15:11:10.900 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:10.900 INFO:teuthology.orchestra.run.smithi161.stdout:5816 write 0x71bccfa thru 0x71cc2a8 (0xf5af bytes) 2024-09-21T15:11:10.919 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.917+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad140 finish: resending after timeout 2024-09-21T15:11:10.919 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.917+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588b40 finish: resending after timeout 2024-09-21T15:11:10.920 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.917+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0d80 finish: resending after timeout 2024-09-21T15:11:10.920 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.917+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a69c0 finish: resending after timeout 2024-09-21T15:11:10.920 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.917+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:11:10.923 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.921+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a6480 finish: resending after timeout 2024-09-21T15:11:10.923 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.921+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a55206c0 finish: resending after timeout 2024-09-21T15:11:10.923 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.921+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ab14b680 finish: resending after timeout 2024-09-21T15:11:10.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.921+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bd800 finish: resending after timeout 2024-09-21T15:11:10.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.921+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc300 finish: resending after timeout 2024-09-21T15:11:10.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.921+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43a40 finish: resending after timeout 2024-09-21T15:11:10.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.921+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c420c0 finish: resending after timeout 2024-09-21T15:11:10.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.921+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43140 finish: resending after timeout 2024-09-21T15:11:10.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.925+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e561140 finish: resending after timeout 2024-09-21T15:11:10.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.925+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad9095c0 finish: resending after timeout 2024-09-21T15:11:10.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.925+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59edea6c0 finish: resending after timeout 2024-09-21T15:11:10.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.925+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908fc0 finish: resending after timeout 2024-09-21T15:11:10.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.925+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560540 finish: resending after timeout 2024-09-21T15:11:10.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.925+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909a40 finish: resending after timeout 2024-09-21T15:11:10.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.925+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c780 finish: resending after timeout 2024-09-21T15:11:10.929 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.929+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a3de5bc0 finish: resending after timeout 2024-09-21T15:11:10.930 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.929+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0c00 finish: resending after timeout 2024-09-21T15:11:10.930 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.929+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b18c0 finish: resending after timeout 2024-09-21T15:11:10.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.929+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cadec0 finish: resending after timeout 2024-09-21T15:11:10.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.929+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e618fc0 finish: resending after timeout 2024-09-21T15:11:10.932 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.929+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1fbc0 finish: resending after timeout 2024-09-21T15:11:10.932 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.929+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461ec0 finish: resending after timeout 2024-09-21T15:11:10.932 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.929+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43980 finish: resending after timeout 2024-09-21T15:11:10.932 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.929+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae988300 finish: resending after timeout 2024-09-21T15:11:10.933 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.929+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61e840 finish: resending after timeout 2024-09-21T15:11:10.933 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.929+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9bc80 finish: resending after timeout 2024-09-21T15:11:10.933 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:10.929+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f380 finish: resending after timeout 2024-09-21T15:11:10.936 INFO:teuthology.orchestra.run.smithi161.stdout:5817 punch from 0x613b3a4 to 0x6143691, (0x82ed bytes) 2024-09-21T15:11:10.936 INFO:teuthology.orchestra.run.smithi161.stdout:5818 writesame 0xceac2c5 thru 0xcead9e4 data_size 0x8(0x1720 bytes) 2024-09-21T15:11:10.949 INFO:teuthology.orchestra.run.smithi161.stdout:5819 read 0x150427f thru 0x150e281 (0xa003 bytes) 2024-09-21T15:11:10.950 INFO:teuthology.orchestra.run.smithi161.stdout:5821 write 0x62fd435 thru 0x630c525 (0xf0f1 bytes) 2024-09-21T15:11:10.978 INFO:teuthology.orchestra.run.smithi161.stdout:5822 writesame 0x76e2464 thru 0x76e83e7 data_size 0x2(0x5f84 bytes) 2024-09-21T15:11:10.993 INFO:teuthology.orchestra.run.smithi161.stdout:5823 writesame 0x3ba4078 thru 0x3bb0cb3 data_size 0x6(0xcc3c bytes) 2024-09-21T15:11:11.012 INFO:teuthology.orchestra.run.smithi161.stdout:5824 punch from 0x7840ba3 to 0x7845256, (0x46b3 bytes) 2024-09-21T15:11:11.031 INFO:teuthology.orchestra.run.smithi161.stdout:5825 trunc from 0xe109403 to 0x5c1556a 2024-09-21T15:11:11.102 INFO:teuthology.orchestra.run.smithi161.stdout:5826 read 0x22f4822 thru 0x22f87a0 (0x3f7f bytes) 2024-09-21T15:11:11.102 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:11.107 INFO:teuthology.orchestra.run.smithi161.stdout:5828 trunc from 0x5c1556a to 0x7a37c18 2024-09-21T15:11:11.137 INFO:teuthology.orchestra.run.smithi161.stdout:5829 read 0x6f887b1 thru 0x6f97210 (0xea60 bytes) 2024-09-21T15:11:11.138 INFO:teuthology.orchestra.run.smithi161.stdout:5830 clone 57 order 19 su 8192 sc 15 2024-09-21T15:11:11.198 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:11.197+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3f99860 handle_clone_image: failed to clone image mirror/10b45ee8c178 to image_cluster1.client.mirror.3-clone56 2024-09-21T15:11:11.723 INFO:teuthology.orchestra.run.smithi161.stdout:truncating image image_cluster1.client.mirror.3-clone56 from 0x7a37c18 (overlap 0x32949be) to 0x0 2024-09-21T15:11:11.988 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #55, image image_cluster1.client.mirror.3-clone55 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent56 2024-09-21T15:11:12.575 INFO:teuthology.orchestra.run.smithi161.stdout:5831 writesame 0x7f6346e thru 0x7f6cca0 data_size 0x1(0x9833 bytes) 2024-09-21T15:11:12.609 INFO:teuthology.orchestra.run.smithi161.stdout:5832 write 0x53d8b39 thru 0x53db228 (0x26f0 bytes) 2024-09-21T15:11:12.682 INFO:teuthology.orchestra.run.smithi161.stdout:5833 writesame 0xee2c283 thru 0xee33db6 data_size 0x53(0x7b34 bytes) 2024-09-21T15:11:12.688 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:12.688 INFO:teuthology.orchestra.run.smithi161.stdout:5836 write 0x61019d5 thru 0x610c133 (0xa75f bytes) 2024-09-21T15:11:12.727 INFO:teuthology.orchestra.run.smithi161.stdout:5837 write 0x7def796 thru 0x7dfe596 (0xee01 bytes) 2024-09-21T15:11:12.760 INFO:teuthology.orchestra.run.smithi161.stdout:5838 punch from 0x990aaf8 to 0x99115e4, (0x6aec bytes) 2024-09-21T15:11:12.760 INFO:teuthology.orchestra.run.smithi161.stdout:5839 read 0xa910a53 thru 0xa914496 (0x3a44 bytes) 2024-09-21T15:11:12.760 INFO:teuthology.orchestra.run.smithi161.stdout:5842 punch from 0x32de016 to 0x32e81c6, (0xa1b0 bytes) 2024-09-21T15:11:12.760 INFO:teuthology.orchestra.run.smithi161.stdout:5843 write 0xb5dda7d thru 0xb5e2c2d (0x51b1 bytes) 2024-09-21T15:11:12.780 INFO:teuthology.orchestra.run.smithi161.stdout:5844 write 0x71c3276 thru 0x71c96d7 (0x6462 bytes) 2024-09-21T15:11:12.825 INFO:teuthology.orchestra.run.smithi161.stdout:5845 write 0xa7bc565 thru 0xa7c32e1 (0x6d7d bytes) 2024-09-21T15:11:12.850 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:12.850 INFO:teuthology.orchestra.run.smithi161.stdout:5848 write 0xe69da2d thru 0xe6ac8ef (0xeec3 bytes) 2024-09-21T15:11:12.887 INFO:teuthology.orchestra.run.smithi161.stdout:5849 read 0xc64fe2d thru 0xc654897 (0x4a6b bytes) 2024-09-21T15:11:12.887 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:12.887 INFO:teuthology.orchestra.run.smithi161.stdout:5851 writesame 0x13fcc02 thru 0x14055f4 data_size 0x7(0x89f3 bytes) 2024-09-21T15:11:12.928 INFO:teuthology.orchestra.run.smithi161.stdout:5852 trunc from 0xee33db7 to 0xe785be4 2024-09-21T15:11:12.966 INFO:teuthology.orchestra.run.smithi161.stdout:5853 read 0x9c9540 thru 0x9ca833 (0x12f4 bytes) 2024-09-21T15:11:12.975 INFO:teuthology.orchestra.run.smithi161.stdout:5854 trunc from 0xe785be4 to 0xb73e846 2024-09-21T15:11:13.037 INFO:teuthology.orchestra.run.smithi161.stdout:5855 trunc from 0xb73e846 to 0x75ecbf5 2024-09-21T15:11:13.138 INFO:teuthology.orchestra.run.smithi161.stdout:5856 read 0x1a6a7a8 thru 0x1a6da41 (0x329a bytes) 2024-09-21T15:11:13.139 INFO:teuthology.orchestra.run.smithi161.stdout:5857 read 0x4bec6a9 thru 0x4bf931e (0xcc76 bytes) 2024-09-21T15:11:13.140 INFO:teuthology.orchestra.run.smithi161.stdout:5862 read 0x38d13c7 thru 0x38d931d (0x7f57 bytes) 2024-09-21T15:11:13.141 INFO:teuthology.orchestra.run.smithi161.stdout:5863 write 0x187b349 thru 0x1880cce (0x5986 bytes) 2024-09-21T15:11:13.179 INFO:teuthology.orchestra.run.smithi161.stdout:5864 writesame 0x6185c6b thru 0x618e55f data_size 0x1f(0x88f5 bytes) 2024-09-21T15:11:13.209 INFO:teuthology.orchestra.run.smithi161.stdout:5865 punch from 0x20dbe5b to 0x20e3008, (0x71ad bytes) 2024-09-21T15:11:13.209 INFO:teuthology.orchestra.run.smithi161.stdout:5866 read 0x5880614 thru 0x5882db1 (0x279e bytes) 2024-09-21T15:11:13.209 INFO:teuthology.orchestra.run.smithi161.stdout:5867 read 0x67fbf6a thru 0x680b785 (0xf81c bytes) 2024-09-21T15:11:13.209 INFO:teuthology.orchestra.run.smithi161.stdout:5869 write 0x2284770 thru 0x228ce2c (0x86bd bytes) 2024-09-21T15:11:13.454 INFO:teuthology.orchestra.run.smithi161.stdout:5871 read 0x7d93cb thru 0x7dcd2d (0x3963 bytes) 2024-09-21T15:11:13.455 INFO:teuthology.orchestra.run.smithi161.stdout:5872 read 0xe44f77 thru 0xe5017e (0xb208 bytes) 2024-09-21T15:11:13.456 INFO:teuthology.orchestra.run.smithi161.stdout:5873 read 0x1ae247 thru 0x1bc122 (0xdedc bytes) 2024-09-21T15:11:13.471 INFO:teuthology.orchestra.run.smithi161.stdout:5874 trunc from 0x75ecbf5 to 0x1140178 2024-09-21T15:11:13.683 INFO:teuthology.orchestra.run.smithi161.stdout:5875 writesame 0xcec316c thru 0xcece20f data_size 0x1(0xb0a4 bytes) 2024-09-21T15:11:13.689 INFO:teuthology.orchestra.run.smithi161.stdout:5876 read 0x1fe33ab thru 0x1fe8b38 (0x578e bytes) 2024-09-21T15:11:13.690 INFO:teuthology.orchestra.run.smithi161.stdout:5878 flatten 2024-09-21T15:11:13.873 INFO:teuthology.orchestra.run.smithi161.stdout:5881 writesame 0x1c1defd thru 0x1c236d7 data_size 0x3f(0x57db bytes) 2024-09-21T15:11:13.899 INFO:teuthology.orchestra.run.smithi161.stdout:5883 read 0x4f64936 thru 0x4f6c69a (0x7d65 bytes) 2024-09-21T15:11:13.899 INFO:teuthology.orchestra.run.smithi161.stdout:5887 write 0x8c52e6d thru 0x8c5cc75 (0x9e09 bytes) 2024-09-21T15:11:13.926 INFO:teuthology.orchestra.run.smithi161.stdout:5889 write 0x45f56e8 thru 0x45fdf0a (0x8823 bytes) 2024-09-21T15:11:13.951 INFO:teuthology.orchestra.run.smithi161.stdout:5890 write 0x396d7f9 thru 0x397a81a (0xd022 bytes) 2024-09-21T15:11:13.983 INFO:teuthology.orchestra.run.smithi161.stdout:5891 writesame 0x109e27a thru 0x10a1e33 data_size 0x37(0x3bba bytes) 2024-09-21T15:11:13.990 INFO:teuthology.orchestra.run.smithi161.stdout:5892 punch from 0x150a0de to 0x1517eeb, (0xde0d bytes) 2024-09-21T15:11:13.990 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:13.990 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:13.990 INFO:teuthology.orchestra.run.smithi161.stdout:5898 read 0x5f97224 thru 0x5fa7055 (0xfe32 bytes) 2024-09-21T15:11:13.991 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:14.007 INFO:teuthology.orchestra.run.smithi161.stdout:5900 trunc from 0xcece210 to 0x633215a 2024-09-21T15:11:14.110 INFO:teuthology.orchestra.run.smithi161.stdout:5901 write 0xed38faa thru 0xed4604e (0xd0a5 bytes) 2024-09-21T15:11:14.146 INFO:teuthology.orchestra.run.smithi161.stdout:5902 read 0x455dde thru 0x462240 (0xc463 bytes) 2024-09-21T15:11:14.147 INFO:teuthology.orchestra.run.smithi161.stdout:5903 write 0x363e97b thru 0x363ef68 (0x5ee bytes) 2024-09-21T15:11:14.157 INFO:teuthology.orchestra.run.smithi161.stdout:5905 punch from 0xe9f9b69 to 0xea07eec, (0xe383 bytes) 2024-09-21T15:11:14.158 INFO:teuthology.orchestra.run.smithi161.stdout:5906 write 0x561f74d thru 0x562431a (0x4bce bytes) 2024-09-21T15:11:14.181 INFO:teuthology.orchestra.run.smithi161.stdout:5908 punch from 0x89c53ad to 0x89d359a, (0xe1ed bytes) 2024-09-21T15:11:14.181 INFO:teuthology.orchestra.run.smithi161.stdout:5909 read 0x42c683b thru 0x42d4cdc (0xe4a2 bytes) 2024-09-21T15:11:14.182 INFO:teuthology.orchestra.run.smithi161.stdout:5910 read 0xf6fa9d thru 0xf7dd1d (0xe281 bytes) 2024-09-21T15:11:14.183 INFO:teuthology.orchestra.run.smithi161.stdout:5912 write 0xa5abbfc thru 0xa5ae2c4 (0x26c9 bytes) 2024-09-21T15:11:14.201 INFO:teuthology.orchestra.run.smithi161.stdout:5913 writesame 0xb361447 thru 0xb364db7 data_size 0x5(0x3971 bytes) 2024-09-21T15:11:14.220 INFO:teuthology.orchestra.run.smithi161.stdout:5915 punch from 0x69f6c52 to 0x6a00a91, (0x9e3f bytes) 2024-09-21T15:11:14.220 INFO:teuthology.orchestra.run.smithi161.stdout:5916 writesame 0xd23aa05 thru 0xd24989c data_size 0x3c(0xee98 bytes) 2024-09-21T15:11:14.253 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:14.253 INFO:teuthology.orchestra.run.smithi161.stdout:5918 punch from 0xc38a4d7 to 0xc38ff39, (0x5a62 bytes) 2024-09-21T15:11:14.253 INFO:teuthology.orchestra.run.smithi161.stdout:5919 punch from 0x200737d to 0x2012d8b, (0xba0e bytes) 2024-09-21T15:11:14.253 INFO:teuthology.orchestra.run.smithi161.stdout:5920 punch from 0xc225a4d to 0xc22a47f, (0x4a32 bytes) 2024-09-21T15:11:14.253 INFO:teuthology.orchestra.run.smithi161.stdout:5921 writesame 0xd8317dd thru 0xd840c7d data_size 0x7d(0xf4a1 bytes) 2024-09-21T15:11:14.274 INFO:teuthology.orchestra.run.smithi161.stdout:5924 punch from 0xcdd5664 to 0xcdd856a, (0x2f06 bytes) 2024-09-21T15:11:14.275 INFO:teuthology.orchestra.run.smithi161.stdout:5925 read 0xbeb19e thru 0xbf7f8b (0xcdee bytes) 2024-09-21T15:11:14.295 INFO:teuthology.orchestra.run.smithi161.stdout:5926 trunc from 0xed4604f to 0x62b77f0 2024-09-21T15:11:14.367 INFO:teuthology.orchestra.run.smithi161.stdout:5927 write 0x1bb883b thru 0x1bc670b (0xded1 bytes) 2024-09-21T15:11:14.416 INFO:teuthology.orchestra.run.smithi161.stdout:5928 trunc from 0x62b77f0 to 0xe9f0cd7 2024-09-21T15:11:14.456 INFO:teuthology.orchestra.run.smithi161.stdout:5931 write 0x4e00e10 thru 0x4e05207 (0x43f8 bytes) 2024-09-21T15:11:14.477 INFO:teuthology.orchestra.run.smithi161.stdout:5933 punch from 0xd0a11 to 0xdd1a0, (0xc78f bytes) 2024-09-21T15:11:14.477 INFO:teuthology.orchestra.run.smithi161.stdout:5934 writesame 0xb6c56b2 thru 0xb6ca5ee data_size 0x1(0x4f3d bytes) 2024-09-21T15:11:14.504 INFO:teuthology.orchestra.run.smithi161.stdout:5937 writesame 0x277af0d thru 0x2784118 data_size 0x1a(0x920c bytes) 2024-09-21T15:11:14.534 INFO:teuthology.orchestra.run.smithi161.stdout:5941 writesame 0xb51527d thru 0xb51df81 data_size 0x1(0x8d05 bytes) 2024-09-21T15:11:14.571 INFO:teuthology.orchestra.run.smithi161.stdout:5942 write 0xcf690e6 thru 0xcf6d303 (0x421e bytes) 2024-09-21T15:11:14.595 INFO:teuthology.orchestra.run.smithi161.stdout:5943 punch from 0xcbc45db to 0xcbccfef, (0x8a14 bytes) 2024-09-21T15:11:14.595 INFO:teuthology.orchestra.run.smithi161.stdout:5944 write 0xca4f704 thru 0xca51d3b (0x2638 bytes) 2024-09-21T15:11:14.613 INFO:teuthology.orchestra.run.smithi161.stdout:5945 read 0xab3011a thru 0xab3ebdf (0xeac6 bytes) 2024-09-21T15:11:14.636 INFO:teuthology.orchestra.run.smithi161.stdout:5946 trunc from 0xe9f0cd7 to 0x48a02e9 2024-09-21T15:11:14.717 INFO:teuthology.orchestra.run.smithi161.stdout:5947 read 0x302520b thru 0x3031313 (0xc109 bytes) 2024-09-21T15:11:14.718 INFO:teuthology.orchestra.run.smithi161.stdout:5950 punch from 0x171d7a8 to 0x171ec83, (0x14db bytes) 2024-09-21T15:11:14.718 INFO:teuthology.orchestra.run.smithi161.stdout:5951 read 0x3b39c39 thru 0x3b47393 (0xd75b bytes) 2024-09-21T15:11:14.719 INFO:teuthology.orchestra.run.smithi161.stdout:5952 write 0x24531b0 thru 0x2457bc0 (0x4a11 bytes) 2024-09-21T15:11:14.740 INFO:teuthology.orchestra.run.smithi161.stdout:5954 read 0x19f40b7 thru 0x19fd9c8 (0x9912 bytes) 2024-09-21T15:11:14.806 INFO:teuthology.orchestra.run.smithi161.stdout:5955 write 0xde8900a thru 0xde94c91 (0xbc88 bytes) 2024-09-21T15:11:14.836 INFO:teuthology.orchestra.run.smithi161.stdout:5956 write 0xb012f6d thru 0xb0132ab (0x33f bytes) 2024-09-21T15:11:14.849 INFO:teuthology.orchestra.run.smithi161.stdout:5957 trunc from 0xde94c92 to 0xeb96c34 2024-09-21T15:11:14.887 INFO:teuthology.orchestra.run.smithi161.stdout:5958 punch from 0x84520bc to 0x84543a9, (0x22ed bytes) 2024-09-21T15:11:14.887 INFO:teuthology.orchestra.run.smithi161.stdout:5959 write 0xd2ee3e6 thru 0xd2fb97a (0xd595 bytes) 2024-09-21T15:11:14.921 INFO:teuthology.orchestra.run.smithi161.stdout:5960 read 0x9f2d37c thru 0x9f3a41d (0xd0a2 bytes) 2024-09-21T15:11:14.956 INFO:teuthology.orchestra.run.smithi161.stdout:5961 writesame 0xec56654 thru 0xec629aa data_size 0x3(0xc357 bytes) 2024-09-21T15:11:14.961 INFO:teuthology.orchestra.run.smithi161.stdout:5962 write 0x3be58e7 thru 0x3bf064b (0xad65 bytes) 2024-09-21T15:11:14.982 INFO:teuthology.orchestra.run.smithi161.stdout:5963 read 0x4225e14 thru 0x42343b0 (0xe59d bytes) 2024-09-21T15:11:14.984 INFO:teuthology.orchestra.run.smithi161.stdout:5964 trunc from 0xec629ab to 0xdda3fad 2024-09-21T15:11:15.033 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:15.033 INFO:teuthology.orchestra.run.smithi161.stdout:5966 read 0x404502d thru 0x405228c (0xd260 bytes) 2024-09-21T15:11:15.033 INFO:teuthology.orchestra.run.smithi161.stdout:5967 read 0x5fe4f58 thru 0x5fe815e (0x3207 bytes) 2024-09-21T15:11:15.034 INFO:teuthology.orchestra.run.smithi161.stdout:5969 read 0x269f0f9 thru 0x26a53ce (0x62d6 bytes) 2024-09-21T15:11:15.034 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:15.034 INFO:teuthology.orchestra.run.smithi161.stdout:5971 write 0x7ebf356 thru 0x7ecb56c (0xc217 bytes) 2024-09-21T15:11:15.070 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:15.070 INFO:teuthology.orchestra.run.smithi161.stdout:5974 read 0xd4825d6 thru 0xd48f968 (0xd393 bytes) 2024-09-21T15:11:15.072 INFO:teuthology.orchestra.run.smithi161.stdout:5975 trunc from 0xdda3fad to 0xd765890 2024-09-21T15:11:15.132 INFO:teuthology.orchestra.run.smithi161.stdout:5976 read 0x3efde3b thru 0x3eff505 (0x16cb bytes) 2024-09-21T15:11:15.133 INFO:teuthology.orchestra.run.smithi161.stdout:5977 writesame 0xcb91c26 thru 0xcb98d00 data_size 0x1(0x70db bytes) 2024-09-21T15:11:15.170 INFO:teuthology.orchestra.run.smithi161.stdout:5978 punch from 0x38ce0ae to 0x38dc4f7, (0xe449 bytes) 2024-09-21T15:11:15.170 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:15.170 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:15.170 INFO:teuthology.orchestra.run.smithi161.stdout:5983 writesame 0x5dd63e7 thru 0x5dd7a06 data_size 0x1(0x1620 bytes) 2024-09-21T15:11:15.184 INFO:teuthology.orchestra.run.smithi161.stdout:compare and write disabled 2024-09-21T15:11:15.207 INFO:teuthology.orchestra.run.smithi161.stdout:5986 trunc from 0xd765890 to 0x2eb00bb 2024-09-21T15:11:15.291 INFO:teuthology.orchestra.run.smithi161.stdout:5987 read 0x25902c7 thru 0x2595953 (0x568d bytes) 2024-09-21T15:11:15.329 INFO:teuthology.orchestra.run.smithi161.stdout:5988 write 0x409a4ca thru 0x40aa3e0 (0xff17 bytes) 2024-09-21T15:11:15.419 INFO:teuthology.orchestra.run.smithi161.stdout:5989 writesame 0x7d06cd5 thru 0x7d0b76e data_size 0x9(0x4a9a bytes) 2024-09-21T15:11:15.424 INFO:teuthology.orchestra.run.smithi161.stdout:5990 read 0x6273ac1 thru 0x6276bd2 (0x3112 bytes) 2024-09-21T15:11:15.424 INFO:teuthology.orchestra.run.smithi161.stdout:5993 read 0x2806898 thru 0x28162a1 (0xfa0a bytes) 2024-09-21T15:11:15.477 INFO:teuthology.orchestra.run.smithi161.stdout:5994 write 0xbfc7737 thru 0xbfc9b2b (0x23f5 bytes) 2024-09-21T15:11:15.504 INFO:teuthology.orchestra.run.smithi161.stdout:5995 write 0x9f0fd58 thru 0x9f13288 (0x3531 bytes) 2024-09-21T15:11:15.545 INFO:teuthology.orchestra.run.smithi161.stdout:5996 write 0x6e74613 thru 0x6e76259 (0x1c47 bytes) 2024-09-21T15:11:15.560 INFO:teuthology.orchestra.run.smithi161.stdout:5997 punch from 0xaca1d93 to 0xacaa5dc, (0x8849 bytes) 2024-09-21T15:11:15.560 INFO:teuthology.orchestra.run.smithi161.stdout:5998 read 0x4ed6419 thru 0x4ee0094 (0x9c7c bytes) 2024-09-21T15:11:15.581 INFO:teuthology.orchestra.run.smithi161.stdout:5999 trunc from 0xbfc9b2c to 0x2659840 2024-09-21T15:11:15.686 INFO:teuthology.orchestra.run.smithi161.stdout:checking clone #56, image image_cluster1.client.mirror.3-clone56 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent57 2024-09-21T15:11:15.741 INFO:teuthology.orchestra.run.smithi161.stdout:All operations completed A-OK! 2024-09-21T15:11:15.785 DEBUG:teuthology.parallel:result is None 2024-09-21T15:11:15.785 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T15:11:15.798 INFO:tasks.workunit:Pulling workunits from ref a477b1894d5c5a613f23260ca0e6b96d79652ba7 2024-09-21T15:11:15.798 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T15:11:15.798 DEBUG:teuthology.orchestra.run.smithi161:> stat -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2024-09-21T15:11:15.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T15:11:15.831 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.cluster1.mirror': No such file or directory 2024-09-21T15:11:15.831 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2024-09-21T15:11:15.856 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.cluster1.mirror 2024-09-21T15:11:15.856 DEBUG:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror && mkdir -- client.mirror 2024-09-21T15:11:15.863 INFO:tasks.workunit:timeout=6h 2024-09-21T15:11:15.863 INFO:tasks.workunit:cleanup=True 2024-09-21T15:11:15.863 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/clone.cluster1.client.mirror && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.cluster1.client.mirror && cd /home/ubuntu/cephtest/clone.cluster1.client.mirror && git checkout a477b1894d5c5a613f23260ca0e6b96d79652ba7 2024-09-21T15:11:15.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:Cloning into '/home/ubuntu/cephtest/clone.cluster1.client.mirror'... 2024-09-21T15:11:17.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.565+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461980 finish: resending after timeout 2024-09-21T15:11:17.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.565+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad140 finish: resending after timeout 2024-09-21T15:11:17.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.565+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588b40 finish: resending after timeout 2024-09-21T15:11:17.569 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.565+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:11:17.569 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.569+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f0a6480 finish: resending after timeout 2024-09-21T15:11:17.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.569+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a55206c0 finish: resending after timeout 2024-09-21T15:11:17.571 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.569+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ab14b680 finish: resending after timeout 2024-09-21T15:11:17.571 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.569+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bd800 finish: resending after timeout 2024-09-21T15:11:17.571 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.569+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc300 finish: resending after timeout 2024-09-21T15:11:17.572 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.569+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43a40 finish: resending after timeout 2024-09-21T15:11:17.573 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.569+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c420c0 finish: resending after timeout 2024-09-21T15:11:17.573 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.569+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43140 finish: resending after timeout 2024-09-21T15:11:17.573 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.569+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e561140 finish: resending after timeout 2024-09-21T15:11:17.573 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.569+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad9095c0 finish: resending after timeout 2024-09-21T15:11:17.573 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.569+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59edea6c0 finish: resending after timeout 2024-09-21T15:11:17.574 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.569+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908fc0 finish: resending after timeout 2024-09-21T15:11:17.574 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.573+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560540 finish: resending after timeout 2024-09-21T15:11:17.574 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.573+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909a40 finish: resending after timeout 2024-09-21T15:11:17.575 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.573+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c780 finish: resending after timeout 2024-09-21T15:11:17.577 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.573+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a3de5bc0 finish: resending after timeout 2024-09-21T15:11:17.577 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.573+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0c00 finish: resending after timeout 2024-09-21T15:11:17.577 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.573+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b18c0 finish: resending after timeout 2024-09-21T15:11:17.578 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.573+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cadec0 finish: resending after timeout 2024-09-21T15:11:17.578 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.577+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e618fc0 finish: resending after timeout 2024-09-21T15:11:17.578 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.577+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1fbc0 finish: resending after timeout 2024-09-21T15:11:17.579 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.577+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461ec0 finish: resending after timeout 2024-09-21T15:11:17.579 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.577+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43980 finish: resending after timeout 2024-09-21T15:11:17.580 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.577+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae988300 finish: resending after timeout 2024-09-21T15:11:17.580 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.577+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61e840 finish: resending after timeout 2024-09-21T15:11:17.580 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.577+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9bc80 finish: resending after timeout 2024-09-21T15:11:17.580 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:17.577+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f380 finish: resending after timeout 2024-09-21T15:11:17.918 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:17.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:11:17.919 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:17.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:11:17.919 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:17.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:11:18.027 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.021+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:11:18.029 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.025+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:11:18.030 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.029+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:11:18.032 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.029+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb2b0 2024-09-21T15:11:18.032 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.029+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:11:18.032 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.029+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:11:18.033 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.029+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:11:18.033 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.029+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a0d0 2024-09-21T15:11:18.033 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.029+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:11:18.033 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.029+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b860 2024-09-21T15:11:18.038 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:11:18.038 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8000 2024-09-21T15:11:18.039 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:11:18.039 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8340 2024-09-21T15:11:18.039 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:11:18.039 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:11:18.039 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:11:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:11:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8d00 2024-09-21T15:11:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:11:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:11:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9450 2024-09-21T15:11:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb95f0 2024-09-21T15:11:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:11:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9930 2024-09-21T15:11:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9c70 2024-09-21T15:11:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:11:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:11:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cdd0 2024-09-21T15:11:18.041 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cea0 2024-09-21T15:11:22.363 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.357+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:11:22.364 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.361+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:11:22.364 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.361+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:11:22.366 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.361+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:11:22.366 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.361+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:11:22.366 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.361+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:11:22.366 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.361+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:11:22.366 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.361+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:11:22.366 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.361+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:11:22.366 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.361+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:11:22.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.365+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:11:22.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.365+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:11:22.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.369+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:11:22.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.369+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:11:22.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.369+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:11:22.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.369+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:11:22.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.369+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:11:22.377 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.377+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:11:22.378 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.377+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:11:22.378 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.377+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:11:22.378 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.377+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:11:22.378 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.377+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:11:22.378 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.377+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:11:22.378 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.377+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:11:22.378 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.377+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:11:22.378 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.377+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:11:22.378 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.377+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:11:22.385 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.385+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:11:22.385 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.385+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:11:22.386 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.385+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:11:22.393 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.389+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:11:22.394 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.389+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:11:22.400 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.397+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:11:22.402 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.401+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:11:22.403 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.401+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:11:22.403 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.401+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:11:22.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.401+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:11:22.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.401+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:11:22.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.401+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:11:22.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.401+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:11:22.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.405+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:11:22.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.405+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:11:22.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.405+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:11:22.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.405+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:11:22.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.405+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:11:22.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.405+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:11:22.412 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:11:22.412 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:11:22.412 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:11:22.412 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:11:22.412 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:11:22.412 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:11:22.412 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:11:22.413 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:11:22.413 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:11:22.413 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:11:22.413 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:11:22.413 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:11:22.413 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:11:22.413 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:11:22.413 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:11:22.414 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:11:22.414 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:11:22.414 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:22.409+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:11:22.860 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.857+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:11:22.860 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.857+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16000 2024-09-21T15:11:22.861 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.857+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:11:22.861 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.857+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:11:22.862 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.857+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:11:22.864 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.857+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:11:22.868 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:11:22.869 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:11:22.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.869+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:11:22.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.869+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b860 2024-09-21T15:11:22.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.873+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:11:22.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.873+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8000 2024-09-21T15:11:22.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.873+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:11:22.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.873+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8340 2024-09-21T15:11:22.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.873+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:11:22.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.873+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:11:22.877 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.873+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:11:22.877 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.873+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:11:22.877 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.873+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8d00 2024-09-21T15:11:22.877 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.873+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:11:22.877 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.873+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:11:22.877 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.873+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9450 2024-09-21T15:11:22.878 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.877+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb95f0 2024-09-21T15:11:22.878 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.877+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:11:22.879 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.877+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9930 2024-09-21T15:11:22.879 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.877+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9c70 2024-09-21T15:11:22.879 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.877+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:11:22.879 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.877+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:11:22.879 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.877+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cdd0 2024-09-21T15:11:22.880 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:22.877+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cea0 2024-09-21T15:11:26.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:26.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:11:26.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:26.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:11:26.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:26.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:11:26.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:26.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:11:26.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:26.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:11:26.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:26.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:11:27.837 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.829+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:11:27.855 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.849+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810b60 2024-09-21T15:11:27.858 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.849+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:11:27.867 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.865+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b040 2024-09-21T15:11:27.867 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.865+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b790 2024-09-21T15:11:27.870 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.865+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb184e0 2024-09-21T15:11:27.870 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.865+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb192b0 2024-09-21T15:11:27.870 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.865+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:11:27.870 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.865+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:11:27.870 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.865+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:11:27.883 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.881+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:11:27.891 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.885+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9e8f0 2024-09-21T15:11:27.891 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:11:27.891 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f930 2024-09-21T15:11:27.891 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:11:27.891 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83930 2024-09-21T15:11:27.891 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4c8f0 2024-09-21T15:11:27.892 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4cf70 2024-09-21T15:11:27.892 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:11:27.892 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:11:27.892 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b10492b0 2024-09-21T15:11:27.892 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:11:27.892 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049ee0 2024-09-21T15:11:27.892 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b10d1a00 2024-09-21T15:11:27.892 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:11:27.892 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:11:27.892 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6b60 2024-09-21T15:11:27.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:11:27.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:11:27.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:11:27.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd00d0 2024-09-21T15:11:27.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1040 2024-09-21T15:11:27.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1ba0 2024-09-21T15:11:27.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:11:27.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c9c0 2024-09-21T15:11:27.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fa8f0 2024-09-21T15:11:27.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b28585b0 2024-09-21T15:11:27.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50270 2024-09-21T15:11:27.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50410 2024-09-21T15:11:27.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f504e0 2024-09-21T15:11:27.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50750 2024-09-21T15:11:27.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:11:27.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50b60 2024-09-21T15:11:27.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50f70 2024-09-21T15:11:27.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f512b0 2024-09-21T15:11:27.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:11:27.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:11:27.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:11:27.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51860 2024-09-21T15:11:27.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51930 2024-09-21T15:11:27.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51a00 2024-09-21T15:11:27.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51ad0 2024-09-21T15:11:27.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:11:27.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:11:27.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:11:27.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3100410 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31009c0 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc410 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd520 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd6c0 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:11:27.897 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:11:27.898 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:11:27.898 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810b60 2024-09-21T15:11:27.898 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:11:27.898 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811a00 2024-09-21T15:11:27.898 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:11:27.898 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:11:27.898 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45de340 2024-09-21T15:11:27.898 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:11:27.898 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45df860 2024-09-21T15:11:27.898 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dfa00 2024-09-21T15:11:27.898 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76000 2024-09-21T15:11:27.898 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:11:27.903 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76d00 2024-09-21T15:11:27.903 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:11:27.903 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:11:27.903 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd2ea0 2024-09-21T15:11:27.903 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:11:27.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3ad0 2024-09-21T15:11:27.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:11:27.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:11:27.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:11:27.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:11:27.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:11:27.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:11:27.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:11:27.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:11:27.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:11:27.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:11:27.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:11:27.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:11:27.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:11:27.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:11:27.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:11:27.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:11:27.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:11:27.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:11:27.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eab60 2024-09-21T15:11:27.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:11:27.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:11:27.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:11:27.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d85b0 2024-09-21T15:11:27.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:11:27.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:11:27.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:11:27.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:11:27.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:11:27.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:11:27.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:11:27.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782410 2024-09-21T15:11:27.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:11:27.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:11:27.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782820 2024-09-21T15:11:27.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782a90 2024-09-21T15:11:27.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782d00 2024-09-21T15:11:27.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:11:27.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783040 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783380 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783520 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783e10 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9110 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de95f0 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9930 2024-09-21T15:11:27.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9ba0 2024-09-21T15:11:27.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:11:27.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:11:27.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:11:27.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:11:27.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47040 2024-09-21T15:11:27.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:11:27.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:11:27.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:11:27.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:27.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90d00 2024-09-21T15:11:27.935 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461980 finish: resending after timeout 2024-09-21T15:11:27.935 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad140 finish: resending after timeout 2024-09-21T15:11:27.935 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588b40 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ab14b680 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bd800 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc300 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43a40 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c420c0 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43140 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e561140 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad9095c0 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59edea6c0 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908fc0 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560540 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909a40 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c780 finish: resending after timeout 2024-09-21T15:11:27.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a3de5bc0 finish: resending after timeout 2024-09-21T15:11:27.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0c00 finish: resending after timeout 2024-09-21T15:11:27.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b18c0 finish: resending after timeout 2024-09-21T15:11:27.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cadec0 finish: resending after timeout 2024-09-21T15:11:27.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e618fc0 finish: resending after timeout 2024-09-21T15:11:27.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1fbc0 finish: resending after timeout 2024-09-21T15:11:27.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461ec0 finish: resending after timeout 2024-09-21T15:11:27.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43980 finish: resending after timeout 2024-09-21T15:11:27.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61e840 finish: resending after timeout 2024-09-21T15:11:27.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae988300 finish: resending after timeout 2024-09-21T15:11:27.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9bc80 finish: resending after timeout 2024-09-21T15:11:27.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:27.933+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f380 finish: resending after timeout 2024-09-21T15:11:28.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:28.169+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a2481680 handle_clone_image: failed to clone image mirror/10b65af4931e to image_cluster1.client.mirror.4-clone46 2024-09-21T15:11:28.185 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.172+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:11:28.185 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.172+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:11:28.194 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.176+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:11:28.229 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.220+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:11:28.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.220+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:11:28.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.220+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:11:28.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.220+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:11:28.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.220+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:11:28.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.220+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:11:28.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.220+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:11:28.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.220+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:11:28.231 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.220+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf8750 2024-09-21T15:11:28.232 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.228+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01d40 2024-09-21T15:11:28.232 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.228+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69860 2024-09-21T15:11:28.246 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.240+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:11:28.247 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.240+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:11:28.247 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.240+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:11:28.247 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.240+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:11:28.247 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.240+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:11:28.247 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.240+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af311c70 2024-09-21T15:11:28.247 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.240+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:11:28.247 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.240+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a000 2024-09-21T15:11:28.247 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.240+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:11:28.247 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:11:28.240+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57ba0 2024-09-21T15:11:28.357 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:28.353+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a0d11860 handle_clone_image: failed to clone image mirror/10b45ee8c178 to image_cluster1.client.mirror.3-clone56 2024-09-21T15:11:28.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:28.409+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a0e6a5a0 handle_clone_image: failed to clone image mirror/10aeab1f4a58 to image_cluster1.client.mirror.1-clone23 2024-09-21T15:11:28.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:28.493+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59e109e00 handle_clone_image: failed to clone image mirror/10b7124093bf to image_cluster1.client.mirror.5-clone35 2024-09-21T15:11:28.531 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:28.529+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3546f00 handle_clone_image: failed to clone image mirror/10ad336bb776 to image_cluster1.client.mirror.2-clone40 2024-09-21T15:11:28.550 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:28.545+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3c04960 handle_clone_image: failed to clone image mirror/10b6c945d42f to image_cluster1.client.mirror.4-clone50 2024-09-21T15:11:28.656 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:28.653+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3c04d20 handle_clone_image: failed to clone image mirror/10b479a83609 to image_cluster1.client.mirror.3-clone48 2024-09-21T15:11:28.713 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:28.709+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59f8eb2c0 handle_clone_image: failed to clone image mirror/10b71b385b9c to image_cluster1.client.mirror.5-clone25 2024-09-21T15:11:28.716 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:28.713+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3ec8960 handle_clone_image: failed to clone image mirror/10b4de9218fc to image_cluster1.client.mirror.3-clone35 2024-09-21T15:11:28.725 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:28.721+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a7b10000 handle_clone_image: failed to clone image mirror/10add02eae04 to image_cluster1.client.mirror.2-clone33 2024-09-21T15:11:28.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:28.761+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a2c47c20 handle_clone_image: failed to clone image mirror/10b4954dd49a to image_cluster1.client.mirror.3-clone40 2024-09-21T15:11:28.852 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.845+0000 7f52f1ba9700 -1 reset not still connected to 0x55713912b2b0 2024-09-21T15:11:28.852 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.845+0000 7f52f1ba9700 -1 reset not still connected to 0x5571393e85b0 2024-09-21T15:11:28.852 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.845+0000 7f52f1ba9700 -1 reset not still connected to 0x5571393e8820 2024-09-21T15:11:28.853 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.845+0000 7f52f1ba9700 -1 reset not still connected to 0x5571393e8c30 2024-09-21T15:11:28.857 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713962d930 2024-09-21T15:11:28.857 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a397d40 2024-09-21T15:11:28.858 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a49d930 2024-09-21T15:11:28.858 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ad1eb60 2024-09-21T15:11:28.858 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ad1fa00 2024-09-21T15:11:28.858 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713af26000 2024-09-21T15:11:28.858 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:11:28.858 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e410 2024-09-21T15:11:28.858 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61f380 2024-09-21T15:11:28.858 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:11:28.858 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b8601a0 2024-09-21T15:11:28.859 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc76410 2024-09-21T15:11:28.859 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc8cb60 2024-09-21T15:11:28.859 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c10d110 2024-09-21T15:11:28.860 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c10d5f0 2024-09-21T15:11:28.860 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c155860 2024-09-21T15:11:28.860 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c213860 2024-09-21T15:11:28.860 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf0d860 2024-09-21T15:11:28.860 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf7c5b0 2024-09-21T15:11:28.860 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cfa7040 2024-09-21T15:11:28.860 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.849+0000 7f52f1ba9700 -1 reset not still connected to 0x55713d8225b0 2024-09-21T15:11:28.862 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:28.860+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:11:28.863 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.857+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ad0 2024-09-21T15:11:28.863 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.857+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ba0 2024-09-21T15:11:28.863 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.857+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:11:28.863 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.857+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:11:28.863 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.857+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df812b0 2024-09-21T15:11:28.863 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.857+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81930 2024-09-21T15:11:28.864 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.857+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81ba0 2024-09-21T15:11:28.865 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.861+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e0ea8f0 2024-09-21T15:11:28.865 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.861+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:11:28.865 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.861+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e115040 2024-09-21T15:11:28.865 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.861+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e7ea270 2024-09-21T15:11:28.865 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.861+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:11:28.865 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.861+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4340 2024-09-21T15:11:28.865 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.861+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4410 2024-09-21T15:11:28.865 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.861+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e49c0 2024-09-21T15:11:28.866 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:28.864+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:11:28.866 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:28.864+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:11:28.869 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4c30 2024-09-21T15:11:28.869 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4f70 2024-09-21T15:11:28.871 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e51e0 2024-09-21T15:11:28.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5860 2024-09-21T15:11:28.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ba0 2024-09-21T15:11:28.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5c70 2024-09-21T15:11:28.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ee0 2024-09-21T15:11:28.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:11:28.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb24c30 2024-09-21T15:11:28.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:11:28.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25790 2024-09-21T15:11:28.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fdd61a0 2024-09-21T15:11:28.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c270 2024-09-21T15:11:28.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:11:28.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c9c0 2024-09-21T15:11:28.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cb60 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cd00 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dee0 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed01a0 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed0ea0 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f4820 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f5110 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f55f0 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1110 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1e10 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16000 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16b60 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17040 2024-09-21T15:11:28.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb0000 2024-09-21T15:11:28.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb1c70 2024-09-21T15:11:28.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:11:28.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:11:28.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:11:28.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb110 2024-09-21T15:11:28.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb2b0 2024-09-21T15:11:28.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:11:28.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:11:28.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:11:28.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0f70 2024-09-21T15:11:28.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef12b0 2024-09-21T15:11:28.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef1a00 2024-09-21T15:11:28.874 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a0d0 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232aea0 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b860 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8000 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8340 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8d00 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:11:28.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:11:28.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9450 2024-09-21T15:11:28.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb95f0 2024-09-21T15:11:28.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:11:28.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9930 2024-09-21T15:11:28.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9c70 2024-09-21T15:11:28.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:11:28.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:11:28.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cdd0 2024-09-21T15:11:28.876 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:28.865+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cea0 2024-09-21T15:11:28.877 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:28.868+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:11:28.877 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:28.868+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:11:28.877 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:28.868+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:11:28.916 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:28.913+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a2ba4780 handle_clone_image: failed to clone image mirror/10b4726378e0 to image_cluster1.client.mirror.3-clone20 2024-09-21T15:11:28.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.973+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac0000 2024-09-21T15:11:28.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.973+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb184e0 2024-09-21T15:11:28.993 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.989+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:11:28.993 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.989+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:11:28.993 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.989+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:11:28.993 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.989+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f930 2024-09-21T15:11:28.993 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.989+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07790 2024-09-21T15:11:28.993 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.989+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:11:28.993 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.989+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4cf70 2024-09-21T15:11:28.994 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.989+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:11:28.994 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.989+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:11:29.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:11:29.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049ee0 2024-09-21T15:11:29.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:11:29.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:11:29.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6b60 2024-09-21T15:11:29.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:11:29.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:11:29.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:11:29.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1040 2024-09-21T15:11:29.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:11:29.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c9c0 2024-09-21T15:11:29.006 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266d6c0 2024-09-21T15:11:29.006 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50410 2024-09-21T15:11:29.006 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:11:29.006 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:11:29.006 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:11:29.006 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:11:29.006 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51930 2024-09-21T15:11:29.006 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:11:29.006 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:11:29.006 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31004e0 2024-09-21T15:11:29.006 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31009c0 2024-09-21T15:11:29.007 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:28.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:11:29.007 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.001+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:11:29.007 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.001+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:11:29.007 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.001+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:11:29.007 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.001+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:11:29.007 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.001+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc410 2024-09-21T15:11:29.008 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.005+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:11:29.008 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.005+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:11:29.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.005+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd520 2024-09-21T15:11:29.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.005+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd6c0 2024-09-21T15:11:29.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.005+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:11:29.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.005+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:11:29.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.005+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:11:29.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.005+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:11:29.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.005+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b36868f0 2024-09-21T15:11:29.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:11:29.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810b60 2024-09-21T15:11:29.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:11:29.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:11:29.011 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:11:29.011 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:11:29.015 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:11:29.015 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76c30 2024-09-21T15:11:29.015 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:11:29.015 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:11:29.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:11:29.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:11:29.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:11:29.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:11:29.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:11:29.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:11:29.018 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:11:29.018 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:11:29.018 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:11:29.018 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:11:29.018 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:11:29.018 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:11:29.018 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:11:29.018 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:11:29.022 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:11:29.030 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:11:29.030 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.025+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:11:29.032 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.025+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:11:29.032 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:11:29.032 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:11:29.032 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:11:29.032 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:11:29.032 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:11:29.032 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d85b0 2024-09-21T15:11:29.032 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:11:29.032 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:11:29.032 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:11:29.032 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782410 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782820 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782a90 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782d00 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783380 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783520 2024-09-21T15:11:29.033 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:11:29.034 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:11:29.034 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:11:29.034 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:11:29.034 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:11:29.034 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:11:29.034 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:11:29.034 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:11:29.034 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:11:29.034 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:11:29.034 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:29.029+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:11:29.045 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:29.041+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:11:29.055 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:29.049+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:11:29.073 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:29.065+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:11:29.080 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:29.073+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8d00 2024-09-21T15:11:29.080 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:29.073+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:11:29.080 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:29.073+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:11:29.080 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:29.073+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9450 2024-09-21T15:11:29.081 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:29.077+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:11:29.083 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:29.077+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9c70 2024-09-21T15:11:29.083 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:29.077+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:11:29.083 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:29.077+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cdd0 2024-09-21T15:11:29.083 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:29.077+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cea0 2024-09-21T15:11:29.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:29.113+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a174e780 handle_clone_image: failed to clone image mirror/10b6858d977f to image_cluster1.client.mirror.4-clone34 2024-09-21T15:11:29.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:29.221+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a0d06000 handle_clone_image: failed to clone image mirror/10ad31ba3310 to image_cluster1.client.mirror.2-clone19 2024-09-21T15:11:29.913 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:29.909+0000 7ff753f07700 -1 reset not still connected to 0x5601694015f0 2024-09-21T15:11:29.919 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:29.917+0000 7ff753f07700 -1 reset not still connected to 0x56016b9cc750 2024-09-21T15:11:29.919 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:29.917+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e36c0 2024-09-21T15:11:30.631 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.538963020656579) > weight (0.25) 2024-09-21T15:11:30.631 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.27705302670740495) > weight (0.25) 2024-09-21T15:11:30.631 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.2 2024-09-21T15:11:30.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Sent signal 15 2024-09-21T15:11:30.631 INFO:tasks.rbd_mirror_thrash:waiting for 1 secs before reviving daemons 2024-09-21T15:11:30.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:11:30.629+0000 7f82a3b73700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 (PID: 28135) UID: 1000 2024-09-21T15:11:31.632 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.2 2024-09-21T15:11:31.633 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:11:31.633 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.2 2024-09-21T15:11:31.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Restarting daemon 2024-09-21T15:11:31.633 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 2024-09-21T15:11:31.636 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Started 2024-09-21T15:11:31.636 INFO:tasks.rbd_mirror_thrash:waiting for 66 secs before thrashing 2024-09-21T15:11:34.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.077+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461980 finish: resending after timeout 2024-09-21T15:11:34.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.077+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad140 finish: resending after timeout 2024-09-21T15:11:34.082 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.081+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588b40 finish: resending after timeout 2024-09-21T15:11:34.082 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.081+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bc300 finish: resending after timeout 2024-09-21T15:11:34.082 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.081+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43a40 finish: resending after timeout 2024-09-21T15:11:34.083 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.081+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c420c0 finish: resending after timeout 2024-09-21T15:11:34.083 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.081+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43140 finish: resending after timeout 2024-09-21T15:11:34.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.081+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e561140 finish: resending after timeout 2024-09-21T15:11:34.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.081+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad9095c0 finish: resending after timeout 2024-09-21T15:11:34.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.081+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59edea6c0 finish: resending after timeout 2024-09-21T15:11:34.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.081+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908fc0 finish: resending after timeout 2024-09-21T15:11:34.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.081+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560540 finish: resending after timeout 2024-09-21T15:11:34.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.081+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909a40 finish: resending after timeout 2024-09-21T15:11:34.085 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.081+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c780 finish: resending after timeout 2024-09-21T15:11:34.087 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.085+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a3de5bc0 finish: resending after timeout 2024-09-21T15:11:34.087 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.085+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0c00 finish: resending after timeout 2024-09-21T15:11:34.087 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.085+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b18c0 finish: resending after timeout 2024-09-21T15:11:34.088 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.085+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cadec0 finish: resending after timeout 2024-09-21T15:11:34.088 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.085+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e618fc0 finish: resending after timeout 2024-09-21T15:11:34.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.085+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1fbc0 finish: resending after timeout 2024-09-21T15:11:34.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.085+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461ec0 finish: resending after timeout 2024-09-21T15:11:34.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.085+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43980 finish: resending after timeout 2024-09-21T15:11:34.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.085+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61e840 finish: resending after timeout 2024-09-21T15:11:34.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.085+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae988300 finish: resending after timeout 2024-09-21T15:11:34.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.089+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9bc80 finish: resending after timeout 2024-09-21T15:11:34.090 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.089+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f380 finish: resending after timeout 2024-09-21T15:11:34.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.089+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909680 finish: resending after timeout 2024-09-21T15:11:34.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.089+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4618c0 finish: resending after timeout 2024-09-21T15:11:34.092 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.089+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2fc1140 finish: resending after timeout 2024-09-21T15:11:34.092 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.089+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560180 finish: resending after timeout 2024-09-21T15:11:34.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.137+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f680 finish: resending after timeout 2024-09-21T15:11:34.203 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.201+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334ccc0 finish: resending after timeout 2024-09-21T15:11:34.310 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.309+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461080 finish: resending after timeout 2024-09-21T15:11:34.332 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:34.329+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9b200 finish: resending after timeout 2024-09-21T15:11:37.887 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.877+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:11:37.892 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.881+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:11:37.892 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.881+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:11:37.892 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.885+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:11:37.892 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.885+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:11:37.892 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.885+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:11:37.892 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.885+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:11:37.892 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.885+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:11:37.894 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.889+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:11:37.894 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.889+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:11:37.905 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.897+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:11:37.905 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.897+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:11:37.905 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.897+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:11:37.906 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.897+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:11:37.906 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.897+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:11:37.916 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.909+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:11:37.916 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.909+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:11:37.916 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.909+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:11:37.916 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.909+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:11:37.916 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.913+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:11:37.916 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.913+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:11:37.923 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:11:37.923 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:11:37.923 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:11:37.923 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:11:37.923 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:11:37.924 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:11:37.924 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:11:37.924 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:11:37.924 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:11:37.924 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:11:37.924 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:11:37.924 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:11:37.924 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:11:37.924 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:11:37.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:11:37.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:11:37.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:11:37.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:11:37.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:11:37.921+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:11:42.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.881+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461980 finish: resending after timeout 2024-09-21T15:11:42.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.881+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad140 finish: resending after timeout 2024-09-21T15:11:42.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.881+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588b40 finish: resending after timeout 2024-09-21T15:11:42.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.881+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43140 finish: resending after timeout 2024-09-21T15:11:42.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.881+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e561140 finish: resending after timeout 2024-09-21T15:11:42.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.881+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad9095c0 finish: resending after timeout 2024-09-21T15:11:42.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.881+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59edea6c0 finish: resending after timeout 2024-09-21T15:11:42.886 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.881+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908fc0 finish: resending after timeout 2024-09-21T15:11:42.886 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.881+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560540 finish: resending after timeout 2024-09-21T15:11:42.886 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.881+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909a40 finish: resending after timeout 2024-09-21T15:11:42.886 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.885+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c780 finish: resending after timeout 2024-09-21T15:11:42.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.885+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a3de5bc0 finish: resending after timeout 2024-09-21T15:11:42.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.885+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0c00 finish: resending after timeout 2024-09-21T15:11:42.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.885+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b18c0 finish: resending after timeout 2024-09-21T15:11:42.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.885+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cadec0 finish: resending after timeout 2024-09-21T15:11:42.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.885+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e618fc0 finish: resending after timeout 2024-09-21T15:11:42.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.885+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1fbc0 finish: resending after timeout 2024-09-21T15:11:42.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.885+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461ec0 finish: resending after timeout 2024-09-21T15:11:42.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.885+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43980 finish: resending after timeout 2024-09-21T15:11:42.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.885+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61e840 finish: resending after timeout 2024-09-21T15:11:42.890 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.889+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9bc80 finish: resending after timeout 2024-09-21T15:11:42.891 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.889+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae988300 finish: resending after timeout 2024-09-21T15:11:42.891 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.889+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f380 finish: resending after timeout 2024-09-21T15:11:42.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.889+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909680 finish: resending after timeout 2024-09-21T15:11:42.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.889+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4618c0 finish: resending after timeout 2024-09-21T15:11:42.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.889+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2fc1140 finish: resending after timeout 2024-09-21T15:11:42.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.889+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560180 finish: resending after timeout 2024-09-21T15:11:42.893 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.889+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f680 finish: resending after timeout 2024-09-21T15:11:42.893 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.889+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334ccc0 finish: resending after timeout 2024-09-21T15:11:42.893 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.893+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461080 finish: resending after timeout 2024-09-21T15:11:42.894 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:42.893+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9b200 finish: resending after timeout 2024-09-21T15:11:47.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:47.881+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461980 finish: resending after timeout 2024-09-21T15:11:47.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:47.881+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad140 finish: resending after timeout 2024-09-21T15:11:47.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:47.881+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588b40 finish: resending after timeout 2024-09-21T15:11:47.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:47.881+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e561140 finish: resending after timeout 2024-09-21T15:11:47.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:47.881+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad9095c0 finish: resending after timeout 2024-09-21T15:11:47.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:47.881+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59edea6c0 finish: resending after timeout 2024-09-21T15:11:47.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:47.885+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908fc0 finish: resending after timeout 2024-09-21T15:11:47.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:47.885+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560540 finish: resending after timeout 2024-09-21T15:11:47.886 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:47.885+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909a40 finish: resending after timeout 2024-09-21T15:11:47.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:47.885+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c780 finish: resending after timeout 2024-09-21T15:11:47.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:47.885+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a3de5bc0 finish: resending after timeout 2024-09-21T15:11:47.955 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.949+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac0000 2024-09-21T15:11:47.956 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.949+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb184e0 2024-09-21T15:11:47.963 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.957+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:11:47.963 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.957+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:11:47.964 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.957+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:11:47.964 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.957+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:11:47.964 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.957+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:11:47.964 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.957+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:11:47.964 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.957+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:11:47.964 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.957+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:11:47.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049ee0 2024-09-21T15:11:47.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:11:47.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:11:47.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:11:47.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:11:47.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:11:47.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:11:47.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c9c0 2024-09-21T15:11:47.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266d6c0 2024-09-21T15:11:47.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:11:47.970 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:11:47.970 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:11:47.970 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:11:47.970 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.961+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51930 2024-09-21T15:11:47.971 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:11:47.972 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:11:47.972 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31004e0 2024-09-21T15:11:47.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:11:47.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:11:47.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:11:47.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:11:47.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:11:47.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:11:47.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.965+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:11:47.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:11:47.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:11:47.975 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:11:47.975 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b36868f0 2024-09-21T15:11:47.975 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:11:47.975 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:11:47.975 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:11:47.975 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:11:47.975 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:11:47.975 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76c30 2024-09-21T15:11:47.975 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:11:47.975 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:11:47.975 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:11:47.976 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:11:47.977 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.969+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:11:47.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.977+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:11:47.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.989+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:11:47.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.989+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:11:47.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.989+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:11:47.994 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.989+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:11:47.998 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:11:47.998 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:11:47.998 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:47.997+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:11:48.012 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:11:48.013 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:11:48.016 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:11:48.016 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:11:48.016 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:11:48.016 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:11:48.016 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ad638750 2024-09-21T15:11:48.016 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adaa3c70 2024-09-21T15:11:48.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5860 2024-09-21T15:11:48.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5d40 2024-09-21T15:11:48.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25aa90 2024-09-21T15:11:48.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25ac30 2024-09-21T15:11:48.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25bba0 2024-09-21T15:11:48.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.009+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344680 2024-09-21T15:11:48.017 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344750 2024-09-21T15:11:48.018 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:11:48.018 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.013+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47e1a0 2024-09-21T15:11:48.022 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47f380 2024-09-21T15:11:48.022 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810b60 2024-09-21T15:11:48.022 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae8d8000 2024-09-21T15:11:48.022 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:11:48.022 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aef04b60 2024-09-21T15:11:48.022 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac0000 2024-09-21T15:11:48.022 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb184e0 2024-09-21T15:11:48.022 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:11:48.022 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:11:48.022 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:11:48.023 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:11:48.023 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07790 2024-09-21T15:11:48.023 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:11:48.023 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.017+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4cf70 2024-09-21T15:11:48.025 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:11:48.025 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:11:48.025 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:11:48.025 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049ee0 2024-09-21T15:11:48.025 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:11:48.025 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:11:48.025 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:11:48.025 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:11:48.025 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:11:48.025 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:11:48.025 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c9c0 2024-09-21T15:11:48.026 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266d6c0 2024-09-21T15:11:48.026 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:11:48.026 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:11:48.026 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:11:48.026 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:11:48.026 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51930 2024-09-21T15:11:48.026 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:11:48.026 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:11:48.026 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31004e0 2024-09-21T15:11:48.026 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:11:48.026 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:11:48.026 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:11:48.026 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b36868f0 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76c30 2024-09-21T15:11:48.027 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:11:48.028 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:11:48.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:11:48.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:11:48.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:11:48.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:11:48.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:11:48.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:11:48.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:11:48.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:11:48.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:11:48.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:11:48.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:11:48.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:48.021+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:11:52.858 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:52.848+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:11:52.858 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:52.848+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:11:52.858 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:52.852+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:11:52.866 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:52.852+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:11:52.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.864+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ad0 2024-09-21T15:11:52.875 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.864+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:11:52.887 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.880+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:11:52.887 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.880+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df812b0 2024-09-21T15:11:52.892 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.884+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81930 2024-09-21T15:11:52.892 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.884+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81ba0 2024-09-21T15:11:52.903 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.892+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e0ea8f0 2024-09-21T15:11:52.903 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.892+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:11:52.903 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.892+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e115040 2024-09-21T15:11:52.903 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.892+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e7ea270 2024-09-21T15:11:52.903 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.892+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:11:52.907 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4340 2024-09-21T15:11:52.907 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e49c0 2024-09-21T15:11:52.907 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4c30 2024-09-21T15:11:52.908 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4f70 2024-09-21T15:11:52.908 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e51e0 2024-09-21T15:11:52.908 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5860 2024-09-21T15:11:52.908 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ba0 2024-09-21T15:11:52.908 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5c70 2024-09-21T15:11:52.909 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ee0 2024-09-21T15:11:52.909 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:11:52.909 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb24c30 2024-09-21T15:11:52.909 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:11:52.909 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25790 2024-09-21T15:11:52.910 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fdd61a0 2024-09-21T15:11:52.910 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c270 2024-09-21T15:11:52.910 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:11:52.910 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c9c0 2024-09-21T15:11:52.910 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cb60 2024-09-21T15:11:52.911 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cd00 2024-09-21T15:11:52.911 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dee0 2024-09-21T15:11:52.911 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed01a0 2024-09-21T15:11:52.911 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed0ea0 2024-09-21T15:11:52.911 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f4820 2024-09-21T15:11:52.911 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f55f0 2024-09-21T15:11:52.911 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:11:52.911 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.896+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1110 2024-09-21T15:11:52.914 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.900+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1e10 2024-09-21T15:11:52.915 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.900+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16000 2024-09-21T15:11:52.915 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.900+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:11:52.915 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.900+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16b60 2024-09-21T15:11:52.916 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.900+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17040 2024-09-21T15:11:52.916 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.900+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb0000 2024-09-21T15:11:52.916 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.900+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb1c70 2024-09-21T15:11:52.916 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.900+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:11:52.916 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.900+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:11:52.916 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.900+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:11:52.916 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.900+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb110 2024-09-21T15:11:52.929 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb2b0 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0f70 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef12b0 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232aea0 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b860 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8000 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8340 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:11:52.930 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8d00 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9450 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb95f0 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9930 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9c70 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x55714346a340 2024-09-21T15:11:52.931 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x55714346b930 2024-09-21T15:11:52.932 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cdd0 2024-09-21T15:11:52.932 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:11:52.916+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cea0 2024-09-21T15:11:53.656 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:53.652+0000 7f7fd044c700 -1 reset not still connected to 0x56369f5dc000 2024-09-21T15:11:53.658 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:53.656+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:11:53.658 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:53.656+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:11:53.658 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:53.656+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:11:53.658 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:53.656+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:11:53.658 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:53.656+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:11:53.658 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:53.656+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:11:53.659 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:53.656+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:11:53.659 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:53.656+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:11:53.659 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:53.656+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:11:55.334 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.331+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:11:55.334 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.331+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7149ad0 2024-09-21T15:11:55.339 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.335+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:11:55.340 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.339+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:11:55.340 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.339+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:11:55.342 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.339+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff64820 2024-09-21T15:11:55.348 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.343+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:11:55.348 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.343+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:11:55.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.343+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4340 2024-09-21T15:11:55.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4750 2024-09-21T15:11:55.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:11:55.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:11:55.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:11:55.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:11:55.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:11:55.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:11:55.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:11:55.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:11:55.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:11:55.350 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:11:55.350 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:11:55.350 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:11:55.350 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:11:55.350 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:11:55.350 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a750 2024-09-21T15:11:55.350 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:11:55.350 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:11:55.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:11:55.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:11:55.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:11:55.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:11:55.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:11:55.347+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:11:57.870 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.860+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:11:57.871 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.864+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:11:57.901 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.892+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:11:57.901 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.892+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:11:57.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0c00 finish: resending after timeout 2024-09-21T15:11:57.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b18c0 finish: resending after timeout 2024-09-21T15:11:57.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cadec0 finish: resending after timeout 2024-09-21T15:11:57.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e618fc0 finish: resending after timeout 2024-09-21T15:11:57.908 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1fbc0 finish: resending after timeout 2024-09-21T15:11:57.908 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461ec0 finish: resending after timeout 2024-09-21T15:11:57.908 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43980 finish: resending after timeout 2024-09-21T15:11:57.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61e840 finish: resending after timeout 2024-09-21T15:11:57.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9bc80 finish: resending after timeout 2024-09-21T15:11:57.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae988300 finish: resending after timeout 2024-09-21T15:11:57.909 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:11:57.914 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:11:57.914 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:11:57.915 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:11:57.915 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:11:57.915 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.912+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f380 finish: resending after timeout 2024-09-21T15:11:57.916 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:11:57.916 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:11:57.916 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:11:57.916 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.904+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:11:57.923 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.920+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909680 finish: resending after timeout 2024-09-21T15:11:57.923 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.920+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4618c0 finish: resending after timeout 2024-09-21T15:11:57.927 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.924+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2fc1140 finish: resending after timeout 2024-09-21T15:11:57.928 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.920+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:11:57.928 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.920+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:11:57.928 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.920+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:11:57.928 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.920+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:11:57.928 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.920+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:11:57.929 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.924+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560180 finish: resending after timeout 2024-09-21T15:11:57.929 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.924+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f680 finish: resending after timeout 2024-09-21T15:11:57.929 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.924+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334ccc0 finish: resending after timeout 2024-09-21T15:11:57.929 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.924+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461080 finish: resending after timeout 2024-09-21T15:11:57.929 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9b200 finish: resending after timeout 2024-09-21T15:11:57.930 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461980 finish: resending after timeout 2024-09-21T15:11:57.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad9095c0 finish: resending after timeout 2024-09-21T15:11:57.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59edea6c0 finish: resending after timeout 2024-09-21T15:11:57.932 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908fc0 finish: resending after timeout 2024-09-21T15:11:57.932 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909a40 finish: resending after timeout 2024-09-21T15:11:57.932 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.920+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:11:57.932 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.920+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:11:57.938 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.936+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c780 finish: resending after timeout 2024-09-21T15:11:57.941 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:11:57.941 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:11:57.941 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d85b0 2024-09-21T15:11:57.941 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782a90 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783040 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:11:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:11:57.943 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:11:57.943 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783e10 2024-09-21T15:11:57.943 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:11:57.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:57.936+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a3de5bc0 finish: resending after timeout 2024-09-21T15:11:57.944 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.932+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:11:57.944 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.932+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:11:57.944 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.932+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:11:57.944 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.932+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47040 2024-09-21T15:11:57.944 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.932+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:11:57.944 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.932+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:11:57.944 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.932+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:11:57.944 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:11:57.932+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:11:58.094 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:58.088+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3ec7860 handle_clone_image: failed to clone image mirror/10b45ee8c178 to image_cluster1.client.mirror.3-clone56 2024-09-21T15:11:58.196 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:58.192+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59fbbcb40 handle_clone_image: failed to clone image mirror/10aeab1f4a58 to image_cluster1.client.mirror.1-clone23 2024-09-21T15:11:58.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:58.404+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3ec6000 handle_clone_image: failed to clone image mirror/10b6c945d42f to image_cluster1.client.mirror.4-clone50 2024-09-21T15:11:58.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:58.456+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a2481c20 handle_clone_image: failed to clone image mirror/10add02eae04 to image_cluster1.client.mirror.2-clone33 2024-09-21T15:11:58.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:58.680+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a1eca1e0 handle_clone_image: failed to clone image mirror/10b4954dd49a to image_cluster1.client.mirror.3-clone40 2024-09-21T15:11:58.692 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:58.688+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59eef0960 handle_clone_image: failed to clone image mirror/10b479a83609 to image_cluster1.client.mirror.3-clone48 2024-09-21T15:11:58.730 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:58.728+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a1eca960 handle_clone_image: failed to clone image mirror/10b6785f577e to image_cluster1.client.mirror.4-clone40 2024-09-21T15:11:58.734 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:58.732+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a269f860 handle_clone_image: failed to clone image mirror/10b4726378e0 to image_cluster1.client.mirror.3-clone20 2024-09-21T15:11:58.925 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:58.920+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3546b40 handle_clone_image: failed to clone image mirror/10b4de9218fc to image_cluster1.client.mirror.3-clone35 2024-09-21T15:11:58.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:58.952+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a1ecb4a0 handle_clone_image: failed to clone image mirror/10b7375492f5 to image_cluster1.client.mirror.5-clone36 2024-09-21T15:11:59.037 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:59.032+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3c05c20 handle_clone_image: failed to clone image mirror/10b6858d977f to image_cluster1.client.mirror.4-clone34 2024-09-21T15:11:59.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:59.048+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3f99c20 handle_clone_image: failed to clone image mirror/10b6b549e4a1 to image_cluster1.client.mirror.4-clone15 2024-09-21T15:11:59.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:11:59.080+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59fa57a40 handle_clone_image: failed to clone image mirror/10ad31ba3310 to image_cluster1.client.mirror.2-clone19 2024-09-21T15:12:02.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.040+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:12:02.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.040+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:12:02.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.040+0000 7ff753f07700 -1 reset not still connected to 0x560169eaa0d0 2024-09-21T15:12:02.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.040+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:12:02.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.052+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f7040 2024-09-21T15:12:02.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.060+0000 7ff753f07700 -1 reset not still connected to 0x56016a50b1e0 2024-09-21T15:12:02.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.060+0000 7ff753f07700 -1 reset not still connected to 0x56016aeceb60 2024-09-21T15:12:02.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.060+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:12:02.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.060+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:12:02.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.060+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:12:02.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.060+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:12:02.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.060+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:12:02.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.060+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:12:02.080 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba4e0 2024-09-21T15:12:02.080 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:12:02.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:12:02.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc60d0 2024-09-21T15:12:02.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:12:02.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:12:02.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:12:02.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:12:02.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e340 2024-09-21T15:12:02.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.068+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016f1629c0 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:12:02.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:12:02.086 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56017063fee0 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9930 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:12:02.087 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:12:02.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:12:02.089 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:12:02.089 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:12:02.089 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:12:02.089 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:02.072+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:12:02.906 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.903+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:12:02.919 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.915+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:12:02.920 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.919+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:12:02.920 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.919+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:12:02.922 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.919+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:12:02.922 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.919+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:12:02.929 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.923+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:12:02.932 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.931+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:12:02.932 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.931+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:12:02.932 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.931+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:12:02.932 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.931+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:12:02.934 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.931+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:12:02.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:12:02.946 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:12:02.947 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:12:02.947 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.943+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:12:02.949 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.947+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbbba0 2024-09-21T15:12:02.949 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.947+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a750 2024-09-21T15:12:02.950 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.947+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:12:02.950 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.947+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:12:02.954 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.951+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:12:02.954 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.951+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:12:02.954 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.951+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:12:02.955 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.951+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:12:02.955 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.951+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:12:02.955 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.951+0000 7f7fd044c700 -1 reset not still connected to 0x56369e02d6c0 2024-09-21T15:12:02.955 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.951+0000 7f7fd044c700 -1 reset not still connected to 0x56369e5756c0 2024-09-21T15:12:02.955 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.951+0000 7f7fd044c700 -1 reset not still connected to 0x56369e6189c0 2024-09-21T15:12:02.966 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x56369e619520 2024-09-21T15:12:02.966 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x56369f5dc000 2024-09-21T15:12:02.966 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:12:02.967 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef03ba0 2024-09-21T15:12:02.967 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:12:02.967 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:12:02.967 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:12:02.967 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x5636b7149ad0 2024-09-21T15:12:02.967 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb9930 2024-09-21T15:12:02.967 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:12:02.967 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e000 2024-09-21T15:12:02.967 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:12:02.967 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e5b0 2024-09-21T15:12:02.967 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:12:02.967 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff64820 2024-09-21T15:12:02.967 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.963+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbb2b0 2024-09-21T15:12:02.969 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.967+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc40d0 2024-09-21T15:12:02.969 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.967+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:12:02.971 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.967+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:12:02.971 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.967+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4340 2024-09-21T15:12:02.971 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.967+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4750 2024-09-21T15:12:02.971 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4f70 2024-09-21T15:12:02.971 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:12:02.972 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:12:02.972 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:12:02.974 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:12:02.974 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:12:02.974 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:12:02.974 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:12:02.974 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:12:02.974 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:12:02.974 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:12:02.974 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:12:02.975 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:12:02.975 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:12:02.975 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:12:02.975 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.971+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:12:02.978 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.975+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:12:02.978 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.975+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbbba0 2024-09-21T15:12:02.978 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.975+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a750 2024-09-21T15:12:02.978 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.975+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:12:02.978 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.975+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:12:02.979 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.975+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:12:02.979 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.975+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:12:02.979 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.975+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:12:02.979 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.975+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:12:02.979 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:02.975+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:12:03.370 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:03.363+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:12:03.371 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:03.363+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:12:03.371 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:03.367+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:12:03.387 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:03.375+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:12:03.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:03.379+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:12:03.389 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:03.383+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a8f0 2024-09-21T15:12:03.389 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:03.383+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:12:03.389 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:03.383+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540b60 2024-09-21T15:12:03.389 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:03.383+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:12:07.879 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.868+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adaa3c70 2024-09-21T15:12:07.938 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:12:07.938 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:12:07.938 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:12:07.938 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.928+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:12:07.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:12:07.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:12:07.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:12:07.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:12:07.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:12:07.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:12:07.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:12:07.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:12:07.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:12:07.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:12:07.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:12:07.948 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:12:07.948 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:12:07.948 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:07.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:12:12.966 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.964+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0c00 finish: resending after timeout 2024-09-21T15:12:12.968 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.964+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b18c0 finish: resending after timeout 2024-09-21T15:12:12.969 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.964+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cadec0 finish: resending after timeout 2024-09-21T15:12:12.969 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.964+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e618fc0 finish: resending after timeout 2024-09-21T15:12:12.969 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.968+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1fbc0 finish: resending after timeout 2024-09-21T15:12:12.970 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.968+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461ec0 finish: resending after timeout 2024-09-21T15:12:12.970 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.968+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43980 finish: resending after timeout 2024-09-21T15:12:12.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.968+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61e840 finish: resending after timeout 2024-09-21T15:12:12.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.968+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9bc80 finish: resending after timeout 2024-09-21T15:12:12.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.968+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae988300 finish: resending after timeout 2024-09-21T15:12:12.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.968+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f380 finish: resending after timeout 2024-09-21T15:12:12.974 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909680 finish: resending after timeout 2024-09-21T15:12:12.974 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4618c0 finish: resending after timeout 2024-09-21T15:12:12.974 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2fc1140 finish: resending after timeout 2024-09-21T15:12:12.975 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560180 finish: resending after timeout 2024-09-21T15:12:12.975 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f680 finish: resending after timeout 2024-09-21T15:12:12.975 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334ccc0 finish: resending after timeout 2024-09-21T15:12:12.975 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.972+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461080 finish: resending after timeout 2024-09-21T15:12:12.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9b200 finish: resending after timeout 2024-09-21T15:12:12.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461980 finish: resending after timeout 2024-09-21T15:12:12.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.976+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a3de5bc0 finish: resending after timeout 2024-09-21T15:12:12.979 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.976+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61ee40 finish: resending after timeout 2024-09-21T15:12:12.979 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.976+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae989c80 finish: resending after timeout 2024-09-21T15:12:12.979 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.976+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908d80 finish: resending after timeout 2024-09-21T15:12:12.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:12.976+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:12:17.038 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:Note: switching to 'a477b1894d5c5a613f23260ca0e6b96d79652ba7'. 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: git switch -c 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:Or undo this operation with: 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: git switch - 2024-09-21T15:12:17.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:12:17.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T15:12:17.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: 2024-09-21T15:12:17.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:HEAD is now at a477b1894d5 Merge pull request #59761 from rhcs-dashboard/reef-hosts-selection-show-only-10-entries-fix 2024-09-21T15:12:17.046 DEBUG:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror 2024-09-21T15:12:17.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T15:12:17.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/direct_io' 2024-09-21T15:12:17.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T15:12:17.121 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T15:12:17.193 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T15:12:17.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/direct_io' 2024-09-21T15:12:17.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/fs' 2024-09-21T15:12:17.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T15:12:17.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/fs' 2024-09-21T15:12:17.311 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-21T15:12:17.311 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror of=/dev/stdout 2024-09-21T15:12:17.318 INFO:tasks.workunit:Running workunits matching rbd/rbd_mirror_fsx_compare.sh on cluster1.client.mirror... 2024-09-21T15:12:17.319 INFO:tasks.workunit:Running workunit rbd/rbd_mirror_fsx_compare.sh... 2024-09-21T15:12:17.319 DEBUG:teuthology.orchestra.run.smithi161:workunit test rbd/rbd_mirror_fsx_compare.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a477b1894d5c5a613f23260ca0e6b96d79652ba7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS='' RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_fsx_compare.sh 2024-09-21T15:12:17.331 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ dirname /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_fsx_compare.sh 2024-09-21T15:12:17.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ . /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_helpers.sh 2024-09-21T15:12:17.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ type xmlstarlet 2024-09-21T15:12:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ XMLSTARLET=xmlstarlet 2024-09-21T15:12:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ RBD_MIRROR_INSTANCES=2 2024-09-21T15:12:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CLUSTER1=cluster1 2024-09-21T15:12:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CLUSTER2=cluster2 2024-09-21T15:12:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ PEER_CLUSTER_SUFFIX= 2024-09-21T15:12:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ POOL=mirror 2024-09-21T15:12:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ PARENT_POOL=mirror_parent 2024-09-21T15:12:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ NS1=ns1 2024-09-21T15:12:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ NS2=ns2 2024-09-21T15:12:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ TEMPDIR= 2024-09-21T15:12:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CEPH_ID=mirror 2024-09-21T15:12:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ RBD_IMAGE_FEATURES=layering,exclusive-lock,journaling 2024-09-21T15:12:17.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ MIRROR_USER_ID_PREFIX=mirror. 2024-09-21T15:12:17.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ MIRROR_POOL_MODE=pool 2024-09-21T15:12:17.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ MIRROR_IMAGE_MODE=journal 2024-09-21T15:12:17.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ export 'CEPH_ARGS=--id mirror' 2024-09-21T15:12:17.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CEPH_ARGS='--id mirror' 2024-09-21T15:12:17.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ LAST_MIRROR_INSTANCE=1 2024-09-21T15:12:17.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++++ dirname /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_fsx_compare.sh 2024-09-21T15:12:17.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+++ readlink -f /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/../../../src 2024-09-21T15:12:17.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror/src 2024-09-21T15:12:17.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CEPH_BIN=. 2024-09-21T15:12:17.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ CEPH_SRC=. 2024-09-21T15:12:17.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ '[' -e CMakeCache.txt ']' 2024-09-21T15:12:17.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ '[' 0 -gt 0 ']' 2024-09-21T15:12:17.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ trap 'cleanup $?' INT TERM EXIT 2024-09-21T15:12:17.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ setup_tempdir 2024-09-21T15:12:17.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -n '' ']' 2024-09-21T15:12:17.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ mktemp -d 2024-09-21T15:12:17.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ TEMPDIR=/tmp/tmp.ZUZ2ADv8z3 2024-09-21T15:12:17.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ testlog 'TEST: wait for all images' 2024-09-21T15:12:17.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ tee -a /tmp/tmp.ZUZ2ADv8z3/rbd-mirror.test.log 2024-09-21T15:12:17.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ date '+%F %T' 2024-09-21T15:12:17.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ echo 2024-09-21 15:12:17 TEST: wait for all images 2024-09-21T15:12:17.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:2024-09-21 15:12:17 TEST: wait for all images 2024-09-21T15:12:17.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --pool mirror ls 2024-09-21T15:12:17.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:12:17.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ image_count=263 2024-09-21T15:12:17.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=0 2024-09-21T15:12:17.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep_seconds=10 2024-09-21T15:12:17.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 0 -le 7200 ']' 2024-09-21T15:12:17.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:12:17.402 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:12:17.454 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 221 -ge 263 ']' 2024-09-21T15:12:17.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:12:17.883 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:17.876+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:12:17.884 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:17.876+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:12:17.884 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:17.876+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:12:17.884 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:17.876+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:12:17.966 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.964+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b0c00 finish: resending after timeout 2024-09-21T15:12:17.969 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.964+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b18c0 finish: resending after timeout 2024-09-21T15:12:17.969 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.968+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cadec0 finish: resending after timeout 2024-09-21T15:12:17.970 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.968+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e618fc0 finish: resending after timeout 2024-09-21T15:12:17.970 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.968+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1fbc0 finish: resending after timeout 2024-09-21T15:12:17.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.968+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461ec0 finish: resending after timeout 2024-09-21T15:12:17.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.968+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43980 finish: resending after timeout 2024-09-21T15:12:17.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.968+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61e840 finish: resending after timeout 2024-09-21T15:12:17.974 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9bc80 finish: resending after timeout 2024-09-21T15:12:17.974 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.972+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae988300 finish: resending after timeout 2024-09-21T15:12:17.974 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.972+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f380 finish: resending after timeout 2024-09-21T15:12:17.975 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909680 finish: resending after timeout 2024-09-21T15:12:17.976 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.972+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4618c0 finish: resending after timeout 2024-09-21T15:12:17.976 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2fc1140 finish: resending after timeout 2024-09-21T15:12:17.976 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.972+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560180 finish: resending after timeout 2024-09-21T15:12:17.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f680 finish: resending after timeout 2024-09-21T15:12:17.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.976+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334ccc0 finish: resending after timeout 2024-09-21T15:12:17.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.976+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461080 finish: resending after timeout 2024-09-21T15:12:17.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.976+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9b200 finish: resending after timeout 2024-09-21T15:12:17.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.976+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461980 finish: resending after timeout 2024-09-21T15:12:17.979 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.976+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61ee40 finish: resending after timeout 2024-09-21T15:12:17.979 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.976+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae989c80 finish: resending after timeout 2024-09-21T15:12:17.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.976+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908d80 finish: resending after timeout 2024-09-21T15:12:17.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:17.976+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:12:22.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.968+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cadec0 finish: resending after timeout 2024-09-21T15:12:22.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.968+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e618fc0 finish: resending after timeout 2024-09-21T15:12:22.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.968+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1fbc0 finish: resending after timeout 2024-09-21T15:12:22.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.968+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461ec0 finish: resending after timeout 2024-09-21T15:12:22.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.968+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43980 finish: resending after timeout 2024-09-21T15:12:22.973 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.968+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61e840 finish: resending after timeout 2024-09-21T15:12:22.976 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9bc80 finish: resending after timeout 2024-09-21T15:12:22.976 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae988300 finish: resending after timeout 2024-09-21T15:12:22.976 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.972+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f380 finish: resending after timeout 2024-09-21T15:12:22.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.972+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909680 finish: resending after timeout 2024-09-21T15:12:22.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.972+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4618c0 finish: resending after timeout 2024-09-21T15:12:22.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.976+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2fc1140 finish: resending after timeout 2024-09-21T15:12:22.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.976+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560180 finish: resending after timeout 2024-09-21T15:12:22.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.976+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f680 finish: resending after timeout 2024-09-21T15:12:22.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.976+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334ccc0 finish: resending after timeout 2024-09-21T15:12:22.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.976+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461080 finish: resending after timeout 2024-09-21T15:12:22.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.976+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9b200 finish: resending after timeout 2024-09-21T15:12:22.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.980+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461980 finish: resending after timeout 2024-09-21T15:12:22.982 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.980+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61ee40 finish: resending after timeout 2024-09-21T15:12:22.982 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.980+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae989c80 finish: resending after timeout 2024-09-21T15:12:22.983 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.980+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908d80 finish: resending after timeout 2024-09-21T15:12:22.983 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:22.980+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:12:27.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=10 2024-09-21T15:12:27.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 10 -le 7200 ']' 2024-09-21T15:12:27.457 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:12:27.457 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:12:27.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 221 -ge 263 ']' 2024-09-21T15:12:27.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:12:28.001 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:27.996+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3f98b40 handle_clone_image: failed to clone image mirror/10b45ee8c178 to image_cluster1.client.mirror.3-clone56 2024-09-21T15:12:28.191 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:28.188+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3546960 handle_clone_image: failed to clone image mirror/10b7a86900d8 to image_cluster1.client.mirror.5-clone26 2024-09-21T15:12:28.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.224+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:12:28.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.224+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:12:28.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.228+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:12:28.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.232+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:12:28.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.232+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:12:28.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.232+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:12:28.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.232+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:12:28.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.232+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:12:28.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.252+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:12:28.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.252+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:12:28.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.252+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:12:28.257 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.252+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b85b0 2024-09-21T15:12:28.258 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.252+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:12:28.258 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.252+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:12:28.258 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.252+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:12:28.258 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.252+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba4e0 2024-09-21T15:12:28.258 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:12:28.258 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb040 2024-09-21T15:12:28.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:12:28.261 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:12:28.261 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:12:28.261 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:12:28.261 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:12:28.262 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:12:28.263 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:12:28.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:12:28.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:12:28.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:12:28.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:12:28.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:12:28.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:12:28.266 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:12:28.266 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:12:28.266 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:12:28.266 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:12:28.266 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:12:28.266 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:12:28.267 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.260+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:12:28.267 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.260+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:12:28.267 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.260+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:12:28.267 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.260+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:12:28.267 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.260+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:12:28.267 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.260+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:12:28.267 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.264+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:12:28.267 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.264+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:12:28.267 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.264+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:12:28.272 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.268+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:12:28.272 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.268+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:12:28.272 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.268+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:12:28.272 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.268+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:12:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.268+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:12:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.268+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:12:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.268+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9930 2024-09-21T15:12:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.268+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:12:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.268+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:12:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.268+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:12:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.268+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:12:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.268+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:12:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.268+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:12:28.275 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:12:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:12:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:12:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:12:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:12:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:12:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:12:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:12:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:12:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:12:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:12:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:12:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:12:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:12:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:12:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:12:28.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:12:28.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:28.380+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a0d070e0 handle_clone_image: failed to clone image mirror/10add02eae04 to image_cluster1.client.mirror.2-clone33 2024-09-21T15:12:28.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:28.428+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a1eca780 handle_clone_image: failed to clone image mirror/10b65cf2d949 to image_cluster1.client.mirror.4-clone47 2024-09-21T15:12:28.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:28.460+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a0d07c20 handle_clone_image: failed to clone image mirror/10b6785f577e to image_cluster1.client.mirror.4-clone40 2024-09-21T15:12:28.491 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:28.488+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59e1081e0 handle_clone_image: failed to clone image mirror/10b479a83609 to image_cluster1.client.mirror.3-clone48 2024-09-21T15:12:28.754 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:28.752+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a01690e0 handle_clone_image: failed to clone image mirror/10b4de9218fc to image_cluster1.client.mirror.3-clone35 2024-09-21T15:12:28.816 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:28.812+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a0d11680 handle_clone_image: failed to clone image mirror/10b7375492f5 to image_cluster1.client.mirror.5-clone36 2024-09-21T15:12:28.845 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:28.835+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:12:28.848 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:28.839+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:12:28.848 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:28.839+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:12:28.848 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:28.839+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:12:29.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:29.108+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a174e960 handle_clone_image: failed to clone image mirror/10b4726378e0 to image_cluster1.client.mirror.3-clone20 2024-09-21T15:12:29.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:29.144+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a1ecbc20 handle_clone_image: failed to clone image mirror/10b6858d977f to image_cluster1.client.mirror.4-clone34 2024-09-21T15:12:29.193 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:29.192+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59faa94a0 handle_clone_image: failed to clone image mirror/10b6b549e4a1 to image_cluster1.client.mirror.4-clone15 2024-09-21T15:12:29.200 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:29.196+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a7465680 handle_clone_image: failed to clone image mirror/10adc4083ff6 to image_cluster1.client.mirror.2-clone10 2024-09-21T15:12:29.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:29.216+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a29101e0 handle_clone_image: failed to clone image mirror/10ad31ba3310 to image_cluster1.client.mirror.2-clone19 2024-09-21T15:12:32.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:32.892+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:12:34.103 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.100+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a1c43980 finish: resending after timeout 2024-09-21T15:12:34.103 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.100+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61e840 finish: resending after timeout 2024-09-21T15:12:34.104 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.100+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9bc80 finish: resending after timeout 2024-09-21T15:12:34.104 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.100+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae988300 finish: resending after timeout 2024-09-21T15:12:34.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.100+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f380 finish: resending after timeout 2024-09-21T15:12:34.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909680 finish: resending after timeout 2024-09-21T15:12:34.106 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4618c0 finish: resending after timeout 2024-09-21T15:12:34.106 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2fc1140 finish: resending after timeout 2024-09-21T15:12:34.107 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560180 finish: resending after timeout 2024-09-21T15:12:34.107 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f680 finish: resending after timeout 2024-09-21T15:12:34.108 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334ccc0 finish: resending after timeout 2024-09-21T15:12:34.108 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461080 finish: resending after timeout 2024-09-21T15:12:34.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9b200 finish: resending after timeout 2024-09-21T15:12:34.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461980 finish: resending after timeout 2024-09-21T15:12:34.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61ee40 finish: resending after timeout 2024-09-21T15:12:34.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae989c80 finish: resending after timeout 2024-09-21T15:12:34.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908d80 finish: resending after timeout 2024-09-21T15:12:34.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:12:34.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.104+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61fe00 finish: resending after timeout 2024-09-21T15:12:34.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.108+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f80c0 finish: resending after timeout 2024-09-21T15:12:34.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.108+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9af00 finish: resending after timeout 2024-09-21T15:12:34.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:34.108+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c0c0 finish: resending after timeout 2024-09-21T15:12:34.386 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.379+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:12:34.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.379+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3ee0 2024-09-21T15:12:34.389 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.383+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:12:34.397 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.391+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:12:34.397 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.391+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:12:34.405 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.399+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:12:34.405 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.399+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:12:34.405 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.399+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:12:34.405 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.399+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:12:34.408 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.403+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:12:34.409 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.403+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:12:34.409 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.403+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:12:34.409 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.403+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:12:34.409 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.407+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780ed00 2024-09-21T15:12:34.410 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.407+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:12:34.410 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.407+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:12:34.418 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.415+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:12:34.419 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.415+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:12:34.419 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.415+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:12:34.419 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.415+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:12:34.429 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.419+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:12:34.429 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.419+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:12:34.429 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.419+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aa86f930 2024-09-21T15:12:34.429 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.419+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:12:34.429 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.419+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:12:34.433 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.431+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:12:34.433 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.431+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:12:34.434 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.431+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:12:34.434 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.431+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f2b0 2024-09-21T15:12:34.434 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.431+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:12:34.439 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:12:34.439 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:12:34.439 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c4e0 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:12:34.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9ee0 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b00e7ee0 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540b60 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:12:34.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:34.435+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:12:37.632 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.622+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:12:37.632 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.622+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:12:37.632 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.622+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:12:37.632 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.622+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:12:37.632 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.622+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:12:37.632 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.626+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:12:37.632 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.626+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:12:37.632 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.626+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:12:37.636 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.634+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:12:37.636 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.634+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:12:37.636 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.3952454471833534) > weight (0.25) 2024-09-21T15:12:37.636 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.9696041257365153) > weight (0.25) 2024-09-21T15:12:37.636 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.2 with skip (0.9108346201582106) > weight (0.25) 2024-09-21T15:12:37.637 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.3 with skip (0.7930521038618195) > weight (0.25) 2024-09-21T15:12:37.637 INFO:tasks.rbd_mirror_thrash:waiting for 91 secs before thrashing 2024-09-21T15:12:37.647 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.638+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:12:37.649 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.646+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:12:37.649 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.646+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:12:37.659 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.654+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:12:37.659 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.654+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:12:37.660 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.654+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:12:37.661 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.658+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:12:37.661 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.658+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:12:37.669 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.662+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:12:37.669 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.662+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f1e0 2024-09-21T15:12:37.669 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f2b0 2024-09-21T15:12:37.669 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:12:37.670 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:12:37.670 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:12:37.670 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:12:37.670 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c4e0 2024-09-21T15:12:37.670 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18dc70 2024-09-21T15:12:37.671 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e8410 2024-09-21T15:12:37.671 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:12:37.672 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:12:37.672 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:12:37.672 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:12:37.672 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:12:37.672 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:12:37.672 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:12:37.672 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:12:37.672 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:12:37.672 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:12:37.672 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:12:37.672 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:12:37.672 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.666+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:12:37.676 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:12:37.676 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:12:37.676 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:12:37.676 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:12:37.676 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:12:37.676 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:12:37.676 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:12:37.676 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af310f70 2024-09-21T15:12:37.676 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:12:37.677 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a4e0 2024-09-21T15:12:37.677 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:12:37.677 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8750 2024-09-21T15:12:37.677 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9ee0 2024-09-21T15:12:37.677 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b00e7ee0 2024-09-21T15:12:37.677 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57ba0 2024-09-21T15:12:37.677 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:12:37.677 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540b60 2024-09-21T15:12:37.677 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:12:37.677 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.670+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677110 2024-09-21T15:12:37.678 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.674+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45296c0 2024-09-21T15:12:37.678 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:12:37.674+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:12:37.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=20 2024-09-21T15:12:37.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 20 -le 7200 ']' 2024-09-21T15:12:37.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:12:37.717 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:12:37.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 225 -ge 263 ']' 2024-09-21T15:12:37.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:12:38.958 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.955+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:12:38.959 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.955+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:12:38.962 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.959+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:12:38.962 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.959+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:12:38.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.963+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:12:38.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.963+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:12:38.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.963+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:12:38.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.963+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:12:38.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.963+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:12:38.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.963+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:12:38.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.963+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:12:38.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.963+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:12:38.980 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.971+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:12:38.980 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.971+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:12:38.980 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.971+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:12:38.981 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.975+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:12:38.983 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.975+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:12:38.983 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.975+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:12:38.986 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.975+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:12:38.986 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:12:38.987 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:12:38.988 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:12:38.988 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:12:38.988 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:12:38.988 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:12:38.988 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:12:38.989 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:12:38.989 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:12:38.989 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:12:38.989 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.983+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:12:38.994 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.991+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:12:38.994 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.991+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:12:38.997 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.991+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782a90 2024-09-21T15:12:38.997 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.991+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:12:39.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.999+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783040 2024-09-21T15:12:39.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.999+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:12:39.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:38.999+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:12:39.008 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.003+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:12:39.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:12:39.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:12:39.010 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:12:39.011 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783e10 2024-09-21T15:12:39.011 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:12:39.013 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9110 2024-09-21T15:12:39.013 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de95f0 2024-09-21T15:12:39.014 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:12:39.014 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:12:39.014 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:12:39.014 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:12:39.014 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47040 2024-09-21T15:12:39.014 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:12:39.014 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:12:39.014 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:12:39.014 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.007+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:12:39.015 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.011+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:12:39.015 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:39.011+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fe10 2024-09-21T15:12:39.104 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.099+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61e840 finish: resending after timeout 2024-09-21T15:12:39.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.099+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9bc80 finish: resending after timeout 2024-09-21T15:12:39.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.099+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae988300 finish: resending after timeout 2024-09-21T15:12:39.106 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.103+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f380 finish: resending after timeout 2024-09-21T15:12:39.106 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.103+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909680 finish: resending after timeout 2024-09-21T15:12:39.108 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.103+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4618c0 finish: resending after timeout 2024-09-21T15:12:39.108 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.103+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2fc1140 finish: resending after timeout 2024-09-21T15:12:39.108 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.103+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560180 finish: resending after timeout 2024-09-21T15:12:39.108 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.103+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f680 finish: resending after timeout 2024-09-21T15:12:39.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334ccc0 finish: resending after timeout 2024-09-21T15:12:39.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461080 finish: resending after timeout 2024-09-21T15:12:39.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9b200 finish: resending after timeout 2024-09-21T15:12:39.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461980 finish: resending after timeout 2024-09-21T15:12:39.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61ee40 finish: resending after timeout 2024-09-21T15:12:39.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae989c80 finish: resending after timeout 2024-09-21T15:12:39.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908d80 finish: resending after timeout 2024-09-21T15:12:39.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:12:39.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61fe00 finish: resending after timeout 2024-09-21T15:12:39.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.111+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f80c0 finish: resending after timeout 2024-09-21T15:12:39.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9af00 finish: resending after timeout 2024-09-21T15:12:39.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:39.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c0c0 finish: resending after timeout 2024-09-21T15:12:42.638 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.9663763948389) > weight (0.25) 2024-09-21T15:12:42.638 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.9340845339808366) > weight (0.25) 2024-09-21T15:12:42.638 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.8839208751464327) > weight (0.25) 2024-09-21T15:12:42.638 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.3 2024-09-21T15:12:42.639 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Sent signal 15 2024-09-21T15:12:42.639 INFO:tasks.rbd_mirror_thrash:waiting for 4 secs before reviving daemons 2024-09-21T15:12:42.640 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:12:42.635+0000 7f8d3f5f7700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.3 (PID: 29596) UID: 1000 2024-09-21T15:12:44.106 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.103+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9bc80 finish: resending after timeout 2024-09-21T15:12:44.107 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.103+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f380 finish: resending after timeout 2024-09-21T15:12:44.107 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.103+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909680 finish: resending after timeout 2024-09-21T15:12:44.108 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.103+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4618c0 finish: resending after timeout 2024-09-21T15:12:44.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.103+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2fc1140 finish: resending after timeout 2024-09-21T15:12:44.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.103+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560180 finish: resending after timeout 2024-09-21T15:12:44.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f680 finish: resending after timeout 2024-09-21T15:12:44.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334ccc0 finish: resending after timeout 2024-09-21T15:12:44.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461080 finish: resending after timeout 2024-09-21T15:12:44.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9b200 finish: resending after timeout 2024-09-21T15:12:44.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461980 finish: resending after timeout 2024-09-21T15:12:44.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61ee40 finish: resending after timeout 2024-09-21T15:12:44.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae989c80 finish: resending after timeout 2024-09-21T15:12:44.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908d80 finish: resending after timeout 2024-09-21T15:12:44.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:12:44.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.111+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61fe00 finish: resending after timeout 2024-09-21T15:12:44.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f80c0 finish: resending after timeout 2024-09-21T15:12:44.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.111+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9af00 finish: resending after timeout 2024-09-21T15:12:44.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:44.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c0c0 finish: resending after timeout 2024-09-21T15:12:46.639 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.3 2024-09-21T15:12:46.639 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:12:46.640 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.3 2024-09-21T15:12:46.640 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Restarting daemon 2024-09-21T15:12:46.640 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.3 2024-09-21T15:12:46.642 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Started 2024-09-21T15:12:46.642 INFO:tasks.rbd_mirror_thrash:waiting for 100 secs before thrashing 2024-09-21T15:12:47.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.131+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727e13180 [3/8025792e-3904-4159-9de2-729ebbf24852] start: already running 2024-09-21T15:12:47.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.131+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727e9a280 [3/96bdba02-bf8c-4de9-8b36-c42ccdad5cf0] start: already running 2024-09-21T15:12:47.155 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.151+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef1180 [3/ab9322e9-f0d3-4e57-ba54-faf9cbd16ee7] start: already running 2024-09-21T15:12:47.156 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.151+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50500 [3/b0959eb5-273e-4f52-8a00-24247f1f87d2] start: already running 2024-09-21T15:12:47.189 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e13900 [3/867e338b-f348-4ad9-b746-7ff49fa378b8] start: already running 2024-09-21T15:12:47.189 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e13900 [3/867e338b-f348-4ad9-b746-7ff49fa378b8] start: already running 2024-09-21T15:12:47.189 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4ca00 [3/8b3fb276-65d9-4307-be3d-8481e9d99405] start: already running 2024-09-21T15:12:47.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4ca00 [3/8b3fb276-65d9-4307-be3d-8481e9d99405] start: already running 2024-09-21T15:12:47.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4cf00 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:12:47.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4cf00 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:12:47.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4d180 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:12:47.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4d180 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:12:47.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef1400 [3/ace09410-303f-4cc6-8fa7-c5190a4c62e6] start: already running 2024-09-21T15:12:47.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef1400 [3/ace09410-303f-4cc6-8fa7-c5190a4c62e6] start: already running 2024-09-21T15:12:47.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50c80 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:12:47.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50c80 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:12:47.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f51900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:12:47.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f51900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:12:47.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4d400 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:12:47.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4d400 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:12:47.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9a500 [3/96f7130e-627f-496e-8a7c-886f81d92e20] start: already running 2024-09-21T15:12:47.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9a500 [3/96f7130e-627f-496e-8a7c-886f81d92e20] start: already running 2024-09-21T15:12:47.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4d900 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:12:47.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4d900 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:12:47.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9ac80 [3/9899b7e1-7c24-4bdd-b213-241bfd0956fd] start: already running 2024-09-21T15:12:47.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9ac80 [3/9899b7e1-7c24-4bdd-b213-241bfd0956fd] start: already running 2024-09-21T15:12:47.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9af00 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:12:47.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9af00 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:12:47.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f91400 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:12:47.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f91400 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:12:47.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f91b80 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:12:47.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f91b80 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4780 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4780 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef0a00 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef0500 [3/a886c6ec-95d5-4bec-95d6-90b535ab9694] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.183+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9b900 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef1680 [3/af7bb590-faa2-4f57-80f6-c5ab02216567] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef1680 [3/af7bb590-faa2-4f57-80f6-c5ab02216567] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef0c80 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50000 [3/aff5f3bc-3e8e-4a66-b089-b2f57573290a] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50000 [3/aff5f3bc-3e8e-4a66-b089-b2f57573290a] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50280 [3/b0925bf1-5012-45a2-afe9-91608ced3c6a] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50280 [3/b0925bf1-5012-45a2-afe9-91608ced3c6a] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef0f00 [3/ab585917-bbfb-41ce-a268-5e9596e12ef3] start: already running 2024-09-21T15:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2500 [3/ee5e1490-4a11-4636-ab8f-ee0651bb84e7] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2500 [3/ee5e1490-4a11-4636-ab8f-ee0651bb84e7] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2780 [3/ee8573b9-7a14-470f-b519-004503b68b59] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2780 [3/ee8573b9-7a14-470f-b519-004503b68b59] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2f00 [3/f033ad39-c053-43aa-829a-9160c2473e5a] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2f00 [3/f033ad39-c053-43aa-829a-9160c2473e5a] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff3b80 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff3b80 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff3900 [3/f7c87bd3-b914-47e1-bfe3-31c0275bb492] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff3900 [3/f7c87bd3-b914-47e1-bfe3-31c0275bb492] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef1b80 [3/afce2605-a8db-416c-a324-7471613e476c] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef1b80 [3/afce2605-a8db-416c-a324-7471613e476c] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50a00 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50a00 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e13680 [3/85d0a44e-84cb-4cc5-bee6-694533ad4fbd] start: already running 2024-09-21T15:12:47.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e13680 [3/85d0a44e-84cb-4cc5-bee6-694533ad4fbd] start: already running 2024-09-21T15:12:47.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90000 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:12:47.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90000 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:12:47.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4cc80 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:12:47.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4cc80 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:12:47.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4db80 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] start: already running 2024-09-21T15:12:47.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4db80 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] start: already running 2024-09-21T15:12:47.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9aa00 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:12:47.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9aa00 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:12:47.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef1900 [3/af962aab-237c-497b-989c-5a6f03523f73] start: already running 2024-09-21T15:12:47.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef1900 [3/af962aab-237c-497b-989c-5a6f03523f73] start: already running 2024-09-21T15:12:47.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef0780 [3/a88a0c18-875d-4624-b7df-602dca14305c] start: already running 2024-09-21T15:12:47.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9b680 [3/9f1ae171-c261-402d-a90a-2b4cca77a51c] start: already running 2024-09-21T15:12:47.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9b680 [3/9f1ae171-c261-402d-a90a-2b4cca77a51c] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50f00 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50f00 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9a000 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9a000 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef0280 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f51b80 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f51b80 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9a780 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9a780 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9b400 [3/9c634cdf-a6f6-482b-a85c-0d163bc3d079] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9b400 [3/9c634cdf-a6f6-482b-a85c-0d163bc3d079] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9bb80 [3/a15513b2-9cf9-4c80-b9b1-ea6973791935] start: already running 2024-09-21T15:12:47.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9bb80 [3/a15513b2-9cf9-4c80-b9b1-ea6973791935] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90f00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90f00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f51180 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f51180 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f91900 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f91900 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3a500 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3a500 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3a780 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3a780 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3a000 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3a000 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3b680 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:12:47.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3b680 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:12:47.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3b400 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:12:47.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3b400 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:12:47.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3a280 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:12:47.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3a280 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:12:47.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4000 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:12:47.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4000 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:12:47.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3b900 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:12:47.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3b900 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:12:47.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3bb80 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:12:47.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.187+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3bb80 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:12:47.209 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4c80 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:12:47.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4c80 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:12:47.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4c80 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:12:47.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4280 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:12:47.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4280 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:12:47.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4280 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:12:47.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4f00 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:12:47.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4f00 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:12:47.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4f00 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:12:47.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5180 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:12:47.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5180 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:12:47.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5180 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3af00 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3af00 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3af00 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4d680 [3/937229a7-e2f3-4109-a1c5-4cd12b947e67] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4d680 [3/937229a7-e2f3-4109-a1c5-4cd12b947e67] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5400 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5400 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5400 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5680 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5680 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5680 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5900 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5900 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:12:47.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5900 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:12:47.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5b80 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:12:47.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5b80 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:12:47.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc5b80 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:12:47.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6000 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:12:47.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6000 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:12:47.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6000 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:12:47.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4a00 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:12:47.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4a00 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:12:47.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4a00 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:12:47.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6280 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:12:47.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6280 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:12:47.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6280 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:12:47.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6a00 [3/e11bf669-24bd-415f-9833-0c4630550c23] start: already running 2024-09-21T15:12:47.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6a00 [3/e11bf669-24bd-415f-9833-0c4630550c23] start: already running 2024-09-21T15:12:47.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6a00 [3/e11bf669-24bd-415f-9833-0c4630550c23] start: already running 2024-09-21T15:12:47.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6f00 [3/e33347f9-479f-4080-b33f-92c69acaa835] start: already running 2024-09-21T15:12:47.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6f00 [3/e33347f9-479f-4080-b33f-92c69acaa835] start: already running 2024-09-21T15:12:47.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6f00 [3/e33347f9-479f-4080-b33f-92c69acaa835] start: already running 2024-09-21T15:12:47.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2000 [3/e6c1e46d-943e-48ab-b899-f1d65ff8944a] start: already running 2024-09-21T15:12:47.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2000 [3/e6c1e46d-943e-48ab-b899-f1d65ff8944a] start: already running 2024-09-21T15:12:47.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2000 [3/e6c1e46d-943e-48ab-b899-f1d65ff8944a] start: already running 2024-09-21T15:12:47.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7900 [3/e51aede5-de84-423f-9449-2f9e9884385e] start: already running 2024-09-21T15:12:47.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7900 [3/e51aede5-de84-423f-9449-2f9e9884385e] start: already running 2024-09-21T15:12:47.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7900 [3/e51aede5-de84-423f-9449-2f9e9884385e] start: already running 2024-09-21T15:12:47.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7180 [3/e4a35a0f-eabb-4389-9239-82ff9a0828e6] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7180 [3/e4a35a0f-eabb-4389-9239-82ff9a0828e6] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7180 [3/e4a35a0f-eabb-4389-9239-82ff9a0828e6] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7b80 [3/e6696bd8-9005-4eeb-8e44-c70647860921] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7b80 [3/e6696bd8-9005-4eeb-8e44-c70647860921] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7b80 [3/e6696bd8-9005-4eeb-8e44-c70647860921] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7680 [3/e513238f-c4c4-4cbc-8a2f-c21215922f5f] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7680 [3/e513238f-c4c4-4cbc-8a2f-c21215922f5f] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7680 [3/e513238f-c4c4-4cbc-8a2f-c21215922f5f] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7400 [3/e4d1114b-ada5-4ff8-999f-0119c103708f] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7400 [3/e4d1114b-ada5-4ff8-999f-0119c103708f] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd7400 [3/e4d1114b-ada5-4ff8-999f-0119c103708f] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2280 [3/ed8f9c7d-1492-4fbd-ae77-4c3bfa2f3787] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2280 [3/ed8f9c7d-1492-4fbd-ae77-4c3bfa2f3787] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2280 [3/ed8f9c7d-1492-4fbd-ae77-4c3bfa2f3787] start: already running 2024-09-21T15:12:47.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e13b80 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e13b80 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000780 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000780 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000780 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2c80 [3/ef79be89-94fa-4d0c-a9a8-2fd05127bdc5] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2c80 [3/ef79be89-94fa-4d0c-a9a8-2fd05127bdc5] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff2c80 [3/ef79be89-94fa-4d0c-a9a8-2fd05127bdc5] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000a00 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000a00 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000a00 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff3180 [3/f2dae9ca-5e22-44e6-90a3-2cbebe5fa594] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff3180 [3/f2dae9ca-5e22-44e6-90a3-2cbebe5fa594] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff3180 [3/f2dae9ca-5e22-44e6-90a3-2cbebe5fa594] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4c780 [3/8a44e3ef-3163-4842-8e5c-c12038e5ac8c] start: already running 2024-09-21T15:12:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.203+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4c780 [3/8a44e3ef-3163-4842-8e5c-c12038e5ac8c] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000500 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000500 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000500 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef0000 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ef0000 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff3680 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff3680 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727ff3680 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3ac80 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3ac80 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3ac80 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000280 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000280 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000280 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000000 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:12:47.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000000 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000000 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e4c500 [3/8973e161-8e97-4797-a3fc-b13855716446] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4500 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4500 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4500 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f91180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f91180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f91180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6c80 [3/e2c7112f-7834-4998-b6f4-09f9fd94ae24] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6c80 [3/e2c7112f-7834-4998-b6f4-09f9fd94ae24] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6c80 [3/e2c7112f-7834-4998-b6f4-09f9fd94ae24] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000c80 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562728000c80 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9b180 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:12:47.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727e9b180 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f51680 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f51680 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f51680 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f50780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90500 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90500 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90500 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90c80 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90c80 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90c80 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90780 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:12:47.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90780 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90780 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3aa00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3aa00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3aa00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6780 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6780 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fd6780 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3b180 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3b180 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f3b180 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f51400 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f51400 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f51400 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:12:47.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90a00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:12:47.220 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90a00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:12:47.220 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f90a00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:12:47.220 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f91680 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:12:47.220 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f91680 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:12:47.220 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.207+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727f91680 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:12:47.224 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.219+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727f50500 [3/b0959eb5-273e-4f52-8a00-24247f1f87d2] start: already running 2024-09-21T15:12:47.261 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.255+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727fd6500 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:12:47.261 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.255+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727fd6500 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:12:47.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.255+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727fd6500 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:12:47.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.255+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727ff3400 [3/f5f9a344-230e-4e5b-b1a4-3e4b4fc4cc86] start: already running 2024-09-21T15:12:47.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.255+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727ff3400 [3/f5f9a344-230e-4e5b-b1a4-3e4b4fc4cc86] start: already running 2024-09-21T15:12:47.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.255+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727ff3400 [3/f5f9a344-230e-4e5b-b1a4-3e4b4fc4cc86] start: already running 2024-09-21T15:12:47.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.255+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727e12f00 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] start: already running 2024-09-21T15:12:47.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.255+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727e13400 [3/8319ade8-0cb1-4b7e-98ca-ced578aceb3e] start: already running 2024-09-21T15:12:47.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.255+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727e4c280 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:12:47.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.255+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727e4c000 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:12:47.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.255+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727ff2a00 [3/eee89f94-874b-48ea-bcd4-804b53f039c0] start: already running 2024-09-21T15:12:47.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.255+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727ff2a00 [3/eee89f94-874b-48ea-bcd4-804b53f039c0] start: already running 2024-09-21T15:12:47.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.255+0000 7f610f0ae700 -1 rbd::mirror::ImageReplayer: 0x562727ff2a00 [3/eee89f94-874b-48ea-bcd4-804b53f039c0] start: already running 2024-09-21T15:12:47.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.283+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727ef1680 [3/af7bb590-faa2-4f57-80f6-c5ab02216567] start: already running 2024-09-21T15:12:47.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.283+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727ef0c80 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:12:47.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.283+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727e9b900 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:12:47.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.283+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727ef0500 [3/a886c6ec-95d5-4bec-95d6-90b535ab9694] start: already running 2024-09-21T15:12:47.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.283+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727ef0a00 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:12:47.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.283+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727f50000 [3/aff5f3bc-3e8e-4a66-b089-b2f57573290a] start: already running 2024-09-21T15:12:47.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.283+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727ef0f00 [3/ab585917-bbfb-41ce-a268-5e9596e12ef3] start: already running 2024-09-21T15:12:47.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.283+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727f50280 [3/b0925bf1-5012-45a2-afe9-91608ced3c6a] start: already running 2024-09-21T15:12:47.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.283+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727ef1b80 [3/afce2605-a8db-416c-a324-7471613e476c] start: already running 2024-09-21T15:12:47.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.283+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727f50a00 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:12:47.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.291+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727ef1900 [3/af962aab-237c-497b-989c-5a6f03523f73] start: already running 2024-09-21T15:12:47.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.291+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727f50f00 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:12:47.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.291+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727ef0780 [3/a88a0c18-875d-4624-b7df-602dca14305c] start: already running 2024-09-21T15:12:47.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.291+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727f90280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:12:47.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.291+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727f51b80 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:12:47.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.291+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727ef0280 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:12:47.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.291+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727f90f00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:12:47.311 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.307+0000 7f6101893700 -1 rbd::mirror::ImageReplayer: 0x562727f3bb80 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:12:47.311 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.307+0000 7f6101893700 -1 rbd::mirror::ImageReplayer: 0x562727f3a500 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:12:47.311 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.307+0000 7f6101893700 -1 rbd::mirror::ImageReplayer: 0x562727f91900 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:12:47.311 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.307+0000 7f6101893700 -1 rbd::mirror::ImageReplayer: 0x562727f3b400 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:12:47.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.307+0000 7f6101893700 -1 rbd::mirror::ImageReplayer: 0x562727f3b680 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:12:47.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.307+0000 7f6101893700 -1 rbd::mirror::ImageReplayer: 0x562727f51180 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:12:47.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.307+0000 7f6101893700 -1 rbd::mirror::ImageReplayer: 0x562727fc4000 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:12:47.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.307+0000 7f6101893700 -1 rbd::mirror::ImageReplayer: 0x562727f3a780 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:12:47.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.307+0000 7f6101893700 -1 rbd::mirror::ImageReplayer: 0x562727f3a000 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:12:47.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.307+0000 7f6101893700 -1 rbd::mirror::ImageReplayer: 0x562727f3b900 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:12:47.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.307+0000 7f6101893700 -1 rbd::mirror::ImageReplayer: 0x562727f3a280 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:12:47.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.555+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727f50c80 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:12:47.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.555+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727ef1400 [3/ace09410-303f-4cc6-8fa7-c5190a4c62e6] start: already running 2024-09-21T15:12:47.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.555+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727f91b80 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:12:47.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.555+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727f51900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:12:47.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.575+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727f91400 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:12:47.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.575+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727ef0000 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] start: already running 2024-09-21T15:12:47.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.611+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727f3ac80 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:12:47.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.611+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727f91180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:12:47.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.611+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727fd6c80 [3/e2c7112f-7834-4998-b6f4-09f9fd94ae24] start: already running 2024-09-21T15:12:47.616 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.611+0000 7f6102094700 -1 rbd::mirror::ImageReplayer: 0x562727fc4500 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:12:47.640 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:12:47.635+0000 7f610e8ad700 -1 rbd::mirror::ImageReplayer: 0x562727ff2a00 [3/eee89f94-874b-48ea-bcd4-804b53f039c0] start: already running 2024-09-21T15:12:47.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=30 2024-09-21T15:12:47.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 30 -le 7200 ']' 2024-09-21T15:12:47.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:12:47.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:12:47.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 225 -ge 263 ']' 2024-09-21T15:12:47.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:12:49.108 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.103+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909680 finish: resending after timeout 2024-09-21T15:12:49.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.103+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4618c0 finish: resending after timeout 2024-09-21T15:12:49.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2fc1140 finish: resending after timeout 2024-09-21T15:12:49.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560180 finish: resending after timeout 2024-09-21T15:12:49.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f680 finish: resending after timeout 2024-09-21T15:12:49.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334ccc0 finish: resending after timeout 2024-09-21T15:12:49.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461080 finish: resending after timeout 2024-09-21T15:12:49.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9b200 finish: resending after timeout 2024-09-21T15:12:49.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461980 finish: resending after timeout 2024-09-21T15:12:49.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61ee40 finish: resending after timeout 2024-09-21T15:12:49.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae989c80 finish: resending after timeout 2024-09-21T15:12:49.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.111+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908d80 finish: resending after timeout 2024-09-21T15:12:49.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:12:49.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.111+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61fe00 finish: resending after timeout 2024-09-21T15:12:49.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f80c0 finish: resending after timeout 2024-09-21T15:12:49.116 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.111+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9af00 finish: resending after timeout 2024-09-21T15:12:49.116 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:49.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c0c0 finish: resending after timeout 2024-09-21T15:12:52.909 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.903+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:12:52.917 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.911+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:12:52.918 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.911+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:12:52.918 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.915+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:12:52.918 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.915+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:12:52.924 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.919+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:12:52.924 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.919+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:12:52.924 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.919+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:12:52.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.919+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:12:52.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.919+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:12:52.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.919+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:12:52.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.919+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:12:52.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.919+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:12:52.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.919+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:12:52.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.919+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:12:52.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.919+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:12:52.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.919+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:12:52.951 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.943+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:12:52.951 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.943+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:12:52.951 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.943+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:12:52.951 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.943+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:12:52.951 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.947+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:12:52.952 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.947+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:12:52.954 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.947+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:12:52.957 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.951+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f7040 2024-09-21T15:12:52.959 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.955+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:12:52.960 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.955+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:12:52.960 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.955+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:12:52.960 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.955+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:12:52.961 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.955+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:12:52.961 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.955+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:12:52.961 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.955+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:12:52.961 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.955+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:12:52.963 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.959+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:12:52.963 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.959+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:12:52.963 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.959+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:12:52.964 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.959+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:12:52.964 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.959+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:12:52.964 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.959+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:12:52.968 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.963+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:12:52.968 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.963+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:12:52.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.963+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:12:52.970 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:12:52.972 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:12:52.972 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:12:52.972 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:12:52.972 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:12:52.972 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016f1629c0 2024-09-21T15:12:52.972 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:12:52.972 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:12:52.972 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:12:52.972 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:12:52.973 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:12:52.973 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:12:52.973 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:12:52.973 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:12:52.973 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:12:52.973 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.967+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:12:52.974 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:12:52.975 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:12:52.975 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:12:52.975 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:12:52.975 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:12:52.975 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:12:52.976 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:12:52.976 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:12:52.976 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:12:52.976 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:12:52.976 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:12:52.976 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:12:52.976 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:12:52.977 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:12:52.977 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:12:52.978 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:12:52.978 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:12:52.978 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:12:52.978 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:12:52.978 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:12:52.978 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:12:52.978 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:12:52.978 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:12:52.978 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:12:52.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:12:52.980 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:12:52.980 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:12:52.980 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:12:52.980 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:12:52.980 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:12:52.971+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:12:54.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad909680 finish: resending after timeout 2024-09-21T15:12:54.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4618c0 finish: resending after timeout 2024-09-21T15:12:54.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2fc1140 finish: resending after timeout 2024-09-21T15:12:54.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e560180 finish: resending after timeout 2024-09-21T15:12:54.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f680 finish: resending after timeout 2024-09-21T15:12:54.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334ccc0 finish: resending after timeout 2024-09-21T15:12:54.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.107+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461080 finish: resending after timeout 2024-09-21T15:12:54.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.107+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9b200 finish: resending after timeout 2024-09-21T15:12:54.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61ee40 finish: resending after timeout 2024-09-21T15:12:54.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae989c80 finish: resending after timeout 2024-09-21T15:12:54.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908d80 finish: resending after timeout 2024-09-21T15:12:54.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.111+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:12:54.116 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61fe00 finish: resending after timeout 2024-09-21T15:12:54.119 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.111+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f80c0 finish: resending after timeout 2024-09-21T15:12:54.119 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.111+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9af00 finish: resending after timeout 2024-09-21T15:12:54.119 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:54.111+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c0c0 finish: resending after timeout 2024-09-21T15:12:55.102 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:55.095+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:12:55.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:55.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:12:55.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:55.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:12:55.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:55.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:12:55.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:55.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:12:55.123 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:55.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:12:55.125 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:55.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:12:55.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:55.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:12:55.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:55.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:12:55.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:55.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:12:55.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:55.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:12:55.130 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:55.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:12:55.130 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:55.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:12:57.830 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=40 2024-09-21T15:12:57.830 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 40 -le 7200 ']' 2024-09-21T15:12:57.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:12:57.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:12:57.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 225 -ge 263 ']' 2024-09-21T15:12:57.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:12:57.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.931+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:12:57.943 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.935+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:12:57.949 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.943+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:12:57.953 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.943+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:12:57.954 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.947+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:12:57.954 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.947+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:12:57.962 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.951+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:12:57.962 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.951+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:12:57.962 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.951+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:12:57.965 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.955+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:12:57.965 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.955+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:12:57.965 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.955+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:12:57.965 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.955+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:12:57.966 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.959+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:12:57.967 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.959+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:12:57.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.959+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:12:57.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.959+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:12:57.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.963+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:12:57.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.963+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:12:57.977 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.971+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:12:57.983 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.975+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:12:57.983 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.975+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:12:57.983 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.975+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:12:57.984 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:12:57.984 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:12:57.984 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:12:57.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:12:57.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:12:57.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:12:57.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:12:57.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:12:57.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:12:57.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:12:57.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:12:57.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:12:57.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:12:57.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:12:57.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:12:57.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:12:57.986 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:12:57.986 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:12:57.986 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:12:57.986 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:12:57.986 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:12:57.986 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:12:57.986 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:12:57.986 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.979+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:12:57.987 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.983+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:12:57.987 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.983+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:12:57.987 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.983+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:12:57.987 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.983+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:12:57.987 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.983+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:12:57.987 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.983+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:12:57.987 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.983+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:12:57.987 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.983+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:12:57.987 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.983+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:12:57.987 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.983+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:12:57.988 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:12:57.983+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:12:58.102 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.098+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:12:58.103 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.098+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:12:58.103 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.098+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:12:58.103 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.098+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:12:58.103 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.098+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:12:58.115 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.110+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:12:58.115 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.110+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:12:58.115 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.110+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:12:58.115 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.110+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:12:58.115 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.110+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:12:58.115 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.110+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:12:58.115 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.110+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:12:58.116 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.110+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:12:58.116 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.110+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:12:58.128 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.122+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:12:58.215 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.206+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:12:58.216 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.206+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:12:58.216 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.206+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:12:58.216 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.206+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:12:58.219 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.214+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:12:58.220 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.214+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:12:58.373 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.366+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:12:58.374 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.366+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:12:58.374 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.366+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:12:58.387 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.374+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:12:58.393 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.382+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:12:58.395 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.390+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:12:58.397 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.390+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:12:58.397 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.390+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:12:58.398 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.394+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4709a00 2024-09-21T15:12:58.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.394+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:12:58.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.394+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:12:58.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.394+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:12:58.401 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.398+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:12:58.401 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.398+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb110 2024-09-21T15:12:58.402 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.398+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:12:58.402 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.398+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbbba0 2024-09-21T15:12:58.402 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.398+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:12:58.402 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.398+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:12:58.402 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.398+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c24e0 2024-09-21T15:12:58.402 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.398+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c28f0 2024-09-21T15:12:58.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:58.399+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3c05680 handle_clone_image: failed to clone image mirror/10b7a86900d8 to image_cluster1.client.mirror.5-clone26 2024-09-21T15:12:58.409 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.402+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3ad0 2024-09-21T15:12:58.409 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.402+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:12:58.409 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.402+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:12:58.409 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.402+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:12:58.409 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.402+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:12:58.410 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.402+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:12:58.410 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.402+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:12:58.410 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:12:58.402+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335e10 2024-09-21T15:12:58.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:58.535+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59f2bfc20 handle_clone_image: failed to clone image mirror/10b4726378e0 to image_cluster1.client.mirror.3-clone20 2024-09-21T15:12:58.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:58.543+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a0169a40 handle_clone_image: failed to clone image mirror/10b479a83609 to image_cluster1.client.mirror.3-clone48 2024-09-21T15:12:58.565 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:58.559+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a0a12960 handle_clone_image: failed to clone image mirror/10b6b9b65ebc to image_cluster1.client.mirror.4-clone51 2024-09-21T15:12:58.576 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:58.571+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59faa9c20 handle_clone_image: failed to clone image mirror/10b6785f577e to image_cluster1.client.mirror.4-clone40 2024-09-21T15:12:58.589 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:58.583+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a35461e0 handle_clone_image: failed to clone image mirror/10b65cf2d949 to image_cluster1.client.mirror.4-clone47 2024-09-21T15:12:58.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:58.659+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3ec70e0 handle_clone_image: failed to clone image mirror/10b7375492f5 to image_cluster1.client.mirror.5-clone36 2024-09-21T15:12:58.692 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:58.687+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a174fe00 handle_clone_image: failed to clone image mirror/10b6b549e4a1 to image_cluster1.client.mirror.4-clone15 2024-09-21T15:12:58.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:58.767+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59e108960 handle_clone_image: failed to clone image mirror/10adc4083ff6 to image_cluster1.client.mirror.2-clone10 2024-09-21T15:12:58.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:12:58.779+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a34ecb40 handle_clone_image: failed to clone image mirror/10b449ea7866 to image_cluster1.client.mirror.3-clone41 2024-09-21T15:13:04.025 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.019+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61f680 finish: resending after timeout 2024-09-21T15:13:04.025 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.019+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334ccc0 finish: resending after timeout 2024-09-21T15:13:04.025 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.019+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461080 finish: resending after timeout 2024-09-21T15:13:04.025 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.019+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9b200 finish: resending after timeout 2024-09-21T15:13:04.025 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.019+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61ee40 finish: resending after timeout 2024-09-21T15:13:04.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.023+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae989c80 finish: resending after timeout 2024-09-21T15:13:04.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908d80 finish: resending after timeout 2024-09-21T15:13:04.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:13:04.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61fe00 finish: resending after timeout 2024-09-21T15:13:04.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f80c0 finish: resending after timeout 2024-09-21T15:13:04.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9af00 finish: resending after timeout 2024-09-21T15:13:04.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c0c0 finish: resending after timeout 2024-09-21T15:13:04.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e4fd5c0 finish: resending after timeout 2024-09-21T15:13:04.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:13:04.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588600 finish: resending after timeout 2024-09-21T15:13:04.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.087+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1e0c0 finish: resending after timeout 2024-09-21T15:13:04.131 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:04.127+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2df5500 finish: resending after timeout 2024-09-21T15:13:07.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=50 2024-09-21T15:13:07.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 50 -le 7200 ']' 2024-09-21T15:13:07.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:13:07.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:13:07.945 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 230 -ge 263 ']' 2024-09-21T15:13:07.945 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:13:09.027 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461080 finish: resending after timeout 2024-09-21T15:13:09.027 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.023+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9b200 finish: resending after timeout 2024-09-21T15:13:09.027 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61ee40 finish: resending after timeout 2024-09-21T15:13:09.027 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.023+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae989c80 finish: resending after timeout 2024-09-21T15:13:09.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908d80 finish: resending after timeout 2024-09-21T15:13:09.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.023+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:13:09.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61fe00 finish: resending after timeout 2024-09-21T15:13:09.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.027+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f80c0 finish: resending after timeout 2024-09-21T15:13:09.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.027+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9af00 finish: resending after timeout 2024-09-21T15:13:09.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.027+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c0c0 finish: resending after timeout 2024-09-21T15:13:09.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.027+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e4fd5c0 finish: resending after timeout 2024-09-21T15:13:09.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.027+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:13:09.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.027+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588600 finish: resending after timeout 2024-09-21T15:13:09.090 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.087+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1e0c0 finish: resending after timeout 2024-09-21T15:13:09.133 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:09.127+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2df5500 finish: resending after timeout 2024-09-21T15:13:13.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.162+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:13:13.174 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.166+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3ee0 2024-09-21T15:13:13.174 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.166+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:13:13.177 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.174+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:13:13.177 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.174+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:13:13.203 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.198+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:13:13.205 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.202+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:13:13.205 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.202+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:13:13.215 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.206+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:13:13.215 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.206+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:13:13.215 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.206+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:13:13.215 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.206+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:13:13.215 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.206+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:13:13.215 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.206+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:13:13.215 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.206+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:13:13.215 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.206+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:13:13.215 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.206+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:13:13.216 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.206+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:13:13.217 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:13:13.217 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:13:13.217 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:13:13.217 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:13:13.217 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:13:13.217 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:13:13.217 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:13:13.217 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:13:13.217 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:13:13.218 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:13:13.218 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:13:13.218 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:13:13.218 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.210+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:13:13.220 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.218+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:13:13.221 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:13.218+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:13:14.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:14.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61ee40 finish: resending after timeout 2024-09-21T15:13:14.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:14.023+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae989c80 finish: resending after timeout 2024-09-21T15:13:14.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:14.023+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908d80 finish: resending after timeout 2024-09-21T15:13:14.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:14.027+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:13:14.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:14.027+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61fe00 finish: resending after timeout 2024-09-21T15:13:14.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:14.027+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f80c0 finish: resending after timeout 2024-09-21T15:13:14.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:14.027+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9af00 finish: resending after timeout 2024-09-21T15:13:14.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:14.027+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c0c0 finish: resending after timeout 2024-09-21T15:13:14.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:14.027+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e4fd5c0 finish: resending after timeout 2024-09-21T15:13:14.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:14.027+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:13:14.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:14.031+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588600 finish: resending after timeout 2024-09-21T15:13:14.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:14.087+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1e0c0 finish: resending after timeout 2024-09-21T15:13:14.133 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:14.131+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2df5500 finish: resending after timeout 2024-09-21T15:13:17.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=60 2024-09-21T15:13:17.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 60 -le 7200 ']' 2024-09-21T15:13:17.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:13:17.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:13:18.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 230 -ge 263 ']' 2024-09-21T15:13:18.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:13:19.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:19.027+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae989c80 finish: resending after timeout 2024-09-21T15:13:19.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:19.027+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908d80 finish: resending after timeout 2024-09-21T15:13:19.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:19.027+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:13:19.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:19.027+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61fe00 finish: resending after timeout 2024-09-21T15:13:19.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:19.027+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f80c0 finish: resending after timeout 2024-09-21T15:13:19.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:19.027+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9af00 finish: resending after timeout 2024-09-21T15:13:19.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:19.031+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c0c0 finish: resending after timeout 2024-09-21T15:13:19.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:19.031+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e4fd5c0 finish: resending after timeout 2024-09-21T15:13:19.035 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:19.031+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:13:19.036 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:19.031+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588600 finish: resending after timeout 2024-09-21T15:13:19.073 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.067+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:13:19.074 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.067+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:13:19.074 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.067+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:13:19.074 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.067+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:13:19.074 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.067+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e51e0 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ba0 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5c70 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ee0 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fdd61a0 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16000 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb2b0 2024-09-21T15:13:19.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:13:19.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:13:19.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:13:19.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:13:19.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:13:19.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8340 2024-09-21T15:13:19.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.083+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:13:19.091 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.087+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:13:19.091 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.087+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:13:19.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.087+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb95f0 2024-09-21T15:13:19.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.087+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:13:19.099 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.095+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:13:19.102 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.095+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:13:19.103 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.099+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cdd0 2024-09-21T15:13:19.103 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:19.099+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cea0 2024-09-21T15:13:24.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:24.102+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1e0c0 finish: resending after timeout 2024-09-21T15:13:24.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:24.106+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2df5500 finish: resending after timeout 2024-09-21T15:13:24.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:24.106+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ad908d80 finish: resending after timeout 2024-09-21T15:13:24.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:24.106+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:13:24.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:24.106+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5ae61fe00 finish: resending after timeout 2024-09-21T15:13:24.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:24.106+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e0f80c0 finish: resending after timeout 2024-09-21T15:13:24.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:24.106+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9af00 finish: resending after timeout 2024-09-21T15:13:24.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:24.106+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c0c0 finish: resending after timeout 2024-09-21T15:13:24.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:24.106+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e4fd5c0 finish: resending after timeout 2024-09-21T15:13:24.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:24.106+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:13:24.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:24.106+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588600 finish: resending after timeout 2024-09-21T15:13:27.925 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.914+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:13:27.931 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.926+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:13:27.932 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.926+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:13:27.942 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.934+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:13:27.947 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.934+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:13:27.947 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.934+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:13:27.947 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.934+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:13:27.947 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.934+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:13:27.947 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.934+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:13:27.964 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.950+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:13:27.976 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.970+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:13:27.976 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.970+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:13:27.976 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.970+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:13:27.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.974+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:13:27.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.974+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e340 2024-09-21T15:13:27.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.974+0000 7ff753f07700 -1 reset not still connected to 0x56016d985ba0 2024-09-21T15:13:27.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.974+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:13:27.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.974+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:13:27.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.974+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:13:27.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.974+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:13:27.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.974+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:13:27.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:13:27.989 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:13:27.989 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:13:27.989 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:13:27.989 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:13:27.990 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:13:27.990 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:13:27.991 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f1629c0 2024-09-21T15:13:27.991 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:13:27.991 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:13:27.992 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:13:27.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:13:27.994 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:13:27.994 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:13:27.994 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:13:27.994 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:13:27.994 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:13:27.994 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:13:27.994 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:13:27.994 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:13:27.994 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.978+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:13:27.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.982+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:13:27.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.982+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:13:27.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.982+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:13:27.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.982+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:13:27.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.982+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:13:27.996 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.982+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:13:27.996 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.982+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:13:27.996 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.982+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:13:27.996 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.982+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:13:27.996 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.982+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:13:27.996 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.982+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:13:27.996 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.982+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:13:27.996 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:27.982+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:13:27.996 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:27.986+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:13:27.996 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:27.990+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:13:27.997 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:27.990+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:13:27.997 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:27.990+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:13:27.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:27.994+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:13:28.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=70 2024-09-21T15:13:28.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 70 -le 7200 ']' 2024-09-21T15:13:28.008 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.002+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:13:28.009 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:27.994+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:13:28.010 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:27.994+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:13:28.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:13:28.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:13:28.012 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:28.006+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:13:28.012 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.002+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:13:28.013 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.006+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:13:28.013 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.006+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:13:28.021 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.014+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:13:28.022 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:28.010+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:13:28.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.018+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:13:28.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.018+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:13:28.035 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:28.022+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:13:28.035 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:28.022+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:13:28.035 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:28.022+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:13:28.035 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:28.022+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9c70 2024-09-21T15:13:28.036 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:28.022+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:13:28.036 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:28.022+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:13:28.039 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.026+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:13:28.039 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.026+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:13:28.039 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.026+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:13:28.040 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.026+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:13:28.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:13:28.048 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:13:28.048 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:13:28.048 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:13:28.048 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:13:28.048 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:13:28.048 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:13:28.048 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:13:28.048 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:13:28.049 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:13:28.049 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:13:28.049 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:13:28.049 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:13:28.049 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.034+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:13:28.055 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.046+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:13:28.057 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.046+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:13:28.057 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.046+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:13:28.059 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:13:28.059 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:13:28.059 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.050+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:13:28.059 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.050+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:13:28.059 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.050+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:13:28.060 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.054+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:13:28.060 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.054+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:13:28.063 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.058+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:13:28.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.058+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:13:28.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.062+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:13:28.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.062+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:13:28.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.062+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:13:28.072 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:13:28.072 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:13:28.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:13:28.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:13:28.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:13:28.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:13:28.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:13:28.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:13:28.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:13:28.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:13:28.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:13:28.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:13:28.077 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.066+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:13:28.078 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.070+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:13:28.078 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.070+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:13:28.078 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.070+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:13:28.078 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.070+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:13:28.078 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.070+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:13:28.078 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:28.070+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:13:28.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 230 -ge 263 ']' 2024-09-21T15:13:28.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:13:28.474 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:28.470+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a269ed20 handle_clone_image: failed to clone image mirror/10ad17167a54 to image_cluster1.client.mirror.2-clone34 2024-09-21T15:13:28.479 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:28.474+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a181cf00 handle_clone_image: failed to clone image mirror/10b6b9b65ebc to image_cluster1.client.mirror.4-clone51 2024-09-21T15:13:28.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:28.774+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a37ad2c0 handle_clone_image: failed to clone image mirror/10b7394b6f24 to image_cluster1.client.mirror.5-clone27 2024-09-21T15:13:28.878 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:28.874+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a1eca3c0 handle_clone_image: failed to clone image mirror/10b449ea7866 to image_cluster1.client.mirror.3-clone41 2024-09-21T15:13:28.950 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:28.946+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a2ba41e0 handle_clone_image: failed to clone image mirror/10ad6846a059 to image_cluster1.client.mirror.2-clone20 2024-09-21T15:13:32.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:32.990+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:13:32.998 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:32.994+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:13:33.013 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.002+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:13:33.013 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.002+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:13:33.020 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.018+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f7040 2024-09-21T15:13:33.023 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.022+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:13:33.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.022+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:13:33.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.022+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:13:33.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.022+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:13:33.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.026+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:13:33.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.038+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:13:33.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.038+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba4e0 2024-09-21T15:13:33.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.038+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:13:33.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.038+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:13:33.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.038+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:13:33.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.038+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:13:33.042 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.038+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:13:33.042 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.038+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:13:33.043 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.042+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:13:33.043 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.042+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:13:33.046 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.046+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:13:33.046 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.046+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:13:33.046 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.046+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:13:33.050 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:13:33.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:13:33.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:13:33.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3790 2024-09-21T15:13:33.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f162000 2024-09-21T15:13:33.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:13:33.052 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:13:33.052 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:13:33.052 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:13:33.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f1629c0 2024-09-21T15:13:33.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:13:33.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:13:33.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.050+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:13:33.055 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.054+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:13:33.055 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.054+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:13:33.055 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.054+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:13:33.055 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.054+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:13:33.055 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.054+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:13:33.055 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.054+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:13:33.055 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.054+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:13:33.055 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.054+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:13:33.056 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.054+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:13:33.056 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.054+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:13:33.056 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.054+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:13:33.056 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.054+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:13:33.056 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.054+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:13:33.062 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.058+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:13:33.062 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.058+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:13:33.062 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.058+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:13:33.062 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.058+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:13:33.064 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:13:33.064 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:13:33.064 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:13:33.064 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:13:33.064 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:13:33.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560168574270 2024-09-21T15:13:33.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f7040 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:13:33.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.062+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:13:33.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:13:33.069 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:13:33.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:13:33.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:13:33.072 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:33.066+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:13:33.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:33.626+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1e0c0 finish: resending after timeout 2024-09-21T15:13:33.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:33.626+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2df5500 finish: resending after timeout 2024-09-21T15:13:33.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:33.626+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0f9af00 finish: resending after timeout 2024-09-21T15:13:33.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:33.626+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c0c0 finish: resending after timeout 2024-09-21T15:13:33.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:33.630+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e4fd5c0 finish: resending after timeout 2024-09-21T15:13:33.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:33.630+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:13:33.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:33.630+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588600 finish: resending after timeout 2024-09-21T15:13:33.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:33.630+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59df48000 finish: resending after timeout 2024-09-21T15:13:33.649 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:33.650+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a6d3a600 finish: resending after timeout 2024-09-21T15:13:33.686 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:33.686+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad800 finish: resending after timeout 2024-09-21T15:13:33.688 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:33.686+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59df49ec0 finish: resending after timeout 2024-09-21T15:13:33.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:33.978+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e619680 finish: resending after timeout 2024-09-21T15:13:34.100 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:34.098+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b1ec0 finish: resending after timeout 2024-09-21T15:13:34.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:34.238+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bde00 finish: resending after timeout 2024-09-21T15:13:38.117 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=80 2024-09-21T15:13:38.117 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 80 -le 7200 ']' 2024-09-21T15:13:38.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:13:38.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:13:38.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 237 -ge 263 ']' 2024-09-21T15:13:38.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:13:38.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:38.630+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1e0c0 finish: resending after timeout 2024-09-21T15:13:38.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:38.630+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2df5500 finish: resending after timeout 2024-09-21T15:13:38.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:38.630+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a334c0c0 finish: resending after timeout 2024-09-21T15:13:38.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:38.630+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e4fd5c0 finish: resending after timeout 2024-09-21T15:13:38.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:38.630+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:13:38.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:38.630+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588600 finish: resending after timeout 2024-09-21T15:13:38.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:38.634+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59df48000 finish: resending after timeout 2024-09-21T15:13:38.650 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:38.650+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a6d3a600 finish: resending after timeout 2024-09-21T15:13:38.686 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:38.686+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad800 finish: resending after timeout 2024-09-21T15:13:38.689 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:38.686+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59df49ec0 finish: resending after timeout 2024-09-21T15:13:38.982 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:38.982+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e619680 finish: resending after timeout 2024-09-21T15:13:39.101 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:39.098+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b1ec0 finish: resending after timeout 2024-09-21T15:13:39.242 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:39.242+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bde00 finish: resending after timeout 2024-09-21T15:13:42.945 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.938+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:13:42.955 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.946+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:13:42.959 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.946+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:13:42.963 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.958+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:13:42.967 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.962+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:13:42.967 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.962+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:13:42.968 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.966+0000 7ff753f07700 -1 reset not still connected to 0x560169eaa0d0 2024-09-21T15:13:42.968 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.966+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:13:42.977 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.978+0000 7ff753f07700 -1 reset not still connected to 0x56016a50b1e0 2024-09-21T15:13:42.980 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.978+0000 7ff753f07700 -1 reset not still connected to 0x56016aeceb60 2024-09-21T15:13:42.980 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.978+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:13:42.980 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.978+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:13:42.980 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.978+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:13:42.983 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.982+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:13:42.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.986+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:13:42.990 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.990+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:13:42.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.990+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba4e0 2024-09-21T15:13:42.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.990+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:13:42.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.990+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:13:42.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.990+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc60d0 2024-09-21T15:13:42.993 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.990+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:13:42.994 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.994+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:13:42.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.994+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:13:42.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.994+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:13:42.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.994+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e340 2024-09-21T15:13:42.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.994+0000 7ff753f07700 -1 reset not still connected to 0x56016d985ba0 2024-09-21T15:13:42.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.994+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:13:42.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.994+0000 7ff753f07700 -1 reset not still connected to 0x56016dd771e0 2024-09-21T15:13:42.999 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.998+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:13:42.999 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.998+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:13:42.999 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.998+0000 7ff753f07700 -1 reset not still connected to 0x56016e36eb60 2024-09-21T15:13:42.999 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.998+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:13:42.999 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.998+0000 7ff753f07700 -1 reset not still connected to 0x56016e36fc70 2024-09-21T15:13:43.000 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.998+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:13:43.000 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:42.998+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:13:43.002 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:13:43.002 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:13:43.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:13:43.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3790 2024-09-21T15:13:43.005 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f162000 2024-09-21T15:13:43.005 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:13:43.005 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:13:43.005 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:13:43.005 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:13:43.005 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f1629c0 2024-09-21T15:13:43.005 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:13:43.005 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:13:43.005 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:13:43.005 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:13:43.005 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:13:43.006 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:13:43.006 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:13:43.006 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:13:43.006 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:13:43.006 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:13:43.006 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:13:43.006 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:13:43.006 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:13:43.006 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:13:43.006 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:13:43.006 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:13:43.006 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:13:43.006 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:13:43.007 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:13:43.007 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:13:43.007 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:13:43.007 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:13:43.007 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:13:43.008 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99d40 2024-09-21T15:13:43.008 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:13:43.008 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd8000 2024-09-21T15:13:43.008 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.002+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:13:43.008 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:13:43.008 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:13:43.008 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:13:43.008 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56017063fee0 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9930 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9e10 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:13:43.009 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56017157c5b0 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:13:43.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:13:43.011 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:13:43.011 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:13:43.011 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:13:43.011 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:13:43.006+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:13:43.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:43.630+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a0a1e0c0 finish: resending after timeout 2024-09-21T15:13:43.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:43.630+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2df5500 finish: resending after timeout 2024-09-21T15:13:43.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:43.634+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2589a40 finish: resending after timeout 2024-09-21T15:13:43.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:43.634+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2588600 finish: resending after timeout 2024-09-21T15:13:43.635 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:43.634+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59df48000 finish: resending after timeout 2024-09-21T15:13:43.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:43.650+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a6d3a600 finish: resending after timeout 2024-09-21T15:13:43.687 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:43.686+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad800 finish: resending after timeout 2024-09-21T15:13:43.690 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:43.690+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59df49ec0 finish: resending after timeout 2024-09-21T15:13:43.983 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:43.982+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e619680 finish: resending after timeout 2024-09-21T15:13:44.101 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:44.098+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b1ec0 finish: resending after timeout 2024-09-21T15:13:44.149 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.141+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:13:44.152 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.141+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:13:44.152 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.141+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:13:44.152 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.141+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:13:44.164 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:13:44.164 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:13:44.164 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:13:44.164 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:13:44.164 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:13:44.168 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.161+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:13:44.168 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.161+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:13:44.168 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.161+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af311c70 2024-09-21T15:13:44.168 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.161+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:13:44.168 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.161+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:13:44.171 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.165+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9040 2024-09-21T15:13:44.178 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.173+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:13:44.178 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.173+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:13:44.178 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.173+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1ee0 2024-09-21T15:13:44.187 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.181+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:13:44.187 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.181+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677110 2024-09-21T15:13:44.187 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:44.181+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:13:44.243 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:44.242+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bde00 finish: resending after timeout 2024-09-21T15:13:47.166 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.149+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf49c3a00 2024-09-21T15:13:47.175 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.157+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4680 2024-09-21T15:13:47.177 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.157+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4c30 2024-09-21T15:13:47.177 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.157+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff52b0 2024-09-21T15:13:47.177 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.157+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5d40 2024-09-21T15:13:47.177 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.157+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5ee0 2024-09-21T15:13:47.178 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.157+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0ee7b5f0 2024-09-21T15:13:47.178 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.157+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546c820 2024-09-21T15:13:47.178 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.157+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:13:47.178 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.157+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc16e7b5f0 2024-09-21T15:13:47.178 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.157+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1753d450 2024-09-21T15:13:47.187 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.181+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939ef70 2024-09-21T15:13:47.187 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.181+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfce4e0 2024-09-21T15:13:47.188 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.181+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfcedd0 2024-09-21T15:13:47.188 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.181+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c383040 2024-09-21T15:13:47.201 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.193+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:13:47.201 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.193+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3516c0 2024-09-21T15:13:47.201 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.193+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822b60 2024-09-21T15:13:47.201 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.193+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e823ad0 2024-09-21T15:13:47.201 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.193+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:13:47.202 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.193+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4410 2024-09-21T15:13:47.202 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.193+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f51e0 2024-09-21T15:13:47.202 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.193+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:13:47.202 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.193+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:13:47.202 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:47.193+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f3450 2024-09-21T15:13:48.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=90 2024-09-21T15:13:48.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 90 -le 7200 ']' 2024-09-21T15:13:48.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:13:48.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:13:48.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 237 -ge 263 ']' 2024-09-21T15:13:48.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:13:50.345 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:13:50.347 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:13:50.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.345+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:13:50.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.345+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:13:50.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.345+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:13:50.362 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.357+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:13:50.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.357+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:13:50.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.357+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:13:50.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.357+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:13:50.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.357+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:13:50.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.357+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:13:50.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.357+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:13:50.382 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:13:50.383 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:13:50.386 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.381+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:13:50.395 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.385+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:13:50.396 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.385+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:13:50.396 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.385+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:13:50.398 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:13:50.400 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:13:50.400 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1ee0 2024-09-21T15:13:50.400 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:13:50.400 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3110 2024-09-21T15:13:50.401 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:50.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:13:52.980 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:13:52.973+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:13:52.980 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:13:52.973+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:13:52.980 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:13:52.973+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:13:52.980 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:13:52.973+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:13:52.980 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:13:52.973+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:13:52.980 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:13:52.973+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:13:52.980 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:13:52.973+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:13:52.980 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:13:52.973+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:13:52.980 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:13:52.973+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:13:52.980 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:13:52.973+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:13:52.980 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:13:52.973+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:13:52.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:52.982+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2df5500 finish: resending after timeout 2024-09-21T15:13:52.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:52.982+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59df48000 finish: resending after timeout 2024-09-21T15:13:52.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:52.982+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a6d3a600 finish: resending after timeout 2024-09-21T15:13:52.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:52.982+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad800 finish: resending after timeout 2024-09-21T15:13:52.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:52.982+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59df49ec0 finish: resending after timeout 2024-09-21T15:13:52.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:52.982+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e619680 finish: resending after timeout 2024-09-21T15:13:52.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:52.982+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b1ec0 finish: resending after timeout 2024-09-21T15:13:52.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:52.982+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bde00 finish: resending after timeout 2024-09-21T15:13:53.018 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.014+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810b60 2024-09-21T15:13:53.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.022+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:13:53.029 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.022+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:13:53.034 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.026+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:13:53.034 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.026+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:13:53.035 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.030+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:13:53.035 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.030+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:13:53.037 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.030+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049ee0 2024-09-21T15:13:53.038 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.030+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:13:53.048 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.042+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:13:53.049 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.042+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:13:53.049 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.042+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:13:53.049 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.042+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:13:53.053 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.050+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1040 2024-09-21T15:13:53.056 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.050+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:13:53.056 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.050+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:13:53.056 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.050+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:13:53.056 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.050+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:13:53.057 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.054+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:13:53.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:13:53.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:13:53.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:13:53.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:13:53.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:13:53.059 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:13:53.059 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:13:53.059 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:13:53.060 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:13:53.060 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:13:53.060 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:13:53.060 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:13:53.060 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:13:53.060 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:13:53.060 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:13:53.060 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:13:53.060 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:13:53.061 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:13:53.061 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:13:53.061 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:13:53.061 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:13:53.061 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.058+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:13:53.065 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.062+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:13:53.065 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.062+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:13:53.065 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.062+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:13:53.065 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.062+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:13:53.065 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.062+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:13:53.066 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.062+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:13:53.066 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.062+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:13:53.066 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.062+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:13:53.066 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.062+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:13:53.127 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.122+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:13:53.152 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.150+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:13:53.152 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.150+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f930 2024-09-21T15:13:53.155 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.154+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:13:53.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.154+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4c8f0 2024-09-21T15:13:53.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.154+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4cf70 2024-09-21T15:13:53.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.154+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:13:53.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.154+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:13:53.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.154+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:13:53.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.154+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049ee0 2024-09-21T15:13:53.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.154+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:13:53.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.154+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:13:53.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.154+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6b60 2024-09-21T15:13:53.158 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.154+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:13:53.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:13:53.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:13:53.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1040 2024-09-21T15:13:53.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:13:53.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c9c0 2024-09-21T15:13:53.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266d6c0 2024-09-21T15:13:53.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b28585b0 2024-09-21T15:13:53.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50270 2024-09-21T15:13:53.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50410 2024-09-21T15:13:53.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f504e0 2024-09-21T15:13:53.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:13:53.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50a90 2024-09-21T15:13:53.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50b60 2024-09-21T15:13:53.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.162+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50f70 2024-09-21T15:13:53.167 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.162+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:13:53.168 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.162+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:13:53.168 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.162+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:13:53.168 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.162+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51860 2024-09-21T15:13:53.168 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.162+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51930 2024-09-21T15:13:53.168 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.162+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51a00 2024-09-21T15:13:53.171 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.166+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:13:53.172 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.170+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:13:53.175 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.170+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:13:53.176 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.170+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31004e0 2024-09-21T15:13:53.176 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.170+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31009c0 2024-09-21T15:13:53.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.170+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:13:53.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.170+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:13:53.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.170+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:13:53.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.174+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:13:53.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.174+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:13:53.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.174+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc410 2024-09-21T15:13:53.181 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:13:53.181 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:13:53.181 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd520 2024-09-21T15:13:53.181 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd6c0 2024-09-21T15:13:53.181 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:13:53.181 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:13:53.181 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:13:53.182 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:13:53.182 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b36868f0 2024-09-21T15:13:53.182 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:13:53.182 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810b60 2024-09-21T15:13:53.182 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:13:53.182 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811a00 2024-09-21T15:13:53.185 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:13:53.189 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:13:53.189 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45de340 2024-09-21T15:13:53.189 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:13:53.189 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45df860 2024-09-21T15:13:53.189 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dfa00 2024-09-21T15:13:53.189 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76000 2024-09-21T15:13:53.189 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:13:53.189 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76c30 2024-09-21T15:13:53.189 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76d00 2024-09-21T15:13:53.189 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:13:53.189 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:13:53.189 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd2ea0 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:13:53.190 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:13:53.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:13:53.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:13:53.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:13:53.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:13:53.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:13:53.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:13:53.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eab60 2024-09-21T15:13:53.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:13:53.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:13:53.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.186+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:13:53.192 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.190+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d85b0 2024-09-21T15:13:53.192 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.190+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:13:53.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:13:53.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:13:53.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:13:53.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:13:53.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:13:53.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:13:53.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782410 2024-09-21T15:13:53.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:13:53.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782820 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782a90 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782d00 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783040 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783380 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783520 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:13:53.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783e10 2024-09-21T15:13:53.196 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:13:53.196 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:13:53.196 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9110 2024-09-21T15:13:53.196 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9930 2024-09-21T15:13:53.196 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:13:53.197 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:13:53.197 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:13:53.197 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:13:53.197 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47040 2024-09-21T15:13:53.197 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:13:53.197 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:13:53.197 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a4e0 2024-09-21T15:13:53.198 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b86c6270 2024-09-21T15:13:53.198 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:13:53.198 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:13:53.198 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:13:53.198 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:13:53.198 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:13:53.198 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:13:53.198 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:13:53.194+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fe10 2024-09-21T15:13:57.865 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.853+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:13:57.865 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.853+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:13:57.865 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.853+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:13:57.876 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.869+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:13:57.889 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.877+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:13:57.889 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.881+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:13:57.890 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.881+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:13:57.891 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.881+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:13:57.891 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.881+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:13:57.891 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.881+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780ed00 2024-09-21T15:13:57.891 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.881+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:13:57.891 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.881+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:13:57.891 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.881+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:13:57.891 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.885+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:13:57.891 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.885+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:13:57.892 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.885+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:13:57.892 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.885+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:13:57.892 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.885+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:13:57.892 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.885+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:13:57.892 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.885+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:13:57.894 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:13:57.894 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:13:57.894 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:13:57.894 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f1e0 2024-09-21T15:13:57.894 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f2b0 2024-09-21T15:13:57.894 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:13:57.894 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:13:57.894 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:13:57.894 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:13:57.894 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c4e0 2024-09-21T15:13:57.894 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18dc70 2024-09-21T15:13:57.894 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:13:57.894 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:13:57.895 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:13:57.895 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:13:57.895 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:13:57.895 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:13:57.895 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:13:57.895 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:13:57.895 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:13:57.895 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:13:57.895 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:13:57.895 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288b60 2024-09-21T15:13:57.895 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:13:57.895 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:13:57.895 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:13:57.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:13:57.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69e10 2024-09-21T15:13:57.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:13:57.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:13:57.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:13:57.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:13:57.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:13:57.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af311c70 2024-09-21T15:13:57.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:13:57.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:13:57.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8750 2024-09-21T15:13:57.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:13:57.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9040 2024-09-21T15:13:57.897 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:13:57.897 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:13:57.898 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:13:57.898 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:13:57.898 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677110 2024-09-21T15:13:57.898 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3110 2024-09-21T15:13:57.898 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:57.889+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:13:57.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:57.986+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59df48000 finish: resending after timeout 2024-09-21T15:13:57.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:57.986+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a6d3a600 finish: resending after timeout 2024-09-21T15:13:57.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:57.986+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad800 finish: resending after timeout 2024-09-21T15:13:57.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:57.986+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59df49ec0 finish: resending after timeout 2024-09-21T15:13:57.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:57.986+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e619680 finish: resending after timeout 2024-09-21T15:13:57.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:57.986+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b1ec0 finish: resending after timeout 2024-09-21T15:13:57.988 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:57.986+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bde00 finish: resending after timeout 2024-09-21T15:13:58.224 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=100 2024-09-21T15:13:58.225 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 100 -le 7200 ']' 2024-09-21T15:13:58.225 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:13:58.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:13:58.242 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:58.242+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59f8ea1e0 handle_clone_image: failed to clone image mirror/10b4afba8c8d to image_cluster1.client.mirror.3-clone49 2024-09-21T15:13:58.275 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.269+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:13:58.275 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.269+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939edd0 2024-09-21T15:13:58.278 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.273+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939ef70 2024-09-21T15:13:58.279 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.273+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fc70 2024-09-21T15:13:58.280 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 238 -ge 263 ']' 2024-09-21T15:13:58.280 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:13:58.282 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.277+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfce4e0 2024-09-21T15:13:58.307 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfcedd0 2024-09-21T15:13:58.307 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c383040 2024-09-21T15:13:58.307 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:13:58.308 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3508f0 2024-09-21T15:13:58.308 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3516c0 2024-09-21T15:13:58.308 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822680 2024-09-21T15:13:58.308 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822b60 2024-09-21T15:13:58.308 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e823ad0 2024-09-21T15:13:58.308 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:13:58.308 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4410 2024-09-21T15:13:58.308 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f51e0 2024-09-21T15:13:58.308 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:13:58.308 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:13:58.308 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:13:58.301+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f3450 2024-09-21T15:13:58.310 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:58.306+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:13:58.313 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:58.310+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:13:58.314 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:58.310+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:13:58.314 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:58.310+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:13:58.326 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:58.318+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:13:58.327 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:58.322+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:13:58.327 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:58.322+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:13:58.332 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:58.330+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:13:58.333 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:13:58.330+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:13:58.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:58.642+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a2ba43c0 handle_clone_image: failed to clone image mirror/10b6652a2687 to image_cluster1.client.mirror.4-clone41 2024-09-21T15:13:58.689 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:58.686+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3547c20 handle_clone_image: failed to clone image mirror/10b7e5ea9f3c to image_cluster1.client.mirror.5-clone37 2024-09-21T15:13:58.713 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:58.701+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:13:58.715 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:13:58.705+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:13:58.716 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:58.714+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a269f0e0 handle_clone_image: failed to clone image mirror/10ad30b3b2ab to image_cluster1.client.mirror.2-clone35 2024-09-21T15:13:58.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:58.786+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f5a3f99860 handle_clone_image: failed to clone image mirror/10b7394b6f24 to image_cluster1.client.mirror.5-clone27 2024-09-21T15:13:58.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:13:58.906+0000 7f47cd813700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x55f59f2be5a0 handle_clone_image: failed to clone image mirror/10b65ffcf470 to image_cluster1.client.mirror.4-clone16 2024-09-21T15:14:00.026 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.022+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:14:00.037 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.034+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:14:00.040 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.038+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:14:00.040 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.038+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:14:00.040 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.038+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:14:00.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.038+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:14:00.045 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.042+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:14:00.050 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.046+0000 7ff753f07700 -1 reset not still connected to 0x560169eaa0d0 2024-09-21T15:14:00.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.046+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:14:00.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.046+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:14:00.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.046+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:14:00.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.046+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:14:00.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.046+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:14:00.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.046+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:14:00.062 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.058+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba4e0 2024-09-21T15:14:00.062 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.058+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:14:00.062 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.058+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:14:00.062 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.058+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:14:00.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.062+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:14:00.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.062+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:14:00.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.062+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:14:00.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.062+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:14:00.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.062+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:14:00.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.062+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:14:00.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.062+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:14:00.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.062+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:14:00.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.062+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:14:00.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:14:00.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:14:00.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:14:00.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:14:00.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.066+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:14:00.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:14:00.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:14:00.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:14:00.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:14:00.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:14:00.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.066+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:14:00.072 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:14:00.072 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:14:00.072 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:14:00.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:14:00.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:14:00.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:14:00.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:14:00.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:14:00.073 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:14:00.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:14:00.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:14:00.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:14:00.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:14:00.074 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.070+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:14:00.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.074+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:14:00.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.074+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:14:00.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.074+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:14:00.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.074+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:14:00.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.074+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:14:00.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.074+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:14:00.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.074+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:14:00.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.074+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:14:00.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.074+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:14:00.075 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.074+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:14:00.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.074+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:14:00.076 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:00.074+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:14:03.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:03.354+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cad800 finish: resending after timeout 2024-09-21T15:14:03.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:03.354+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59df49ec0 finish: resending after timeout 2024-09-21T15:14:03.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:03.354+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e619680 finish: resending after timeout 2024-09-21T15:14:03.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:03.354+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b1ec0 finish: resending after timeout 2024-09-21T15:14:03.357 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:03.354+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bde00 finish: resending after timeout 2024-09-21T15:14:03.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:03.486+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e619500 finish: resending after timeout 2024-09-21T15:14:03.487 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:03.486+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4609c0 finish: resending after timeout 2024-09-21T15:14:04.244 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:04.241+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:14:04.278 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:04.277+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a4f7b8c0 finish: resending after timeout 2024-09-21T15:14:04.314 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:04.313+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a4f7a9c0 finish: resending after timeout 2024-09-21T15:14:08.280 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=110 2024-09-21T15:14:08.281 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 110 -le 7200 ']' 2024-09-21T15:14:08.281 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:14:08.281 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:14:08.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 242 -ge 263 ']' 2024-09-21T15:14:08.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:14:08.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:08.353+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59df49ec0 finish: resending after timeout 2024-09-21T15:14:08.357 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:08.353+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e619680 finish: resending after timeout 2024-09-21T15:14:08.357 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:08.357+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b1ec0 finish: resending after timeout 2024-09-21T15:14:08.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:08.357+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bde00 finish: resending after timeout 2024-09-21T15:14:08.487 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:08.485+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e619500 finish: resending after timeout 2024-09-21T15:14:08.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:08.485+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4609c0 finish: resending after timeout 2024-09-21T15:14:08.638 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.6512137052542417) > weight (0.25) 2024-09-21T15:14:08.638 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.1 2024-09-21T15:14:08.638 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Sent signal 15 2024-09-21T15:14:08.638 INFO:tasks.rbd_mirror_thrash:waiting for 1 secs before reviving daemons 2024-09-21T15:14:08.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:14:08.637+0000 7fe4fa99d700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 24853) UID: 1000 2024-09-21T15:14:09.245 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:09.241+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:14:09.279 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:09.277+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a4f7b8c0 finish: resending after timeout 2024-09-21T15:14:09.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:09.313+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a4f7a9c0 finish: resending after timeout 2024-09-21T15:14:09.639 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.1 2024-09-21T15:14:09.640 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:14:09.640 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.1 2024-09-21T15:14:09.640 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2024-09-21T15:14:09.640 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2024-09-21T15:14:09.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2024-09-21T15:14:09.643 INFO:tasks.rbd_mirror_thrash:waiting for 74 secs before thrashing 2024-09-21T15:14:13.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:13.357+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a33b1ec0 finish: resending after timeout 2024-09-21T15:14:13.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:13.357+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a27bde00 finish: resending after timeout 2024-09-21T15:14:13.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:13.485+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e619500 finish: resending after timeout 2024-09-21T15:14:13.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:13.485+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f4609c0 finish: resending after timeout 2024-09-21T15:14:14.246 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:14.245+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:14:14.280 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:14.277+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a4f7b8c0 finish: resending after timeout 2024-09-21T15:14:14.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:14.313+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a4f7a9c0 finish: resending after timeout 2024-09-21T15:14:17.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:17.697+0000 7f481109a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x55f5ad19d880 get_replay_status: replay not running 2024-09-21T15:14:18.014 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.009+0000 7f52f1ba9700 -1 reset not still connected to 0x55713af26000 2024-09-21T15:14:18.015 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.009+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:14:18.017 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.013+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:14:18.018 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.017+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc8cb60 2024-09-21T15:14:18.027 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.025+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf0d860 2024-09-21T15:14:18.027 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.025+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf7c5b0 2024-09-21T15:14:18.027 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.025+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cfa7040 2024-09-21T15:14:18.029 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.025+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ad0 2024-09-21T15:14:18.029 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.025+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae11e0 2024-09-21T15:14:18.029 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.025+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:14:18.029 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.025+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:14:18.031 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.029+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df812b0 2024-09-21T15:14:18.031 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.029+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81930 2024-09-21T15:14:18.032 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.029+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81ba0 2024-09-21T15:14:18.037 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.033+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:14:18.038 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.033+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e115040 2024-09-21T15:14:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e7ea270 2024-09-21T15:14:18.040 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.037+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:14:18.047 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.045+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4340 2024-09-21T15:14:18.047 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.045+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4410 2024-09-21T15:14:18.050 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.045+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e49c0 2024-09-21T15:14:18.052 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.049+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4c30 2024-09-21T15:14:18.054 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.049+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4f70 2024-09-21T15:14:18.054 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.049+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e51e0 2024-09-21T15:14:18.054 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.049+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5860 2024-09-21T15:14:18.055 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.049+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ba0 2024-09-21T15:14:18.057 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.053+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5c70 2024-09-21T15:14:18.063 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.061+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ee0 2024-09-21T15:14:18.064 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.061+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:14:18.064 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.061+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb24c30 2024-09-21T15:14:18.064 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.061+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:14:18.064 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.061+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fdd61a0 2024-09-21T15:14:18.064 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.061+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c270 2024-09-21T15:14:18.064 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.061+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:14:18.064 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.061+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c9c0 2024-09-21T15:14:18.065 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.061+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cb60 2024-09-21T15:14:18.065 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.061+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cd00 2024-09-21T15:14:18.065 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.061+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dee0 2024-09-21T15:14:18.065 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.061+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed01a0 2024-09-21T15:14:18.065 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.061+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed0ea0 2024-09-21T15:14:18.071 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.065+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f4820 2024-09-21T15:14:18.071 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.065+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f5110 2024-09-21T15:14:18.071 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.065+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f55f0 2024-09-21T15:14:18.073 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.069+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:14:18.073 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.069+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1110 2024-09-21T15:14:18.073 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.069+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1e10 2024-09-21T15:14:18.073 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.069+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16000 2024-09-21T15:14:18.073 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.069+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:14:18.073 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.069+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16b60 2024-09-21T15:14:18.073 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.069+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17040 2024-09-21T15:14:18.074 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.069+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17a00 2024-09-21T15:14:18.074 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.069+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb0000 2024-09-21T15:14:18.074 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.069+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb1c70 2024-09-21T15:14:18.074 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.069+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:14:18.075 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.073+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:14:18.075 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.073+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:14:18.075 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.073+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb2b0 2024-09-21T15:14:18.075 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.073+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:14:18.075 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.073+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:14:18.075 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.073+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:14:18.076 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.073+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0f70 2024-09-21T15:14:18.076 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.073+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef12b0 2024-09-21T15:14:18.082 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.077+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef1a00 2024-09-21T15:14:18.084 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a0d0 2024-09-21T15:14:18.084 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232aea0 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b860 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142d01110 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8000 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8340 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8d00 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:14:18.085 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:14:18.086 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9450 2024-09-21T15:14:18.086 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb95f0 2024-09-21T15:14:18.086 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:14:18.086 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9930 2024-09-21T15:14:18.086 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9c70 2024-09-21T15:14:18.086 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:14:18.086 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:14:18.086 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714346b930 2024-09-21T15:14:18.086 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cdd0 2024-09-21T15:14:18.086 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cea0 2024-09-21T15:14:18.086 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557147227e10 2024-09-21T15:14:18.086 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713912a820 2024-09-21T15:14:18.086 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713912b2b0 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x5571393e85b0 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x5571393e8820 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x5571393e8c30 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713962d930 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a397d40 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a49d930 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ad1eb60 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ad1fa00 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713af26000 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e410 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61f380 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7f21a0 2024-09-21T15:14:18.087 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b8601a0 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc76410 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc8cb60 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c10d110 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c10d5f0 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c155860 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c213860 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf0d860 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf7c5b0 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cfa7040 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ad0 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ba0 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae11e0 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:14:18.088 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:14:18.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81040 2024-09-21T15:14:18.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df812b0 2024-09-21T15:14:18.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81930 2024-09-21T15:14:18.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81ba0 2024-09-21T15:14:18.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:14:18.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e115040 2024-09-21T15:14:18.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e7ea270 2024-09-21T15:14:18.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:14:18.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4340 2024-09-21T15:14:18.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4410 2024-09-21T15:14:18.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e49c0 2024-09-21T15:14:18.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4c30 2024-09-21T15:14:18.089 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4f70 2024-09-21T15:14:18.091 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e51e0 2024-09-21T15:14:18.091 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5860 2024-09-21T15:14:18.091 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ba0 2024-09-21T15:14:18.091 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5c70 2024-09-21T15:14:18.091 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ee0 2024-09-21T15:14:18.091 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:14:18.091 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb24c30 2024-09-21T15:14:18.091 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:14:18.091 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fdd61a0 2024-09-21T15:14:18.091 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c270 2024-09-21T15:14:18.091 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c9c0 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cb60 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cd00 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dee0 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed01a0 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed0ea0 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f4820 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f5110 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f55f0 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1110 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1e10 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16000 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:14:18.092 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16b60 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17040 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17a00 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb0000 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb1c70 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.081+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb2b0 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0f70 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef12b0 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef1a00 2024-09-21T15:14:18.093 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a0d0 2024-09-21T15:14:18.094 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232aea0 2024-09-21T15:14:18.094 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:14:18.094 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b860 2024-09-21T15:14:18.094 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:14:18.094 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142d01110 2024-09-21T15:14:18.094 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8000 2024-09-21T15:14:18.094 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:14:18.094 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8340 2024-09-21T15:14:18.094 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:14:18.094 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8d00 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9450 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb95f0 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9930 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9c70 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cdd0 2024-09-21T15:14:18.095 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cea0 2024-09-21T15:14:18.096 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55713912b2b0 2024-09-21T15:14:18.096 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55713962d930 2024-09-21T15:14:18.096 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a397d40 2024-09-21T15:14:18.096 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a49d930 2024-09-21T15:14:18.096 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:14:18.096 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:14:18.096 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81930 2024-09-21T15:14:18.096 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:14:18.096 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:14:18.096 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:14:18.096 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:18.085+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:14:18.163 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:18.160+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:14:18.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=120 2024-09-21T15:14:18.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 120 -le 7200 ']' 2024-09-21T15:14:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:14:18.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:14:18.381 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 242 -ge 263 ']' 2024-09-21T15:14:18.381 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:14:23.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:23.081+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59f461800 finish: resending after timeout 2024-09-21T15:14:23.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:23.081+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a4f7b8c0 finish: resending after timeout 2024-09-21T15:14:23.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:23.081+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a4f7a9c0 finish: resending after timeout 2024-09-21T15:14:26.644 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.0 2024-09-21T15:14:26.644 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Sent signal 15 2024-09-21T15:14:26.644 INFO:tasks.rbd_mirror_thrash:waiting for 9 secs before reviving daemons 2024-09-21T15:14:26.645 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:14:26.641+0000 7f610f8af700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 (PID: 37152) UID: 1000 2024-09-21T15:14:27.675 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.673+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:14:27.675 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.673+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:14:27.675 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.673+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:14:27.680 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.677+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:14:27.684 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.677+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:14:27.696 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.693+0000 7ff753f07700 -1 reset not still connected to 0x56016a38c410 2024-09-21T15:14:27.696 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.693+0000 7ff753f07700 -1 reset not still connected to 0x56016a50b1e0 2024-09-21T15:14:27.696 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.693+0000 7ff753f07700 -1 reset not still connected to 0x56016aeceb60 2024-09-21T15:14:27.696 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.693+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:14:27.696 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.693+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:14:27.696 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.693+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:14:27.696 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.693+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:14:27.698 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.697+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:14:27.698 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.697+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:14:27.713 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.709+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb040 2024-09-21T15:14:27.713 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.709+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:14:27.714 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.713+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc60d0 2024-09-21T15:14:27.714 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.713+0000 7ff753f07700 -1 reset not still connected to 0x56016cfb9790 2024-09-21T15:14:27.714 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.713+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:14:27.714 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.713+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:14:27.714 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.713+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:14:27.714 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.713+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e340 2024-09-21T15:14:27.714 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.713+0000 7ff753f07700 -1 reset not still connected to 0x56016d985ba0 2024-09-21T15:14:27.714 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.713+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:14:27.721 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:14:27.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:14:27.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:14:27.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:14:27.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:14:27.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:14:27.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:14:27.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:14:27.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:14:27.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f1629c0 2024-09-21T15:14:27.723 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:14:27.723 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:14:27.723 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:14:27.723 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:14:27.723 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:14:27.723 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:14:27.723 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:14:27.723 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:14:27.723 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:14:27.723 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:14:27.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:14:27.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:14:27.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:14:27.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:14:27.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:14:27.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:14:27.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:14:27.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:14:27.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:14:27.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:14:27.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd8000 2024-09-21T15:14:27.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:14:27.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017063fee0 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9930 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017157c5b0 2024-09-21T15:14:27.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:14:27.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:14:27.727 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:14:27.727 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:14:27.727 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:14:27.727 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:14:27.727 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:14:27.727 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:14:27.727 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017529a000 2024-09-21T15:14:27.727 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:27.717+0000 7ff753f07700 -1 reset not still connected to 0x56017529a4e0 2024-09-21T15:14:27.937 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.928+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546d790 2024-09-21T15:14:27.939 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.936+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:14:27.939 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.936+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc16e7b5f0 2024-09-21T15:14:27.939 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.936+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1753d450 2024-09-21T15:14:27.945 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.936+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939edd0 2024-09-21T15:14:27.945 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.936+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939ef70 2024-09-21T15:14:27.945 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.936+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fc70 2024-09-21T15:14:27.948 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.944+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc19691790 2024-09-21T15:14:27.956 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.948+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfce4e0 2024-09-21T15:14:27.956 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.948+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfcedd0 2024-09-21T15:14:27.959 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c383040 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf592b0 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3508f0 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3516c0 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822680 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822b60 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e823ad0 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1f299930 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1fdebd40 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4410 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f51e0 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:14:27.960 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21738c30 2024-09-21T15:14:27.961 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f3450 2024-09-21T15:14:27.961 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc238280d0 2024-09-21T15:14:27.961 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc23829520 2024-09-21T15:14:27.961 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc23829d40 2024-09-21T15:14:27.961 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24055ad0 2024-09-21T15:14:27.961 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:14:27.956+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0cf70 2024-09-21T15:14:28.085 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:28.081+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a4f7b8c0 finish: resending after timeout 2024-09-21T15:14:28.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=130 2024-09-21T15:14:28.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 130 -le 7200 ']' 2024-09-21T15:14:28.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:14:28.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:14:28.436 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 243 -ge 263 ']' 2024-09-21T15:14:28.436 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:14:28.485 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.481+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:14:28.486 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.485+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:14:28.486 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.485+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:14:28.486 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.485+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:14:28.501 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.497+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:14:28.501 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.497+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:14:28.502 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.497+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:14:28.502 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.497+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:14:28.515 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.509+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:14:28.516 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.509+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:14:28.516 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.509+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:14:28.516 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.509+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:14:28.516 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.509+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:14:28.516 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.509+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:14:28.517 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.509+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:14:28.517 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.509+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:14:28.519 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.513+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:14:28.519 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.513+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:14:28.520 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.517+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:14:28.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:14:28.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:14:28.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:14:28.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:14:28.533 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:14:28.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:14:28.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:14:28.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:14:28.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:14:28.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:14:28.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:14:28.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:14:28.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:14:28.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:14:28.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.529+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:14:28.663 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.661+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:14:28.663 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.661+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:14:28.671 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.669+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:14:28.671 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.669+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:14:28.672 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.669+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:14:28.672 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.669+0000 7ff753f07700 -1 reset not still connected to 0x560169eaa0d0 2024-09-21T15:14:28.672 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.669+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:14:28.672 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.669+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f7040 2024-09-21T15:14:28.673 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.669+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:14:28.673 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.669+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:14:28.673 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.669+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:14:28.673 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.669+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:14:28.679 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.673+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:14:28.679 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.673+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:14:28.694 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.693+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:14:28.701 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.697+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:14:28.702 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.697+0000 7ff753f07700 -1 reset not still connected to 0x56016cfb9790 2024-09-21T15:14:28.706 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.701+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:14:28.706 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.701+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:14:28.706 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.701+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:14:28.710 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.709+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e340 2024-09-21T15:14:28.710 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.709+0000 7ff753f07700 -1 reset not still connected to 0x56016d985ba0 2024-09-21T15:14:28.711 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.709+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:14:28.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.721+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:14:28.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.721+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:14:28.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.721+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:14:28.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.721+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:14:28.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.721+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:14:28.723 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.721+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:14:28.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.721+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:14:28.724 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.721+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:14:28.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f162000 2024-09-21T15:14:28.726 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:28.724+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:14:28.726 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:28.724+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:14:28.728 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:14:28.728 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:14:28.729 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:14:28.729 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:28.724+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:14:28.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:14:28.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f1629c0 2024-09-21T15:14:28.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:14:28.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:14:28.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:14:28.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:14:28.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:14:28.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:14:28.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:14:28.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:14:28.731 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:14:28.731 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:14:28.731 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:14:28.731 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:14:28.734 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:14:28.734 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:14:28.734 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:14:28.734 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:14:28.734 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:14:28.734 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:14:28.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:14:28.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:14:28.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:14:28.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:14:28.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:14:28.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:14:28.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd8000 2024-09-21T15:14:28.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:14:28.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:14:28.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:14:28.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.725+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:14:28.738 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:14:28.738 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:14:28.738 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017063fee0 2024-09-21T15:14:28.738 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:14:28.738 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:14:28.738 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:14:28.741 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:14:28.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9930 2024-09-21T15:14:28.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:14:28.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:14:28.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:14:28.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:14:28.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:14:28.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:14:28.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017157c5b0 2024-09-21T15:14:28.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:14:28.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:14:28.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:14:28.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:14:28.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:14:28.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:14:28.744 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017529a000 2024-09-21T15:14:28.744 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:28.737+0000 7ff753f07700 -1 reset not still connected to 0x56017529a4e0 2024-09-21T15:14:28.841 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.837+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:14:28.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.841+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:14:28.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.841+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:14:28.852 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.849+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:14:28.853 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.849+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:14:28.881 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.877+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76d00 2024-09-21T15:14:28.881 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.877+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:14:28.881 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.877+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:14:28.883 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.881+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd2ea0 2024-09-21T15:14:28.884 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.881+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:14:28.884 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.881+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:14:28.884 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.881+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:14:28.884 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.881+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:14:28.884 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.881+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:14:28.884 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.881+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:14:28.884 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.881+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:14:28.884 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.881+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:14:28.887 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.885+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:14:28.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.885+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:14:28.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.885+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:14:28.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.885+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:14:28.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.885+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:14:28.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.889+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:14:28.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:14:28.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:14:28.895 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:14:28.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:14:28.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:14:28.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:14:28.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eab60 2024-09-21T15:14:28.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:14:28.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:14:28.896 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:14:28.899 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d85b0 2024-09-21T15:14:28.901 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.893+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:14:28.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:14:28.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:14:28.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:14:28.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:14:28.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:14:28.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:14:28.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782410 2024-09-21T15:14:28.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:14:28.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:14:28.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782820 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782a90 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782d00 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783040 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783380 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783520 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783e10 2024-09-21T15:14:28.905 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:14:28.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:14:28.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9110 2024-09-21T15:14:28.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de95f0 2024-09-21T15:14:28.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.897+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9930 2024-09-21T15:14:28.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.901+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9ba0 2024-09-21T15:14:28.906 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.901+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:14:28.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.901+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:14:28.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.901+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:14:28.907 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.901+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:14:28.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.905+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47040 2024-09-21T15:14:28.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.905+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:14:28.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.905+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:14:28.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.905+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a4e0 2024-09-21T15:14:28.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.905+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b86c6270 2024-09-21T15:14:28.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.905+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:14:28.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.905+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:14:28.908 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.905+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90d00 2024-09-21T15:14:28.909 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.905+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8f82270 2024-09-21T15:14:28.909 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.905+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8f83ad0 2024-09-21T15:14:28.911 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.909+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:14:28.914 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:14:28.914 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f790 2024-09-21T15:14:28.914 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f930 2024-09-21T15:14:28.914 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:14:28.914 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3380 2024-09-21T15:14:28.915 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d35f0 2024-09-21T15:14:28.915 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3860 2024-09-21T15:14:28.915 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e60d0 2024-09-21T15:14:28.915 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:14:28.915 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e6750 2024-09-21T15:14:28.915 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e7c70 2024-09-21T15:14:28.915 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:14:28.915 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72e4e0 2024-09-21T15:14:28.915 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fe10 2024-09-21T15:14:28.915 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:28.913+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:14:29.311 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:29.309+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:14:29.311 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:29.309+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:14:29.311 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:29.309+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:14:29.311 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:29.309+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:14:29.311 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:29.309+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:14:29.411 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:14:29.409+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:14:31.028 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.025+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d26c80 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:14:31.028 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.025+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8cbf180 [3/ab9322e9-f0d3-4e57-ba54-faf9cbd16ee7] start: already running 2024-09-21T15:14:31.028 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.025+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d26500 [3/b0959eb5-273e-4f52-8a00-24247f1f87d2] start: already running 2024-09-21T15:14:31.061 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.057+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d91b80 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:14:31.061 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.057+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d91b80 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:14:31.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9c500 [3/ee5e1490-4a11-4636-ab8f-ee0651bb84e7] start: already running 2024-09-21T15:14:31.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9c500 [3/ee5e1490-4a11-4636-ab8f-ee0651bb84e7] start: already running 2024-09-21T15:14:31.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8cbef00 [3/ab585917-bbfb-41ce-a268-5e9596e12ef3] start: already running 2024-09-21T15:14:31.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8cbec80 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:14:31.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d26000 [3/aff5f3bc-3e8e-4a66-b089-b2f57573290a] start: already running 2024-09-21T15:14:31.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8cbea00 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:14:31.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8cbf900 [3/af962aab-237c-497b-989c-5a6f03523f73] start: already running 2024-09-21T15:14:31.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8cbfb80 [3/afce2605-a8db-416c-a324-7471613e476c] start: already running 2024-09-21T15:14:31.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8cbf400 [3/ace09410-303f-4cc6-8fa7-c5190a4c62e6] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d26a00 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d26f00 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8cbf680 [3/af7bb590-faa2-4f57-80f6-c5ab02216567] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d27180 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d26280 [3/b0925bf1-5012-45a2-afe9-91608ced3c6a] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d27900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d27900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90000 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90000 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d27b80 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d27b80 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:14:31.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90f00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90f00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d91180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d91180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d91900 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d91900 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dba000 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dba000 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dba780 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dba780 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dba280 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dba280 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbac80 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbac80 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:14:31.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dba500 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dba500 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d91400 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8d91400 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbbb80 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbbb80 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8df5680 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8df5680 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4ca00 [3/e11bf669-24bd-415f-9833-0c4630550c23] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4ca00 [3/e11bf669-24bd-415f-9833-0c4630550c23] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbaf00 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbaf00 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4c280 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4c280 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:14:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4500 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:14:31.090 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.081+0000 7faa4eb8c700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4500 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:14:31.101 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4f00 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:14:31.101 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4f00 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:14:31.101 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df5400 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df5400 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4a00 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4a00 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbb900 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbb900 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4cc80 [3/e2c7112f-7834-4998-b6f4-09f9fd94ae24] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4cc80 [3/e2c7112f-7834-4998-b6f4-09f9fd94ae24] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbb400 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbb400 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4c000 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4c000 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4280 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4280 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:14:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4000 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4000 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df5180 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df5180 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4780 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4780 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df5b80 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df5b80 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9c280 [3/ed8f9c7d-1492-4fbd-ae77-4c3bfa2f3787] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9c280 [3/ed8f9c7d-1492-4fbd-ae77-4c3bfa2f3787] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4d900 [3/e51aede5-de84-423f-9449-2f9e9884385e] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4d900 [3/e51aede5-de84-423f-9449-2f9e9884385e] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4cf00 [3/e33347f9-479f-4080-b33f-92c69acaa835] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4cf00 [3/e33347f9-479f-4080-b33f-92c69acaa835] start: already running 2024-09-21T15:14:31.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4db80 [3/e6696bd8-9005-4eeb-8e44-c70647860921] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4db80 [3/e6696bd8-9005-4eeb-8e44-c70647860921] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4d680 [3/e513238f-c4c4-4cbc-8a2f-c21215922f5f] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4d680 [3/e513238f-c4c4-4cbc-8a2f-c21215922f5f] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbb680 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbb680 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9d180 [3/f2dae9ca-5e22-44e6-90a3-2cbebe5fa594] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9d180 [3/f2dae9ca-5e22-44e6-90a3-2cbebe5fa594] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4d180 [3/e4a35a0f-eabb-4389-9239-82ff9a0828e6] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4d180 [3/e4a35a0f-eabb-4389-9239-82ff9a0828e6] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9c780 [3/ee8573b9-7a14-470f-b519-004503b68b59] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9c780 [3/ee8573b9-7a14-470f-b519-004503b68b59] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4c80 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8df4c80 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:14:31.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9c000 [3/e6c1e46d-943e-48ab-b899-f1d65ff8944a] start: already running 2024-09-21T15:14:31.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9c000 [3/e6c1e46d-943e-48ab-b899-f1d65ff8944a] start: already running 2024-09-21T15:14:31.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9d680 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:14:31.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9d680 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:14:31.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9cf00 [3/f033ad39-c053-43aa-829a-9160c2473e5a] start: already running 2024-09-21T15:14:31.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9cf00 [3/f033ad39-c053-43aa-829a-9160c2473e5a] start: already running 2024-09-21T15:14:31.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9cc80 [3/ef79be89-94fa-4d0c-a9a8-2fd05127bdc5] start: already running 2024-09-21T15:14:31.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9cc80 [3/ef79be89-94fa-4d0c-a9a8-2fd05127bdc5] start: already running 2024-09-21T15:14:31.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8d27400 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:14:31.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.097+0000 7faa4e38b700 -1 rbd::mirror::ImageReplayer: 0x557bf8d27400 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:14:31.108 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.105+0000 7faa5bba6700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9d900 [3/f7c87bd3-b914-47e1-bfe3-31c0275bb492] start: already running 2024-09-21T15:14:31.108 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.105+0000 7faa5bba6700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9d900 [3/f7c87bd3-b914-47e1-bfe3-31c0275bb492] start: already running 2024-09-21T15:14:31.109 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.105+0000 7faa5bba6700 -1 rbd::mirror::ImageReplayer: 0x557bf8ed2280 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:14:31.109 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.105+0000 7faa5bba6700 -1 rbd::mirror::ImageReplayer: 0x557bf8ed2280 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:14:31.109 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.105+0000 7faa5bba6700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9db80 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:14:31.109 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.105+0000 7faa5bba6700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9db80 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:14:31.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.129+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8ed2500 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:14:31.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.129+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8ed2500 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:14:31.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.129+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90a00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:14:31.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.129+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90a00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:14:31.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.129+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d91680 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:14:31.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.129+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d91680 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:14:31.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbb180 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:14:31.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbb180 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:14:31.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4c500 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4c500 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9d400 [3/f5f9a344-230e-4e5b-b1a4-3e4b4fc4cc86] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9d400 [3/f5f9a344-230e-4e5b-b1a4-3e4b4fc4cc86] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9ca00 [3/eee89f94-874b-48ea-bcd4-804b53f039c0] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8e9ca00 [3/eee89f94-874b-48ea-bcd4-804b53f039c0] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8ed2000 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8ed2000 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8ed2a00 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8ed2a00 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8ed2780 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8ed2780 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8ed2c80 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8ed2c80 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:14:31.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d27680 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d27680 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90500 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90500 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4c780 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4c780 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90780 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90780 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d26780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbaa00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8dbaa00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4d400 [3/e4d1114b-ada5-4ff8-999f-0119c103708f] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8e4d400 [3/e4d1114b-ada5-4ff8-999f-0119c103708f] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90c80 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8d90c80 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:14:31.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8df5900 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:14:31.138 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:14:31.133+0000 7faa5b3a5700 -1 rbd::mirror::ImageReplayer: 0x557bf8df5900 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:14:34.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:34.429+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e4fc0c0 finish: resending after timeout 2024-09-21T15:14:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:34.429+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a2e6c480 finish: resending after timeout 2024-09-21T15:14:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:34.429+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a5fca000 finish: resending after timeout 2024-09-21T15:14:34.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:34.429+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59ca0fc80 finish: resending after timeout 2024-09-21T15:14:34.433 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:34.429+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a6d37500 finish: resending after timeout 2024-09-21T15:14:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:34.457+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a5fca540 finish: resending after timeout 2024-09-21T15:14:35.645 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.0 2024-09-21T15:14:35.645 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:14:35.645 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.0 2024-09-21T15:14:35.646 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Restarting daemon 2024-09-21T15:14:35.646 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 2024-09-21T15:14:35.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Started 2024-09-21T15:14:35.648 INFO:tasks.rbd_mirror_thrash:waiting for 94 secs before thrashing 2024-09-21T15:14:38.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=140 2024-09-21T15:14:38.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 140 -le 7200 ']' 2024-09-21T15:14:38.438 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:14:38.438 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:14:38.495 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 248 -ge 263 ']' 2024-09-21T15:14:38.495 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:14:43.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:43.057+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59ca0fc80 finish: resending after timeout 2024-09-21T15:14:43.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:43.057+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a6d37500 finish: resending after timeout 2024-09-21T15:14:43.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:43.061+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a5fca540 finish: resending after timeout 2024-09-21T15:14:48.021 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.008+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:14:48.022 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.008+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:14:48.038 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.032+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:14:48.038 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.032+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:14:48.040 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.032+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:14:48.040 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.032+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:14:48.040 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.032+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:14:48.040 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.032+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:14:48.040 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.032+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:14:48.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.036+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:14:48.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.036+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:14:48.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.036+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:14:48.049 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.044+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:14:48.049 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.044+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:14:48.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.048+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:14:48.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.048+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:14:48.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.048+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:14:48.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.048+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9930 2024-09-21T15:14:48.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.048+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:14:48.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.048+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:14:48.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.048+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:14:48.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.048+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:14:48.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.048+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:14:48.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.048+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:14:48.060 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:14:48.060 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:14:48.060 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:14:48.060 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:14:48.060 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:14:48.060 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:14:48.060 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:14:48.060 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:14:48.060 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:14:48.060 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x560171f05ee0 2024-09-21T15:14:48.061 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:14:48.061 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:14:48.061 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:14:48.061 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:14:48.061 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:14:48.061 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:14:48.061 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:14:48.061 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:14:48.061 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:14:48.061 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:14:48.061 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:14:48.061 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.056+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:14:48.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.060+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:14:48.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:14:48.060+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a5fca540 finish: resending after timeout 2024-09-21T15:14:48.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.060+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:14:48.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.064+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:14:48.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.068+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:14:48.070 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.068+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:14:48.071 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.068+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:14:48.079 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.072+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:14:48.079 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.072+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:14:48.080 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.076+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:14:48.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.076+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:14:48.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.076+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:14:48.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.084+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:14:48.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.084+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:14:48.088 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.084+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:14:48.089 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.084+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:14:48.089 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.084+0000 7ff753f07700 -1 reset not still connected to 0x56016f162000 2024-09-21T15:14:48.090 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.084+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:14:48.090 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.084+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:14:48.092 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.088+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:14:48.092 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.088+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:14:48.092 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.088+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:14:48.093 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.088+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:14:48.098 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.092+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:14:48.100 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:14:48.100 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:14:48.100 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:14:48.100 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:14:48.100 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:14:48.100 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:14:48.100 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:14:48.102 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:14:48.102 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:14:48.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:14:48.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:14:48.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:14:48.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:14:48.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:14:48.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:14:48.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:14:48.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99d40 2024-09-21T15:14:48.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:14:48.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:14:48.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:14:48.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:14:48.103 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.096+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:14:48.108 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.104+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:14:48.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.104+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:14:48.111 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.104+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:14:48.114 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.108+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:14:48.114 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.112+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:14:48.114 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.112+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:14:48.114 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.112+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:14:48.114 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.112+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:14:48.114 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.112+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:14:48.123 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.120+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:14:48.123 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.120+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:14:48.132 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.124+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:14:48.132 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.124+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:14:48.133 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.124+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:14:48.133 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.124+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:14:48.133 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.124+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:14:48.134 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.128+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:14:48.134 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.128+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:14:48.134 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.128+0000 7ff753f07700 -1 reset not still connected to 0x560171f05ee0 2024-09-21T15:14:48.134 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.128+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:14:48.134 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.128+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:14:48.134 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.128+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:14:48.137 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.132+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:14:48.137 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.132+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:14:48.137 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.132+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:14:48.138 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.132+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:14:48.138 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.132+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:14:48.138 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.132+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:14:48.138 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.136+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:14:48.138 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.136+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:14:48.142 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.140+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:14:48.145 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.140+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:14:48.153 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.140+0000 7ff753f07700 -1 reset not still connected to 0x56016878aea0 2024-09-21T15:14:48.153 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.140+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:14:48.153 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.140+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:14:48.153 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.140+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:14:48.153 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.140+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:14:48.153 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.140+0000 7ff753f07700 -1 reset not still connected to 0x560169401520 2024-09-21T15:14:48.153 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.140+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:14:48.153 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.140+0000 7ff753f07700 -1 reset not still connected to 0x560169887110 2024-09-21T15:14:48.153 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.140+0000 7ff753f07700 -1 reset not still connected to 0x560169e2fa00 2024-09-21T15:14:48.154 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.140+0000 7ff753f07700 -1 reset not still connected to 0x560169eaa0d0 2024-09-21T15:14:48.154 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.140+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:14:48.160 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.156+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f7040 2024-09-21T15:14:48.160 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.156+0000 7ff753f07700 -1 reset not still connected to 0x56016a38c410 2024-09-21T15:14:48.164 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.156+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:14:48.167 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.160+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:14:48.167 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.160+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:14:48.167 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.160+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b85b0 2024-09-21T15:14:48.167 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.160+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:14:48.172 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.168+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:14:48.176 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.172+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:14:48.179 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.176+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba4e0 2024-09-21T15:14:48.179 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.176+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:14:48.180 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.176+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb040 2024-09-21T15:14:48.180 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.176+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:14:48.183 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.180+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:14:48.198 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.192+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:14:48.198 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.192+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:14:48.198 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.192+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:14:48.198 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.196+0000 7ff753f07700 -1 reset not still connected to 0x56016d985ba0 2024-09-21T15:14:48.199 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.196+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:14:48.204 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.196+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:14:48.204 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.196+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:14:48.208 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.204+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:14:48.208 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.204+0000 7ff753f07700 -1 reset not still connected to 0x56016e36fc70 2024-09-21T15:14:48.210 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.208+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:14:48.214 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.208+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:14:48.214 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.208+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:14:48.214 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.212+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:14:48.215 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.212+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3790 2024-09-21T15:14:48.216 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.212+0000 7ff753f07700 -1 reset not still connected to 0x56016f162000 2024-09-21T15:14:48.218 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.216+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:14:48.218 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.216+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:14:48.218 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.216+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:14:48.218 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.216+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:14:48.218 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.216+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:14:48.218 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.216+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:14:48.219 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.216+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:14:48.219 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.216+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:14:48.219 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.216+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:14:48.219 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.216+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:14:48.219 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.216+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:14:48.219 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.216+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:14:48.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:14:48.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:14:48.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99d40 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:14:48.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:14:48.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:14:48.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:14:48.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:14:48.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:14:48.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.220+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:14:48.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:14:48.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:14:48.229 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:14:48.229 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:14:48.229 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:14:48.229 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:14:48.229 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:14:48.229 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:14:48.229 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:14:48.229 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560171f05ee0 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:14:48.230 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:14:48.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:14:48.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:14:48.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:14:48.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:14:48.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:14:48.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:14:48.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:14:48.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:14:48.234 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:14:48.234 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:14:48.234 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:14:48.234 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:14:48.234 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:14:48.235 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:14:48.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:14:48.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:14:48.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:14:48.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:14:48.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:14:48.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:14:48.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560169886a90 2024-09-21T15:14:48.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c8820 2024-09-21T15:14:48.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560167cc5860 2024-09-21T15:14:48.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:14:48.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:14:48.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016878aea0 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560169401520 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560169887110 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560169e2fa00 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x560169eaa0d0 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f61a0 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f7040 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016a38c410 2024-09-21T15:14:48.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016a50b1e0 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016aeceb60 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016b24e820 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b85b0 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba4e0 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb040 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:14:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc60d0 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e340 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016e36fc70 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.224+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:14:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3790 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f162000 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f1629c0 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:14:48.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:14:48.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:14:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:14:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:14:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:14:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:14:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:14:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:14:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:14:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:14:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:14:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:14:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:14:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:14:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:14:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:14:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:14:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:14:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:14:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:14:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:14:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:14:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:14:48.228+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:14:48.496 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=150 2024-09-21T15:14:48.497 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 150 -le 7200 ']' 2024-09-21T15:14:48.498 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:14:48.498 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:14:48.559 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 248 -ge 263 ']' 2024-09-21T15:14:48.559 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:14:58.328 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.323+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678ed00 2024-09-21T15:14:58.339 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.335+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:14:58.341 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.335+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb9930 2024-09-21T15:14:58.425 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.343+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:14:58.436 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.431+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:14:58.436 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.431+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e5b0 2024-09-21T15:14:58.439 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.435+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:14:58.443 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:14:58.443 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:14:58.443 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4340 2024-09-21T15:14:58.443 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4750 2024-09-21T15:14:58.443 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:14:58.443 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:14:58.443 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:14:58.443 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:14:58.444 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:14:58.447 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.443+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:14:58.447 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.443+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:14:58.447 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.443+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:14:58.447 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.443+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:14:58.447 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.443+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:14:58.456 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.451+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:14:58.456 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.451+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:14:58.461 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:14:58.462 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:14:58.463 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb110 2024-09-21T15:14:58.463 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:14:58.464 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:14:58.464 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbba00 2024-09-21T15:14:58.466 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.463+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbbba0 2024-09-21T15:14:58.466 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.463+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:14:58.466 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.463+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:14:58.467 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.463+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55110 2024-09-21T15:14:58.467 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.463+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c24e0 2024-09-21T15:14:58.470 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3a00 2024-09-21T15:14:58.470 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3ad0 2024-09-21T15:14:58.470 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:14:58.470 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:14:58.470 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:14:58.471 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:14:58.474 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:14:58.474 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:14:58.474 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x56369e02d6c0 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x56369e5756c0 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef03ba0 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678ed00 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb9930 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e5b0 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:14:58.475 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4340 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:14:58.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb110 2024-09-21T15:14:58.477 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:14:58.477 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbbba0 2024-09-21T15:14:58.477 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:14:58.477 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:14:58.477 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55110 2024-09-21T15:14:58.477 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c24e0 2024-09-21T15:14:58.477 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:14:58.477 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:14:58.477 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:14:58.477 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:14:58.477 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:14:58.477 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:14:58.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:14:58.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=160 2024-09-21T15:14:58.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 160 -le 7200 ']' 2024-09-21T15:14:58.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:14:58.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:14:58.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 249 -ge 263 ']' 2024-09-21T15:14:58.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:14:58.673 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.667+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:14:58.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.675+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3ee0 2024-09-21T15:14:58.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.675+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:14:58.692 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:14:58.692 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:14:58.693 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.691+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:14:58.714 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.707+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:14:58.715 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.707+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:14:58.715 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.707+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:14:58.715 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.707+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51484e0 2024-09-21T15:14:58.715 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.707+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:14:58.715 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.707+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:14:58.715 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.707+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:14:58.715 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.707+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:14:58.715 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.707+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:14:58.715 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.707+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:14:58.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:14:58.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:14:58.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1ad0 2024-09-21T15:14:58.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:14:58.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:14:58.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:14:58.720 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:14:58.720 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:14:58.720 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:14:58.720 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:14:58.720 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:14:58.721 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:14:58.721 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:14:58.721 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:14:58.721 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:14:58.721 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:14:58.721 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:14:58.721 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.715+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:14:58.725 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.719+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:14:58.725 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.719+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:14:58.725 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.719+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:14:58.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.719+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:14:58.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.719+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:14:58.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.719+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:14:58.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.719+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:14:58.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.719+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:14:58.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.719+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:14:58.726 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.719+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:14:58.727 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:14:58.723+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:14:58.890 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.884+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:14:58.903 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.896+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:14:58.904 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.896+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:14:58.912 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.908+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:14:58.917 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.912+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:14:58.917 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.912+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:14:58.923 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.916+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:14:58.923 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.916+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:14:58.923 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.916+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:14:58.924 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.916+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:14:58.924 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.920+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:14:58.925 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.920+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:14:58.925 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.920+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:14:58.926 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.920+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7b790 2024-09-21T15:14:58.927 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.924+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:14:58.928 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.924+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:14:58.928 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.924+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:14:58.928 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.924+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:14:58.929 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.924+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:14:58.938 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.932+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:14:58.938 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.932+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:14:58.938 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.932+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782820 2024-09-21T15:14:58.939 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782d00 2024-09-21T15:14:58.939 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:14:58.939 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:14:58.939 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783380 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783520 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b86c6270 2024-09-21T15:14:58.940 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:14:58.941 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.936+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:14:58.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.940+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:14:58.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.940+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:14:58.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.940+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3380 2024-09-21T15:14:58.942 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.940+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:14:58.943 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.940+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e76c0 2024-09-21T15:14:58.944 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.940+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:14:58.944 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.940+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:14:58.944 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.940+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fe10 2024-09-21T15:14:58.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.940+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6270 2024-09-21T15:14:58.948 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:14:58.940+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:15:04.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:15:04.220+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a7cadbc0 finish: resending after timeout 2024-09-21T15:15:04.319 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:15:04.316+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f59e5478c0 finish: resending after timeout 2024-09-21T15:15:04.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:15:04.568+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a5fcaa80 finish: resending after timeout 2024-09-21T15:15:04.580 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:15:04.576+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5af0f3e00 finish: resending after timeout 2024-09-21T15:15:07.179 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.172+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:15:07.179 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.176+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:15:07.180 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.176+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:15:07.180 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.176+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:15:07.181 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.176+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:15:07.181 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.176+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:15:07.183 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.180+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:15:07.183 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.180+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:15:07.196 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.188+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:15:07.203 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.196+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:15:07.203 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.196+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:15:07.205 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.200+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:15:07.209 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.204+0000 7f52f1ba9700 -1 reset not still connected to 0x55713912b2b0 2024-09-21T15:15:07.210 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.204+0000 7f52f1ba9700 -1 reset not still connected to 0x5571393e85b0 2024-09-21T15:15:07.210 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.204+0000 7f52f1ba9700 -1 reset not still connected to 0x5571393e8c30 2024-09-21T15:15:07.210 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.204+0000 7f52f1ba9700 -1 reset not still connected to 0x55713962d930 2024-09-21T15:15:07.212 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.208+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a397d40 2024-09-21T15:15:07.212 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.208+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a49d930 2024-09-21T15:15:07.212 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.208+0000 7f52f1ba9700 -1 reset not still connected to 0x55713af26000 2024-09-21T15:15:07.212 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.208+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:15:07.216 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.212+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61f380 2024-09-21T15:15:07.219 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.216+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:15:07.221 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.216+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc8cb60 2024-09-21T15:15:07.221 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.216+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c155860 2024-09-21T15:15:07.224 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.220+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf0d860 2024-09-21T15:15:07.224 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.220+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf7c5b0 2024-09-21T15:15:07.224 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.220+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ad0 2024-09-21T15:15:07.224 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.220+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:15:07.224 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.220+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:15:07.225 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.220+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df812b0 2024-09-21T15:15:07.229 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.224+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81930 2024-09-21T15:15:07.229 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.224+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:15:07.233 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e7ea270 2024-09-21T15:15:07.234 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:15:07.234 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4340 2024-09-21T15:15:07.234 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e51e0 2024-09-21T15:15:07.234 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ba0 2024-09-21T15:15:07.234 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ee0 2024-09-21T15:15:07.234 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb24c30 2024-09-21T15:15:07.234 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:15:07.234 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fdd61a0 2024-09-21T15:15:07.234 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed0ea0 2024-09-21T15:15:07.234 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:15:07.234 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:15:07.234 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:15:07.235 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.228+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:15:07.235 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.232+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:15:07.236 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.232+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:15:07.236 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.232+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:15:07.236 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.232+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:15:07.236 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.232+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:15:07.236 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.232+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:15:07.236 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.232+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:15:07.236 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.232+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:15:07.236 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.232+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:15:07.236 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:07.232+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:15:08.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=170 2024-09-21T15:15:08.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 170 -le 7200 ']' 2024-09-21T15:15:08.624 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:15:08.624 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:15:08.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 254 -ge 263 ']' 2024-09-21T15:15:08.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:15:12.240 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:15:12.236+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5af0f3e00 finish: resending after timeout 2024-09-21T15:15:13.142 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.132+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:15:13.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae4ce820 2024-09-21T15:15:13.156 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.148+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810b60 2024-09-21T15:15:13.156 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.148+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:15:13.156 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.148+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b040 2024-09-21T15:15:13.156 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.148+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb184e0 2024-09-21T15:15:13.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.152+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb192b0 2024-09-21T15:15:13.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.152+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:15:13.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.152+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:15:13.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.152+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:15:13.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.152+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:15:13.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.152+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:15:13.163 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.156+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4c8f0 2024-09-21T15:15:13.176 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.168+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4cf70 2024-09-21T15:15:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.168+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:15:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.168+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:15:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.168+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:15:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.168+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049ee0 2024-09-21T15:15:13.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.172+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:15:13.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.172+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:15:13.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.172+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6b60 2024-09-21T15:15:13.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.172+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:15:13.182 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.176+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:15:13.182 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.176+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:15:13.182 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.176+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1040 2024-09-21T15:15:13.183 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.176+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:15:13.183 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.176+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c9c0 2024-09-21T15:15:13.183 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.176+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b28585b0 2024-09-21T15:15:13.183 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.176+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50270 2024-09-21T15:15:13.183 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.176+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50410 2024-09-21T15:15:13.184 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.180+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f504e0 2024-09-21T15:15:13.187 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.184+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50750 2024-09-21T15:15:13.187 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.184+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:15:13.187 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.184+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50a90 2024-09-21T15:15:13.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.184+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50b60 2024-09-21T15:15:13.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.184+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50f70 2024-09-21T15:15:13.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.184+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f512b0 2024-09-21T15:15:13.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.184+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:15:13.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.184+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:15:13.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.184+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:15:13.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.184+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51860 2024-09-21T15:15:13.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.184+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51930 2024-09-21T15:15:13.191 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.184+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51a00 2024-09-21T15:15:13.192 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.188+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51ad0 2024-09-21T15:15:13.192 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.188+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:15:13.192 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.188+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:15:13.192 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.188+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:15:13.192 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.188+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3100410 2024-09-21T15:15:13.198 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.192+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31004e0 2024-09-21T15:15:13.198 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.192+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31009c0 2024-09-21T15:15:13.198 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.192+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:15:13.198 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.192+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:15:13.198 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.192+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:15:13.200 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.196+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:15:13.200 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.196+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:15:13.201 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.196+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc410 2024-09-21T15:15:13.202 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.196+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:15:13.202 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.196+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:15:13.202 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.196+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd520 2024-09-21T15:15:13.208 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd6c0 2024-09-21T15:15:13.208 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:15:13.208 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:15:13.208 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:15:13.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:15:13.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b36868f0 2024-09-21T15:15:13.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:15:13.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810b60 2024-09-21T15:15:13.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:15:13.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811a00 2024-09-21T15:15:13.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:15:13.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3935ba0 2024-09-21T15:15:13.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:15:13.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45de340 2024-09-21T15:15:13.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:15:13.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45df860 2024-09-21T15:15:13.213 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76000 2024-09-21T15:15:13.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:15:13.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76410 2024-09-21T15:15:13.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76c30 2024-09-21T15:15:13.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76d00 2024-09-21T15:15:13.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:15:13.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:15:13.215 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd2ea0 2024-09-21T15:15:13.215 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:15:13.215 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:15:13.215 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3ad0 2024-09-21T15:15:13.215 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:15:13.215 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:15:13.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:15:13.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:15:13.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:15:13.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:15:13.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:15:13.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:15:13.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:15:13.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:15:13.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:15:13.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:15:13.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:15:13.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:15:13.218 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:15:13.218 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:15:13.218 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:15:13.218 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:15:13.218 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eab60 2024-09-21T15:15:13.218 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:15:13.219 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:15:13.219 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:15:13.219 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7b790 2024-09-21T15:15:13.219 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d85b0 2024-09-21T15:15:13.219 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:15:13.219 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:15:13.219 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:15:13.220 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:15:13.220 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:15:13.220 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:15:13.220 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:15:13.220 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782410 2024-09-21T15:15:13.220 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:15:13.221 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:15:13.221 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782820 2024-09-21T15:15:13.221 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782a90 2024-09-21T15:15:13.221 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782d00 2024-09-21T15:15:13.221 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:15:13.221 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783040 2024-09-21T15:15:13.221 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:15:13.222 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:15:13.222 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783380 2024-09-21T15:15:13.222 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:15:13.222 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783520 2024-09-21T15:15:13.222 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:15:13.222 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:15:13.223 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:15:13.223 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783e10 2024-09-21T15:15:13.223 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:15:13.223 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:15:13.223 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:15:13.223 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:15:13.224 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:15:13.224 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:15:13.224 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:15:13.224 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:15:13.224 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a4e0 2024-09-21T15:15:13.224 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b86c6270 2024-09-21T15:15:13.224 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:15:13.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:15:13.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90116c0 2024-09-21T15:15:13.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165110 2024-09-21T15:15:13.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:15:13.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:15:13.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3380 2024-09-21T15:15:13.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3860 2024-09-21T15:15:13.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:15:13.226 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e76c0 2024-09-21T15:15:13.226 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:15:13.226 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72f380 2024-09-21T15:15:13.226 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:15:13.226 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fe10 2024-09-21T15:15:13.226 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6270 2024-09-21T15:15:13.226 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:13.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:15:18.043 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.036+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:15:18.063 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.056+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:15:18.067 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.056+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:15:18.067 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:15:18.067 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:15:18.067 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:15:18.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:15:18.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:15:18.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:15:18.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:15:18.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:15:18.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:15:18.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:15:18.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:15:18.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:15:18.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:15:18.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:18.060+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b86c6270 2024-09-21T15:15:18.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=180 2024-09-21T15:15:18.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 180 -le 7200 ']' 2024-09-21T15:15:18.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:15:18.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:15:18.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 254 -ge 263 ']' 2024-09-21T15:15:18.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:15:19.563 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.559+0000 7f1e9c77a700 -1 reset not still connected to 0x56288c584340 2024-09-21T15:15:19.563 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.559+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:15:19.563 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.559+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d2ea0 2024-09-21T15:15:19.567 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.559+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3ee0 2024-09-21T15:15:19.574 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.567+0000 7f1e9c77a700 -1 reset not still connected to 0x562895933ba0 2024-09-21T15:15:19.574 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.571+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:15:19.574 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.571+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a1f75380 2024-09-21T15:15:19.584 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.579+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:15:19.584 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.579+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2e88340 2024-09-21T15:15:19.584 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.579+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:15:19.585 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.579+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:15:19.585 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.579+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a40415f0 2024-09-21T15:15:19.585 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.579+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:15:19.586 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.583+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:15:19.586 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.583+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:15:19.587 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.583+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:15:19.587 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.583+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51484e0 2024-09-21T15:15:19.587 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.583+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec61a0 2024-09-21T15:15:19.587 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.583+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:15:19.587 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.583+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:15:19.587 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.583+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:15:19.590 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160680 2024-09-21T15:15:19.590 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:15:19.590 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780ed00 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1ad0 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:15:19.591 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:15:19.592 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:15:19.592 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:15:19.592 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f1e0 2024-09-21T15:15:19.592 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f2b0 2024-09-21T15:15:19.592 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:15:19.592 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:15:19.592 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:15:19.592 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:15:19.592 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c4e0 2024-09-21T15:15:19.592 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18dc70 2024-09-21T15:15:19.593 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e8410 2024-09-21T15:15:19.593 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:15:19.593 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.587+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:15:19.594 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:15:19.594 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:15:19.594 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:15:19.594 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:15:19.594 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:15:19.594 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:15:19.594 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:15:19.594 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a9450 2024-09-21T15:15:19.594 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48680 2024-09-21T15:15:19.594 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:15:19.594 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:15:19.594 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288b60 2024-09-21T15:15:19.595 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:15:19.595 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:15:19.595 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:15:19.595 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:15:19.598 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69e10 2024-09-21T15:15:19.598 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:15:19.598 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:15:19.598 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:15:19.598 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:15:19.598 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:15:19.598 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.591+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:15:19.598 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.595+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a4e0 2024-09-21T15:15:19.598 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.595+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a820 2024-09-21T15:15:19.598 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.595+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:15:19.599 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.595+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8750 2024-09-21T15:15:19.599 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.595+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:15:19.599 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.595+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57380 2024-09-21T15:15:19.599 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.595+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:15:19.599 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.595+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:15:19.599 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.595+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:15:19.599 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.595+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:15:19.599 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.595+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:15:19.599 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.595+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677110 2024-09-21T15:15:19.599 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:19.595+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:15:23.644 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.6997165888308777) > weight (0.25) 2024-09-21T15:15:23.644 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.3678573093930706) > weight (0.25) 2024-09-21T15:15:23.644 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.2 with skip (0.44146133986817837) > weight (0.25) 2024-09-21T15:15:23.644 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.3 with skip (0.45950134480169325) > weight (0.25) 2024-09-21T15:15:23.645 INFO:tasks.rbd_mirror_thrash:waiting for 61 secs before thrashing 2024-09-21T15:15:28.201 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.192+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:15:28.205 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.196+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:15:28.205 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.196+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:15:28.205 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.196+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:15:28.214 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.204+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:15:28.214 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.204+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:15:28.214 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.208+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:15:28.216 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.212+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:15:28.217 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.212+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:15:28.217 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.212+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:15:28.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.216+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:15:28.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.216+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:15:28.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.216+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:15:28.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.216+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:15:28.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.216+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:15:28.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.216+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:15:28.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.216+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:15:28.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.216+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:15:28.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.216+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:15:28.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.220+0000 7ff753f07700 -1 reset not still connected to 0x560168574270 2024-09-21T15:15:28.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.228+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:15:28.234 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.228+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:15:28.234 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.228+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:15:28.234 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.228+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:15:28.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.232+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:15:28.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.232+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:15:28.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.232+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:15:28.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.232+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:15:28.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.232+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:15:28.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.232+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:15:28.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.232+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:15:28.240 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.232+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:15:28.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.232+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:15:28.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.236+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:15:28.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.236+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:15:28.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.236+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:15:28.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.236+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:15:28.245 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.240+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:15:28.247 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.244+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:15:28.247 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.244+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:15:28.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.244+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:15:28.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.244+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:15:28.250 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.244+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:15:28.250 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.244+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:15:28.263 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:15:28.263 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.256+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:15:28.272 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.268+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:15:28.272 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.268+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:15:28.272 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.268+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:15:28.272 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.268+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:15:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.268+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:15:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.268+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:15:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.268+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:15:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.268+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:15:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.268+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:15:28.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.268+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:15:28.275 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.272+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:15:28.275 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.272+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:15:28.275 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:15:28.275 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.272+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:15:28.275 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.272+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:15:28.275 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:15:28.275 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:15:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:15:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:15:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:15:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:15:28.276 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:28.272+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:15:28.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:28.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b86c6270 2024-09-21T15:15:28.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:28.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:15:28.544 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:28.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:15:28.546 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:28.540+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3380 2024-09-21T15:15:28.549 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:28.544+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:15:28.550 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:28.544+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e76c0 2024-09-21T15:15:28.550 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:28.544+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:15:28.550 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:28.544+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72f380 2024-09-21T15:15:28.550 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:28.544+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:15:28.550 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:28.544+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fe10 2024-09-21T15:15:28.550 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:28.544+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6270 2024-09-21T15:15:28.550 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:28.544+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:15:28.744 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=190 2024-09-21T15:15:28.744 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 190 -le 7200 ']' 2024-09-21T15:15:28.744 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:15:28.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:15:28.796 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 259 -ge 263 ']' 2024-09-21T15:15:28.796 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:15:33.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:15:33.879+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a5fcb380 finish: resending after timeout 2024-09-21T15:15:33.933 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:15:33.927+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a5fca840 finish: resending after timeout 2024-09-21T15:15:38.079 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.071+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:15:38.083 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.075+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae8d8000 2024-09-21T15:15:38.084 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:15:38.084 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:15:38.084 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:15:38.085 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:15:38.085 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:15:38.085 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:15:38.085 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:15:38.085 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:15:38.085 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:15:38.085 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:15:38.085 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:15:38.085 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:15:38.085 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:15:38.085 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.079+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:15:38.089 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.083+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:15:38.090 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.083+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:15:38.094 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.087+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:15:38.111 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.107+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:15:38.111 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.107+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:15:38.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.115+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:15:38.123 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:15:38.123 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:15:38.125 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.119+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd520 2024-09-21T15:15:38.127 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:15:38.127 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:15:38.127 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:15:38.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:15:38.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b36868f0 2024-09-21T15:15:38.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:15:38.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810b60 2024-09-21T15:15:38.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:15:38.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.127+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:15:38.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.127+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3935ba0 2024-09-21T15:15:38.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.127+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:15:38.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.127+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:15:38.134 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:15:38.135 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76c30 2024-09-21T15:15:38.135 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:15:38.135 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:15:38.138 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:15:38.138 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:15:38.139 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:15:38.139 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:15:38.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:15:38.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:15:38.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:15:38.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:15:38.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:15:38.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:15:38.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:15:38.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:15:38.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:15:38.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:15:38.141 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:15:38.141 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:15:38.141 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:15:38.141 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:15:38.141 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:15:38.141 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:15:38.141 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:15:38.143 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:15:38.143 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:15:38.143 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7b790 2024-09-21T15:15:38.143 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d85b0 2024-09-21T15:15:38.144 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:15:38.144 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:15:38.144 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:15:38.144 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:15:38.147 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:15:38.147 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:15:38.147 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:15:38.147 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782410 2024-09-21T15:15:38.147 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:15:38.147 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:15:38.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782820 2024-09-21T15:15:38.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782a90 2024-09-21T15:15:38.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782d00 2024-09-21T15:15:38.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:15:38.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783040 2024-09-21T15:15:38.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:15:38.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:15:38.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783380 2024-09-21T15:15:38.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:15:38.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783520 2024-09-21T15:15:38.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:15:38.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:15:38.149 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:15:38.149 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783e10 2024-09-21T15:15:38.149 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:15:38.149 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:15:38.149 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:15:38.150 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:15:38.150 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:15:38.150 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:15:38.150 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:15:38.150 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.143+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:15:38.152 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.147+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b86c6270 2024-09-21T15:15:38.152 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.147+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:15:38.152 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.147+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:15:38.156 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90116c0 2024-09-21T15:15:38.156 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165110 2024-09-21T15:15:38.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:15:38.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:15:38.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3380 2024-09-21T15:15:38.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3860 2024-09-21T15:15:38.158 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:15:38.158 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e76c0 2024-09-21T15:15:38.158 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72f380 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fe10 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915860 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915e10 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6270 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ad638750 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adaa3c70 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25aa90 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25bba0 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae8d8000 2024-09-21T15:15:38.159 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:15:38.160 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:15:38.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:15:38.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:38.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:15:38.797 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=200 2024-09-21T15:15:38.797 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 200 -le 7200 ']' 2024-09-21T15:15:38.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:15:38.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:15:38.858 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 259 -ge 263 ']' 2024-09-21T15:15:38.858 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:15:38.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:15:38.931+0000 7f481109a700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5a5fca840 finish: resending after timeout 2024-09-21T15:15:39.029 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:39.018+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:15:39.029 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:39.018+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:15:39.029 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:39.018+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:15:39.032 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:39.026+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:15:39.032 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:39.026+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:15:39.032 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:39.026+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:15:39.032 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:15:39.026+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:15:48.211 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.207+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:15:48.214 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.207+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:15:48.214 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.207+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:15:48.219 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.207+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:15:48.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.211+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:15:48.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.219+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:15:48.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.219+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:15:48.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.227+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:15:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:15:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:15:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:15:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:15:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:15:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:15:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:15:48.238 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:15:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:15:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:15:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:15:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:15:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:15:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:15:48.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:15:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:15:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:15:48.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:15:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:15:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:15:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:15:48.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.235+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:15:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.239+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:15:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.239+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:15:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.239+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:15:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.239+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:15:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.239+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:15:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.239+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:15:48.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.239+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:15:48.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.243+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:15:48.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.243+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:15:48.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.243+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:15:48.252 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.247+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:15:48.252 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.247+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:15:48.252 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.247+0000 7ff753f07700 -1 reset not still connected to 0x56017063fee0 2024-09-21T15:15:48.252 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.247+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:15:48.252 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.247+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:15:48.252 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.247+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:15:48.252 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.247+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:15:48.252 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.247+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9930 2024-09-21T15:15:48.252 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.247+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:15:48.252 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.247+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:15:48.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.251+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:15:48.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.251+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:15:48.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.251+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:15:48.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.251+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:15:48.256 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.251+0000 7ff753f07700 -1 reset not still connected to 0x56017157c5b0 2024-09-21T15:15:48.256 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.251+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:15:48.256 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.251+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:15:48.256 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.251+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:15:48.256 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.251+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:15:48.256 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.251+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:15:48.259 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:15:48.259 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:15:48.259 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:15:48.259 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:15:48.259 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x560171f05ee0 2024-09-21T15:15:48.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:15:48.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:15:48.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:15:48.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:15:48.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:15:48.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:15:48.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:15:48.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:15:48.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:15:48.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:15:48.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2b60 2024-09-21T15:15:48.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:15:48.260 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:15:48.261 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:15:48.261 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7d40 2024-09-21T15:15:48.261 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x56017529a000 2024-09-21T15:15:48.261 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x56017529a4e0 2024-09-21T15:15:48.261 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:48.255+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc750 2024-09-21T15:15:48.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=210 2024-09-21T15:15:48.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 210 -le 7200 ']' 2024-09-21T15:15:48.861 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:15:48.861 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:15:48.922 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 259 -ge 263 ']' 2024-09-21T15:15:48.922 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:15:54.668 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.658+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:15:54.669 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.666+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:15:54.670 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.666+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678ed00 2024-09-21T15:15:54.672 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.670+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:15:54.673 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.670+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb9930 2024-09-21T15:15:54.673 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.670+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:15:54.673 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.670+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e000 2024-09-21T15:15:54.673 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.670+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:15:54.673 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.670+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e5b0 2024-09-21T15:15:54.674 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.670+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:15:54.679 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.674+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:15:54.679 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.674+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:15:54.681 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.678+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4340 2024-09-21T15:15:54.681 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.678+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4750 2024-09-21T15:15:54.687 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.682+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4f70 2024-09-21T15:15:54.687 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.682+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:15:54.687 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.682+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:15:54.687 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.682+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:15:54.687 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.682+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:15:54.688 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.682+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:15:54.688 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.682+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:15:54.688 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.682+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:15:54.688 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.682+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:15:54.688 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.682+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:15:54.688 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.682+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:15:54.691 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.686+0000 7f7fd044c700 -1 reset not still connected to 0x5636c47091e0 2024-09-21T15:15:54.693 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.686+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4709a00 2024-09-21T15:15:54.693 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.686+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:15:54.693 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.686+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:15:54.693 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.686+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:15:54.693 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.686+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:15:54.693 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.686+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb110 2024-09-21T15:15:54.693 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.686+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:15:54.693 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.686+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:15:54.693 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.686+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbba00 2024-09-21T15:15:54.695 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbbba0 2024-09-21T15:15:54.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:15:54.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:15:54.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55110 2024-09-21T15:15:54.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c24e0 2024-09-21T15:15:54.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3a00 2024-09-21T15:15:54.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3ad0 2024-09-21T15:15:54.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:15:54.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9e10 2024-09-21T15:15:54.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:15:54.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:15:54.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:15:54.699 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:15:54.699 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:15:54.699 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:15:54.699 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:15:54.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335e10 2024-09-21T15:15:58.102 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:58.095+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:15:58.103 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:58.095+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:15:58.103 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:15:58.095+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:15:58.685 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.679+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:15:58.688 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.679+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:15:58.689 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.679+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:15:58.699 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.695+0000 7ff753f07700 -1 reset not still connected to 0x560169eaa0d0 2024-09-21T15:15:58.699 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.695+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:15:58.721 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.715+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f7040 2024-09-21T15:15:58.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.715+0000 7ff753f07700 -1 reset not still connected to 0x56016a50b1e0 2024-09-21T15:15:58.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.715+0000 7ff753f07700 -1 reset not still connected to 0x56016aeceb60 2024-09-21T15:15:58.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.715+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:15:58.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.715+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:15:58.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.715+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:15:58.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.715+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:15:58.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.715+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:15:58.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.719+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:15:58.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.723+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba4e0 2024-09-21T15:15:58.726 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.723+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:15:58.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.723+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:15:58.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.723+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:15:58.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.723+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:15:58.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.723+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:15:58.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.723+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:15:58.730 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.723+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:15:58.739 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.731+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:15:58.739 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.731+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:15:58.740 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.735+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:15:58.740 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.735+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a2820 2024-09-21T15:15:58.740 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.735+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:15:58.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:15:58.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:15:58.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:15:58.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:15:58.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:15:58.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:15:58.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:15:58.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:15:58.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:15:58.745 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:15:58.745 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:15:58.745 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:15:58.745 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:15:58.745 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:15:58.745 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:15:58.745 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:15:58.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:15:58.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:15:58.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:15:58.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:15:58.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:15:58.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:15:58.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:15:58.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:15:58.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:15:58.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:15:58.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:15:58.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.739+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:15:58.748 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:15:58.748 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:15:58.748 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:15:58.748 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:15:58.748 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:15:58.748 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:15:58.748 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:15:58.748 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:15:58.748 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:15:58.748 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:15:58.749 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:15:58.743+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7d40 2024-09-21T15:15:58.841 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.831+0000 7f52f1ba9700 -1 reset not still connected to 0x55713af26000 2024-09-21T15:15:58.842 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.835+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:15:58.842 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.835+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e410 2024-09-21T15:15:58.842 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.835+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61f380 2024-09-21T15:15:58.842 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.835+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:15:58.842 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.835+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc8cb60 2024-09-21T15:15:58.847 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.835+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c10d110 2024-09-21T15:15:58.847 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.835+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c155860 2024-09-21T15:15:58.847 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.839+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf0d860 2024-09-21T15:15:58.848 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.839+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf7c5b0 2024-09-21T15:15:58.848 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.839+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cfa7040 2024-09-21T15:15:58.852 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.847+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ad0 2024-09-21T15:15:58.852 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.847+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae11e0 2024-09-21T15:15:58.852 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.847+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:15:58.852 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.847+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:15:58.852 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.847+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df812b0 2024-09-21T15:15:58.853 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.847+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81930 2024-09-21T15:15:58.853 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.847+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81ba0 2024-09-21T15:15:58.853 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.847+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:15:58.853 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.847+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e115040 2024-09-21T15:15:58.853 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.847+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e7ea270 2024-09-21T15:15:58.853 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.847+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:15:58.853 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.847+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4340 2024-09-21T15:15:58.853 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.851+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e49c0 2024-09-21T15:15:58.857 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.851+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4f70 2024-09-21T15:15:58.858 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.851+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e51e0 2024-09-21T15:15:58.858 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.851+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5860 2024-09-21T15:15:58.858 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ba0 2024-09-21T15:15:58.859 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5c70 2024-09-21T15:15:58.859 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ee0 2024-09-21T15:15:58.859 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:15:58.859 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb24c30 2024-09-21T15:15:58.859 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:15:58.859 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25790 2024-09-21T15:15:58.859 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fdd61a0 2024-09-21T15:15:58.859 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:15:58.860 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c9c0 2024-09-21T15:15:58.860 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cb60 2024-09-21T15:15:58.861 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cd00 2024-09-21T15:15:58.861 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dee0 2024-09-21T15:15:58.861 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed01a0 2024-09-21T15:15:58.861 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed0ea0 2024-09-21T15:15:58.861 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f4820 2024-09-21T15:15:58.861 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f55f0 2024-09-21T15:15:58.861 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:15:58.861 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.855+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1110 2024-09-21T15:15:58.864 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1e10 2024-09-21T15:15:58.864 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16000 2024-09-21T15:15:58.864 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:15:58.864 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb0000 2024-09-21T15:15:58.864 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb1c70 2024-09-21T15:15:58.864 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:15:58.865 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:15:58.865 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:15:58.865 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb2b0 2024-09-21T15:15:58.865 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:15:58.866 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:15:58.866 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:15:58.866 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:15:58.866 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b860 2024-09-21T15:15:58.866 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.859+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:15:58.866 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.863+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8000 2024-09-21T15:15:58.866 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.863+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:15:58.870 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8340 2024-09-21T15:15:58.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:15:58.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:15:58.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:15:58.872 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:15:58.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8d00 2024-09-21T15:15:58.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:15:58.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:15:58.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:15:58.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9930 2024-09-21T15:15:58.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9c70 2024-09-21T15:15:58.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:15:58.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:15:58.873 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.867+0000 7f52f1ba9700 -1 reset not still connected to 0x55714346b930 2024-09-21T15:15:58.923 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=220 2024-09-21T15:15:58.923 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 220 -le 7200 ']' 2024-09-21T15:15:58.926 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.923+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:15:58.939 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.931+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61f380 2024-09-21T15:15:58.939 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.931+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:15:58.942 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.935+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc8cb60 2024-09-21T15:15:58.942 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.935+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c10d110 2024-09-21T15:15:58.943 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.935+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf0d860 2024-09-21T15:15:58.943 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.935+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf7c5b0 2024-09-21T15:15:58.943 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.935+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cfa7040 2024-09-21T15:15:58.948 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:15:58.949 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:15:58.950 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.943+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ad0 2024-09-21T15:15:58.966 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.955+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae11e0 2024-09-21T15:15:58.966 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.955+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:15:58.968 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.955+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:15:58.968 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.955+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df812b0 2024-09-21T15:15:58.968 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.955+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81930 2024-09-21T15:15:58.968 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.955+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81ba0 2024-09-21T15:15:58.975 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.971+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:15:58.975 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.971+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e115040 2024-09-21T15:15:58.975 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.971+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e7ea270 2024-09-21T15:15:58.975 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.971+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:15:58.978 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4340 2024-09-21T15:15:58.979 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4410 2024-09-21T15:15:58.979 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e49c0 2024-09-21T15:15:58.979 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4c30 2024-09-21T15:15:58.979 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4f70 2024-09-21T15:15:58.981 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e51e0 2024-09-21T15:15:58.982 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5860 2024-09-21T15:15:58.983 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ba0 2024-09-21T15:15:58.983 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5c70 2024-09-21T15:15:58.983 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ee0 2024-09-21T15:15:58.983 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:15:58.983 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb24c30 2024-09-21T15:15:58.983 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:15:58.983 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.975+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fdd61a0 2024-09-21T15:15:58.986 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c270 2024-09-21T15:15:58.987 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:15:58.987 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c9c0 2024-09-21T15:15:58.987 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cb60 2024-09-21T15:15:58.987 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cd00 2024-09-21T15:15:58.987 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dee0 2024-09-21T15:15:58.987 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed01a0 2024-09-21T15:15:58.987 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed0ea0 2024-09-21T15:15:58.987 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f4820 2024-09-21T15:15:58.990 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f5110 2024-09-21T15:15:58.990 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f55f0 2024-09-21T15:15:58.990 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:15:58.990 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1110 2024-09-21T15:15:58.990 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1e10 2024-09-21T15:15:58.991 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.979+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16000 2024-09-21T15:15:58.994 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.987+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:15:58.994 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.987+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16b60 2024-09-21T15:15:58.994 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.987+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17040 2024-09-21T15:15:58.994 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.987+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17a00 2024-09-21T15:15:58.995 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.987+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb0000 2024-09-21T15:15:58.995 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.987+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb08f0 2024-09-21T15:15:58.995 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.987+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb1c70 2024-09-21T15:15:58.995 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.987+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:15:58.995 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.987+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:15:58.995 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.987+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:15:58.995 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.987+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb110 2024-09-21T15:15:58.997 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb2b0 2024-09-21T15:15:58.997 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:15:58.997 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:15:58.998 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:15:58.998 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0f70 2024-09-21T15:15:58.998 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef12b0 2024-09-21T15:15:58.998 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef1a00 2024-09-21T15:15:58.998 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a0d0 2024-09-21T15:15:58.998 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232aea0 2024-09-21T15:15:58.998 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:15:58.998 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b860 2024-09-21T15:15:58.998 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:15:58.998 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142629ba0 2024-09-21T15:15:58.998 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142d01110 2024-09-21T15:15:58.998 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8000 2024-09-21T15:15:58.998 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8340 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8d00 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9450 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb95f0 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9930 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9c70 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:15:58.999 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:15:59.000 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x55714346b930 2024-09-21T15:15:59.000 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417b520 2024-09-21T15:15:59.000 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cdd0 2024-09-21T15:15:59.000 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cea0 2024-09-21T15:15:59.000 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456de10 2024-09-21T15:15:59.000 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f6c0 2024-09-21T15:15:59.000 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765ba0 2024-09-21T15:15:59.000 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765d40 2024-09-21T15:15:59.000 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557147226680 2024-09-21T15:15:59.000 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.991+0000 7f52f1ba9700 -1 reset not still connected to 0x557147227e10 2024-09-21T15:15:59.000 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.995+0000 7f52f1ba9700 -1 reset not still connected to 0x5571480009c0 2024-09-21T15:15:59.001 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.995+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012270 2024-09-21T15:15:59.001 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.995+0000 7f52f1ba9700 -1 reset not still connected to 0x5571480135f0 2024-09-21T15:15:59.001 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:15:58.995+0000 7f52f1ba9700 -1 reset not still connected to 0x557148f52f70 2024-09-21T15:15:59.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 262 -ge 263 ']' 2024-09-21T15:15:59.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:16:04.121 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:16:04.115+0000 7f4810899700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55f5aaa7c600 finish: resending after timeout 2024-09-21T15:16:08.223 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.218+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:16:08.233 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.222+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:16:08.239 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.230+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:16:08.239 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.230+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:16:08.243 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.234+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:16:08.244 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.238+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:16:08.245 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.242+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:16:08.246 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.242+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:16:08.246 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.242+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:16:08.246 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.242+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:16:08.246 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.242+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:16:08.247 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.242+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:16:08.248 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.246+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:16:08.266 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.254+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:16:08.266 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.254+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:16:08.270 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.262+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:16:08.272 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:16:08.272 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:16:08.272 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:16:08.272 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:16:08.272 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:16:08.272 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:16:08.272 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:16:08.272 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:16:08.273 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:16:08.273 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:16:08.273 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:08.266+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:16:09.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=230 2024-09-21T15:16:09.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 230 -le 7200 ']' 2024-09-21T15:16:09.079 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:16:09.079 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:16:09.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 262 -ge 263 ']' 2024-09-21T15:16:09.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:16:09.649 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.8981282075199678) > weight (0.25) 2024-09-21T15:16:09.649 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.2579132424340206) > weight (0.25) 2024-09-21T15:16:09.649 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.37047728852984296) > weight (0.25) 2024-09-21T15:16:09.649 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.3 with skip (0.8728957546707129) > weight (0.25) 2024-09-21T15:16:09.649 INFO:tasks.rbd_mirror_thrash:waiting for 72 secs before thrashing 2024-09-21T15:16:10.557 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:10.545+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:16:13.127 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:16:13.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810b60 2024-09-21T15:16:13.130 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae8d8000 2024-09-21T15:16:13.138 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.127+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:16:13.139 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac0000 2024-09-21T15:16:13.143 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:16:13.144 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:16:13.144 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:16:13.144 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:16:13.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:16:13.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:16:13.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:16:13.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:16:13.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:16:13.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:16:13.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:16:13.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:16:13.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:16:13.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:16:13.147 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.139+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:16:13.149 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.147+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:16:13.150 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.147+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:16:13.152 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.147+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:16:13.152 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.147+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:16:13.154 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.147+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:16:13.155 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:16:13.163 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.159+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:16:13.167 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.159+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:16:13.167 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.159+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:16:13.167 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.159+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:16:13.167 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.163+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:16:13.173 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:16:13.173 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:16:13.173 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:16:13.173 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:16:13.173 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:16:13.173 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:16:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:16:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:16:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:16:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:16:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:16:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:16:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:16:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:16:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:16:13.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:16:13.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:16:13.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:16:13.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:16:13.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:16:13.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:16:13.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:16:13.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:16:13.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:16:13.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:16:13.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:16:13.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:16:13.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:16:13.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:16:13.180 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:16:13.180 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:16:13.180 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:16:13.180 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:16:13.180 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:16:13.180 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:13.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:16:18.094 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.082+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:16:18.098 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.082+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:16:18.099 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.086+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:16:18.099 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.086+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:16:18.108 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.090+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:16:18.109 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.090+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:16:18.109 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.090+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:16:18.121 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.106+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:16:18.170 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.154+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:16:18.176 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.162+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:16:18.183 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:16:18.183 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:16:18.183 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1040 2024-09-21T15:16:18.188 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.182+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:16:18.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.206+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c9c0 2024-09-21T15:16:18.218 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.206+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266d6c0 2024-09-21T15:16:18.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.214+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b28585b0 2024-09-21T15:16:18.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.214+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50270 2024-09-21T15:16:18.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.214+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50410 2024-09-21T15:16:18.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.214+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f504e0 2024-09-21T15:16:18.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.214+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50750 2024-09-21T15:16:18.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.214+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:16:18.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.214+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50b60 2024-09-21T15:16:18.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.214+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50f70 2024-09-21T15:16:18.227 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.218+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f512b0 2024-09-21T15:16:18.227 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.218+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:16:18.227 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.218+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:16:18.227 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.218+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:16:18.227 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.218+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51860 2024-09-21T15:16:18.227 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.218+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51930 2024-09-21T15:16:18.234 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.226+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51a00 2024-09-21T15:16:18.234 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.226+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51ad0 2024-09-21T15:16:18.235 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:16:18.237 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:16:18.237 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:16:18.237 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3100410 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31004e0 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31009c0 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc410 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd520 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd6c0 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:16:18.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.230+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:16:18.240 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.234+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:16:18.243 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.238+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:16:18.244 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.238+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b36868f0 2024-09-21T15:16:18.244 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.238+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:16:18.244 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.238+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:16:18.246 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811a00 2024-09-21T15:16:18.252 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:16:18.252 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3935ba0 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45de340 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45df860 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dfa00 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76000 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76410 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76c30 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76d00 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77c70 2024-09-21T15:16:18.253 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd2ea0 2024-09-21T15:16:18.254 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:16:18.254 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:16:18.254 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3ad0 2024-09-21T15:16:18.254 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:16:18.254 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:16:18.254 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:16:18.254 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:16:18.255 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:16:18.255 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:16:18.255 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:16:18.255 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.250+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:16:18.255 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.250+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:16:18.255 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.250+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:16:18.255 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.250+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:16:18.255 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.250+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:16:18.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:16:18.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:16:18.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:16:18.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:16:18.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:16:18.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:16:18.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eab60 2024-09-21T15:16:18.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:16:18.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:16:18.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:16:18.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7b790 2024-09-21T15:16:18.261 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d85b0 2024-09-21T15:16:18.262 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:16:18.264 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:16:18.264 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782410 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782820 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782a90 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782d00 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783040 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:16:18.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:16:18.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783380 2024-09-21T15:16:18.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:16:18.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783520 2024-09-21T15:16:18.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:16:18.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:16:18.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:16:18.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783e10 2024-09-21T15:16:18.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:16:18.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:16:18.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.258+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9110 2024-09-21T15:16:18.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.258+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de95f0 2024-09-21T15:16:18.267 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.258+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9930 2024-09-21T15:16:18.267 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.258+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9ba0 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.258+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47040 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeef70 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83705b0 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a4e0 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83ccc30 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83ccd00 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cd1e0 2024-09-21T15:16:18.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cd790 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b86c6270 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b86c69c0 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90d00 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8f82270 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8f83ad0 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90116c0 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1e10 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165110 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f790 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f930 2024-09-21T15:16:18.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:16:18.270 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8f70 2024-09-21T15:16:18.270 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3380 2024-09-21T15:16:18.270 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d35f0 2024-09-21T15:16:18.270 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3860 2024-09-21T15:16:18.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e60d0 2024-09-21T15:16:18.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:16:18.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e76c0 2024-09-21T15:16:18.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e7c70 2024-09-21T15:16:18.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:16:18.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72e4e0 2024-09-21T15:16:18.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72f380 2024-09-21T15:16:18.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:16:18.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fe10 2024-09-21T15:16:18.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915860 2024-09-21T15:16:18.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915e10 2024-09-21T15:16:18.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6270 2024-09-21T15:16:18.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:16:18.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:16:19.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=240 2024-09-21T15:16:19.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 240 -le 7200 ']' 2024-09-21T15:16:19.138 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:16:19.138 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:16:19.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 262 -ge 263 ']' 2024-09-21T15:16:19.192 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 10 2024-09-21T15:16:20.078 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:20.073+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:16:20.078 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:20.073+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:16:20.078 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:20.073+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:16:20.078 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:20.073+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:16:20.090 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:20.077+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:16:20.090 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:20.077+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:16:20.090 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:20.077+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:16:20.091 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:20.077+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:16:20.091 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:20.077+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:16:20.091 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:20.077+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:16:20.091 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:20.081+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677110 2024-09-21T15:16:20.096 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:20.081+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529d40 2024-09-21T15:16:23.101 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.085+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:16:23.103 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.097+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:16:23.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:16:23.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48680 2024-09-21T15:16:23.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:16:23.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:16:23.119 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.113+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289520 2024-09-21T15:16:23.119 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.113+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:16:23.120 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.113+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:16:23.120 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.113+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:16:23.120 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.113+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:16:23.124 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69e10 2024-09-21T15:16:23.124 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:16:23.124 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:16:23.124 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:16:23.124 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:16:23.124 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:16:23.124 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.121+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a4e0 2024-09-21T15:16:23.124 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.121+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a820 2024-09-21T15:16:23.125 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.121+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:16:23.134 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:16:23.134 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:16:23.134 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:16:23.134 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:16:23.134 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677110 2024-09-21T15:16:23.134 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529d40 2024-09-21T15:16:23.134 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:23.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:16:24.646 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2024-09-21T15:16:24.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2024-09-21T15:16:24.647 INFO:tasks.rbd_mirror_thrash:waiting for 1 secs before reviving daemons 2024-09-21T15:16:24.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:16:24.642+0000 7f9e3dcf3700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 31804) UID: 1000 2024-09-21T15:16:25.647 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2024-09-21T15:16:25.648 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:16:25.648 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.0 2024-09-21T15:16:25.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2024-09-21T15:16:25.648 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2024-09-21T15:16:25.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2024-09-21T15:16:25.651 INFO:tasks.rbd_mirror_thrash:waiting for 104 secs before thrashing 2024-09-21T15:16:29.193 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ retrying_seconds=250 2024-09-21T15:16:29.193 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 250 -le 7200 ']' 2024-09-21T15:16:29.194 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster2 --pool mirror ls 2024-09-21T15:16:29.194 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ wc -l 2024-09-21T15:16:29.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 263 -ge 263 ']' 2024-09-21T15:16:29.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ break 2024-09-21T15:16:29.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ testlog 'TEST: snapshot all pool images' 2024-09-21T15:16:29.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ tee -a /tmp/tmp.ZUZ2ADv8z3/rbd-mirror.test.log 2024-09-21T15:16:29.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ date '+%F %T' 2024-09-21T15:16:29.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ echo 2024-09-21 15:16:29 TEST: snapshot all pool images 2024-09-21T15:16:29.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:2024-09-21 15:16:29 TEST: snapshot all pool images 2024-09-21T15:16:29.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ uuidgen 2024-09-21T15:16:29.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ snap_id=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:29.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --pool mirror ls 2024-09-21T15:16:29.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:29.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:29.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:29.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:29.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0 2024-09-21T15:16:29.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:29.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:30.063 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.057+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:16:30.073 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.065+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:16:30.073 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.065+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:16:30.074 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.065+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:16:30.074 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.065+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:16:30.074 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.069+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:16:30.075 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.069+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:16:30.075 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.069+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:16:30.076 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.069+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:16:30.082 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.073+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:16:30.087 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.081+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f2b0 2024-09-21T15:16:30.088 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.081+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:16:30.088 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.081+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:16:30.099 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.089+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e8410 2024-09-21T15:16:30.099 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.089+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:16:30.099 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.089+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:16:30.113 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:16:30.113 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:16:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:16:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:16:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:16:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:16:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:16:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:16:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:16:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:16:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:16:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:16:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:16:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.109+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:16:30.128 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:16:30.134 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:16:30.141 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.129+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:16:30.142 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.137+0000 7f1e9c77a700 -1 reset not still connected to 0x562872bb89c0 2024-09-21T15:16:30.145 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.137+0000 7f1e9c77a700 -1 reset not still connected to 0x562876d89520 2024-09-21T15:16:30.145 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.141+0000 7f1e9c77a700 -1 reset not still connected to 0x56288301b2b0 2024-09-21T15:16:30.145 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.141+0000 7f1e9c77a700 -1 reset not still connected to 0x56288c584340 2024-09-21T15:16:30.147 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.141+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:16:30.147 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.141+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d2ea0 2024-09-21T15:16:30.147 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.141+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3ee0 2024-09-21T15:16:30.147 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.141+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:16:30.148 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.141+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a1f75380 2024-09-21T15:16:30.148 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.141+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:16:30.150 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.141+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:16:30.157 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:16:30.157 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:16:30.157 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:16:30.157 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:16:30.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:16:30.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51484e0 2024-09-21T15:16:30.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec61a0 2024-09-21T15:16:30.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:16:30.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:16:30.158 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:16:30.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160680 2024-09-21T15:16:30.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:16:30.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:16:30.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780ed00 2024-09-21T15:16:30.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:16:30.159 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.149+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:16:30.163 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:16:30.166 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1ad0 2024-09-21T15:16:30.166 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:16:30.166 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:16:30.166 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:16:30.166 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:16:30.166 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f2b0 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c4e0 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e8410 2024-09-21T15:16:30.167 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.157+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:16:30.171 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.165+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:16:30.171 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.165+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:16:30.171 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.165+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:16:30.176 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:16:30.176 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:16:30.176 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:16:30.176 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:16:30.177 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:16:30.177 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:16:30.177 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:16:30.177 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:16:30.177 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:16:30.177 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:16:30.177 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:16:30.177 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:16:30.177 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:16:30.177 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:16:30.177 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:30.169+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:16:30.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:30.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:30.722 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:30.722 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:30.722 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:30.722 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone1 2024-09-21T15:16:30.722 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:30.722 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:31.121 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:16:31.122 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:16:31.122 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:16:31.122 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:16:31.127 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:16:31.127 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:16:31.127 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:16:31.134 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:16:31.134 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:16:31.134 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.125+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:16:31.275 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.269+0000 7f1e9c77a700 -1 reset not still connected to 0x562872bb89c0 2024-09-21T15:16:31.276 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.269+0000 7f1e9c77a700 -1 reset not still connected to 0x562876d89520 2024-09-21T15:16:31.276 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.269+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:16:31.277 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.273+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3ee0 2024-09-21T15:16:31.277 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.273+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:16:31.283 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.277+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:16:31.284 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.277+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:16:31.284 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.277+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:16:31.284 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.277+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:16:31.284 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.277+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:16:31.284 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.277+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51484e0 2024-09-21T15:16:31.284 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.277+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:16:31.284 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.277+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:16:31.284 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.277+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:16:31.284 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.277+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:16:31.287 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:16:31.289 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:16:31.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:16:31.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:16:31.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:16:31.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:16:31.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:16:31.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:16:31.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:16:31.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:16:31.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:16:31.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:16:31.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:16:31.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:16:31.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:16:31.291 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.281+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:16:31.291 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.285+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:16:31.291 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.285+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:16:31.291 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.285+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:16:31.291 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.285+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:16:31.291 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:16:31.285+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:16:31.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:31.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:31.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone10 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:31.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:31.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:31.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone10 2024-09-21T15:16:31.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:31.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:32.668 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:32.696 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:32.697 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone11 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:32.697 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:32.697 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:32.697 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone11 2024-09-21T15:16:32.697 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:32.697 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:33.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:33.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:33.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone12 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:33.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:33.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:33.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone12 2024-09-21T15:16:33.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:33.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:34.676 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:34.703 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:34.703 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone13 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:34.703 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:34.703 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:34.704 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone13 2024-09-21T15:16:34.704 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:34.704 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:35.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:35.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:35.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone14 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:35.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:35.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:35.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone14 2024-09-21T15:16:35.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:35.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:36.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:36.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:36.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone15 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:36.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:36.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:36.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone15 2024-09-21T15:16:36.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:36.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:37.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:37.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:37.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone16 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:37.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:37.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:37.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone16 2024-09-21T15:16:37.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:37.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:38.710 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:38.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:38.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone17 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:38.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:38.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:38.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone17 2024-09-21T15:16:38.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:38.738 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:39.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:39.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:39.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone18 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:39.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:39.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:39.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone18 2024-09-21T15:16:39.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:39.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:40.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:40.960 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:40.960 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone19 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:40.960 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:40.960 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:40.960 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone19 2024-09-21T15:16:40.960 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:40.960 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:41.627 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:41.654 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:41.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:41.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:41.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:41.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone2 2024-09-21T15:16:41.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:41.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:42.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:42.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:42.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone20 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:42.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:42.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:42.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone20 2024-09-21T15:16:42.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:42.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:43.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:43.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:43.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone21 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:43.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:43.775 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:43.775 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone21 2024-09-21T15:16:43.775 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:43.775 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:44.820 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:44.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:44.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone22 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:44.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:44.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:44.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone22 2024-09-21T15:16:44.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:44.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:45.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:45.778 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:45.778 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone23 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:45.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:45.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:45.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone23 2024-09-21T15:16:45.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:45.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:46.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:46.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:46.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone24 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:46.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:46.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:46.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone24 2024-09-21T15:16:46.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:46.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:47.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:47.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:47.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone25 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:47.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:47.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:47.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone25 2024-09-21T15:16:47.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:47.795 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:48.775 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:48.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:48.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone26 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:48.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:48.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:48.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone26 2024-09-21T15:16:48.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:48.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:49.157 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:16:49.149+0000 7f7fd044c700 -1 reset not still connected to 0x56369f5dc000 2024-09-21T15:16:49.157 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:16:49.149+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:16:49.158 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:16:49.149+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:16:49.160 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:16:49.153+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:16:49.167 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:16:49.153+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:16:49.167 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:16:49.153+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:16:49.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:49.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:49.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone27 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:49.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:49.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:49.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone27 2024-09-21T15:16:49.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:49.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:50.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:50.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:50.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone28 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:50.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:50.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:50.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone28 2024-09-21T15:16:50.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:50.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:51.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:51.821 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:51.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone29 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:51.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:51.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:51.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone29 2024-09-21T15:16:51.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:51.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:52.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone3 2024-09-21T15:16:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:53.143 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.138+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a49d930 2024-09-21T15:16:53.144 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.138+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:16:53.150 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.142+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61f380 2024-09-21T15:16:53.150 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.142+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:16:53.150 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.142+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc8cb60 2024-09-21T15:16:53.152 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.150+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf7c5b0 2024-09-21T15:16:53.155 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.154+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:16:53.157 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.154+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:16:53.163 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.158+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df812b0 2024-09-21T15:16:53.165 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.162+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81930 2024-09-21T15:16:53.166 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.162+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:16:53.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.162+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:16:53.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.166+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4340 2024-09-21T15:16:53.173 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.170+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:16:53.173 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.170+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed0ea0 2024-09-21T15:16:53.173 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.170+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:16:53.173 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:16:53.170+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:16:53.801 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:53.824 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:53.824 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone30 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:53.824 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:53.824 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:53.824 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone30 2024-09-21T15:16:53.824 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:53.824 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:54.814 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:54.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:54.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone31 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:54.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:54.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:54.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone31 2024-09-21T15:16:54.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:54.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:55.821 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:55.848 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:55.848 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone32 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:55.848 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:55.848 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:55.848 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone32 2024-09-21T15:16:55.848 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:55.848 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:56.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:56.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:56.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone33 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:56.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:56.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:56.846 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone33 2024-09-21T15:16:56.846 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:56.846 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:57.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone34 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone34 2024-09-21T15:16:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:58.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:58.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:58.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone35 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:58.861 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:58.861 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:58.861 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone35 2024-09-21T15:16:58.861 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:58.861 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:59.846 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:16:59.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:16:59.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone36 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:59.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:16:59.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:16:59.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone36 2024-09-21T15:16:59.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:16:59.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:00.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:00.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:00.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone37 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:00.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:00.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:00.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone37 2024-09-21T15:17:00.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:00.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:01.868 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:01.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:01.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone38 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:01.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:01.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:01.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone38 2024-09-21T15:17:01.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:01.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:02.876 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:02.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:02.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone39 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:02.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:02.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:02.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone39 2024-09-21T15:17:02.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:02.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:03.889 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:03.917 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:03.917 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:03.917 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:03.917 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:03.918 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone4 2024-09-21T15:17:03.918 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:03.918 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:04.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone5 2024-09-21T15:17:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:04.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:05.900 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:05.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:05.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone6 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:05.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:05.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:05.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone6 2024-09-21T15:17:05.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:05.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:06.905 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:06.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:06.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone7 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:06.931 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:06.931 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:06.931 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone7 2024-09-21T15:17:06.931 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:06.931 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:07.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:07.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:07.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone8 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:07.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:07.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:07.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone8 2024-09-21T15:17:07.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:07.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:08.917 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:08.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:08.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.0-clone9 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:08.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:08.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:08.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone9 2024-09-21T15:17:08.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:08.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.0-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:09.264 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.248+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:17:09.275 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.272+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:17:09.280 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.276+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:17:09.281 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.276+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:17:09.284 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.280+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:17:09.285 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.280+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51484e0 2024-09-21T15:17:09.285 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.280+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:17:09.285 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.280+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:17:09.285 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.280+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:17:09.295 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:17:09.295 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:17:09.295 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:17:09.296 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.292+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:17:09.298 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.296+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:17:09.298 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.296+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:17:09.305 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:17:09.305 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f2b0 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c4e0 2024-09-21T15:17:09.306 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:17:09.307 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:17:09.307 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:17:09.307 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:17:09.307 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:17:09.315 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:17:09.336 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.324+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:17:09.339 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.324+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:17:09.339 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.324+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:17:09.340 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.328+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48680 2024-09-21T15:17:09.340 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.328+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:17:09.340 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.328+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:17:09.341 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.332+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:17:09.341 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.332+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:17:09.341 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.332+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:17:09.341 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.332+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:17:09.341 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.332+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:17:09.341 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.332+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:17:09.342 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.332+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:17:09.342 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.332+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:17:09.342 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.340+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:17:09.342 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.340+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:17:09.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.344+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:17:09.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.344+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:17:09.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.344+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:17:09.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.344+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:17:09.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.344+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529d40 2024-09-21T15:17:09.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.344+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:17:09.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.344+0000 7f1e9c77a700 -1 reset not still connected to 0x562872bb89c0 2024-09-21T15:17:09.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.344+0000 7f1e9c77a700 -1 reset not still connected to 0x562876d89520 2024-09-21T15:17:09.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.344+0000 7f1e9c77a700 -1 reset not still connected to 0x56288661c000 2024-09-21T15:17:09.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.344+0000 7f1e9c77a700 -1 reset not still connected to 0x56288661c820 2024-09-21T15:17:09.353 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.348+0000 7f1e9c77a700 -1 reset not still connected to 0x56288c584340 2024-09-21T15:17:09.353 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.348+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:17:09.353 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.348+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d2ea0 2024-09-21T15:17:09.361 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3ee0 2024-09-21T15:17:09.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628958fd110 2024-09-21T15:17:09.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x562895933ba0 2024-09-21T15:17:09.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:17:09.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a1f75380 2024-09-21T15:17:09.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2e88340 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a40415f0 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51484e0 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.356+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:17:09.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:17:09.365 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780ed00 2024-09-21T15:17:09.365 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:17:09.365 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:17:09.365 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:17:09.365 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:17:09.369 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:17:09.369 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:17:09.369 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:17:09.369 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:17:09.369 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:17:09.370 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:17:09.370 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:17:09.370 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:17:09.370 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:17:09.370 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:17:09.370 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f1e0 2024-09-21T15:17:09.371 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f2b0 2024-09-21T15:17:09.371 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:17:09.371 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:17:09.371 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:17:09.371 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:17:09.371 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c4e0 2024-09-21T15:17:09.371 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18dc70 2024-09-21T15:17:09.371 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:17:09.371 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:17:09.371 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:17:09.371 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a9450 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48680 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288b60 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289520 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:17:09.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.364+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:17:09.373 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.368+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:17:09.373 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69e10 2024-09-21T15:17:09.373 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:17:09.373 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:17:09.373 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:17:09.374 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:17:09.374 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:17:09.375 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:17:09.375 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a820 2024-09-21T15:17:09.375 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:17:09.375 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8750 2024-09-21T15:17:09.375 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:17:09.376 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:17:09.376 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:17:09.376 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:17:09.376 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:17:09.376 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:17:09.376 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677110 2024-09-21T15:17:09.376 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529d40 2024-09-21T15:17:09.376 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:09.372+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:17:09.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:09.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:09.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:09.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:09.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:09.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1 2024-09-21T15:17:09.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:09.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:10.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:10.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:10.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:10.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:10.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:10.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone1 2024-09-21T15:17:10.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:10.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:11.937 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:11.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:11.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone10 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:11.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:11.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:11.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone10 2024-09-21T15:17:11.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:11.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:12.948 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:12.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:12.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone11 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:12.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:12.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:12.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone11 2024-09-21T15:17:12.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:12.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:13.175 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.165+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:17:13.180 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.169+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:17:13.182 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.169+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:17:13.182 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.169+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:17:13.183 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.173+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:17:13.191 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.177+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:17:13.198 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.189+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:17:13.198 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.189+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:17:13.198 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.189+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:17:13.198 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.189+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a2820 2024-09-21T15:17:13.199 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.189+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:17:13.199 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.189+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:17:13.199 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.193+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:17:13.199 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.193+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:17:13.203 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.197+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:17:13.206 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.201+0000 7ff753f07700 -1 reset not still connected to 0x56016f162000 2024-09-21T15:17:13.206 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.201+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:17:13.206 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.201+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:17:13.209 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.205+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:17:13.209 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.205+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:17:13.209 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.205+0000 7ff753f07700 -1 reset not still connected to 0x56016f1629c0 2024-09-21T15:17:13.209 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.205+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:17:13.209 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.205+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:17:13.209 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.205+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:17:13.209 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.205+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:17:13.210 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.205+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:17:13.217 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.213+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:17:13.219 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.217+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:17:13.219 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.217+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:17:13.219 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.217+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:17:13.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.217+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:17:13.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.217+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:17:13.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.217+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:17:13.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.217+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:17:13.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.217+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:17:13.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.217+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:17:13.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.217+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:17:13.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.217+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:17:13.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.217+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:17:13.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.221+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:17:13.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.221+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:17:13.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.221+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:17:13.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.221+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:17:13.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.221+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:17:13.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.221+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99d40 2024-09-21T15:17:13.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.221+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:17:13.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.221+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:17:13.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.221+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:17:13.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.221+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:17:13.227 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.221+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:17:13.228 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.225+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:17:13.228 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.225+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:17:13.228 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.225+0000 7ff753f07700 -1 reset not still connected to 0x56017063fee0 2024-09-21T15:17:13.229 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.225+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:17:13.229 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.225+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:17:13.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.229+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:17:13.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.229+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:17:13.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.229+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9930 2024-09-21T15:17:13.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.229+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:17:13.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.229+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:17:13.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.229+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9e10 2024-09-21T15:17:13.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.229+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:17:13.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.229+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:17:13.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.233+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:17:13.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.233+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:17:13.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.233+0000 7ff753f07700 -1 reset not still connected to 0x56017157c5b0 2024-09-21T15:17:13.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.233+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:17:13.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.233+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:17:13.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.233+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:17:13.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.233+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:17:13.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.237+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:17:13.245 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:17:13.245 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:17:13.245 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:17:13.245 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:17:13.245 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x560171f05ee0 2024-09-21T15:17:13.245 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:17:13.245 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:17:13.245 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:17:13.245 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:17:13.245 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:17:13.245 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:17:13.245 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:17:13.246 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:17:13.246 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:17:13.246 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.241+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:17:13.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.245+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2b60 2024-09-21T15:17:13.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.245+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:17:13.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.245+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:17:13.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.245+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:17:13.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.245+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7d40 2024-09-21T15:17:13.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.245+0000 7ff753f07700 -1 reset not still connected to 0x56017529a000 2024-09-21T15:17:13.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.245+0000 7ff753f07700 -1 reset not still connected to 0x56017529a4e0 2024-09-21T15:17:13.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.245+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1d40 2024-09-21T15:17:13.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.245+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc750 2024-09-21T15:17:13.250 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:13.249+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccdd0 2024-09-21T15:17:13.944 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:13.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:13.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone12 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:13.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:13.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:13.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone12 2024-09-21T15:17:13.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:13.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:14.952 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:14.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:14.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone13 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:14.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:14.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:14.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone13 2024-09-21T15:17:14.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:14.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:15.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:15.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:15.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone14 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:15.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:15.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:15.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone14 2024-09-21T15:17:15.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:15.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:16.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:16.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:16.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone15 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:16.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:16.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:16.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone15 2024-09-21T15:17:16.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:16.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:17.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:18.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:18.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone16 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:18.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:18.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:18.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone16 2024-09-21T15:17:18.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:18.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:18.177 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:17:18.169+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:17:18.177 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:17:18.169+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:17:18.177 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:17:18.169+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:17:18.177 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:17:18.169+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:17:18.177 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:17:18.169+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:17:18.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:19.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:19.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone17 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:19.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:19.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:19.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone17 2024-09-21T15:17:19.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:19.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:20.034 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:20.059 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:20.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone18 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:20.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:20.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:20.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone18 2024-09-21T15:17:20.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:20.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:21.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:21.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:21.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone19 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:21.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:21.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:21.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone19 2024-09-21T15:17:21.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:21.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:21.650 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.9348207144417432) > weight (0.25) 2024-09-21T15:17:21.650 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.5423118896305426) > weight (0.25) 2024-09-21T15:17:21.650 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.5185735229799167) > weight (0.25) 2024-09-21T15:17:21.651 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.3 with skip (0.48790193639687085) > weight (0.25) 2024-09-21T15:17:21.651 INFO:tasks.rbd_mirror_thrash:waiting for 107 secs before thrashing 2024-09-21T15:17:22.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:22.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:22.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:22.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:22.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:22.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone2 2024-09-21T15:17:22.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:22.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:23.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:23.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:23.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone20 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:23.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:23.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:23.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone20 2024-09-21T15:17:23.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:23.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:23.169 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:17:23.169 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:17:23.169 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:17:23.170 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:17:23.170 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:17:23.170 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:17:23.170 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:17:23.170 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:17:23.170 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:17:23.171 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:17:23.171 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:17:23.171 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:17:23.171 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:17:23.172 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:17:23.172 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:17:23.172 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:17:23.172 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:23.165+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:17:24.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:24.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:24.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone21 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:24.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:24.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:24.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone21 2024-09-21T15:17:24.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:24.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:25.077 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:25.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:25.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone22 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:25.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:25.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:25.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone22 2024-09-21T15:17:25.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:25.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:26.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone23 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:26.105 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone23 2024-09-21T15:17:26.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:26.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:27.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone24 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone24 2024-09-21T15:17:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:28.096 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:28.160 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.157+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:17:28.182 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.173+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:17:28.182 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.173+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:17:28.182 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.173+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:17:28.183 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.177+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:17:28.183 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.177+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:17:28.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:28.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone25 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:28.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:28.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:28.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone25 2024-09-21T15:17:28.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:28.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:28.207 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.185+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:17:28.207 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.189+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:17:28.207 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.189+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:17:28.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.197+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:17:28.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.221+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:17:28.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.221+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:17:28.226 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.221+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:17:28.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.225+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:17:28.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.225+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:17:28.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.225+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:17:28.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.225+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:17:28.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.225+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:17:28.236 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.225+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:17:28.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.225+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:17:28.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.225+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:17:28.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.225+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:17:28.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.225+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:17:28.237 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.225+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:17:28.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.237+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:17:28.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.237+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:17:28.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.237+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:17:28.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.241+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:17:28.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.241+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:17:28.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.241+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:17:28.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.241+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:17:28.248 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.241+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:17:28.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.241+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:17:28.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.241+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:17:28.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.241+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:17:28.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.241+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:17:28.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:17:28.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:17:28.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:17:28.250 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:17:28.250 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:17:28.250 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:17:28.250 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:17:28.250 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:17:28.250 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:17:28.250 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:17:28.251 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:17:28.252 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:17:28.252 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7d40 2024-09-21T15:17:28.252 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:28.245+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc750 2024-09-21T15:17:29.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:29.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:29.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone26 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:29.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:29.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:29.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone26 2024-09-21T15:17:29.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:29.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:30.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:30.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:30.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone27 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:30.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:30.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:30.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone27 2024-09-21T15:17:30.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:30.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:31.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:31.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:31.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone28 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:31.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:31.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:31.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone28 2024-09-21T15:17:31.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:31.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:32.122 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:32.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:32.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone29 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:32.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:32.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:32.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone29 2024-09-21T15:17:32.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:32.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:33.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:33.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:33.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone3 2024-09-21T15:17:33.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:33.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:34.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:34.170 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:34.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone30 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:34.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:34.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:34.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone30 2024-09-21T15:17:34.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:34.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:34.266 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.260+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:17:34.290 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.280+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:17:34.292 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2e88340 2024-09-21T15:17:34.292 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:17:34.292 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:17:34.292 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a40415f0 2024-09-21T15:17:34.292 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:17:34.292 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:17:34.292 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:17:34.292 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:17:34.292 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51484e0 2024-09-21T15:17:34.292 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec61a0 2024-09-21T15:17:34.292 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:17:34.292 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:17:34.293 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:17:34.297 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:17:34.297 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:17:34.297 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780ed00 2024-09-21T15:17:34.297 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:17:34.297 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.292+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:17:34.297 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.292+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:17:34.298 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.292+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1ad0 2024-09-21T15:17:34.298 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.292+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:17:34.304 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:17:34.304 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.300+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:17:34.311 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:17:34.312 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:17:34.312 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9c270 2024-09-21T15:17:34.312 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:17:34.312 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:17:34.312 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:17:34.312 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:17:34.312 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:17:34.313 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.308+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:17:34.313 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.308+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f1e0 2024-09-21T15:17:34.313 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.308+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f2b0 2024-09-21T15:17:34.313 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.308+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:17:34.313 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.308+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:17:34.313 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.308+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:17:34.313 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.308+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:17:34.313 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.308+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c4e0 2024-09-21T15:17:34.313 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.308+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18dc70 2024-09-21T15:17:34.314 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e8410 2024-09-21T15:17:34.314 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:17:34.314 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:17:34.314 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:17:34.314 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:17:34.315 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:17:34.316 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:17:34.316 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:17:34.316 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:17:34.316 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:17:34.316 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a8a90 2024-09-21T15:17:34.316 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a92b0 2024-09-21T15:17:34.316 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a9450 2024-09-21T15:17:34.316 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48680 2024-09-21T15:17:34.317 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:17:34.317 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:17:34.317 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288b60 2024-09-21T15:17:34.317 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289520 2024-09-21T15:17:34.317 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:17:34.317 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:17:34.317 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:17:34.317 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:17:34.317 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:17:34.318 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69e10 2024-09-21T15:17:34.318 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:17:34.318 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:17:34.318 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:17:34.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:17:34.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:17:34.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:17:34.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a4e0 2024-09-21T15:17:34.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a820 2024-09-21T15:17:34.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:17:34.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b520 2024-09-21T15:17:34.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8750 2024-09-21T15:17:34.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:17:34.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57380 2024-09-21T15:17:34.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57c70 2024-09-21T15:17:34.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:17:34.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:17:34.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:17:34.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:17:34.321 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:17:34.321 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:17:34.321 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677110 2024-09-21T15:17:34.321 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529d40 2024-09-21T15:17:34.321 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:34.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:17:35.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone4 2024-09-21T15:17:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:35.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:36.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone5 2024-09-21T15:17:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:37.157 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:37.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:37.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone6 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:37.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:37.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:37.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone6 2024-09-21T15:17:37.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:37.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:38.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:38.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:38.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone7 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:38.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:38.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:38.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone7 2024-09-21T15:17:38.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:38.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:39.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:39.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:39.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone8 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:39.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:39.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:39.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone8 2024-09-21T15:17:39.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:39.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:40.037 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:40.031+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:17:40.037 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:40.031+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:17:40.042 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:40.039+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:17:40.042 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:40.039+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:17:40.042 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:40.039+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:17:40.047 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:40.043+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:17:40.174 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:40.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:40.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.1-clone9 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:40.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:40.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:40.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone9 2024-09-21T15:17:40.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:40.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.1-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:41.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:41.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:41.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:41.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:41.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:41.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2 2024-09-21T15:17:41.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:41.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:42.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:42.225 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:42.225 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:42.225 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:42.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:42.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone1 2024-09-21T15:17:42.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:42.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:43.176 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.164+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:17:43.176 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.164+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:17:43.193 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.184+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:17:43.202 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.196+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:17:43.202 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.196+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:17:43.208 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.200+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:17:43.210 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.204+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:17:43.210 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.204+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:17:43.210 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.204+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:17:43.218 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:43.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.212+0000 7ff753f07700 -1 reset not still connected to 0x56016d985ba0 2024-09-21T15:17:43.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.212+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:17:43.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.212+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:17:43.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.212+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:17:43.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.212+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:17:43.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.212+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a2820 2024-09-21T15:17:43.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.216+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:17:43.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.220+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:17:43.225 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.220+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:17:43.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:17:43.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:43.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone10 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:43.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:43.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:43.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone10 2024-09-21T15:17:43.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:43.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:43.241 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:17:43.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3790 2024-09-21T15:17:43.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f162000 2024-09-21T15:17:43.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:17:43.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:17:43.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:17:43.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:17:43.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f1629c0 2024-09-21T15:17:43.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:17:43.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:17:43.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:17:43.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:17:43.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:17:43.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:17:43.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:17:43.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:17:43.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:17:43.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:17:43.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:17:43.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:17:43.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.236+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:17:43.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.244+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:17:43.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.244+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:17:43.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.244+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:17:43.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.244+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:17:43.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.244+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:17:43.249 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.244+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:17:43.253 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.244+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:17:43.253 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:17:43.254 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:17:43.254 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:17:43.254 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:17:43.254 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:17:43.254 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:17:43.254 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:17:43.254 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:17:43.254 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:17:43.254 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:17:43.254 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:17:43.254 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:17:43.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:17:43.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:17:43.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9930 2024-09-21T15:17:43.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:17:43.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:17:43.255 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.248+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:17:43.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.256+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:17:43.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.256+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:17:43.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.256+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:17:43.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.268+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:17:43.273 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.268+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:17:43.274 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.268+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:17:43.274 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.268+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:17:43.274 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.268+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:17:43.279 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.272+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:17:43.288 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.272+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:17:43.288 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.272+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:17:43.289 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.276+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:17:43.295 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.288+0000 7ff753f07700 -1 reset not still connected to 0x560171f05ee0 2024-09-21T15:17:43.295 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.288+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:17:43.296 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.288+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:17:43.296 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.288+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:17:43.296 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.288+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:17:43.303 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.296+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:17:43.303 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.296+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:17:43.303 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.296+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:17:43.308 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.304+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:17:43.308 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.304+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:17:43.310 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.304+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:17:43.311 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.308+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:17:43.327 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.320+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:17:43.328 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.324+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:17:43.328 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.324+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7d40 2024-09-21T15:17:43.332 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.328+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1d40 2024-09-21T15:17:43.333 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.328+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc750 2024-09-21T15:17:43.333 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.328+0000 7ff753f07700 -1 reset not still connected to 0x560168574270 2024-09-21T15:17:43.333 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.328+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:17:43.333 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.328+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:17:43.333 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.328+0000 7ff753f07700 -1 reset not still connected to 0x56016878aea0 2024-09-21T15:17:43.334 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.328+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:17:43.334 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.328+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:17:43.336 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.332+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:17:43.337 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.332+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:17:43.343 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.340+0000 7ff753f07700 -1 reset not still connected to 0x560169401520 2024-09-21T15:17:43.343 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.340+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:17:43.343 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.340+0000 7ff753f07700 -1 reset not still connected to 0x560169887110 2024-09-21T15:17:43.343 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.340+0000 7ff753f07700 -1 reset not still connected to 0x560169e2fa00 2024-09-21T15:17:43.344 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.340+0000 7ff753f07700 -1 reset not still connected to 0x560169eaa0d0 2024-09-21T15:17:43.344 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.340+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:17:43.344 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.340+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f7040 2024-09-21T15:17:43.347 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.344+0000 7ff753f07700 -1 reset not still connected to 0x56016a50b1e0 2024-09-21T15:17:43.350 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.348+0000 7ff753f07700 -1 reset not still connected to 0x56016aeceb60 2024-09-21T15:17:43.350 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.348+0000 7ff753f07700 -1 reset not still connected to 0x56016b24e820 2024-09-21T15:17:43.350 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.348+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:17:43.351 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.348+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:17:43.351 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.348+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:17:43.351 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.348+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:17:43.351 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.348+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:17:43.351 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.348+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:17:43.354 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.352+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba4e0 2024-09-21T15:17:43.354 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.352+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:17:43.354 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.352+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb040 2024-09-21T15:17:43.354 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.352+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:17:43.355 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.352+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc60d0 2024-09-21T15:17:43.355 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.352+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:17:43.355 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.352+0000 7ff753f07700 -1 reset not still connected to 0x56016cfb9790 2024-09-21T15:17:43.356 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.352+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:17:43.357 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.352+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:17:43.358 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:17:43.359 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e340 2024-09-21T15:17:43.359 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016d985ba0 2024-09-21T15:17:43.360 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:17:43.360 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:17:43.360 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:17:43.360 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016e36eb60 2024-09-21T15:17:43.360 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:17:43.360 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016e36fc70 2024-09-21T15:17:43.360 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a2820 2024-09-21T15:17:43.360 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:17:43.360 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:17:43.360 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:17:43.362 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:17:43.362 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:17:43.362 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3790 2024-09-21T15:17:43.362 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016f162000 2024-09-21T15:17:43.362 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:17:43.362 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:17:43.362 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:17:43.362 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.356+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:17:43.365 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.360+0000 7ff753f07700 -1 reset not still connected to 0x56016f1629c0 2024-09-21T15:17:43.365 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.360+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:17:43.365 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.360+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:17:43.365 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.360+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:17:43.365 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.360+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:17:43.365 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.360+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:17:43.368 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.360+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:17:43.368 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.360+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:17:43.368 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.360+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:17:43.368 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.360+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:17:43.369 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:17:43.370 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:17:43.370 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:17:43.370 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:17:43.370 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:17:43.370 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:17:43.370 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:17:43.370 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:17:43.370 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:17:43.370 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:17:43.370 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:17:43.370 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:17:43.370 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9930 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:17:43.371 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171f05ee0 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:17:43.372 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7d40 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1d40 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc750 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560168574270 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560168574c30 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560168575040 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560169222340 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560169eaa0d0 2024-09-21T15:17:43.373 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:17:43.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:17:43.375 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:17:43.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:17:43.377 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:17:43.364+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:17:44.210 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:44.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:44.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone11 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:44.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:44.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:44.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone11 2024-09-21T15:17:44.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:44.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:45.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:45.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:45.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone12 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:45.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:45.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:45.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone12 2024-09-21T15:17:45.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:45.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:46.225 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:46.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:46.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone13 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:46.293 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:46.293 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:46.293 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone13 2024-09-21T15:17:46.293 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:46.293 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:47.096 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.087+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:17:47.096 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:17:47.096 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:17:47.096 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:17:47.096 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:17:47.096 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:17:47.096 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:17:47.096 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:17:47.096 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:17:47.096 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:17:47.097 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:17:47.097 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:17:47.097 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.091+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:17:47.130 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.127+0000 7f7fd044c700 -1 reset not still connected to 0x56369f5dc000 2024-09-21T15:17:47.137 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.135+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:17:47.137 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.135+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:17:47.138 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.135+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:17:47.140 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.135+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678ed00 2024-09-21T15:17:47.141 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.135+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:17:47.141 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.135+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb9930 2024-09-21T15:17:47.141 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.135+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:17:47.141 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.135+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e000 2024-09-21T15:17:47.142 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.139+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:17:47.142 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.139+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:17:47.142 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.139+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbb2b0 2024-09-21T15:17:47.142 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.139+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc40d0 2024-09-21T15:17:47.142 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.139+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:17:47.145 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.139+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:17:47.145 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.139+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4340 2024-09-21T15:17:47.145 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.139+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4750 2024-09-21T15:17:47.149 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.143+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4f70 2024-09-21T15:17:47.150 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.143+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:17:47.150 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.143+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:17:47.150 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.143+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:17:47.150 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.143+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:17:47.150 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.143+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:17:47.150 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.143+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:17:47.150 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.143+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:17:47.155 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.147+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:17:47.155 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.147+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:17:47.155 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.147+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:17:47.155 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.147+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:17:47.155 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.147+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:17:47.155 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.147+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:17:47.155 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.147+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:17:47.155 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.147+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb110 2024-09-21T15:17:47.155 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.147+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:17:47.155 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.147+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:17:47.156 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.147+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbba00 2024-09-21T15:17:47.156 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.151+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbbba0 2024-09-21T15:17:47.156 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.151+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:17:47.156 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.151+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:17:47.156 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.151+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c24e0 2024-09-21T15:17:47.156 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.151+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:17:47.156 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.151+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9e10 2024-09-21T15:17:47.156 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.151+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:17:47.156 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.151+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:17:47.156 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.151+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:17:47.156 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.151+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:17:47.156 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:17:47.151+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:17:47.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:47.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:47.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone14 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:47.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:47.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:47.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone14 2024-09-21T15:17:47.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:47.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:48.249 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:48.280 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:48.280 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone15 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:48.280 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:48.280 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:48.280 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone15 2024-09-21T15:17:48.280 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:48.280 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:49.247 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:49.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:49.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone16 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:49.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:49.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:49.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone16 2024-09-21T15:17:49.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:49.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:50.262 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:50.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:50.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone17 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:50.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:50.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:50.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone17 2024-09-21T15:17:50.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:50.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:50.668 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:50.663+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:17:51.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:51.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:51.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone18 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:51.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:51.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:51.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone18 2024-09-21T15:17:51.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:51.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:52.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:52.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:52.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone19 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:52.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:52.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:52.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone19 2024-09-21T15:17:52.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:52.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:53.185 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:53.172+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:17:53.204 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:53.196+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:17:53.205 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:53.196+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:17:53.206 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:53.200+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:17:53.206 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:53.204+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:17:53.255 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:53.248+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:17:53.258 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:53.248+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e76c0 2024-09-21T15:17:53.258 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:17:53.248+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:17:53.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone2 2024-09-21T15:17:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:54.286 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:54.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:54.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone20 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:54.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:54.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:54.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone20 2024-09-21T15:17:54.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:54.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:55.339 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.331+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:17:55.345 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.335+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:17:55.345 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.335+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:17:55.357 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.347+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:17:55.357 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.347+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:17:55.359 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.351+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:17:55.364 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.351+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:17:55.365 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.355+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:17:55.368 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.355+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:17:55.368 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.355+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:17:55.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.367+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:17:55.372 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.367+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:17:55.373 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.367+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:17:55.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:55.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.379+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:17:55.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.379+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:17:55.390 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.387+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:17:55.391 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.387+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:17:55.391 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.387+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:17:55.391 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.387+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:17:55.391 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.387+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:17:55.391 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.387+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:17:55.391 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:17:55.387+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:17:55.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:55.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone21 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:55.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:55.431 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:55.431 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone21 2024-09-21T15:17:55.431 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:55.431 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:56.299 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:56.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:56.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone22 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:56.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:56.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:56.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone22 2024-09-21T15:17:56.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:56.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:57.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:57.331 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:57.331 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone23 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:57.331 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:57.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:57.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone23 2024-09-21T15:17:57.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:57.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:58.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:58.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:58.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone24 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:58.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:58.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:58.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone24 2024-09-21T15:17:58.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:58.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:59.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:17:59.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:17:59.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone25 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:59.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:17:59.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:17:59.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone25 2024-09-21T15:17:59.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:17:59.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:00.330 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:00.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:00.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone26 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:00.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:00.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:00.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone26 2024-09-21T15:18:00.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:00.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:01.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:01.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:01.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone27 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:01.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:01.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:01.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone27 2024-09-21T15:18:01.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:01.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:02.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:02.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:02.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone28 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:02.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:02.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:02.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone28 2024-09-21T15:18:02.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:02.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:03.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:03.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:03.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone29 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:03.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:03.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:03.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone29 2024-09-21T15:18:03.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:03.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:04.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:04.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:04.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:04.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:04.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:04.369 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone3 2024-09-21T15:18:04.369 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:04.369 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:05.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:05.366 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:05.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone30 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:05.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:05.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:05.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone30 2024-09-21T15:18:05.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:05.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:06.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:06.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:06.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone31 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:06.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:06.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:06.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone31 2024-09-21T15:18:06.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:06.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:07.363 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:07.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:07.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone32 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:07.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:07.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:07.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone32 2024-09-21T15:18:07.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:07.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:07.462 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:18:07.475 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.464+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:18:07.475 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.464+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b040 2024-09-21T15:18:07.499 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:18:07.499 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:18:07.499 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:18:07.500 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:18:07.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:18:07.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:18:07.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:18:07.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:18:07.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:18:07.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:18:07.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:18:07.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:18:07.502 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:18:07.502 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:18:07.502 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1040 2024-09-21T15:18:07.503 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:18:07.503 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:18:07.503 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:18:07.503 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:18:07.503 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:18:07.503 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:18:07.503 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:18:07.503 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:18:07.503 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:18:07.503 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:18:07.503 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:18:07.503 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:18:07.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:18:07.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:18:07.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:18:07.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:18:07.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:18:07.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:18:07.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:18:07.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:18:07.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:18:07.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:18:07.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:18:07.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:18:07.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:18:07.506 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:18:07.506 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:18:07.506 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:18:07.506 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:18:07.506 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:18:07.506 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:07.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:18:08.366 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:08.393 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:08.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone33 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:08.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:08.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:08.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone33 2024-09-21T15:18:08.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:08.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:09.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:09.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:09.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone34 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:09.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:09.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:09.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone34 2024-09-21T15:18:09.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:09.402 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:09.652 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2024-09-21T15:18:09.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2024-09-21T15:18:09.653 INFO:tasks.rbd_mirror_thrash:waiting for 6 secs before reviving daemons 2024-09-21T15:18:09.654 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:18:09.648+0000 7f8e7f127700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 51830) UID: 1000 2024-09-21T15:18:10.386 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:10.414 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:10.414 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone35 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:10.414 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:10.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:10.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone35 2024-09-21T15:18:10.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:10.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:11.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:11.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:11.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone36 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:11.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:11.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:11.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone36 2024-09-21T15:18:11.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:11.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:12.392 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:12.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:12.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone37 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:12.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:12.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:12.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone37 2024-09-21T15:18:12.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:12.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:13.190 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:13.171+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4410 2024-09-21T15:18:13.203 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:13.195+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f51e0 2024-09-21T15:18:13.214 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:13.203+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:18:13.214 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:13.203+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:18:13.218 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:13.203+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21712dd0 2024-09-21T15:18:13.218 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:13.203+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21738c30 2024-09-21T15:18:13.219 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:13.203+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363bd40 2024-09-21T15:18:13.219 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:13.203+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f3450 2024-09-21T15:18:13.220 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:13.215+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc238285b0 2024-09-21T15:18:13.220 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:13.215+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc23829d40 2024-09-21T15:18:13.220 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:13.215+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24055ad0 2024-09-21T15:18:13.303 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.295+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:18:13.303 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.295+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a1f75380 2024-09-21T15:18:13.308 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.299+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:18:13.309 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.303+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:18:13.309 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.303+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:18:13.309 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.303+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a40415f0 2024-09-21T15:18:13.309 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.303+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:18:13.309 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.303+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:18:13.309 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.303+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:18:13.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.311+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:18:13.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.311+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51484e0 2024-09-21T15:18:13.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.311+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a59a2dd0 2024-09-21T15:18:13.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.311+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec61a0 2024-09-21T15:18:13.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.311+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:18:13.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.311+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:18:13.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.311+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:18:13.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.311+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160680 2024-09-21T15:18:13.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.311+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:18:13.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.311+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:18:13.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.311+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780ed00 2024-09-21T15:18:13.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.315+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:18:13.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.315+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:18:13.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.315+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:18:13.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.315+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1ad0 2024-09-21T15:18:13.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.315+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:18:13.327 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:18:13.327 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:18:13.327 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:18:13.327 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:18:13.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9c270 2024-09-21T15:18:13.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9dd40 2024-09-21T15:18:13.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:18:13.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:18:13.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:18:13.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:18:13.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:18:13.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:18:13.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f1e0 2024-09-21T15:18:13.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f2b0 2024-09-21T15:18:13.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:18:13.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:18:13.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:18:13.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:18:13.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c4e0 2024-09-21T15:18:13.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18dc70 2024-09-21T15:18:13.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e8410 2024-09-21T15:18:13.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:18:13.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:18:13.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:18:13.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:18:13.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:18:13.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:18:13.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:18:13.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:18:13.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.323+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:18:13.332 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a8a90 2024-09-21T15:18:13.332 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a92b0 2024-09-21T15:18:13.332 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a9450 2024-09-21T15:18:13.332 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48680 2024-09-21T15:18:13.332 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:18:13.332 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:18:13.332 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288b60 2024-09-21T15:18:13.332 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289520 2024-09-21T15:18:13.332 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:18:13.332 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:18:13.332 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:18:13.332 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69040 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69e10 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a4e0 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a820 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8750 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:18:13.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:18:13.334 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:18:13.334 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:18:13.334 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:18:13.334 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:18:13.334 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677110 2024-09-21T15:18:13.334 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529d40 2024-09-21T15:18:13.334 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:13.327+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:18:13.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:13.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:13.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone38 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:13.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:13.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:13.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone38 2024-09-21T15:18:13.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:13.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:14.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:14.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:14.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone39 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:14.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:14.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:14.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone39 2024-09-21T15:18:14.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:14.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:15.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:15.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:15.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:15.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:15.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:15.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone4 2024-09-21T15:18:15.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:15.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:15.653 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2024-09-21T15:18:15.653 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:18:15.653 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.0 2024-09-21T15:18:15.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2024-09-21T15:18:15.654 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2024-09-21T15:18:15.656 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2024-09-21T15:18:15.656 INFO:tasks.rbd_mirror_thrash:waiting for 99 secs before thrashing 2024-09-21T15:18:16.424 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone40 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone40 2024-09-21T15:18:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:17.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:17.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:17.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:17.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:17.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:17.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone5 2024-09-21T15:18:17.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:17.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:18.438 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:18.463 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:18.463 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone6 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:18.463 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:18.463 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:18.463 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone6 2024-09-21T15:18:18.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:18.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:19.448 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:19.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:19.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone7 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:19.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:19.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:19.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone7 2024-09-21T15:18:19.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:19.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:20.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:20.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:20.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone8 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:20.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:20.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:20.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone8 2024-09-21T15:18:20.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:20.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:21.460 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:21.483 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:21.483 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.2-clone9 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:21.483 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:21.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:21.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone9 2024-09-21T15:18:21.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:21.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.2-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:22.460 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:22.488 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:22.488 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:22.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:22.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:22.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3 2024-09-21T15:18:22.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:22.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:23.482 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:23.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:23.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:23.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:23.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:23.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone1 2024-09-21T15:18:23.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:23.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:24.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:24.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:24.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone10 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:24.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:24.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:24.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone10 2024-09-21T15:18:24.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:24.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:25.504 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:25.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:25.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone11 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:25.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:25.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:25.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone11 2024-09-21T15:18:25.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:25.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:26.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:26.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:26.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone12 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:26.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:26.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:26.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone12 2024-09-21T15:18:26.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:26.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:27.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:27.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:27.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone13 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:27.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:27.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:27.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone13 2024-09-21T15:18:27.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:27.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:28.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:28.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:28.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone14 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:28.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:28.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:28.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone14 2024-09-21T15:18:28.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:28.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:28.654 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:28.650+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:18:28.656 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:28.650+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9e10 2024-09-21T15:18:28.671 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:28.658+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:18:28.671 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:28.662+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:18:28.672 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:28.662+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:18:28.672 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:28.662+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:18:28.672 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:28.662+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:18:29.529 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:29.556 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:29.557 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone15 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:29.557 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:29.557 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:29.557 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone15 2024-09-21T15:18:29.557 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:29.557 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:30.284 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.278+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5d40 2024-09-21T15:18:30.285 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.278+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5ee0 2024-09-21T15:18:30.290 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.286+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc15459450 2024-09-21T15:18:30.296 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.286+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546c750 2024-09-21T15:18:30.306 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.298+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546d1e0 2024-09-21T15:18:30.309 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.302+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546d790 2024-09-21T15:18:30.320 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc157fc000 2024-09-21T15:18:30.320 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:18:30.320 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1661a4e0 2024-09-21T15:18:30.320 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc16e7b5f0 2024-09-21T15:18:30.321 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1753d450 2024-09-21T15:18:30.321 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc192bcd00 2024-09-21T15:18:30.321 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939edd0 2024-09-21T15:18:30.321 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939ef70 2024-09-21T15:18:30.321 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fad0 2024-09-21T15:18:30.321 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fc70 2024-09-21T15:18:30.321 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc19691790 2024-09-21T15:18:30.321 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfce4e0 2024-09-21T15:18:30.321 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfcedd0 2024-09-21T15:18:30.321 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c383040 2024-09-21T15:18:30.323 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:18:30.323 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf592b0 2024-09-21T15:18:30.323 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3508f0 2024-09-21T15:18:30.323 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3515f0 2024-09-21T15:18:30.323 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3516c0 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822680 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822b60 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e823ad0 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1f299930 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1fdea750 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1fdebd40 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4410 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f51e0 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21708000 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21712dd0 2024-09-21T15:18:30.324 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21738c30 2024-09-21T15:18:30.325 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363bd40 2024-09-21T15:18:30.325 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f3450 2024-09-21T15:18:30.325 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc238280d0 2024-09-21T15:18:30.325 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc238285b0 2024-09-21T15:18:30.325 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc23829d40 2024-09-21T15:18:30.325 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:30.318+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24055ad0 2024-09-21T15:18:30.522 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:30.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:30.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone16 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:30.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:30.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:30.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone16 2024-09-21T15:18:30.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:30.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:31.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:31.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:31.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone17 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:31.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:31.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:31.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone17 2024-09-21T15:18:31.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:31.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:32.550 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone18 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone18 2024-09-21T15:18:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:33.226 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.219+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:18:33.226 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.219+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:18:33.228 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.219+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:18:33.228 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.219+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:18:33.228 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.219+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:18:33.240 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.231+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:18:33.243 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.235+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:18:33.243 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.235+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:18:33.244 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.235+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:18:33.244 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.235+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:18:33.244 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.235+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:18:33.244 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.239+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:18:33.248 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.239+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:18:33.248 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.239+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:18:33.248 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.239+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:18:33.248 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:18:33.239+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:18:34.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:34.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone19 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone19 2024-09-21T15:18:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:34.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:35.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:35.607 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:35.607 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:35.607 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:35.607 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:35.607 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone2 2024-09-21T15:18:35.607 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:35.608 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:36.565 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:36.589 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:36.589 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone20 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:36.589 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:36.589 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:36.589 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone20 2024-09-21T15:18:36.589 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:36.589 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:37.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone21 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone21 2024-09-21T15:18:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:38.578 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:38.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:38.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone22 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:38.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:38.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:38.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone22 2024-09-21T15:18:38.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:38.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:39.672 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:39.674 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.670+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:18:39.679 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.674+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:18:39.679 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.674+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678ed00 2024-09-21T15:18:39.683 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.678+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:18:39.683 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.678+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb9930 2024-09-21T15:18:39.684 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.678+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:18:39.684 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.678+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e000 2024-09-21T15:18:39.686 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.682+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:18:39.691 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.686+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:18:39.697 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:18:39.697 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:18:39.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.694+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4340 2024-09-21T15:18:39.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.694+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4750 2024-09-21T15:18:39.705 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.698+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4f70 2024-09-21T15:18:39.705 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.698+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:18:39.705 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.698+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:18:39.705 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.698+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:18:39.706 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:18:39.706 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:18:39.706 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:18:39.706 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:18:39.706 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:18:39.706 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:18:39.707 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:18:39.707 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4709a00 2024-09-21T15:18:39.707 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:18:39.707 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:18:39.707 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:18:39.707 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:18:39.707 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb110 2024-09-21T15:18:39.707 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:18:39.707 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:18:39.708 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbbba0 2024-09-21T15:18:39.708 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:18:39.708 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:18:39.708 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55110 2024-09-21T15:18:39.708 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c24e0 2024-09-21T15:18:39.708 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3ad0 2024-09-21T15:18:39.708 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:18:39.708 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9e10 2024-09-21T15:18:39.709 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:18:39.709 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:18:39.709 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:18:39.709 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:18:39.709 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:39.702+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:18:39.750 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:39.751 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone23 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:39.751 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:39.751 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:39.751 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone23 2024-09-21T15:18:39.751 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:39.751 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:40.585 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:40.606 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:40.607 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone24 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:40.607 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:40.607 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:40.607 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone24 2024-09-21T15:18:40.607 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:40.607 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:41.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:41.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:41.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone25 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:41.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:41.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:41.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone25 2024-09-21T15:18:41.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:41.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:42.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:42.627 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:42.627 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone26 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:42.627 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:42.627 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:42.627 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone26 2024-09-21T15:18:42.627 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:42.627 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:43.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:43.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:43.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone27 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:43.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:43.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:43.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone27 2024-09-21T15:18:43.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:43.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:44.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:44.649 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:44.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone28 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:44.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:44.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:44.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone28 2024-09-21T15:18:44.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:44.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:45.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:45.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone29 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:45.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:45.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:45.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone29 2024-09-21T15:18:45.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:45.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:46.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:46.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:46.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:46.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:46.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:46.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone3 2024-09-21T15:18:46.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:46.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:47.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:47.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:47.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone30 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:47.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:47.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:47.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone30 2024-09-21T15:18:47.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:47.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:48.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone31 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone31 2024-09-21T15:18:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:49.449 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:49.442+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:18:49.449 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:49.442+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:18:49.449 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:49.442+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:18:49.449 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:49.442+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:18:49.471 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:49.466+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:18:49.471 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:49.466+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:18:49.471 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:49.466+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:18:49.471 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:49.466+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677110 2024-09-21T15:18:49.471 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:49.466+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529d40 2024-09-21T15:18:49.471 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:18:49.466+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:18:49.657 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:49.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:49.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone32 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:49.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:49.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:49.686 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone32 2024-09-21T15:18:49.686 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:49.686 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:50.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:50.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:50.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone33 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:50.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:50.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:50.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone33 2024-09-21T15:18:50.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:50.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:51.675 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:51.705 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:51.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone34 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:51.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:51.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:51.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone34 2024-09-21T15:18:51.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:51.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:52.359 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:52.346+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f3450 2024-09-21T15:18:52.360 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:52.354+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc238285b0 2024-09-21T15:18:52.370 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:52.366+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc23829d40 2024-09-21T15:18:52.376 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:52.370+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24055ad0 2024-09-21T15:18:52.376 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:18:52.370+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0cf70 2024-09-21T15:18:52.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:52.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:52.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone35 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:52.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:52.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:52.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone35 2024-09-21T15:18:52.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:52.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:53.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:53.710 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:53.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone36 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:53.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:53.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:53.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone36 2024-09-21T15:18:53.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:53.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:54.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:54.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:54.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone37 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:54.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:54.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:54.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone37 2024-09-21T15:18:54.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:54.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:55.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:55.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:55.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone38 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:55.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:55.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:55.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone38 2024-09-21T15:18:55.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:55.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:56.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:56.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:56.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone39 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:56.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:56.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:56.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone39 2024-09-21T15:18:56.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:56.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:57.702 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:57.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:57.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:57.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:57.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:57.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone4 2024-09-21T15:18:57.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:57.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:58.212 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.194+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:18:58.226 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.218+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:18:58.226 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.218+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e000 2024-09-21T15:18:58.226 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.218+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:18:58.226 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.218+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e5b0 2024-09-21T15:18:58.226 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.218+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:18:58.235 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.226+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:18:58.242 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.226+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4340 2024-09-21T15:18:58.242 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.226+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4750 2024-09-21T15:18:58.243 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.226+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:18:58.243 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.226+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:18:58.243 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.226+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:18:58.243 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.226+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:18:58.244 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.234+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:18:58.244 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.238+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:18:58.244 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.238+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:18:58.244 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.238+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:18:58.244 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.238+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:18:58.245 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.238+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:18:58.248 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.242+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:18:58.248 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.242+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:18:58.248 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.242+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:18:58.248 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.242+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:18:58.248 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.242+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb110 2024-09-21T15:18:58.248 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.242+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:18:58.248 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.242+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:18:58.248 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.242+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbba00 2024-09-21T15:18:58.252 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.246+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbbba0 2024-09-21T15:18:58.252 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.246+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:18:58.252 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.246+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:18:58.252 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.246+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55110 2024-09-21T15:18:58.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.246+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c24e0 2024-09-21T15:18:58.263 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.254+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3ad0 2024-09-21T15:18:58.264 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.254+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:18:58.264 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.254+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9e10 2024-09-21T15:18:58.264 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.254+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:18:58.264 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.254+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:18:58.264 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.254+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:18:58.264 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.254+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:18:58.264 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.254+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:18:58.264 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:18:58.254+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:18:58.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:58.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:58.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone40 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:58.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:58.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:58.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone40 2024-09-21T15:18:58.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:58.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:59.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:18:59.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:18:59.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone41 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:59.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:18:59.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:18:59.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone41 2024-09-21T15:18:59.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:18:59.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone41@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:00.726 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:00.754 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:00.754 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone42 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:00.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:00.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:00.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone42 2024-09-21T15:19:00.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:00.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone42@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:01.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:01.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:01.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone43 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:01.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:01.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:01.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone43 2024-09-21T15:19:01.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:01.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone43@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:02.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:02.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:02.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone44 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:02.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:02.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:02.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone44 2024-09-21T15:19:02.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:02.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone44@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:03.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:03.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:03.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone45 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:03.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:03.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:03.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone45 2024-09-21T15:19:03.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:03.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone45@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:04.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:04.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:04.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone46 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:04.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:04.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:04.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone46 2024-09-21T15:19:04.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:04.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone46@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:05.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:05.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:05.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone47 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:05.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:05.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:05.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone47 2024-09-21T15:19:05.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:05.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone47@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:06.068 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.059+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:19:06.069 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.059+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:19:06.101 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.095+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:19:06.123 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.111+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:19:06.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ad638750 2024-09-21T15:19:06.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adaa3c70 2024-09-21T15:19:06.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ade4e9c0 2024-09-21T15:19:06.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5860 2024-09-21T15:19:06.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5d40 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25aa90 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25ac30 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25b860 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25bba0 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344680 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344750 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47e1a0 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae4ce820 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810b60 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810dd0 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae8d8000 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:19:06.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b040 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aef04b60 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac0000 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb184e0 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb192b0 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4c8f0 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4cf70 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:19:06.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:19:06.133 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:19:06.133 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:19:06.133 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:19:06.133 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:19:06.133 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:19:06.133 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1040 2024-09-21T15:19:06.133 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.123+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:19:06.134 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.127+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c9c0 2024-09-21T15:19:06.134 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.127+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b28585b0 2024-09-21T15:19:06.138 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.127+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:19:06.138 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.127+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:19:06.139 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.127+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:19:06.139 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.127+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:19:06.139 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.127+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51930 2024-09-21T15:19:06.139 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.127+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:19:06.139 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:19:06.139 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31009c0 2024-09-21T15:19:06.139 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:19:06.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:19:06.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:19:06.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:19:06.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.131+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:19:06.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:19:06.140 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:19:06.141 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:19:06.141 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.135+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:19:06.153 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.147+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:19:06.154 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.147+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:19:06.154 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.147+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b36868f0 2024-09-21T15:19:06.154 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.147+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:19:06.155 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.147+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:19:06.155 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:19:06.157 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:19:06.158 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:19:06.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:19:06.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:19:06.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:19:06.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:19:06.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:19:06.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:19:06.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.151+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:19:06.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:19:06.163 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:19:06.165 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:19:06.165 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.155+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:19:06.171 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:19:06.174 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:19:06.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:19:06.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:19:06.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:19:06.177 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:19:06.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:19:06.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:19:06.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:19:06.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:19:06.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.167+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:19:06.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:19:06.178 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:19:06.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:19:06.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:19:06.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.171+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:19:06.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:19:06.179 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:19:06.180 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:19:06.180 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:19:06.181 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.175+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:19:06.183 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.179+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:19:06.183 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.179+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:19:06.183 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.179+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:19:06.183 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.179+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:19:06.183 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.179+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:19:06.184 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.179+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:19:06.184 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.179+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:19:06.184 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.179+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:19:06.184 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.179+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:19:06.184 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.179+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ad638750 2024-09-21T15:19:06.184 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.179+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adaa3c70 2024-09-21T15:19:06.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ade4e9c0 2024-09-21T15:19:06.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5860 2024-09-21T15:19:06.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5d40 2024-09-21T15:19:06.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25aa90 2024-09-21T15:19:06.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25ac30 2024-09-21T15:19:06.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25b860 2024-09-21T15:19:06.194 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25bba0 2024-09-21T15:19:06.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344680 2024-09-21T15:19:06.196 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344750 2024-09-21T15:19:06.196 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:19:06.196 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47e1a0 2024-09-21T15:19:06.196 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae4ce820 2024-09-21T15:19:06.196 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810b60 2024-09-21T15:19:06.196 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.187+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810dd0 2024-09-21T15:19:06.202 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.195+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae8d8000 2024-09-21T15:19:06.203 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.195+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:19:06.203 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.195+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b040 2024-09-21T15:19:06.203 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.195+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b790 2024-09-21T15:19:06.204 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.195+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aef04b60 2024-09-21T15:19:06.204 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.195+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac0000 2024-09-21T15:19:06.204 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.195+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb184e0 2024-09-21T15:19:06.204 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.195+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb192b0 2024-09-21T15:19:06.204 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.199+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:19:06.205 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.199+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:19:06.205 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.199+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:19:06.205 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.199+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:19:06.205 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.199+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:19:06.205 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.199+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:19:06.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4c8f0 2024-09-21T15:19:06.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4cf70 2024-09-21T15:19:06.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:19:06.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:19:06.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:19:06.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049ee0 2024-09-21T15:19:06.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:19:06.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:19:06.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:19:06.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:19:06.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:19:06.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1040 2024-09-21T15:19:06.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:19:06.208 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c9c0 2024-09-21T15:19:06.208 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b28585b0 2024-09-21T15:19:06.208 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50750 2024-09-21T15:19:06.208 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:19:06.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:19:06.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:19:06.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:19:06.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51930 2024-09-21T15:19:06.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:19:06.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:19:06.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:19:06.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31009c0 2024-09-21T15:19:06.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:19:06.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:19:06.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:19:06.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:19:06.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:19:06.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:19:06.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:19:06.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd6c0 2024-09-21T15:19:06.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:19:06.211 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:19:06.211 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:19:06.211 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:19:06.211 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b36868f0 2024-09-21T15:19:06.211 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:19:06.211 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:19:06.211 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811a00 2024-09-21T15:19:06.211 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.203+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:19:06.213 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.207+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:19:06.213 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.207+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:19:06.213 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.207+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:19:06.213 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.207+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:19:06.213 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.207+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:19:06.213 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.207+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:19:06.213 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.207+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:19:06.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.207+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:19:06.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.207+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:19:06.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.207+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:19:06.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.207+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:19:06.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.207+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:19:06.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.207+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:19:06.215 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:19:06.215 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:19:06.215 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:19:06.215 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:19:06.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:19:06.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:19:06.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:19:06.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:19:06.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:19:06.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:19:06.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:19:06.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:19:06.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:19:06.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:19:06.216 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:19:06.217 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:19:06.218 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:19:06.218 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:19:06.218 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:19:06.218 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:06.211+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:19:06.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:06.793 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:06.793 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone48 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:06.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:06.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:06.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone48 2024-09-21T15:19:06.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:06.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone48@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:07.266 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.261+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf3061a00 2024-09-21T15:19:07.268 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.261+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf49c3a00 2024-09-21T15:19:07.268 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.261+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4680 2024-09-21T15:19:07.269 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.261+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5d40 2024-09-21T15:19:07.271 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.265+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:19:07.271 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.265+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:19:07.271 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.265+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4410 2024-09-21T15:19:07.313 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.297+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf49c3a00 2024-09-21T15:19:07.313 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.297+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5d40 2024-09-21T15:19:07.314 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.305+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:19:07.314 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.305+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:19:07.316 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.309+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3516c0 2024-09-21T15:19:07.317 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.309+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:19:07.327 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.317+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:19:07.327 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:07.317+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f3450 2024-09-21T15:19:07.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:07.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:07.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone49 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:07.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:07.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:07.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone49 2024-09-21T15:19:07.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:07.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone49@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:08.652 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.8485154072136538) > weight (0.25) 2024-09-21T15:19:08.652 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.1 2024-09-21T15:19:08.652 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Sent signal 15 2024-09-21T15:19:08.652 INFO:tasks.rbd_mirror_thrash:waiting for 2 secs before reviving daemons 2024-09-21T15:19:08.653 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:19:08.650+0000 7f1d7d3f8700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 (PID: 27329) UID: 1000 2024-09-21T15:19:08.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:08.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:08.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:08.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:08.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:08.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone5 2024-09-21T15:19:08.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:08.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:09.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:09.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:09.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone50 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:09.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:09.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:09.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone50 2024-09-21T15:19:09.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:09.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone50@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:10.654 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.1 2024-09-21T15:19:10.654 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:19:10.654 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.1 2024-09-21T15:19:10.654 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2024-09-21T15:19:10.654 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2024-09-21T15:19:10.657 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2024-09-21T15:19:10.657 INFO:tasks.rbd_mirror_thrash:waiting for 69 secs before thrashing 2024-09-21T15:19:10.797 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:10.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:10.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone51 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:10.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:10.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:10.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone51 2024-09-21T15:19:10.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:10.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone51@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:11.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:11.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:11.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone52 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:11.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:11.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:11.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone52 2024-09-21T15:19:11.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:11.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone52@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:12.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:12.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:12.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone53 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:12.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:12.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:12.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone53 2024-09-21T15:19:12.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:12.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone53@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:13.821 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:13.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:13.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone54 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:13.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:13.846 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:13.846 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone54 2024-09-21T15:19:13.846 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:13.846 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone54@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:14.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone55 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone55 2024-09-21T15:19:14.847 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:14.848 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone55@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:15.693 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.685+0000 7f7fd044c700 -1 reset not still connected to 0x56369f95bc70 2024-09-21T15:19:15.697 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.689+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:19:15.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.693+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:19:15.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.693+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678ed00 2024-09-21T15:19:15.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.693+0000 7f7fd044c700 -1 reset not still connected to 0x5636b71484e0 2024-09-21T15:19:15.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.693+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb9930 2024-09-21T15:19:15.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.693+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:19:15.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.693+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e000 2024-09-21T15:19:15.704 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.697+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:19:15.704 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.697+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:19:15.704 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.697+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbb2b0 2024-09-21T15:19:15.711 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.705+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc40d0 2024-09-21T15:19:15.711 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.705+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:19:15.711 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.705+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4270 2024-09-21T15:19:15.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.705+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4340 2024-09-21T15:19:15.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.705+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4750 2024-09-21T15:19:15.719 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.709+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4f70 2024-09-21T15:19:15.719 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.709+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:19:15.719 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.709+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:19:15.719 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.709+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:19:15.719 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.709+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:19:15.719 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.709+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:19:15.720 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.709+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:19:15.720 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.709+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:19:15.720 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.709+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:19:15.721 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.713+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504dd0 2024-09-21T15:19:15.721 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.713+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:19:15.721 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.713+0000 7f7fd044c700 -1 reset not still connected to 0x5636c47091e0 2024-09-21T15:19:15.721 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.713+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4709860 2024-09-21T15:19:15.721 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.713+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4709a00 2024-09-21T15:19:15.721 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.713+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:19:15.721 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.713+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:19:15.721 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.713+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:19:15.723 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.713+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:19:15.723 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.713+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb110 2024-09-21T15:19:15.723 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.713+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:19:15.723 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.713+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:19:15.723 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.713+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbba00 2024-09-21T15:19:15.726 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.721+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbbba0 2024-09-21T15:19:15.726 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.721+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:19:15.726 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.721+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:19:15.726 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.721+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55110 2024-09-21T15:19:15.726 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.721+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c24e0 2024-09-21T15:19:15.729 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.725+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3040 2024-09-21T15:19:15.729 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.725+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3a00 2024-09-21T15:19:15.730 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.725+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3ad0 2024-09-21T15:19:15.730 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.725+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:19:15.730 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.725+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9e10 2024-09-21T15:19:15.730 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.725+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:19:15.730 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.725+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:19:15.730 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.725+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:19:15.734 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.729+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:19:15.735 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.729+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:19:15.735 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.729+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:19:15.735 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.729+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335e10 2024-09-21T15:19:15.735 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:19:15.729+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966820 2024-09-21T15:19:15.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:15.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:15.876 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone56 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:15.876 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:15.876 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:15.876 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone56 2024-09-21T15:19:15.876 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:15.876 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone56@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:16.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:16.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:16.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone57 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:16.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:16.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:16.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone57 2024-09-21T15:19:16.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:16.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone57@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:17.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:17.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:17.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone6 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:17.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:17.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:17.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone6 2024-09-21T15:19:17.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:17.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:18.862 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:18.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:18.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone7 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:18.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:18.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:18.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone7 2024-09-21T15:19:18.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:18.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:19.865 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:19.890 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:19.890 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone8 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:19.890 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:19.890 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:19.890 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone8 2024-09-21T15:19:19.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:19.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:20.866 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:20.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:20.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.3-clone9 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:20.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:20.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:20.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone9 2024-09-21T15:19:20.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:20.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.3-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:21.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:21.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:21.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:21.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:21.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:21.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4 2024-09-21T15:19:21.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:21.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:22.881 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:22.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:22.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:22.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:22.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:22.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone1 2024-09-21T15:19:22.907 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:22.907 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:23.388 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.374+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b040 2024-09-21T15:19:23.391 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.378+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:19:23.394 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.394+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:19:23.397 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:19:23.397 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:19:23.398 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:19:23.398 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:19:23.398 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:19:23.398 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:19:23.398 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:19:23.398 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:19:23.428 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.422+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:19:23.429 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.422+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:19:23.429 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.422+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:19:23.429 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.422+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:19:23.429 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.422+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a2820 2024-09-21T15:19:23.429 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.422+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:19:23.434 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.426+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:19:23.434 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.426+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:19:23.434 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.426+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:19:23.436 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.434+0000 7ff753f07700 -1 reset not still connected to 0x56016f162000 2024-09-21T15:19:23.438 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.434+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:19:23.439 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.434+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:19:23.439 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.434+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:19:23.439 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.434+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:19:23.439 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.434+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:19:23.440 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.434+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:19:23.440 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.438+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:19:23.440 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.438+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:19:23.451 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.450+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:19:23.451 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.450+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:19:23.451 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.450+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:19:23.451 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.450+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:19:23.451 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.450+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:19:23.451 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.450+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:19:23.451 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.442+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:19:23.453 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.450+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:19:23.454 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.450+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:19:23.454 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.450+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:19:23.454 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.450+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:19:23.455 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.454+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:19:23.457 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.454+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:19:23.457 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.454+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:19:23.461 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.458+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:19:23.461 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.458+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:19:23.463 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.458+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:19:23.469 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.462+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:19:23.469 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.462+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:19:23.469 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.462+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:19:23.469 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.462+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:19:23.470 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.462+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:19:23.470 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.466+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd8000 2024-09-21T15:19:23.470 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.466+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:19:23.474 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:19:23.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:19:23.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:19:23.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:19:23.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:19:23.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56017063fee0 2024-09-21T15:19:23.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:19:23.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:19:23.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:19:23.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:19:23.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9930 2024-09-21T15:19:23.476 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.466+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:19:23.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:19:23.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:19:23.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:19:23.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:19:23.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:19:23.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:19:23.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56017157c5b0 2024-09-21T15:19:23.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:19:23.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:19:23.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:19:23.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:19:23.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:19:23.478 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:19:23.478 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:19:23.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.466+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:19:23.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.466+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:19:23.478 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:19:23.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.466+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:19:23.480 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:19:23.480 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:19:23.480 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:19:23.480 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:19:23.480 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:19:23.480 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:19:23.480 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:19:23.480 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:19:23.480 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:19:23.481 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:19:23.481 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:19:23.481 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:19:23.481 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:19:23.481 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7d40 2024-09-21T15:19:23.481 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:23.470+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc750 2024-09-21T15:19:23.481 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.470+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:19:23.484 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.478+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:19:23.484 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.478+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:19:23.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.482+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:19:23.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:23.482+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:19:23.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:23.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:23.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone10 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:23.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:23.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:23.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone10 2024-09-21T15:19:23.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:23.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:24.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:24.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:24.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone11 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:24.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:24.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:24.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone11 2024-09-21T15:19:24.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:24.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:25.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:25.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:25.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone12 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:25.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:25.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:25.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone12 2024-09-21T15:19:25.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:25.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:26.908 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:26.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:26.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone13 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:26.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:26.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:26.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone13 2024-09-21T15:19:26.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:26.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:27.382 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:19:27.373+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:19:27.384 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:19:27.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:19:27.398 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:19:27.389+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:19:27.421 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:19:27.417+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:19:27.432 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:19:27.425+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:19:27.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:19:27.429+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:19:27.441 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:19:27.429+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:19:27.445 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:19:27.433+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:19:27.446 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:19:27.433+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:19:27.447 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:19:27.433+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:19:27.447 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:19:27.433+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:19:27.571 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:27.565+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf6054680 2024-09-21T15:19:27.677 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:19:27.674+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0000 2024-09-21T15:19:27.917 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:27.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:27.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone14 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:27.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:27.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:27.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone14 2024-09-21T15:19:27.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:27.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:28.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:28.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:28.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone15 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:28.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:28.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:28.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone15 2024-09-21T15:19:28.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:28.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:29.394 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.386+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25aa90 2024-09-21T15:19:29.395 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.386+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25bba0 2024-09-21T15:19:29.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:19:29.408 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.402+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810b60 2024-09-21T15:19:29.416 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae8d8000 2024-09-21T15:19:29.416 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:19:29.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b040 2024-09-21T15:19:29.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb192b0 2024-09-21T15:19:29.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:19:29.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:19:29.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:19:29.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:19:29.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:19:29.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:19:29.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:19:29.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:19:29.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:19:29.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.422+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:19:29.428 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:19:29.428 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:19:29.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:19:29.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:19:29.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:19:29.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:19:29.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:19:29.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:19:29.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:19:29.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:19:29.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:19:29.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:19:29.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:19:29.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:19:29.436 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.434+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:19:29.436 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.434+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:19:29.436 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.434+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:19:29.436 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.434+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:19:29.440 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:19:29.440 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:19:29.440 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:19:29.440 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:19:29.441 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:19:29.441 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:19:29.441 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:19:29.441 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:19:29.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.438+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:19:29.443 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.442+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:19:29.443 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.442+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:19:29.444 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.442+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:19:29.445 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.442+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:19:29.445 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:29.442+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:19:29.937 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:29.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:29.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone16 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:29.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:29.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:29.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone16 2024-09-21T15:19:29.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:29.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:30.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:30.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:30.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone17 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:30.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:30.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:30.965 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone17 2024-09-21T15:19:30.965 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:30.965 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:31.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:31.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:31.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone18 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:31.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:31.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:31.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone18 2024-09-21T15:19:31.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:31.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:32.944 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:32.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:32.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone19 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:32.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:32.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:32.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone19 2024-09-21T15:19:32.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:32.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:33.324 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.318+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:19:33.329 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.318+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b040 2024-09-21T15:19:33.329 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.322+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac0000 2024-09-21T15:19:33.331 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.330+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb184e0 2024-09-21T15:19:33.332 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.330+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:19:33.332 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.330+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:19:33.333 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.330+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:19:33.335 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.334+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:19:33.335 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.334+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:19:33.335 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.334+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:19:33.340 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:33.333+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822680 2024-09-21T15:19:33.340 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:33.333+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e823ad0 2024-09-21T15:19:33.341 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:33.333+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f51e0 2024-09-21T15:19:33.341 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:33.333+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:19:33.341 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.338+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:19:33.341 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.338+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:19:33.342 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.338+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:19:33.342 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.338+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:19:33.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:33.337+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:19:33.345 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.342+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:19:33.348 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:19:33.348 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:19:33.348 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:19:33.348 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c9c0 2024-09-21T15:19:33.349 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:19:33.349 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:19:33.349 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:19:33.351 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:19:33.352 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:19:33.352 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:19:33.352 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:19:33.352 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:19:33.352 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:19:33.352 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:19:33.352 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:19:33.352 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:19:33.352 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:19:33.353 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:19:33.353 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:19:33.353 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:19:33.353 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:19:33.353 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:19:33.353 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:19:33.353 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:19:33.353 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:19:33.353 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:19:33.356 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:19:33.356 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:19:33.356 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:19:33.356 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:19:33.356 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:19:33.357 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:19:33.357 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:19:33.357 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:19:33.358 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:19:33.358 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:19:33.358 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:19:33.358 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:19:33.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:19:33.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:19:33.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:19:33.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:19:33.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:19:33.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:19:33.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:19:33.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:34.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:34.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:34.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:34.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:34.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone2 2024-09-21T15:19:34.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:34.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:34.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:34.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:34.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone20 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:34.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:34.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:34.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone20 2024-09-21T15:19:34.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:34.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:35.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:36.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:36.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone21 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:36.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:36.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:36.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone21 2024-09-21T15:19:36.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:36.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:36.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:37.016 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:37.016 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone22 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:37.016 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:37.016 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:37.016 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone22 2024-09-21T15:19:37.016 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:37.017 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:38.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:38.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:38.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone23 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:38.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:38.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:38.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone23 2024-09-21T15:19:38.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:38.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:39.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:39.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:39.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone24 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:39.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:39.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:39.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone24 2024-09-21T15:19:39.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:39.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:40.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:40.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:40.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone25 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:40.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:40.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:40.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone25 2024-09-21T15:19:40.044 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:40.044 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:41.015 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:41.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:41.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone26 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:41.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:41.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:41.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone26 2024-09-21T15:19:41.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:41.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:42.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:42.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:42.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone27 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:42.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:42.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:42.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone27 2024-09-21T15:19:42.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:42.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:43.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:43.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:43.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone28 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:43.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:43.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:43.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone28 2024-09-21T15:19:43.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:43.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:43.303 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:19:43.298+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:19:43.304 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:19:43.302+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:19:43.305 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:19:43.302+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:19:43.307 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:19:43.306+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:19:43.317 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:19:43.314+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:19:43.324 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:19:43.318+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:19:44.042 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:44.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:44.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone29 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:44.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:44.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:44.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone29 2024-09-21T15:19:44.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:44.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:45.046 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:45.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:45.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:45.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:45.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:45.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone3 2024-09-21T15:19:45.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:45.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:46.047 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:46.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:46.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone30 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:46.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:46.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone30 2024-09-21T15:19:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:47.065 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:47.090 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:47.090 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone31 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:47.090 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:47.090 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:47.090 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone31 2024-09-21T15:19:47.090 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:47.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:48.065 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone32 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone32 2024-09-21T15:19:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:49.070 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:49.094 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:49.094 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone33 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:49.094 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:49.094 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:49.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone33 2024-09-21T15:19:49.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:49.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:50.077 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:50.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:50.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone34 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:50.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:50.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:50.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone34 2024-09-21T15:19:50.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:50.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:51.094 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:51.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:51.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone35 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:51.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:51.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:51.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone35 2024-09-21T15:19:51.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:51.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:52.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:52.117 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:52.117 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone36 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:52.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:52.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:52.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone36 2024-09-21T15:19:52.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:52.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:53.105 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:53.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:53.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone37 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:53.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:53.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:53.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone37 2024-09-21T15:19:53.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:53.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:54.101 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.096+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4680 2024-09-21T15:19:54.101 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.096+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5d40 2024-09-21T15:19:54.105 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.096+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5ee0 2024-09-21T15:19:54.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.100+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:19:54.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.100+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939edd0 2024-09-21T15:19:54.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.100+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939ef70 2024-09-21T15:19:54.106 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.100+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfcedd0 2024-09-21T15:19:54.108 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.100+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c383040 2024-09-21T15:19:54.108 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.100+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:19:54.108 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.100+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822b60 2024-09-21T15:19:54.108 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.100+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e823ad0 2024-09-21T15:19:54.108 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.100+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:19:54.117 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.108+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4410 2024-09-21T15:19:54.117 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.108+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f51e0 2024-09-21T15:19:54.122 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.116+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:19:54.123 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:19:54.116+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:19:54.155 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:54.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:54.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone38 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:54.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:54.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:54.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone38 2024-09-21T15:19:54.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:54.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:54.657 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2024-09-21T15:19:54.657 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2024-09-21T15:19:54.657 INFO:tasks.rbd_mirror_thrash:waiting for 4 secs before reviving daemons 2024-09-21T15:19:54.658 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:19:54.657+0000 7f84eac7e700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 58409) UID: 1000 2024-09-21T15:19:55.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:55.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:55.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone39 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:55.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:55.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:55.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone39 2024-09-21T15:19:55.150 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:55.150 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:56.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:56.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:56.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:56.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:56.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:56.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone4 2024-09-21T15:19:56.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:56.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:57.132 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:57.157 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:57.157 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone40 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:57.157 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:57.157 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:57.157 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone40 2024-09-21T15:19:57.157 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:57.157 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:58.132 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:58.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:58.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone41 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:58.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:58.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:58.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone41 2024-09-21T15:19:58.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:58.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone41@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:58.658 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2024-09-21T15:19:58.658 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:19:58.659 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.0 2024-09-21T15:19:58.659 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2024-09-21T15:19:58.659 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2024-09-21T15:19:58.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2024-09-21T15:19:58.661 INFO:tasks.rbd_mirror_thrash:waiting for 103 secs before thrashing 2024-09-21T15:19:59.144 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:19:59.168 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:19:59.168 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone42 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:59.168 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:19:59.168 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:19:59.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone42 2024-09-21T15:19:59.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:19:59.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone42@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:00.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:00.217 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:00.217 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone43 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:00.217 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:00.217 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:00.218 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone43 2024-09-21T15:20:00.218 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:00.218 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone43@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:01.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:01.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:01.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone44 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:01.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:01.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:01.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone44 2024-09-21T15:20:01.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:01.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone44@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:02.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:02.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:02.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone45 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:02.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:02.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:02.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone45 2024-09-21T15:20:02.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:02.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone45@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:03.168 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:03.193 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:03.193 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone46 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:03.193 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:03.194 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:03.194 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone46 2024-09-21T15:20:03.194 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:03.194 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone46@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:04.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:04.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:04.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone47 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:04.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:04.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:04.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone47 2024-09-21T15:20:04.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:04.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone47@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:05.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:05.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:05.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone48 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:05.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:05.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:05.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone48 2024-09-21T15:20:05.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:05.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone48@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:06.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:06.225 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:06.225 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone49 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:06.225 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:06.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:06.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone49 2024-09-21T15:20:06.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:06.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone49@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:07.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:07.224 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:07.224 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:07.224 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:07.224 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:07.224 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone5 2024-09-21T15:20:07.224 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:07.224 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:08.222 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone50 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone50 2024-09-21T15:20:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:08.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone50@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:09.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:09.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:09.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone51 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:09.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:09.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:09.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone51 2024-09-21T15:20:09.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:09.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone51@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:10.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:10.272 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:10.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone6 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:10.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:10.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:10.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone6 2024-09-21T15:20:10.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:10.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:11.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:11.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:11.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone7 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:11.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:11.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:11.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone7 2024-09-21T15:20:11.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:11.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:12.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:12.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:12.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone8 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:12.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:12.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:12.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone8 2024-09-21T15:20:12.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:12.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:13.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:13.272 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:13.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.4-clone9 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:13.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:13.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:13.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone9 2024-09-21T15:20:13.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:13.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.4-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:14.272 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:14.295 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5 2024-09-21T15:20:14.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:14.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:15.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:15.294 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:15.294 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:15.294 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:15.294 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:15.294 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone1 2024-09-21T15:20:15.294 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:15.294 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:16.271 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:16.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:16.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone10 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:16.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:16.297 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:16.297 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone10 2024-09-21T15:20:16.297 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:16.297 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:17.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:17.300 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone11 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone11 2024-09-21T15:20:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:17.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:18.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:18.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:18.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone12 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:18.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:18.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:18.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone12 2024-09-21T15:20:18.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:18.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:19.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:19.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:19.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone13 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:19.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:19.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:19.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone13 2024-09-21T15:20:19.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:19.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:19.657 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.0 2024-09-21T15:20:19.658 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Sent signal 15 2024-09-21T15:20:19.658 INFO:tasks.rbd_mirror_thrash:waiting for 3 secs before reviving daemons 2024-09-21T15:20:19.659 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:20:19.657+0000 7fb314f66700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 (PID: 48316) UID: 1000 2024-09-21T15:20:20.292 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.288+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:20:20.294 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.292+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:20:20.319 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:20:20.320 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:20:20.321 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.316+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:20:20.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.324+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:20:20.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.324+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:20:20.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.324+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:20:20.329 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.324+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:20:20.335 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.328+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:20:20.336 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.328+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f1e0 2024-09-21T15:20:20.337 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.328+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:20:20.337 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.328+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:20:20.337 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.328+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:20:20.337 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.328+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:20:20.350 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.348+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:20:20.350 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.348+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:20:20.350 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.348+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:20:20.354 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:20:20.354 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:20:20.354 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:20:20.354 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:20:20.354 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:20:20.354 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:20:20.354 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a8a90 2024-09-21T15:20:20.354 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a92b0 2024-09-21T15:20:20.354 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a9450 2024-09-21T15:20:20.354 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48680 2024-09-21T15:20:20.354 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:20:20.354 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:20:20.357 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288b60 2024-09-21T15:20:20.357 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289520 2024-09-21T15:20:20.357 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:20:20.357 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:20:20.357 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:20:20.357 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:20:20.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:20:20.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69e10 2024-09-21T15:20:20.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:20:20.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:20:20.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:20:20.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:20:20.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:20:20.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:20:20.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a820 2024-09-21T15:20:20.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:20:20.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8750 2024-09-21T15:20:20.358 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:20:20.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:20:20.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:20:20.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:20:20.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:20:20.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:20:20.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:20:20.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677110 2024-09-21T15:20:20.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529d40 2024-09-21T15:20:20.363 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:20:20.360+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:20:20.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:20.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:20.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone14 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:20.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:20.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:20.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone14 2024-09-21T15:20:20.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:20.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:21.309 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:21.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:21.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone15 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:21.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:21.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:21.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone15 2024-09-21T15:20:21.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:21.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:22.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:22.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:22.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone16 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:22.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:22.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:22.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone16 2024-09-21T15:20:22.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:22.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:22.659 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.0 2024-09-21T15:20:22.659 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:20:22.660 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.0 2024-09-21T15:20:22.660 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Restarting daemon 2024-09-21T15:20:22.660 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 2024-09-21T15:20:22.662 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Started 2024-09-21T15:20:22.663 INFO:tasks.rbd_mirror_thrash:waiting for 75 secs before thrashing 2024-09-21T15:20:23.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:23.344 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.341+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:20:23.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:23.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone17 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:23.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:23.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:23.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone17 2024-09-21T15:20:23.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:23.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:23.436 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.433+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:20:23.436 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.433+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:20:23.436 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.433+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:20:23.436 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.433+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:20:23.441 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.437+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:20:23.445 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.437+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:20:23.445 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.437+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:20:23.445 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.437+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:20:23.446 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.441+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:20:23.447 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.445+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:20:23.447 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.445+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:20:23.447 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.445+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:20:23.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.453+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b86c6270 2024-09-21T15:20:23.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.453+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:20:23.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.453+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:20:23.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.453+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90116c0 2024-09-21T15:20:23.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.453+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1e10 2024-09-21T15:20:23.457 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.453+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:20:23.457 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.453+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:20:23.457 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.453+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3380 2024-09-21T15:20:23.460 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.457+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:20:23.460 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.457+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e6c30 2024-09-21T15:20:23.460 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.457+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e76c0 2024-09-21T15:20:23.460 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.457+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:20:23.460 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.457+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72f380 2024-09-21T15:20:23.460 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.457+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:20:23.460 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.457+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fe10 2024-09-21T15:20:23.460 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.457+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915860 2024-09-21T15:20:23.460 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.457+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6270 2024-09-21T15:20:23.461 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:23.457+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:20:24.331 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:24.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:24.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone18 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:24.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:24.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:24.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone18 2024-09-21T15:20:24.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:24.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:25.331 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:25.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:25.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone19 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:25.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:25.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:25.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone19 2024-09-21T15:20:25.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:25.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:26.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:26.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:26.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:26.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:26.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:26.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone2 2024-09-21T15:20:26.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:26.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:27.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:27.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:27.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone20 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:27.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:27.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:27.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone20 2024-09-21T15:20:27.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:27.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:27.783 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:27.781+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0000 2024-09-21T15:20:28.334 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.325+0000 7f52f1ba9700 -1 reset not still connected to 0x55713912b2b0 2024-09-21T15:20:28.335 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.325+0000 7f52f1ba9700 -1 reset not still connected to 0x5571393e85b0 2024-09-21T15:20:28.335 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.325+0000 7f52f1ba9700 -1 reset not still connected to 0x55713962d930 2024-09-21T15:20:28.335 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.325+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a49d930 2024-09-21T15:20:28.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:28.346 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.337+0000 7f52f1ba9700 -1 reset not still connected to 0x55713af26000 2024-09-21T15:20:28.346 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.337+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:20:28.351 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.341+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e410 2024-09-21T15:20:28.357 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.349+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61f380 2024-09-21T15:20:28.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:28.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone21 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:28.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:28.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:28.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone21 2024-09-21T15:20:28.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:28.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:28.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.361+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:20:28.374 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b8601a0 2024-09-21T15:20:28.375 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc76410 2024-09-21T15:20:28.375 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc8cb60 2024-09-21T15:20:28.375 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c10d110 2024-09-21T15:20:28.375 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c155860 2024-09-21T15:20:28.375 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c213860 2024-09-21T15:20:28.375 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf0d860 2024-09-21T15:20:28.375 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf7c5b0 2024-09-21T15:20:28.375 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cfa7040 2024-09-21T15:20:28.375 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713d8225b0 2024-09-21T15:20:28.375 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ad0 2024-09-21T15:20:28.375 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ba0 2024-09-21T15:20:28.375 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae11e0 2024-09-21T15:20:28.376 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:20:28.376 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.369+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:20:28.376 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.373+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df812b0 2024-09-21T15:20:28.385 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.377+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81930 2024-09-21T15:20:28.386 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.377+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81ba0 2024-09-21T15:20:28.395 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.385+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df9be10 2024-09-21T15:20:28.395 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.385+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e0ea8f0 2024-09-21T15:20:28.395 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.385+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:20:28.395 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.385+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e115040 2024-09-21T15:20:28.395 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.385+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e7ea270 2024-09-21T15:20:28.395 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.385+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:20:28.414 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.405+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4340 2024-09-21T15:20:28.418 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.409+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4410 2024-09-21T15:20:28.418 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.409+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e49c0 2024-09-21T15:20:28.418 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.409+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4c30 2024-09-21T15:20:28.422 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.417+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4f70 2024-09-21T15:20:28.422 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.417+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e51e0 2024-09-21T15:20:28.422 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.417+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5860 2024-09-21T15:20:28.437 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.425+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ba0 2024-09-21T15:20:28.437 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.425+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5c70 2024-09-21T15:20:28.437 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.425+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ee0 2024-09-21T15:20:28.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.425+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:20:28.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.425+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb24c30 2024-09-21T15:20:28.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.425+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:20:28.442 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.437+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25790 2024-09-21T15:20:28.443 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.437+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fdd61a0 2024-09-21T15:20:28.443 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.437+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c270 2024-09-21T15:20:28.443 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.437+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:20:28.443 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.437+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c9c0 2024-09-21T15:20:28.449 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.445+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cb60 2024-09-21T15:20:28.449 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.445+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cd00 2024-09-21T15:20:28.449 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.445+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dee0 2024-09-21T15:20:28.449 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.445+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed01a0 2024-09-21T15:20:28.449 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.445+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed0ea0 2024-09-21T15:20:28.449 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.445+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f4820 2024-09-21T15:20:28.449 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.445+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f5110 2024-09-21T15:20:28.449 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.445+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f55f0 2024-09-21T15:20:28.449 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.445+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:20:28.449 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.445+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1110 2024-09-21T15:20:28.463 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.453+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1e10 2024-09-21T15:20:28.465 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.457+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16000 2024-09-21T15:20:28.466 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.457+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:20:28.466 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.457+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16b60 2024-09-21T15:20:28.466 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.457+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17040 2024-09-21T15:20:28.467 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.457+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb0000 2024-09-21T15:20:28.468 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.457+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb08f0 2024-09-21T15:20:28.468 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.457+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb1c70 2024-09-21T15:20:28.468 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.457+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:20:28.468 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.457+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:20:28.468 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.457+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:20:28.468 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.457+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb110 2024-09-21T15:20:28.468 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.461+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb2b0 2024-09-21T15:20:28.468 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:20:28.468 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:20:28.469 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:20:28.469 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0f70 2024-09-21T15:20:28.469 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef12b0 2024-09-21T15:20:28.469 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef1a00 2024-09-21T15:20:28.469 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a0d0 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232aea0 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b860 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557142629ba0 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557142d01110 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8000 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8340 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8d00 2024-09-21T15:20:28.470 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:20:28.471 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:20:28.471 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.465+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9450 2024-09-21T15:20:28.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb95f0 2024-09-21T15:20:28.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:20:28.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9930 2024-09-21T15:20:28.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9c70 2024-09-21T15:20:28.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:20:28.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:20:28.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55714346a340 2024-09-21T15:20:28.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55714346b930 2024-09-21T15:20:28.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417b520 2024-09-21T15:20:28.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cdd0 2024-09-21T15:20:28.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cea0 2024-09-21T15:20:28.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456d450 2024-09-21T15:20:28.477 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456de10 2024-09-21T15:20:28.477 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x5571456a2000 2024-09-21T15:20:28.477 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f6c0 2024-09-21T15:20:28.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765d40 2024-09-21T15:20:28.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x557147226680 2024-09-21T15:20:28.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x557147227c70 2024-09-21T15:20:28.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x557147227e10 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x5571479ab040 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x5571479ab6c0 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x5571480009c0 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012270 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x5571480135f0 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713912a820 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713912b2b0 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x5571393e85b0 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x5571393e8820 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x5571393e8c30 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713962d930 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a397d40 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a49d930 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ad1eb60 2024-09-21T15:20:28.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ad1fa00 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713af26000 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e410 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61f380 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b8601a0 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc76410 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc8cb60 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c10d110 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.469+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c155860 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c213860 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf0d860 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf7c5b0 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cfa7040 2024-09-21T15:20:28.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713d8225b0 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713d823ee0 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ad0 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ba0 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae11e0 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81040 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df812b0 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81930 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81ba0 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df9be10 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e0ea8f0 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e115040 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e7ea270 2024-09-21T15:20:28.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4340 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4410 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e49c0 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4c30 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4f70 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e51e0 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5860 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ba0 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5c70 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ee0 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb24c30 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:20:28.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25790 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fdd61a0 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c270 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c9c0 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cb60 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cd00 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dee0 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed01a0 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed0ea0 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f4820 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f5110 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f55f0 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1110 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1e10 2024-09-21T15:20:28.483 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16000 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17040 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb0000 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb08f0 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb1c70 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb110 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb2b0 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0f70 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef12b0 2024-09-21T15:20:28.484 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef1a00 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a0d0 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232aea0 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b860 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142629ba0 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142d01110 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8000 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8340 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8d00 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:20:28.485 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9450 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb95f0 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9930 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9c70 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714346b930 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417b520 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cdd0 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cea0 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456de10 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765d40 2024-09-21T15:20:28.486 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557147227e10 2024-09-21T15:20:28.487 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x5571480009c0 2024-09-21T15:20:28.487 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012270 2024-09-21T15:20:28.487 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:20:28.473+0000 7f52f1ba9700 -1 reset not still connected to 0x5571480135f0 2024-09-21T15:20:29.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:29.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:29.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone22 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:29.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:29.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:29.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone22 2024-09-21T15:20:29.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:29.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:30.369 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:30.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:30.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone23 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:30.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:30.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:30.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone23 2024-09-21T15:20:30.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:30.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:31.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:31.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:31.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone24 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:31.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:31.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:31.407 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone24 2024-09-21T15:20:31.407 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:31.407 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:32.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:32.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:32.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone25 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:32.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:32.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:32.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone25 2024-09-21T15:20:32.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:32.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:33.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:33.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:33.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone26 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:33.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:33.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:33.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone26 2024-09-21T15:20:33.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:33.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:33.439 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.436+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:20:33.466 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x560169400dd0 2024-09-21T15:20:33.466 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:20:33.466 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:20:33.466 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:20:33.466 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:20:33.466 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:20:33.466 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:20:33.466 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:20:33.466 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:20:33.466 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:20:33.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:20:33.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:20:33.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:20:33.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:20:33.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:20:33.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:20:33.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:20:33.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:20:33.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:20:33.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:20:33.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:20:33.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:20:33.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:20:33.469 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:20:33.469 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:20:33.469 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:20:33.469 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:20:33.469 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:20:33.469 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:20:33.470 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:20:33.470 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:20:33.470 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:20:33.470 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:20:33.470 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:20:33.470 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:20:33.470 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:20:33.470 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:20:33.470 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:33.460+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:20:33.525 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb184e0 2024-09-21T15:20:33.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb192b0 2024-09-21T15:20:33.534 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:20:33.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:20:33.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:20:33.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:20:33.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:20:33.577 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f930 2024-09-21T15:20:33.577 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:20:33.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4c8f0 2024-09-21T15:20:33.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:20:33.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:20:33.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:20:33.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049ee0 2024-09-21T15:20:33.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b10d1a00 2024-09-21T15:20:33.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:20:33.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:20:33.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6b60 2024-09-21T15:20:33.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:20:33.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:20:33.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:20:33.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1040 2024-09-21T15:20:33.599 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.592+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:20:33.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.596+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266d6c0 2024-09-21T15:20:33.612 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.600+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fa8f0 2024-09-21T15:20:33.612 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.600+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fbad0 2024-09-21T15:20:33.612 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.600+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b28585b0 2024-09-21T15:20:33.612 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.600+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50270 2024-09-21T15:20:33.613 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.600+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50410 2024-09-21T15:20:33.613 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.604+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f504e0 2024-09-21T15:20:33.614 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.604+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50750 2024-09-21T15:20:33.614 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.604+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:20:33.614 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.604+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50b60 2024-09-21T15:20:33.614 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.604+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50f70 2024-09-21T15:20:33.616 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f512b0 2024-09-21T15:20:33.616 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:20:33.616 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:20:33.616 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:20:33.616 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51860 2024-09-21T15:20:33.616 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51930 2024-09-21T15:20:33.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51a00 2024-09-21T15:20:33.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51ad0 2024-09-21T15:20:33.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:20:33.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:20:33.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:20:33.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3100410 2024-09-21T15:20:33.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31004e0 2024-09-21T15:20:33.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.612+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31009c0 2024-09-21T15:20:33.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.612+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:20:33.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.612+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:20:33.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.612+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:20:33.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.612+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:20:33.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.612+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:20:33.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.612+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc410 2024-09-21T15:20:33.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:20:33.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:20:33.624 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd520 2024-09-21T15:20:33.624 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd6c0 2024-09-21T15:20:33.624 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:20:33.624 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:20:33.624 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:20:33.624 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:20:33.624 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b36868f0 2024-09-21T15:20:33.624 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:20:33.624 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810b60 2024-09-21T15:20:33.624 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:20:33.624 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811a00 2024-09-21T15:20:33.624 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:20:33.625 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:20:33.625 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45de340 2024-09-21T15:20:33.625 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:20:33.625 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45df860 2024-09-21T15:20:33.625 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76000 2024-09-21T15:20:33.625 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:20:33.625 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76410 2024-09-21T15:20:33.625 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76d00 2024-09-21T15:20:33.625 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:20:33.625 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:20:33.626 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd2ea0 2024-09-21T15:20:33.626 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:20:33.626 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:20:33.626 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:20:33.626 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:20:33.626 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:20:33.626 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:20:33.626 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:20:33.626 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:20:33.626 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:20:33.627 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:20:33.627 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:20:33.627 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:20:33.627 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:20:33.627 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:20:33.627 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:20:33.627 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:20:33.627 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:20:33.627 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:20:33.627 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:20:33.627 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:20:33.627 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eab60 2024-09-21T15:20:33.628 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:20:33.628 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:20:33.628 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:20:33.628 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d85b0 2024-09-21T15:20:33.628 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:20:33.628 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:20:33.628 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:20:33.628 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:20:33.628 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.616+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:20:33.630 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:20:33.630 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:20:33.630 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782410 2024-09-21T15:20:33.630 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:20:33.630 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:20:33.630 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782820 2024-09-21T15:20:33.630 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782a90 2024-09-21T15:20:33.630 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782d00 2024-09-21T15:20:33.631 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:20:33.631 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783040 2024-09-21T15:20:33.631 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:20:33.631 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:20:33.631 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783380 2024-09-21T15:20:33.631 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:20:33.631 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783520 2024-09-21T15:20:33.631 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:20:33.631 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:20:33.631 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:20:33.631 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783e10 2024-09-21T15:20:33.631 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b86c6270 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90116c0 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1e10 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:20:33.632 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3380 2024-09-21T15:20:33.633 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:20:33.633 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e6c30 2024-09-21T15:20:33.633 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:20:33.633 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72f380 2024-09-21T15:20:33.633 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:20:33.633 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fe10 2024-09-21T15:20:33.633 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915860 2024-09-21T15:20:33.633 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:33.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6270 2024-09-21T15:20:34.392 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:34.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:34.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone27 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:34.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:34.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:34.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone27 2024-09-21T15:20:34.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:34.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:35.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:35.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:35.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone28 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:35.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:35.438 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:35.438 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone28 2024-09-21T15:20:35.438 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:35.438 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:36.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:36.498 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:36.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone29 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:36.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:36.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:36.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone29 2024-09-21T15:20:36.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:36.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:37.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:37.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:37.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:37.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:37.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:37.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone3 2024-09-21T15:20:37.438 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:37.438 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:38.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:38.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:38.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone30 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:38.452 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:38.452 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:38.452 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone30 2024-09-21T15:20:38.452 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:38.452 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:39.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:39.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:39.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone31 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:39.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:39.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:39.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone31 2024-09-21T15:20:39.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:39.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:40.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:40.448 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:40.448 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone32 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:40.448 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:40.448 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:40.448 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone32 2024-09-21T15:20:40.448 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:40.448 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:40.695 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.692+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:20:40.695 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.692+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:20:40.736 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.732+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:20:40.736 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.732+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3380 2024-09-21T15:20:40.736 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.732+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:20:40.736 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.732+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e6c30 2024-09-21T15:20:40.736 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.732+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e76c0 2024-09-21T15:20:40.736 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.732+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:20:40.736 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.732+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72f380 2024-09-21T15:20:40.736 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.732+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:20:40.736 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.732+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fe10 2024-09-21T15:20:40.736 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.732+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915860 2024-09-21T15:20:40.736 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.732+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6270 2024-09-21T15:20:40.736 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:20:40.732+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:20:41.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:41.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:41.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone33 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:41.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:41.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:41.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone33 2024-09-21T15:20:41.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:41.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:42.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:42.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:42.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone34 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:42.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:42.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:42.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone34 2024-09-21T15:20:42.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:42.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:43.285 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.279+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:20:43.285 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.279+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:20:43.298 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.291+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:20:43.298 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.291+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:20:43.298 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.291+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:20:43.298 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.291+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:20:43.298 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.291+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:20:43.298 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.291+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c24e0 2024-09-21T15:20:43.303 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.299+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:20:43.303 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.299+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9e10 2024-09-21T15:20:43.315 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.307+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:20:43.316 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.307+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:20:43.316 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.307+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:20:43.316 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.307+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:20:43.316 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.307+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:20:43.316 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:20:43.311+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:20:43.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:43.496 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:43.496 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone35 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:43.497 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:43.497 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:43.497 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone35 2024-09-21T15:20:43.497 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:43.497 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:44.478 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:44.504 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:44.505 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone36 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:44.505 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:44.505 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:44.505 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone36 2024-09-21T15:20:44.505 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:44.505 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:45.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:45.513 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:45.513 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone37 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:45.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:45.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:45.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone37 2024-09-21T15:20:45.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:45.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:46.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:46.515 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:46.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone38 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:46.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:46.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:46.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone38 2024-09-21T15:20:46.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:46.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:47.498 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:47.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:47.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone39 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:47.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:47.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:47.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone39 2024-09-21T15:20:47.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:47.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:48.332 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.328+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:20:48.341 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.332+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:20:48.351 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.344+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:20:48.367 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.364+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:20:48.374 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.368+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:20:48.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.368+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba4e0 2024-09-21T15:20:48.376 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.368+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:20:48.379 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.376+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:20:48.381 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.376+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbbd40 2024-09-21T15:20:48.382 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.376+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc60d0 2024-09-21T15:20:48.382 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.376+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:20:48.389 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.384+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:20:48.389 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.384+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:20:48.390 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.384+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:20:48.390 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.384+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e340 2024-09-21T15:20:48.390 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.384+0000 7ff753f07700 -1 reset not still connected to 0x56016d985ba0 2024-09-21T15:20:48.390 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.384+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:20:48.394 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.388+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:20:48.394 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.388+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:20:48.394 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.388+0000 7ff753f07700 -1 reset not still connected to 0x56016e36eb60 2024-09-21T15:20:48.394 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.388+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:20:48.394 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.388+0000 7ff753f07700 -1 reset not still connected to 0x56016e36fc70 2024-09-21T15:20:48.394 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.388+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a2820 2024-09-21T15:20:48.395 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.388+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:20:48.400 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.396+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:20:48.400 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.396+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d20d0 2024-09-21T15:20:48.400 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.396+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2410 2024-09-21T15:20:48.400 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.396+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d29c0 2024-09-21T15:20:48.401 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.396+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:20:48.401 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.396+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:20:48.401 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.396+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d31e0 2024-09-21T15:20:48.401 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.396+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:20:48.401 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.396+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3790 2024-09-21T15:20:48.401 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.396+0000 7ff753f07700 -1 reset not still connected to 0x56016f162000 2024-09-21T15:20:48.401 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.396+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:20:48.403 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:20:48.403 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:20:48.403 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:20:48.403 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f1629c0 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f162b60 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:20:48.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:20:48.405 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:20:48.405 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:20:48.405 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3450 2024-09-21T15:20:48.406 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:20:48.406 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:20:48.406 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:20:48.406 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:20:48.406 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:20:48.406 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99d40 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd8000 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017063fee0 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:20:48.407 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9930 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ad0 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9e10 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017157c5b0 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:20:48.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560171d00c30 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560171d01040 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560171d01110 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560171f05ee0 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:20:48.409 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:20:48.410 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:20:48.410 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:20:48.410 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:20:48.410 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2b60 2024-09-21T15:20:48.410 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:20:48.410 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:20:48.410 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:20:48.410 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7d40 2024-09-21T15:20:48.410 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017529a000 2024-09-21T15:20:48.410 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x56017529a4e0 2024-09-21T15:20:48.410 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1d40 2024-09-21T15:20:48.410 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.400+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc750 2024-09-21T15:20:48.411 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:20:48.404+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccdd0 2024-09-21T15:20:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:48.528 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:48.528 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:48.528 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:48.528 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:48.528 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone4 2024-09-21T15:20:48.528 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:48.528 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:49.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:49.538 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:49.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone40 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:49.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:49.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:49.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone40 2024-09-21T15:20:49.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:49.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:50.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:50.549 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:50.549 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:50.549 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:50.549 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:50.550 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone5 2024-09-21T15:20:50.550 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:50.550 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:51.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:51.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:51.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone6 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:51.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:51.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:51.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone6 2024-09-21T15:20:51.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:51.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:52.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:52.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:52.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone7 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:52.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:52.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:52.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone7 2024-09-21T15:20:52.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:52.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:53.670 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:53.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:53.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone8 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:53.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:53.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:53.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone8 2024-09-21T15:20:53.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:53.695 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:54.675 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:54.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:54.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ create_snapshot cluster1 mirror image_cluster1.client.mirror.5-clone9 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:54.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:20:54.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:54.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone9 2024-09-21T15:20:54.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:54.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 snap create mirror/image_cluster1.client.mirror.5-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:55.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-21T15:20:55.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ testlog 'TEST: wait for snapshots' 2024-09-21T15:20:55.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ tee -a /tmp/tmp.ZUZ2ADv8z3/rbd-mirror.test.log 2024-09-21T15:20:55.712 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ date '+%F %T' 2024-09-21T15:20:55.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ echo 2024-09-21 15:20:55 TEST: wait for snapshots 2024-09-21T15:20:55.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:2024-09-21 15:20:55 TEST: wait for snapshots 2024-09-21T15:20:55.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --pool mirror ls 2024-09-21T15:20:55.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:55.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:55.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:20:55.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:55.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0 2024-09-21T15:20:55.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:55.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:20:55.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:20:55.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:20:56.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0': 2024-09-21T15:20:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 58 MiB in 15 objects 2024-09-21T15:20:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:20:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:20:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9a0f30a42 2024-09-21T15:20:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9a0f30a42 2024-09-21T15:20:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:20:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:20:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:20:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:20:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:20:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:20:56.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:20:56.834 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:20:56.834 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9a0f30a42 2024-09-21T15:20:56.834 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:20:56.834 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:20:56.834 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 61e40bd2-a6f8-4810-904b-d9763ddf6fd0 2024-09-21T15:20:56.834 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:20:56.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:20:56.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:56.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:56.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:20:56.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:56.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone1 2024-09-21T15:20:56.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:56.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:20:56.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:20:56.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:20:57.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:57.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone1': 2024-09-21T15:20:57.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 14 MiB in 8 objects 2024-09-21T15:20:57.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:20:57.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:20:57.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b95fb3949 2024-09-21T15:20:57.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b95fb3949 2024-09-21T15:20:57.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:20:57.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:20:57.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:20:57.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:20:57.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:20:57.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:20:57.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:20:57.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:20:57.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 MiB 2024-09-21T15:20:57.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:20:57.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b95fb3949 2024-09-21T15:20:57.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:20:57.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:20:57.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: e4a35a0f-eabb-4389-9239-82ff9a0828e6 2024-09-21T15:20:57.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:20:57.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:20:57.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:57.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone10 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:57.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:20:57.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:57.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone10 2024-09-21T15:20:57.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:57.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:20:57.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:20:57.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:20:58.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:58.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone10': 2024-09-21T15:20:58.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 2.6 MiB in 8 objects 2024-09-21T15:20:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:20:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:20:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9dafe4d60 2024-09-21T15:20:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9dafe4d60 2024-09-21T15:20:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:20:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:20:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:20:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:20:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:20:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:20:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:20:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:20:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone9@snap 2024-09-21T15:20:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 2.6 MiB 2024-09-21T15:20:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:20:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:20:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9dafe4d60 2024-09-21T15:20:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:20:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:20:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: c2f4442b-fb50-43c3-b857-324706ebb952 2024-09-21T15:20:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:20:59.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:20:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:20:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone11 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:20:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:20:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone11 2024-09-21T15:20:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:20:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:20:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:20:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:00.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:00.099 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone11': 2024-09-21T15:21:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 36 MiB in 5 objects 2024-09-21T15:21:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:21:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b91ac5ea39 2024-09-21T15:21:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b91ac5ea39 2024-09-21T15:21:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:21:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:21:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:21:00.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:00.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone10@snap 2024-09-21T15:21:00.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 36 MiB 2024-09-21T15:21:00.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 MiB 2024-09-21T15:21:00.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:21:00.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b91ac5ea39 2024-09-21T15:21:00.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:00.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:00.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: cb421ca2-8e98-43a7-b278-4fac682f0a47 2024-09-21T15:21:00.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:00.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:00.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:00.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone12 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:00.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:00.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:00.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone12 2024-09-21T15:21:00.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:00.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:00.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:00.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:01.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:01.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone12': 2024-09-21T15:21:01.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 28 MiB in 8 objects 2024-09-21T15:21:01.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:21:01.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:01.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b964301fc7 2024-09-21T15:21:01.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b964301fc7 2024-09-21T15:21:01.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:01.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:01.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:01.241 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:01.241 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:21:01.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:21:01.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:21:01.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:01.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone11@snap 2024-09-21T15:21:01.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 28 MiB 2024-09-21T15:21:01.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 MiB 2024-09-21T15:21:01.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:21:01.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b964301fc7 2024-09-21T15:21:01.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:01.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:01.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 8b7051b8-a921-4443-bbf8-fd20e9cbcef1 2024-09-21T15:21:01.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:01.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:01.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:01.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone13 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:01.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:01.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:01.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone13 2024-09-21T15:21:01.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:01.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:01.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:01.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:02.247 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:02.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone13': 2024-09-21T15:21:02.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 162 MiB in 42 objects 2024-09-21T15:21:02.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:21:02.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:02.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9526ad05c 2024-09-21T15:21:02.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9526ad05c 2024-09-21T15:21:02.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:02.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:02.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:02.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:02.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:21:02.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:21:02.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:21:02.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:02.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:21:02.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:21:02.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9526ad05c 2024-09-21T15:21:02.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:02.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:02.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 637122ca-60c4-4992-9f94-ae01ebaccd0e 2024-09-21T15:21:02.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:02.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:02.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:02.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone14 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:02.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:02.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:02.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone14 2024-09-21T15:21:02.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:02.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:02.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:02.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:03.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:03.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone14': 2024-09-21T15:21:03.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 234 MiB in 39 objects 2024-09-21T15:21:03.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:21:03.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:03.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b999505d71 2024-09-21T15:21:03.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b999505d71 2024-09-21T15:21:03.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:03.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:03.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:03.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:03.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:26 2024 2024-09-21T15:21:03.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:26 2024 2024-09-21T15:21:03.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:26 2024 2024-09-21T15:21:03.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:03.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:21:03.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:21:03.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b999505d71 2024-09-21T15:21:03.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:03.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:03.391 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 03d84ea6-9ad5-4a5d-beec-ecb0055acb54 2024-09-21T15:21:03.391 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:03.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:03.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:03.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone15 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:03.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:03.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:03.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone15 2024-09-21T15:21:03.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:03.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:03.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:03.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:04.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:04.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone15': 2024-09-21T15:21:04.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 125 MiB in 507 objects 2024-09-21T15:21:04.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:21:04.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:04.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b92582e95f 2024-09-21T15:21:04.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b92582e95f 2024-09-21T15:21:04.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:31 2024 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:31 2024 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:31 2024 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b92582e95f 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 5e8b4579-81b1-4cbb-a0ef-7f96494cfc61 2024-09-21T15:21:04.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:04.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:04.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:04.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone16 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:04.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:04.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:04.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone16 2024-09-21T15:21:04.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:04.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:04.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:04.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:05.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:05.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone16': 2024-09-21T15:21:05.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 44 MiB in 12 objects 2024-09-21T15:21:05.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:21:05.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:05.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b994f6b143 2024-09-21T15:21:05.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b994f6b143 2024-09-21T15:21:05.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:05.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:05.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:05.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:05.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:21:05.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:21:05.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:21:05.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:05.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone15@snap 2024-09-21T15:21:05.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 44 MiB 2024-09-21T15:21:05.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:21:05.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:21:05.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b994f6b143 2024-09-21T15:21:05.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:05.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:05.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: ef79be89-94fa-4d0c-a9a8-2fd05127bdc5 2024-09-21T15:21:05.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:05.559 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:05.559 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:05.559 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone17 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:05.559 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:05.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:05.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone17 2024-09-21T15:21:05.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:05.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:05.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:05.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:06.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:06.654 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone17': 2024-09-21T15:21:06.654 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 95 MiB in 6 objects 2024-09-21T15:21:06.654 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:21:06.654 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:06.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9ebc4f6ef 2024-09-21T15:21:06.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9ebc4f6ef 2024-09-21T15:21:06.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:06.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:06.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:06.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:06.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:06.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:06.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:06.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone16@snap 2024-09-21T15:21:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 1.3 MiB 2024-09-21T15:21:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:21:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:21:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9ebc4f6ef 2024-09-21T15:21:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: dc874683-1fb8-422d-a7dc-6396041ed697 2024-09-21T15:21:06.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:06.662 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone18 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone18 2024-09-21T15:21:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:07.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:07.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone18': 2024-09-21T15:21:07.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 95 MiB in 390 objects 2024-09-21T15:21:07.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:21:07.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:07.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9687b7bc2 2024-09-21T15:21:07.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9687b7bc2 2024-09-21T15:21:07.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:07.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:07.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:07.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:07.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:21:07.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:21:07.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:21:07.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone17@snap 2024-09-21T15:21:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 95 MiB 2024-09-21T15:21:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:21:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:21:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9687b7bc2 2024-09-21T15:21:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: baa504ab-cf1a-43bc-8e31-d24f1f4d3107 2024-09-21T15:21:07.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:07.781 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:07.781 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:07.781 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone19 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:07.781 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:07.781 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:07.781 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone19 2024-09-21T15:21:07.781 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:07.782 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:07.782 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:07.782 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:08.424 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.412+0000 7f52f1ba9700 -1 reset not still connected to 0x55713912b2b0 2024-09-21T15:21:08.441 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.436+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a397d40 2024-09-21T15:21:08.441 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.436+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a49d930 2024-09-21T15:21:08.456 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.444+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:21:08.456 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.444+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e410 2024-09-21T15:21:08.457 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.452+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:21:08.466 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.456+0000 7f52f1ba9700 -1 reset not still connected to 0x55713bc8cb60 2024-09-21T15:21:08.471 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c10d110 2024-09-21T15:21:08.471 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c155860 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf0d860 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf7c5b0 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ad0 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81930 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e115040 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e7ea270 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4340 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e51e0 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5860 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5c70 2024-09-21T15:21:08.472 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb24c30 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fdd61a0 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed0ea0 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb0000 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb2b0 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:21:08.473 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:21:08.474 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:21:08.474 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8340 2024-09-21T15:21:08.474 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:21:08.474 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:21:08.474 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:21:08.474 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:21:08.474 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:21:08.474 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:08.464+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:21:08.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:08.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone19': 2024-09-21T15:21:08.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 4.9 MiB in 3 objects 2024-09-21T15:21:08.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:21:08.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4e12a6113 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4e12a6113 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:23 2024 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:23 2024 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:23 2024 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone18@snap 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 4.9 MiB 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 MiB 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:21:08.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4e12a6113 2024-09-21T15:21:08.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:08.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:08.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: bc85cdde-3180-4a2f-9b73-da5029177042 2024-09-21T15:21:08.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:08.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:08.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:08.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:08.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:08.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:08.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone2 2024-09-21T15:21:08.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:08.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:08.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:08.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:09.922 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:09.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone2': 2024-09-21T15:21:09.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 2.0 MiB in 11 objects 2024-09-21T15:21:09.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:21:09.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:09.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b94de2e2cf 2024-09-21T15:21:09.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b94de2e2cf 2024-09-21T15:21:09.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:09.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:09.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:09.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:09.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:21:09.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:21:09.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:21:09.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:09.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:21:09.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 6 2024-09-21T15:21:09.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b94de2e2cf 2024-09-21T15:21:09.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:09.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:09.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 107eff09-cb63-4786-8ede-67a702996f4d 2024-09-21T15:21:09.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:09.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:09.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:09.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone20 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:09.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:09.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:09.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone20 2024-09-21T15:21:09.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:09.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:09.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:09.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:10.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:11.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone20': 2024-09-21T15:21:11.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:21:11.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:21:11.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c475fd2a4a 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c475fd2a4a 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:11:29 2024 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:11:29 2024 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:29 2024 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c475fd2a4a 2024-09-21T15:21:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:11.063 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:11.063 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 535b2c9f-8008-4989-b65d-748a5cd23a9b 2024-09-21T15:21:11.063 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone21 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone21 2024-09-21T15:21:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:12.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone21': 2024-09-21T15:21:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 227 MiB in 228 objects 2024-09-21T15:21:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:21:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9a79b357e 2024-09-21T15:21:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9a79b357e 2024-09-21T15:21:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:21:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 6 2024-09-21T15:21:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9a79b357e 2024-09-21T15:21:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: dd99a03b-3e52-424a-92c1-99ecc2e48374 2024-09-21T15:21:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:12.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:12.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:12.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone22 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:12.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:12.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:12.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone22 2024-09-21T15:21:12.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:12.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:12.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:12.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:13.144 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:13.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone22': 2024-09-21T15:21:13.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 43 MiB in 180 objects 2024-09-21T15:21:13.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:21:13.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:13.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b91c25fb9a 2024-09-21T15:21:13.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b91c25fb9a 2024-09-21T15:21:13.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:13.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:13.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:13.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:13.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:13.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:13.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:13.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:13.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone21@snap 2024-09-21T15:21:13.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 43 MiB 2024-09-21T15:21:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:21:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:21:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b91c25fb9a 2024-09-21T15:21:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: e4d1114b-ada5-4ff8-999f-0119c103708f 2024-09-21T15:21:13.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:13.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:13.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:13.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone23 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:13.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:13.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:13.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone23 2024-09-21T15:21:13.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:13.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:13.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:13.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:13.323 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0659c410 2024-09-21T15:21:13.323 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.314+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0659cea0 2024-09-21T15:21:13.333 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.322+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff41a0 2024-09-21T15:21:13.333 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.322+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4680 2024-09-21T15:21:13.339 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.334+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4c30 2024-09-21T15:21:13.339 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.334+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff52b0 2024-09-21T15:21:13.339 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.334+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5d40 2024-09-21T15:21:13.339 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.334+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5ee0 2024-09-21T15:21:13.339 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.334+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0ee7a340 2024-09-21T15:21:13.339 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.334+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0ee7b450 2024-09-21T15:21:13.342 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0ee7b5f0 2024-09-21T15:21:13.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0ee7be10 2024-09-21T15:21:13.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc154580d0 2024-09-21T15:21:13.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc15459450 2024-09-21T15:21:13.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc154595f0 2024-09-21T15:21:13.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546c750 2024-09-21T15:21:13.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546c820 2024-09-21T15:21:13.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546d1e0 2024-09-21T15:21:13.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546d790 2024-09-21T15:21:13.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc157fc000 2024-09-21T15:21:13.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:21:13.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1661a4e0 2024-09-21T15:21:13.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc16e7b5f0 2024-09-21T15:21:13.343 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1753d450 2024-09-21T15:21:13.344 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc192bcd00 2024-09-21T15:21:13.344 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939edd0 2024-09-21T15:21:13.344 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939ef70 2024-09-21T15:21:13.344 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fad0 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fc70 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc19691790 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfce4e0 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfcedd0 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c383040 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf592b0 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3508f0 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3515f0 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3516c0 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822680 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822b60 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e823ad0 2024-09-21T15:21:13.345 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1f299930 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1fdea750 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1fdebd40 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4410 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f51e0 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21708000 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21709ad0 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21712dd0 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc217131e0 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21738c30 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363bd40 2024-09-21T15:21:13.346 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f3450 2024-09-21T15:21:13.347 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc238280d0 2024-09-21T15:21:13.347 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc238285b0 2024-09-21T15:21:13.347 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc23829520 2024-09-21T15:21:13.347 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc23829d40 2024-09-21T15:21:13.347 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24055ad0 2024-09-21T15:21:13.347 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:13.338+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0cf70 2024-09-21T15:21:14.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:14.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone23': 2024-09-21T15:21:14.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 207 MiB in 13 objects 2024-09-21T15:21:14.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:21:14.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9567bebae 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9567bebae 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:05 2024 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:05 2024 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:05 2024 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 MiB 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9567bebae 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:14.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 2356d978-bbcf-4641-a1a5-fa6a827028ca 2024-09-21T15:21:14.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:14.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:14.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:14.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone24 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:14.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:14.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:14.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone24 2024-09-21T15:21:14.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:14.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:14.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:14.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:15.309 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone24': 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 229 MiB in 924 objects 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b92b6a61cf 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b92b6a61cf 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:21:15.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:15.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:21:15.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:21:15.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b92b6a61cf 2024-09-21T15:21:15.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:15.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:15.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 363b13b9-82c8-4420-bc7f-68b6bbdb20b8 2024-09-21T15:21:15.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:15.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:15.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:15.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone25 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:15.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:15.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:15.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone25 2024-09-21T15:21:15.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:15.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:15.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:15.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:16.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:16.449 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone25': 2024-09-21T15:21:16.449 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 104 MiB in 30 objects 2024-09-21T15:21:16.449 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9fe3b5045 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9fe3b5045 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9fe3b5045 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:16.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:16.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: fc9614b7-402a-4ce0-b4f1-439db186e14d 2024-09-21T15:21:16.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:16.454 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:16.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:16.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone26 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:16.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:16.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:16.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone26 2024-09-21T15:21:16.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:16.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:16.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:16.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:17.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:17.538 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone26': 2024-09-21T15:21:17.538 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 41 MiB in 8 objects 2024-09-21T15:21:17.538 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:21:17.538 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:17.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b95a57cfd8 2024-09-21T15:21:17.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b95a57cfd8 2024-09-21T15:21:17.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:17.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:17.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:17.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:17.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:17.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:17.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:17.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:17.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone25@snap 2024-09-21T15:21:17.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 41 MiB 2024-09-21T15:21:17.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:21:17.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:21:17.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b95a57cfd8 2024-09-21T15:21:17.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:17.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:17.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 59c93a57-c7d1-4245-95e1-c3b4a05e2c1a 2024-09-21T15:21:17.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:17.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:17.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:17.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone27 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:17.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:17.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:17.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone27 2024-09-21T15:21:17.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:17.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:17.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:17.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:18.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone27': 2024-09-21T15:21:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 171 MiB in 9 objects 2024-09-21T15:21:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:21:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b92cd3d546 2024-09-21T15:21:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b92cd3d546 2024-09-21T15:21:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:22 2024 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:22 2024 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:22 2024 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b92cd3d546 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: ba4344b7-ecea-46ff-9bcf-47fd00e1ad54 2024-09-21T15:21:18.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:18.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:18.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:18.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone28 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:18.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:18.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:18.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone28 2024-09-21T15:21:18.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:18.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:18.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:18.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:19.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:19.705 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone28': 2024-09-21T15:21:19.705 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 196 KiB in 4 objects 2024-09-21T15:21:19.705 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:21:19.705 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:19.705 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9e7809edc 2024-09-21T15:21:19.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9e7809edc 2024-09-21T15:21:19.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:19.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:19.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:19.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:19.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:19.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:19.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:19.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:19.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone27@snap 2024-09-21T15:21:19.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 196 KiB 2024-09-21T15:21:19.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:21:19.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:21:19.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9e7809edc 2024-09-21T15:21:19.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:19.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:19.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 293432f7-5a81-4489-9831-906269d79354 2024-09-21T15:21:19.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:19.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:19.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:19.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone29 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:19.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:19.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:19.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone29 2024-09-21T15:21:19.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:19.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:19.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:19.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:20.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:20.782 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone29': 2024-09-21T15:21:20.782 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9bbb450b9 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9bbb450b9 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:21:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:21:20.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9bbb450b9 2024-09-21T15:21:20.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:20.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:20.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 125852bb-d5fb-41d4-9c7c-f90dc1e40959 2024-09-21T15:21:20.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:20.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:20.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:20.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:20.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:20.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:20.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone3 2024-09-21T15:21:20.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:20.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:20.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:20.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:21.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:21.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone3': 2024-09-21T15:21:21.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 1.2 MiB in 5 objects 2024-09-21T15:21:21.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:21:21.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:21.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9541ee3fe 2024-09-21T15:21:21.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9541ee3fe 2024-09-21T15:21:21.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:21.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:21.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:21.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:21.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:21:21.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:21:21.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:21:21.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:21.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone2@snap 2024-09-21T15:21:21.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 1.2 MiB 2024-09-21T15:21:21.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:21:21.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:21:21.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9541ee3fe 2024-09-21T15:21:21.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:21.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:21.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: af7bb590-faa2-4f57-80f6-c5ab02216567 2024-09-21T15:21:21.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:21.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:21.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:21.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone30 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:21.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:21.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:21.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone30 2024-09-21T15:21:21.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:21.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:21.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:21.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:22.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:22.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone30': 2024-09-21T15:21:22.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 85 MiB in 12 objects 2024-09-21T15:21:22.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:21:22.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:22.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c445de2050 2024-09-21T15:21:22.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c445de2050 2024-09-21T15:21:22.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:22.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:22.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:22.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:22.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:21:22.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:21:22.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:21:22.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:22.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone29@snap 2024-09-21T15:21:22.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 85 MiB 2024-09-21T15:21:22.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:21:22.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:21:22.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c445de2050 2024-09-21T15:21:22.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:22.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:22.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 7da6e340-1c90-4fa6-9dff-abf5cab1d562 2024-09-21T15:21:22.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:22.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:22.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:22.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone31 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:22.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:22.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:22.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone31 2024-09-21T15:21:22.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:22.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:22.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:22.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:23.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:23.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb9930 2024-09-21T15:21:23.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:23.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:21:23.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:23.338+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:21:23.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:23.346+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:21:23.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:23.346+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:21:23.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:23.346+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:21:23.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:23.346+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:21:23.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:23.346+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:21:23.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:23.346+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:21:23.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:23.346+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:21:23.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:23.346+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:21:23.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:23.346+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:21:23.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:24.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone31': 2024-09-21T15:21:24.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:21:24.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:21:24.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:24.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c44d859255 2024-09-21T15:21:24.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c44d859255 2024-09-21T15:21:24.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:24.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:24.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:24.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:24.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:21:24.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:21:24.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:21:24.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:24.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:21:24.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 6 2024-09-21T15:21:24.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c44d859255 2024-09-21T15:21:24.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:24.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:24.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: bfe08582-8db2-46ec-bf28-30b92617af81 2024-09-21T15:21:24.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone32 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone32 2024-09-21T15:21:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:24.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:25.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:25.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone32': 2024-09-21T15:21:25.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 227 MiB in 120 objects 2024-09-21T15:21:25.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:21:25.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:25.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9acc266ef 2024-09-21T15:21:25.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9acc266ef 2024-09-21T15:21:25.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:25.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:25.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:25.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:25.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:25.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:25.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:25.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:25.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:21:25.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:21:25.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9acc266ef 2024-09-21T15:21:25.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:25.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:25.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b0925bf1-5012-45a2-afe9-91608ced3c6a 2024-09-21T15:21:25.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:25.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:25.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:25.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone33 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:25.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:25.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:25.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone33 2024-09-21T15:21:25.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:25.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:25.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:25.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:26.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:26.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone33': 2024-09-21T15:21:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 3.4 MiB in 8 objects 2024-09-21T15:21:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:21:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c494afa71c 2024-09-21T15:21:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c494afa71c 2024-09-21T15:21:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:21:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:21:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:21:26.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:26.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone32@snap 2024-09-21T15:21:26.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 3.4 MiB 2024-09-21T15:21:26.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:21:26.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:21:26.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c494afa71c 2024-09-21T15:21:26.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:26.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:26.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 365611e2-1ad6-4f54-9c58-bf966f5928e7 2024-09-21T15:21:26.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:26.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:26.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:26.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone34 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:26.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:26.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:26.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone34 2024-09-21T15:21:26.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:26.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:26.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:26.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:27.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:27.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone34': 2024-09-21T15:21:27.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 227 MiB in 24 objects 2024-09-21T15:21:27.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:21:27.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:27.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4e749b83c 2024-09-21T15:21:27.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4e749b83c 2024-09-21T15:21:27.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:27.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:27.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:27.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:27.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:29 2024 2024-09-21T15:21:27.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:29 2024 2024-09-21T15:21:27.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:29 2024 2024-09-21T15:21:27.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:27.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone33@snap 2024-09-21T15:21:27.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 27 MiB 2024-09-21T15:21:27.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:21:27.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:21:27.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4e749b83c 2024-09-21T15:21:27.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:27.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:27.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 347ff7bb-17b6-437e-9043-ee0191f8394d 2024-09-21T15:21:27.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone35 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone35 2024-09-21T15:21:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:27.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:28.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:28.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.511+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25bba0 2024-09-21T15:21:28.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.511+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:21:28.530 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.523+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:21:28.534 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.523+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:21:28.534 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.527+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b61e1a0 2024-09-21T15:21:28.535 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.527+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b7a5110 2024-09-21T15:21:28.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.523+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:21:28.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.523+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:21:28.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.523+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:21:28.539 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.527+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:21:28.539 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.535+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf0d860 2024-09-21T15:21:28.539 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.535+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf7c5b0 2024-09-21T15:21:28.542 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.535+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ad0 2024-09-21T15:21:28.542 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.535+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae11e0 2024-09-21T15:21:28.557 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.551+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae1e10 2024-09-21T15:21:28.557 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.551+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df80ea0 2024-09-21T15:21:28.557 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.551+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df812b0 2024-09-21T15:21:28.558 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.551+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81930 2024-09-21T15:21:28.559 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.555+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e114000 2024-09-21T15:21:28.559 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.555+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e7ea270 2024-09-21T15:21:28.559 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.555+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:21:28.559 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.555+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4340 2024-09-21T15:21:28.565 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.555+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e49c0 2024-09-21T15:21:28.569 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.559+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4f70 2024-09-21T15:21:28.570 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.563+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e51e0 2024-09-21T15:21:28.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:21:28.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:21:28.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:21:28.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:21:28.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:21:28.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:21:28.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c9c0 2024-09-21T15:21:28.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:21:28.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:21:28.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:21:28.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:21:28.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51930 2024-09-21T15:21:28.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:21:28.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31009c0 2024-09-21T15:21:28.574 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.567+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5860 2024-09-21T15:21:28.575 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.567+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ba0 2024-09-21T15:21:28.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:21:28.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:21:28.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:21:28.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:21:28.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:21:28.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:21:28.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:21:28.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:21:28.577 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:21:28.577 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:21:28.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:21:28.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:21:28.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:21:28.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:21:28.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:21:28.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:21:28.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:21:28.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:21:28.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:21:28.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:21:28.584 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.579+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5c70 2024-09-21T15:21:28.585 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.579+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5ee0 2024-09-21T15:21:28.585 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.579+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:21:28.585 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.579+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb24c30 2024-09-21T15:21:28.585 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.579+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:21:28.591 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fdd61a0 2024-09-21T15:21:28.591 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:21:28.591 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c9c0 2024-09-21T15:21:28.591 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cb60 2024-09-21T15:21:28.591 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dee0 2024-09-21T15:21:28.591 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed01a0 2024-09-21T15:21:28.591 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed0ea0 2024-09-21T15:21:28.591 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f4820 2024-09-21T15:21:28.591 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f55f0 2024-09-21T15:21:28.592 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0000 2024-09-21T15:21:28.592 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1110 2024-09-21T15:21:28.592 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d1e10 2024-09-21T15:21:28.593 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16000 2024-09-21T15:21:28.593 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:21:28.593 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16b60 2024-09-21T15:21:28.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:21:28.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:21:28.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:21:28.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:21:28.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:28.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:21:28.596 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17040 2024-09-21T15:21:28.596 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17a00 2024-09-21T15:21:28.596 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb0000 2024-09-21T15:21:28.596 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb1c70 2024-09-21T15:21:28.597 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba4e0 2024-09-21T15:21:28.597 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:21:28.597 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbaf70 2024-09-21T15:21:28.597 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb2b0 2024-09-21T15:21:28.599 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:21:28.599 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:21:28.600 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbee0 2024-09-21T15:21:28.600 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0f70 2024-09-21T15:21:28.600 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef12b0 2024-09-21T15:21:28.600 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232aea0 2024-09-21T15:21:28.600 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:21:28.600 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.591+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b860 2024-09-21T15:21:28.600 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:21:28.600 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x557142629ba0 2024-09-21T15:21:28.601 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x557142d01110 2024-09-21T15:21:28.601 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8000 2024-09-21T15:21:28.601 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:21:28.601 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8340 2024-09-21T15:21:28.601 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:21:28.601 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:21:28.601 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:21:28.601 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8b60 2024-09-21T15:21:28.601 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8d00 2024-09-21T15:21:28.601 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb92b0 2024-09-21T15:21:28.601 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:21:28.601 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.595+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9450 2024-09-21T15:21:28.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb95f0 2024-09-21T15:21:28.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9790 2024-09-21T15:21:28.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9930 2024-09-21T15:21:28.608 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9c70 2024-09-21T15:21:28.608 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:21:28.608 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9e10 2024-09-21T15:21:28.609 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x55714346b930 2024-09-21T15:21:28.609 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cdd0 2024-09-21T15:21:28.609 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cea0 2024-09-21T15:21:28.609 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456de10 2024-09-21T15:21:28.609 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765ba0 2024-09-21T15:21:28.609 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x5571480009c0 2024-09-21T15:21:28.609 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012270 2024-09-21T15:21:28.609 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:21:28.599+0000 7f52f1ba9700 -1 reset not still connected to 0x5571480135f0 2024-09-21T15:21:28.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone35': 2024-09-21T15:21:28.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 191 MiB in 770 objects 2024-09-21T15:21:28.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:21:28.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:28.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4b1480e48 2024-09-21T15:21:28.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4b1480e48 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4b1480e48 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 66ab926c-550e-47ad-ad7b-e61c7dbbcd06 2024-09-21T15:21:28.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:28.649 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:28.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:28.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone36 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:28.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:28.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:28.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone36 2024-09-21T15:21:28.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:28.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:28.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:28.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:29.654 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:29.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone36': 2024-09-21T15:21:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 150 MiB in 75 objects 2024-09-21T15:21:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:21:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4a191c920 2024-09-21T15:21:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4a191c920 2024-09-21T15:21:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:29 2024 2024-09-21T15:21:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:29 2024 2024-09-21T15:21:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:29 2024 2024-09-21T15:21:29.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:29.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone35@snap 2024-09-21T15:21:29.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 15 MiB 2024-09-21T15:21:29.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:21:29.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:21:29.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4a191c920 2024-09-21T15:21:29.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:29.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:29.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 11fce1ba-4c77-4152-b67e-fce8e444ea05 2024-09-21T15:21:29.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:29.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:29.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:29.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone37 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:29.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:29.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:29.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone37 2024-09-21T15:21:29.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:29.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:29.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:29.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:30.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:30.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone37': 2024-09-21T15:21:30.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 179 MiB in 92 objects 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4e0cd0743 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4e0cd0743 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:26 2024 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:26 2024 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:26 2024 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:21:30.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:21:30.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4e0cd0743 2024-09-21T15:21:30.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:30.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:30.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: cd2c68f6-f61c-4a24-a394-1bff3bb8adea 2024-09-21T15:21:30.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:30.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:30.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:30.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone38 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:30.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:30.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:30.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone38 2024-09-21T15:21:30.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:30.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:30.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:30.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:31.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:31.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone38': 2024-09-21T15:21:31.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 118 MiB in 18 objects 2024-09-21T15:21:31.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c49b33a9d1 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c49b33a9d1 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:27 2024 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:27 2024 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:27 2024 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c49b33a9d1 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:31.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:31.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 3f55813c-389e-4273-ad96-2ee904d4730d 2024-09-21T15:21:31.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:31.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:31.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:31.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone39 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:31.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:31.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:31.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone39 2024-09-21T15:21:31.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:31.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:31.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:31.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:32.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:32.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone39': 2024-09-21T15:21:32.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 200 MiB in 52 objects 2024-09-21T15:21:32.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:21:32.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 1 2024-09-21T15:21:32.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c463a8bec6 2024-09-21T15:21:32.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c463a8bec6 2024-09-21T15:21:32.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:32.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:32.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:32.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:32.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:21:32.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:21:32.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:21:32.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:32.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone38@snap 2024-09-21T15:21:32.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 5.2 MiB 2024-09-21T15:21:32.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:21:32.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:21:32.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c463a8bec6 2024-09-21T15:21:32.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:32.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:32.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 0e38c267-ca71-47c8-85c5-6e571f45254e 2024-09-21T15:21:32.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:32.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:32.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:32.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:32.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:32.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:32.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone4 2024-09-21T15:21:32.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:32.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:32.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:32.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:33.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:33.467+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:21:33.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:33.467+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:21:33.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:33.467+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:21:33.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:33.471+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:21:33.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone4': 2024-09-21T15:21:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:21:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:21:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9f4d8fe0b 2024-09-21T15:21:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9f4d8fe0b 2024-09-21T15:21:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:21:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:21:34.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:21:34.054 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:34.054 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:21:34.054 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:21:34.054 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9f4d8fe0b 2024-09-21T15:21:34.054 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:34.054 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:34.054 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 9fbaf0e4-e740-44b5-93a8-aaac75180cbd 2024-09-21T15:21:34.054 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone5 2024-09-21T15:21:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:34.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:35.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:35.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone5': 2024-09-21T15:21:35.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 194 MiB in 28 objects 2024-09-21T15:21:35.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:21:35.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:35.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b98a20aeb6 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b98a20aeb6 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:57 2024 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:57 2024 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:57 2024 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b98a20aeb6 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:35.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 887dd3d1-67f5-4f70-aa57-03b613724dc3 2024-09-21T15:21:35.127 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:35.132 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:35.132 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:35.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone6 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:35.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:35.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:35.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone6 2024-09-21T15:21:35.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:35.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:35.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:35.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:36.134 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:36.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone6': 2024-09-21T15:21:36.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:21:36.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:21:36.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9236183b 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9236183b 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 6 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9236183b 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:36.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:36.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 202d909b-438b-4fae-87ea-7e1cb2c21dfe 2024-09-21T15:21:36.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:36.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:36.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:36.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone7 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:36.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:36.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:36.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone7 2024-09-21T15:21:36.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:36.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:36.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:36.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:36.410 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:36.406+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:21:36.411 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:36.406+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:21:36.411 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:36.406+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:21:37.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:37.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone7': 2024-09-21T15:21:37.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 213 MiB in 429 objects 2024-09-21T15:21:37.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:21:37.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:37.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b92d396b01 2024-09-21T15:21:37.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b92d396b01 2024-09-21T15:21:37.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:37.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:37.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:37.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:37.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:21:37.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:21:37.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:21:37.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:37.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone6@snap 2024-09-21T15:21:37.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 21 MiB 2024-09-21T15:21:37.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:21:37.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:21:37.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b92d396b01 2024-09-21T15:21:37.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:37.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:37.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 04541b78-9209-4691-bb39-3dd6fa0ec333 2024-09-21T15:21:37.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:37.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:37.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:37.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone8 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:37.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:37.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:37.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone8 2024-09-21T15:21:37.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:37.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:37.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:37.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:37.663 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.8091596752297866) > weight (0.25) 2024-09-21T15:21:37.664 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.9889772567959683) > weight (0.25) 2024-09-21T15:21:37.664 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.38868203722951133) > weight (0.25) 2024-09-21T15:21:37.664 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.3 with skip (0.3738465810510665) > weight (0.25) 2024-09-21T15:21:37.664 INFO:tasks.rbd_mirror_thrash:waiting for 72 secs before thrashing 2024-09-21T15:21:38.234 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:38.226+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:21:38.234 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:38.226+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:21:38.235 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:38.230+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:21:38.235 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:38.230+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:21:38.239 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:21:38.230+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:21:38.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:38.403 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.395+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:21:38.403 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.395+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:21:38.411 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.399+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:21:38.437 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.431+0000 7ff753f07700 -1 reset not still connected to 0x56016b24f930 2024-09-21T15:21:38.437 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.431+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:21:38.437 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.431+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:21:38.438 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.431+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:21:38.438 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.431+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:21:38.438 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.431+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba340 2024-09-21T15:21:38.450 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.435+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba680 2024-09-21T15:21:38.454 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.447+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbb6c0 2024-09-21T15:21:38.463 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.455+0000 7ff753f07700 -1 reset not still connected to 0x56016cdc7ba0 2024-09-21T15:21:38.470 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.455+0000 7ff753f07700 -1 reset not still connected to 0x56016d18e270 2024-09-21T15:21:38.470 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.455+0000 7ff753f07700 -1 reset not still connected to 0x56016d18edd0 2024-09-21T15:21:38.493 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.483+0000 7ff753f07700 -1 reset not still connected to 0x56016d80e0d0 2024-09-21T15:21:38.496 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.483+0000 7ff753f07700 -1 reset not still connected to 0x56016d985ba0 2024-09-21T15:21:38.496 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.483+0000 7ff753f07700 -1 reset not still connected to 0x56016d985d40 2024-09-21T15:21:38.524 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.519+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:21:38.525 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.519+0000 7ff753f07700 -1 reset not still connected to 0x56016e3284e0 2024-09-21T15:21:38.525 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.519+0000 7ff753f07700 -1 reset not still connected to 0x56016e36eb60 2024-09-21T15:21:38.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.523+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:21:38.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.523+0000 7ff753f07700 -1 reset not still connected to 0x56016e36fc70 2024-09-21T15:21:38.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.523+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a2820 2024-09-21T15:21:38.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.523+0000 7ff753f07700 -1 reset not still connected to 0x56016eb6cf70 2024-09-21T15:21:38.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.523+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:21:38.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.523+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2a90 2024-09-21T15:21:38.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.523+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:21:38.540 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:21:38.540 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3790 2024-09-21T15:21:38.540 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f162000 2024-09-21T15:21:38.540 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:21:38.540 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:21:38.540 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f1625b0 2024-09-21T15:21:38.541 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:21:38.541 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f162c30 2024-09-21T15:21:38.541 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f162ea0 2024-09-21T15:21:38.541 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f1631e0 2024-09-21T15:21:38.541 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:21:38.543 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f163380 2024-09-21T15:21:38.543 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ad0 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fa4fad0 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98270 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98820 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:21:38.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99040 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99ee0 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd89c0 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x5601709b84e0 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8dd0 2024-09-21T15:21:38.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9ba0 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560170f652b0 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560170f65ba0 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560171d008f0 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560171f05ee0 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:21:38.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7d40 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1d40 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560168574270 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:21:38.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:38.535+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:21:38.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone8': 2024-09-21T15:21:38.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 119 MiB in 247 objects 2024-09-21T15:21:38.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:21:38.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:38.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9abf5365a 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9abf5365a 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9abf5365a 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 31e98e64-d9b2-447d-bce9-435d3d7cef3a 2024-09-21T15:21:38.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:38.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:38.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:38.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.0-clone9 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:38.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:38.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:38.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone9 2024-09-21T15:21:38.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:38.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:38.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:38.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:39.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.0-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:39.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.0-clone9': 2024-09-21T15:21:39.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 8.6 MiB in 42 objects 2024-09-21T15:21:39.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:21:39.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:39.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9d1156990 2024-09-21T15:21:39.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9d1156990 2024-09-21T15:21:39.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:39.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:39.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:39.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:39.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:21:39.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:21:39.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:21:39.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:39.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.0-clone8@snap 2024-09-21T15:21:39.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 8.6 MiB 2024-09-21T15:21:39.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 KiB 2024-09-21T15:21:39.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:21:39.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9d1156990 2024-09-21T15:21:39.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:39.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:39.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985 2024-09-21T15:21:39.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:39.698 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:39.698 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:39.698 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:39.698 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:39.698 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:39.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1 2024-09-21T15:21:39.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:39.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:39.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:39.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:40.514 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.506+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:21:40.523 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.518+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:21:40.542 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.538+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:21:40.554 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.550+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:21:40.565 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.558+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:21:40.565 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.558+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:21:40.565 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.558+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:21:40.565 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.558+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:21:40.566 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.558+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:21:40.568 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.562+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:21:40.569 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.562+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:21:40.569 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.562+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:21:40.569 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.562+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:21:40.569 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.562+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:21:40.569 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.562+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a9450 2024-09-21T15:21:40.569 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.562+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48680 2024-09-21T15:21:40.569 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.562+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:21:40.569 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.562+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:21:40.570 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.566+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289520 2024-09-21T15:21:40.571 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.566+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:21:40.571 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.566+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:21:40.571 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.566+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:21:40.571 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.566+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:21:40.573 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.566+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:21:40.579 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69e10 2024-09-21T15:21:40.579 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a820 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677110 2024-09-21T15:21:40.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529d40 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3ee0 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:21:40.581 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:21:40.582 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:21:40.582 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:21:40.582 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:40.570+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:21:40.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:40.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1': 2024-09-21T15:21:40.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 87 MiB in 22 objects 2024-09-21T15:21:40.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:21:40.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:40.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b92fa6ea45 2024-09-21T15:21:40.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b92fa6ea45 2024-09-21T15:21:40.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:40.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:40.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:40.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:40.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:21:40.768 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:21:40.768 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:21:40.768 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:40.768 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b92fa6ea45 2024-09-21T15:21:40.768 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:40.768 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:40.768 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 2b696388-ccf4-4874-ae7a-646ab0d69446 2024-09-21T15:21:40.768 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:40.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:40.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:40.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:40.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:40.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:40.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone1 2024-09-21T15:21:40.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:40.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:40.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:40.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:41.662 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.31005228910763083) > weight (0.25) 2024-09-21T15:21:41.662 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.2540090970522978) > weight (0.25) 2024-09-21T15:21:41.662 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.2 with skip (0.8714356760005717) > weight (0.25) 2024-09-21T15:21:41.663 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.3 with skip (0.5371775002658477) > weight (0.25) 2024-09-21T15:21:41.663 INFO:tasks.rbd_mirror_thrash:waiting for 101 secs before thrashing 2024-09-21T15:21:41.775 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:41.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone1': 2024-09-21T15:21:41.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 181 MiB in 24 objects 2024-09-21T15:21:41.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:21:41.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:41.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b95909945f 2024-09-21T15:21:41.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b95909945f 2024-09-21T15:21:41.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:41.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:21:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:21:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:21:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:21:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:21:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b95909945f 2024-09-21T15:21:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: a8c8bfff-c185-48fa-b5d7-a827841c0373 2024-09-21T15:21:41.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:41.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:41.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:41.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone10 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:41.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:41.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:41.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone10 2024-09-21T15:21:41.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:41.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:41.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:41.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:42.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:42.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone10': 2024-09-21T15:21:42.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 4.8 MiB in 1 objects 2024-09-21T15:21:42.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:21:42.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:42.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b95e248aae 2024-09-21T15:21:42.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b95e248aae 2024-09-21T15:21:42.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:42.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:42.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:42.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:42.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:21:42.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:21:42.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:21:42.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:42.959 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.1-clone9@snap 2024-09-21T15:21:42.959 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 4.8 MiB 2024-09-21T15:21:42.959 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 MiB 2024-09-21T15:21:42.959 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:21:42.959 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b95e248aae 2024-09-21T15:21:42.959 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:42.959 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:42.959 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 6af429ba-f735-4db2-8ce0-990e9e419129 2024-09-21T15:21:42.959 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:42.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:42.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:42.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone11 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:42.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:42.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:42.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone11 2024-09-21T15:21:42.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:42.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:42.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:42.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:43.968 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:44.099 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone11': 2024-09-21T15:21:44.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 1.0 MiB in 6 objects 2024-09-21T15:21:44.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:21:44.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:44.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b974aaa9a3 2024-09-21T15:21:44.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b974aaa9a3 2024-09-21T15:21:44.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:44.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:44.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:44.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:44.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:21:44.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:21:44.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:21:44.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:44.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.1-clone10@snap 2024-09-21T15:21:44.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 1.0 MiB 2024-09-21T15:21:44.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 KiB 2024-09-21T15:21:44.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 6 2024-09-21T15:21:44.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b974aaa9a3 2024-09-21T15:21:44.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:44.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:44.102 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 1857f2cd-7b23-459e-b47e-de455e02aabc 2024-09-21T15:21:44.102 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:44.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:44.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:44.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone12 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:44.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:44.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:44.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone12 2024-09-21T15:21:44.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:44.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:44.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:44.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:45.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:45.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone12': 2024-09-21T15:21:45.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:21:45.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:21:45.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:45.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c48de7aaff 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c48de7aaff 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c48de7aaff 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:45.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: a88a0c18-875d-4624-b7df-602dca14305c 2024-09-21T15:21:45.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:45.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:45.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:45.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone13 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:45.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:45.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:45.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone13 2024-09-21T15:21:45.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:45.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:45.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:45.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:46.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:46.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone13': 2024-09-21T15:21:46.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 3.5 MiB in 1 objects 2024-09-21T15:21:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:21:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4bff580e3 2024-09-21T15:21:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4bff580e3 2024-09-21T15:21:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:21:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:21:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:21:46.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:46.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.1-clone12@snap 2024-09-21T15:21:46.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 3.5 MiB 2024-09-21T15:21:46.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:21:46.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:21:46.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4bff580e3 2024-09-21T15:21:46.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:46.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:46.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 01f8d37c-a37a-4fbe-af84-d8f7c64de775 2024-09-21T15:21:46.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:46.352 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:46.352 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:46.352 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone14 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:46.352 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:46.353 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:46.353 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone14 2024-09-21T15:21:46.353 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:46.353 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:46.353 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:46.353 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:47.353 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:47.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone14': 2024-09-21T15:21:47.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 117 MiB in 11 objects 2024-09-21T15:21:47.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:21:47.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:47.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b98b8106fd 2024-09-21T15:21:47.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b98b8106fd 2024-09-21T15:21:47.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:47.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:47.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:47.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:47.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:21:47.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:21:47.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:21:47.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:47.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:21:47.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:21:47.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b98b8106fd 2024-09-21T15:21:47.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:47.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:47.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 9864fae0-3895-4e6e-8b42-30d51bc9fbb9 2024-09-21T15:21:47.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:47.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:47.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:47.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone15 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:47.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:47.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:47.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone15 2024-09-21T15:21:47.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:47.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:47.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:47.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:48.332 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:48.326+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:21:48.333 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:21:48.326+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:21:48.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:48.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone15': 2024-09-21T15:21:48.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 4.8 MiB in 20 objects 2024-09-21T15:21:48.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:21:48.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:48.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b91700b241 2024-09-21T15:21:48.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b91700b241 2024-09-21T15:21:48.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:48.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.1-clone14@snap 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 4.8 MiB 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 KiB 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b91700b241 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:48.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 7a09179e-ea78-49c4-ab31-16f3fb8ff4df 2024-09-21T15:21:48.502 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:48.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:48.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:48.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone16 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:48.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:48.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:48.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone16 2024-09-21T15:21:48.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:48.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:48.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:48.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:49.202 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.194+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4680 2024-09-21T15:21:49.203 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.198+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff52b0 2024-09-21T15:21:49.203 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.198+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5d40 2024-09-21T15:21:49.203 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.198+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5ee0 2024-09-21T15:21:49.210 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.206+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc15459450 2024-09-21T15:21:49.211 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.206+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc154595f0 2024-09-21T15:21:49.211 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.206+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546c820 2024-09-21T15:21:49.216 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.206+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546d790 2024-09-21T15:21:49.230 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.218+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:21:49.230 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.218+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc16e7b5f0 2024-09-21T15:21:49.230 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.218+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1753d450 2024-09-21T15:21:49.237 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc192bcd00 2024-09-21T15:21:49.237 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939edd0 2024-09-21T15:21:49.237 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939ef70 2024-09-21T15:21:49.237 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fad0 2024-09-21T15:21:49.237 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fc70 2024-09-21T15:21:49.237 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc19691790 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfce4e0 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfcedd0 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c383040 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf592b0 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3508f0 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3516c0 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822680 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822b60 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e823ad0 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1f299930 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1fdea750 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1fdebd40 2024-09-21T15:21:49.238 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:21:49.239 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4410 2024-09-21T15:21:49.239 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f51e0 2024-09-21T15:21:49.239 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:21:49.239 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:21:49.239 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21708000 2024-09-21T15:21:49.239 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21738c30 2024-09-21T15:21:49.239 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363bd40 2024-09-21T15:21:49.239 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f3450 2024-09-21T15:21:49.239 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc238280d0 2024-09-21T15:21:49.239 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc23829520 2024-09-21T15:21:49.239 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc23829d40 2024-09-21T15:21:49.239 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24055ad0 2024-09-21T15:21:49.239 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:21:49.230+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0cf70 2024-09-21T15:21:49.510 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:49.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone16': 2024-09-21T15:21:49.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 223 MiB in 30 objects 2024-09-21T15:21:49.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:21:49.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:49.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b92980cb7c 2024-09-21T15:21:49.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b92980cb7c 2024-09-21T15:21:49.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:49.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:49.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:49.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:49.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:49.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:49.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:49.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:49.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.1-clone15@snap 2024-09-21T15:21:49.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 1.7 MiB 2024-09-21T15:21:49.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:21:49.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:21:49.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b92980cb7c 2024-09-21T15:21:49.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:49.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:49.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: e51aede5-de84-423f-9449-2f9e9884385e 2024-09-21T15:21:49.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:49.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:49.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:49.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone17 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:49.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:49.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:49.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone17 2024-09-21T15:21:49.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:49.613 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:49.613 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:49.613 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:50.613 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:50.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone17': 2024-09-21T15:21:50.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 228 MiB in 36 objects 2024-09-21T15:21:50.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:21:50.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:50.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b94873523d 2024-09-21T15:21:50.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b94873523d 2024-09-21T15:21:50.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:50.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:50.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:50.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:50.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:21:50.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:21:50.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:21:50.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:50.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:21:50.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:21:50.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b94873523d 2024-09-21T15:21:50.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:50.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:50.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 36de9bdb-aa84-407c-8a36-4edec11ef7e9 2024-09-21T15:21:50.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:50.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:50.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:50.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone18 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:50.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:50.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:50.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone18 2024-09-21T15:21:50.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:50.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:50.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:50.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:51.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:51.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone18': 2024-09-21T15:21:51.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 227 MiB in 36 objects 2024-09-21T15:21:51.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:21:51.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:51.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b92a821057 2024-09-21T15:21:51.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b92a821057 2024-09-21T15:21:51.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:51.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:51.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:51.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:51.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:51.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:51.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:21:51.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:51.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:21:51.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:21:51.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b92a821057 2024-09-21T15:21:51.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:51.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:51.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 0edcfa49-d8f9-4e7d-966d-6871597811e6 2024-09-21T15:21:51.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:51.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:51.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:51.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone19 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:51.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:51.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:51.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone19 2024-09-21T15:21:51.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:51.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:51.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:51.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:52.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone19': 2024-09-21T15:21:52.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 226 MiB in 456 objects 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b99aef1a62 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b99aef1a62 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:21:52.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b99aef1a62 2024-09-21T15:21:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 71a77f4d-9e83-4fd4-82da-4a34261112d8 2024-09-21T15:21:52.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:52.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:52.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:52.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:52.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:52.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:52.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone2 2024-09-21T15:21:52.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:52.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:52.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:52.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:53.453 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.443+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:21:53.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.443+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:21:53.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.447+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:21:53.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.479+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:21:53.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.479+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:21:53.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.479+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:21:53.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.479+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:21:53.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.479+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:21:53.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.479+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:21:53.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.483+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:21:53.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.483+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:21:53.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.483+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:21:53.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.483+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:21:53.489 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.483+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:21:53.489 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.483+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:21:53.489 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.483+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:21:53.489 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.483+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:21:53.489 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.483+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:21:53.489 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.483+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:21:53.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.487+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:21:53.498 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.491+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:21:53.498 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.491+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:21:53.509 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.499+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:21:53.509 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.499+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:21:53.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.519+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:21:53.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.519+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:21:53.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:21:53.519+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:21:53.834 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:53.900 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone2': 2024-09-21T15:21:53.900 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 218 MiB in 876 objects 2024-09-21T15:21:53.900 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b959b3e885 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b959b3e885 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 6 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b959b3e885 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:53.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 2c920b45-e415-4127-8e5e-84e50ed4265e 2024-09-21T15:21:53.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:53.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:53.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:53.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone20 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:53.907 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:53.907 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:53.907 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone20 2024-09-21T15:21:53.907 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:53.907 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:53.907 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:53.907 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:54.908 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:54.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone20': 2024-09-21T15:21:54.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:21:54.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:21:54.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:54.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9a99d1ab1 2024-09-21T15:21:54.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9a99d1ab1 2024-09-21T15:21:54.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:54.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:54.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:54.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:54.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:54.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:54.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:21:54.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:54.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 MiB 2024-09-21T15:21:54.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:21:54.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9a99d1ab1 2024-09-21T15:21:54.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:54.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:54.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: ff92add1-cc80-42c3-b549-7eb5463480d3 2024-09-21T15:21:54.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:54.980 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:54.980 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:54.980 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone21 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:54.980 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:54.980 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:54.980 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone21 2024-09-21T15:21:54.981 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:54.981 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:54.981 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:54.981 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:55.981 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:56.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone21': 2024-09-21T15:21:56.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 35 MiB in 14 objects 2024-09-21T15:21:56.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:21:56.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:56.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4c3fa2897 2024-09-21T15:21:56.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4c3fa2897 2024-09-21T15:21:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:21:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:21:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:21:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.1-clone20@snap 2024-09-21T15:21:56.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 35 MiB 2024-09-21T15:21:56.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:21:56.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:21:56.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4c3fa2897 2024-09-21T15:21:56.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:56.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:56.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: cb06e058-0aca-44b5-9820-87e1992c0207 2024-09-21T15:21:56.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:56.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:56.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:56.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone22 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:56.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:56.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:56.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone22 2024-09-21T15:21:56.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:56.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:56.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:56.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:57.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:57.151 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone22': 2024-09-21T15:21:57.151 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4523fbeb7 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4523fbeb7 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:21:57.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4523fbeb7 2024-09-21T15:21:57.153 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:57.153 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:57.153 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: e6696bd8-9005-4eeb-8e44-c70647860921 2024-09-21T15:21:57.153 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:57.157 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:57.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:57.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone23 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:57.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:57.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:57.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone23 2024-09-21T15:21:57.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:57.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:57.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:57.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:57.791 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:21:57.787+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0000 2024-09-21T15:21:58.159 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:58.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone23': 2024-09-21T15:21:58.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:21:58.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:21:58.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:58.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c436951906 2024-09-21T15:21:58.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c436951906 2024-09-21T15:21:58.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:58.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:58.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:58.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:58.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:12:28 2024 2024-09-21T15:21:58.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:12:28 2024 2024-09-21T15:21:58.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:12:28 2024 2024-09-21T15:21:58.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:58.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 MiB 2024-09-21T15:21:58.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:21:58.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c436951906 2024-09-21T15:21:58.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:58.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:58.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 96f7130e-627f-496e-8a7c-886f81d92e20 2024-09-21T15:21:58.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:58.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:58.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:58.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone24 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:58.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:58.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:58.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone24 2024-09-21T15:21:58.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:58.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:58.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:58.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:21:59.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:59.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone24': 2024-09-21T15:21:59.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 173 MiB in 44 objects 2024-09-21T15:21:59.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:21:59.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:21:59.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9970a1316 2024-09-21T15:21:59.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9970a1316 2024-09-21T15:21:59.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:21:59.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:21:59.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:21:59.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:21:59.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:57 2024 2024-09-21T15:21:59.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:57 2024 2024-09-21T15:21:59.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:57 2024 2024-09-21T15:21:59.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:21:59.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:21:59.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:21:59.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9970a1316 2024-09-21T15:21:59.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:21:59.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:21:59.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b24d1ffe-dcef-44c9-945f-83e9b544edec 2024-09-21T15:21:59.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:21:59.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:21:59.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:21:59.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone25 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:59.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:21:59.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:21:59.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone25 2024-09-21T15:21:59.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:21:59.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:21:59.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:21:59.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:00.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:00.393 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone25': 2024-09-21T15:22:00.393 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 156 MiB in 630 objects 2024-09-21T15:22:00.393 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:22:00.393 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:00.393 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4783561bd 2024-09-21T15:22:00.393 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4783561bd 2024-09-21T15:22:00.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:00.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:00.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:00.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:00.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:22:00.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:22:00.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:22:00.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:00.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.1-clone24@snap 2024-09-21T15:22:00.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 156 MiB 2024-09-21T15:22:00.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 KiB 2024-09-21T15:22:00.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:22:00.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4783561bd 2024-09-21T15:22:00.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:00.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:00.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 59c4deec-1cba-4460-94d5-6bed35911cea 2024-09-21T15:22:00.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:00.402 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:00.402 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:00.402 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone26 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:00.402 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:00.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:00.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone26 2024-09-21T15:22:00.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:00.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:00.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:00.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:01.404 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:01.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone26': 2024-09-21T15:22:01.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 203 MiB in 102 objects 2024-09-21T15:22:01.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b94409e5d6 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b94409e5d6 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b94409e5d6 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: eee89f94-874b-48ea-bcd4-804b53f039c0 2024-09-21T15:22:01.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone27 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:01.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:01.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone27 2024-09-21T15:22:01.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:01.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:01.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:01.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:02.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone27': 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 158 MiB in 18 objects 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c463418e01 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c463418e01 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:02.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:22:02.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:22:02.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c463418e01 2024-09-21T15:22:02.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:02.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:02.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: e513238f-c4c4-4cbc-8a2f-c21215922f5f 2024-09-21T15:22:02.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:02.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:02.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:02.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone28 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:02.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:02.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:02.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone28 2024-09-21T15:22:02.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:02.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:02.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:02.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:03.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:03.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone28': 2024-09-21T15:22:03.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:22:03.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:22:03.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:03.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4c767f0a5 2024-09-21T15:22:03.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4c767f0a5 2024-09-21T15:22:03.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:03.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:03.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:03.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:03.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:29 2024 2024-09-21T15:22:03.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:29 2024 2024-09-21T15:22:03.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:29 2024 2024-09-21T15:22:03.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:03.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 KiB 2024-09-21T15:22:03.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:22:03.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4c767f0a5 2024-09-21T15:22:03.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:03.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:03.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 18beec6d-0569-40d4-9d25-4aee7c0f6abb 2024-09-21T15:22:03.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:03.617 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:03.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:03.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone29 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:03.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:03.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:03.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone29 2024-09-21T15:22:03.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:03.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:03.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:03.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:04.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:04.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone29': 2024-09-21T15:22:04.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 222 MiB in 39 objects 2024-09-21T15:22:04.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:22:04.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:04.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4300e888c 2024-09-21T15:22:04.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4300e888c 2024-09-21T15:22:04.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:04.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:04.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:04.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:04.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:28 2024 2024-09-21T15:22:04.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:28 2024 2024-09-21T15:22:04.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:28 2024 2024-09-21T15:22:04.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:04.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:22:04.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:22:04.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4300e888c 2024-09-21T15:22:04.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:04.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:04.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 17533440-f958-4ed4-a80c-8e242aef088b 2024-09-21T15:22:04.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:04.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:04.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:04.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:04.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:04.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:04.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone3 2024-09-21T15:22:04.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:04.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:04.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:04.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:05.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:05.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone3': 2024-09-21T15:22:05.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 103 MiB in 15 objects 2024-09-21T15:22:05.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:22:05.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:05.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b967440391 2024-09-21T15:22:05.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b967440391 2024-09-21T15:22:05.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:05.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:05.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:05.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:05.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:22:05.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:22:05.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:22:05.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:05.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:22:05.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:22:05.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b967440391 2024-09-21T15:22:05.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:05.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:05.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b36b8111-2b07-4cfc-b245-f5bbf9b652aa 2024-09-21T15:22:05.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:05.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:05.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:05.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone30 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:05.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:05.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:05.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone30 2024-09-21T15:22:05.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:05.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:05.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:05.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:05.767 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.761+0000 7f1e9c77a700 -1 reset not still connected to 0x56288661c820 2024-09-21T15:22:05.783 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.773+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:22:05.784 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.777+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d2ea0 2024-09-21T15:22:05.784 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.777+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f9d3ee0 2024-09-21T15:22:05.806 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628958fdad0 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x562895933ba0 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x56289b659930 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a1f75380 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a22ffa00 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2655110 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a2e88340 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a40415f0 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a45800d0 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:22:05.807 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:22:05.808 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a51484e0 2024-09-21T15:22:05.808 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a59a2dd0 2024-09-21T15:22:05.808 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec61a0 2024-09-21T15:22:05.808 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:22:05.808 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:22:05.808 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6f404e0 2024-09-21T15:22:05.808 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160680 2024-09-21T15:22:05.808 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160f70 2024-09-21T15:22:05.808 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:22:05.808 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780ed00 2024-09-21T15:22:05.809 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:22:05.809 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8198dd0 2024-09-21T15:22:05.809 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:22:05.809 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.797+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1ad0 2024-09-21T15:22:05.809 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1040 2024-09-21T15:22:05.810 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:22:05.810 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:22:05.810 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:22:05.810 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:22:05.810 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9c270 2024-09-21T15:22:05.810 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab14340 2024-09-21T15:22:05.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab148f0 2024-09-21T15:22:05.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:22:05.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:22:05.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:22:05.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:22:05.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f1e0 2024-09-21T15:22:05.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1f2b0 2024-09-21T15:22:05.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:22:05.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:22:05.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0f380 2024-09-21T15:22:05.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:22:05.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c4e0 2024-09-21T15:22:05.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e8410 2024-09-21T15:22:05.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e89c0 2024-09-21T15:22:05.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e9040 2024-09-21T15:22:05.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:22:05.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:22:05.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:22:05.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:22:05.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274d00 2024-09-21T15:22:05.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a80d0 2024-09-21T15:22:05.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a8a90 2024-09-21T15:22:05.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a92b0 2024-09-21T15:22:05.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a9450 2024-09-21T15:22:05.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48680 2024-09-21T15:22:05.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:22:05.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:22:05.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289520 2024-09-21T15:22:05.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:22:05.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:22:05.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:22:05.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:22:05.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:22:05.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69e10 2024-09-21T15:22:05.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26c750 2024-09-21T15:22:05.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:22:05.814 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.801+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:22:05.814 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:22:05.814 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:22:05.814 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:22:05.815 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a4e0 2024-09-21T15:22:05.815 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a820 2024-09-21T15:22:05.815 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:22:05.815 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:22:05.815 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:22:05.815 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3860 2024-09-21T15:22:05.815 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:22:05.815 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1a00 2024-09-21T15:22:05.815 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:22:05.815 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677110 2024-09-21T15:22:05.815 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529d40 2024-09-21T15:22:05.815 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3a00 2024-09-21T15:22:05.816 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:22:05.816 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a0d6f860 2024-09-21T15:22:05.816 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:22:05.816 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1790 2024-09-21T15:22:05.816 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:05.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:22:06.241 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.233+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc719a00 2024-09-21T15:22:06.241 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.233+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e000 2024-09-21T15:22:06.245 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.237+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:22:06.245 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.237+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e5b0 2024-09-21T15:22:06.245 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.237+0000 7f7fd044c700 -1 reset not still connected to 0x5636beaeadd0 2024-09-21T15:22:06.247 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.241+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4340 2024-09-21T15:22:06.247 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.241+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4750 2024-09-21T15:22:06.247 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.241+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:22:06.247 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.241+0000 7f7fd044c700 -1 reset not still connected to 0x5636c074c270 2024-09-21T15:22:06.247 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.241+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:22:06.247 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.241+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc3860 2024-09-21T15:22:06.247 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.241+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45040d0 2024-09-21T15:22:06.249 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.241+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504410 2024-09-21T15:22:06.250 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.241+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4504750 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.245+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4505520 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.245+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e270 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.245+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.249+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5040 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.249+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb1e0 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.249+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbb5f0 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.249+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.249+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55110 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.249+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c24e0 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.249+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.249+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9e10 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.249+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690820 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.249+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:22:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:22:06.249+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:22:06.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:06.834 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone30': 2024-09-21T15:22:06.834 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 182 MiB in 735 objects 2024-09-21T15:22:06.834 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:22:06.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 1 2024-09-21T15:22:06.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c496a27cc9 2024-09-21T15:22:06.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c496a27cc9 2024-09-21T15:22:06.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:06.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:06.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:06.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:06.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:22:06.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:22:06.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:22:06.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:06.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:22:06.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:22:06.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c496a27cc9 2024-09-21T15:22:06.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:06.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:06.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 38d35746-a904-4bdd-bf2c-f409673624e7 2024-09-21T15:22:06.837 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:06.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:06.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:06.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:06.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:06.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:06.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone4 2024-09-21T15:22:06.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:06.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:06.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:06.842 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:07.842 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:07.909 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone4': 2024-09-21T15:22:07.909 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 192 MiB in 24 objects 2024-09-21T15:22:07.909 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:22:07.909 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:07.909 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9563b138e 2024-09-21T15:22:07.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9563b138e 2024-09-21T15:22:07.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:07.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:07.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:07.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:07.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:57 2024 2024-09-21T15:22:07.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:57 2024 2024-09-21T15:22:07.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:57 2024 2024-09-21T15:22:07.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:07.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:22:07.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:22:07.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9563b138e 2024-09-21T15:22:07.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:07.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:07.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 0548c5e3-c10e-47f9-b0c1-cd5c74547602 2024-09-21T15:22:07.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:07.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:07.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:07.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:07.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:07.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:07.916 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone5 2024-09-21T15:22:07.916 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:07.916 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:07.916 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:07.916 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:08.438 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.422+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:22:08.449 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.438+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:22:08.452 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.438+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:22:08.452 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.438+0000 7ff753f07700 -1 reset not still connected to 0x560171d004e0 2024-09-21T15:22:08.452 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.438+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:22:08.454 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.442+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:22:08.457 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.450+0000 7ff753f07700 -1 reset not still connected to 0x560171d012b0 2024-09-21T15:22:08.459 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.450+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:22:08.462 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.454+0000 7ff753f07700 -1 reset not still connected to 0x560171f94680 2024-09-21T15:22:08.462 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.454+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:22:08.462 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.454+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:22:08.462 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.454+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:22:08.462 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.454+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:22:08.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.454+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:22:08.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.454+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:22:08.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.454+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:22:08.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.454+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:22:08.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.458+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:22:08.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.458+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:22:08.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.458+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6000 2024-09-21T15:22:08.471 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.466+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7ad0 2024-09-21T15:22:08.471 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.466+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7d40 2024-09-21T15:22:08.473 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.466+0000 7ff753f07700 -1 reset not still connected to 0x56017529a000 2024-09-21T15:22:08.473 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.466+0000 7ff753f07700 -1 reset not still connected to 0x56017529a4e0 2024-09-21T15:22:08.473 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.466+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1d40 2024-09-21T15:22:08.473 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.466+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc750 2024-09-21T15:22:08.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:08.470+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccdd0 2024-09-21T15:22:08.916 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:08.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone5': 2024-09-21T15:22:08.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 174 MiB in 15 objects 2024-09-21T15:22:08.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:22:08.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:08.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9adae7e85 2024-09-21T15:22:08.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9adae7e85 2024-09-21T15:22:08.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:08.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:08.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:08.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:08.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:22:08.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:22:08.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:22:08.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:08.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.1-clone4@snap 2024-09-21T15:22:08.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 29 MiB 2024-09-21T15:22:08.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:22:08.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:22:08.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9adae7e85 2024-09-21T15:22:08.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:08.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:08.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 4db41bcc-01af-44fc-9cb1-aedfd7a02660 2024-09-21T15:22:08.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:08.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:08.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:08.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone6 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:08.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:08.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:09.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone6 2024-09-21T15:22:09.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:09.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:09.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:09.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:10.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:10.090 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone6': 2024-09-21T15:22:10.090 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 8.8 MiB in 5 objects 2024-09-21T15:22:10.090 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:22:10.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:10.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9379594f1 2024-09-21T15:22:10.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9379594f1 2024-09-21T15:22:10.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:10.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:10.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:10.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:10.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:10.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:10.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:10.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:10.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.1-clone5@snap 2024-09-21T15:22:10.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 8.8 MiB 2024-09-21T15:22:10.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:22:10.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:22:10.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9379594f1 2024-09-21T15:22:10.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:10.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:10.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 43028d32-4202-4ac6-b083-241946f596da 2024-09-21T15:22:10.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:10.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:10.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:10.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone7 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:10.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:10.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:10.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone7 2024-09-21T15:22:10.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:10.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:10.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:10.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:11.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:11.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone7': 2024-09-21T15:22:11.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 66 MiB in 11 objects 2024-09-21T15:22:11.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b97ba249af 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b97ba249af 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:22:11.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b97ba249af 2024-09-21T15:22:11.174 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:11.174 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:11.174 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 3fdcc685-72aa-4afe-9cdb-1ad60b962a91 2024-09-21T15:22:11.174 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:11.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:11.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:11.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone8 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:11.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:11.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:11.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone8 2024-09-21T15:22:11.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:11.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:11.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:11.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:12.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:12.247 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone8': 2024-09-21T15:22:12.247 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:22:12.247 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b98fcdd896 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b98fcdd896 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 KiB 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b98fcdd896 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:12.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:12.249 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 3d2cada1-cdba-4793-9a15-f743b41bee74 2024-09-21T15:22:12.249 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.1-clone9 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone9 2024-09-21T15:22:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:12.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:12.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:13.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.1-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:13.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.1-clone9': 2024-09-21T15:22:13.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 47 MiB in 24 objects 2024-09-21T15:22:13.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:22:13.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:13.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b95b53030e 2024-09-21T15:22:13.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b95b53030e 2024-09-21T15:22:13.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:13.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:13.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:13.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:13.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:13.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:13.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:13.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:13.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.1-clone8@snap 2024-09-21T15:22:13.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 47 MiB 2024-09-21T15:22:13.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:22:13.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:22:13.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b95b53030e 2024-09-21T15:22:13.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:13.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:13.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 8d7a3b11-1cec-4004-b7be-e3f2f5588529 2024-09-21T15:22:13.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:13.363 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:13.363 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:13.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:13.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:13.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:13.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2 2024-09-21T15:22:13.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:13.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:13.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:13.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:14.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:14.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2': 2024-09-21T15:22:14.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 192 MiB in 48 objects 2024-09-21T15:22:14.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:22:14.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:14.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b978a783cb 2024-09-21T15:22:14.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b978a783cb 2024-09-21T15:22:14.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:14.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:14.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:14.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:14.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:22:14.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:22:14.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:22:14.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:14.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b978a783cb 2024-09-21T15:22:14.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:14.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:14.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 2799bff6-159c-4fac-9ff0-10626f02c84d 2024-09-21T15:22:14.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:14.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:14.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:14.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:14.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:14.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:14.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone1 2024-09-21T15:22:14.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:14.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:14.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:14.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:15.441 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:15.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone1': 2024-09-21T15:22:15.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 2.3 MiB in 10 objects 2024-09-21T15:22:15.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:22:15.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:15.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9accddda5 2024-09-21T15:22:15.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9accddda5 2024-09-21T15:22:15.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:15.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:15.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:15.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:15.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:22:15.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:22:15.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:22:15.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:15.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2@snap 2024-09-21T15:22:15.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 2.3 MiB 2024-09-21T15:22:15.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:22:15.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:22:15.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9accddda5 2024-09-21T15:22:15.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:15.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:15.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 58968828-f010-4fe8-9cec-0eac08331be4 2024-09-21T15:22:15.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:15.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:15.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:15.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone10 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:15.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:15.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:15.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone10 2024-09-21T15:22:15.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:15.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:15.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:15.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:16.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:16.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone10': 2024-09-21T15:22:16.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 3.3 MiB in 3 objects 2024-09-21T15:22:16.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:22:16.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:16.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4dff1441f 2024-09-21T15:22:16.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4dff1441f 2024-09-21T15:22:16.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:16.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:16.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:16.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:16.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:13:59 2024 2024-09-21T15:22:16.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:13:59 2024 2024-09-21T15:22:16.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:13:59 2024 2024-09-21T15:22:16.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:16.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone9@snap 2024-09-21T15:22:16.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 3.3 MiB 2024-09-21T15:22:16.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:22:16.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:22:16.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4dff1441f 2024-09-21T15:22:16.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:16.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:16.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 96bdba02-bf8c-4de9-8b36-c42ccdad5cf0 2024-09-21T15:22:16.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:16.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:16.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:16.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone11 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:16.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:16.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:16.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone11 2024-09-21T15:22:16.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:16.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:16.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:16.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:17.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:17.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone11': 2024-09-21T15:22:17.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 196 MiB in 52 objects 2024-09-21T15:22:17.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:22:17.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:17.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b97d3e789c 2024-09-21T15:22:17.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b97d3e789c 2024-09-21T15:22:17.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b97d3e789c 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 791a4288-2321-4776-a51f-ba5428b8b556 2024-09-21T15:22:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:17.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:17.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:17.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone12 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:17.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:17.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:17.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone12 2024-09-21T15:22:17.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:17.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:17.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:17.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:18.770 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:18.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone12': 2024-09-21T15:22:18.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 220 MiB in 30 objects 2024-09-21T15:22:18.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:22:18.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:18.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9a75aacc3 2024-09-21T15:22:18.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9a75aacc3 2024-09-21T15:22:18.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:18.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:18.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:18.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:18.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:18.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:18.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:18.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:18.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone11@snap 2024-09-21T15:22:18.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 178 MiB 2024-09-21T15:22:18.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:22:18.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:22:18.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9a75aacc3 2024-09-21T15:22:18.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:18.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:18.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 3dc01151-5655-47e1-a307-fa2b690265ce 2024-09-21T15:22:18.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:18.858 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:18.858 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:18.858 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone13 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:18.859 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:18.859 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:18.859 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone13 2024-09-21T15:22:18.859 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:18.859 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:18.859 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:18.859 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:19.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:19.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone13': 2024-09-21T15:22:19.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 68 MiB in 9 objects 2024-09-21T15:22:19.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:22:19.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:19.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b913528bb1 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b913528bb1 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b913528bb1 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:19.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 4d33624c-dcd8-4157-891c-5b117dfa1f81 2024-09-21T15:22:19.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:19.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:19.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:19.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone14 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:19.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:19.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:19.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone14 2024-09-21T15:22:19.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:19.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:19.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:19.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:20.937 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:21.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone14': 2024-09-21T15:22:21.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 185 MiB in 741 objects 2024-09-21T15:22:21.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:22:21.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:21.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b91f15b448 2024-09-21T15:22:21.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b91f15b448 2024-09-21T15:22:21.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:21.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:21.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:21.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:21.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:21.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:21.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:21.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:21.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone13@snap 2024-09-21T15:22:21.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 1.9 MiB 2024-09-21T15:22:21.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 KiB 2024-09-21T15:22:21.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:22:21.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b91f15b448 2024-09-21T15:22:21.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:21.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:21.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 9b697614-262c-4e5e-b05c-df51b0c07bbc 2024-09-21T15:22:21.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:21.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:21.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:21.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone15 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:21.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:21.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:21.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone15 2024-09-21T15:22:21.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:21.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:21.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:21.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:22.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:22.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone15': 2024-09-21T15:22:22.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 129 MiB in 36 objects 2024-09-21T15:22:22.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:22:22.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:22.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b954e30e39 2024-09-21T15:22:22.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b954e30e39 2024-09-21T15:22:22.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:22.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:22.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:22.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:22.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:22:22.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:22:22.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:22:22.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:22.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone14@snap 2024-09-21T15:22:22.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 129 MiB 2024-09-21T15:22:22.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 MiB 2024-09-21T15:22:22.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:22:22.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b954e30e39 2024-09-21T15:22:22.132 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:22.132 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:22.132 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 051f7b8b-b89c-4aa0-83cb-5e738fb8ed75 2024-09-21T15:22:22.132 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:22.138 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:22.138 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:22.138 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone16 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:22.138 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:22.138 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:22.138 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone16 2024-09-21T15:22:22.138 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:22.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:22.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:22.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:23.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:23.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone16': 2024-09-21T15:22:23.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 24 MiB in 24 objects 2024-09-21T15:22:23.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:22:23.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:23.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9a3a9ce17 2024-09-21T15:22:23.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9a3a9ce17 2024-09-21T15:22:23.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:23.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:23.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:23.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:23.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:22:23.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:22:23.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:22:23.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:23.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone15@snap 2024-09-21T15:22:23.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 24 MiB 2024-09-21T15:22:23.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:22:23.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:22:23.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9a3a9ce17 2024-09-21T15:22:23.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:23.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:23.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b77b49b0-d5db-407a-b80a-648f56d5ce27 2024-09-21T15:22:23.253 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:23.260 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:23.260 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:23.260 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone17 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:23.260 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:23.260 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:23.260 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone17 2024-09-21T15:22:23.260 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:23.260 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:23.260 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:23.260 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:23.356 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:23.349+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:22:23.356 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:23.349+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aac0e410 2024-09-21T15:22:23.356 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:23.349+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:22:23.356 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:23.349+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:22:23.360 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:23.349+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:22:23.360 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:23.349+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac8768f0 2024-09-21T15:22:23.360 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:23.349+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac877c70 2024-09-21T15:22:23.360 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:23.349+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:22:23.360 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:23.349+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:22:23.361 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:23.349+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:22:23.361 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:22:23.349+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7ac30 2024-09-21T15:22:24.261 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:24.386 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone17': 2024-09-21T15:22:24.386 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 489 KiB in 1 objects 2024-09-21T15:22:24.386 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:22:24.386 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:24.386 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c42fd3785e 2024-09-21T15:22:24.386 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c42fd3785e 2024-09-21T15:22:24.386 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:24.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:24.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:24.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:24.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:23 2024 2024-09-21T15:22:24.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:23 2024 2024-09-21T15:22:24.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:23 2024 2024-09-21T15:22:24.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:24.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone16@snap 2024-09-21T15:22:24.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 489 KiB 2024-09-21T15:22:24.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:22:24.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:22:24.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c42fd3785e 2024-09-21T15:22:24.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:24.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:24.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 284dc960-2660-419d-b060-d0e1013bae61 2024-09-21T15:22:24.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:24.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:24.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:24.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone18 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:24.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:24.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:24.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone18 2024-09-21T15:22:24.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:24.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:24.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:24.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:25.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:25.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone18': 2024-09-21T15:22:25.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 12 MiB in 9 objects 2024-09-21T15:22:25.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:22:25.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:25.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c47723ef7e 2024-09-21T15:22:25.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c47723ef7e 2024-09-21T15:22:25.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:25.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:25.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:25.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:25.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:22:25.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:22:25.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:22:25.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:25.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone17@snap 2024-09-21T15:22:25.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 12 MiB 2024-09-21T15:22:25.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:22:25.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:22:25.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c47723ef7e 2024-09-21T15:22:25.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:25.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:25.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 2df7d008-2aa8-45c9-992d-6135bdf46eec 2024-09-21T15:22:25.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:25.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:25.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:25.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone19 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:25.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:25.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:25.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone19 2024-09-21T15:22:25.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:25.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:25.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:25.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:26.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:26.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone19': 2024-09-21T15:22:26.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 180 MiB in 49 objects 2024-09-21T15:22:26.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:22:26.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:26.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c42dd1448 2024-09-21T15:22:26.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c42dd1448 2024-09-21T15:22:26.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:26.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:26.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:26.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:26.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:22:26.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:22:26.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:22:26.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:26.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone18@snap 2024-09-21T15:22:26.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 21 MiB 2024-09-21T15:22:26.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:22:26.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:22:26.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c42dd1448 2024-09-21T15:22:26.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:26.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:26.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 447d408d-afd0-42db-aef7-f284975751e4 2024-09-21T15:22:26.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:26.718 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:26.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:26.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:26.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:26.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:26.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone2 2024-09-21T15:22:26.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:26.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:26.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:26.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:27.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:27.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone2': 2024-09-21T15:22:27.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 3.2 MiB in 14 objects 2024-09-21T15:22:27.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:22:27.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:27.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b957a3485d 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b957a3485d 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone1@snap 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 3.2 MiB 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:22:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b957a3485d 2024-09-21T15:22:27.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:27.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:27.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 6c6c57d8-5093-4705-a2fd-c4493902301e 2024-09-21T15:22:27.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:27.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:27.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:27.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone20 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:27.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:27.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:27.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone20 2024-09-21T15:22:27.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:27.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:27.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:27.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:28.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:29.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone20': 2024-09-21T15:22:29.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 83 MiB in 14 objects 2024-09-21T15:22:29.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:22:29.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:29.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4fee8e58e 2024-09-21T15:22:29.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4fee8e58e 2024-09-21T15:22:29.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:29.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:29.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:29.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:29.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:13:59 2024 2024-09-21T15:22:29.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:13:59 2024 2024-09-21T15:22:29.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:13:59 2024 2024-09-21T15:22:29.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:29.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone19@snap 2024-09-21T15:22:29.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 83 MiB 2024-09-21T15:22:29.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:22:29.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:22:29.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4fee8e58e 2024-09-21T15:22:29.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:29.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:29.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: f7c87bd3-b914-47e1-bfe3-31c0275bb492 2024-09-21T15:22:29.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone21 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone21 2024-09-21T15:22:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:29.020 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:30.021 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:30.087 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone21': 2024-09-21T15:22:30.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 221 MiB in 450 objects 2024-09-21T15:22:30.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:22:30.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:30.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9324e7ebe 2024-09-21T15:22:30.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9324e7ebe 2024-09-21T15:22:30.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:30.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:30.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:30.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:30.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:55 2024 2024-09-21T15:22:30.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:55 2024 2024-09-21T15:22:30.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:55 2024 2024-09-21T15:22:30.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:30.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:22:30.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:22:30.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9324e7ebe 2024-09-21T15:22:30.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:30.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:30.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 270edf45-6738-4fd2-95f6-31351dcf77ee 2024-09-21T15:22:30.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:30.094 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:30.094 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:30.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone22 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:30.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:30.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:30.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone22 2024-09-21T15:22:30.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:30.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:30.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:30.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:31.096 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:31.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone22': 2024-09-21T15:22:31.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 107 MiB in 216 objects 2024-09-21T15:22:31.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:22:31.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:31.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9f8b7ca68 2024-09-21T15:22:31.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9f8b7ca68 2024-09-21T15:22:31.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:59 2024 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:59 2024 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:59 2024 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9f8b7ca68 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 43a73e62-4bcf-4dbf-97f4-0fa9db2adcba 2024-09-21T15:22:31.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:31.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:31.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:31.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone23 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:31.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:31.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:31.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone23 2024-09-21T15:22:31.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:31.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:31.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:31.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:32.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:32.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone23': 2024-09-21T15:22:32.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 97 MiB in 14 objects 2024-09-21T15:22:32.258 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:22:32.258 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:32.258 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b945a9c874 2024-09-21T15:22:32.258 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b945a9c874 2024-09-21T15:22:32.258 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:32.258 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:32.258 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:32.258 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:32.258 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:22:32.258 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:22:32.258 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:22:32.258 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:32.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone22@snap 2024-09-21T15:22:32.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 97 MiB 2024-09-21T15:22:32.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:22:32.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:22:32.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b945a9c874 2024-09-21T15:22:32.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:32.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:32.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: bae74f9d-63e6-459c-8ee7-ebd8fc1516a2 2024-09-21T15:22:32.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:32.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:32.266 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:32.266 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone24 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:32.266 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:32.266 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:32.266 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone24 2024-09-21T15:22:32.266 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:32.266 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:32.266 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:32.266 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:33.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:33.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone24': 2024-09-21T15:22:33.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 102 MiB in 28 objects 2024-09-21T15:22:33.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:22:33.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:33.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9bdc48c53 2024-09-21T15:22:33.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9bdc48c53 2024-09-21T15:22:33.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:33.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:33.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:33.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:33.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:05 2024 2024-09-21T15:22:33.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:05 2024 2024-09-21T15:22:33.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:05 2024 2024-09-21T15:22:33.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:33.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 MiB 2024-09-21T15:22:33.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:22:33.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9bdc48c53 2024-09-21T15:22:33.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:33.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:33.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: d82e23c2-c2b4-4fbc-b384-89a7b6924e53 2024-09-21T15:22:33.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:33.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:33.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:33.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone25 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:33.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:33.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:33.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone25 2024-09-21T15:22:33.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:33.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:33.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:33.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:34.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:34.411 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone25': 2024-09-21T15:22:34.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 118 MiB in 32 objects 2024-09-21T15:22:34.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:22:34.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:34.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b998422603 2024-09-21T15:22:34.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b998422603 2024-09-21T15:22:34.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:34.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:34.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:34.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:34.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:12 2024 2024-09-21T15:22:34.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:12 2024 2024-09-21T15:22:34.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:12 2024 2024-09-21T15:22:34.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:34.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:22:34.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:22:34.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b998422603 2024-09-21T15:22:34.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:34.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:34.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 1c70ef5e-d46a-47ae-a3f1-63ca19b272bb 2024-09-21T15:22:34.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:34.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:34.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:34.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone26 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:34.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:34.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:34.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone26 2024-09-21T15:22:34.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:34.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:34.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:34.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:35.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:35.498 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone26': 2024-09-21T15:22:35.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 3.5 MiB in 14 objects 2024-09-21T15:22:35.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:22:35.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:35.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b922229584 2024-09-21T15:22:35.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b922229584 2024-09-21T15:22:35.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:35.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:35.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:35.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:35.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:20 2024 2024-09-21T15:22:35.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:20 2024 2024-09-21T15:22:35.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:20 2024 2024-09-21T15:22:35.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:35.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone25@snap 2024-09-21T15:22:35.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 3.5 MiB 2024-09-21T15:22:35.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:22:35.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:22:35.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b922229584 2024-09-21T15:22:35.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:35.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:35.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 5d24c14f-898d-40de-9618-1f90e4165f5d 2024-09-21T15:22:35.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:35.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:35.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:35.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone27 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:35.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:35.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:35.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone27 2024-09-21T15:22:35.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:35.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:35.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:35.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:36.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:36.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone27': 2024-09-21T15:22:36.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 24 MiB in 104 objects 2024-09-21T15:22:36.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:22:36.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:36.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9e6a4d494 2024-09-21T15:22:36.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9e6a4d494 2024-09-21T15:22:36.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:36.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:36.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:36.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:36.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:26 2024 2024-09-21T15:22:36.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:26 2024 2024-09-21T15:22:36.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:26 2024 2024-09-21T15:22:36.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:36.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone26@snap 2024-09-21T15:22:36.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 24 MiB 2024-09-21T15:22:36.606 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 KiB 2024-09-21T15:22:36.606 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:22:36.606 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9e6a4d494 2024-09-21T15:22:36.606 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:36.606 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:36.606 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 533f49cb-9e85-487d-a73d-6b891eb8fdc6 2024-09-21T15:22:36.606 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:36.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:36.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:36.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone28 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:36.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:36.613 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:36.613 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone28 2024-09-21T15:22:36.613 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:36.613 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:36.613 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:36.613 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:37.614 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:37.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone28': 2024-09-21T15:22:37.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 218 MiB in 220 objects 2024-09-21T15:22:37.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:22:37.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:37.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b96aebfc71 2024-09-21T15:22:37.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b96aebfc71 2024-09-21T15:22:37.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:37.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:37.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:37.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:37.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:22:37.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:22:37.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:22:37.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:37.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:22:37.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:22:37.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b96aebfc71 2024-09-21T15:22:37.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:37.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:37.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b66f4a27-5eef-427c-b07a-9838403b8c68 2024-09-21T15:22:37.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone29 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone29 2024-09-21T15:22:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:37.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:37.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:38.380 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.365+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc15459450 2024-09-21T15:22:38.381 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.365+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546c750 2024-09-21T15:22:38.401 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546d790 2024-09-21T15:22:38.401 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc157fc000 2024-09-21T15:22:38.401 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:22:38.401 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1661a4e0 2024-09-21T15:22:38.401 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc16e7b5f0 2024-09-21T15:22:38.401 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1753d450 2024-09-21T15:22:38.402 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc192bcd00 2024-09-21T15:22:38.402 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939edd0 2024-09-21T15:22:38.402 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939ef70 2024-09-21T15:22:38.402 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fad0 2024-09-21T15:22:38.402 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fc70 2024-09-21T15:22:38.402 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc19691790 2024-09-21T15:22:38.402 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfce4e0 2024-09-21T15:22:38.402 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfcedd0 2024-09-21T15:22:38.402 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c383040 2024-09-21T15:22:38.402 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:22:38.402 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf592b0 2024-09-21T15:22:38.402 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3508f0 2024-09-21T15:22:38.402 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3515f0 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3516c0 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822680 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822b60 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e823ad0 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1f299930 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1fdea750 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1fdebd40 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4410 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f51e0 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21708000 2024-09-21T15:22:38.403 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21709ad0 2024-09-21T15:22:38.404 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21712dd0 2024-09-21T15:22:38.404 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc217131e0 2024-09-21T15:22:38.404 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21738c30 2024-09-21T15:22:38.404 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363bd40 2024-09-21T15:22:38.404 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f3450 2024-09-21T15:22:38.404 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc238280d0 2024-09-21T15:22:38.404 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc238285b0 2024-09-21T15:22:38.404 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc23829520 2024-09-21T15:22:38.404 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc23829d40 2024-09-21T15:22:38.404 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24055ad0 2024-09-21T15:22:38.404 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:38.393+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0cf70 2024-09-21T15:22:38.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:38.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone29': 2024-09-21T15:22:38.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 234 MiB in 236 objects 2024-09-21T15:22:38.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:22:38.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9e18b05c2 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9e18b05c2 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9e18b05c2 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:38.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: db1aec05-3e9e-4ce0-aee0-ee841cb39971 2024-09-21T15:22:38.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:38.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:38.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:38.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:38.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:38.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:38.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone3 2024-09-21T15:22:38.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:38.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:38.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:38.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:39.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:39.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone3': 2024-09-21T15:22:39.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:22:39.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:22:39.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:39.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9a3547592 2024-09-21T15:22:39.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9a3547592 2024-09-21T15:22:39.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9a3547592 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: d38f5425-d707-492a-a5ac-85995dac41f4 2024-09-21T15:22:39.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:39.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:39.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:39.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone30 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:39.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:39.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:39.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone30 2024-09-21T15:22:39.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:39.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:39.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:39.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:40.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:40.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone30': 2024-09-21T15:22:40.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 79 MiB in 20 objects 2024-09-21T15:22:40.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:22:40.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:40.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9448bc8f 2024-09-21T15:22:40.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9448bc8f 2024-09-21T15:22:40.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:40.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:40.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:40.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:40.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:22:40.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:22:40.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:22:40.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:40.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:22:40.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:22:40.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9448bc8f 2024-09-21T15:22:40.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:40.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:40.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: a77fae66-b2f4-4e7a-be7f-ae0afc3628db 2024-09-21T15:22:40.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:40.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:40.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:40.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone31 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:40.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:40.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:40.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone31 2024-09-21T15:22:40.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:40.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:40.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:40.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:41.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:42.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone31': 2024-09-21T15:22:42.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 20 MiB in 25 objects 2024-09-21T15:22:42.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:22:42.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:42.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c44e09845e 2024-09-21T15:22:42.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c44e09845e 2024-09-21T15:22:42.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:42.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:42.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:42.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:42.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:22:42.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:22:42.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:22:42.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:42.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone30@snap 2024-09-21T15:22:42.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 20 MiB 2024-09-21T15:22:42.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:22:42.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:22:42.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c44e09845e 2024-09-21T15:22:42.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:42.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:42.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 73d4dc39-4c38-488c-8699-cb2c5857bb77 2024-09-21T15:22:42.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:42.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:42.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:42.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone32 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:42.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:42.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:42.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone32 2024-09-21T15:22:42.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:42.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:42.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:42.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:43.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:43.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone32': 2024-09-21T15:22:43.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 70 MiB in 9 objects 2024-09-21T15:22:43.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:22:43.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4c50b9a53 2024-09-21T15:22:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4c50b9a53 2024-09-21T15:22:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:22:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:22:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:22:43.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:43.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone31@snap 2024-09-21T15:22:43.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 70 MiB 2024-09-21T15:22:43.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 MiB 2024-09-21T15:22:43.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:22:43.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4c50b9a53 2024-09-21T15:22:43.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:43.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:43.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 5d444500-7ead-4909-a696-94bdbd9f7e8c 2024-09-21T15:22:43.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:43.117 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:43.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:43.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone33 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:43.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:43.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:43.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone33 2024-09-21T15:22:43.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:43.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:43.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:43.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:43.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:43.466+0000 7ff753f07700 -1 reset not still connected to 0x56017219e750 2024-09-21T15:22:43.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:43.466+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:22:43.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:43.474+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:22:43.480 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:43.478+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:22:43.480 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:43.478+0000 7ff753f07700 -1 reset not still connected to 0x56017219fe10 2024-09-21T15:22:43.480 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:43.478+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:22:44.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:44.190 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone33': 2024-09-21T15:22:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:22:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:22:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c43848d5d6 2024-09-21T15:22:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c43848d5d6 2024-09-21T15:22:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:22:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:22:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:22:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:44.192 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:22:44.192 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:22:44.192 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c43848d5d6 2024-09-21T15:22:44.192 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:44.192 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:44.192 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 4bd5f744-bf83-4824-98f0-d27d9f1c8197 2024-09-21T15:22:44.192 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:44.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:44.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:44.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone34 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:44.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:44.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:44.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone34 2024-09-21T15:22:44.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:44.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:44.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:44.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:45.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:45.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone34': 2024-09-21T15:22:45.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 26 MiB in 9 objects 2024-09-21T15:22:45.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:22:45.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4c12881d2 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4c12881d2 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:13:58 2024 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:13:58 2024 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:13:58 2024 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone33@snap 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 26 MiB 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:22:45.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:22:45.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4c12881d2 2024-09-21T15:22:45.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:45.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:45.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 17d4ffa8-0813-4494-8b4e-ee40ecedca48 2024-09-21T15:22:45.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:45.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:45.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:45.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone35 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:45.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:45.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:45.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone35 2024-09-21T15:22:45.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:45.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:45.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:45.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:46.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:46.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone35': 2024-09-21T15:22:46.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 1.4 MiB in 9 objects 2024-09-21T15:22:46.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4101bd2c8 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4101bd2c8 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone34@snap 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 1.4 MiB 2024-09-21T15:22:46.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:22:46.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:22:46.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4101bd2c8 2024-09-21T15:22:46.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:46.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:46.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 195f6116-53dd-4f4c-9885-eb0d620dc00c 2024-09-21T15:22:46.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:46.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:46.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:46.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone36 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:46.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:46.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:46.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone36 2024-09-21T15:22:46.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:46.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:46.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:46.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:47.477 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:47.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone36': 2024-09-21T15:22:47.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 25 MiB in 5 objects 2024-09-21T15:22:47.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:22:47.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:47.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c46bf61246 2024-09-21T15:22:47.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c46bf61246 2024-09-21T15:22:47.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:47.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:47.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:47.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:47.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:14:58 2024 2024-09-21T15:22:47.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:14:58 2024 2024-09-21T15:22:47.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:14:58 2024 2024-09-21T15:22:47.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:47.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone35@snap 2024-09-21T15:22:47.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 25 MiB 2024-09-21T15:22:47.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:22:47.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:22:47.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c46bf61246 2024-09-21T15:22:47.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:47.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:47.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 36cc0788-436b-4847-beeb-ef7205663578 2024-09-21T15:22:47.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:47.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:47.632 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:47.632 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone37 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:47.632 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:47.632 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:47.632 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone37 2024-09-21T15:22:47.633 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:47.633 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:47.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:47.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:48.633 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:48.793 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone37': 2024-09-21T15:22:48.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 12 MiB in 24 objects 2024-09-21T15:22:48.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:22:48.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:48.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c495bd6f51 2024-09-21T15:22:48.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c495bd6f51 2024-09-21T15:22:48.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:48.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:48.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:48.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:48.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:15:28 2024 2024-09-21T15:22:48.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:15:28 2024 2024-09-21T15:22:48.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:15:28 2024 2024-09-21T15:22:48.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:48.795 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone36@snap 2024-09-21T15:22:48.795 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 12 MiB 2024-09-21T15:22:48.795 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 KiB 2024-09-21T15:22:48.795 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:22:48.795 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c495bd6f51 2024-09-21T15:22:48.795 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:48.795 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:48.795 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: ab9322e9-f0d3-4e57-ba54-faf9cbd16ee7 2024-09-21T15:22:48.796 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:48.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:48.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:48.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone38 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:48.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:48.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:48.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone38 2024-09-21T15:22:48.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:48.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:48.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:48.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:49.665 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.4166585239146944) > weight (0.25) 2024-09-21T15:22:49.665 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.1 2024-09-21T15:22:49.665 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Sent signal 15 2024-09-21T15:22:49.665 INFO:tasks.rbd_mirror_thrash:waiting for 4 secs before reviving daemons 2024-09-21T15:22:49.666 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:22:49.665+0000 7fa8ff349700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 (PID: 61717) UID: 1000 2024-09-21T15:22:49.805 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:49.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone38': 2024-09-21T15:22:49.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:22:49.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:22:49.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:49.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c45fbe2b2b 2024-09-21T15:22:49.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c45fbe2b2b 2024-09-21T15:22:49.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:15:58 2024 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:15:58 2024 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:15:58 2024 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c45fbe2b2b 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 867e338b-f348-4ad9-b746-7ff49fa378b8 2024-09-21T15:22:49.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:49.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:49.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:49.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone39 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:49.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:49.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:49.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone39 2024-09-21T15:22:49.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:49.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:49.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:49.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:50.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:50.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone39': 2024-09-21T15:22:50.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 176 MiB in 45 objects 2024-09-21T15:22:50.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:22:50.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:50.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4f845d0b5 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4f845d0b5 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:57 2024 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:57 2024 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:57 2024 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4f845d0b5 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:50.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 235c6780-0eb8-4b58-8a3e-08efcc9ea11c 2024-09-21T15:22:50.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:50.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:50.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:50.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:50.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:50.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:50.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone4 2024-09-21T15:22:50.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:50.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:50.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:50.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:51.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:52.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone4': 2024-09-21T15:22:52.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 232 MiB in 32 objects 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9f94c2b0c 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9f94c2b0c 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:57 2024 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:57 2024 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:57 2024 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:22:52.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:22:52.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9f94c2b0c 2024-09-21T15:22:52.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:52.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:52.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 0bb25ca5-fa0f-42d0-af66-5ebefa81e993 2024-09-21T15:22:52.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:52.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:52.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone40 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone40 2024-09-21T15:22:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:52.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:53.031 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:53.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone40': 2024-09-21T15:22:53.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 228 MiB in 126 objects 2024-09-21T15:22:53.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:22:53.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 1 2024-09-21T15:22:53.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4596ac0bc 2024-09-21T15:22:53.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4596ac0bc 2024-09-21T15:22:53.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:53.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:53.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:53.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:53.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:12:28 2024 2024-09-21T15:22:53.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:12:28 2024 2024-09-21T15:22:53.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:12:28 2024 2024-09-21T15:22:53.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:53.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone39@snap 2024-09-21T15:22:53.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 34 MiB 2024-09-21T15:22:53.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:22:53.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:22:53.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4596ac0bc 2024-09-21T15:22:53.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:53.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:53.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 72cf5188-c646-4c84-b151-51750759e12e 2024-09-21T15:22:53.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:53.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:53.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:53.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:53.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:53.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:53.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone5 2024-09-21T15:22:53.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:53.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:53.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:53.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:53.666 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.1 2024-09-21T15:22:53.666 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:22:53.666 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.1 2024-09-21T15:22:53.666 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2024-09-21T15:22:53.666 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2024-09-21T15:22:53.669 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2024-09-21T15:22:53.669 INFO:tasks.rbd_mirror_thrash:waiting for 100 secs before thrashing 2024-09-21T15:22:54.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:54.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone5': 2024-09-21T15:22:54.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:22:54.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:22:54.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:54.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9a383f97a 2024-09-21T15:22:54.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9a383f97a 2024-09-21T15:22:54.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:27 2024 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9a383f97a 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 0e735348-ba0d-4e20-ac7c-dbc118fb42ba 2024-09-21T15:22:54.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:54.402 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:54.402 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:54.402 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone6 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:54.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:54.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:54.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone6 2024-09-21T15:22:54.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:54.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:54.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:54.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:55.404 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:55.410 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.404+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4680 2024-09-21T15:22:55.410 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.404+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4c30 2024-09-21T15:22:55.410 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.404+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff52b0 2024-09-21T15:22:55.410 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.404+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5d40 2024-09-21T15:22:55.410 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.404+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5ee0 2024-09-21T15:22:55.410 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.404+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0ee7a340 2024-09-21T15:22:55.410 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.404+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0ee7b450 2024-09-21T15:22:55.410 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.404+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0ee7b5f0 2024-09-21T15:22:55.415 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.408+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc154580d0 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.408+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc15459450 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.408+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc154595f0 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.408+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546c750 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.408+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546c820 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.408+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546d1e0 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.408+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1546d790 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.408+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc157fc000 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.408+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.408+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1661a4e0 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.408+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc16e7b5f0 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.408+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1753d450 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.412+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc192bcd00 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.412+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939edd0 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.412+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939ef70 2024-09-21T15:22:55.416 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.412+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fad0 2024-09-21T15:22:55.417 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.412+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939fc70 2024-09-21T15:22:55.420 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc19691790 2024-09-21T15:22:55.420 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfce4e0 2024-09-21T15:22:55.420 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfcedd0 2024-09-21T15:22:55.420 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1c383040 2024-09-21T15:22:55.420 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:22:55.420 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf592b0 2024-09-21T15:22:55.420 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3508f0 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3516c0 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822680 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e822b60 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e823ad0 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1f299930 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4410 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f51e0 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5ee0 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21708000 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f3450 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc238280d0 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc23829d40 2024-09-21T15:22:55.421 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24055ad0 2024-09-21T15:22:55.422 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:22:55.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0cf70 2024-09-21T15:22:55.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone6': 2024-09-21T15:22:55.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 15 MiB in 5 objects 2024-09-21T15:22:55.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:22:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9d3120d59 2024-09-21T15:22:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9d3120d59 2024-09-21T15:22:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:22:55.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:55.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone5@snap 2024-09-21T15:22:55.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 15 MiB 2024-09-21T15:22:55.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:22:55.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:22:55.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9d3120d59 2024-09-21T15:22:55.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:55.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:55.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 8025792e-3904-4159-9de2-729ebbf24852 2024-09-21T15:22:55.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:55.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:55.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:55.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone7 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:55.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:55.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:55.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone7 2024-09-21T15:22:55.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:55.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:55.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:55.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:56.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:56.617 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone7': 2024-09-21T15:22:56.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 13 MiB in 15 objects 2024-09-21T15:22:56.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:22:56.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:56.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9cb5d37e3 2024-09-21T15:22:56.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9cb5d37e3 2024-09-21T15:22:56.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:56.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:56.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:56.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:56.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:22:56.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:22:56.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:22:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone6@snap 2024-09-21T15:22:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 13 MiB 2024-09-21T15:22:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:22:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:22:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9cb5d37e3 2024-09-21T15:22:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 6c3b3b70-9cbd-4de9-9ecc-2955d67c515d 2024-09-21T15:22:56.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:56.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:56.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:56.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone8 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:56.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:56.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:56.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone8 2024-09-21T15:22:56.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:56.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:56.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:56.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:57.627 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:57.806 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone8': 2024-09-21T15:22:57.806 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 6.6 MiB in 2 objects 2024-09-21T15:22:57.806 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:22:57.806 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:57.806 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9ae4912b3 2024-09-21T15:22:57.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9ae4912b3 2024-09-21T15:22:57.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:57.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:57.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:57.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:57.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:22:57.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:22:57.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:22:57.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:57.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone7@snap 2024-09-21T15:22:57.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 6.6 MiB 2024-09-21T15:22:57.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:22:57.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:22:57.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9ae4912b3 2024-09-21T15:22:57.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:57.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:57.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: f620a0f2-d707-4b9a-9838-275e4f310336 2024-09-21T15:22:57.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:57.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:57.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:57.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.2-clone9 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:57.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:57.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:57.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone9 2024-09-21T15:22:57.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:57.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:57.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:57.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:58.610 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.601+0000 7ff753f07700 -1 reset not still connected to 0x560168802680 2024-09-21T15:22:58.611 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.601+0000 7ff753f07700 -1 reset not still connected to 0x560168803380 2024-09-21T15:22:58.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.613+0000 7ff753f07700 -1 reset not still connected to 0x56016983fba0 2024-09-21T15:22:58.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.613+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:22:58.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.613+0000 7ff753f07700 -1 reset not still connected to 0x56016f162750 2024-09-21T15:22:58.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.613+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:22:58.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.613+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf3380 2024-09-21T15:22:58.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.613+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98750 2024-09-21T15:22:58.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.617+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:22:58.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.617+0000 7ff753f07700 -1 reset not still connected to 0x56016feffba0 2024-09-21T15:22:58.627 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.621+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:22:58.631 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.625+0000 7ff753f07700 -1 reset not still connected to 0x56017063ea90 2024-09-21T15:22:58.633 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.625+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8270 2024-09-21T15:22:58.633 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.625+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:22:58.633 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.625+0000 7ff753f07700 -1 reset not still connected to 0x560170f65930 2024-09-21T15:22:58.634 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.629+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:22:58.634 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.629+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:22:58.634 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.629+0000 7ff753f07700 -1 reset not still connected to 0x56017219e1a0 2024-09-21T15:22:58.634 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.629+0000 7ff753f07700 -1 reset not still connected to 0x56017219e340 2024-09-21T15:22:58.634 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:22:58.629+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:22:58.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.2-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:58.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.2-clone9': 2024-09-21T15:22:58.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 13 MiB in 20 objects 2024-09-21T15:22:58.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:22:58.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:22:58.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c482b44124 2024-09-21T15:22:58.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c482b44124 2024-09-21T15:22:58.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:22:58.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:22:58.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:22:58.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:22:58.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:11:59 2024 2024-09-21T15:22:58.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:11:59 2024 2024-09-21T15:22:58.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:59 2024 2024-09-21T15:22:58.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:22:58.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.2-clone8@snap 2024-09-21T15:22:58.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 13 MiB 2024-09-21T15:22:58.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:22:58.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:22:58.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c482b44124 2024-09-21T15:22:58.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:22:58.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:22:58.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: fb93addd-a120-4280-8d34-f4656e3d52f5 2024-09-21T15:22:58.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:22:58.965 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:22:58.965 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:22:58.965 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:58.965 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:22:58.965 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:22:58.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3 2024-09-21T15:22:58.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:22:58.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:22:58.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:22:58.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:22:59.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:00.031 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3': 2024-09-21T15:23:00.031 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 124 MiB in 32 objects 2024-09-21T15:23:00.031 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:23:00.031 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:00.031 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b94edcee2e 2024-09-21T15:23:00.031 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b94edcee2e 2024-09-21T15:23:00.031 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:00.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:00.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:00.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:00.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:23:00.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:23:00.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:23:00.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:00.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b94edcee2e 2024-09-21T15:23:00.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:00.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:00.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 3e87a2ed-dc29-47ec-976a-1a33bfabf914 2024-09-21T15:23:00.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:00.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:00.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:00.037 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:00.037 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:00.037 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:00.037 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone1 2024-09-21T15:23:00.037 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:00.037 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:00.037 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:00.037 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:01.038 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:01.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone1': 2024-09-21T15:23:01.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 21 MiB in 10 objects 2024-09-21T15:23:01.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:23:01.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:01.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b97f768aec 2024-09-21T15:23:01.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b97f768aec 2024-09-21T15:23:01.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:01.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:01.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:01.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:01.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:23:01.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:23:01.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:23:01.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:01.121 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3@snap 2024-09-21T15:23:01.121 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 21 MiB 2024-09-21T15:23:01.121 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 MiB 2024-09-21T15:23:01.121 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:23:01.121 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b97f768aec 2024-09-21T15:23:01.121 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:01.121 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:01.121 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 2b6dc334-3fe0-49f9-81e0-cb6bcee84c98 2024-09-21T15:23:01.121 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:01.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:01.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:01.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone10 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:01.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:01.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:01.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone10 2024-09-21T15:23:01.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:01.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:01.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:01.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:02.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:02.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone10': 2024-09-21T15:23:02.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 87 MiB in 28 objects 2024-09-21T15:23:02.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:23:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b96dcdec52 2024-09-21T15:23:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b96dcdec52 2024-09-21T15:23:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:02.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:02.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone9@snap 2024-09-21T15:23:02.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 87 MiB 2024-09-21T15:23:02.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:23:02.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:23:02.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b96dcdec52 2024-09-21T15:23:02.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:02.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:02.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 7f000672-af45-450e-aaab-fb2ef2b65d33 2024-09-21T15:23:02.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:02.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:02.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:02.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone11 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:02.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:02.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:02.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone11 2024-09-21T15:23:02.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:02.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:02.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:02.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:03.250 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:03.362 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone11': 2024-09-21T15:23:03.362 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 222 MiB in 890 objects 2024-09-21T15:23:03.362 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:23:03.362 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:03.362 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b949a7475e 2024-09-21T15:23:03.363 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b949a7475e 2024-09-21T15:23:03.363 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:03.363 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:03.363 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:03.363 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:03.363 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:23:03.363 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:23:03.363 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:23:03.363 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone10@snap 2024-09-21T15:23:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 60 MiB 2024-09-21T15:23:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 KiB 2024-09-21T15:23:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:23:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b949a7475e 2024-09-21T15:23:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 90681343-98ff-49b4-a3fe-5ba10265e680 2024-09-21T15:23:03.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:03.372 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:03.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:03.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone12 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:03.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:03.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:03.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone12 2024-09-21T15:23:03.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:03.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:03.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:03.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:04.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:04.510 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone12': 2024-09-21T15:23:04.510 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 6.2 MiB in 14 objects 2024-09-21T15:23:04.510 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:23:04.510 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:04.510 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b975af8440 2024-09-21T15:23:04.510 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b975af8440 2024-09-21T15:23:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:23:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:23:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:23:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone11@snap 2024-09-21T15:23:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 6.2 MiB 2024-09-21T15:23:04.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:23:04.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:23:04.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b975af8440 2024-09-21T15:23:04.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:04.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:04.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 8734c6e5-3fa8-4c37-acd9-f56594af88e1 2024-09-21T15:23:04.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:04.520 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:04.520 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:04.520 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone13 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:04.520 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:04.520 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:04.520 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone13 2024-09-21T15:23:04.521 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:04.521 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:04.521 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:04.521 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:05.521 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:05.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone13': 2024-09-21T15:23:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 172 MiB in 90 objects 2024-09-21T15:23:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:23:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9acd75409 2024-09-21T15:23:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9acd75409 2024-09-21T15:23:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:58 2024 2024-09-21T15:23:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:58 2024 2024-09-21T15:23:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:58 2024 2024-09-21T15:23:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:05.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:23:05.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:23:05.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9acd75409 2024-09-21T15:23:05.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:05.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:05.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: c8fe4afe-785c-497e-a798-bcb2c774854a 2024-09-21T15:23:05.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:05.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:05.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:05.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone14 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:05.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:05.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:05.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone14 2024-09-21T15:23:05.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:05.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:05.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:05.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:06.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone14': 2024-09-21T15:23:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 209 MiB in 840 objects 2024-09-21T15:23:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:23:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b939111373 2024-09-21T15:23:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b939111373 2024-09-21T15:23:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:23:06.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:23:06.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:23:06.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:06.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:23:06.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:23:06.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b939111373 2024-09-21T15:23:06.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:06.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:06.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: afce2605-a8db-416c-a324-7471613e476c 2024-09-21T15:23:06.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:06.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:06.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:06.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone15 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:06.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:06.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:06.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone15 2024-09-21T15:23:06.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:06.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:06.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:06.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:07.672 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:07.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone15': 2024-09-21T15:23:07.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 3.4 MiB in 24 objects 2024-09-21T15:23:07.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:23:07.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:07.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b98a97c821 2024-09-21T15:23:07.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b98a97c821 2024-09-21T15:23:07.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:07.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:07.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:07.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:07.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:07.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:07.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:07.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:07.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone14@snap 2024-09-21T15:23:07.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 3.4 MiB 2024-09-21T15:23:07.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:23:07.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:23:07.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b98a97c821 2024-09-21T15:23:07.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:07.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:07.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: cabbf079-1702-448b-b0df-97a6f9e3b176 2024-09-21T15:23:07.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:07.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:07.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:07.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone16 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:07.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:07.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:07.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone16 2024-09-21T15:23:07.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:07.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:07.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:07.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:08.410 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:08.408+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf3061a00 2024-09-21T15:23:08.418 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:08.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf49c3a00 2024-09-21T15:23:08.425 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:08.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff4680 2024-09-21T15:23:08.425 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:08.416+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0bff5d40 2024-09-21T15:23:08.425 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:08.420+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:23:08.425 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:08.420+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:23:08.425 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:08.420+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:23:08.425 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:08.420+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:23:08.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:08.854 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone16': 2024-09-21T15:23:08.854 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 74 MiB in 26 objects 2024-09-21T15:23:08.854 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:23:08.854 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:08.854 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b954b1833a 2024-09-21T15:23:08.854 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b954b1833a 2024-09-21T15:23:08.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:08.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:08.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:08.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:08.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:08.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:08.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:08.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:08.856 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone15@snap 2024-09-21T15:23:08.856 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 74 MiB 2024-09-21T15:23:08.856 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:23:08.856 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:23:08.856 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b954b1833a 2024-09-21T15:23:08.856 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:08.856 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:08.856 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: f2dae9ca-5e22-44e6-90a3-2cbebe5fa594 2024-09-21T15:23:08.856 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:08.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:08.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:08.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone17 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:08.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:08.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:08.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone17 2024-09-21T15:23:08.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:08.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:08.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:08.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:09.865 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:09.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone17': 2024-09-21T15:23:09.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:23:09.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:23:09.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:09.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9cb397eea 2024-09-21T15:23:09.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9cb397eea 2024-09-21T15:23:09.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9cb397eea 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 1a1e66f6-5757-4250-90a9-6afa01bb72a4 2024-09-21T15:23:09.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:09.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:09.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:09.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone18 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:09.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:09.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:09.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone18 2024-09-21T15:23:09.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:09.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:09.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:09.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:10.937 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:11.059 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone18': 2024-09-21T15:23:11.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 284 KiB in 1 objects 2024-09-21T15:23:11.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:23:11.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:11.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4828f49bd 2024-09-21T15:23:11.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4828f49bd 2024-09-21T15:23:11.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:11.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:11.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:11.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:11.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:23:11.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:23:11.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:23:11.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:11.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone17@snap 2024-09-21T15:23:11.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 284 KiB 2024-09-21T15:23:11.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:23:11.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:23:11.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4828f49bd 2024-09-21T15:23:11.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:11.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:11.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 7d0b51cc-d698-4c7c-856b-37b97a187993 2024-09-21T15:23:11.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone19 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:11.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:11.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:11.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone19 2024-09-21T15:23:11.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:11.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:11.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:11.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:12.070 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:12.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone19': 2024-09-21T15:23:12.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c41005fdd3 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c41005fdd3 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:23:12.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:23:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c41005fdd3 2024-09-21T15:23:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: fa6ea117-5701-4c3c-97d9-547c6b28451e 2024-09-21T15:23:12.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:12.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:12.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:12.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:12.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:12.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:12.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone2 2024-09-21T15:23:12.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:12.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:12.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:12.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:12.330 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:12.324+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:23:12.330 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:12.324+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4dcb6c0 2024-09-21T15:23:12.330 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:12.324+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec7790 2024-09-21T15:23:12.330 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:12.324+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a780e0d0 2024-09-21T15:23:12.336 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:12.332+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:23:12.344 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:12.340+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1a00 2024-09-21T15:23:12.353 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:12.348+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab151e0 2024-09-21T15:23:12.353 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:12.348+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1fad0 2024-09-21T15:23:12.353 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:12.348+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:23:12.353 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:12.348+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:23:12.353 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:12.348+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:23:12.359 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:12.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d5f0 2024-09-21T15:23:12.359 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:12.352+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:23:13.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:13.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone2': 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b91bb27fdf 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b91bb27fdf 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:13.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:23:13.215 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:23:13.215 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b91bb27fdf 2024-09-21T15:23:13.215 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:13.215 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:13.215 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 6db0eab9-313d-45bf-828c-bf42d15aefce 2024-09-21T15:23:13.215 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:13.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:13.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:13.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone20 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:13.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:13.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:13.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone20 2024-09-21T15:23:13.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:13.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:13.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:13.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:13.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.473+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adaa3c70 2024-09-21T15:23:13.483 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.477+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25aa90 2024-09-21T15:23:13.483 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.477+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25bba0 2024-09-21T15:23:13.484 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.481+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344680 2024-09-21T15:23:13.484 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.481+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:23:13.499 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.497+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810b60 2024-09-21T15:23:13.513 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.497+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae8d8000 2024-09-21T15:23:13.515 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.509+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:23:13.515 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.509+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b040 2024-09-21T15:23:13.530 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.525+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aef04b60 2024-09-21T15:23:13.530 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.525+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac0000 2024-09-21T15:23:13.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.525+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb184e0 2024-09-21T15:23:13.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.529+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb192b0 2024-09-21T15:23:13.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.529+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:23:13.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.541+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:23:13.543 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.541+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:23:13.544 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.541+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:23:13.557 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.553+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9e8f0 2024-09-21T15:23:13.557 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.553+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:23:13.557 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.553+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f930 2024-09-21T15:23:13.557 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.553+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07790 2024-09-21T15:23:13.557 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.553+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:23:13.557 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.553+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83930 2024-09-21T15:23:13.559 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4c8f0 2024-09-21T15:23:13.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4cf70 2024-09-21T15:23:13.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:23:13.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:23:13.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b10492b0 2024-09-21T15:23:13.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:23:13.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049ee0 2024-09-21T15:23:13.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b10d1a00 2024-09-21T15:23:13.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:23:13.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:23:13.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6b60 2024-09-21T15:23:13.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:23:13.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:23:13.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:23:13.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1040 2024-09-21T15:23:13.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1ba0 2024-09-21T15:23:13.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:23:13.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c9c0 2024-09-21T15:23:13.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266d6c0 2024-09-21T15:23:13.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b28585b0 2024-09-21T15:23:13.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50270 2024-09-21T15:23:13.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50410 2024-09-21T15:23:13.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f504e0 2024-09-21T15:23:13.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50750 2024-09-21T15:23:13.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:23:13.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50a90 2024-09-21T15:23:13.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50b60 2024-09-21T15:23:13.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50f70 2024-09-21T15:23:13.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f512b0 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51860 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51930 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51a00 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51ad0 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31004e0 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31009c0 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:23:13.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:23:13.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:23:13.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc410 2024-09-21T15:23:13.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:23:13.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:23:13.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.565+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd520 2024-09-21T15:23:13.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.565+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd6c0 2024-09-21T15:23:13.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.565+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:23:13.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.565+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:23:13.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.565+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:23:13.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.565+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:23:13.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.565+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b36868f0 2024-09-21T15:23:13.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.565+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:23:13.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.565+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810b60 2024-09-21T15:23:13.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.565+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:23:13.571 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.565+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811a00 2024-09-21T15:23:13.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:23:13.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3935ba0 2024-09-21T15:23:13.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:23:13.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45de340 2024-09-21T15:23:13.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:23:13.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45df860 2024-09-21T15:23:13.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76000 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76410 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76c30 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76d00 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd2ea0 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3ad0 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8820 2024-09-21T15:23:13.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:23:13.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:23:13.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:23:13.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:23:13.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:23:13.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:23:13.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:23:13.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:23:13.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:23:13.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff450 2024-09-21T15:23:13.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:23:13.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:23:13.575 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.573+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:23:13.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.573+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:23:13.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.573+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:23:13.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.573+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eab60 2024-09-21T15:23:13.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.573+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:23:13.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.573+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:23:13.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.573+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:23:13.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.573+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7b790 2024-09-21T15:23:13.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.573+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d85b0 2024-09-21T15:23:13.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.573+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:23:13.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:23:13.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:23:13.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:23:13.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:23:13.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:23:13.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:23:13.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782410 2024-09-21T15:23:13.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782680 2024-09-21T15:23:13.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:23:13.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782820 2024-09-21T15:23:13.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782a90 2024-09-21T15:23:13.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782d00 2024-09-21T15:23:13.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:23:13.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783040 2024-09-21T15:23:13.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:23:13.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:23:13.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783380 2024-09-21T15:23:13.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:23:13.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783520 2024-09-21T15:23:13.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:23:13.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:23:13.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:23:13.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783e10 2024-09-21T15:23:13.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:23:13.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de89c0 2024-09-21T15:23:13.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9110 2024-09-21T15:23:13.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de95f0 2024-09-21T15:23:13.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9930 2024-09-21T15:23:13.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9ba0 2024-09-21T15:23:13.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46270 2024-09-21T15:23:13.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:23:13.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:23:13.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46ea0 2024-09-21T15:23:13.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47040 2024-09-21T15:23:13.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:23:13.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:23:13.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeef70 2024-09-21T15:23:13.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a4e0 2024-09-21T15:23:13.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cd1e0 2024-09-21T15:23:13.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b86c6270 2024-09-21T15:23:13.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b86c69c0 2024-09-21T15:23:13.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:23:13.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:23:13.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90d00 2024-09-21T15:23:13.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8f82270 2024-09-21T15:23:13.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8f83ad0 2024-09-21T15:23:13.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:23:13.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90116c0 2024-09-21T15:23:13.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1e10 2024-09-21T15:23:13.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165110 2024-09-21T15:23:13.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:23:13.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f790 2024-09-21T15:23:13.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f930 2024-09-21T15:23:13.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:23:13.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8f70 2024-09-21T15:23:13.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3380 2024-09-21T15:23:13.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d35f0 2024-09-21T15:23:13.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3860 2024-09-21T15:23:13.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e60d0 2024-09-21T15:23:13.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e65b0 2024-09-21T15:23:13.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e6c30 2024-09-21T15:23:13.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e76c0 2024-09-21T15:23:13.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e7c70 2024-09-21T15:23:13.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:23:13.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72e4e0 2024-09-21T15:23:13.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72f380 2024-09-21T15:23:13.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:23:13.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fe10 2024-09-21T15:23:13.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915860 2024-09-21T15:23:13.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915e10 2024-09-21T15:23:13.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6270 2024-09-21T15:23:13.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:23:13.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ad638750 2024-09-21T15:23:13.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adaa3c70 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25aa90 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25bba0 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344680 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae8d8000 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b040 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:23:13.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:23:13.596 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:23:13.597 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:23:13.597 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:23:13.597 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:23:13.597 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:23:13.597 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:23:13.597 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:23:13.597 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:23:13.597 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:23:13.597 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:23:13.597 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:23:13.597 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:13.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:23:14.222 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:14.379 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone20': 2024-09-21T15:23:14.379 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 87 MiB in 177 objects 2024-09-21T15:23:14.379 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:23:14.379 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:14.379 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4773b388b 2024-09-21T15:23:14.379 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4773b388b 2024-09-21T15:23:14.379 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:14.379 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:14.379 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:14.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:14.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:23:14.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:23:14.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:23:14.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:14.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone19@snap 2024-09-21T15:23:14.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 87 MiB 2024-09-21T15:23:14.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:23:14.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:23:14.381 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4773b388b 2024-09-21T15:23:14.381 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:14.381 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:14.381 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 30273c29-bc9f-490c-9701-443a18e6e419 2024-09-21T15:23:14.381 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:14.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:14.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:14.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone21 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:14.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:14.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:14.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone21 2024-09-21T15:23:14.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:14.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:14.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:14.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:15.391 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone21': 2024-09-21T15:23:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 162 MiB in 650 objects 2024-09-21T15:23:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:23:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b91aafd7aa 2024-09-21T15:23:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b91aafd7aa 2024-09-21T15:23:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:15.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:15.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:15.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:15.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:15.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:23:15.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:23:15.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b91aafd7aa 2024-09-21T15:23:15.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:15.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:15.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 1ee4b202-75aa-4164-b5c6-1cf01e44cb5b 2024-09-21T15:23:15.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:15.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:15.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:15.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone22 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:15.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:15.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:15.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone22 2024-09-21T15:23:15.461 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:15.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:15.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:15.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:16.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:16.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone22': 2024-09-21T15:23:16.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:23:16.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:23:16.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:16.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b98380339d 2024-09-21T15:23:16.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b98380339d 2024-09-21T15:23:16.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:16.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:16.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:16.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:16.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:16.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:23:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:23:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b98380339d 2024-09-21T15:23:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 1aa9c1ba-00e1-4a95-ab0e-5a12698846c4 2024-09-21T15:23:16.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:16.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:16.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:16.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone23 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:16.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:16.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:16.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone23 2024-09-21T15:23:16.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:16.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:16.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:16.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:17.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:17.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone23': 2024-09-21T15:23:17.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:23:17.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:23:17.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:17.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b91e56c5f6 2024-09-21T15:23:17.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b91e56c5f6 2024-09-21T15:23:17.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:17.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:17.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:17.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:17.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:17.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:17.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:17.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:17.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:23:17.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:23:17.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b91e56c5f6 2024-09-21T15:23:17.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:17.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:17.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: cdc361e2-89eb-4d89-8033-df23aa089fc1 2024-09-21T15:23:17.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:17.608 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:17.608 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:17.608 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone24 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:17.608 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:17.608 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:17.608 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone24 2024-09-21T15:23:17.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:17.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:17.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:17.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:18.547 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.545+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25bba0 2024-09-21T15:23:18.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae345860 2024-09-21T15:23:18.560 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.557+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae810b60 2024-09-21T15:23:18.565 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae8d8000 2024-09-21T15:23:18.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2a8f0 2024-09-21T15:23:18.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2b040 2024-09-21T15:23:18.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afac0000 2024-09-21T15:23:18.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb184e0 2024-09-21T15:23:18.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb192b0 2024-09-21T15:23:18.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdc000 2024-09-21T15:23:18.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:23:18.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.561+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddad0 2024-09-21T15:23:18.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07ccf70 2024-09-21T15:23:18.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9f040 2024-09-21T15:23:18.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c83380 2024-09-21T15:23:18.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4c8f0 2024-09-21T15:23:18.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:23:18.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dac820 2024-09-21T15:23:18.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.569+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1049380 2024-09-21T15:23:18.577 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.573+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:23:18.577 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.573+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e68f0 2024-09-21T15:23:18.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b14de340 2024-09-21T15:23:18.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:23:18.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833ad0 2024-09-21T15:23:18.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd1040 2024-09-21T15:23:18.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:23:18.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c9c0 2024-09-21T15:23:18.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b28585b0 2024-09-21T15:23:18.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:23:18.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:23:18.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:23:18.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:23:18.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51930 2024-09-21T15:23:18.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4820 2024-09-21T15:23:18.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.577+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4b60 2024-09-21T15:23:18.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:23:18.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388340 2024-09-21T15:23:18.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:23:18.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3389ba0 2024-09-21T15:23:18.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc000 2024-09-21T15:23:18.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc410 2024-09-21T15:23:18.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fc680 2024-09-21T15:23:18.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.581+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd040 2024-09-21T15:23:18.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd520 2024-09-21T15:23:18.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:23:18.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd930 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fdc70 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3811520 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388eb60 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167ba0 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d760d0 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d771e0 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8fee0 2024-09-21T15:23:18.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:23:18.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:23:18.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe1a0 2024-09-21T15:23:18.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:23:18.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe410 2024-09-21T15:23:18.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.585+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:23:18.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff110 2024-09-21T15:23:18.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff2b0 2024-09-21T15:23:18.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:23:18.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffa00 2024-09-21T15:23:18.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffad0 2024-09-21T15:23:18.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffd40 2024-09-21T15:23:18.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffee0 2024-09-21T15:23:18.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dca000 2024-09-21T15:23:18.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5dcb6c0 2024-09-21T15:23:18.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d89c0 2024-09-21T15:23:18.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9380 2024-09-21T15:23:18.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9d40 2024-09-21T15:23:18.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:23:18.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67820d0 2024-09-21T15:23:18.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782750 2024-09-21T15:23:18.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:23:18.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783110 2024-09-21T15:23:18.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b67832b0 2024-09-21T15:23:18.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783450 2024-09-21T15:23:18.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783790 2024-09-21T15:23:18.595 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:18.589+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47a00 2024-09-21T15:23:18.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:18.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone24': 2024-09-21T15:23:18.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 120 MiB in 130 objects 2024-09-21T15:23:18.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:23:18.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:18.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9f781b9ea 2024-09-21T15:23:18.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9f781b9ea 2024-09-21T15:23:18.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:18.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:18.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:18.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:18.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:18.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:18.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:18.725 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:18.725 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:23:18.725 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:23:18.725 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9f781b9ea 2024-09-21T15:23:18.725 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:18.725 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:18.725 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 32979c40-b09e-47fb-96bc-99dc3f3188ed 2024-09-21T15:23:18.725 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:18.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:18.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:18.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone25 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:18.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:18.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:18.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone25 2024-09-21T15:23:18.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:18.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:18.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:18.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:19.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:19.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone25': 2024-09-21T15:23:19.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 228 MiB in 70 objects 2024-09-21T15:23:19.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:23:19.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:19.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9dc9cdfa0 2024-09-21T15:23:19.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9dc9cdfa0 2024-09-21T15:23:19.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:19.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:19.812 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:19.812 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:19.812 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:23:19.812 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:23:19.812 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:23:19.812 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:19.812 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone24@snap 2024-09-21T15:23:19.812 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 5.2 MiB 2024-09-21T15:23:19.812 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:23:19.813 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:23:19.813 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9dc9cdfa0 2024-09-21T15:23:19.813 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:19.813 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:19.813 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 04c38b7c-01bc-4aba-abf6-b06791607e1f 2024-09-21T15:23:19.813 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:19.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:19.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:19.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone26 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:19.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:19.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:19.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone26 2024-09-21T15:23:19.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:19.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:19.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:19.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:20.820 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:20.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone26': 2024-09-21T15:23:20.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 200 MiB in 52 objects 2024-09-21T15:23:20.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:23:20.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b93f3c203e 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b93f3c203e 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:49 2024 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:49 2024 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:49 2024 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 MiB 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b93f3c203e 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:20.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:20.889 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: ab585917-bbfb-41ce-a268-5e9596e12ef3 2024-09-21T15:23:20.889 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:20.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:20.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:20.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone27 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:20.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:20.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:20.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone27 2024-09-21T15:23:20.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:20.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:20.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:20.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:21.660 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:21.656+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a3322b60 2024-09-21T15:23:21.687 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:21.676+0000 7f2ef42ce700 -1 reset not still connected to 0x55dbf49c3a00 2024-09-21T15:23:21.688 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:21.684+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0ee7b5f0 2024-09-21T15:23:21.689 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:21.684+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc158ea340 2024-09-21T15:23:21.689 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:21.684+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1939ef70 2024-09-21T15:23:21.689 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:21.684+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf591e0 2024-09-21T15:23:21.689 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:21.684+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:23:21.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:21.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone27': 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 4.5 MiB in 5 objects 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b95fe998e5 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b95fe998e5 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:21.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:23:21.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:23:21.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b95fe998e5 2024-09-21T15:23:21.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:21.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:21.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 1521f990-e0f3-447d-8ae6-8c8eaf7726c1 2024-09-21T15:23:21.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:21.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:21.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:21.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone28 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:21.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:21.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:21.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone28 2024-09-21T15:23:21.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:21.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:21.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:21.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:22.664 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.6864781940066812) > weight (0.25) 2024-09-21T15:23:22.664 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.4477787042782989) > weight (0.25) 2024-09-21T15:23:22.664 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.2 with skip (0.9966051258835517) > weight (0.25) 2024-09-21T15:23:22.664 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.3 2024-09-21T15:23:22.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Sent signal 15 2024-09-21T15:23:22.665 INFO:tasks.rbd_mirror_thrash:waiting for 0 secs before reviving daemons 2024-09-21T15:23:22.665 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.3 2024-09-21T15:23:22.665 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:23:22.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:23:22.661+0000 7f481189b700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.3 (PID: 24910) UID: 1000 2024-09-21T15:23:22.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:23.047 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone28': 2024-09-21T15:23:23.047 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 3.2 MiB in 7 objects 2024-09-21T15:23:23.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:23:23.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:23.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9b70a2bca 2024-09-21T15:23:23.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9b70a2bca 2024-09-21T15:23:23.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:23.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:23.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:23.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:23.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:23.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:23.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:23.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:23.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone27@snap 2024-09-21T15:23:23.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 3.2 MiB 2024-09-21T15:23:23.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:23:23.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:23:23.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9b70a2bca 2024-09-21T15:23:23.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:23.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:23.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 737c0d42-d3d6-4665-a92d-89d76507af57 2024-09-21T15:23:23.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:23.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:23.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:23.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone29 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:23.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:23.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:23.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone29 2024-09-21T15:23:23.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:23.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:23.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:23.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:24.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:24.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone29': 2024-09-21T15:23:24.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 9.0 MiB in 11 objects 2024-09-21T15:23:24.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:23:24.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:24.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b93e1560bd 2024-09-21T15:23:24.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b93e1560bd 2024-09-21T15:23:24.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:24.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:24.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:24.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:24.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:24.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:24.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:24.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:24.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone28@snap 2024-09-21T15:23:24.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 9.0 MiB 2024-09-21T15:23:24.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:23:24.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:23:24.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b93e1560bd 2024-09-21T15:23:24.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:24.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:24.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 0efbaa1f-200b-4402-80cf-e1832c046762 2024-09-21T15:23:24.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:24.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:24.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:24.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:24.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:24.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:24.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone3 2024-09-21T15:23:24.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:24.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:24.155 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:24.155 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:24.810 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:24.803+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:23:24.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:24.807+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48680 2024-09-21T15:23:25.155 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:25.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone3': 2024-09-21T15:23:25.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 6.7 MiB in 15 objects 2024-09-21T15:23:25.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:23:25.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:25.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b94afd7e43 2024-09-21T15:23:25.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b94afd7e43 2024-09-21T15:23:25.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:25.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:25.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:25.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:25.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:25.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:25.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:25.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:25.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone2@snap 2024-09-21T15:23:25.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 6.7 MiB 2024-09-21T15:23:25.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:23:25.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:23:25.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b94afd7e43 2024-09-21T15:23:25.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:25.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:25.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 639e7549-39e6-4963-86db-7a414ac8d909 2024-09-21T15:23:25.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:25.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:25.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:25.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone30 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:25.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:25.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:25.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone30 2024-09-21T15:23:25.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:25.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:25.278 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:25.278 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:26.278 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:26.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone30': 2024-09-21T15:23:26.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 219 MiB in 56 objects 2024-09-21T15:23:26.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:23:26.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:26.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b94dff9298 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b94dff9298 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b94dff9298 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:26.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:26.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: be89b0c4-d429-4c57-9087-99c39aa47775 2024-09-21T15:23:26.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:26.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:26.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:26.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone31 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:26.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:26.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:26.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone31 2024-09-21T15:23:26.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:26.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:26.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:26.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:27.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:27.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone31': 2024-09-21T15:23:27.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 31 MiB in 14 objects 2024-09-21T15:23:27.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:23:27.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:27.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b98adcfb8b 2024-09-21T15:23:27.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b98adcfb8b 2024-09-21T15:23:27.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:27.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:27.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:27.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:27.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:27.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:27.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:27.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:27.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone30@snap 2024-09-21T15:23:27.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 31 MiB 2024-09-21T15:23:27.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:23:27.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:23:27.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b98adcfb8b 2024-09-21T15:23:27.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:27.441 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:27.441 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: e0e12844-c372-4352-ae7b-7a7ae05a7f18 2024-09-21T15:23:27.441 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:27.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:27.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:27.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone32 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:27.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:27.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:27.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone32 2024-09-21T15:23:27.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:27.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:27.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:27.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:28.448 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:28.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone32': 2024-09-21T15:23:28.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 3.2 MiB in 11 objects 2024-09-21T15:23:28.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:23:28.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:28.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b954b08b26 2024-09-21T15:23:28.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b954b08b26 2024-09-21T15:23:28.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:28.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:28.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:28.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:28.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:28.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:28.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:28.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:28.541 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone31@snap 2024-09-21T15:23:28.541 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 3.2 MiB 2024-09-21T15:23:28.541 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:23:28.541 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:23:28.541 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b954b08b26 2024-09-21T15:23:28.541 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:28.541 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:28.541 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 06083b71-7c43-447a-b25c-2ee4be39c803 2024-09-21T15:23:28.541 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:28.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:28.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:28.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone33 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:28.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:28.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:28.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone33 2024-09-21T15:23:28.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:28.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:28.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:28.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:28.767 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.3 2024-09-21T15:23:28.767 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Restarting daemon 2024-09-21T15:23:28.767 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.3 2024-09-21T15:23:28.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Started 2024-09-21T15:23:28.770 INFO:tasks.rbd_mirror_thrash:waiting for 104 secs before thrashing 2024-09-21T15:23:29.549 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:29.611 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:29.604+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8c30 2024-09-21T15:23:29.611 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:29.604+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8d00 2024-09-21T15:23:29.611 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:29.604+0000 7f52f1ba9700 -1 reset not still connected to 0x55714346b450 2024-09-21T15:23:29.649 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:29.644+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456c9c0 2024-09-21T15:23:29.652 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:29.648+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cd00 2024-09-21T15:23:29.653 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:29.648+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af72b0 2024-09-21T15:23:29.653 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:29.648+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f1e0 2024-09-21T15:23:29.653 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:29.648+0000 7f52f1ba9700 -1 reset not still connected to 0x557146764270 2024-09-21T15:23:29.653 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:29.648+0000 7f52f1ba9700 -1 reset not still connected to 0x5571479ab040 2024-09-21T15:23:29.653 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:29.648+0000 7f52f1ba9700 -1 reset not still connected to 0x557148000680 2024-09-21T15:23:29.653 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:29.648+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821b790 2024-09-21T15:23:29.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone33': 2024-09-21T15:23:29.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 7.2 MiB in 8 objects 2024-09-21T15:23:29.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:23:29.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:29.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4f6cb5c9b 2024-09-21T15:23:29.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4f6cb5c9b 2024-09-21T15:23:29.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:29.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:29.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:29.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:29.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:23:29.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:23:29.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:23:29.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:29.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone32@snap 2024-09-21T15:23:29.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 7.2 MiB 2024-09-21T15:23:29.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:23:29.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:23:29.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4f6cb5c9b 2024-09-21T15:23:29.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:29.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:29.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 2961b7ba-9b12-4b85-bd70-b26353c4e0fb 2024-09-21T15:23:29.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone34 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone34 2024-09-21T15:23:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:29.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:29.837 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:29.828+0000 7f52f1ba9700 -1 reset not still connected to 0x5571479ab040 2024-09-21T15:23:29.838 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:29.828+0000 7f52f1ba9700 -1 reset not still connected to 0x557148000680 2024-09-21T15:23:30.100 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:30.095+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb48d00 2024-09-21T15:23:30.100 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:30.095+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:23:30.105 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac5110 2024-09-21T15:23:30.105 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541ad0 2024-09-21T15:23:30.105 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2000 2024-09-21T15:23:30.105 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3d40 2024-09-21T15:23:30.105 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18dc70 2024-09-21T15:23:30.114 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e8410 2024-09-21T15:23:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:23:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628abb49380 2024-09-21T15:23:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac5110 2024-09-21T15:23:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541ad0 2024-09-21T15:23:30.116 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:30.111+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3d40 2024-09-21T15:23:30.199 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.192+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07ad0 2024-09-21T15:23:30.203 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.192+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b10d1a00 2024-09-21T15:23:30.203 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.192+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76680 2024-09-21T15:23:30.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.200+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe820 2024-09-21T15:23:30.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.200+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fed00 2024-09-21T15:23:30.209 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.200+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:23:30.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.200+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59ebad0 2024-09-21T15:23:30.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.200+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387380 2024-09-21T15:23:30.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.200+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839b860 2024-09-21T15:23:30.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.200+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc680 2024-09-21T15:23:30.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.200+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0dd0 2024-09-21T15:23:30.210 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.200+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d35f0 2024-09-21T15:23:30.230 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.216+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d71e0 2024-09-21T15:23:30.242 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.224+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351ba0 2024-09-21T15:23:30.242 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.228+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6268f0 2024-09-21T15:23:30.242 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.228+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c00088f0 2024-09-21T15:23:30.242 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.228+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:23:30.321 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.316+0000 7ff753f07700 -1 reset not still connected to 0x56016f162f70 2024-09-21T15:23:30.322 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.320+0000 7ff753f07700 -1 reset not still connected to 0x56016f163930 2024-09-21T15:23:30.323 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.320+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf24e0 2024-09-21T15:23:30.323 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.320+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd8000 2024-09-21T15:23:30.323 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.320+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90680 2024-09-21T15:23:30.334 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.324+0000 7ff753f07700 -1 reset not still connected to 0x56016fe916c0 2024-09-21T15:23:30.334 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.324+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:23:30.334 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.324+0000 7ff753f07700 -1 reset not still connected to 0x56016fefe270 2024-09-21T15:23:30.335 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.324+0000 7ff753f07700 -1 reset not still connected to 0x56016fefedd0 2024-09-21T15:23:30.335 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.324+0000 7ff753f07700 -1 reset not still connected to 0x56016feff6c0 2024-09-21T15:23:30.335 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.324+0000 7ff753f07700 -1 reset not still connected to 0x560171f95110 2024-09-21T15:23:30.335 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.324+0000 7ff753f07700 -1 reset not still connected to 0x56017219ed00 2024-09-21T15:23:30.335 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.324+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7d40 2024-09-21T15:23:30.335 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.324+0000 7ff753f07700 -1 reset not still connected to 0x56017529aa90 2024-09-21T15:23:30.335 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.324+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0820 2024-09-21T15:23:30.336 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.324+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc000 2024-09-21T15:23:30.336 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.324+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc9c0 2024-09-21T15:23:30.336 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:30.324+0000 7ff753f07700 -1 reset not still connected to 0x560177984410 2024-09-21T15:23:30.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.500+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb628a00 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:23:30.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.500+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb628a00 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:23:30.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.500+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb628a00 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:23:30.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.500+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb628a00 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:23:30.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.500+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9900 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:23:30.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.500+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9900 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:23:30.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.500+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9900 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:23:30.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.500+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9900 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:23:30.598 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.592+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fed00 2024-09-21T15:23:30.599 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.596+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:23:30.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.596+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47c70 2024-09-21T15:23:30.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.596+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839b860 2024-09-21T15:23:30.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.596+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc680 2024-09-21T15:23:30.602 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.596+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0dd0 2024-09-21T15:23:30.606 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.600+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:23:30.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628280 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:23:30.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628280 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:23:30.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628280 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:23:30.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628280 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:23:30.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628280 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:23:30.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628280 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628280 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8c80 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8c80 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8c80 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8c80 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8c80 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8c80 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb677b80 [3/2799bff6-159c-4fac-9ff0-10626f02c84d] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb677b80 [3/2799bff6-159c-4fac-9ff0-10626f02c84d] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb677b80 [3/2799bff6-159c-4fac-9ff0-10626f02c84d] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb677b80 [3/2799bff6-159c-4fac-9ff0-10626f02c84d] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9180 [3/235c6780-0eb8-4b58-8a3e-08efcc9ea11c] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9180 [3/235c6780-0eb8-4b58-8a3e-08efcc9ea11c] start: already running 2024-09-21T15:23:30.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9180 [3/235c6780-0eb8-4b58-8a3e-08efcc9ea11c] start: already running 2024-09-21T15:23:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9180 [3/235c6780-0eb8-4b58-8a3e-08efcc9ea11c] start: already running 2024-09-21T15:23:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb629900 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:23:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb629900 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:23:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb629900 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:23:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb629900 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:23:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb629900 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:23:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb629900 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:23:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb84b900 [3/867e338b-f348-4ad9-b746-7ff49fa378b8] start: already running 2024-09-21T15:23:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fc9589400 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:23:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fc9589400 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:23:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fc9589400 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:23:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fc9589400 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:23:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fc9589400 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:23:30.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fc9589400 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:23:30.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fc9589400 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:23:30.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb676a00 [3/293432f7-5a81-4489-9831-906269d79354] start: already running 2024-09-21T15:23:30.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb676a00 [3/293432f7-5a81-4489-9831-906269d79354] start: already running 2024-09-21T15:23:30.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb676a00 [3/293432f7-5a81-4489-9831-906269d79354] start: already running 2024-09-21T15:23:30.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.620+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb676a00 [3/293432f7-5a81-4489-9831-906269d79354] start: already running 2024-09-21T15:23:30.629 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915e10 2024-09-21T15:23:30.629 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc425ee0 2024-09-21T15:23:30.629 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351ba0 2024-09-21T15:23:30.629 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6268f0 2024-09-21T15:23:30.629 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be627d40 2024-09-21T15:23:30.630 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bba0 2024-09-21T15:23:30.630 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:23:30.630 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:30.624+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921110 2024-09-21T15:23:30.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.628+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb676000 [3/24b4fbb0-7c7f-43b3-8add-fc2245c3b143] start: already running 2024-09-21T15:23:30.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.628+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb676000 [3/24b4fbb0-7c7f-43b3-8add-fc2245c3b143] start: already running 2024-09-21T15:23:30.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.628+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb676000 [3/24b4fbb0-7c7f-43b3-8add-fc2245c3b143] start: already running 2024-09-21T15:23:30.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.628+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb676000 [3/24b4fbb0-7c7f-43b3-8add-fc2245c3b143] start: already running 2024-09-21T15:23:30.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.636+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb792500 [3/4bd5f744-bf83-4824-98f0-d27d9f1c8197] start: already running 2024-09-21T15:23:30.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.636+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb792500 [3/4bd5f744-bf83-4824-98f0-d27d9f1c8197] start: already running 2024-09-21T15:23:30.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.636+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73b900 [3/43a73e62-4bcf-4dbf-97f4-0fa9db2adcba] start: already running 2024-09-21T15:23:30.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.636+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73b900 [3/43a73e62-4bcf-4dbf-97f4-0fa9db2adcba] start: already running 2024-09-21T15:23:30.642 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.636+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6f00 [3/791a4288-2321-4776-a51f-ba5428b8b556] start: already running 2024-09-21T15:23:30.642 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.636+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6f00 [3/791a4288-2321-4776-a51f-ba5428b8b556] start: already running 2024-09-21T15:23:30.642 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb865b80 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:23:30.642 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb865b80 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:23:30.644 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb677680 [3/276535f4-9168-47d5-a517-d2edfbcc99eb] start: already running 2024-09-21T15:23:30.644 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb677680 [3/276535f4-9168-47d5-a517-d2edfbcc99eb] start: already running 2024-09-21T15:23:30.644 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb677680 [3/276535f4-9168-47d5-a517-d2edfbcc99eb] start: already running 2024-09-21T15:23:30.644 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb677680 [3/276535f4-9168-47d5-a517-d2edfbcc99eb] start: already running 2024-09-21T15:23:30.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8500 [3/17533440-f958-4ed4-a80c-8e242aef088b] start: already running 2024-09-21T15:23:30.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8500 [3/17533440-f958-4ed4-a80c-8e242aef088b] start: already running 2024-09-21T15:23:30.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8500 [3/17533440-f958-4ed4-a80c-8e242aef088b] start: already running 2024-09-21T15:23:30.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8500 [3/17533440-f958-4ed4-a80c-8e242aef088b] start: already running 2024-09-21T15:23:30.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8500 [3/17533440-f958-4ed4-a80c-8e242aef088b] start: already running 2024-09-21T15:23:30.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8500 [3/17533440-f958-4ed4-a80c-8e242aef088b] start: already running 2024-09-21T15:23:30.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8500 [3/17533440-f958-4ed4-a80c-8e242aef088b] start: already running 2024-09-21T15:23:30.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb705b80 [3/3858bbd9-acac-4b4f-a8fb-0fd6f0dc3cb9] start: already running 2024-09-21T15:23:30.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb705b80 [3/3858bbd9-acac-4b4f-a8fb-0fd6f0dc3cb9] start: already running 2024-09-21T15:23:30.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb705b80 [3/3858bbd9-acac-4b4f-a8fb-0fd6f0dc3cb9] start: already running 2024-09-21T15:23:30.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb705b80 [3/3858bbd9-acac-4b4f-a8fb-0fd6f0dc3cb9] start: already running 2024-09-21T15:23:30.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab900 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:23:30.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab900 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:23:30.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab900 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:23:30.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab900 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:23:30.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab900 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:23:30.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab900 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:23:30.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.640+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab900 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:23:30.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.644+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4780 [3/5aef6686-3462-4732-9396-d809d993e90b] start: already running 2024-09-21T15:23:30.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.644+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4780 [3/5aef6686-3462-4732-9396-d809d993e90b] start: already running 2024-09-21T15:23:30.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.644+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73af00 [3/3f55813c-389e-4273-ad96-2ee904d4730d] start: already running 2024-09-21T15:23:30.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.644+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73af00 [3/3f55813c-389e-4273-ad96-2ee904d4730d] start: already running 2024-09-21T15:23:30.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.644+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73af00 [3/3f55813c-389e-4273-ad96-2ee904d4730d] start: already running 2024-09-21T15:23:30.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.660+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb69aa00 [3/2b6dc334-3fe0-49f9-81e0-cb6bcee84c98] start: already running 2024-09-21T15:23:30.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.660+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb69aa00 [3/2b6dc334-3fe0-49f9-81e0-cb6bcee84c98] start: already running 2024-09-21T15:23:30.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.660+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb69aa00 [3/2b6dc334-3fe0-49f9-81e0-cb6bcee84c98] start: already running 2024-09-21T15:23:30.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.660+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb69aa00 [3/2b6dc334-3fe0-49f9-81e0-cb6bcee84c98] start: already running 2024-09-21T15:23:30.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.660+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb950000 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:23:30.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.660+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb704280 [3/363b13b9-82c8-4420-bc7f-68b6bbdb20b8] start: already running 2024-09-21T15:23:30.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.660+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb704280 [3/363b13b9-82c8-4420-bc7f-68b6bbdb20b8] start: already running 2024-09-21T15:23:30.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.660+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb704280 [3/363b13b9-82c8-4420-bc7f-68b6bbdb20b8] start: already running 2024-09-21T15:23:30.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.660+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb704280 [3/363b13b9-82c8-4420-bc7f-68b6bbdb20b8] start: already running 2024-09-21T15:23:30.732 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.728+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aac80 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:23:30.732 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.728+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aac80 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:23:30.732 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.728+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aac80 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:23:30.732 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.728+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aac80 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:23:30.732 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.728+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aac80 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:23:30.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.728+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aac80 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:23:30.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.728+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aac80 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:23:30.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.728+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb84a000 [3/5d8470f4-d7d3-4732-8815-2ed1bc60c759] start: already running 2024-09-21T15:23:30.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.728+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb84a000 [3/5d8470f4-d7d3-4732-8815-2ed1bc60c759] start: already running 2024-09-21T15:23:30.736 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f5400 [3/5e8b4579-81b1-4cbb-a0ef-7f96494cfc61] start: already running 2024-09-21T15:23:30.736 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f5400 [3/5e8b4579-81b1-4cbb-a0ef-7f96494cfc61] start: already running 2024-09-21T15:23:30.736 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589b80 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:23:30.736 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589b80 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:23:30.736 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589b80 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:23:30.737 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589b80 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:23:30.737 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589b80 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:23:30.737 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589b80 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:23:30.737 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589b80 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:23:30.737 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589180 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:23:30.737 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589180 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:23:30.737 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589180 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:23:30.737 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589180 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:23:30.738 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589180 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:23:30.738 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589180 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:23:30.738 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.732+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fc9589180 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:23:30.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:30.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb950500 [3/96f7130e-627f-496e-8a7c-886f81d92e20] start: already running 2024-09-21T15:23:30.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb792780 [3/4d33624c-dcd8-4157-891c-5b117dfa1f81] start: already running 2024-09-21T15:23:30.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb792780 [3/4d33624c-dcd8-4157-891c-5b117dfa1f81] start: already running 2024-09-21T15:23:30.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8f00 [3/2356d978-bbcf-4641-a1a5-fa6a827028ca] start: already running 2024-09-21T15:23:30.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8f00 [3/2356d978-bbcf-4641-a1a5-fa6a827028ca] start: already running 2024-09-21T15:23:30.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8f00 [3/2356d978-bbcf-4641-a1a5-fa6a827028ca] start: already running 2024-09-21T15:23:30.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8f00 [3/2356d978-bbcf-4641-a1a5-fa6a827028ca] start: already running 2024-09-21T15:23:30.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588c80 [3/02c68625-9e68-49b7-9164-c8fd75eb654b] start: already running 2024-09-21T15:23:30.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588c80 [3/02c68625-9e68-49b7-9164-c8fd75eb654b] start: already running 2024-09-21T15:23:30.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588c80 [3/02c68625-9e68-49b7-9164-c8fd75eb654b] start: already running 2024-09-21T15:23:30.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588c80 [3/02c68625-9e68-49b7-9164-c8fd75eb654b] start: already running 2024-09-21T15:23:30.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588c80 [3/02c68625-9e68-49b7-9164-c8fd75eb654b] start: already running 2024-09-21T15:23:30.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588c80 [3/02c68625-9e68-49b7-9164-c8fd75eb654b] start: already running 2024-09-21T15:23:30.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588c80 [3/02c68625-9e68-49b7-9164-c8fd75eb654b] start: already running 2024-09-21T15:23:30.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b180 [3/2ecbd40e-3deb-400c-92b4-6c441ce7dbae] start: already running 2024-09-21T15:23:30.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b180 [3/2ecbd40e-3deb-400c-92b4-6c441ce7dbae] start: already running 2024-09-21T15:23:30.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b180 [3/2ecbd40e-3deb-400c-92b4-6c441ce7dbae] start: already running 2024-09-21T15:23:30.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.788+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b180 [3/2ecbd40e-3deb-400c-92b4-6c441ce7dbae] start: already running 2024-09-21T15:23:30.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.932+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d7900 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:23:30.935 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.932+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaa00 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:23:30.935 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.932+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaa00 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:23:30.935 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.932+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaa00 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:23:30.935 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.932+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaa00 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:23:30.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.932+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaa00 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:23:30.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.932+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaa00 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:23:30.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.932+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaa00 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:23:30.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.932+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb704f00 [3/3dc01151-5655-47e1-a307-fa2b690265ce] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:30.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.932+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704f00 [3/3dc01151-5655-47e1-a307-fa2b690265ce] start: already running 2024-09-21T15:23:30.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.932+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704f00 [3/3dc01151-5655-47e1-a307-fa2b690265ce] start: already running 2024-09-21T15:23:30.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.932+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704f00 [3/3dc01151-5655-47e1-a307-fa2b690265ce] start: already running 2024-09-21T15:23:30.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.932+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb629680 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:30.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.952+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb629680 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:23:30.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.952+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb629680 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:23:30.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.952+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb629680 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:23:30.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.952+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb629680 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:23:30.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.952+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb629680 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:23:30.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:30.952+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb629680 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:23:31.005 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa500 [3/0da2d7cc-be3d-48b3-9444-121826b07f97] start: already running 2024-09-21T15:23:31.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa500 [3/0da2d7cc-be3d-48b3-9444-121826b07f97] start: already running 2024-09-21T15:23:31.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa500 [3/0da2d7cc-be3d-48b3-9444-121826b07f97] start: already running 2024-09-21T15:23:31.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa500 [3/0da2d7cc-be3d-48b3-9444-121826b07f97] start: already running 2024-09-21T15:23:31.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa500 [3/0da2d7cc-be3d-48b3-9444-121826b07f97] start: already running 2024-09-21T15:23:31.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa500 [3/0da2d7cc-be3d-48b3-9444-121826b07f97] start: already running 2024-09-21T15:23:31.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa500 [3/0da2d7cc-be3d-48b3-9444-121826b07f97] start: already running 2024-09-21T15:23:31.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b680 [3/32979c40-b09e-47fb-96bc-99dc3f3188ed] start: already running 2024-09-21T15:23:31.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b680 [3/32979c40-b09e-47fb-96bc-99dc3f3188ed] start: already running 2024-09-21T15:23:31.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b680 [3/32979c40-b09e-47fb-96bc-99dc3f3188ed] start: already running 2024-09-21T15:23:31.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b680 [3/32979c40-b09e-47fb-96bc-99dc3f3188ed] start: already running 2024-09-21T15:23:31.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb92c280 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:23:31.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb792a00 [3/4db41bcc-01af-44fc-9cb1-aedfd7a02660] start: already running 2024-09-21T15:23:31.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.000+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb792a00 [3/4db41bcc-01af-44fc-9cb1-aedfd7a02660] start: already running 2024-09-21T15:23:31.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb704500 [3/365611e2-1ad6-4f54-9c58-bf966f5928e7] start: already running 2024-09-21T15:23:31.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb704500 [3/365611e2-1ad6-4f54-9c58-bf966f5928e7] start: already running 2024-09-21T15:23:31.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb704500 [3/365611e2-1ad6-4f54-9c58-bf966f5928e7] start: already running 2024-09-21T15:23:31.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb704500 [3/365611e2-1ad6-4f54-9c58-bf966f5928e7] start: already running 2024-09-21T15:23:31.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb677900 [3/27657923-4991-47a3-8bed-28264b9e04a1] start: already running 2024-09-21T15:23:31.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb677900 [3/27657923-4991-47a3-8bed-28264b9e04a1] start: already running 2024-09-21T15:23:31.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb677900 [3/27657923-4991-47a3-8bed-28264b9e04a1] start: already running 2024-09-21T15:23:31.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb677900 [3/27657923-4991-47a3-8bed-28264b9e04a1] start: already running 2024-09-21T15:23:31.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb629180 [3/1db510c7-c786-462a-b73c-998b902f5c86] start: already running 2024-09-21T15:23:31.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb629180 [3/1db510c7-c786-462a-b73c-998b902f5c86] start: already running 2024-09-21T15:23:31.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb629180 [3/1db510c7-c786-462a-b73c-998b902f5c86] start: already running 2024-09-21T15:23:31.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb629180 [3/1db510c7-c786-462a-b73c-998b902f5c86] start: already running 2024-09-21T15:23:31.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb629180 [3/1db510c7-c786-462a-b73c-998b902f5c86] start: already running 2024-09-21T15:23:31.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb629180 [3/1db510c7-c786-462a-b73c-998b902f5c86] start: already running 2024-09-21T15:23:31.009 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6280 [3/72cf5188-c646-4c84-b151-51750759e12e] start: already running 2024-09-21T15:23:31.009 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6280 [3/72cf5188-c646-4c84-b151-51750759e12e] start: already running 2024-09-21T15:23:31.009 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb793400 [3/535b2c9f-8008-4989-b65d-748a5cd23a9b] start: already running 2024-09-21T15:23:31.010 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb793400 [3/535b2c9f-8008-4989-b65d-748a5cd23a9b] start: already running 2024-09-21T15:23:31.010 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.004+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d7400 [3/a886c6ec-95d5-4bec-95d6-90b535ab9694] start: already running 2024-09-21T15:23:31.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.012+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb84a500 [3/7a09179e-ea78-49c4-ab31-16f3fb8ff4df] start: already running 2024-09-21T15:23:31.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.012+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb84a500 [3/7a09179e-ea78-49c4-ab31-16f3fb8ff4df] start: already running 2024-09-21T15:23:31.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.012+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb864a00 [3/69a6bb5f-56ca-4197-9a03-c1f93382494d] start: already running 2024-09-21T15:23:31.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.012+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb864a00 [3/69a6bb5f-56ca-4197-9a03-c1f93382494d] start: already running 2024-09-21T15:23:31.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.012+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb705180 [3/3dfcc7ae-1175-4f2b-8854-b9f69eeda24f] start: already running 2024-09-21T15:23:31.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.012+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb705180 [3/3dfcc7ae-1175-4f2b-8854-b9f69eeda24f] start: already running 2024-09-21T15:23:31.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.012+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb705180 [3/3dfcc7ae-1175-4f2b-8854-b9f69eeda24f] start: already running 2024-09-21T15:23:31.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.052+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb9e0000 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:31.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.052+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb9e0000 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:31.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.052+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb9e0000 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] start: already running 2024-09-21T15:23:31.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.052+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b400 [3/31e98e64-d9b2-447d-bce9-435d3d7cef3a] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:31.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b400 [3/31e98e64-d9b2-447d-bce9-435d3d7cef3a] start: already running 2024-09-21T15:23:31.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b400 [3/31e98e64-d9b2-447d-bce9-435d3d7cef3a] start: already running 2024-09-21T15:23:31.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b400 [3/31e98e64-d9b2-447d-bce9-435d3d7cef3a] start: already running 2024-09-21T15:23:31.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b400 [3/31e98e64-d9b2-447d-bce9-435d3d7cef3a] start: already running 2024-09-21T15:23:31.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8280 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:23:31.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8280 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:23:31.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8280 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:23:31.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8280 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:23:31.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8280 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:23:31.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8280 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:23:31.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8280 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:23:31.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588f00 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:23:31.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588f00 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:23:31.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588f00 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:23:31.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588f00 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588f00 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588f00 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588f00 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb84bb80 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6000 [3/72133ade-d434-4fb0-892a-d55cec4945c3] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6000 [3/72133ade-d434-4fb0-892a-d55cec4945c3] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704000 [3/347ff7bb-17b6-437e-9043-ee0191f8394d] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704000 [3/347ff7bb-17b6-437e-9043-ee0191f8394d] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704000 [3/347ff7bb-17b6-437e-9043-ee0191f8394d] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704000 [3/347ff7bb-17b6-437e-9043-ee0191f8394d] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73ac80 [3/3e87a2ed-dc29-47ec-976a-1a33bfabf914] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73ac80 [3/3e87a2ed-dc29-47ec-976a-1a33bfabf914] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73ac80 [3/3e87a2ed-dc29-47ec-976a-1a33bfabf914] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589900 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:23:31.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589900 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:23:31.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589900 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:23:31.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589900 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:23:31.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589900 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:23:31.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589900 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:23:31.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.056+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589900 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:23:31.138 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73b180 [3/3fdcc685-72aa-4afe-9cdb-1ad60b962a91] start: already running 2024-09-21T15:23:31.138 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73b180 [3/3fdcc685-72aa-4afe-9cdb-1ad60b962a91] start: already running 2024-09-21T15:23:31.138 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73b180 [3/3fdcc685-72aa-4afe-9cdb-1ad60b962a91] start: already running 2024-09-21T15:23:31.138 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb676780 [3/28770fc6-fe31-43ff-8ae6-a1beb20f7e4d] start: already running 2024-09-21T15:23:31.138 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb676780 [3/28770fc6-fe31-43ff-8ae6-a1beb20f7e4d] start: already running 2024-09-21T15:23:31.138 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb676780 [3/28770fc6-fe31-43ff-8ae6-a1beb20f7e4d] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb676780 [3/28770fc6-fe31-43ff-8ae6-a1beb20f7e4d] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa280 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa280 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa280 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa280 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa280 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa280 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa280 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a500 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a500 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a500 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a500 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628500 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:23:31.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628500 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628500 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628500 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628500 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628500 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628500 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb951180 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588500 [3/0111f35b-69c8-4614-8b36-510c97864eec] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588500 [3/0111f35b-69c8-4614-8b36-510c97864eec] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588500 [3/0111f35b-69c8-4614-8b36-510c97864eec] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588500 [3/0111f35b-69c8-4614-8b36-510c97864eec] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588500 [3/0111f35b-69c8-4614-8b36-510c97864eec] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588500 [3/0111f35b-69c8-4614-8b36-510c97864eec] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588500 [3/0111f35b-69c8-4614-8b36-510c97864eec] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb676500 [3/270edf45-6738-4fd2-95f6-31351dcf77ee] start: already running 2024-09-21T15:23:31.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb676500 [3/270edf45-6738-4fd2-95f6-31351dcf77ee] start: already running 2024-09-21T15:23:31.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb676500 [3/270edf45-6738-4fd2-95f6-31351dcf77ee] start: already running 2024-09-21T15:23:31.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb676500 [3/270edf45-6738-4fd2-95f6-31351dcf77ee] start: already running 2024-09-21T15:23:31.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1abb80 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:23:31.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1abb80 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:23:31.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1abb80 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:23:31.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1abb80 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:23:31.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1abb80 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:23:31.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1abb80 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:23:31.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1abb80 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:23:31.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69ac80 [3/2c920b45-e415-4127-8e5e-84e50ed4265e] start: already running 2024-09-21T15:23:31.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69ac80 [3/2c920b45-e415-4127-8e5e-84e50ed4265e] start: already running 2024-09-21T15:23:31.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69ac80 [3/2c920b45-e415-4127-8e5e-84e50ed4265e] start: already running 2024-09-21T15:23:31.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.132+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69ac80 [3/2c920b45-e415-4127-8e5e-84e50ed4265e] start: already running 2024-09-21T15:23:31.203 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:31.192+0000 7ff753f07700 -1 reset not still connected to 0x5601727fb930 2024-09-21T15:23:31.214 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:31.208+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdd40 2024-09-21T15:23:31.214 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:31.208+0000 7ff753f07700 -1 reset not still connected to 0x5601780489c0 2024-09-21T15:23:31.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone34': 2024-09-21T15:23:31.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 38 MiB in 77 objects 2024-09-21T15:23:31.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:23:31.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:31.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4ec9ec41d 2024-09-21T15:23:31.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4ec9ec41d 2024-09-21T15:23:31.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:31.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:31.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:31.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:31.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:23:31.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:23:31.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:23:31.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:31.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone33@snap 2024-09-21T15:23:31.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 38 MiB 2024-09-21T15:23:31.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:23:31.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:23:31.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4ec9ec41d 2024-09-21T15:23:31.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:31.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:31.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 9f1ae171-c261-402d-a90a-2b4cca77a51c 2024-09-21T15:23:31.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:31.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:31.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:31.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone35 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:31.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:31.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:31.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone35 2024-09-21T15:23:31.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:31.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:31.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:31.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:31.288 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.284+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6500 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:23:31.288 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.284+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6500 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:23:31.288 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.284+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb950780 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:23:31.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.360+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8780 [3/17d4ffa8-0813-4494-8b4e-ee40ecedca48] start: already running 2024-09-21T15:23:31.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.360+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8780 [3/17d4ffa8-0813-4494-8b4e-ee40ecedca48] start: already running 2024-09-21T15:23:31.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.360+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8780 [3/17d4ffa8-0813-4494-8b4e-ee40ecedca48] start: already running 2024-09-21T15:23:31.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.360+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8780 [3/17d4ffa8-0813-4494-8b4e-ee40ecedca48] start: already running 2024-09-21T15:23:31.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.360+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8780 [3/17d4ffa8-0813-4494-8b4e-ee40ecedca48] start: already running 2024-09-21T15:23:31.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.360+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8780 [3/17d4ffa8-0813-4494-8b4e-ee40ecedca48] start: already running 2024-09-21T15:23:31.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.360+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8780 [3/17d4ffa8-0813-4494-8b4e-ee40ecedca48] start: already running 2024-09-21T15:23:31.369 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.364+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a280 [3/3b97819c-ef2b-4fc6-91d4-dcc334a34235] start: already running 2024-09-21T15:23:31.369 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.364+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a280 [3/3b97819c-ef2b-4fc6-91d4-dcc334a34235] start: already running 2024-09-21T15:23:34.395 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.364+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a280 [3/3b97819c-ef2b-4fc6-91d4-dcc334a34235] start: already running 2024-09-21T15:23:34.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.364+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a280 [3/3b97819c-ef2b-4fc6-91d4-dcc334a34235] start: already running 2024-09-21T15:23:34.399 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.295+0000 7f7fd044c700 -1 reset not still connected to 0x5636a780e9c0 2024-09-21T15:23:34.399 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.295+0000 7f7fd044c700 -1 reset not still connected to 0x5636ad238000 2024-09-21T15:23:34.399 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.303+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef025b0 2024-09-21T15:23:34.399 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.303+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65520 2024-09-21T15:23:34.399 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.303+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbb2b0 2024-09-21T15:23:34.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.307+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a5b0 2024-09-21T15:23:34.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.311+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9ad00 2024-09-21T15:23:34.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.311+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c84e0 2024-09-21T15:23:34.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.315+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c92b0 2024-09-21T15:23:34.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.315+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9c70 2024-09-21T15:23:34.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.315+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7334680 2024-09-21T15:23:34.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.315+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:23:34.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.315+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:23:34.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.327+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50820 2024-09-21T15:23:34.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.327+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50c30 2024-09-21T15:23:34.400 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.327+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51450 2024-09-21T15:23:34.401 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.327+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51c70 2024-09-21T15:23:34.401 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.327+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c410 2024-09-21T15:23:34.401 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.331+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d1e0 2024-09-21T15:23:34.401 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:34.339+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01da00 2024-09-21T15:23:34.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.460+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73b680 [3/43028d32-4202-4ac6-b083-241946f596da] start: already running 2024-09-21T15:23:34.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.460+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73b680 [3/43028d32-4202-4ac6-b083-241946f596da] start: already running 2024-09-21T15:23:34.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.460+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628780 [3/1ab01511-442c-4ff5-8810-7bb04776a396] start: already running 2024-09-21T15:23:34.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.460+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628780 [3/1ab01511-442c-4ff5-8810-7bb04776a396] start: already running 2024-09-21T15:23:34.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.460+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628780 [3/1ab01511-442c-4ff5-8810-7bb04776a396] start: already running 2024-09-21T15:23:34.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.460+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628780 [3/1ab01511-442c-4ff5-8810-7bb04776a396] start: already running 2024-09-21T15:23:34.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.460+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628780 [3/1ab01511-442c-4ff5-8810-7bb04776a396] start: already running 2024-09-21T15:23:34.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.460+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628780 [3/1ab01511-442c-4ff5-8810-7bb04776a396] start: already running 2024-09-21T15:23:34.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.460+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb628780 [3/1ab01511-442c-4ff5-8810-7bb04776a396] start: already running 2024-09-21T15:23:34.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb628f00 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:23:34.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb628f00 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:23:34.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb628f00 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:23:34.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb628f00 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:23:34.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb628f00 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:23:34.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb628f00 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:23:34.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb628f00 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:23:34.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f5b80 [3/616a1e50-ff37-4e76-b4b1-0f051d7e5ca3] start: already running 2024-09-21T15:23:34.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f5b80 [3/616a1e50-ff37-4e76-b4b1-0f051d7e5ca3] start: already running 2024-09-21T15:23:34.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb676f00 [3/2e0d532d-d0fa-46dd-8ea2-5577312481b6] start: already running 2024-09-21T15:23:34.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb676f00 [3/2e0d532d-d0fa-46dd-8ea2-5577312481b6] start: already running 2024-09-21T15:23:34.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb676f00 [3/2e0d532d-d0fa-46dd-8ea2-5577312481b6] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb676f00 [3/2e0d532d-d0fa-46dd-8ea2-5577312481b6] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb793900 [3/59c4deec-1cba-4460-94d5-6bed35911cea] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.536+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb793900 [3/59c4deec-1cba-4460-94d5-6bed35911cea] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.540+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb84b400 [3/8319ade8-0cb1-4b7e-98ca-ced578aceb3e] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb864000 [3/61e40bd2-a6f8-4810-904b-d9763ddf6fd0] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb864000 [3/61e40bd2-a6f8-4810-904b-d9763ddf6fd0] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb950a00 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb792f00 [3/50a1f802-df95-4e98-8630-fafd576b3b77] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb792f00 [3/50a1f802-df95-4e98-8630-fafd576b3b77] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4f00 [3/5d512263-1e55-4555-80ca-62bb3f5592fb] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4f00 [3/5d512263-1e55-4555-80ca-62bb3f5592fb] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a500 [3/2936d0d6-bde0-48c6-807a-b5288242b35d] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a500 [3/2936d0d6-bde0-48c6-807a-b5288242b35d] start: already running 2024-09-21T15:23:34.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a500 [3/2936d0d6-bde0-48c6-807a-b5288242b35d] start: already running 2024-09-21T15:23:34.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a500 [3/2936d0d6-bde0-48c6-807a-b5288242b35d] start: already running 2024-09-21T15:23:34.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb792c80 [3/4f24f6f0-5be2-4ea3-af4f-83dbaa368544] start: already running 2024-09-21T15:23:34.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb792c80 [3/4f24f6f0-5be2-4ea3-af4f-83dbaa368544] start: already running 2024-09-21T15:23:34.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb864500 [3/637122ca-60c4-4992-9f94-ae01ebaccd0e] start: already running 2024-09-21T15:23:34.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb864500 [3/637122ca-60c4-4992-9f94-ae01ebaccd0e] start: already running 2024-09-21T15:23:34.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb676c80 [3/2b696388-ccf4-4874-ae7a-646ab0d69446] start: already running 2024-09-21T15:23:34.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb676c80 [3/2b696388-ccf4-4874-ae7a-646ab0d69446] start: already running 2024-09-21T15:23:34.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb676c80 [3/2b696388-ccf4-4874-ae7a-646ab0d69446] start: already running 2024-09-21T15:23:34.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb676c80 [3/2b696388-ccf4-4874-ae7a-646ab0d69446] start: already running 2024-09-21T15:23:34.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb865900 [3/6dcfb50f-6365-4e2b-904c-11572f8ea5c9] start: already running 2024-09-21T15:23:34.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb865900 [3/6dcfb50f-6365-4e2b-904c-11572f8ea5c9] start: already running 2024-09-21T15:23:34.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb793680 [3/536a1fc6-237a-4cc9-9799-f875bd685121] start: already running 2024-09-21T15:23:34.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb793680 [3/536a1fc6-237a-4cc9-9799-f875bd685121] start: already running 2024-09-21T15:23:34.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb792000 [3/4a9de63d-2d57-4edb-9b9f-67ede03fdec6] start: already running 2024-09-21T15:23:34.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb792000 [3/4a9de63d-2d57-4edb-9b9f-67ede03fdec6] start: already running 2024-09-21T15:23:34.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9680 [3/18beec6d-0569-40d4-9d25-4aee7c0f6abb] start: already running 2024-09-21T15:23:34.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9680 [3/18beec6d-0569-40d4-9d25-4aee7c0f6abb] start: already running 2024-09-21T15:23:34.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9680 [3/18beec6d-0569-40d4-9d25-4aee7c0f6abb] start: already running 2024-09-21T15:23:34.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9680 [3/18beec6d-0569-40d4-9d25-4aee7c0f6abb] start: already running 2024-09-21T15:23:34.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9680 [3/18beec6d-0569-40d4-9d25-4aee7c0f6abb] start: already running 2024-09-21T15:23:34.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9680 [3/18beec6d-0569-40d4-9d25-4aee7c0f6abb] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9680 [3/18beec6d-0569-40d4-9d25-4aee7c0f6abb] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb92d180 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a000 [3/38d35746-a904-4bdd-bf2c-f409673624e7] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a000 [3/38d35746-a904-4bdd-bf2c-f409673624e7] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a000 [3/38d35746-a904-4bdd-bf2c-f409673624e7] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a000 [3/38d35746-a904-4bdd-bf2c-f409673624e7] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb84a280 [3/66ab926c-550e-47ad-ad7b-e61c7dbbcd06] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb84a280 [3/66ab926c-550e-47ad-ad7b-e61c7dbbcd06] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb705680 [3/5372d49a-7f62-4cee-a4e4-61183f5854a0] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb705680 [3/5372d49a-7f62-4cee-a4e4-61183f5854a0] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb865680 [3/6db0eab9-313d-45bf-828c-bf42d15aefce] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb865680 [3/6db0eab9-313d-45bf-828c-bf42d15aefce] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb951900 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:23:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704a00 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] start: already running 2024-09-21T15:23:34.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704a00 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] start: already running 2024-09-21T15:23:34.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704a00 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] start: already running 2024-09-21T15:23:34.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704a00 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] start: already running 2024-09-21T15:23:34.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f5680 [3/6019fe59-e961-41f3-881e-27522f0e43d6] start: already running 2024-09-21T15:23:34.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f5680 [3/6019fe59-e961-41f3-881e-27522f0e43d6] start: already running 2024-09-21T15:23:34.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704c80 [3/3d2cada1-cdba-4793-9a15-f743b41bee74] start: already running 2024-09-21T15:23:34.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704c80 [3/3d2cada1-cdba-4793-9a15-f743b41bee74] start: already running 2024-09-21T15:23:34.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb704c80 [3/3d2cada1-cdba-4793-9a15-f743b41bee74] start: already running 2024-09-21T15:23:34.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb951b80 [3/a15513b2-9cf9-4c80-b9b1-ea6973791935] start: already running 2024-09-21T15:23:34.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb84ac80 [3/7de4521f-65c0-4d27-870f-8b5a840e1a42] start: already running 2024-09-21T15:23:34.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6a00 [3/73d4dc39-4c38-488c-8699-cb2c5857bb77] start: already running 2024-09-21T15:23:34.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6a00 [3/73d4dc39-4c38-488c-8699-cb2c5857bb77] start: already running 2024-09-21T15:23:34.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb951400 [3/9c634cdf-a6f6-482b-a85c-0d163bc3d079] start: already running 2024-09-21T15:23:34.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb865400 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:23:34.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb865400 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:23:34.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb793180 [3/533f49cb-9e85-487d-a73d-6b891eb8fdc6] start: already running 2024-09-21T15:23:34.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb793180 [3/533f49cb-9e85-487d-a73d-6b891eb8fdc6] start: already running 2024-09-21T15:23:34.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a780 [3/2961b7ba-9b12-4b85-bd70-b26353c4e0fb] start: already running 2024-09-21T15:23:34.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a780 [3/2961b7ba-9b12-4b85-bd70-b26353c4e0fb] start: already running 2024-09-21T15:23:34.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a780 [3/2961b7ba-9b12-4b85-bd70-b26353c4e0fb] start: already running 2024-09-21T15:23:34.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a780 [3/2961b7ba-9b12-4b85-bd70-b26353c4e0fb] start: already running 2024-09-21T15:23:34.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb705400 [3/3e3bdb4c-3bdb-49bc-8680-3d524894c052] start: already running 2024-09-21T15:23:34.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb705400 [3/3e3bdb4c-3bdb-49bc-8680-3d524894c052] start: already running 2024-09-21T15:23:34.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.756+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb705400 [3/3e3bdb4c-3bdb-49bc-8680-3d524894c052] start: already running 2024-09-21T15:23:34.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:31.824+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb9e0280 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:23:34.412 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:23:34.412 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff5f0 2024-09-21T15:23:34.412 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783930 2024-09-21T15:23:34.412 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeef70 2024-09-21T15:23:34.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83709c0 2024-09-21T15:23:34.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a4e0 2024-09-21T15:23:34.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc680 2024-09-21T15:23:34.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5e10 2024-09-21T15:23:34.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35cdd0 2024-09-21T15:23:34.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6000 2024-09-21T15:23:34.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6268f0 2024-09-21T15:23:34.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.912+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c00080d0 2024-09-21T15:23:34.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.912+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008a90 2024-09-21T15:23:34.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:31.912+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920c30 2024-09-21T15:23:34.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18000 [3/ab585917-bbfb-41ce-a268-5e9596e12ef3] start: already running 2024-09-21T15:23:34.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d7680 [3/a88a0c18-875d-4624-b7df-602dca14305c] start: already running 2024-09-21T15:23:34.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab400 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:23:34.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab400 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:23:34.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab400 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:23:34.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab400 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:23:34.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab400 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:23:34.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab400 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:23:34.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab400 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:23:34.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0db80 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:23:34.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0db80 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:23:34.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0db80 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:23:34.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0db80 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:23:34.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0db80 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:23:34.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0db80 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:23:34.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0db80 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:23:34.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0db80 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:23:34.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa780 [3/0e38c267-ca71-47c8-85c5-6e571f45254e] start: already running 2024-09-21T15:23:34.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa780 [3/0e38c267-ca71-47c8-85c5-6e571f45254e] start: already running 2024-09-21T15:23:34.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa780 [3/0e38c267-ca71-47c8-85c5-6e571f45254e] start: already running 2024-09-21T15:23:34.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa780 [3/0e38c267-ca71-47c8-85c5-6e571f45254e] start: already running 2024-09-21T15:23:34.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa780 [3/0e38c267-ca71-47c8-85c5-6e571f45254e] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa780 [3/0e38c267-ca71-47c8-85c5-6e571f45254e] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa780 [3/0e38c267-ca71-47c8-85c5-6e571f45254e] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.064+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb950c80 [3/9899b7e1-7c24-4bdd-b213-241bfd0956fd] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd900 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd900 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd900 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd900 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd900 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd900 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd900 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18500 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18500 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18500 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18500 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:23:34.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18500 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18500 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18500 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18500 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545680 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545680 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545680 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545680 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545680 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942f00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942f00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942f00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942f00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942f00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942f00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:23:34.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942f00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:23:34.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942f00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:23:34.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18780 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:23:34.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18780 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:23:34.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18780 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:23:34.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18780 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:23:34.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18780 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:23:34.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18780 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:23:34.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18780 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:23:34.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18780 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:23:34.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4280 [3/58968828-f010-4fe8-9cec-0eac08331be4] start: already running 2024-09-21T15:23:34.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4280 [3/58968828-f010-4fe8-9cec-0eac08331be4] start: already running 2024-09-21T15:23:34.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab680 [3/11fce1ba-4c77-4152-b67e-fce8e444ea05] start: already running 2024-09-21T15:23:34.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab680 [3/11fce1ba-4c77-4152-b67e-fce8e444ea05] start: already running 2024-09-21T15:23:34.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab680 [3/11fce1ba-4c77-4152-b67e-fce8e444ea05] start: already running 2024-09-21T15:23:34.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab680 [3/11fce1ba-4c77-4152-b67e-fce8e444ea05] start: already running 2024-09-21T15:23:34.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab680 [3/11fce1ba-4c77-4152-b67e-fce8e444ea05] start: already running 2024-09-21T15:23:34.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab680 [3/11fce1ba-4c77-4152-b67e-fce8e444ea05] start: already running 2024-09-21T15:23:34.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab680 [3/11fce1ba-4c77-4152-b67e-fce8e444ea05] start: already running 2024-09-21T15:23:34.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6c80 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] start: already running 2024-09-21T15:23:34.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6c80 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] start: already running 2024-09-21T15:23:34.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34ddb80 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:23:34.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34ddb80 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:23:34.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34ddb80 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:23:34.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34ddb80 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:23:34.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34ddb80 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:23:34.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34ddb80 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:23:34.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34ddb80 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:23:34.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.124+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd3860a00 [3/e6696bd8-9005-4eeb-8e44-c70647860921] start: already running 2024-09-21T15:23:34.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.124+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd3860a00 [3/e6696bd8-9005-4eeb-8e44-c70647860921] start: already running 2024-09-21T15:23:34.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.124+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd3860a00 [3/e6696bd8-9005-4eeb-8e44-c70647860921] start: already running 2024-09-21T15:23:34.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.124+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd3860a00 [3/e6696bd8-9005-4eeb-8e44-c70647860921] start: already running 2024-09-21T15:23:34.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.124+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd3860a00 [3/e6696bd8-9005-4eeb-8e44-c70647860921] start: already running 2024-09-21T15:23:34.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.180+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba19900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:23:34.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.180+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba19900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:23:34.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.180+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba19900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:23:34.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.180+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba19900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:23:34.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.180+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba19900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:23:34.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.180+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba19900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:23:34.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.180+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba19900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:23:34.426 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.180+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba19900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:23:34.426 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.192+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18c80 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:23:34.426 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.192+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18c80 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:23:34.426 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.192+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18c80 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:23:34.426 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.192+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18c80 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:23:34.426 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.192+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18c80 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:23:34.426 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.192+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18c80 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:23:34.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.192+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18c80 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:23:34.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.192+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18c80 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:23:34.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb84b180 [3/8025792e-3904-4159-9de2-729ebbf24852] start: already running 2024-09-21T15:23:34.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9400 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:34.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9400 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:23:34.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9400 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:23:34.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9400 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:23:34.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9400 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:23:34.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9400 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:23:34.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9400 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:23:34.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9400 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:23:34.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc000 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:34.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc000 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:34.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc000 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:23:34.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc000 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc000 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc000 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc000 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc000 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc000 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.196+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc000 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.252+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb793b80 [3/59c93a57-c7d1-4245-95e1-c3b4a05e2c1a] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.252+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb793b80 [3/59c93a57-c7d1-4245-95e1-c3b4a05e2c1a] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.252+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830f00 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.252+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830f00 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.252+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830f00 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.252+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830f00 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.252+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830f00 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:23:34.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.252+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861180 [3/ee5e1490-4a11-4636-ab8f-ee0651bb84e7] start: already running 2024-09-21T15:23:34.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.252+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861180 [3/ee5e1490-4a11-4636-ab8f-ee0651bb84e7] start: already running 2024-09-21T15:23:34.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.252+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861180 [3/ee5e1490-4a11-4636-ab8f-ee0651bb84e7] start: already running 2024-09-21T15:23:34.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.252+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861180 [3/ee5e1490-4a11-4636-ab8f-ee0651bb84e7] start: already running 2024-09-21T15:23:34.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.252+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861180 [3/ee5e1490-4a11-4636-ab8f-ee0651bb84e7] start: already running 2024-09-21T15:23:34.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.252+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb92cf00 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:23:34.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc780 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:23:34.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc780 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:23:34.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc780 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:23:34.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc780 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:23:34.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc780 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:23:34.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc780 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc780 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc780 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d680 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d680 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d680 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d680 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d680 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830500 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830500 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830500 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830500 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830500 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831680 [3/e11bf669-24bd-415f-9833-0c4630550c23] start: already running 2024-09-21T15:23:34.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831680 [3/e11bf669-24bd-415f-9833-0c4630550c23] start: already running 2024-09-21T15:23:34.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831680 [3/e11bf669-24bd-415f-9833-0c4630550c23] start: already running 2024-09-21T15:23:34.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831680 [3/e11bf669-24bd-415f-9833-0c4630550c23] start: already running 2024-09-21T15:23:34.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831680 [3/e11bf669-24bd-415f-9833-0c4630550c23] start: already running 2024-09-21T15:23:34.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb705900 [3/55849911-b935-4c97-b400-325303585d1b] start: already running 2024-09-21T15:23:34.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb705900 [3/55849911-b935-4c97-b400-325303585d1b] start: already running 2024-09-21T15:23:34.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3860c80 [3/e6c1e46d-943e-48ab-b899-f1d65ff8944a] start: already running 2024-09-21T15:23:34.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3860c80 [3/e6c1e46d-943e-48ab-b899-f1d65ff8944a] start: already running 2024-09-21T15:23:34.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3860c80 [3/e6c1e46d-943e-48ab-b899-f1d65ff8944a] start: already running 2024-09-21T15:23:34.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3860c80 [3/e6c1e46d-943e-48ab-b899-f1d65ff8944a] start: already running 2024-09-21T15:23:34.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.256+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3860c80 [3/e6c1e46d-943e-48ab-b899-f1d65ff8944a] start: already running 2024-09-21T15:23:34.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:34.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone35': 2024-09-21T15:23:34.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:23:34.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:23:34.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4e1555a35 2024-09-21T15:23:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4e1555a35 2024-09-21T15:23:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:23:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:23:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:23:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:23:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:23:34.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4e1555a35 2024-09-21T15:23:34.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:34.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:34.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: f033ad39-c053-43aa-829a-9160c2473e5a 2024-09-21T15:23:34.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:34.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:34.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:34.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone36 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:34.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:34.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:34.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone36 2024-09-21T15:23:34.436 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:34.436 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:34.436 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:34.436 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:34.436 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.520+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4a00 [3/5d24c14f-898d-40de-9618-1f90e4165f5d] start: already running 2024-09-21T15:23:34.436 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.520+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4a00 [3/5d24c14f-898d-40de-9618-1f90e4165f5d] start: already running 2024-09-21T15:23:34.436 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414d900 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:23:34.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414d900 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:23:34.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414d900 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:23:34.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414d900 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:23:34.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414d900 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:23:34.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3545180 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:23:34.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3545180 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:23:34.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3545180 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:23:34.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3545180 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:23:34.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3545180 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:23:34.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3545180 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:23:34.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd180 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:23:34.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd180 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:23:34.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd180 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:23:34.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd180 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:23:34.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd180 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:23:34.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd180 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:23:34.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd180 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:23:34.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3861680 [3/eee89f94-874b-48ea-bcd4-804b53f039c0] start: already running 2024-09-21T15:23:34.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3861680 [3/eee89f94-874b-48ea-bcd4-804b53f039c0] start: already running 2024-09-21T15:23:34.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3861680 [3/eee89f94-874b-48ea-bcd4-804b53f039c0] start: already running 2024-09-21T15:23:34.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3861680 [3/eee89f94-874b-48ea-bcd4-804b53f039c0] start: already running 2024-09-21T15:23:34.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3861680 [3/eee89f94-874b-48ea-bcd4-804b53f039c0] start: already running 2024-09-21T15:23:34.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942780 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:23:34.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942780 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:23:34.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942780 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:23:34.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942780 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:23:34.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942780 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:23:34.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942780 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:23:34.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942780 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:23:34.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942780 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:23:34.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3545b80 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:23:34.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3545b80 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:23:34.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3545b80 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:23:34.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3545b80 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:23:34.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3545b80 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:23:34.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830a00 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:23:34.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830a00 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:23:34.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830a00 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830a00 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830a00 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830280 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830280 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830280 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830280 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830280 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830000 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830000 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830000 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830000 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830000 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcc80 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:23:34.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcc80 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:23:34.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcc80 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:23:34.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcc80 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:23:34.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcc80 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:23:34.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcc80 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:23:34.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcc80 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:23:34.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcc80 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:23:34.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860500 [3/e513238f-c4c4-4cbc-8a2f-c21215922f5f] start: already running 2024-09-21T15:23:34.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860500 [3/e513238f-c4c4-4cbc-8a2f-c21215922f5f] start: already running 2024-09-21T15:23:34.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860500 [3/e513238f-c4c4-4cbc-8a2f-c21215922f5f] start: already running 2024-09-21T15:23:34.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860500 [3/e513238f-c4c4-4cbc-8a2f-c21215922f5f] start: already running 2024-09-21T15:23:34.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860500 [3/e513238f-c4c4-4cbc-8a2f-c21215922f5f] start: already running 2024-09-21T15:23:34.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414cf00 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:23:34.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414cf00 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:23:34.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414cf00 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:23:34.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414cf00 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:23:34.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414cf00 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:23:34.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860000 [3/e4a35a0f-eabb-4389-9239-82ff9a0828e6] start: already running 2024-09-21T15:23:34.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860000 [3/e4a35a0f-eabb-4389-9239-82ff9a0828e6] start: already running 2024-09-21T15:23:34.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860000 [3/e4a35a0f-eabb-4389-9239-82ff9a0828e6] start: already running 2024-09-21T15:23:34.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860000 [3/e4a35a0f-eabb-4389-9239-82ff9a0828e6] start: already running 2024-09-21T15:23:34.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860000 [3/e4a35a0f-eabb-4389-9239-82ff9a0828e6] start: already running 2024-09-21T15:23:34.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3831180 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:23:34.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3831180 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:23:34.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3831180 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:23:34.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3831180 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3831180 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd680 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd680 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd680 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd680 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd680 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd680 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd680 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414c280 [3/f5f9a344-230e-4e5b-b1a4-3e4b4fc4cc86] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414c280 [3/f5f9a344-230e-4e5b-b1a4-3e4b4fc4cc86] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414c280 [3/f5f9a344-230e-4e5b-b1a4-3e4b4fc4cc86] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414c280 [3/f5f9a344-230e-4e5b-b1a4-3e4b4fc4cc86] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414c280 [3/f5f9a344-230e-4e5b-b1a4-3e4b4fc4cc86] start: already running 2024-09-21T15:23:34.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3861b80 [3/f033ad39-c053-43aa-829a-9160c2473e5a] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3861b80 [3/f033ad39-c053-43aa-829a-9160c2473e5a] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3861b80 [3/f033ad39-c053-43aa-829a-9160c2473e5a] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3861b80 [3/f033ad39-c053-43aa-829a-9160c2473e5a] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3861b80 [3/f033ad39-c053-43aa-829a-9160c2473e5a] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb864f00 [3/6af429ba-f735-4db2-8ce0-990e9e419129] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb864f00 [3/6af429ba-f735-4db2-8ce0-990e9e419129] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414cc80 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414cc80 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414cc80 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414cc80 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd414cc80 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2943b80 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2943b80 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:23:34.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2943b80 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:23:34.445 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2943b80 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:23:34.445 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2943b80 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:23:34.445 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2943b80 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:23:34.445 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2943b80 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:23:34.445 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2943b80 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:23:34.445 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb92d900 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:23:34.445 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb950f00 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:23:34.445 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f5900 [3/60ee4d91-fe2c-4f38-849f-9f6974471b07] start: already running 2024-09-21T15:23:34.445 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.636+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f5900 [3/60ee4d91-fe2c-4f38-849f-9f6974471b07] start: already running 2024-09-21T15:23:34.447 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.868+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:23:34.447 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.868+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9d40 2024-09-21T15:23:34.447 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.868+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:23:34.447 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x56017219ed00 2024-09-21T15:23:34.447 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:23:34.447 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x560173e67790 2024-09-21T15:23:34.447 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x5601743d3040 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7380 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cb60 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc0d0 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x5601762fdba0 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0270 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1ee0 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc8f0 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x5601780489c0 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x560169f10d00 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x56016ca80750 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9d40 2024-09-21T15:23:34.448 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:23:34.449 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:32.880+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:23:34.449 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.407+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3508f0 2024-09-21T15:23:34.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.407+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1fdebad0 2024-09-21T15:23:34.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.419+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2106e0d0 2024-09-21T15:23:34.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.419+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc217385b0 2024-09-21T15:23:34.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.419+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2182b860 2024-09-21T15:23:34.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.419+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0c4e0 2024-09-21T15:23:34.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.423+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0cea0 2024-09-21T15:23:34.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.423+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0d520 2024-09-21T15:23:34.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.427+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0dc70 2024-09-21T15:23:34.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.431+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264ea9c0 2024-09-21T15:23:34.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.431+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb5f0 2024-09-21T15:23:34.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.431+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb860 2024-09-21T15:23:34.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.435+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc26ecd040 2024-09-21T15:23:34.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.435+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc26ecd520 2024-09-21T15:23:34.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.435+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc26ecd5f0 2024-09-21T15:23:34.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.435+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2820 2024-09-21T15:23:34.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.435+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc288f51e0 2024-09-21T15:23:34.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.435+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc288f5d40 2024-09-21T15:23:34.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.435+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc28e3e750 2024-09-21T15:23:34.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d400 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:23:34.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d400 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:23:34.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d400 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:23:34.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d400 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:23:34.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d400 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:23:34.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb864c80 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:23:34.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb864c80 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:23:34.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d7b80 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:23:34.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589680 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:23:34.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589680 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:23:34.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589680 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:23:34.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589680 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:23:34.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589680 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:23:34.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589680 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:23:34.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.984+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9589680 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:23:34.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa000 [3/06206359-a5f6-4376-970d-9f794536ac14] start: already running 2024-09-21T15:23:34.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa000 [3/06206359-a5f6-4376-970d-9f794536ac14] start: already running 2024-09-21T15:23:34.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa000 [3/06206359-a5f6-4376-970d-9f794536ac14] start: already running 2024-09-21T15:23:34.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa000 [3/06206359-a5f6-4376-970d-9f794536ac14] start: already running 2024-09-21T15:23:34.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa000 [3/06206359-a5f6-4376-970d-9f794536ac14] start: already running 2024-09-21T15:23:34.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa000 [3/06206359-a5f6-4376-970d-9f794536ac14] start: already running 2024-09-21T15:23:34.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aa000 [3/06206359-a5f6-4376-970d-9f794536ac14] start: already running 2024-09-21T15:23:34.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb92c780 [3/8a44e3ef-3163-4842-8e5c-c12038e5ac8c] start: already running 2024-09-21T15:23:34.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8000 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:23:34.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8000 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:23:34.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8000 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:23:34.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8000 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:23:34.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8000 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:23:34.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8000 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:23:34.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8000 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:23:34.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc500 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:23:34.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc500 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:23:34.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc500 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:23:34.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc500 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:23:34.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc500 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:23:34.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc500 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc500 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc500 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9900 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9900 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545900 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545900 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545900 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545900 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545900 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3860280 [3/e4d1114b-ada5-4ff8-999f-0119c103708f] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3860280 [3/e4d1114b-ada5-4ff8-999f-0119c103708f] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3860280 [3/e4d1114b-ada5-4ff8-999f-0119c103708f] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3860280 [3/e4d1114b-ada5-4ff8-999f-0119c103708f] start: already running 2024-09-21T15:23:34.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3860280 [3/e4d1114b-ada5-4ff8-999f-0119c103708f] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943400 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943400 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943400 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943400 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943400 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943400 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943400 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943400 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0d900 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0d900 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0d900 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0d900 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0d900 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:23:34.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0d900 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:23:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0d900 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:23:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcbd0d900 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:23:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628a00 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:23:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628a00 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:23:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4500 [3/5a2bda13-d29d-4620-a6e7-180dd2cee0a8] start: already running 2024-09-21T15:23:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4500 [3/5a2bda13-d29d-4620-a6e7-180dd2cee0a8] start: already running 2024-09-21T15:23:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaf00 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:23:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaf00 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:23:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaf00 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:23:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaf00 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:23:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaf00 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:23:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaf00 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:23:34.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1aaf00 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588a00 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588a00 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588a00 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588a00 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588a00 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588a00 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fc9588a00 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628000 [3/195f6116-53dd-4f4c-9885-eb0d620dc00c] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628000 [3/195f6116-53dd-4f4c-9885-eb0d620dc00c] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628000 [3/195f6116-53dd-4f4c-9885-eb0d620dc00c] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628000 [3/195f6116-53dd-4f4c-9885-eb0d620dc00c] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628000 [3/195f6116-53dd-4f4c-9885-eb0d620dc00c] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628000 [3/195f6116-53dd-4f4c-9885-eb0d620dc00c] start: already running 2024-09-21T15:23:34.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:32.988+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628000 [3/195f6116-53dd-4f4c-9885-eb0d620dc00c] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861900 [3/ef79be89-94fa-4d0c-a9a8-2fd05127bdc5] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861900 [3/ef79be89-94fa-4d0c-a9a8-2fd05127bdc5] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861900 [3/ef79be89-94fa-4d0c-a9a8-2fd05127bdc5] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861900 [3/ef79be89-94fa-4d0c-a9a8-2fd05127bdc5] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861900 [3/ef79be89-94fa-4d0c-a9a8-2fd05127bdc5] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831400 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831400 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831400 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831400 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831400 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd3831400 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8a00 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8a00 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8a00 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:23:34.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8a00 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8a00 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b8a00 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4c80 [3/5d444500-7ead-4909-a696-94bdbd9f7e8c] start: already running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4c80 [3/5d444500-7ead-4909-a696-94bdbd9f7e8c] start: already running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb864280 [3/62263722-a51f-40ca-9cc5-1ab605e9bb14] start: already running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb864280 [3/62263722-a51f-40ca-9cc5-1ab605e9bb14] start: already running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.240+0000 7fd40715b700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fcbec2000 get_replay_status: replay not running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab180 [3/0fa7a298-927a-43ff-b471-c5ded7e56000] start: already running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab180 [3/0fa7a298-927a-43ff-b471-c5ded7e56000] start: already running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab180 [3/0fa7a298-927a-43ff-b471-c5ded7e56000] start: already running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab180 [3/0fa7a298-927a-43ff-b471-c5ded7e56000] start: already running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab180 [3/0fa7a298-927a-43ff-b471-c5ded7e56000] start: already running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab180 [3/0fa7a298-927a-43ff-b471-c5ded7e56000] start: already running 2024-09-21T15:23:34.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb1ab180 [3/0fa7a298-927a-43ff-b471-c5ded7e56000] start: already running 2024-09-21T15:23:34.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3544780 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:23:34.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3544780 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:23:34.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3544780 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:23:34.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3544780 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:23:34.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3544780 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:23:34.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3544780 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:23:34.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb792280 [3/4b9face3-5cac-4c8c-ab5f-f75cbc0915bc] start: already running 2024-09-21T15:23:34.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb792280 [3/4b9face3-5cac-4c8c-ab5f-f75cbc0915bc] start: already running 2024-09-21T15:23:34.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb69af00 [3/2df7d008-2aa8-45c9-992d-6135bdf46eec] start: already running 2024-09-21T15:23:34.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb69af00 [3/2df7d008-2aa8-45c9-992d-6135bdf46eec] start: already running 2024-09-21T15:23:34.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb69af00 [3/2df7d008-2aa8-45c9-992d-6135bdf46eec] start: already running 2024-09-21T15:23:34.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb69af00 [3/2df7d008-2aa8-45c9-992d-6135bdf46eec] start: already running 2024-09-21T15:23:34.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b900 [3/33006863-7504-40fd-b7bf-bdaf3c7c6daa] start: already running 2024-09-21T15:23:34.463 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b900 [3/33006863-7504-40fd-b7bf-bdaf3c7c6daa] start: already running 2024-09-21T15:23:34.463 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b900 [3/33006863-7504-40fd-b7bf-bdaf3c7c6daa] start: already running 2024-09-21T15:23:34.463 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb69b900 [3/33006863-7504-40fd-b7bf-bdaf3c7c6daa] start: already running 2024-09-21T15:23:34.463 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb84a780 [3/7d0b51cc-d698-4c7c-856b-37b97a187993] start: already running 2024-09-21T15:23:34.463 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6780 [3/73b4e1fe-3f10-4db7-b803-aa7461633260] start: already running 2024-09-21T15:23:34.463 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.368+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d6780 [3/73b4e1fe-3f10-4db7-b803-aa7461633260] start: already running 2024-09-21T15:23:34.463 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:34.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.472+0000 7fd40695a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fcb9e3180 get_replay_status: replay not running 2024-09-21T15:23:34.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.484+0000 7fd40695a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fd61b0380 get_replay_status: replay not running 2024-09-21T15:23:34.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.504+0000 7fd40695a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fcc03ae00 get_replay_status: replay not running 2024-09-21T15:23:34.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.572+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:23:34.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.572+0000 7ff753f07700 -1 reset not still connected to 0x56017219ed00 2024-09-21T15:23:34.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.580+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cb60 2024-09-21T15:23:34.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.580+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cc30 2024-09-21T15:23:34.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.592+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc0d0 2024-09-21T15:23:34.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.592+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc680 2024-09-21T15:23:34.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.592+0000 7ff753f07700 -1 reset not still connected to 0x5601762fdba0 2024-09-21T15:23:34.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.592+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0270 2024-09-21T15:23:34.465 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.592+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1ee0 2024-09-21T15:23:34.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.604+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb677400 [3/30daac8e-2d9f-4da1-a5a1-1fa7d734a3e5] start: already running 2024-09-21T15:23:34.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.604+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb677400 [3/30daac8e-2d9f-4da1-a5a1-1fa7d734a3e5] start: already running 2024-09-21T15:23:34.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.604+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb677400 [3/30daac8e-2d9f-4da1-a5a1-1fa7d734a3e5] start: already running 2024-09-21T15:23:34.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.604+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb677400 [3/30daac8e-2d9f-4da1-a5a1-1fa7d734a3e5] start: already running 2024-09-21T15:23:34.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.604+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb92cc80 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:23:34.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.604+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb704780 [3/36cc0788-436b-4847-beeb-ef7205663578] start: already running 2024-09-21T15:23:34.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.604+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb704780 [3/36cc0788-436b-4847-beeb-ef7205663578] start: already running 2024-09-21T15:23:34.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.604+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb704780 [3/36cc0788-436b-4847-beeb-ef7205663578] start: already running 2024-09-21T15:23:34.467 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.604+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb704780 [3/36cc0788-436b-4847-beeb-ef7205663578] start: already running 2024-09-21T15:23:34.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.596+0000 7ff753f07700 -1 reset not still connected to 0x5601772731e0 2024-09-21T15:23:34.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.604+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc000 2024-09-21T15:23:34.468 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.604+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:23:34.468 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.612+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc8f0 2024-09-21T15:23:34.468 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.612+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:23:34.468 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.612+0000 7ff753f07700 -1 reset not still connected to 0x560177985ba0 2024-09-21T15:23:34.468 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.612+0000 7ff753f07700 -1 reset not still connected to 0x5601780489c0 2024-09-21T15:23:34.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone36': 2024-09-21T15:23:34.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 235 MiB in 60 objects 2024-09-21T15:23:34.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:23:34.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:34.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9f54ae87c 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9f54ae87c 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9f54ae87c 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:34.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:34.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1 2024-09-21T15:23:34.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:34.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:34.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:34.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone37 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:34.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:34.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:34.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone37 2024-09-21T15:23:34.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:34.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:34.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:34.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:34.474 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x560169f10d00 2024-09-21T15:23:34.474 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016a9e61a0 2024-09-21T15:23:34.474 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016ad40c30 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016b24e5b0 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016ca80750 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba270 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbba00 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016e36eb60 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016e36fc70 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d25b0 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2d00 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016f1b7110 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90680 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016fe916c0 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016feff6c0 2024-09-21T15:23:34.475 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9d40 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.788+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9e10 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.792+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.800+0000 7ff753f07700 -1 reset not still connected to 0x560171d01a00 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.800+0000 7ff753f07700 -1 reset not still connected to 0x56017219ed00 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2270 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601743d3ee0 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7380 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cb60 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc0d0 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc4e0 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc680 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd1e0 2024-09-21T15:23:34.476 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0270 2024-09-21T15:23:34.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1ee0 2024-09-21T15:23:34.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601772731e0 2024-09-21T15:23:34.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc000 2024-09-21T15:23:34.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:23:34.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc8f0 2024-09-21T15:23:34.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:23:34.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x560177985ba0 2024-09-21T15:23:34.477 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:33.808+0000 7ff753f07700 -1 reset not still connected to 0x5601780489c0 2024-09-21T15:23:34.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.896+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dad380 2024-09-21T15:23:34.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6ea0 2024-09-21T15:23:34.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2858750 2024-09-21T15:23:34.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50a90 2024-09-21T15:23:34.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:23:34.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3386340 2024-09-21T15:23:34.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77c70 2024-09-21T15:23:34.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8ef70 2024-09-21T15:23:34.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:23:34.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:23:34.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:23:34.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc680 2024-09-21T15:23:34.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9010410 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165ad0 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3930 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3ad0 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c270 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3505b0 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53ad0 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008340 2024-09-21T15:23:34.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.900+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921930 2024-09-21T15:23:34.481 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860f00 [3/ed8f9c7d-1492-4fbd-ae77-4c3bfa2f3787] start: already running 2024-09-21T15:23:34.481 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860f00 [3/ed8f9c7d-1492-4fbd-ae77-4c3bfa2f3787] start: already running 2024-09-21T15:23:34.481 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860f00 [3/ed8f9c7d-1492-4fbd-ae77-4c3bfa2f3787] start: already running 2024-09-21T15:23:34.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860f00 [3/ed8f9c7d-1492-4fbd-ae77-4c3bfa2f3787] start: already running 2024-09-21T15:23:34.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860f00 [3/ed8f9c7d-1492-4fbd-ae77-4c3bfa2f3787] start: already running 2024-09-21T15:23:34.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fd3830c80 [3/dc874683-1fb8-422d-a7dc-6396041ed697] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:34.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd3830c80 [3/dc874683-1fb8-422d-a7dc-6396041ed697] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:34.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830c80 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:23:34.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830c80 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:23:34.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830c80 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:23:34.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830c80 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:23:34.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3830c80 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:23:34.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb84af00 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:34.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb84af00 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:34.483 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.924+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb84af00 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] start: already running 2024-09-21T15:23:34.483 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:33.928+0000 7fd40695a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fcfc2a000 get_replay_status: replay not running 2024-09-21T15:23:34.484 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.984+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dad380 2024-09-21T15:23:34.484 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.984+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2858750 2024-09-21T15:23:34.484 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.988+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:23:34.484 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.988+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:23:34.484 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.988+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77c70 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.988+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8ef70 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.988+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.988+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.992+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387380 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.992+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cd860 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.992+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:33.992+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc680 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9010410 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90116c0 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165ad0 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4c30 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:23:34.485 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3ad0 2024-09-21T15:23:34.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6f70 2024-09-21T15:23:34.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc425ee0 2024-09-21T15:23:34.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:23:34.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3505b0 2024-09-21T15:23:34.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:23:34.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:23:34.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:23:34.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6268f0 2024-09-21T15:23:34.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53ad0 2024-09-21T15:23:34.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008340 2024-09-21T15:23:34.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921110 2024-09-21T15:23:34.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:34.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921930 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.068+0000 7ff753f07700 -1 reset not still connected to 0x56016b24e5b0 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.068+0000 7ff753f07700 -1 reset not still connected to 0x56016ca80750 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.068+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba270 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.068+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d25b0 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.072+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.076+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x5601709b96c0 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9d40 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9e10 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x56017219ed00 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2270 2024-09-21T15:23:34.489 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc0d0 2024-09-21T15:23:34.490 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc680 2024-09-21T15:23:34.490 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0270 2024-09-21T15:23:34.490 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1ee0 2024-09-21T15:23:34.490 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x5601772731e0 2024-09-21T15:23:34.490 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:23:34.490 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc8f0 2024-09-21T15:23:34.490 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:23:34.490 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.084+0000 7ff753f07700 -1 reset not still connected to 0x5601780489c0 2024-09-21T15:23:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fd3544c80 [3/cb06e058-0aca-44b5-9820-87e1992c0207] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3544c80 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:23:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3544c80 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:23:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3544c80 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:23:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3544c80 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:23:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3544c80 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:23:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3544c80 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:23:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcf00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcf00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcf00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:23:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcf00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:23:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcf00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:23:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcf00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcf00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcf00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dcf00 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942a00 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942a00 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942a00 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942a00 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942a00 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942a00 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942a00 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd2942a00 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860780 [3/e51aede5-de84-423f-9449-2f9e9884385e] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860780 [3/e51aede5-de84-423f-9449-2f9e9884385e] start: already running 2024-09-21T15:23:34.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860780 [3/e51aede5-de84-423f-9449-2f9e9884385e] start: already running 2024-09-21T15:23:34.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860780 [3/e51aede5-de84-423f-9449-2f9e9884385e] start: already running 2024-09-21T15:23:34.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3860780 [3/e51aede5-de84-423f-9449-2f9e9884385e] start: already running 2024-09-21T15:23:34.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd400 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:23:34.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd400 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:23:34.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd400 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:23:34.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd400 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:23:34.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd400 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:23:34.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd400 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:23:34.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.164+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd34dd400 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:23:34.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.200+0000 7fd40715b700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fd66c2380 get_replay_status: replay not running 2024-09-21T15:23:34.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb865180 [3/6c3b3b70-9cbd-4de9-9ecc-2955d67c515d] start: already running 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb865180 [3/6c3b3b70-9cbd-4de9-9ecc-2955d67c515d] start: already running 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fd414c000 [3/f2dae9ca-5e22-44e6-90a3-2cbebe5fa594] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c000 [3/f2dae9ca-5e22-44e6-90a3-2cbebe5fa594] start: already running 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c000 [3/f2dae9ca-5e22-44e6-90a3-2cbebe5fa594] start: already running 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c000 [3/f2dae9ca-5e22-44e6-90a3-2cbebe5fa594] start: already running 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c000 [3/f2dae9ca-5e22-44e6-90a3-2cbebe5fa594] start: already running 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c000 [3/f2dae9ca-5e22-44e6-90a3-2cbebe5fa594] start: already running 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb864780 [3/639e7549-39e6-4963-86db-7a414ac8d909] start: already running 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb864780 [3/639e7549-39e6-4963-86db-7a414ac8d909] start: already running 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb92d400 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861400 [3/ee8573b9-7a14-470f-b519-004503b68b59] start: already running 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861400 [3/ee8573b9-7a14-470f-b519-004503b68b59] start: already running 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861400 [3/ee8573b9-7a14-470f-b519-004503b68b59] start: already running 2024-09-21T15:23:34.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861400 [3/ee8573b9-7a14-470f-b519-004503b68b59] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3861400 [3/ee8573b9-7a14-470f-b519-004503b68b59] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d7180 [3/79702e90-a4fc-44eb-b594-346223325651] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb8d7180 [3/79702e90-a4fc-44eb-b594-346223325651] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb92db80 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414ca00 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414ca00 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414ca00 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414ca00 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414ca00 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a000 [3/27b12a21-b493-4095-b7d3-cfe660cb3dbd] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a000 [3/27b12a21-b493-4095-b7d3-cfe660cb3dbd] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a000 [3/27b12a21-b493-4095-b7d3-cfe660cb3dbd] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a000 [3/27b12a21-b493-4095-b7d3-cfe660cb3dbd] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb84aa00 [3/7da6e340-1c90-4fa6-9dff-abf5cab1d562] start: already running 2024-09-21T15:23:34.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb629b80 [3/2037df74-ba68-4814-bebc-291884a396bb] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb629b80 [3/2037df74-ba68-4814-bebc-291884a396bb] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb629b80 [3/2037df74-ba68-4814-bebc-291884a396bb] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.212+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb629b80 [3/2037df74-ba68-4814-bebc-291884a396bb] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.264+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73b400 [3/4026d3a9-81ff-4074-aa36-3ae99da1306d] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.264+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73b400 [3/4026d3a9-81ff-4074-aa36-3ae99da1306d] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.264+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9b80 [3/19512931-b55f-4107-8787-bbdcbc6a72f8] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.264+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9b80 [3/19512931-b55f-4107-8787-bbdcbc6a72f8] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.264+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9b80 [3/19512931-b55f-4107-8787-bbdcbc6a72f8] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.264+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9b80 [3/19512931-b55f-4107-8787-bbdcbc6a72f8] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.264+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9b80 [3/19512931-b55f-4107-8787-bbdcbc6a72f8] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.264+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9b80 [3/19512931-b55f-4107-8787-bbdcbc6a72f8] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.264+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb1b9b80 [3/19512931-b55f-4107-8787-bbdcbc6a72f8] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.264+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a280 [3/284dc960-2660-419d-b060-d0e1013bae61] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.264+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a280 [3/284dc960-2660-419d-b060-d0e1013bae61] start: already running 2024-09-21T15:23:34.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.264+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a280 [3/284dc960-2660-419d-b060-d0e1013bae61] start: already running 2024-09-21T15:23:34.498 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.264+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69a280 [3/284dc960-2660-419d-b060-d0e1013bae61] start: already running 2024-09-21T15:23:34.498 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.288+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9d40 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.292+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.324+0000 7ff753f07700 -1 reset not still connected to 0x560173d87a00 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.324+0000 7ff753f07700 -1 reset not still connected to 0x560173e67790 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.328+0000 7ff753f07700 -1 reset not still connected to 0x5601743d3ee0 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.328+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7380 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.328+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cc30 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.328+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc0d0 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.328+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc680 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.328+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd1e0 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.328+0000 7ff753f07700 -1 reset not still connected to 0x5601762fdba0 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.328+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0270 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.328+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1ee0 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.328+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc000 2024-09-21T15:23:34.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.328+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:23:34.500 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.336+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc8f0 2024-09-21T15:23:34.500 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.364+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:23:34.500 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.364+0000 7ff753f07700 -1 reset not still connected to 0x560177985ba0 2024-09-21T15:23:34.500 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:34.364+0000 7ff753f07700 -1 reset not still connected to 0x5601780489c0 2024-09-21T15:23:34.501 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.412+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef11e0 2024-09-21T15:23:34.501 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.416+0000 7f52f1ba9700 -1 reset not still connected to 0x557142628820 2024-09-21T15:23:34.502 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.420+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8f70 2024-09-21T15:23:34.502 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.420+0000 7f52f1ba9700 -1 reset not still connected to 0x557143600f70 2024-09-21T15:23:34.502 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.420+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601380 2024-09-21T15:23:34.502 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.428+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601860 2024-09-21T15:23:34.502 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.428+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76a90 2024-09-21T15:23:34.502 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.428+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77380 2024-09-21T15:23:34.502 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.428+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cd00 2024-09-21T15:23:34.502 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.428+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456d450 2024-09-21T15:23:34.502 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.428+0000 7f52f1ba9700 -1 reset not still connected to 0x5571456a3040 2024-09-21T15:23:34.502 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.428+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f1e0 2024-09-21T15:23:34.502 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.428+0000 7f52f1ba9700 -1 reset not still connected to 0x557146764270 2024-09-21T15:23:34.502 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.428+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765040 2024-09-21T15:23:34.502 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.428+0000 7f52f1ba9700 -1 reset not still connected to 0x5571472268f0 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.428+0000 7f52f1ba9700 -1 reset not still connected to 0x557148000680 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.428+0000 7f52f1ba9700 -1 reset not still connected to 0x557148000dd0 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.432+0000 7f52f1ba9700 -1 reset not still connected to 0x557148001040 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.432+0000 7f52f1ba9700 -1 reset not still connected to 0x557148001930 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.432+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012270 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.432+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821a000 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.432+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a0d0 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.432+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29b380 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.432+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf0750 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.432+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb2000 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.436+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3450 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.436+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe1a0 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.436+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ffee0 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.468+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ad1eb60 2024-09-21T15:23:34.503 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b450f70 2024-09-21T15:23:34.504 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf7d110 2024-09-21T15:23:34.504 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.480+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cdd40 2024-09-21T15:23:34.504 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.480+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:23:34.504 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.484+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dc70 2024-09-21T15:23:34.504 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.484+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0680 2024-09-21T15:23:34.504 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.496+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba270 2024-09-21T15:23:34.504 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.496+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba8f0 2024-09-21T15:23:34.505 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.496+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb1e0 2024-09-21T15:23:34.505 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.496+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef11e0 2024-09-21T15:23:34.505 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:23:34.505 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557142628820 2024-09-21T15:23:34.505 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557142d000d0 2024-09-21T15:23:34.505 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8f70 2024-09-21T15:23:34.505 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557143600f70 2024-09-21T15:23:34.505 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601380 2024-09-21T15:23:34.505 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601860 2024-09-21T15:23:34.506 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76a90 2024-09-21T15:23:34.506 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77380 2024-09-21T15:23:34.506 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557143bf5ad0 2024-09-21T15:23:34.506 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cd00 2024-09-21T15:23:34.506 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456d450 2024-09-21T15:23:34.506 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x5571456a3040 2024-09-21T15:23:34.507 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f1e0 2024-09-21T15:23:34.507 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557146764270 2024-09-21T15:23:34.507 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765040 2024-09-21T15:23:34.507 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765ba0 2024-09-21T15:23:34.507 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x5571472268f0 2024-09-21T15:23:34.507 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557148000680 2024-09-21T15:23:34.507 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557148000dd0 2024-09-21T15:23:34.507 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557148001040 2024-09-21T15:23:34.507 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557148001930 2024-09-21T15:23:34.507 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012270 2024-09-21T15:23:34.507 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.500+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821a000 2024-09-21T15:23:34.511 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.504+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a0d0 2024-09-21T15:23:34.511 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.504+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29b380 2024-09-21T15:23:34.511 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.504+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf0750 2024-09-21T15:23:34.511 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.504+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb2000 2024-09-21T15:23:34.511 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.504+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3450 2024-09-21T15:23:34.511 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.504+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe1a0 2024-09-21T15:23:34.511 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:34.504+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ffee0 2024-09-21T15:23:34.517 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942c80 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:23:34.517 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942c80 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:23:34.517 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942c80 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:23:34.517 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942c80 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:23:34.517 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942c80 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:23:34.517 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942c80 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:23:34.517 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942c80 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:23:34.517 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2942c80 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:23:34.517 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3544a00 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:23:34.518 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3544a00 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:23:34.518 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3544a00 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:23:34.518 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3544a00 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:23:34.518 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3544a00 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:23:34.518 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.512+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3544a00 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:23:34.519 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.516+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb951680 [3/9f1ae171-c261-402d-a90a-2b4cca77a51c] start: already running 2024-09-21T15:23:34.649 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.643+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1940f5f0 2024-09-21T15:23:34.649 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.643+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1b73f110 2024-09-21T15:23:34.649 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.643+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1dba0410 2024-09-21T15:23:34.650 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.643+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1dba0680 2024-09-21T15:23:34.650 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.643+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1dba1860 2024-09-21T15:23:34.650 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.643+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1dba1ee0 2024-09-21T15:23:34.650 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.643+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3508f0 2024-09-21T15:23:34.654 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:34.660 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1fdebad0 2024-09-21T15:23:34.661 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:23:34.661 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2106e0d0 2024-09-21T15:23:34.661 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21709520 2024-09-21T15:23:34.661 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc217385b0 2024-09-21T15:23:34.661 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21739ba0 2024-09-21T15:23:34.661 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2182b860 2024-09-21T15:23:34.661 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0c4e0 2024-09-21T15:23:34.661 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0cea0 2024-09-21T15:23:34.661 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0d520 2024-09-21T15:23:34.661 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264ea9c0 2024-09-21T15:23:34.661 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb5f0 2024-09-21T15:23:34.661 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb860 2024-09-21T15:23:34.662 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc26ecd040 2024-09-21T15:23:34.662 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.655+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc26ecd520 2024-09-21T15:23:34.667 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.659+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc26ecd5f0 2024-09-21T15:23:34.667 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.659+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2820 2024-09-21T15:23:34.667 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.659+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc288f51e0 2024-09-21T15:23:34.667 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.663+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc288f5d40 2024-09-21T15:23:34.667 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.663+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc28e3e4e0 2024-09-21T15:23:34.667 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:34.663+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc28e3e750 2024-09-21T15:23:34.707 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.704+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943180 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:23:34.707 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.704+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943180 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:23:34.707 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.704+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943180 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:23:34.707 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.704+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943180 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:23:34.707 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.704+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943180 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:23:34.708 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.704+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943180 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:23:34.708 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.704+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943180 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:23:34.708 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.704+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943180 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:23:34.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.776+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3831b80 [3/e33347f9-479f-4080-b33f-92c69acaa835] start: already running 2024-09-21T15:23:34.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.776+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3831b80 [3/e33347f9-479f-4080-b33f-92c69acaa835] start: already running 2024-09-21T15:23:34.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.776+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3831b80 [3/e33347f9-479f-4080-b33f-92c69acaa835] start: already running 2024-09-21T15:23:34.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.776+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3831b80 [3/e33347f9-479f-4080-b33f-92c69acaa835] start: already running 2024-09-21T15:23:34.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.776+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3831b80 [3/e33347f9-479f-4080-b33f-92c69acaa835] start: already running 2024-09-21T15:23:34.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.776+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3544f00 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:23:34.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.776+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3544f00 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:23:34.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.776+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3544f00 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:23:34.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.776+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3544f00 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:23:34.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.776+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3544f00 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:23:34.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.776+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fd3544f00 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:23:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone37': 2024-09-21T15:23:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 5.5 MiB in 8 objects 2024-09-21T15:23:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:23:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b99353d8ed 2024-09-21T15:23:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b99353d8ed 2024-09-21T15:23:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:34.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:34.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:23:34.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:34.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone36@snap 2024-09-21T15:23:34.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 5.5 MiB 2024-09-21T15:23:34.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:23:34.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:23:34.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b99353d8ed 2024-09-21T15:23:34.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:34.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:34.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b1ddd406-16bd-4901-9f94-c81bbe5c9ca5 2024-09-21T15:23:34.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:34.814 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:34.814 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:34.814 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone38 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:34.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:34.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:34.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone38 2024-09-21T15:23:34.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:34.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:34.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:34.815 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:34.906 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.904+0000 7fd40715b700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fcdfe0380 get_replay_status: replay not running 2024-09-21T15:23:34.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.920+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4000 [3/55c2a1c2-e5de-4bcb-8d07-45955fdc4e18] start: already running 2024-09-21T15:23:34.925 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:34.920+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f4000 [3/55c2a1c2-e5de-4bcb-8d07-45955fdc4e18] start: already running 2024-09-21T15:23:35.096 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.092+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb84b680 [3/85d0a44e-84cb-4cc5-bee6-694533ad4fbd] start: already running 2024-09-21T15:23:35.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830780 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:23:35.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830780 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:23:35.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830780 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:23:35.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830780 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:23:35.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.116+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3830780 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:23:35.234 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.227+0000 7f7fd044c700 -1 reset not still connected to 0x5636a04a1450 2024-09-21T15:23:35.275 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636a4b15860 2024-09-21T15:23:35.275 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636a780e5b0 2024-09-21T15:23:35.275 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636a780f6c0 2024-09-21T15:23:35.275 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8d0dad0 2024-09-21T15:23:35.275 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef025b0 2024-09-21T15:23:35.278 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636b0b3f450 2024-09-21T15:23:35.278 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e4e0 2024-09-21T15:23:35.278 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e8f0 2024-09-21T15:23:35.278 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65520 2024-09-21T15:23:35.278 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:23:35.278 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a410 2024-09-21T15:23:35.279 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9ad00 2024-09-21T15:23:35.279 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:23:35.279 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c84e0 2024-09-21T15:23:35.279 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c92b0 2024-09-21T15:23:35.279 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9c70 2024-09-21T15:23:35.279 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:23:35.279 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7334680 2024-09-21T15:23:35.279 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.263+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766340 2024-09-21T15:23:35.280 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.275+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:23:35.280 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.275+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:23:35.280 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.275+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8340 2024-09-21T15:23:35.280 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.275+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50820 2024-09-21T15:23:35.280 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.275+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50b60 2024-09-21T15:23:35.280 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.275+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50c30 2024-09-21T15:23:35.312 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.308+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddc70 2024-09-21T15:23:35.315 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.307+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50ea0 2024-09-21T15:23:35.317 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.308+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07790 2024-09-21T15:23:35.317 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.312+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4c8f0 2024-09-21T15:23:35.317 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.312+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dad380 2024-09-21T15:23:35.317 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.312+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd0a90 2024-09-21T15:23:35.317 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.312+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2858750 2024-09-21T15:23:35.318 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.311+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f515f0 2024-09-21T15:23:35.318 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.311+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51ba0 2024-09-21T15:23:35.320 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.311+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde26f70 2024-09-21T15:23:35.320 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.311+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde272b0 2024-09-21T15:23:35.320 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.311+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c410 2024-09-21T15:23:35.320 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.311+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c750 2024-09-21T15:23:35.320 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.315+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d1e0 2024-09-21T15:23:35.320 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.315+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d380 2024-09-21T15:23:35.325 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.319+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01da00 2024-09-21T15:23:35.332 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.324+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:23:35.332 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.324+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:23:35.332 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.324+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:23:35.339 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.332+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3687380 2024-09-21T15:23:35.361 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.348+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:23:35.361 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.348+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77c70 2024-09-21T15:23:35.361 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.348+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8ef70 2024-09-21T15:23:35.361 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.348+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5635790 2024-09-21T15:23:35.361 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.348+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:23:35.361 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.348+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff790 2024-09-21T15:23:35.361 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.348+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eaf70 2024-09-21T15:23:35.361 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.348+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7b790 2024-09-21T15:23:35.363 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.360+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7be10 2024-09-21T15:23:35.363 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.360+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d96c0 2024-09-21T15:23:35.363 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.360+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:23:35.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.360+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:23:35.376 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.372+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47ee0 2024-09-21T15:23:35.376 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.372+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeed00 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8370dd0 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387380 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cc4e0 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cd860 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc680 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9010340 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9010410 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90116c0 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0dd0 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164340 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165110 2024-09-21T15:23:35.381 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165ad0 2024-09-21T15:23:35.382 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:23:35.382 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e48f0 2024-09-21T15:23:35.382 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4c30 2024-09-21T15:23:35.382 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4f70 2024-09-21T15:23:35.382 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.376+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:23:35.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71e750 2024-09-21T15:23:35.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:23:35.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d89c0 2024-09-21T15:23:35.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3ad0 2024-09-21T15:23:35.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e64e0 2024-09-21T15:23:35.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72f380 2024-09-21T15:23:35.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9145b0 2024-09-21T15:23:35.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6f70 2024-09-21T15:23:35.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc425ee0 2024-09-21T15:23:35.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c000 2024-09-21T15:23:35.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c270 2024-09-21T15:23:35.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:23:35.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26cb60 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d040 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d380 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dc70 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3501a0 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3505b0 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350680 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd52b60 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd52c30 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:23:35.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53790 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6264e0 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6265b0 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6268f0 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be627e10 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b790 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b930 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91be10 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc525b0 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52a90 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52c30 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53380 2024-09-21T15:23:35.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53ad0 2024-09-21T15:23:35.402 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53ee0 2024-09-21T15:23:35.402 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008340 2024-09-21T15:23:35.402 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008c30 2024-09-21T15:23:35.402 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009110 2024-09-21T15:23:35.402 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.380+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009ad0 2024-09-21T15:23:35.402 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.396+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920270 2024-09-21T15:23:35.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920680 2024-09-21T15:23:35.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921110 2024-09-21T15:23:35.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c09212b0 2024-09-21T15:23:35.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921450 2024-09-21T15:23:35.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921520 2024-09-21T15:23:35.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921930 2024-09-21T15:23:35.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:23:35.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:35.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30000 2024-09-21T15:23:35.449 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.439+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1940f5f0 2024-09-21T15:23:35.449 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.439+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1b73f110 2024-09-21T15:23:35.449 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.439+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bcf0000 2024-09-21T15:23:35.449 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfcf110 2024-09-21T15:23:35.449 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf592b0 2024-09-21T15:23:35.449 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf59d40 2024-09-21T15:23:35.449 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1dba04e0 2024-09-21T15:23:35.449 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1dba1040 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1dba1860 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1dba1ee0 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1dfa1ad0 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1e3508f0 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1f299930 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f4000 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5380 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc207f5c70 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2106e0d0 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21709520 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc217385b0 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21738680 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21739ba0 2024-09-21T15:23:35.450 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2182b860 2024-09-21T15:23:35.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363ad00 2024-09-21T15:23:35.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0c4e0 2024-09-21T15:23:35.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264ea9c0 2024-09-21T15:23:35.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb110 2024-09-21T15:23:35.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb5f0 2024-09-21T15:23:35.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb860 2024-09-21T15:23:35.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb930 2024-09-21T15:23:35.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc26ecd040 2024-09-21T15:23:35.451 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc26ecd520 2024-09-21T15:23:35.452 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc26ecd5f0 2024-09-21T15:23:35.452 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2820 2024-09-21T15:23:35.452 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc288f51e0 2024-09-21T15:23:35.452 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:23:35.443+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc28e3e750 2024-09-21T15:23:35.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.511+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50c30 2024-09-21T15:23:35.521 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.511+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51c70 2024-09-21T15:23:35.521 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.511+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde26f70 2024-09-21T15:23:35.525 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.519+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c410 2024-09-21T15:23:35.530 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.527+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d1e0 2024-09-21T15:23:35.530 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:35.527+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01da00 2024-09-21T15:23:35.638 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.632+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77a00 2024-09-21T15:23:35.648 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.644+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d25b0 2024-09-21T15:23:35.648 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.644+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:23:35.652 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:23:35.652 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x56016f1b7110 2024-09-21T15:23:35.652 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:23:35.653 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:23:35.653 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:23:35.653 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98680 2024-09-21T15:23:35.654 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x56016fc991e0 2024-09-21T15:23:35.654 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90680 2024-09-21T15:23:35.654 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x56016fe916c0 2024-09-21T15:23:35.654 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x56016feff6c0 2024-09-21T15:23:35.654 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:23:35.654 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:23:35.654 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x5601709b96c0 2024-09-21T15:23:35.655 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9d40 2024-09-21T15:23:35.655 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.648+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9e10 2024-09-21T15:23:35.655 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.652+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:23:35.655 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.652+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:23:35.656 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.652+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:23:35.656 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.652+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:23:35.656 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.652+0000 7ff753f07700 -1 reset not still connected to 0x560171f041a0 2024-09-21T15:23:35.656 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.652+0000 7ff753f07700 -1 reset not still connected to 0x560171f04ea0 2024-09-21T15:23:35.657 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.652+0000 7ff753f07700 -1 reset not still connected to 0x560171f94000 2024-09-21T15:23:35.657 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.652+0000 7ff753f07700 -1 reset not still connected to 0x56017219ed00 2024-09-21T15:23:35.657 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.652+0000 7ff753f07700 -1 reset not still connected to 0x56017219ef70 2024-09-21T15:23:35.657 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.652+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:23:35.658 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.652+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:23:35.664 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x560173b169c0 2024-09-21T15:23:35.664 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x560173d87a00 2024-09-21T15:23:35.665 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x560173e67790 2024-09-21T15:23:35.665 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2270 2024-09-21T15:23:35.665 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x5601743d3ee0 2024-09-21T15:23:35.665 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x5601747f51e0 2024-09-21T15:23:35.665 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x5601747f55f0 2024-09-21T15:23:35.666 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7380 2024-09-21T15:23:35.666 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x56017529a1a0 2024-09-21T15:23:35.666 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0a90 2024-09-21T15:23:35.666 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x560175e1c680 2024-09-21T15:23:35.666 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cc30 2024-09-21T15:23:35.666 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc0d0 2024-09-21T15:23:35.666 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.660+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc680 2024-09-21T15:23:35.668 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd1e0 2024-09-21T15:23:35.668 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd2b0 2024-09-21T15:23:35.668 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x5601762fdba0 2024-09-21T15:23:35.668 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0270 2024-09-21T15:23:35.668 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1450 2024-09-21T15:23:35.668 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1ee0 2024-09-21T15:23:35.668 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x5601772731e0 2024-09-21T15:23:35.668 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x560177273a00 2024-09-21T15:23:35.668 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x560177273c70 2024-09-21T15:23:35.668 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc000 2024-09-21T15:23:35.668 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:23:35.668 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc8f0 2024-09-21T15:23:35.669 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:23:35.669 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x5601779849c0 2024-09-21T15:23:35.669 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x560177984a90 2024-09-21T15:23:35.669 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x560177985ba0 2024-09-21T15:23:35.669 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:35.664+0000 7ff753f07700 -1 reset not still connected to 0x5601780489c0 2024-09-21T15:23:35.677 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.672+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb92d680 [3/937229a7-e2f3-4109-a1c5-4cd12b947e67] start: already running 2024-09-21T15:23:35.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.672+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb676280 [3/266a11c0-43fd-491b-83b0-d9425e9362e1] start: already running 2024-09-21T15:23:35.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.672+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb676280 [3/266a11c0-43fd-491b-83b0-d9425e9362e1] start: already running 2024-09-21T15:23:35.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.672+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb676280 [3/266a11c0-43fd-491b-83b0-d9425e9362e1] start: already running 2024-09-21T15:23:35.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.672+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb676280 [3/266a11c0-43fd-491b-83b0-d9425e9362e1] start: already running 2024-09-21T15:23:35.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.724+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a780 [3/3c2f36af-e877-40dc-8246-6729625140b2] start: already running 2024-09-21T15:23:35.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.724+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a780 [3/3c2f36af-e877-40dc-8246-6729625140b2] start: already running 2024-09-21T15:23:35.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.724+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73a780 [3/3c2f36af-e877-40dc-8246-6729625140b2] start: already running 2024-09-21T15:23:35.755 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.748+0000 7fd40715b700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fd2ab6700 get_replay_status: replay not running 2024-09-21T15:23:35.804 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.792+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dc70 2024-09-21T15:23:35.806 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.796+0000 7f52f1ba9700 -1 reset not still connected to 0x5571416d0680 2024-09-21T15:23:35.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:35.804+0000 7fd3fa141700 -1 rbd::mirror::ImageReplayer: 0x558fcb950280 [3/96bdba02-bf8c-4de9-8b36-c42ccdad5cf0] start: already running 2024-09-21T15:23:35.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:35.831 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.828+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba270 2024-09-21T15:23:35.831 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.828+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bba8f0 2024-09-21T15:23:35.831 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.828+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb1e0 2024-09-21T15:23:35.831 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.828+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef11e0 2024-09-21T15:23:35.831 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.828+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232b5f0 2024-09-21T15:23:35.836 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232be10 2024-09-21T15:23:35.838 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557142628820 2024-09-21T15:23:35.838 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557142d000d0 2024-09-21T15:23:35.838 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8a90 2024-09-21T15:23:35.838 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8f70 2024-09-21T15:23:35.838 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x55714346a340 2024-09-21T15:23:35.838 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x5571436009c0 2024-09-21T15:23:35.838 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601380 2024-09-21T15:23:35.838 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x5571436016c0 2024-09-21T15:23:35.838 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601860 2024-09-21T15:23:35.838 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76000 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76a90 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77380 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77790 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557143bf4a90 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557143bf5ad0 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a9c0 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cd00 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456d450 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x5571456a3040 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f1e0 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557146764270 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765ba0 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765d40 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x5571472268f0 2024-09-21T15:23:35.839 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557148000680 2024-09-21T15:23:35.840 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557148000dd0 2024-09-21T15:23:35.840 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557148001040 2024-09-21T15:23:35.840 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557148001930 2024-09-21T15:23:35.840 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012270 2024-09-21T15:23:35.840 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.832+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012b60 2024-09-21T15:23:35.840 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.836+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821a000 2024-09-21T15:23:35.840 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.836+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821ab60 2024-09-21T15:23:35.841 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.836+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821b380 2024-09-21T15:23:35.841 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.836+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a0d0 2024-09-21T15:23:35.841 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.836+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29b380 2024-09-21T15:23:35.841 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.836+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29b860 2024-09-21T15:23:35.841 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.836+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf0750 2024-09-21T15:23:35.841 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.836+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb2000 2024-09-21T15:23:35.841 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.836+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3380 2024-09-21T15:23:35.841 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.836+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3450 2024-09-21T15:23:35.841 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.836+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe1a0 2024-09-21T15:23:35.841 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.836+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ffa00 2024-09-21T15:23:35.841 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:23:35.836+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ffee0 2024-09-21T15:23:35.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone38': 2024-09-21T15:23:35.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 27 MiB in 20 objects 2024-09-21T15:23:35.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:23:35.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:35.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c43a62ce99 2024-09-21T15:23:35.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c43a62ce99 2024-09-21T15:23:35.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:35.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:35.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:35.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:35.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:23:35.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:23:35.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:23:35.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:35.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone37@snap 2024-09-21T15:23:35.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 27 MiB 2024-09-21T15:23:35.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:23:35.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:23:35.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c43a62ce99 2024-09-21T15:23:35.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:35.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:35.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 8a44e3ef-3163-4842-8e5c-c12038e5ac8c 2024-09-21T15:23:35.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:35.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:35.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:35.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone39 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:35.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:35.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:35.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone39 2024-09-21T15:23:35.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:35.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:35.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:35.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:36.131 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.128+0000 7fd40715b700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fdc323c00 get_replay_status: replay not running 2024-09-21T15:23:36.137 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.131+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289e10 2024-09-21T15:23:36.145 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.139+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afb6b5f0 2024-09-21T15:23:36.157 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.151+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef89c0 2024-09-21T15:23:36.157 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.151+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:23:36.157 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.151+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8dd0 2024-09-21T15:23:36.157 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.151+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9790 2024-09-21T15:23:36.168 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.159+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:23:36.173 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.167+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9ba0 2024-09-21T15:23:36.173 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.167+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:23:36.174 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.171+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2410 2024-09-21T15:23:36.174 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.171+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0a90 2024-09-21T15:23:36.174 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.171+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0b60 2024-09-21T15:23:36.179 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.171+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1c70 2024-09-21T15:23:36.180 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.175+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541e10 2024-09-21T15:23:36.184 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.179+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45296c0 2024-09-21T15:23:36.184 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.179+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a000 2024-09-21T15:23:36.184 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.179+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a5b0 2024-09-21T15:23:36.184 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.179+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a750 2024-09-21T15:23:36.184 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.179+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a9c0 2024-09-21T15:23:36.184 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.179+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455af70 2024-09-21T15:23:36.184 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.179+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455b1e0 2024-09-21T15:23:36.185 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.179+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455bba0 2024-09-21T15:23:36.185 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.179+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b24e0 2024-09-21T15:23:36.185 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.179+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b25b0 2024-09-21T15:23:36.185 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.179+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2d00 2024-09-21T15:23:36.192 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.183+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6270 2024-09-21T15:23:36.193 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.183+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6dd0 2024-09-21T15:23:36.193 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.183+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6f70 2024-09-21T15:23:36.193 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.183+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:23:36.193 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.183+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7860 2024-09-21T15:23:36.195 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.191+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7e10 2024-09-21T15:23:36.195 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:36.191+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7ee0 2024-09-21T15:23:36.351 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.348+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943680 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:23:36.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.348+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943680 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:23:36.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.348+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943680 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:23:36.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.348+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943680 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:23:36.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.348+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943680 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:23:36.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.348+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943680 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:23:36.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.348+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943680 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:23:36.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.348+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd2943680 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:23:36.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.380+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545400 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:23:36.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.380+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545400 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:23:36.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.380+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545400 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:23:36.385 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.380+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545400 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:23:36.385 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.380+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545400 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:23:36.385 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.380+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3545400 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:23:36.400 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb92c000 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:23:36.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dca00 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:23:36.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dca00 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:23:36.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dca00 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:23:36.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dca00 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:23:36.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dca00 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:23:36.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dca00 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:23:36.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dca00 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:23:36.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd34dca00 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:23:36.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c500 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:23:36.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c500 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:23:36.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c500 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:23:36.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c500 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:23:36.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c500 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:23:36.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb92c500 [3/8973e161-8e97-4797-a3fc-b13855716446] start: already running 2024-09-21T15:23:36.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831900 [3/e2c7112f-7834-4998-b6f4-09f9fd94ae24] start: already running 2024-09-21T15:23:36.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831900 [3/e2c7112f-7834-4998-b6f4-09f9fd94ae24] start: already running 2024-09-21T15:23:36.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831900 [3/e2c7112f-7834-4998-b6f4-09f9fd94ae24] start: already running 2024-09-21T15:23:36.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831900 [3/e2c7112f-7834-4998-b6f4-09f9fd94ae24] start: already running 2024-09-21T15:23:36.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd3831900 [3/e2c7112f-7834-4998-b6f4-09f9fd94ae24] start: already running 2024-09-21T15:23:36.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f5180 [3/5dd347e3-98d3-46ab-aac5-65babaab9ae6] start: already running 2024-09-21T15:23:36.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.396+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb7f5180 [3/5dd347e3-98d3-46ab-aac5-65babaab9ae6] start: already running 2024-09-21T15:23:36.434 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.428+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb677180 [3/30273c29-bc9f-490c-9701-443a18e6e419] start: already running 2024-09-21T15:23:36.434 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.428+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb677180 [3/30273c29-bc9f-490c-9701-443a18e6e419] start: already running 2024-09-21T15:23:36.434 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.428+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb677180 [3/30273c29-bc9f-490c-9701-443a18e6e419] start: already running 2024-09-21T15:23:36.434 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.428+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb677180 [3/30273c29-bc9f-490c-9701-443a18e6e419] start: already running 2024-09-21T15:23:36.450 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.444+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcba18280 [3/ab9322e9-f0d3-4e57-ba54-faf9cbd16ee7] start: already running 2024-09-21T15:23:36.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.468+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628c80 [3/1d800fca-0dcf-4dff-bf70-934acbfb5464] start: already running 2024-09-21T15:23:36.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.468+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628c80 [3/1d800fca-0dcf-4dff-bf70-934acbfb5464] start: already running 2024-09-21T15:23:36.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.468+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628c80 [3/1d800fca-0dcf-4dff-bf70-934acbfb5464] start: already running 2024-09-21T15:23:36.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.468+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628c80 [3/1d800fca-0dcf-4dff-bf70-934acbfb5464] start: already running 2024-09-21T15:23:36.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.468+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628c80 [3/1d800fca-0dcf-4dff-bf70-934acbfb5464] start: already running 2024-09-21T15:23:36.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.468+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628c80 [3/1d800fca-0dcf-4dff-bf70-934acbfb5464] start: already running 2024-09-21T15:23:36.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.468+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb628c80 [3/1d800fca-0dcf-4dff-bf70-934acbfb5464] start: already running 2024-09-21T15:23:36.516 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.508+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73bb80 [3/447d408d-afd0-42db-aef7-f284975751e4] start: already running 2024-09-21T15:23:36.516 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.508+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb73bb80 [3/447d408d-afd0-42db-aef7-f284975751e4] start: already running 2024-09-21T15:23:36.516 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.508+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d180 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:23:36.516 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.508+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d180 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:23:36.516 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.508+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d180 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:23:36.516 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.508+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d180 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:23:36.516 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.508+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414d180 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:23:36.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.616+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73aa00 [3/3e4c42b2-b54b-4fa5-a521-076c70c59b4f] start: already running 2024-09-21T15:23:36.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.616+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73aa00 [3/3e4c42b2-b54b-4fa5-a521-076c70c59b4f] start: already running 2024-09-21T15:23:36.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.616+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fcb73aa00 [3/3e4c42b2-b54b-4fa5-a521-076c70c59b4f] start: already running 2024-09-21T15:23:36.638 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.636+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb629400 [3/1e99ad07-beb0-48a8-b81e-3cc939897a52] start: already running 2024-09-21T15:23:36.638 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.636+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb629400 [3/1e99ad07-beb0-48a8-b81e-3cc939897a52] start: already running 2024-09-21T15:23:36.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.636+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb629400 [3/1e99ad07-beb0-48a8-b81e-3cc939897a52] start: already running 2024-09-21T15:23:36.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.636+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb629400 [3/1e99ad07-beb0-48a8-b81e-3cc939897a52] start: already running 2024-09-21T15:23:36.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.636+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb629400 [3/1e99ad07-beb0-48a8-b81e-3cc939897a52] start: already running 2024-09-21T15:23:36.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.636+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb629400 [3/1e99ad07-beb0-48a8-b81e-3cc939897a52] start: already running 2024-09-21T15:23:36.739 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.732+0000 7ff753f07700 -1 reset not still connected to 0x56016b24e5b0 2024-09-21T15:23:36.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.736+0000 7ff753f07700 -1 reset not still connected to 0x56016ca80750 2024-09-21T15:23:36.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.736+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba270 2024-09-21T15:23:36.743 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.736+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d25b0 2024-09-21T15:23:36.748 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.740+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90680 2024-09-21T15:23:36.751 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.740+0000 7ff753f07700 -1 reset not still connected to 0x56016fe916c0 2024-09-21T15:23:36.752 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.744+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:23:36.752 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.744+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9d40 2024-09-21T15:23:36.752 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.744+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9e10 2024-09-21T15:23:36.752 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.744+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:23:36.759 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.752+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:23:36.759 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.752+0000 7ff753f07700 -1 reset not still connected to 0x560171f04ea0 2024-09-21T15:23:36.759 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.752+0000 7ff753f07700 -1 reset not still connected to 0x560171f94000 2024-09-21T15:23:36.761 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.756+0000 7ff753f07700 -1 reset not still connected to 0x56017219ed00 2024-09-21T15:23:36.761 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.756+0000 7ff753f07700 -1 reset not still connected to 0x560174554680 2024-09-21T15:23:36.764 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.760+0000 7ff753f07700 -1 reset not still connected to 0x560175e1c680 2024-09-21T15:23:36.764 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.760+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cc30 2024-09-21T15:23:36.764 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.760+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc0d0 2024-09-21T15:23:36.765 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.760+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc680 2024-09-21T15:23:36.765 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.760+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0270 2024-09-21T15:23:36.765 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.760+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1ee0 2024-09-21T15:23:36.765 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.760+0000 7ff753f07700 -1 reset not still connected to 0x560177273c70 2024-09-21T15:23:36.765 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.760+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:23:36.765 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.760+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc8f0 2024-09-21T15:23:36.765 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.760+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:23:36.765 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.760+0000 7ff753f07700 -1 reset not still connected to 0x5601779849c0 2024-09-21T15:23:36.765 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.760+0000 7ff753f07700 -1 reset not still connected to 0x560177985ba0 2024-09-21T15:23:36.765 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:36.760+0000 7ff753f07700 -1 reset not still connected to 0x5601780489c0 2024-09-21T15:23:36.857 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.852+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcb92ca00 [3/8b3fb276-65d9-4307-be3d-8481e9d99405] start: already running 2024-09-21T15:23:36.938 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:36.982 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:36.976+0000 7fd40695a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fd330dc00 get_replay_status: replay not running 2024-09-21T15:23:37.021 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone39': 2024-09-21T15:23:37.021 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:23:37.021 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:23:37.021 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:37.021 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c468efc965 2024-09-21T15:23:37.021 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c468efc965 2024-09-21T15:23:37.021 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 KiB 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c468efc965 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: a2db521e-33c9-46f9-be3c-48d613b2d67d 2024-09-21T15:23:37.022 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:37.028 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:37.028 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:37.028 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:37.028 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:37.028 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:37.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone4 2024-09-21T15:23:37.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:37.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:37.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:37.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:37.041 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:37.036+0000 7fd40695a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fcda5d880 get_replay_status: replay not running 2024-09-21T15:23:37.093 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.084+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90680 2024-09-21T15:23:37.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:37.100+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc280 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:23:37.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:37.100+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc280 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:23:37.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:37.100+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc280 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:23:37.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:37.100+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc280 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:23:37.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:37.100+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc280 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:23:37.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:37.100+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc280 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:23:37.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:37.100+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc280 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:23:37.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:37.100+0000 7fd40695a700 -1 rbd::mirror::ImageReplayer: 0x558fd34dc280 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:23:37.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.100+0000 7ff753f07700 -1 reset not still connected to 0x56016fe916c0 2024-09-21T15:23:37.107 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.100+0000 7ff753f07700 -1 reset not still connected to 0x56016feff6c0 2024-09-21T15:23:37.108 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.100+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:23:37.108 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.100+0000 7ff753f07700 -1 reset not still connected to 0x56017063fd40 2024-09-21T15:23:37.108 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.104+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:23:37.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.104+0000 7ff753f07700 -1 reset not still connected to 0x5601709b96c0 2024-09-21T15:23:37.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.104+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9d40 2024-09-21T15:23:37.109 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.104+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9e10 2024-09-21T15:23:37.114 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.108+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:23:37.114 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.108+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:23:37.115 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.112+0000 7ff753f07700 -1 reset not still connected to 0x560171f04ea0 2024-09-21T15:23:37.115 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.112+0000 7ff753f07700 -1 reset not still connected to 0x560171f94000 2024-09-21T15:23:37.116 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.112+0000 7ff753f07700 -1 reset not still connected to 0x56017219ed00 2024-09-21T15:23:37.116 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.112+0000 7ff753f07700 -1 reset not still connected to 0x56017219ef70 2024-09-21T15:23:37.116 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.112+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:23:37.120 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.116+0000 7ff753f07700 -1 reset not still connected to 0x560173d87a00 2024-09-21T15:23:37.120 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.116+0000 7ff753f07700 -1 reset not still connected to 0x560173e67790 2024-09-21T15:23:37.120 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.116+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2270 2024-09-21T15:23:37.120 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.116+0000 7ff753f07700 -1 reset not still connected to 0x5601743d3ee0 2024-09-21T15:23:37.120 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.116+0000 7ff753f07700 -1 reset not still connected to 0x560174554680 2024-09-21T15:23:37.125 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.120+0000 7ff753f07700 -1 reset not still connected to 0x5601747f51e0 2024-09-21T15:23:37.125 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.120+0000 7ff753f07700 -1 reset not still connected to 0x5601747f55f0 2024-09-21T15:23:37.132 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.128+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7380 2024-09-21T15:23:37.132 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.128+0000 7ff753f07700 -1 reset not still connected to 0x56017529a1a0 2024-09-21T15:23:37.132 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.128+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0410 2024-09-21T15:23:37.140 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1a00 2024-09-21T15:23:37.140 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x560175e1c680 2024-09-21T15:23:37.140 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cc30 2024-09-21T15:23:37.140 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:23:37.140 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc0d0 2024-09-21T15:23:37.140 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc680 2024-09-21T15:23:37.141 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd1e0 2024-09-21T15:23:37.141 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd2b0 2024-09-21T15:23:37.141 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601762fdba0 2024-09-21T15:23:37.141 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601766a00d0 2024-09-21T15:23:37.141 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0270 2024-09-21T15:23:37.141 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1450 2024-09-21T15:23:37.142 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1ee0 2024-09-21T15:23:37.142 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601772731e0 2024-09-21T15:23:37.142 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x560177273a00 2024-09-21T15:23:37.142 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x560177273c70 2024-09-21T15:23:37.142 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc000 2024-09-21T15:23:37.142 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:23:37.143 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc8f0 2024-09-21T15:23:37.143 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:23:37.143 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601779849c0 2024-09-21T15:23:37.143 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x560177984a90 2024-09-21T15:23:37.143 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x560177985ba0 2024-09-21T15:23:37.143 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x5601780489c0 2024-09-21T15:23:37.143 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e0d0 2024-09-21T15:23:37.143 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.136+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e340 2024-09-21T15:23:37.144 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.140+0000 7ff753f07700 -1 reset not still connected to 0x56017a16ef70 2024-09-21T15:23:37.176 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.171+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:23:37.330 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:37.328+0000 7fd40695a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fd2ba2000 get_replay_status: replay not running 2024-09-21T15:23:37.510 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.507+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160410 2024-09-21T15:23:37.529 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.519+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:23:37.530 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.523+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:23:37.530 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.523+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2891e0 2024-09-21T15:23:37.530 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.523+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289e10 2024-09-21T15:23:37.530 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.523+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee684e0 2024-09-21T15:23:37.530 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.523+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69040 2024-09-21T15:23:37.530 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.523+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:23:37.531 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.523+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afb6b5f0 2024-09-21T15:23:37.531 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.523+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef81a0 2024-09-21T15:23:37.531 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.523+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef89c0 2024-09-21T15:23:37.534 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.527+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8dd0 2024-09-21T15:23:37.534 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.527+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9790 2024-09-21T15:23:37.534 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.527+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:23:37.541 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.531+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2410 2024-09-21T15:23:37.541 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.531+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0b60 2024-09-21T15:23:37.541 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.531+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1c70 2024-09-21T15:23:37.541 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.531+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541e10 2024-09-21T15:23:37.541 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.531+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45296c0 2024-09-21T15:23:37.547 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.539+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a750 2024-09-21T15:23:37.547 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.539+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a9c0 2024-09-21T15:23:37.551 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.543+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455bba0 2024-09-21T15:23:37.557 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.551+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b25b0 2024-09-21T15:23:37.557 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.551+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6dd0 2024-09-21T15:23:37.563 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.559+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:23:37.563 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:37.559+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7ee0 2024-09-21T15:23:37.642 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:37.640+0000 7fd40695a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fdc213180 get_replay_status: replay not running 2024-09-21T15:23:37.662 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:37.656+0000 7fd40715b700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fdc213c00 get_replay_status: replay not running 2024-09-21T15:23:37.959 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.944+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:23:37.961 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.952+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cd860 2024-09-21T15:23:37.964 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:37.960+0000 7fd40695a700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fd98a9880 get_replay_status: replay not running 2024-09-21T15:23:37.968 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.960+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc680 2024-09-21T15:23:37.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.964+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9010410 2024-09-21T15:23:37.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.964+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90116c0 2024-09-21T15:23:37.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.968+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164340 2024-09-21T15:23:37.979 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:37.976+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:23:37.990 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:23:37.990 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e48f0 2024-09-21T15:23:37.990 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4c30 2024-09-21T15:23:37.990 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d89c0 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3ad0 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72f380 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9145b0 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc425ee0 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c000 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c270 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d380 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3505b0 2024-09-21T15:23:37.991 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350680 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6264e0 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6268f0 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be627e10 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b790 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91be10 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53ad0 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008340 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008c30 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009450 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921110 2024-09-21T15:23:37.992 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921930 2024-09-21T15:23:37.993 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:37.980+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:23:38.010 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.004+0000 7ff753f07700 -1 reset not still connected to 0x560171f04ea0 2024-09-21T15:23:38.011 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.004+0000 7ff753f07700 -1 reset not still connected to 0x560171f94000 2024-09-21T15:23:38.014 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.012+0000 7ff753f07700 -1 reset not still connected to 0x56017219ed00 2024-09-21T15:23:38.019 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.012+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:23:38.025 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.012+0000 7ff753f07700 -1 reset not still connected to 0x560173e67790 2024-09-21T15:23:38.026 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.020+0000 7ff753f07700 -1 reset not still connected to 0x5601743d3ee0 2024-09-21T15:23:38.026 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.020+0000 7ff753f07700 -1 reset not still connected to 0x560174554680 2024-09-21T15:23:38.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:38.050 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601747f51e0 2024-09-21T15:23:38.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.040+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77c70 2024-09-21T15:23:38.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.040+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8ef70 2024-09-21T15:23:38.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.040+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:23:38.050 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.040+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:23:38.052 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601747f55f0 2024-09-21T15:23:38.052 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7380 2024-09-21T15:23:38.052 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x56017529a1a0 2024-09-21T15:23:38.052 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0410 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1a00 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x560175e1c680 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cc30 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc0d0 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc680 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd1e0 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd2b0 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601762fdba0 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0270 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1ee0 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601772731e0 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x560177273a00 2024-09-21T15:23:38.053 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x560177273c70 2024-09-21T15:23:38.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc000 2024-09-21T15:23:38.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:23:38.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc8f0 2024-09-21T15:23:38.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccb60 2024-09-21T15:23:38.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:23:38.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601779849c0 2024-09-21T15:23:38.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x560177985ba0 2024-09-21T15:23:38.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x5601780489c0 2024-09-21T15:23:38.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x56017a16edd0 2024-09-21T15:23:38.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x56017a204000 2024-09-21T15:23:38.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x56017a204820 2024-09-21T15:23:38.054 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.044+0000 7ff753f07700 -1 reset not still connected to 0x56017a205930 2024-09-21T15:23:38.055 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.040+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:23:38.055 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.040+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387380 2024-09-21T15:23:38.057 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.044+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc680 2024-09-21T15:23:38.057 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.044+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9010410 2024-09-21T15:23:38.057 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.044+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90116c0 2024-09-21T15:23:38.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.048+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:23:38.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.048+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4c30 2024-09-21T15:23:38.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.048+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3ad0 2024-09-21T15:23:38.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.048+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c270 2024-09-21T15:23:38.058 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.048+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:23:38.061 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.052+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:23:38.061 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.052+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3505b0 2024-09-21T15:23:38.061 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.052+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:23:38.062 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.052+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:23:38.063 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.052+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6264e0 2024-09-21T15:23:38.063 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.052+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6268f0 2024-09-21T15:23:38.063 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.052+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:23:38.064 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.052+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008340 2024-09-21T15:23:38.064 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.052+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008c30 2024-09-21T15:23:38.064 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.052+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921110 2024-09-21T15:23:38.064 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:38.052+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921930 2024-09-21T15:23:38.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone4': 2024-09-21T15:23:38.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 5.8 MiB in 9 objects 2024-09-21T15:23:38.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:23:38.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:38.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9804a8d21 2024-09-21T15:23:38.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9804a8d21 2024-09-21T15:23:38.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:38.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:38.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:38.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:38.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:23:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:23:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:23:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone3@snap 2024-09-21T15:23:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 5.8 MiB 2024-09-21T15:23:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:23:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:23:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9804a8d21 2024-09-21T15:23:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: e2c7112f-7834-4998-b6f4-09f9fd94ae24 2024-09-21T15:23:38.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:38.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:38.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:38.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone40 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:38.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:38.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:38.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone40 2024-09-21T15:23:38.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:38.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:38.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:38.329 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:38.346 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.343+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f669c0 2024-09-21T15:23:38.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.343+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289e10 2024-09-21T15:23:38.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.343+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:23:38.467 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.460+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2680 2024-09-21T15:23:38.485 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.480+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99380 2024-09-21T15:23:38.485 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.480+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90680 2024-09-21T15:23:38.490 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.480+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:23:38.490 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.480+0000 7ff753f07700 -1 reset not still connected to 0x56016fe916c0 2024-09-21T15:23:38.491 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.484+0000 7ff753f07700 -1 reset not still connected to 0x56016feff6c0 2024-09-21T15:23:38.491 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.484+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:23:38.491 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.484+0000 7ff753f07700 -1 reset not still connected to 0x56017063fd40 2024-09-21T15:23:38.505 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.496+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8c30 2024-09-21T15:23:38.505 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.496+0000 7ff753f07700 -1 reset not still connected to 0x5601709b96c0 2024-09-21T15:23:38.505 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.496+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9d40 2024-09-21T15:23:38.505 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.496+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9e10 2024-09-21T15:23:38.506 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.500+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:23:38.506 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.500+0000 7ff753f07700 -1 reset not still connected to 0x56017157de10 2024-09-21T15:23:38.507 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.500+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:23:38.507 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.500+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:23:38.509 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.504+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:23:38.509 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.504+0000 7ff753f07700 -1 reset not still connected to 0x560171d01ba0 2024-09-21T15:23:38.515 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.504+0000 7ff753f07700 -1 reset not still connected to 0x560171f041a0 2024-09-21T15:23:38.515 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.504+0000 7ff753f07700 -1 reset not still connected to 0x560171f04ea0 2024-09-21T15:23:38.515 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.504+0000 7ff753f07700 -1 reset not still connected to 0x560171f94000 2024-09-21T15:23:38.515 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.504+0000 7ff753f07700 -1 reset not still connected to 0x56017219ed00 2024-09-21T15:23:38.515 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.504+0000 7ff753f07700 -1 reset not still connected to 0x56017219ef70 2024-09-21T15:23:38.515 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.504+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:23:38.517 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.512+0000 7ff753f07700 -1 reset not still connected to 0x5601727fbee0 2024-09-21T15:23:38.519 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.516+0000 7ff753f07700 -1 reset not still connected to 0x560173b169c0 2024-09-21T15:23:38.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x560173d87a00 2024-09-21T15:23:38.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x560173e67790 2024-09-21T15:23:38.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2270 2024-09-21T15:23:38.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x5601743d3ee0 2024-09-21T15:23:38.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x560174554680 2024-09-21T15:23:38.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x5601747f51e0 2024-09-21T15:23:38.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x5601747f55f0 2024-09-21T15:23:38.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6680 2024-09-21T15:23:38.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x560174ec6ea0 2024-09-21T15:23:38.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7380 2024-09-21T15:23:38.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x56017529a1a0 2024-09-21T15:23:38.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x56017529a9c0 2024-09-21T15:23:38.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0340 2024-09-21T15:23:38.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0410 2024-09-21T15:23:38.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x5601757d04e0 2024-09-21T15:23:38.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0a90 2024-09-21T15:23:38.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1a00 2024-09-21T15:23:38.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x560175e1c680 2024-09-21T15:23:38.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x560175e1c9c0 2024-09-21T15:23:38.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cc30 2024-09-21T15:23:38.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:23:38.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc0d0 2024-09-21T15:23:38.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.524+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc680 2024-09-21T15:23:38.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd1e0 2024-09-21T15:23:38.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd2b0 2024-09-21T15:23:38.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601762fdba0 2024-09-21T15:23:38.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601766a00d0 2024-09-21T15:23:38.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0270 2024-09-21T15:23:38.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1450 2024-09-21T15:23:38.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1ee0 2024-09-21T15:23:38.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601772731e0 2024-09-21T15:23:38.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x560177273a00 2024-09-21T15:23:38.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x560177273c70 2024-09-21T15:23:38.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc000 2024-09-21T15:23:38.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:23:38.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc410 2024-09-21T15:23:38.532 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc8f0 2024-09-21T15:23:38.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccb60 2024-09-21T15:23:38.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:23:38.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601779849c0 2024-09-21T15:23:38.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x560177984a90 2024-09-21T15:23:38.535 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x560177985ba0 2024-09-21T15:23:38.535 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x5601780489c0 2024-09-21T15:23:38.535 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x560178049520 2024-09-21T15:23:38.535 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e0d0 2024-09-21T15:23:38.535 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e340 2024-09-21T15:23:38.535 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e410 2024-09-21T15:23:38.535 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.528+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e4e0 2024-09-21T15:23:38.536 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.532+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e9c0 2024-09-21T15:23:38.536 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.532+0000 7ff753f07700 -1 reset not still connected to 0x56017a16edd0 2024-09-21T15:23:38.536 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.532+0000 7ff753f07700 -1 reset not still connected to 0x56017a16ef70 2024-09-21T15:23:38.536 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.532+0000 7ff753f07700 -1 reset not still connected to 0x56017a16f040 2024-09-21T15:23:38.536 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.532+0000 7ff753f07700 -1 reset not still connected to 0x56017a16f6c0 2024-09-21T15:23:38.537 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.532+0000 7ff753f07700 -1 reset not still connected to 0x56017a16f930 2024-09-21T15:23:38.537 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.532+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fc70 2024-09-21T15:23:38.537 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.532+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fe10 2024-09-21T15:23:38.537 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.532+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fee0 2024-09-21T15:23:38.537 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.532+0000 7ff753f07700 -1 reset not still connected to 0x56017a204000 2024-09-21T15:23:38.537 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.532+0000 7ff753f07700 -1 reset not still connected to 0x56017a2040d0 2024-09-21T15:23:38.542 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.536+0000 7ff753f07700 -1 reset not still connected to 0x56017a2045b0 2024-09-21T15:23:38.542 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.536+0000 7ff753f07700 -1 reset not still connected to 0x56017a204820 2024-09-21T15:23:38.542 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.536+0000 7ff753f07700 -1 reset not still connected to 0x56017a2056c0 2024-09-21T15:23:38.542 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:38.536+0000 7ff753f07700 -1 reset not still connected to 0x56017a205930 2024-09-21T15:23:38.585 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.580+0000 7fd40715b700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x558fcd869c00 get_replay_status: replay not running 2024-09-21T15:23:38.613 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.608+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcba19400 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:23:38.613 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.608+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcba19400 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:23:38.613 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.608+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcba19400 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:23:38.613 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.608+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcba19400 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:23:38.613 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.608+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcba19400 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:23:38.613 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.608+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcba19400 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:23:38.613 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.608+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcba19400 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:23:38.613 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.608+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fcba19400 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:23:38.631 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.623+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7110 2024-09-21T15:23:38.643 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.635+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7e10 2024-09-21T15:23:38.643 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.635+0000 7f1e9c77a700 -1 reset not still connected to 0x56288661d520 2024-09-21T15:23:38.648 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.643+0000 7f1e9c77a700 -1 reset not still connected to 0x562895933110 2024-09-21T15:23:38.649 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.643+0000 7f1e9c77a700 -1 reset not still connected to 0x5628959336c0 2024-09-21T15:23:38.649 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.643+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a59a2dd0 2024-09-21T15:23:38.650 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.643+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a67ee270 2024-09-21T15:23:38.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.659+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160410 2024-09-21T15:23:38.663 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.659+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:23:38.674 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:23:38.674 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0dd0 2024-09-21T15:23:38.678 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9c0d0 2024-09-21T15:23:38.678 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9d2b0 2024-09-21T15:23:38.678 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9d5f0 2024-09-21T15:23:38.678 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9dc70 2024-09-21T15:23:38.679 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aa86e270 2024-09-21T15:23:38.679 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:23:38.679 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:23:38.679 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:23:38.679 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2891e0 2024-09-21T15:23:38.679 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289e10 2024-09-21T15:23:38.679 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad1d4a90 2024-09-21T15:23:38.679 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad1d4d00 2024-09-21T15:23:38.679 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee684e0 2024-09-21T15:23:38.679 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68c30 2024-09-21T15:23:38.679 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68ea0 2024-09-21T15:23:38.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.676+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c780 [3/f7c87bd3-b914-47e1-bfe3-31c0275bb492] start: already running 2024-09-21T15:23:38.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.676+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c780 [3/f7c87bd3-b914-47e1-bfe3-31c0275bb492] start: already running 2024-09-21T15:23:38.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.676+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c780 [3/f7c87bd3-b914-47e1-bfe3-31c0275bb492] start: already running 2024-09-21T15:23:38.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.676+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c780 [3/f7c87bd3-b914-47e1-bfe3-31c0275bb492] start: already running 2024-09-21T15:23:38.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.676+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fd414c780 [3/f7c87bd3-b914-47e1-bfe3-31c0275bb492] start: already running 2024-09-21T15:23:38.681 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69040 2024-09-21T15:23:38.681 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69860 2024-09-21T15:23:38.681 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:23:38.681 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac5110 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afb6b040 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afb6b5f0 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a750 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b520 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef81a0 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef89c0 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8dd0 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9520 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9790 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9ba0 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:23:38.682 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9e10 2024-09-21T15:23:38.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f2000 2024-09-21T15:23:38.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f32b0 2024-09-21T15:23:38.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2410 2024-09-21T15:23:38.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0a90 2024-09-21T15:23:38.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0b60 2024-09-21T15:23:38.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1c70 2024-09-21T15:23:38.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541e10 2024-09-21T15:23:38.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677ad0 2024-09-21T15:23:38.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45296c0 2024-09-21T15:23:38.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a000 2024-09-21T15:23:38.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a270 2024-09-21T15:23:38.683 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.671+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a5b0 2024-09-21T15:23:38.689 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a750 2024-09-21T15:23:38.689 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a9c0 2024-09-21T15:23:38.689 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455af70 2024-09-21T15:23:38.689 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455b1e0 2024-09-21T15:23:38.689 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455ba00 2024-09-21T15:23:38.690 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455bba0 2024-09-21T15:23:38.690 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b24e0 2024-09-21T15:23:38.690 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b25b0 2024-09-21T15:23:38.690 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2d00 2024-09-21T15:23:38.690 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b36c0 2024-09-21T15:23:38.690 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6270 2024-09-21T15:23:38.690 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6dd0 2024-09-21T15:23:38.690 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6f70 2024-09-21T15:23:38.690 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:23:38.690 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7860 2024-09-21T15:23:38.690 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7e10 2024-09-21T15:23:38.690 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.683+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7ee0 2024-09-21T15:23:38.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.684+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69bb80 [3/346bfe3b-fa53-4f73-a11c-fc429615fca9] start: already running 2024-09-21T15:23:38.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.684+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69bb80 [3/346bfe3b-fa53-4f73-a11c-fc429615fca9] start: already running 2024-09-21T15:23:38.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.684+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69bb80 [3/346bfe3b-fa53-4f73-a11c-fc429615fca9] start: already running 2024-09-21T15:23:38.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.684+0000 7fd3f9940700 -1 rbd::mirror::ImageReplayer: 0x558fcb69bb80 [3/346bfe3b-fa53-4f73-a11c-fc429615fca9] start: already running 2024-09-21T15:23:38.764 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.760+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd2943900 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:23:38.764 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.760+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd2943900 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:23:38.764 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.760+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd2943900 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:23:38.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.760+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd2943900 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:23:38.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.760+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd2943900 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:23:38.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.760+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd2943900 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:23:38.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.760+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd2943900 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:23:38.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:23:38.760+0000 7fd40715b700 -1 rbd::mirror::ImageReplayer: 0x558fd2943900 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:23:38.824 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.819+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289e10 2024-09-21T15:23:38.825 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.819+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1c70 2024-09-21T15:23:38.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.823+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45296c0 2024-09-21T15:23:38.838 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:23:38.823+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:23:39.329 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:39.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone40': 2024-09-21T15:23:39.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 82 MiB in 18 objects 2024-09-21T15:23:39.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:23:39.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:39.445 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c485268340 2024-09-21T15:23:39.445 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c485268340 2024-09-21T15:23:39.445 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:39.445 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:39.445 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:39.445 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:39.445 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:12:28 2024 2024-09-21T15:23:39.445 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:12:28 2024 2024-09-21T15:23:39.445 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:12:28 2024 2024-09-21T15:23:39.445 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:39.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone39@snap 2024-09-21T15:23:39.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 82 MiB 2024-09-21T15:23:39.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:23:39.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:23:39.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c485268340 2024-09-21T15:23:39.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:39.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:39.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 4026d3a9-81ff-4074-aa36-3ae99da1306d 2024-09-21T15:23:39.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:39.453 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:39.453 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:39.453 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone41 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:39.453 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:39.453 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:39.454 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone41 2024-09-21T15:23:39.454 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:39.454 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:39.454 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:39.454 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:39.692 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.687+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766340 2024-09-21T15:23:39.773 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.767+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef025b0 2024-09-21T15:23:39.775 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.771+0000 7f7fd044c700 -1 reset not still connected to 0x5636b0b3f450 2024-09-21T15:23:39.775 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.771+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e92b0 2024-09-21T15:23:39.780 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e4e0 2024-09-21T15:23:39.780 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e8f0 2024-09-21T15:23:39.780 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678fad0 2024-09-21T15:23:39.780 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb84e0 2024-09-21T15:23:39.781 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65520 2024-09-21T15:23:39.781 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc40d0 2024-09-21T15:23:39.781 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:23:39.781 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1d40 2024-09-21T15:23:39.782 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:23:39.782 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:23:39.782 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636c47091e0 2024-09-21T15:23:39.783 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483f040 2024-09-21T15:23:39.783 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5930 2024-09-21T15:23:39.783 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a340 2024-09-21T15:23:39.783 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.775+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9ad00 2024-09-21T15:23:39.783 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.779+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:23:39.787 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.779+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c84e0 2024-09-21T15:23:39.787 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.779+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c92b0 2024-09-21T15:23:39.788 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.783+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9c70 2024-09-21T15:23:39.788 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.783+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:23:39.788 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.783+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:23:39.788 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.783+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7334680 2024-09-21T15:23:39.788 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.783+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335860 2024-09-21T15:23:39.788 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.783+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766340 2024-09-21T15:23:39.791 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87665b0 2024-09-21T15:23:39.792 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:23:39.792 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:23:39.792 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966270 2024-09-21T15:23:39.792 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966ea0 2024-09-21T15:23:39.792 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967a00 2024-09-21T15:23:39.792 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50820 2024-09-21T15:23:39.792 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50b60 2024-09-21T15:23:39.792 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50c30 2024-09-21T15:23:39.792 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50ea0 2024-09-21T15:23:39.792 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f515f0 2024-09-21T15:23:39.792 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51ba0 2024-09-21T15:23:39.794 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde26b60 2024-09-21T15:23:39.794 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c410 2024-09-21T15:23:39.794 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c750 2024-09-21T15:23:39.794 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d1e0 2024-09-21T15:23:39.794 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d380 2024-09-21T15:23:39.794 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:39.787+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01da00 2024-09-21T15:23:40.454 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone41@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:40.581 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone41': 2024-09-21T15:23:40.581 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 12 MiB in 13 objects 2024-09-21T15:23:40.581 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:23:40.581 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:40.581 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4168a179a 2024-09-21T15:23:40.581 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4168a179a 2024-09-21T15:23:40.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:40.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:40.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:40.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:40.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:13:58 2024 2024-09-21T15:23:40.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:13:58 2024 2024-09-21T15:23:40.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:13:58 2024 2024-09-21T15:23:40.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:40.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone40@snap 2024-09-21T15:23:40.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 12 MiB 2024-09-21T15:23:40.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:23:40.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:23:40.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4168a179a 2024-09-21T15:23:40.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:40.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:40.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 8973e161-8e97-4797-a3fc-b13855716446 2024-09-21T15:23:40.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:40.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:40.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:40.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone42 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:40.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:40.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:40.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone42 2024-09-21T15:23:40.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:40.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:40.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:40.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:41.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone42@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:41.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone42': 2024-09-21T15:23:41.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:23:41.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:23:41.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:41.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c49bc3c652 2024-09-21T15:23:41.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c49bc3c652 2024-09-21T15:23:41.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:41.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:41.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:41.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:41.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:14:58 2024 2024-09-21T15:23:41.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:14:58 2024 2024-09-21T15:23:41.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:14:58 2024 2024-09-21T15:23:41.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:41.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:23:41.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:23:41.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c49bc3c652 2024-09-21T15:23:41.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:41.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:41.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 0111f35b-69c8-4614-8b36-510c97864eec 2024-09-21T15:23:41.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:41.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:41.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:41.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone43 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:41.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:41.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:41.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone43 2024-09-21T15:23:41.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:41.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:41.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:41.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:42.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone43@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:42.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone43': 2024-09-21T15:23:42.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:23:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:23:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c435313a0b 2024-09-21T15:23:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c435313a0b 2024-09-21T15:23:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:15:27 2024 2024-09-21T15:23:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:15:27 2024 2024-09-21T15:23:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:15:27 2024 2024-09-21T15:23:42.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:42.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:23:42.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:23:42.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c435313a0b 2024-09-21T15:23:42.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:42.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:42.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b0959eb5-273e-4f52-8a00-24247f1f87d2 2024-09-21T15:23:42.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:42.739 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:42.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:42.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone44 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:42.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:42.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:42.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone44 2024-09-21T15:23:42.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:42.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:42.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:42.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:43.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone44@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:43.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone44': 2024-09-21T15:23:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 198 MiB in 12 objects 2024-09-21T15:23:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:23:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c48bb4f7e4 2024-09-21T15:23:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c48bb4f7e4 2024-09-21T15:23:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:15:58 2024 2024-09-21T15:23:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:15:58 2024 2024-09-21T15:23:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:15:58 2024 2024-09-21T15:23:43.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:43.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone43@snap 2024-09-21T15:23:43.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 34 MiB 2024-09-21T15:23:43.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:23:43.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:23:43.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c48bb4f7e4 2024-09-21T15:23:43.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:43.922 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:43.922 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 266a11c0-43fd-491b-83b0-d9425e9362e1 2024-09-21T15:23:43.922 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:43.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:43.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:43.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone45 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:43.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:43.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:43.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone45 2024-09-21T15:23:43.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:43.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:43.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:43.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:44.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone45@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:44.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone45': 2024-09-21T15:23:44.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:23:44.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:23:44.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:44.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4cc55e107 2024-09-21T15:23:44.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4cc55e107 2024-09-21T15:23:44.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:44.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:44.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:45.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:45.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:16:28 2024 2024-09-21T15:23:45.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:16:28 2024 2024-09-21T15:23:45.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:16:28 2024 2024-09-21T15:23:45.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:45.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:23:45.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:23:45.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4cc55e107 2024-09-21T15:23:45.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:45.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:45.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b1bacb05-0cfc-4685-a814-d83528c58107 2024-09-21T15:23:45.000 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:45.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:45.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:45.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone46 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:45.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:45.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:45.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone46 2024-09-21T15:23:45.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:45.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:45.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:45.008 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:45.561 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:45.555+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766340 2024-09-21T15:23:45.571 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:45.563+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:23:46.008 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone46@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:46.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone46': 2024-09-21T15:23:46.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 195 MiB in 195 objects 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c430557f4d 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c430557f4d 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:27 2024 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:27 2024 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:27 2024 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:23:46.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:23:46.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c430557f4d 2024-09-21T15:23:46.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:46.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:46.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: af962aab-237c-497b-989c-5a6f03523f73 2024-09-21T15:23:46.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:46.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:46.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:46.079 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone47 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:46.079 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:46.079 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:46.079 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone47 2024-09-21T15:23:46.079 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:46.079 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:46.079 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:46.079 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:47.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone47@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:47.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone47': 2024-09-21T15:23:47.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 1.4 MiB in 7 objects 2024-09-21T15:23:47.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:23:47.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:47.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4cb5c045 2024-09-21T15:23:47.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4cb5c045 2024-09-21T15:23:47.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:47.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:47.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:47.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:47.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:23:47.163 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:23:47.163 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:23:47.163 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:47.163 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone46@snap 2024-09-21T15:23:47.163 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 1.4 MiB 2024-09-21T15:23:47.163 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:23:47.163 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:23:47.163 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4cb5c045 2024-09-21T15:23:47.164 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:47.164 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:47.164 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 60ee4d91-fe2c-4f38-849f-9f6974471b07 2024-09-21T15:23:47.164 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:47.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:47.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:47.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone48 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:47.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:47.170 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:47.170 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone48 2024-09-21T15:23:47.170 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:47.170 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:47.170 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:47.170 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:48.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone48@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:48.262 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone48': 2024-09-21T15:23:48.262 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 31 MiB in 65 objects 2024-09-21T15:23:48.262 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:23:48.262 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:48.262 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c46ee2c53e 2024-09-21T15:23:48.262 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c46ee2c53e 2024-09-21T15:23:48.262 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:48.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:48.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:48.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:48.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:23:48.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:23:48.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:23:48.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:48.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone47@snap 2024-09-21T15:23:48.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 31 MiB 2024-09-21T15:23:48.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:23:48.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:23:48.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c46ee2c53e 2024-09-21T15:23:48.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:48.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:48.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: ee8573b9-7a14-470f-b519-004503b68b59 2024-09-21T15:23:48.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:48.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:48.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:48.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone49 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:48.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:48.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:48.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone49 2024-09-21T15:23:48.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:48.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:48.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:48.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:49.271 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone49@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:49.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone49': 2024-09-21T15:23:49.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 55 MiB in 15 objects 2024-09-21T15:23:49.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:23:49.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:49.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c41f2f0928 2024-09-21T15:23:49.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c41f2f0928 2024-09-21T15:23:49.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:49.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:49.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:49.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:49.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:23:49.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:23:49.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:23:49.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:49.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone48@snap 2024-09-21T15:23:49.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 55 MiB 2024-09-21T15:23:49.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:23:49.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:23:49.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c41f2f0928 2024-09-21T15:23:49.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:49.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:49.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 02c68625-9e68-49b7-9164-c8fd75eb654b 2024-09-21T15:23:49.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:49.599 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:49.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:49.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:49.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:49.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:49.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone5 2024-09-21T15:23:49.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:49.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:49.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:49.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:50.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:50.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone5': 2024-09-21T15:23:50.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 24 MiB in 12 objects 2024-09-21T15:23:50.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:23:50.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:50.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9e3c62359 2024-09-21T15:23:50.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9e3c62359 2024-09-21T15:23:50.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:50.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:50.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:50.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:50.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:23:50.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:23:50.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:23:50.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:50.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone4@snap 2024-09-21T15:23:50.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 24 MiB 2024-09-21T15:23:50.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:23:50.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:23:50.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9e3c62359 2024-09-21T15:23:50.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:50.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:50.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 55c2a1c2-e5de-4bcb-8d07-45955fdc4e18 2024-09-21T15:23:50.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:50.739 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:50.739 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:50.739 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone50 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:50.739 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:50.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:50.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone50 2024-09-21T15:23:50.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:50.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:50.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:50.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:51.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone50@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:51.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone50': 2024-09-21T15:23:51.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 42 MiB in 30 objects 2024-09-21T15:23:51.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:23:51.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:51.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4b451ed04 2024-09-21T15:23:51.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4b451ed04 2024-09-21T15:23:51.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:51.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:51.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:51.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:51.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:23:51.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:23:51.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:23:51.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:51.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:23:51.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:23:51.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4b451ed04 2024-09-21T15:23:51.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:51.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:51.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 3858bbd9-acac-4b4f-a8fb-0fd6f0dc3cb9 2024-09-21T15:23:51.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:51.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:51.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:51.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone51 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:51.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:51.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:51.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone51 2024-09-21T15:23:51.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:51.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:51.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:51.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:52.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dad380 2024-09-21T15:23:52.481 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.476+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833040 2024-09-21T15:23:52.481 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.476+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2858750 2024-09-21T15:23:52.483 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.480+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:23:52.483 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.480+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:23:52.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:23:52.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77c70 2024-09-21T15:23:52.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8ef70 2024-09-21T15:23:52.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:23:52.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7b790 2024-09-21T15:23:52.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7be10 2024-09-21T15:23:52.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d96c0 2024-09-21T15:23:52.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:23:52.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:23:52.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeed00 2024-09-21T15:23:52.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387380 2024-09-21T15:23:52.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cd860 2024-09-21T15:23:52.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:23:52.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc680 2024-09-21T15:23:52.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:23:52.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9010340 2024-09-21T15:23:52.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9010410 2024-09-21T15:23:52.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90116c0 2024-09-21T15:23:52.498 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165ad0 2024-09-21T15:23:52.498 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:23:52.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e48f0 2024-09-21T15:23:52.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4c30 2024-09-21T15:23:52.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:23:52.502 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:23:52.502 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3ad0 2024-09-21T15:23:52.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72f380 2024-09-21T15:23:52.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9145b0 2024-09-21T15:23:52.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6f70 2024-09-21T15:23:52.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc425ee0 2024-09-21T15:23:52.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c000 2024-09-21T15:23:52.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c270 2024-09-21T15:23:52.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:23:52.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d380 2024-09-21T15:23:52.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:23:52.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:23:52.508 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3505b0 2024-09-21T15:23:52.508 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:23:52.508 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:23:52.508 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:23:52.508 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53790 2024-09-21T15:23:52.508 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6264e0 2024-09-21T15:23:52.509 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6268f0 2024-09-21T15:23:52.511 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:23:52.511 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b790 2024-09-21T15:23:52.511 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91be10 2024-09-21T15:23:52.511 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:23:52.512 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52a90 2024-09-21T15:23:52.512 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53ad0 2024-09-21T15:23:52.512 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008340 2024-09-21T15:23:52.512 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008c30 2024-09-21T15:23:52.513 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009110 2024-09-21T15:23:52.513 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921110 2024-09-21T15:23:52.513 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:23:52.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921930 2024-09-21T15:23:52.601 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:52.588+0000 7ff753f07700 -1 reset not still connected to 0x56016b24e5b0 2024-09-21T15:23:52.601 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:52.588+0000 7ff753f07700 -1 reset not still connected to 0x56016fe916c0 2024-09-21T15:23:52.602 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:52.588+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9d40 2024-09-21T15:23:52.602 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:52.592+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:23:52.602 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:52.592+0000 7ff753f07700 -1 reset not still connected to 0x56017219ed00 2024-09-21T15:23:52.602 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:23:52.592+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:23:52.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone51@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:52.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone51': 2024-09-21T15:23:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 171 MiB in 87 objects 2024-09-21T15:23:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:23:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4355203d5 2024-09-21T15:23:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4355203d5 2024-09-21T15:23:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:46 2024 2024-09-21T15:23:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:46 2024 2024-09-21T15:23:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:56 2024 2024-09-21T15:23:52.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:52.880 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:23:52.880 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:23:52.880 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4355203d5 2024-09-21T15:23:52.880 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:52.880 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:52.880 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 5d8470f4-d7d3-4732-8815-2ed1bc60c759 2024-09-21T15:23:52.880 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:52.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:52.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:52.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone52 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:52.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:52.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:52.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone52 2024-09-21T15:23:52.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:52.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:52.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:52.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:53.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone52@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:53.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone52': 2024-09-21T15:23:53.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 46 MiB in 186 objects 2024-09-21T15:23:53.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:23:53.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:53.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c477eef2c1 2024-09-21T15:23:53.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c477eef2c1 2024-09-21T15:23:53.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:53.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:53.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:53.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:53.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:23:53.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:23:53.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:23:53.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:53.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 KiB 2024-09-21T15:23:53.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:23:53.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c477eef2c1 2024-09-21T15:23:53.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:53.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:53.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: d1ce4217-34a7-462e-a1a0-24ebf7565471 2024-09-21T15:23:53.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:53.960 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:53.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:53.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone53 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:53.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:53.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:53.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone53 2024-09-21T15:23:53.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:53.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:53.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:53.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:54.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone53@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:55.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone53': 2024-09-21T15:23:55.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 218 MiB in 221 objects 2024-09-21T15:23:55.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:23:55.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:55.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4db0c570f 2024-09-21T15:23:55.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4db0c570f 2024-09-21T15:23:55.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:57 2024 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:57 2024 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:12:03 2024 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4db0c570f 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 3dfcc7ae-1175-4f2b-8854-b9f69eeda24f 2024-09-21T15:23:55.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:55.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:55.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:55.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone54 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:55.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:55.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:55.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone54 2024-09-21T15:23:55.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:55.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:55.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:55.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:56.037 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone54@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:56.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone54': 2024-09-21T15:23:56.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 157 MiB in 630 objects 2024-09-21T15:23:56.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:23:56.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:56.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c477438399 2024-09-21T15:23:56.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c477438399 2024-09-21T15:23:56.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:56.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:23:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:23:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:23:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:23:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:23:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c477438399 2024-09-21T15:23:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b4ac21e0-f75d-455c-bcb1-7cd0770cae56 2024-09-21T15:23:56.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:56.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:56.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:56.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone55 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:56.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:56.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:56.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone55 2024-09-21T15:23:56.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:56.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:56.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:56.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:57.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone55@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:57.177 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone55': 2024-09-21T15:23:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 224 MiB in 225 objects 2024-09-21T15:23:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:23:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4f1d76bb2 2024-09-21T15:23:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4f1d76bb2 2024-09-21T15:23:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:11:08 2024 2024-09-21T15:23:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:11:08 2024 2024-09-21T15:23:57.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:12:55 2024 2024-09-21T15:23:57.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:57.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:23:57.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:23:57.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4f1d76bb2 2024-09-21T15:23:57.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:57.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:57.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: c9f982c4-88fc-4116-9ce6-8f33f83a2a54 2024-09-21T15:23:57.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:57.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:57.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:57.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone56 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:57.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:57.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:57.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone56 2024-09-21T15:23:57.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:57.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:57.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:57.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:58.185 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone56@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:58.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone56': 2024-09-21T15:23:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:23:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:23:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:23:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4b8dfa4c3 2024-09-21T15:23:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4b8dfa4c3 2024-09-21T15:23:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:23:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:23:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:23:58.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:58.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:23:58.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 6 2024-09-21T15:23:58.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4b8dfa4c3 2024-09-21T15:23:58.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:58.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:58.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 5aef6686-3462-4732-9396-d809d993e90b 2024-09-21T15:23:58.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone57 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone57 2024-09-21T15:23:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:58.261 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:58.262 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:59.262 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone57@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:59.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone57': 2024-09-21T15:23:59.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 38 MiB in 90 objects 2024-09-21T15:23:59.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:23:59.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 1 2024-09-21T15:23:59.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4d1b5d4e4 2024-09-21T15:23:59.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4d1b5d4e4 2024-09-21T15:23:59.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:23:59.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:23:59.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:23:59.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:23:59.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:23:59.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:23:59.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:23:59.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:23:59.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:23:59.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:23:59.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4d1b5d4e4 2024-09-21T15:23:59.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:23:59.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:23:59.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 69a6bb5f-56ca-4197-9a03-c1f93382494d 2024-09-21T15:23:59.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:23:59.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:23:59.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:23:59.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone6 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:59.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:23:59.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:23:59.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone6 2024-09-21T15:23:59.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:23:59.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:23:59.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:23:59.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:23:59.414 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:59.407+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766340 2024-09-21T15:23:59.417 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:23:59.411+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c410 2024-09-21T15:24:00.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:00.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone6': 2024-09-21T15:24:00.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 131 MiB in 17 objects 2024-09-21T15:24:00.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:24:00.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9460aea3 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9460aea3 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9460aea3 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:00.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:00.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: c7ca9d94-2023-4304-8c99-f1168681b43d 2024-09-21T15:24:00.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:00.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:00.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:00.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone7 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:00.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:00.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:00.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone7 2024-09-21T15:24:00.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:00.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:00.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:00.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:01.407 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:01.473 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone7': 2024-09-21T15:24:01.473 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 205 MiB in 208 objects 2024-09-21T15:24:01.473 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:24:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9c6e89a0d 2024-09-21T15:24:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9c6e89a0d 2024-09-21T15:24:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:24:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:24:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:24:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:24:01.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:24:01.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9c6e89a0d 2024-09-21T15:24:01.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:01.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:01.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 5372d49a-7f62-4cee-a4e4-61183f5854a0 2024-09-21T15:24:01.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:01.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:01.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:01.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone8 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:01.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:01.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:01.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone8 2024-09-21T15:24:01.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:01.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:01.481 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:01.481 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:02.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.424+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae3452b0 2024-09-21T15:24:02.435 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.432+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0c07790 2024-09-21T15:24:02.438 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.432+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0dad380 2024-09-21T15:24:02.438 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.432+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833040 2024-09-21T15:24:02.438 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.432+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1833450 2024-09-21T15:24:02.462 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2858750 2024-09-21T15:24:02.462 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50d00 2024-09-21T15:24:02.466 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.460+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:24:02.466 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.460+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:24:02.466 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.460+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31011e0 2024-09-21T15:24:02.475 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.460+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:24:02.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.464+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3687380 2024-09-21T15:24:02.480 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167790 2024-09-21T15:24:02.481 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:02.481 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:24:02.481 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77c70 2024-09-21T15:24:02.481 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8ef70 2024-09-21T15:24:02.494 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:24:02.503 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d96c0 2024-09-21T15:24:02.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:24:02.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:24:02.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeed00 2024-09-21T15:24:02.507 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387380 2024-09-21T15:24:02.507 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cc4e0 2024-09-21T15:24:02.507 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:24:02.507 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc680 2024-09-21T15:24:02.508 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:24:02.508 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9010340 2024-09-21T15:24:02.508 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9010410 2024-09-21T15:24:02.508 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90116c0 2024-09-21T15:24:02.512 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164340 2024-09-21T15:24:02.516 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165110 2024-09-21T15:24:02.516 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165ad0 2024-09-21T15:24:02.516 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:24:02.516 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e48f0 2024-09-21T15:24:02.516 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4c30 2024-09-21T15:24:02.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:24:02.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71e750 2024-09-21T15:24:02.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3ad0 2024-09-21T15:24:02.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72f380 2024-09-21T15:24:02.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9145b0 2024-09-21T15:24:02.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6f70 2024-09-21T15:24:02.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc425ee0 2024-09-21T15:24:02.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c000 2024-09-21T15:24:02.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c270 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c680 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26cb60 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d380 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3505b0 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd52c30 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53790 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6268f0 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be627e10 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:24:02.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b790 2024-09-21T15:24:02.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91be10 2024-09-21T15:24:02.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:24:02.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52a90 2024-09-21T15:24:02.522 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53ad0 2024-09-21T15:24:02.522 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008340 2024-09-21T15:24:02.522 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008c30 2024-09-21T15:24:02.522 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921110 2024-09-21T15:24:02.522 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921520 2024-09-21T15:24:02.522 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921930 2024-09-21T15:24:02.522 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921e10 2024-09-21T15:24:02.522 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:02.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e300d0 2024-09-21T15:24:02.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone8': 2024-09-21T15:24:02.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 20 MiB in 6 objects 2024-09-21T15:24:02.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:24:02.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:02.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b955c459d9 2024-09-21T15:24:02.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b955c459d9 2024-09-21T15:24:02.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:02.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:02.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:02.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:02.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:24:02.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:24:02.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:24:02.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:02.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone7@snap 2024-09-21T15:24:02.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 20 MiB 2024-09-21T15:24:02.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:24:02.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 6 2024-09-21T15:24:02.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b955c459d9 2024-09-21T15:24:02.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:02.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:02.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 3e3bdb4c-3bdb-49bc-8680-3d524894c052 2024-09-21T15:24:02.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:02.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:02.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:02.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.3-clone9 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:02.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:02.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:02.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone9 2024-09-21T15:24:02.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:02.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:02.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:02.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:03.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.3-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:03.670 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.3-clone9': 2024-09-21T15:24:03.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 18 MiB in 13 objects 2024-09-21T15:24:03.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:24:03.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:03.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9c6954aa8 2024-09-21T15:24:03.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9c6954aa8 2024-09-21T15:24:03.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:03.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:03.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:03.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:03.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:24:03.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:24:03.672 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:24:03.672 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:03.672 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.3-clone8@snap 2024-09-21T15:24:03.672 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 18 MiB 2024-09-21T15:24:03.672 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:24:03.672 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:24:03.672 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9c6954aa8 2024-09-21T15:24:03.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:03.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:03.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 7709c520-de3e-4233-b3f0-5c64fc1f07b2 2024-09-21T15:24:03.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:03.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:03.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:03.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:03.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:03.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:03.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4 2024-09-21T15:24:03.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:03.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:03.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:03.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:04.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:04.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4': 2024-09-21T15:24:04.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 189 MiB in 48 objects 2024-09-21T15:24:04.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:24:04.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:04.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9e2cb0c09 2024-09-21T15:24:04.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9e2cb0c09 2024-09-21T15:24:04.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:04.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:04.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:04.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:04.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:24:04.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:24:04.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:24:04.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:04.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9e2cb0c09 2024-09-21T15:24:04.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:04.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:04.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 1d81f01f-e156-426e-8eba-235d3f8c7a69 2024-09-21T15:24:04.750 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:04.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:04.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:04.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:04.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:04.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:04.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone1 2024-09-21T15:24:04.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:04.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:04.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:04.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:05.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:05.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone1': 2024-09-21T15:24:05.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 215 MiB in 868 objects 2024-09-21T15:24:05.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:24:05.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:05.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9ca8a219 2024-09-21T15:24:05.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9ca8a219 2024-09-21T15:24:05.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9ca8a219 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: f95a7efc-59b9-4291-8e64-f47bf1a0ff4f 2024-09-21T15:24:05.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:05.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:05.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:05.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone10 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:05.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:05.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:05.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone10 2024-09-21T15:24:05.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:06.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:06.931 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone10': 2024-09-21T15:24:06.931 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 1.6 MiB in 5 objects 2024-09-21T15:24:06.931 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:24:06.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:06.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b924ebf408 2024-09-21T15:24:06.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b924ebf408 2024-09-21T15:24:06.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:06.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:06.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:06.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:06.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:24:06.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:24:06.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:24:06.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:06.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone9@snap 2024-09-21T15:24:06.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 1.6 MiB 2024-09-21T15:24:06.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:24:06.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:24:06.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b924ebf408 2024-09-21T15:24:06.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:06.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:06.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 4b9face3-5cac-4c8c-ab5f-f75cbc0915bc 2024-09-21T15:24:06.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:06.939 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:06.939 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:06.939 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone11 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:06.940 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:06.940 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:06.940 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone11 2024-09-21T15:24:06.940 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:06.940 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:06.940 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:06.940 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:07.941 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:08.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone11': 2024-09-21T15:24:08.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 11 MiB in 10 objects 2024-09-21T15:24:08.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:24:08.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:08.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9bed2c285 2024-09-21T15:24:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9bed2c285 2024-09-21T15:24:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:24:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:24:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:24:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone10@snap 2024-09-21T15:24:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 11 MiB 2024-09-21T15:24:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:24:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:24:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9bed2c285 2024-09-21T15:24:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 2037df74-ba68-4814-bebc-291884a396bb 2024-09-21T15:24:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:08.059 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:08.059 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:08.059 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone12 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:08.059 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:08.059 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:08.059 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone12 2024-09-21T15:24:08.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:08.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:08.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:08.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:09.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:09.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone12': 2024-09-21T15:24:09.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 76 MiB in 306 objects 2024-09-21T15:24:09.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:24:09.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:09.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b982df0056 2024-09-21T15:24:09.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b982df0056 2024-09-21T15:24:09.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:09.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:09.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:09.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:09.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:24:09.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:24:09.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:24:09.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:09.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone11@snap 2024-09-21T15:24:09.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 76 MiB 2024-09-21T15:24:09.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:24:09.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:24:09.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b982df0056 2024-09-21T15:24:09.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:09.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:09.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: c09cc5be-efe7-4ded-a908-526878332ee8 2024-09-21T15:24:09.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:09.196 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:09.196 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:09.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone13 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:09.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:09.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:09.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone13 2024-09-21T15:24:09.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:09.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:09.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:09.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:10.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:10.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone13': 2024-09-21T15:24:10.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 5.9 MiB in 1 objects 2024-09-21T15:24:10.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:24:10.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:10.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4dedb1b95 2024-09-21T15:24:10.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4dedb1b95 2024-09-21T15:24:10.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:10.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:10.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:10.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:10.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:23 2024 2024-09-21T15:24:10.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:23 2024 2024-09-21T15:24:10.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:23 2024 2024-09-21T15:24:10.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:10.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone12@snap 2024-09-21T15:24:10.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 5.9 MiB 2024-09-21T15:24:10.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 MiB 2024-09-21T15:24:10.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:24:10.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4dedb1b95 2024-09-21T15:24:10.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:10.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:10.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 3c2f36af-e877-40dc-8246-6729625140b2 2024-09-21T15:24:10.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:10.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:10.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:10.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone14 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:10.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:10.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:10.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone14 2024-09-21T15:24:10.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:10.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:10.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:10.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:11.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:11.404 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone14': 2024-09-21T15:24:11.404 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:24:11.404 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:24:11.404 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:11.404 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4307141e 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4307141e 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:11:29 2024 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:11:29 2024 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:29 2024 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4307141e 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:11.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:11.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 28770fc6-fe31-43ff-8ae6-a1beb20f7e4d 2024-09-21T15:24:11.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:11.411 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:11.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:11.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone15 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:11.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:11.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:11.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone15 2024-09-21T15:24:11.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:11.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:11.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:11.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:12.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:12.573 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone15': 2024-09-21T15:24:12.573 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 230 MiB in 10 objects 2024-09-21T15:24:12.573 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:24:12.573 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:12.573 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c44d8ac4b3 2024-09-21T15:24:12.573 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c44d8ac4b3 2024-09-21T15:24:12.573 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:12.573 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:12.573 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:12.573 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:12.573 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:24:12.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:24:12.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:24:12.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:12.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone14@snap 2024-09-21T15:24:12.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 598 KiB 2024-09-21T15:24:12.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:24:12.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:24:12.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c44d8ac4b3 2024-09-21T15:24:12.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:12.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:12.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b427bb8c-404c-4fe5-900a-49a86be3a117 2024-09-21T15:24:12.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:12.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:12.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:12.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone16 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:12.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:12.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:12.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone16 2024-09-21T15:24:12.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:12.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:12.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:12.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:13.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:13.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone16': 2024-09-21T15:24:13.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 230 MiB in 468 objects 2024-09-21T15:24:13.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:24:13.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:13.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4c483af66 2024-09-21T15:24:13.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4c483af66 2024-09-21T15:24:13.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:13.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:13.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:13.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:13.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:14:29 2024 2024-09-21T15:24:13.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:14:29 2024 2024-09-21T15:24:13.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:14:29 2024 2024-09-21T15:24:13.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:13.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone15@snap 2024-09-21T15:24:13.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 230 MiB 2024-09-21T15:24:13.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:24:13.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:24:13.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4c483af66 2024-09-21T15:24:13.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:13.768 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:13.768 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: bda20847-8fe7-4b87-a2ac-8dd19094ba3d 2024-09-21T15:24:13.768 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:13.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:13.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:13.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone17 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:13.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:13.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:13.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone17 2024-09-21T15:24:13.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:13.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:13.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:13.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:14.778 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:14.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone17': 2024-09-21T15:24:14.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 115 MiB in 10 objects 2024-09-21T15:24:14.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:24:14.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:14.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c471bc514d 2024-09-21T15:24:14.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c471bc514d 2024-09-21T15:24:14.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:14.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:14.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:14.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:14.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:14:59 2024 2024-09-21T15:24:14.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:14:59 2024 2024-09-21T15:24:14.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:14:59 2024 2024-09-21T15:24:14.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:14.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone16@snap 2024-09-21T15:24:14.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 115 MiB 2024-09-21T15:24:14.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:24:14.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:24:14.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c471bc514d 2024-09-21T15:24:14.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:14.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:14.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 346bfe3b-fa53-4f73-a11c-fc429615fca9 2024-09-21T15:24:14.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:14.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:14.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:14.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone18 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:14.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:14.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:14.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone18 2024-09-21T15:24:14.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:14.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:14.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:14.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:15.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:16.185 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone18': 2024-09-21T15:24:16.186 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 230 MiB in 115 objects 2024-09-21T15:24:16.186 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:24:16.186 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:16.186 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4e7b096d3 2024-09-21T15:24:16.186 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4e7b096d3 2024-09-21T15:24:16.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:16.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:16.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:16.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:16.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:15:28 2024 2024-09-21T15:24:16.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:15:28 2024 2024-09-21T15:24:16.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:15:28 2024 2024-09-21T15:24:16.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:16.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone17@snap 2024-09-21T15:24:16.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 230 MiB 2024-09-21T15:24:16.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:24:16.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:24:16.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4e7b096d3 2024-09-21T15:24:16.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:16.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:16.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 3e4c42b2-b54b-4fa5-a521-076c70c59b4f 2024-09-21T15:24:16.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:16.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:16.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:16.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone19 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:16.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:16.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:16.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone19 2024-09-21T15:24:16.200 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:16.200 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:16.200 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:16.200 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:17.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:17.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone19': 2024-09-21T15:24:17.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:24:17.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:24:17.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:17.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c48af055b4 2024-09-21T15:24:17.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c48af055b4 2024-09-21T15:24:17.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:15:58 2024 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:15:58 2024 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:15:58 2024 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c48af055b4 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: ee5e1490-4a11-4636-ab8f-ee0651bb84e7 2024-09-21T15:24:17.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:17.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:17.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:17.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:17.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:17.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:17.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone2 2024-09-21T15:24:17.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:17.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:17.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:17.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:17.502 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.495+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae3452b0 2024-09-21T15:24:17.507 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.495+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2858750 2024-09-21T15:24:17.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.523+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51380 2024-09-21T15:24:17.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.523+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f515f0 2024-09-21T15:24:17.536 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.527+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686680 2024-09-21T15:24:17.539 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.527+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3687380 2024-09-21T15:24:17.539 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.527+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b36875f0 2024-09-21T15:24:17.539 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.531+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167790 2024-09-21T15:24:17.539 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.531+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:24:17.540 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.531+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76340 2024-09-21T15:24:17.541 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.535+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:24:17.541 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.535+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77c70 2024-09-21T15:24:17.541 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.535+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8ef70 2024-09-21T15:24:17.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.535+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5635790 2024-09-21T15:24:17.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.535+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:24:17.553 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.547+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffba0 2024-09-21T15:24:17.553 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.547+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ffc70 2024-09-21T15:24:17.553 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.547+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eaf70 2024-09-21T15:24:17.556 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.551+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7b790 2024-09-21T15:24:17.556 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.551+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7be10 2024-09-21T15:24:17.556 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.551+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d96c0 2024-09-21T15:24:17.556 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.551+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:24:17.556 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.551+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782ea0 2024-09-21T15:24:17.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.551+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeed00 2024-09-21T15:24:17.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.551+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8370dd0 2024-09-21T15:24:17.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.551+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387380 2024-09-21T15:24:17.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.551+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a4e0 2024-09-21T15:24:17.559 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.551+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cc4e0 2024-09-21T15:24:17.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:24:17.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cd790 2024-09-21T15:24:17.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cd860 2024-09-21T15:24:17.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90000 2024-09-21T15:24:17.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc680 2024-09-21T15:24:17.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:24:17.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9010340 2024-09-21T15:24:17.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9010410 2024-09-21T15:24:17.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90116c0 2024-09-21T15:24:17.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c08f0 2024-09-21T15:24:17.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0dd0 2024-09-21T15:24:17.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0f70 2024-09-21T15:24:17.562 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164340 2024-09-21T15:24:17.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165110 2024-09-21T15:24:17.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165ad0 2024-09-21T15:24:17.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:24:17.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e48f0 2024-09-21T15:24:17.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4c30 2024-09-21T15:24:17.564 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4f70 2024-09-21T15:24:17.565 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.555+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:24:17.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71e750 2024-09-21T15:24:17.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f1e0 2024-09-21T15:24:17.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:24:17.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d89c0 2024-09-21T15:24:17.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3790 2024-09-21T15:24:17.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3ad0 2024-09-21T15:24:17.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed450 2024-09-21T15:24:17.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72f380 2024-09-21T15:24:17.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9145b0 2024-09-21T15:24:17.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d6f70 2024-09-21T15:24:17.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc425ee0 2024-09-21T15:24:17.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b40d0 2024-09-21T15:24:17.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b4680 2024-09-21T15:24:17.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b4b60 2024-09-21T15:24:17.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b4f70 2024-09-21T15:24:17.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c000 2024-09-21T15:24:17.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c270 2024-09-21T15:24:17.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c680 2024-09-21T15:24:17.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:24:17.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26cb60 2024-09-21T15:24:17.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d380 2024-09-21T15:24:17.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.559+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dc70 2024-09-21T15:24:17.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:24:17.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:24:17.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3505b0 2024-09-21T15:24:17.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350680 2024-09-21T15:24:17.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:24:17.571 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:24:17.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd52b60 2024-09-21T15:24:17.575 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd52c30 2024-09-21T15:24:17.575 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:24:17.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53790 2024-09-21T15:24:17.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e270 2024-09-21T15:24:17.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ec30 2024-09-21T15:24:17.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5eea0 2024-09-21T15:24:17.576 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f040 2024-09-21T15:24:17.577 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f110 2024-09-21T15:24:17.577 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.567+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f1e0 2024-09-21T15:24:17.577 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f520 2024-09-21T15:24:17.577 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f790 2024-09-21T15:24:17.577 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6264e0 2024-09-21T15:24:17.577 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6265b0 2024-09-21T15:24:17.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6268f0 2024-09-21T15:24:17.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be627e10 2024-09-21T15:24:17.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91af70 2024-09-21T15:24:17.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:24:17.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b790 2024-09-21T15:24:17.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b930 2024-09-21T15:24:17.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91be10 2024-09-21T15:24:17.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc525b0 2024-09-21T15:24:17.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:24:17.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52a90 2024-09-21T15:24:17.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.579+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52c30 2024-09-21T15:24:17.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.579+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53380 2024-09-21T15:24:17.584 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.579+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53ad0 2024-09-21T15:24:17.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53ee0 2024-09-21T15:24:17.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008340 2024-09-21T15:24:17.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008a90 2024-09-21T15:24:17.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008c30 2024-09-21T15:24:17.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009110 2024-09-21T15:24:17.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009450 2024-09-21T15:24:17.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009ad0 2024-09-21T15:24:17.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:24:17.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921110 2024-09-21T15:24:17.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921520 2024-09-21T15:24:17.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921930 2024-09-21T15:24:17.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:24:17.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921d40 2024-09-21T15:24:17.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921e10 2024-09-21T15:24:17.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae0d0 2024-09-21T15:24:17.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae340 2024-09-21T15:24:17.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae410 2024-09-21T15:24:17.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:24:17.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.583+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:24:17.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae9c0 2024-09-21T15:24:17.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caea90 2024-09-21T15:24:17.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf2b0 2024-09-21T15:24:17.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf380 2024-09-21T15:24:17.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf520 2024-09-21T15:24:17.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf930 2024-09-21T15:24:17.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cafa00 2024-09-21T15:24:17.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cafad0 2024-09-21T15:24:17.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e300d0 2024-09-21T15:24:17.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30270 2024-09-21T15:24:17.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30d00 2024-09-21T15:24:17.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e311e0 2024-09-21T15:24:17.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31520 2024-09-21T15:24:17.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e315f0 2024-09-21T15:24:17.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e316c0 2024-09-21T15:24:17.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31c70 2024-09-21T15:24:17.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6680 2024-09-21T15:24:17.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6c30 2024-09-21T15:24:17.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6dd0 2024-09-21T15:24:17.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7930 2024-09-21T15:24:17.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7a00 2024-09-21T15:24:17.594 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:24:17.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693c70 2024-09-21T15:24:18.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:18.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone2': 2024-09-21T15:24:18.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 235 MiB in 240 objects 2024-09-21T15:24:18.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:24:18.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:18.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9c86dbba6 2024-09-21T15:24:18.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9c86dbba6 2024-09-21T15:24:18.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:18.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:18.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:18.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:18.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:24:18.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:24:18.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:29 2024 2024-09-21T15:24:18.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:18.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:24:18.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:24:18.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9c86dbba6 2024-09-21T15:24:18.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:18.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:18.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 4f24f6f0-5be2-4ea3-af4f-83dbaa368544 2024-09-21T15:24:18.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:18.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:18.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:18.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone20 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:18.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:18.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:18.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone20 2024-09-21T15:24:18.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:18.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:18.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:18.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:19.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:19.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone20': 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 230 MiB in 30 objects 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9894a355e 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9894a355e 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:19.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:24:19.424 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:24:19.424 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9894a355e 2024-09-21T15:24:19.424 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:19.424 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:19.424 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: aff5f3bc-3e8e-4a66-b089-b2f57573290a 2024-09-21T15:24:19.424 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone21 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone21 2024-09-21T15:24:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:19.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:20.431 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:20.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone21': 2024-09-21T15:24:20.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 628 KiB in 5 objects 2024-09-21T15:24:20.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:24:20.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:20.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b93e7a4414 2024-09-21T15:24:20.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b93e7a4414 2024-09-21T15:24:20.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:20.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:20.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:20.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:20.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:24:20.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:24:20.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:24:20.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:20.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone20@snap 2024-09-21T15:24:20.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 628 KiB 2024-09-21T15:24:20.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:24:20.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:24:20.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b93e7a4414 2024-09-21T15:24:20.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:20.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:20.518 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: ed8f9c7d-1492-4fbd-ae77-4c3bfa2f3787 2024-09-21T15:24:20.518 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:20.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:20.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:20.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone22 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:20.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:20.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:20.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone22 2024-09-21T15:24:20.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:20.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:20.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:20.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:20.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.814+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef81a0 2024-09-21T15:24:20.832 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.822+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef89c0 2024-09-21T15:24:20.833 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.822+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:24:20.842 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.834+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9520 2024-09-21T15:24:20.842 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.838+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9790 2024-09-21T15:24:20.842 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.838+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:24:20.853 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9ba0 2024-09-21T15:24:20.856 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.846+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:24:20.858 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.854+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9e10 2024-09-21T15:24:20.861 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.854+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f2000 2024-09-21T15:24:20.864 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.858+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f32b0 2024-09-21T15:24:20.870 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.858+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2410 2024-09-21T15:24:20.870 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.858+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0a90 2024-09-21T15:24:20.871 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.858+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0b60 2024-09-21T15:24:20.871 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.858+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1c70 2024-09-21T15:24:20.872 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.858+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35408f0 2024-09-21T15:24:20.872 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.858+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35412b0 2024-09-21T15:24:20.872 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.862+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541e10 2024-09-21T15:24:20.873 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.862+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36764e0 2024-09-21T15:24:20.873 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.862+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528000 2024-09-21T15:24:20.873 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.862+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45288f0 2024-09-21T15:24:20.876 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529380 2024-09-21T15:24:20.881 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.874+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45296c0 2024-09-21T15:24:20.881 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.874+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529790 2024-09-21T15:24:20.881 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.874+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a000 2024-09-21T15:24:20.885 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a0d0 2024-09-21T15:24:20.885 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a270 2024-09-21T15:24:20.885 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a340 2024-09-21T15:24:20.885 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a4e0 2024-09-21T15:24:20.886 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a5b0 2024-09-21T15:24:20.886 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a680 2024-09-21T15:24:20.886 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a750 2024-09-21T15:24:20.886 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a9c0 2024-09-21T15:24:20.886 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455aa90 2024-09-21T15:24:20.886 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455ac30 2024-09-21T15:24:20.886 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455af70 2024-09-21T15:24:20.886 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455b1e0 2024-09-21T15:24:20.888 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455b930 2024-09-21T15:24:20.888 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455ba00 2024-09-21T15:24:20.888 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455bba0 2024-09-21T15:24:20.888 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.878+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455bd40 2024-09-21T15:24:20.888 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b24e0 2024-09-21T15:24:20.889 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b25b0 2024-09-21T15:24:20.889 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2d00 2024-09-21T15:24:20.889 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b36c0 2024-09-21T15:24:20.889 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6270 2024-09-21T15:24:20.889 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6dd0 2024-09-21T15:24:20.889 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6f70 2024-09-21T15:24:20.889 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7110 2024-09-21T15:24:20.889 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:24:20.889 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7860 2024-09-21T15:24:20.889 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7e10 2024-09-21T15:24:20.889 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:20.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7ee0 2024-09-21T15:24:21.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:21.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone22': 2024-09-21T15:24:21.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:24:21.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:24:21.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:21.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b91dd7bde0 2024-09-21T15:24:21.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b91dd7bde0 2024-09-21T15:24:21.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:21.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:21.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:21.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:21.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:24:21.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:24:21.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:24:21.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:21.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:24:21.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 6 2024-09-21T15:24:21.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b91dd7bde0 2024-09-21T15:24:21.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:21.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:21.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 872cfdbf-272f-4d9f-a928-da68f2136537 2024-09-21T15:24:21.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:21.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:21.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:21.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone23 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:21.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:21.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:21.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone23 2024-09-21T15:24:21.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:21.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:21.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:21.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:22.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:22.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone23': 2024-09-21T15:24:22.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 51 MiB in 60 objects 2024-09-21T15:24:22.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:24:22.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:22.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c45ce2bb18 2024-09-21T15:24:22.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c45ce2bb18 2024-09-21T15:24:22.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:22.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:22.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:22.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:22.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:24:22.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:24:22.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:24:22.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:22.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone22@snap 2024-09-21T15:24:22.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 23 MiB 2024-09-21T15:24:22.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:24:22.710 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:24:22.710 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c45ce2bb18 2024-09-21T15:24:22.710 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:22.710 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:22.710 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 958ce416-411d-4e1a-9982-a2ce4771b41b 2024-09-21T15:24:22.710 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:22.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:22.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:22.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone24 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:22.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:22.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:22.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone24 2024-09-21T15:24:22.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:22.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:22.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:22.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:23.717 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:23.842 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone24': 2024-09-21T15:24:23.842 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 1.7 MiB in 9 objects 2024-09-21T15:24:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:24:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c49fc872e4 2024-09-21T15:24:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c49fc872e4 2024-09-21T15:24:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:24:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:24:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:24:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:23.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone23@snap 2024-09-21T15:24:23.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 1.7 MiB 2024-09-21T15:24:23.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:24:23.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:24:23.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c49fc872e4 2024-09-21T15:24:23.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:23.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:23.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 85d0a44e-84cb-4cc5-bee6-694533ad4fbd 2024-09-21T15:24:23.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:23.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:23.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:23.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone25 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:23.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:23.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:23.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone25 2024-09-21T15:24:23.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:23.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:23.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:23.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:24.854 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:24.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone25': 2024-09-21T15:24:24.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 154 MiB in 156 objects 2024-09-21T15:24:24.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:24:24.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:24.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b944745bb 2024-09-21T15:24:24.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b944745bb 2024-09-21T15:24:24.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:24.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:24.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:24.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:24.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:24:24.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:24:24.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:24:24.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:24.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:24:24.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:24:24.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b944745bb 2024-09-21T15:24:24.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:24.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:24.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 616a1e50-ff37-4e76-b4b1-0f051d7e5ca3 2024-09-21T15:24:24.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:24.925 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:24.925 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:24.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone26 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:24.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:24.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:24.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone26 2024-09-21T15:24:24.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:24.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:24.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:24.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:25.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:26.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone26': 2024-09-21T15:24:26.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 3.1 MiB in 22 objects 2024-09-21T15:24:26.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:24:26.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:26.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b96ec4782 2024-09-21T15:24:26.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b96ec4782 2024-09-21T15:24:26.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:26.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:26.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:26.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:26.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:24:26.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:24:26.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:24:26.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:26.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone25@snap 2024-09-21T15:24:26.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 3.1 MiB 2024-09-21T15:24:26.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:24:26.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:24:26.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b96ec4782 2024-09-21T15:24:26.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:26.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:26.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 69a7130a-5782-4154-a7fd-f0e546ab0ea4 2024-09-21T15:24:26.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:26.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:26.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:26.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone27 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:26.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:26.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:26.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone27 2024-09-21T15:24:26.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:26.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:26.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:26.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:27.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:27.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone27': 2024-09-21T15:24:27.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 180 MiB in 14 objects 2024-09-21T15:24:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:24:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4f8d0b5bf 2024-09-21T15:24:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4f8d0b5bf 2024-09-21T15:24:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:24:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:24:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:24:27.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:27.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone26@snap 2024-09-21T15:24:27.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 180 MiB 2024-09-21T15:24:27.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:24:27.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:24:27.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4f8d0b5bf 2024-09-21T15:24:27.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:27.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:27.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b6899c0b-0c70-4f5e-b225-9b2d50e4b05c 2024-09-21T15:24:27.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:27.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:27.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:27.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone28 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:27.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:27.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:27.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone28 2024-09-21T15:24:27.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:27.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:27.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:27.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:27.443 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.438+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a340 2024-09-21T15:24:27.453 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.446+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9ad00 2024-09-21T15:24:27.458 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.454+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9be10 2024-09-21T15:24:27.458 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.454+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:24:27.458 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.454+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c84e0 2024-09-21T15:24:27.458 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.454+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c92b0 2024-09-21T15:24:27.458 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.454+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9c70 2024-09-21T15:24:27.458 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.454+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:24:27.459 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.454+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:24:27.459 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.454+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7334680 2024-09-21T15:24:27.459 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.454+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335860 2024-09-21T15:24:27.459 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.454+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766340 2024-09-21T15:24:27.484 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.474+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87665b0 2024-09-21T15:24:27.485 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.474+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:24:27.485 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.474+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:24:27.485 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.478+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967a00 2024-09-21T15:24:27.485 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.478+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50820 2024-09-21T15:24:27.486 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.478+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50b60 2024-09-21T15:24:27.486 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.478+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50c30 2024-09-21T15:24:27.486 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.478+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50ea0 2024-09-21T15:24:27.486 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.478+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f515f0 2024-09-21T15:24:27.486 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.478+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51ba0 2024-09-21T15:24:27.499 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.486+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c410 2024-09-21T15:24:27.499 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.486+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c750 2024-09-21T15:24:27.500 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.490+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d1e0 2024-09-21T15:24:27.500 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.490+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d380 2024-09-21T15:24:27.500 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.490+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01da00 2024-09-21T15:24:27.500 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.490+0000 7f7fd044c700 -1 reset not still connected to 0x56369ac5d5f0 2024-09-21T15:24:27.500 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.490+0000 7f7fd044c700 -1 reset not still connected to 0x56369e619520 2024-09-21T15:24:27.502 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.498+0000 7f7fd044c700 -1 reset not still connected to 0x5636a04a12b0 2024-09-21T15:24:27.503 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.498+0000 7f7fd044c700 -1 reset not still connected to 0x5636a04a1450 2024-09-21T15:24:27.503 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.498+0000 7f7fd044c700 -1 reset not still connected to 0x5636a3bce750 2024-09-21T15:24:27.503 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.498+0000 7f7fd044c700 -1 reset not still connected to 0x5636a4b15860 2024-09-21T15:24:27.503 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.498+0000 7f7fd044c700 -1 reset not still connected to 0x5636a5493ee0 2024-09-21T15:24:27.503 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.498+0000 7f7fd044c700 -1 reset not still connected to 0x5636a780e5b0 2024-09-21T15:24:27.503 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.498+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8d0dad0 2024-09-21T15:24:27.509 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.498+0000 7f7fd044c700 -1 reset not still connected to 0x5636abd3ec30 2024-09-21T15:24:27.513 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef025b0 2024-09-21T15:24:27.513 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636b0b3f450 2024-09-21T15:24:27.513 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e92b0 2024-09-21T15:24:27.513 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e4e0 2024-09-21T15:24:27.513 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e8f0 2024-09-21T15:24:27.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678fad0 2024-09-21T15:24:27.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb84e0 2024-09-21T15:24:27.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65520 2024-09-21T15:24:27.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc40d0 2024-09-21T15:24:27.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:24:27.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1d40 2024-09-21T15:24:27.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:24:27.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:24:27.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c47091e0 2024-09-21T15:24:27.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483f040 2024-09-21T15:24:27.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5930 2024-09-21T15:24:27.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a340 2024-09-21T15:24:27.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9ad00 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9be10 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c84e0 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c92b0 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9c70 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7334680 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335860 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766340 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87665b0 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967a00 2024-09-21T15:24:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50820 2024-09-21T15:24:27.516 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50b60 2024-09-21T15:24:27.516 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50c30 2024-09-21T15:24:27.516 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.506+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50ea0 2024-09-21T15:24:27.516 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.510+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f515f0 2024-09-21T15:24:27.516 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.510+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51ba0 2024-09-21T15:24:27.516 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.510+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c410 2024-09-21T15:24:27.516 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.510+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c750 2024-09-21T15:24:27.517 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.510+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d1e0 2024-09-21T15:24:27.517 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.510+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d380 2024-09-21T15:24:27.517 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:27.510+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01da00 2024-09-21T15:24:28.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:28.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone28': 2024-09-21T15:24:28.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 21 MiB in 12 objects 2024-09-21T15:24:28.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:24:28.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:28.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4d0acd0fa 2024-09-21T15:24:28.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4d0acd0fa 2024-09-21T15:24:28.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:28.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:28.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:28.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:28.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:24:28.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:24:28.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:24:28.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:28.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone27@snap 2024-09-21T15:24:28.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 21 MiB 2024-09-21T15:24:28.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:24:28.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:24:28.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4d0acd0fa 2024-09-21T15:24:28.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:28.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:28.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 1ab01511-442c-4ff5-8810-7bb04776a396 2024-09-21T15:24:28.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:28.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:28.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:28.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone29 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:28.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:28.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:28.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone29 2024-09-21T15:24:28.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:28.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:28.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:28.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:29.243 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:29.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone29': 2024-09-21T15:24:29.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 119 MiB in 120 objects 2024-09-21T15:24:29.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:24:29.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:29.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b96fa2bb23 2024-09-21T15:24:29.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b96fa2bb23 2024-09-21T15:24:29.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b96fa2bb23 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 536a1fc6-237a-4cc9-9799-f875bd685121 2024-09-21T15:24:29.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:29.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:29.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:29.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:29.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:29.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:29.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone3 2024-09-21T15:24:29.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:29.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:29.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:29.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:30.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:30.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone3': 2024-09-21T15:24:30.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 4.0 MiB in 9 objects 2024-09-21T15:24:30.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:24:30.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:30.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9f52629b 2024-09-21T15:24:30.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9f52629b 2024-09-21T15:24:30.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:30.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:30.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:30.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:30.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:58 2024 2024-09-21T15:24:30.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:58 2024 2024-09-21T15:24:30.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:58 2024 2024-09-21T15:24:30.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:30.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone2@snap 2024-09-21T15:24:30.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 4.0 MiB 2024-09-21T15:24:30.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:24:30.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:24:30.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9f52629b 2024-09-21T15:24:30.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:30.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:30.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: aa9ede85-ca2d-4619-bec9-dd837ea37942 2024-09-21T15:24:30.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:30.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:30.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:30.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone30 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:30.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:30.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:30.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone30 2024-09-21T15:24:30.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:30.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:30.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:30.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:31.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone30': 2024-09-21T15:24:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 192 MiB in 8 objects 2024-09-21T15:24:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:24:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b935a7611e 2024-09-21T15:24:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b935a7611e 2024-09-21T15:24:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:24:31.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:24:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:27 2024 2024-09-21T15:24:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:24:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:24:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b935a7611e 2024-09-21T15:24:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 130f099f-8b1d-4688-9f7f-374b71d52709 2024-09-21T15:24:31.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:31.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:31.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:31.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone31 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:31.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:31.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:31.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone31 2024-09-21T15:24:31.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:31.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:31.491 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:31.491 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:32.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:32.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone31': 2024-09-21T15:24:32.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 3.7 MiB in 4 objects 2024-09-21T15:24:32.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:24:32.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:32.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9a039c92c 2024-09-21T15:24:32.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9a039c92c 2024-09-21T15:24:32.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:32.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:24:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:24:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:24:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone30@snap 2024-09-21T15:24:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 3.7 MiB 2024-09-21T15:24:32.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:24:32.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:24:32.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9a039c92c 2024-09-21T15:24:32.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:32.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:32.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 8319ade8-0cb1-4b7e-98ca-ced578aceb3e 2024-09-21T15:24:32.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:32.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:32.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:32.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone32 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:32.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:32.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:32.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone32 2024-09-21T15:24:32.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:32.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:32.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:32.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:33.585 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:33.651 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone32': 2024-09-21T15:24:33.651 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:24:33.651 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:24:33.651 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:33.651 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c48a7a17fc 2024-09-21T15:24:33.651 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c48a7a17fc 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c48a7a17fc 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: c2e2d487-dc39-4cd9-8a9b-5fbb585dae13 2024-09-21T15:24:33.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:33.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:33.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:33.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone33 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone33 2024-09-21T15:24:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:33.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:33.670 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.40278885826812505) > weight (0.25) 2024-09-21T15:24:33.671 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.5542296223327677) > weight (0.25) 2024-09-21T15:24:33.671 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.9925307999613318) > weight (0.25) 2024-09-21T15:24:33.671 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.3 with skip (0.9152329883403453) > weight (0.25) 2024-09-21T15:24:33.671 INFO:tasks.rbd_mirror_thrash:waiting for 62 secs before thrashing 2024-09-21T15:24:34.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:34.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone33': 2024-09-21T15:24:34.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 140 MiB in 147 objects 2024-09-21T15:24:34.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:24:34.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:34.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c48ca93d3f 2024-09-21T15:24:34.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c48ca93d3f 2024-09-21T15:24:34.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:34.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:34.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:34.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:34.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:24:34.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:24:34.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:59 2024 2024-09-21T15:24:34.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:34.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone32@snap 2024-09-21T15:24:34.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 140 MiB 2024-09-21T15:24:34.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:24:34.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:24:34.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c48ca93d3f 2024-09-21T15:24:34.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:34.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:34.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 5a2bda13-d29d-4620-a6e7-180dd2cee0a8 2024-09-21T15:24:34.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:34.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:34.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:34.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone34 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:34.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:34.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:34.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone34 2024-09-21T15:24:34.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:34.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:34.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:34.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:34.781 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.770+0000 7f7fd044c700 -1 reset not still connected to 0x5636a4b15860 2024-09-21T15:24:34.790 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.770+0000 7f7fd044c700 -1 reset not still connected to 0x5636a780e5b0 2024-09-21T15:24:34.799 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.786+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef025b0 2024-09-21T15:24:34.800 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.786+0000 7f7fd044c700 -1 reset not still connected to 0x5636b0b3f450 2024-09-21T15:24:34.804 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e92b0 2024-09-21T15:24:34.804 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e4e0 2024-09-21T15:24:34.804 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e8f0 2024-09-21T15:24:34.804 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678fad0 2024-09-21T15:24:34.804 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb84e0 2024-09-21T15:24:34.804 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65520 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1d40 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483f040 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5930 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a340 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9ad00 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9be10 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c84e0 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c92b0 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9c70 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:24:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:24:34.806 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7334680 2024-09-21T15:24:34.806 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335860 2024-09-21T15:24:34.806 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766340 2024-09-21T15:24:34.806 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:24:34.806 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:24:34.806 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967a00 2024-09-21T15:24:34.806 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50820 2024-09-21T15:24:34.806 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.798+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50b60 2024-09-21T15:24:34.806 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.798+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50c30 2024-09-21T15:24:34.806 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.798+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50ea0 2024-09-21T15:24:34.806 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.798+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51ba0 2024-09-21T15:24:34.806 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.798+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c410 2024-09-21T15:24:34.806 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.798+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c750 2024-09-21T15:24:34.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.798+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d1e0 2024-09-21T15:24:34.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.798+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d380 2024-09-21T15:24:34.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:34.798+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01da00 2024-09-21T15:24:35.696 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.678+0000 7f7fd044c700 -1 reset not still connected to 0x56369e619520 2024-09-21T15:24:35.696 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.678+0000 7f7fd044c700 -1 reset not still connected to 0x5636a04a1450 2024-09-21T15:24:35.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636a4b15860 2024-09-21T15:24:35.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636a5493ee0 2024-09-21T15:24:35.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636a780e5b0 2024-09-21T15:24:35.698 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.690+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8d0dad0 2024-09-21T15:24:35.706 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.698+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef025b0 2024-09-21T15:24:35.706 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.698+0000 7f7fd044c700 -1 reset not still connected to 0x5636b0b3f450 2024-09-21T15:24:35.708 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.698+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e92b0 2024-09-21T15:24:35.708 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.698+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e4e0 2024-09-21T15:24:35.709 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.698+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e8f0 2024-09-21T15:24:35.709 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.698+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678fad0 2024-09-21T15:24:35.709 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.698+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb84e0 2024-09-21T15:24:35.709 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.698+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65520 2024-09-21T15:24:35.711 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc40d0 2024-09-21T15:24:35.711 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc5380 2024-09-21T15:24:35.711 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1d40 2024-09-21T15:24:35.711 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0fc2f70 2024-09-21T15:24:35.711 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:24:35.712 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c47091e0 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483f040 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5930 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a340 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9ad00 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9be10 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c84e0 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c92b0 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9c70 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7334680 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335860 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766340 2024-09-21T15:24:35.713 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87665b0 2024-09-21T15:24:35.714 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:24:35.714 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:24:35.714 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966ea0 2024-09-21T15:24:35.714 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967a00 2024-09-21T15:24:35.714 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50820 2024-09-21T15:24:35.715 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50b60 2024-09-21T15:24:35.715 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.706+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50c30 2024-09-21T15:24:35.716 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.710+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f50ea0 2024-09-21T15:24:35.716 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.710+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f515f0 2024-09-21T15:24:35.716 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.710+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51ba0 2024-09-21T15:24:35.716 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.710+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c410 2024-09-21T15:24:35.716 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.710+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c750 2024-09-21T15:24:35.716 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.710+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d1e0 2024-09-21T15:24:35.716 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.710+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d380 2024-09-21T15:24:35.718 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.710+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01da00 2024-09-21T15:24:35.738 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.730+0000 7f7fd044c700 -1 reset not still connected to 0x5636a4b15860 2024-09-21T15:24:35.739 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.730+0000 7f7fd044c700 -1 reset not still connected to 0x5636a780e5b0 2024-09-21T15:24:35.739 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.730+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef025b0 2024-09-21T15:24:35.739 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.730+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65520 2024-09-21T15:24:35.739 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:24:35.730+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:24:35.781 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:35.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone34': 2024-09-21T15:24:35.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 39 MiB in 10 objects 2024-09-21T15:24:35.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:24:35.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:35.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c484d88e6c 2024-09-21T15:24:35.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c484d88e6c 2024-09-21T15:24:35.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:35.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:35.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:35.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:35.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:24:35.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:24:35.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:12:58 2024 2024-09-21T15:24:35.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:35.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone33@snap 2024-09-21T15:24:35.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 39 MiB 2024-09-21T15:24:35.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:24:35.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:24:35.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c484d88e6c 2024-09-21T15:24:35.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:35.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:35.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: cdafaff4-6b78-454a-b798-210e8f89802f 2024-09-21T15:24:35.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:35.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:35.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone35 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone35 2024-09-21T15:24:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:35.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:36.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:36.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone35': 2024-09-21T15:24:36.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 150 MiB in 305 objects 2024-09-21T15:24:36.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:24:36.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:36.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9af555616 2024-09-21T15:24:36.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9af555616 2024-09-21T15:24:36.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:36.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:36.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:24:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:24:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:24:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:24:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:24:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9af555616 2024-09-21T15:24:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: e11bf669-24bd-415f-9833-0c4630550c23 2024-09-21T15:24:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:36.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:36.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:36.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone36 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:36.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:36.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:36.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone36 2024-09-21T15:24:36.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:36.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:36.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:36.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:37.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:38.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone36': 2024-09-21T15:24:38.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 208 MiB in 9 objects 2024-09-21T15:24:38.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:24:38.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:38.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c432916662 2024-09-21T15:24:38.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c432916662 2024-09-21T15:24:38.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:38.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:38.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:38.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:38.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:24:38.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:24:38.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:24:38.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:38.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone35@snap 2024-09-21T15:24:38.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 214 KiB 2024-09-21T15:24:38.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 MiB 2024-09-21T15:24:38.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 6 2024-09-21T15:24:38.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c432916662 2024-09-21T15:24:38.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:38.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:38.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 55849911-b935-4c97-b400-325303585d1b 2024-09-21T15:24:38.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:38.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:38.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:38.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone37 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:38.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:38.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:38.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone37 2024-09-21T15:24:38.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:38.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:38.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:38.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:39.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:39.145 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone37': 2024-09-21T15:24:39.145 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 189 MiB in 96 objects 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b92ff5c68 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b92ff5c68 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:57 2024 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:57 2024 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:57 2024 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:24:39.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b92ff5c68 2024-09-21T15:24:39.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:39.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:39.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 2936d0d6-bde0-48c6-807a-b5288242b35d 2024-09-21T15:24:39.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:39.151 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:39.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:39.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone38 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:39.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:39.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:39.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone38 2024-09-21T15:24:39.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:39.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:39.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:39.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:40.153 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:40.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone38': 2024-09-21T15:24:40.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 202 MiB in 52 objects 2024-09-21T15:24:40.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9d65174af 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9d65174af 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: object map invalid, fast diff invalid 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:10 2024 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:10 2024 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:10 2024 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone37@snap 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 189 MiB 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:24:40.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9d65174af 2024-09-21T15:24:40.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:40.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:40.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 972ded23-1f92-4c82-9bf1-e3d7050a34a2 2024-09-21T15:24:40.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:40.244 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:40.244 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:40.244 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone39 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:40.244 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:40.244 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:40.244 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone39 2024-09-21T15:24:40.244 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:40.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:40.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:40.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:41.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone39': 2024-09-21T15:24:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 1.1 MiB in 13 objects 2024-09-21T15:24:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:24:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:41.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4170b19c6 2024-09-21T15:24:41.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4170b19c6 2024-09-21T15:24:41.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:41.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:41.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:41.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:41.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:24:41.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:24:41.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:28 2024 2024-09-21T15:24:41.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:41.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone38@snap 2024-09-21T15:24:41.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 1.1 MiB 2024-09-21T15:24:41.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:24:41.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:24:41.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4170b19c6 2024-09-21T15:24:41.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:41.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:41.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 3b97819c-ef2b-4fc6-91d4-dcc334a34235 2024-09-21T15:24:41.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:41.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:41.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:41.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:41.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:41.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:41.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone4 2024-09-21T15:24:41.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:41.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:41.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:41.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:42.352 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:42.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone4': 2024-09-21T15:24:42.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:24:42.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:24:42.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:42.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9e48a24da 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9e48a24da 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9e48a24da 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:42.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 18db424e-5a96-4921-b367-efde6164740e 2024-09-21T15:24:42.436 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:42.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:42.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:42.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone40 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:42.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:42.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:42.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone40 2024-09-21T15:24:42.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:42.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:42.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:42.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:43.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:43.550 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone40': 2024-09-21T15:24:43.550 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 15 MiB in 70 objects 2024-09-21T15:24:43.550 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:24:43.550 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:43.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c44ebf9d05 2024-09-21T15:24:43.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c44ebf9d05 2024-09-21T15:24:43.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:43.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:43.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:43.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:43.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:24:43.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:24:43.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:24:43.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:43.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone39@snap 2024-09-21T15:24:43.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 15 MiB 2024-09-21T15:24:43.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:24:43.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:24:43.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c44ebf9d05 2024-09-21T15:24:43.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:43.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:43.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 1db510c7-c786-462a-b73c-998b902f5c86 2024-09-21T15:24:43.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:43.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:43.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:43.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone41 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:43.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:43.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:43.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone41 2024-09-21T15:24:43.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:43.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:43.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:43.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:44.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone41@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:44.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone41': 2024-09-21T15:24:44.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 7.2 MiB in 8 objects 2024-09-21T15:24:44.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:24:44.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:44.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4ddeb46d5 2024-09-21T15:24:44.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4ddeb46d5 2024-09-21T15:24:44.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:44.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:44.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:44.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:44.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:24:44.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:24:44.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:24:44.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:44.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone40@snap 2024-09-21T15:24:44.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 7.2 MiB 2024-09-21T15:24:44.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:24:44.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:24:44.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4ddeb46d5 2024-09-21T15:24:44.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:44.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:44.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 27b12a21-b493-4095-b7d3-cfe660cb3dbd 2024-09-21T15:24:44.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:44.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:44.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:44.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone42 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:44.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:44.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:44.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone42 2024-09-21T15:24:44.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:44.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:44.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:44.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:44.766 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.758+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:24:44.766 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.758+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289e10 2024-09-21T15:24:44.772 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.766+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:24:44.787 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.774+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9790 2024-09-21T15:24:44.788 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.774+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:24:44.797 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.786+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2410 2024-09-21T15:24:44.797 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.786+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1c70 2024-09-21T15:24:44.797 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.786+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541e10 2024-09-21T15:24:44.797 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.786+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45296c0 2024-09-21T15:24:44.805 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.798+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a750 2024-09-21T15:24:44.809 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.802+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a9c0 2024-09-21T15:24:44.809 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.802+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455bba0 2024-09-21T15:24:44.811 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.806+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b25b0 2024-09-21T15:24:44.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.806+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:24:44.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:44.806+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7ee0 2024-09-21T15:24:45.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone42@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:45.830 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone42': 2024-09-21T15:24:45.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 230 MiB in 16 objects 2024-09-21T15:24:45.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:24:45.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:45.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4cfea424a 2024-09-21T15:24:45.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4cfea424a 2024-09-21T15:24:45.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:45.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:45.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:45.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:45.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:14:58 2024 2024-09-21T15:24:45.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:14:58 2024 2024-09-21T15:24:45.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:14:58 2024 2024-09-21T15:24:45.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:45.832 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone41@snap 2024-09-21T15:24:45.832 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 9.8 MiB 2024-09-21T15:24:45.832 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 MiB 2024-09-21T15:24:45.832 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:24:45.832 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4cfea424a 2024-09-21T15:24:45.832 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:45.832 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:45.832 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 79702e90-a4fc-44eb-b594-346223325651 2024-09-21T15:24:45.832 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:45.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:45.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:45.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone43 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:45.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:45.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:45.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone43 2024-09-21T15:24:45.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:45.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:45.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:45.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:46.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone43@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:46.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone43': 2024-09-21T15:24:46.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 138 MiB in 20 objects 2024-09-21T15:24:46.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:24:46.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:46.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c427d8f53f 2024-09-21T15:24:46.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c427d8f53f 2024-09-21T15:24:46.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:46.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:46.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:46.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:46.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:15:28 2024 2024-09-21T15:24:46.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:15:28 2024 2024-09-21T15:24:46.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:15:28 2024 2024-09-21T15:24:46.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:46.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone42@snap 2024-09-21T15:24:46.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 138 MiB 2024-09-21T15:24:46.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:24:46.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:24:46.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c427d8f53f 2024-09-21T15:24:46.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:46.998 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:46.998 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: bf37d95d-24d5-4e99-b4c0-59c9516621d7 2024-09-21T15:24:46.998 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:47.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:47.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:47.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone44 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:47.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:47.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:47.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone44 2024-09-21T15:24:47.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:47.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:47.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:47.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:48.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone44@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:48.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone44': 2024-09-21T15:24:48.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 189 MiB in 15 objects 2024-09-21T15:24:48.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:24:48.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:48.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c47a8e7b7e 2024-09-21T15:24:48.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c47a8e7b7e 2024-09-21T15:24:48.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:48.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:48.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:48.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:48.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:24:48.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:24:48.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:24:48.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:48.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:24:48.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:24:48.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c47a8e7b7e 2024-09-21T15:24:48.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:48.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:48.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: fcddc31d-779e-4790-8f04-636821895e73 2024-09-21T15:24:48.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:48.077 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:48.077 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:48.077 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone45 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:48.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:48.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:48.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone45 2024-09-21T15:24:48.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:48.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:48.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:48.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:49.079 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone45@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:49.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone45': 2024-09-21T15:24:49.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 20 MiB in 8 objects 2024-09-21T15:24:49.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:24:49.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:49.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4918465c5 2024-09-21T15:24:49.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4918465c5 2024-09-21T15:24:49.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:40 2024 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:40 2024 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:40 2024 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4918465c5 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 50a1f802-df95-4e98-8630-fafd576b3b77 2024-09-21T15:24:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:49.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:49.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:49.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone46 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:49.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:49.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:49.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone46 2024-09-21T15:24:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:49.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:50.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone46@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:50.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone46': 2024-09-21T15:24:50.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:24:50.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:24:50.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:50.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4d7e44846 2024-09-21T15:24:50.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4d7e44846 2024-09-21T15:24:50.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:50.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:50.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:50.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:50.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:11:58 2024 2024-09-21T15:24:50.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:11:58 2024 2024-09-21T15:24:50.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:58 2024 2024-09-21T15:24:50.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:50.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:24:50.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:24:50.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4d7e44846 2024-09-21T15:24:50.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:50.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:50.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 6dcfb50f-6365-4e2b-904c-11572f8ea5c9 2024-09-21T15:24:50.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:50.218 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:50.218 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:50.218 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone47 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:50.219 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:50.219 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:50.219 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone47 2024-09-21T15:24:50.219 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:50.219 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:50.219 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:50.219 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:51.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone47@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:51.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone47': 2024-09-21T15:24:51.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 24 MiB in 11 objects 2024-09-21T15:24:51.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:24:51.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:51.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4bb759b7c 2024-09-21T15:24:51.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4bb759b7c 2024-09-21T15:24:51.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:51.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:51.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:51.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:51.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:24:51.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:24:51.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:24:51.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:51.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone46@snap 2024-09-21T15:24:51.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 24 MiB 2024-09-21T15:24:51.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:24:51.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:24:51.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4bb759b7c 2024-09-21T15:24:51.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:51.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:51.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: f8d89eff-024f-42e6-b9d0-84b0bdc5274c 2024-09-21T15:24:51.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:51.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:51.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:51.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone48 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:51.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:51.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:51.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone48 2024-09-21T15:24:51.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:51.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:51.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:51.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:52.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone48@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:52.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone48': 2024-09-21T15:24:52.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 98 MiB in 99 objects 2024-09-21T15:24:52.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:24:52.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:52.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c46dae0982 2024-09-21T15:24:52.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c46dae0982 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c46dae0982 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:52.395 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: f5f9a344-230e-4e5b-b1a4-3e4b4fc4cc86 2024-09-21T15:24:52.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:52.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:52.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:52.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone49 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:52.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:52.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:52.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone49 2024-09-21T15:24:52.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:52.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:52.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:52.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:53.402 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone49@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:53.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone49': 2024-09-21T15:24:53.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 233 MiB in 238 objects 2024-09-21T15:24:53.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:24:53.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:53.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c454b5d3e2 2024-09-21T15:24:53.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c454b5d3e2 2024-09-21T15:24:53.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:53.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:53.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:53.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:53.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:24:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:24:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:58 2024 2024-09-21T15:24:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:24:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:24:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c454b5d3e2 2024-09-21T15:24:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 7de4521f-65c0-4d27-870f-8b5a840e1a42 2024-09-21T15:24:53.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:53.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone5 2024-09-21T15:24:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:53.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:54.477 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:54.585 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone5': 2024-09-21T15:24:54.585 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 3.2 MiB in 1 objects 2024-09-21T15:24:54.585 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:24:54.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:54.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9a7274d 2024-09-21T15:24:54.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9a7274d 2024-09-21T15:24:54.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:54.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:54.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:54.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:54.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:24:54.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:24:54.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:24:54.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:54.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone4@snap 2024-09-21T15:24:54.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 3.2 MiB 2024-09-21T15:24:54.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 MiB 2024-09-21T15:24:54.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:24:54.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9a7274d 2024-09-21T15:24:54.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:54.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:54.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: cadd6ca4-c18a-4ad2-8262-041d93168f2b 2024-09-21T15:24:54.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:54.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:54.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:54.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone50 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:54.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:54.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:54.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone50 2024-09-21T15:24:54.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:54.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:54.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:54.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:55.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone50@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:55.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone50': 2024-09-21T15:24:55.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 105 MiB in 28 objects 2024-09-21T15:24:55.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:24:55.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:55.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4346da5e3 2024-09-21T15:24:55.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4346da5e3 2024-09-21T15:24:55.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:55.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:55.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:55.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:55.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:12:28 2024 2024-09-21T15:24:55.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:12:28 2024 2024-09-21T15:24:55.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:12:28 2024 2024-09-21T15:24:55.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:55.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone49@snap 2024-09-21T15:24:55.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 105 MiB 2024-09-21T15:24:55.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:24:55.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:24:55.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4346da5e3 2024-09-21T15:24:55.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:55.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:55.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 9c634cdf-a6f6-482b-a85c-0d163bc3d079 2024-09-21T15:24:55.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:55.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:55.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:55.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone51 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:55.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:55.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:55.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone51 2024-09-21T15:24:55.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:55.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:55.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:55.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:56.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone51@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:56.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone51': 2024-09-21T15:24:56.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 167 MiB in 52 objects 2024-09-21T15:24:56.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:24:56.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 1 2024-09-21T15:24:56.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4dd1fb470 2024-09-21T15:24:56.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4dd1fb470 2024-09-21T15:24:56.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:56.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:56.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:56.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:56.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:13:58 2024 2024-09-21T15:24:56.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:13:58 2024 2024-09-21T15:24:56.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:13:58 2024 2024-09-21T15:24:56.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:56.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone50@snap 2024-09-21T15:24:56.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 132 MiB 2024-09-21T15:24:56.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:24:56.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:24:56.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4dd1fb470 2024-09-21T15:24:56.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:56.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:56.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: c7b5ea34-ee7c-490c-ba70-f137c71b07e1 2024-09-21T15:24:56.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:56.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:56.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:56.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone6 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:56.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:56.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:56.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone6 2024-09-21T15:24:56.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:56.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:56.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:56.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:57.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone6': 2024-09-21T15:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b96455fdba 2024-09-21T15:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b96455fdba 2024-09-21T15:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:24:57.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:24:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:24:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:24:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:24:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b96455fdba 2024-09-21T15:24:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 3bc38427-dbd9-4b46-aec1-de91638ca6cd 2024-09-21T15:24:57.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:57.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:57.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:57.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone7 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:57.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:57.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:57.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone7 2024-09-21T15:24:57.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:57.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:57.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:57.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:58.856 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone7': 2024-09-21T15:24:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 8.6 MiB in 10 objects 2024-09-21T15:24:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:24:58.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:24:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b95bda6533 2024-09-21T15:24:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b95bda6533 2024-09-21T15:24:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:24:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:24:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:24:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:24:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:24:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:24:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:24:58.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:24:58.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.4-clone6@snap 2024-09-21T15:24:58.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 8.6 MiB 2024-09-21T15:24:58.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:24:58.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:24:58.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b95bda6533 2024-09-21T15:24:58.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:24:58.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:24:58.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 33006863-7504-40fd-b7bf-bdaf3c7c6daa 2024-09-21T15:24:58.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:24:59.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:24:59.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:24:59.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone8 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:59.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:24:59.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:24:59.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone8 2024-09-21T15:24:59.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:24:59.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:24:59.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:24:59.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:24:59.440 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.429+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67040 2024-09-21T15:24:59.442 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.437+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:24:59.451 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.441+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289e10 2024-09-21T15:24:59.452 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.441+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afb6b5f0 2024-09-21T15:24:59.471 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.457+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef89c0 2024-09-21T15:24:59.471 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.457+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9790 2024-09-21T15:24:59.471 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.457+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:24:59.498 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.493+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1c70 2024-09-21T15:24:59.499 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.493+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541e10 2024-09-21T15:24:59.499 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.493+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45296c0 2024-09-21T15:24:59.499 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.493+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b25b0 2024-09-21T15:24:59.508 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.493+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:24:59.508 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.493+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67040 2024-09-21T15:24:59.508 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.493+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:24:59.509 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.493+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9790 2024-09-21T15:24:59.509 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.493+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45296c0 2024-09-21T15:24:59.509 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.493+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a9c0 2024-09-21T15:24:59.856 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.849+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67040 2024-09-21T15:24:59.856 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.849+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160410 2024-09-21T15:24:59.866 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.857+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289e10 2024-09-21T15:24:59.872 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.861+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:24:59.884 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.873+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9790 2024-09-21T15:24:59.884 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.873+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1c70 2024-09-21T15:24:59.884 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.873+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541e10 2024-09-21T15:24:59.884 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.873+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45296c0 2024-09-21T15:24:59.884 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.873+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a9c0 2024-09-21T15:24:59.884 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.873+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b25b0 2024-09-21T15:24:59.884 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.873+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6dd0 2024-09-21T15:24:59.884 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.877+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:24:59.916 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.909+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f669c0 2024-09-21T15:24:59.944 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.929+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f66d00 2024-09-21T15:24:59.944 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.929+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67040 2024-09-21T15:24:59.952 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.941+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67110 2024-09-21T15:24:59.952 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.941+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f672b0 2024-09-21T15:24:59.958 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.945+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67ad0 2024-09-21T15:24:59.959 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.945+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7110 2024-09-21T15:24:59.959 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.945+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7e10 2024-09-21T15:24:59.961 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.945+0000 7f1e9c77a700 -1 reset not still connected to 0x56288661d520 2024-09-21T15:24:59.963 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.953+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28fad0 2024-09-21T15:24:59.966 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.953+0000 7f1e9c77a700 -1 reset not still connected to 0x5628959320d0 2024-09-21T15:24:59.966 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.953+0000 7f1e9c77a700 -1 reset not still connected to 0x5628959336c0 2024-09-21T15:24:59.966 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.953+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a40415f0 2024-09-21T15:24:59.966 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.953+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a59a2dd0 2024-09-21T15:24:59.966 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.953+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a67ee270 2024-09-21T15:24:59.966 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.953+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a7160410 2024-09-21T15:24:59.966 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.953+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a809a4e0 2024-09-21T15:24:59.966 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.953+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a8199d40 2024-09-21T15:24:59.966 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.953+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0dd0 2024-09-21T15:24:59.967 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.957+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9d2b0 2024-09-21T15:24:59.967 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.957+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9d5f0 2024-09-21T15:24:59.967 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.957+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9dc70 2024-09-21T15:24:59.967 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.957+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aa86e270 2024-09-21T15:24:59.967 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.957+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:24:59.968 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.957+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:24:59.968 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.957+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab234ea0 2024-09-21T15:24:59.968 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.957+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2891e0 2024-09-21T15:24:59.968 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.957+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289e10 2024-09-21T15:24:59.968 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.957+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad1d4a90 2024-09-21T15:24:59.968 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.957+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee684e0 2024-09-21T15:24:59.968 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.957+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68ea0 2024-09-21T15:24:59.968 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.957+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69040 2024-09-21T15:24:59.972 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.961+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69860 2024-09-21T15:24:59.972 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.961+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af3104e0 2024-09-21T15:24:59.972 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.965+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac5110 2024-09-21T15:24:59.972 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.965+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afb6b040 2024-09-21T15:24:59.980 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.969+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afb6b5f0 2024-09-21T15:24:59.981 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.969+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a750 2024-09-21T15:24:59.981 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.969+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b520 2024-09-21T15:24:59.981 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.969+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef81a0 2024-09-21T15:24:59.982 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef89c0 2024-09-21T15:24:59.982 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:24:59.983 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8dd0 2024-09-21T15:24:59.983 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef91e0 2024-09-21T15:24:59.983 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9520 2024-09-21T15:24:59.983 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9790 2024-09-21T15:24:59.983 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:24:59.986 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9ba0 2024-09-21T15:24:59.986 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:24:59.986 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9e10 2024-09-21T15:24:59.986 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f2000 2024-09-21T15:24:59.986 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f32b0 2024-09-21T15:24:59.986 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2410 2024-09-21T15:24:59.986 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0a90 2024-09-21T15:24:59.986 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0b60 2024-09-21T15:24:59.986 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f1c70 2024-09-21T15:24:59.986 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35408f0 2024-09-21T15:24:59.986 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35412b0 2024-09-21T15:24:59.986 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541e10 2024-09-21T15:24:59.986 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36764e0 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677ad0 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45296c0 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a000 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a0d0 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a270 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a5b0 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a680 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a750 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a9c0 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455ac30 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455af70 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455b1e0 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455b930 2024-09-21T15:24:59.987 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455ba00 2024-09-21T15:24:59.988 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455bba0 2024-09-21T15:24:59.988 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455bd40 2024-09-21T15:24:59.988 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.977+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b24e0 2024-09-21T15:24:59.988 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.981+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b25b0 2024-09-21T15:24:59.988 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.981+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2d00 2024-09-21T15:24:59.989 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.981+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b36c0 2024-09-21T15:24:59.989 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.981+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6270 2024-09-21T15:24:59.989 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.981+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6dd0 2024-09-21T15:24:59.989 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.981+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd6f70 2024-09-21T15:24:59.989 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.981+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:24:59.989 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.981+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7860 2024-09-21T15:24:59.989 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.981+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7e10 2024-09-21T15:24:59.989 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:24:59.981+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7ee0 2024-09-21T15:25:00.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:00.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone8': 2024-09-21T15:25:00.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 65 MiB in 267 objects 2024-09-21T15:25:00.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:25:00.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:00.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9b26c526a 2024-09-21T15:25:00.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9b26c526a 2024-09-21T15:25:00.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:00.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:00.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:00.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:00.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:00.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:00.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:00.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:00.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:25:00.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 15 2024-09-21T15:25:00.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9b26c526a 2024-09-21T15:25:00.069 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:00.070 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:00.070 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: be9e6865-39e3-44bf-bd1a-f7be9c8aac4c 2024-09-21T15:25:00.070 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:00.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:00.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:00.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.4-clone9 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:00.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:00.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:00.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone9 2024-09-21T15:25:00.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:00.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:00.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:00.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:01.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.4-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:01.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.4-clone9': 2024-09-21T15:25:01.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:25:01.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:25:01.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:01.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9639087bd 2024-09-21T15:25:01.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9639087bd 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9639087bd 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: d5711052-124e-4725-add4-66cb12cc4034 2024-09-21T15:25:01.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:01.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:01.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:01.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:01.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:01.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:01.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5 2024-09-21T15:25:01.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:01.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:01.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:01.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:02.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:02.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5': 2024-09-21T15:25:02.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 219 MiB in 55 objects 2024-09-21T15:25:02.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:25:02.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:02.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b91f79ada9 2024-09-21T15:25:02.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b91f79ada9 2024-09-21T15:25:02.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:02.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:02.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:02.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:02.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:25:02.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:25:02.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:25:02.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:02.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b91f79ada9 2024-09-21T15:25:02.215 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:02.215 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:02.215 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: a886c6ec-95d5-4bec-95d6-90b535ab9694 2024-09-21T15:25:02.215 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:02.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:02.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:02.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone1 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:02.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:02.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:02.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone1 2024-09-21T15:25:02.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:02.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:02.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:02.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:02.453 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:02.442+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456cd00 2024-09-21T15:25:03.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:03.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone1': 2024-09-21T15:25:03.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 89 MiB in 182 objects 2024-09-21T15:25:03.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:25:03.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:03.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9bdc0ade2 2024-09-21T15:25:03.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9bdc0ade2 2024-09-21T15:25:03.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:03.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:03.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:03.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:03.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:03.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:03.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:03.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:03.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5@snap 2024-09-21T15:25:03.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 50 MiB 2024-09-21T15:25:03.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 16 KiB 2024-09-21T15:25:03.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:25:03.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9bdc0ade2 2024-09-21T15:25:03.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:03.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:03.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 27657923-4991-47a3-8bed-28264b9e04a1 2024-09-21T15:25:03.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:03.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:03.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:03.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone10 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:03.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:03.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:03.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone10 2024-09-21T15:25:03.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:03.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:03.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:03.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:04.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:04.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone10': 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9b6b097f5 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9b6b097f5 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:25:04.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:25:04.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9b6b097f5 2024-09-21T15:25:04.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:04.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:04.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: c637239b-4c59-48dc-b548-11f55d5a1b5b 2024-09-21T15:25:04.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:04.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:04.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:04.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone11 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:04.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:04.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:04.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone11 2024-09-21T15:25:04.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:04.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:04.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:04.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:05.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:05.457 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone11': 2024-09-21T15:25:05.457 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 203 MiB in 26 objects 2024-09-21T15:25:05.457 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9d85add8d 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9d85add8d 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:25:05.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9d85add8d 2024-09-21T15:25:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 24b4fbb0-7c7f-43b3-8add-fc2245c3b143 2024-09-21T15:25:05.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:05.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:05.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:05.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone12 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:05.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:05.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:05.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone12 2024-09-21T15:25:05.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:05.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:05.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:05.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:06.465 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:06.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone12': 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b99cf862e5 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b99cf862e5 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:25:06.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:25:06.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b99cf862e5 2024-09-21T15:25:06.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:06.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:06.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b12a2538-c933-4f86-af97-4d8a987efe14 2024-09-21T15:25:06.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:06.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:06.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:06.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone13 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:06.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:06.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:06.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone13 2024-09-21T15:25:06.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:06.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:06.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:06.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:07.508 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.486+0000 7ff753f07700 -1 reset not still connected to 0x56016ad40c30 2024-09-21T15:25:07.508 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.486+0000 7ff753f07700 -1 reset not still connected to 0x56016b24e5b0 2024-09-21T15:25:07.508 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.486+0000 7ff753f07700 -1 reset not still connected to 0x56016ca80750 2024-09-21T15:25:07.509 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.490+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d25b0 2024-09-21T15:25:07.514 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.510+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:25:07.520 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.510+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf28f0 2024-09-21T15:25:07.522 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.514+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90680 2024-09-21T15:25:07.522 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.514+0000 7ff753f07700 -1 reset not still connected to 0x56016fe916c0 2024-09-21T15:25:07.522 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.514+0000 7ff753f07700 -1 reset not still connected to 0x56016feff6c0 2024-09-21T15:25:07.522 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.514+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:25:07.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:07.542 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.530+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9d40 2024-09-21T15:25:07.542 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.530+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9e10 2024-09-21T15:25:07.543 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.530+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:25:07.543 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.530+0000 7ff753f07700 -1 reset not still connected to 0x56017219ed00 2024-09-21T15:25:07.543 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.530+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cc30 2024-09-21T15:25:07.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.530+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc680 2024-09-21T15:25:07.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.530+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0270 2024-09-21T15:25:07.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.530+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1ee0 2024-09-21T15:25:07.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.534+0000 7ff753f07700 -1 reset not still connected to 0x5601772731e0 2024-09-21T15:25:07.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.534+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:25:07.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.534+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc8f0 2024-09-21T15:25:07.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.534+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:25:07.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.534+0000 7ff753f07700 -1 reset not still connected to 0x5601779849c0 2024-09-21T15:25:07.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:07.534+0000 7ff753f07700 -1 reset not still connected to 0x5601780489c0 2024-09-21T15:25:07.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone13': 2024-09-21T15:25:07.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 143 KiB in 1 objects 2024-09-21T15:25:07.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:25:07.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:07.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b938532aaf 2024-09-21T15:25:07.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b938532aaf 2024-09-21T15:25:07.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:07.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:07.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:07.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:07.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:25:07.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:25:07.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:25:07.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:07.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone12@snap 2024-09-21T15:25:07.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 143 KiB 2024-09-21T15:25:07.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:25:07.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:25:07.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b938532aaf 2024-09-21T15:25:07.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:07.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:07.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 1ecb59c1-cb93-43a1-ba73-214a0037caf9 2024-09-21T15:25:07.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone14 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone14 2024-09-21T15:25:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:07.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:07.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:07.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:08.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone14': 2024-09-21T15:25:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 197 MiB in 15 objects 2024-09-21T15:25:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:25:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:08.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b924087cf4 2024-09-21T15:25:08.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b924087cf4 2024-09-21T15:25:08.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:08.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:08.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:08.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:08.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:25:08.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:25:08.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:29 2024 2024-09-21T15:25:08.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:08.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone13@snap 2024-09-21T15:25:08.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 76 MiB 2024-09-21T15:25:08.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:25:08.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 3 2024-09-21T15:25:08.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b924087cf4 2024-09-21T15:25:08.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:08.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:08.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 30daac8e-2d9f-4da1-a5a1-1fa7d734a3e5 2024-09-21T15:25:08.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:08.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:08.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:08.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone15 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:08.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:08.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:08.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone15 2024-09-21T15:25:08.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:08.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:08.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:08.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:09.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone15': 2024-09-21T15:25:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 2.2 MiB in 5 objects 2024-09-21T15:25:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:25:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b95deb9336 2024-09-21T15:25:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b95deb9336 2024-09-21T15:25:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:09.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:25:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:25:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:59 2024 2024-09-21T15:25:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone14@snap 2024-09-21T15:25:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 2.2 MiB 2024-09-21T15:25:09.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:25:09.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:25:09.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b95deb9336 2024-09-21T15:25:09.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:09.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:09.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 73b4e1fe-3f10-4db7-b803-aa7461633260 2024-09-21T15:25:09.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:09.905 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:09.905 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:09.905 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone16 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:09.905 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:09.905 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:09.905 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone16 2024-09-21T15:25:09.905 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:09.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:09.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:09.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:10.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone16': 2024-09-21T15:25:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 167 MiB in 169 objects 2024-09-21T15:25:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:25:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b942442882 2024-09-21T15:25:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b942442882 2024-09-21T15:25:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:10.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 13 2024-09-21T15:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b942442882 2024-09-21T15:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 4a9de63d-2d57-4edb-9b9f-67ede03fdec6 2024-09-21T15:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone17 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:10.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone17 2024-09-21T15:25:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:10.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:11.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:12.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone17': 2024-09-21T15:25:12.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 9.8 MiB in 2 objects 2024-09-21T15:25:12.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:25:12.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:12.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9886158e7 2024-09-21T15:25:12.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9886158e7 2024-09-21T15:25:12.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:12.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:12.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:12.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:12.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:25:12.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:25:12.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:25:12.046 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:12.046 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:25:12.046 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:25:12.046 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9886158e7 2024-09-21T15:25:12.046 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:12.046 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:12.046 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 8f177af5-68e5-41b8-a80d-9cc5dddf14c3 2024-09-21T15:25:12.046 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:12.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:12.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:12.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone18 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone18 2024-09-21T15:25:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:12.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:12.496 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.490+0000 7ff753f07700 -1 reset not still connected to 0x56016b24e5b0 2024-09-21T15:25:12.498 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.490+0000 7ff753f07700 -1 reset not still connected to 0x56016ca80750 2024-09-21T15:25:12.500 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.494+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba270 2024-09-21T15:25:12.500 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.494+0000 7ff753f07700 -1 reset not still connected to 0x56016cdbaea0 2024-09-21T15:25:12.501 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.498+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77a00 2024-09-21T15:25:12.504 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.502+0000 7ff753f07700 -1 reset not still connected to 0x56016e36eb60 2024-09-21T15:25:12.504 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.502+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d25b0 2024-09-21T15:25:12.504 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.502+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:25:12.504 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.502+0000 7ff753f07700 -1 reset not still connected to 0x56016f1632b0 2024-09-21T15:25:12.505 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.502+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90680 2024-09-21T15:25:12.510 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.506+0000 7ff753f07700 -1 reset not still connected to 0x56016fe916c0 2024-09-21T15:25:12.510 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.506+0000 7ff753f07700 -1 reset not still connected to 0x56016feff6c0 2024-09-21T15:25:12.510 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.506+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:25:12.513 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.510+0000 7ff753f07700 -1 reset not still connected to 0x5601709b96c0 2024-09-21T15:25:12.513 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.510+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9d40 2024-09-21T15:25:12.514 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.510+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9e10 2024-09-21T15:25:12.514 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.514+0000 7ff753f07700 -1 reset not still connected to 0x560171d00820 2024-09-21T15:25:12.514 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.514+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:25:12.522 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.518+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:25:12.522 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.518+0000 7ff753f07700 -1 reset not still connected to 0x560171f04ea0 2024-09-21T15:25:12.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.526+0000 7ff753f07700 -1 reset not still connected to 0x560171f94000 2024-09-21T15:25:12.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.526+0000 7ff753f07700 -1 reset not still connected to 0x56017219ed00 2024-09-21T15:25:12.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.526+0000 7ff753f07700 -1 reset not still connected to 0x56017219f2b0 2024-09-21T15:25:12.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.526+0000 7ff753f07700 -1 reset not still connected to 0x560173d87a00 2024-09-21T15:25:12.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.526+0000 7ff753f07700 -1 reset not still connected to 0x560173e67790 2024-09-21T15:25:12.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.530+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2270 2024-09-21T15:25:12.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.530+0000 7ff753f07700 -1 reset not still connected to 0x5601743d3ee0 2024-09-21T15:25:12.535 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.530+0000 7ff753f07700 -1 reset not still connected to 0x560174554680 2024-09-21T15:25:12.536 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.534+0000 7ff753f07700 -1 reset not still connected to 0x5601747f51e0 2024-09-21T15:25:12.540 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.538+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7380 2024-09-21T15:25:12.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.542+0000 7ff753f07700 -1 reset not still connected to 0x560175e1c680 2024-09-21T15:25:12.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.542+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cc30 2024-09-21T15:25:12.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.542+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc0d0 2024-09-21T15:25:12.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.542+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc680 2024-09-21T15:25:12.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.542+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd1e0 2024-09-21T15:25:12.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.542+0000 7ff753f07700 -1 reset not still connected to 0x5601762fdba0 2024-09-21T15:25:12.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.542+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0270 2024-09-21T15:25:12.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.542+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1ee0 2024-09-21T15:25:12.559 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.550+0000 7ff753f07700 -1 reset not still connected to 0x5601772731e0 2024-09-21T15:25:12.560 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.550+0000 7ff753f07700 -1 reset not still connected to 0x560177273c70 2024-09-21T15:25:12.560 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.550+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc000 2024-09-21T15:25:12.560 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.550+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:25:12.560 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.550+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc8f0 2024-09-21T15:25:12.560 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.550+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdc70 2024-09-21T15:25:12.560 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.550+0000 7ff753f07700 -1 reset not still connected to 0x5601779849c0 2024-09-21T15:25:12.560 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.550+0000 7ff753f07700 -1 reset not still connected to 0x560177985ba0 2024-09-21T15:25:12.560 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.550+0000 7ff753f07700 -1 reset not still connected to 0x5601780489c0 2024-09-21T15:25:12.560 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.550+0000 7ff753f07700 -1 reset not still connected to 0x56017a16edd0 2024-09-21T15:25:12.560 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.550+0000 7ff753f07700 -1 reset not still connected to 0x56017a204000 2024-09-21T15:25:12.560 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:12.550+0000 7ff753f07700 -1 reset not still connected to 0x56017a204820 2024-09-21T15:25:12.770 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.9648800031717617) > weight (0.25) 2024-09-21T15:25:12.771 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.3491913103863259) > weight (0.25) 2024-09-21T15:25:12.771 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.2 2024-09-21T15:25:12.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Sent signal 15 2024-09-21T15:25:12.772 INFO:tasks.rbd_mirror_thrash:waiting for 2 secs before reviving daemons 2024-09-21T15:25:12.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:25:12.770+0000 7fd40795c700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 (PID: 38357) UID: 1000 2024-09-21T15:25:13.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:13.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone18': 2024-09-21T15:25:13.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 8.7 MiB in 11 objects 2024-09-21T15:25:13.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:25:13.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:13.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9ece766c7 2024-09-21T15:25:13.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9ece766c7 2024-09-21T15:25:13.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:13.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:13.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:13.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:13.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:25:13.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:25:13.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:25:13.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:13.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone17@snap 2024-09-21T15:25:13.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 8.7 MiB 2024-09-21T15:25:13.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:25:13.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:25:13.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9ece766c7 2024-09-21T15:25:13.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:13.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:13.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 2ecbd40e-3deb-400c-92b4-6c441ce7dbae 2024-09-21T15:25:13.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:13.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone19 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone19 2024-09-21T15:25:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:13.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:14.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone19': 2024-09-21T15:25:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 111 MiB in 228 objects 2024-09-21T15:25:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:25:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9cee321e4 2024-09-21T15:25:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9cee321e4 2024-09-21T15:25:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:25:14.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:25:14.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:25:14.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:14.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:25:14.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 12 2024-09-21T15:25:14.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9cee321e4 2024-09-21T15:25:14.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:14.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:14.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 2e0d532d-d0fa-46dd-8ea2-5577312481b6 2024-09-21T15:25:14.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:14.202 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:14.202 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:14.202 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone2 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:14.202 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:14.202 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:14.202 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone2 2024-09-21T15:25:14.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:14.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:14.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:14.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:14.773 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.2 2024-09-21T15:25:14.773 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:25:15.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:15.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone2': 2024-09-21T15:25:15.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 191 MiB in 384 objects 2024-09-21T15:25:15.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:25:15.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:15.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b998460990 2024-09-21T15:25:15.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b998460990 2024-09-21T15:25:15.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:07:30 2024 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b998460990 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 9c035874-7072-4388-9e66-5ac25ff8778b 2024-09-21T15:25:15.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:15.275 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone20 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone20 2024-09-21T15:25:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:15.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:16.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:16.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone20': 2024-09-21T15:25:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 143 MiB in 576 objects 2024-09-21T15:25:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:25:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9661e3ad1 2024-09-21T15:25:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9661e3ad1 2024-09-21T15:25:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:25:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:25:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:57 2024 2024-09-21T15:25:16.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:16.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 KiB 2024-09-21T15:25:16.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:25:16.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9661e3ad1 2024-09-21T15:25:16.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:16.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:16.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 6019fe59-e961-41f3-881e-27522f0e43d6 2024-09-21T15:25:16.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone21 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone21 2024-09-21T15:25:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:16.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:17.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:17.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone21': 2024-09-21T15:25:17.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 1.2 MiB in 8 objects 2024-09-21T15:25:17.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:25:17.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:17.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9853254e 2024-09-21T15:25:17.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9853254e 2024-09-21T15:25:17.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:17.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:17.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:17.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:17.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:25:17.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:25:17.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:28 2024 2024-09-21T15:25:17.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:17.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone20@snap 2024-09-21T15:25:17.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 1.2 MiB 2024-09-21T15:25:17.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:25:17.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 8 2024-09-21T15:25:17.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9853254e 2024-09-21T15:25:17.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:17.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:17.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: ce7fcc29-8d17-41da-ab67-71f2479df285 2024-09-21T15:25:17.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:17.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:17.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:17.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone22 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:17.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:17.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:17.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone22 2024-09-21T15:25:17.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:17.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:17.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:17.440 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:18.441 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:18.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone22': 2024-09-21T15:25:18.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 29 MiB in 7 objects 2024-09-21T15:25:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:25:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9eab7c7c6 2024-09-21T15:25:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9eab7c7c6 2024-09-21T15:25:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:25:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:25:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:25:18.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone21@snap 2024-09-21T15:25:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 29 MiB 2024-09-21T15:25:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:25:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:25:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9eab7c7c6 2024-09-21T15:25:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 13756a3d-e2f7-4a06-ad9d-ccc844643439 2024-09-21T15:25:18.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone23 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone23 2024-09-21T15:25:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:18.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:19.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:19.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone23': 2024-09-21T15:25:19.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 4.4 MiB in 14 objects 2024-09-21T15:25:19.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:25:19.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:19.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c471493485 2024-09-21T15:25:19.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c471493485 2024-09-21T15:25:19.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:19.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone22@snap 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 4.4 MiB 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c471493485 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:19.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 0fa7a298-927a-43ff-b471-c5ded7e56000 2024-09-21T15:25:19.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:19.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:19.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:19.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone24 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:19.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:19.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:19.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone24 2024-09-21T15:25:19.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:19.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:19.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:19.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:19.946 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.942+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:19.956 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.954+0000 7ff753f07700 -1 reset not still connected to 0x560171cd44e0 2024-09-21T15:25:19.957 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.954+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:19.957 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.954+0000 7ff753f07700 -1 reset not still connected to 0x560173d87930 2024-09-21T15:25:19.958 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.954+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0b60 2024-09-21T15:25:19.963 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.958+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:25:19.966 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.958+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:19.966 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.958+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e9c0 2024-09-21T15:25:19.966 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.958+0000 7ff753f07700 -1 reset not still connected to 0x56016878bc70 2024-09-21T15:25:19.966 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.958+0000 7ff753f07700 -1 reset not still connected to 0x56016a50b1e0 2024-09-21T15:25:19.966 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.958+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a29c0 2024-09-21T15:25:19.967 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.958+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:19.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x560171cd44e0 2024-09-21T15:25:19.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:19.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x560173d86b60 2024-09-21T15:25:19.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x560173d87930 2024-09-21T15:25:19.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0b60 2024-09-21T15:25:19.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:25:19.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:19.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e0d0 2024-09-21T15:25:19.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e9c0 2024-09-21T15:25:19.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a29c0 2024-09-21T15:25:19.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:19.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x560173d86b60 2024-09-21T15:25:19.969 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x560173d87930 2024-09-21T15:25:19.970 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e9c0 2024-09-21T15:25:19.970 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:19.962+0000 7ff753f07700 -1 reset not still connected to 0x560171cd44e0 2024-09-21T15:25:20.014 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.010+0000 7ff753f07700 -1 reset not still connected to 0x560173d86b60 2024-09-21T15:25:20.022 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.018+0000 7ff753f07700 -1 reset not still connected to 0x560173d87930 2024-09-21T15:25:20.022 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.018+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7d40 2024-09-21T15:25:20.022 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.018+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0b60 2024-09-21T15:25:20.028 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.026+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d040 2024-09-21T15:25:20.029 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.026+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:25:20.030 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.030+0000 7ff753f07700 -1 reset not still connected to 0x560178190270 2024-09-21T15:25:20.037 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.030+0000 7ff753f07700 -1 reset not still connected to 0x560178191450 2024-09-21T15:25:20.039 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.034+0000 7ff753f07700 -1 reset not still connected to 0x560178191520 2024-09-21T15:25:20.039 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.034+0000 7ff753f07700 -1 reset not still connected to 0x5601781915f0 2024-09-21T15:25:20.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.038+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:20.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.038+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e000 2024-09-21T15:25:20.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.038+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e0d0 2024-09-21T15:25:20.041 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.038+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e9c0 2024-09-21T15:25:20.197 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.194+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a29c0 2024-09-21T15:25:20.209 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.202+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:20.211 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.206+0000 7ff753f07700 -1 reset not still connected to 0x560171cd44e0 2024-09-21T15:25:20.212 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.206+0000 7ff753f07700 -1 reset not still connected to 0x560171f041a0 2024-09-21T15:25:20.212 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.206+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:20.213 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.210+0000 7ff753f07700 -1 reset not still connected to 0x560173d86b60 2024-09-21T15:25:20.213 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.210+0000 7ff753f07700 -1 reset not still connected to 0x560173d87930 2024-09-21T15:25:20.213 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.210+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0b60 2024-09-21T15:25:20.213 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.210+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1110 2024-09-21T15:25:20.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.218+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d040 2024-09-21T15:25:20.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:25:20.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x560178190270 2024-09-21T15:25:20.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:20.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e0d0 2024-09-21T15:25:20.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e9c0 2024-09-21T15:25:20.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2ea0 2024-09-21T15:25:20.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cc750 2024-09-21T15:25:20.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x56016878bc70 2024-09-21T15:25:20.231 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a29c0 2024-09-21T15:25:20.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:25:20.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:25:20.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:20.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x560171cd44e0 2024-09-21T15:25:20.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:20.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x560173d86b60 2024-09-21T15:25:20.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x560173d87930 2024-09-21T15:25:20.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0b60 2024-09-21T15:25:20.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:25:20.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x560178190270 2024-09-21T15:25:20.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:20.232 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.222+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e9c0 2024-09-21T15:25:20.233 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.226+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a29c0 2024-09-21T15:25:20.233 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.230+0000 7ff753f07700 -1 reset not still connected to 0x56017063e4e0 2024-09-21T15:25:20.242 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.238+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:20.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.238+0000 7ff753f07700 -1 reset not still connected to 0x560171cd44e0 2024-09-21T15:25:20.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.242+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:20.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.242+0000 7ff753f07700 -1 reset not still connected to 0x560173d86b60 2024-09-21T15:25:20.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.242+0000 7ff753f07700 -1 reset not still connected to 0x560173d87930 2024-09-21T15:25:20.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.242+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0b60 2024-09-21T15:25:20.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.242+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:25:20.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.242+0000 7ff753f07700 -1 reset not still connected to 0x560178190270 2024-09-21T15:25:20.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.242+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:20.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.242+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e9c0 2024-09-21T15:25:20.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.242+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2ea0 2024-09-21T15:25:20.277 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.274+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:20.286 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.282+0000 7ff753f07700 -1 reset not still connected to 0x560171cd44e0 2024-09-21T15:25:20.286 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.282+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:20.286 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.282+0000 7ff753f07700 -1 reset not still connected to 0x560173d87930 2024-09-21T15:25:20.286 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.282+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0b60 2024-09-21T15:25:20.287 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.282+0000 7ff753f07700 -1 reset not still connected to 0x5601774cc0d0 2024-09-21T15:25:20.394 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:20.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1a00 2024-09-21T15:25:20.442 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.434+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:20.452 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.442+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e9c0 2024-09-21T15:25:20.452 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.442+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2ea0 2024-09-21T15:25:20.452 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.442+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cc750 2024-09-21T15:25:20.452 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.442+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cc8f0 2024-09-21T15:25:20.656 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:20.646+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30b60 2024-09-21T15:25:20.660 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:20.650+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e311e0 2024-09-21T15:25:20.661 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:20.654+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31520 2024-09-21T15:25:20.661 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:20.654+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6680 2024-09-21T15:25:20.661 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:20.654+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6c30 2024-09-21T15:25:20.661 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:20.654+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7110 2024-09-21T15:25:20.661 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:20.654+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:25:20.662 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:20.658+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693790 2024-09-21T15:25:20.698 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.694+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a591d180 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:25:20.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.694+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a591d180 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:25:20.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.698+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7510f00 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:25:20.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.698+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7510f00 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:25:20.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.698+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a591cf00 [3/02c68625-9e68-49b7-9164-c8fd75eb654b] start: already running 2024-09-21T15:25:20.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.698+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a591cf00 [3/02c68625-9e68-49b7-9164-c8fd75eb654b] start: already running 2024-09-21T15:25:20.700 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.698+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7510a00 [3/0e38c267-ca71-47c8-85c5-6e571f45254e] start: already running 2024-09-21T15:25:20.700 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.698+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7510a00 [3/0e38c267-ca71-47c8-85c5-6e571f45254e] start: already running 2024-09-21T15:25:20.700 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.698+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7511680 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:25:20.701 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.698+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7511680 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:25:20.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:20.786 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.782+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7510500 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:25:20.786 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.782+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7510500 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:25:20.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.786+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a591ca00 [3/0111f35b-69c8-4614-8b36-510c97864eec] start: already running 2024-09-21T15:25:20.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.786+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a591ca00 [3/0111f35b-69c8-4614-8b36-510c97864eec] start: already running 2024-09-21T15:25:20.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.786+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a591db80 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:25:20.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.786+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a591db80 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:25:20.857 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.850+0000 7ff753f07700 -1 reset not still connected to 0x560177273a00 2024-09-21T15:25:20.857 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.850+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccc30 2024-09-21T15:25:20.857 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.850+0000 7ff753f07700 -1 reset not still connected to 0x560178190270 2024-09-21T15:25:20.867 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.858+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:20.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.858+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e000 2024-09-21T15:25:20.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.858+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e0d0 2024-09-21T15:25:20.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.858+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e9c0 2024-09-21T15:25:20.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.858+0000 7ff753f07700 -1 reset not still connected to 0x56017a204a90 2024-09-21T15:25:20.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.858+0000 7ff753f07700 -1 reset not still connected to 0x56017a204b60 2024-09-21T15:25:20.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.858+0000 7ff753f07700 -1 reset not still connected to 0x56017a2055f0 2024-09-21T15:25:20.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.858+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2ea0 2024-09-21T15:25:20.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.858+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cc750 2024-09-21T15:25:20.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.858+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cc8f0 2024-09-21T15:25:20.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.858+0000 7ff753f07700 -1 reset not still connected to 0x56017a8ccf70 2024-09-21T15:25:20.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.858+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd6c0 2024-09-21T15:25:20.875 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.2 2024-09-21T15:25:20.875 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Restarting daemon 2024-09-21T15:25:20.875 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 2024-09-21T15:25:20.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Started 2024-09-21T15:25:20.877 INFO:tasks.rbd_mirror_thrash:waiting for 64 secs before thrashing 2024-09-21T15:25:20.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.878+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7912000 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:25:20.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.878+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7912000 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:25:20.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.878+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7912000 [3/130f099f-8b1d-4688-9f7f-374b71d52709] start: already running 2024-09-21T15:25:20.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.878+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7972000 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:25:20.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.878+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7972000 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:25:20.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.878+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7972000 [3/1a1e66f6-5757-4250-90a9-6afa01bb72a4] start: already running 2024-09-21T15:25:20.894 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.894+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a591d900 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:25:20.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.894+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a591d900 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:25:20.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.894+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a591d900 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:25:20.929 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.910+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:20.929 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.910+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccc30 2024-09-21T15:25:20.929 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:20.910+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e9c0 2024-09-21T15:25:20.955 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.954+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7912500 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:25:20.955 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.954+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7912500 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:25:20.955 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.954+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7912500 [3/1521f990-e0f3-447d-8ae6-8c8eaf7726c1] start: already running 2024-09-21T15:25:20.993 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.990+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7912f00 [3/18beec6d-0569-40d4-9d25-4aee7c0f6abb] start: already running 2024-09-21T15:25:20.994 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.990+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7912f00 [3/18beec6d-0569-40d4-9d25-4aee7c0f6abb] start: already running 2024-09-21T15:25:20.994 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.990+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7912f00 [3/18beec6d-0569-40d4-9d25-4aee7c0f6abb] start: already running 2024-09-21T15:25:20.998 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.994+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510280 [3/06206359-a5f6-4376-970d-9f794536ac14] start: already running 2024-09-21T15:25:20.998 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.994+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510280 [3/06206359-a5f6-4376-970d-9f794536ac14] start: already running 2024-09-21T15:25:20.998 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.994+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510280 [3/06206359-a5f6-4376-970d-9f794536ac14] start: already running 2024-09-21T15:25:21.000 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.998+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a591d680 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:25:21.000 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.998+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a591d680 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:25:21.000 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:20.998+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a591d680 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:25:21.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc000 [3/235c6780-0eb8-4b58-8a3e-08efcc9ea11c] start: already running 2024-09-21T15:25:21.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc000 [3/235c6780-0eb8-4b58-8a3e-08efcc9ea11c] start: already running 2024-09-21T15:25:21.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc000 [3/235c6780-0eb8-4b58-8a3e-08efcc9ea11c] start: already running 2024-09-21T15:25:21.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7973180 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:25:21.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7973180 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:25:21.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7973180 [3/1ee4b202-75aa-4164-b5c6-1cf01e44cb5b] start: already running 2024-09-21T15:25:21.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7913180 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:25:21.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7913180 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:25:21.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7913180 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:25:21.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7913180 [3/18db424e-5a96-4921-b367-efde6164740e] start: already running 2024-09-21T15:25:21.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0500 [3/2799bff6-159c-4fac-9ff0-10626f02c84d] start: already running 2024-09-21T15:25:21.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0500 [3/2799bff6-159c-4fac-9ff0-10626f02c84d] start: already running 2024-09-21T15:25:21.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0500 [3/2799bff6-159c-4fac-9ff0-10626f02c84d] start: already running 2024-09-21T15:25:21.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0280 [3/276535f4-9168-47d5-a517-d2edfbcc99eb] start: already running 2024-09-21T15:25:21.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0280 [3/276535f4-9168-47d5-a517-d2edfbcc99eb] start: already running 2024-09-21T15:25:21.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.074+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0280 [3/276535f4-9168-47d5-a517-d2edfbcc99eb] start: already running 2024-09-21T15:25:21.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.106+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dd900 [3/32979c40-b09e-47fb-96bc-99dc3f3188ed] start: already running 2024-09-21T15:25:21.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.106+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dd900 [3/32979c40-b09e-47fb-96bc-99dc3f3188ed] start: already running 2024-09-21T15:25:21.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.106+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dd900 [3/32979c40-b09e-47fb-96bc-99dc3f3188ed] start: already running 2024-09-21T15:25:21.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.110+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6c000 [3/4a9de63d-2d57-4edb-9b9f-67ede03fdec6] start: already running 2024-09-21T15:25:21.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.110+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6c000 [3/4a9de63d-2d57-4edb-9b9f-67ede03fdec6] start: already running 2024-09-21T15:25:21.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.110+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6c000 [3/4a9de63d-2d57-4edb-9b9f-67ede03fdec6] start: already running 2024-09-21T15:25:21.119 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.114+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7510c80 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.119 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.114+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7510c80 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.119 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.114+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510c80 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:25:21.119 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.114+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510c80 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:25:21.119 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.114+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510c80 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:25:21.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.114+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510c80 [3/0e735348-ba0d-4e20-ac7c-dbc118fb42ba] start: already running 2024-09-21T15:25:21.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.114+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc500 [3/27657923-4991-47a3-8bed-28264b9e04a1] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.118+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc500 [3/27657923-4991-47a3-8bed-28264b9e04a1] start: already running 2024-09-21T15:25:21.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.118+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc500 [3/27657923-4991-47a3-8bed-28264b9e04a1] start: already running 2024-09-21T15:25:21.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.118+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc500 [3/27657923-4991-47a3-8bed-28264b9e04a1] start: already running 2024-09-21T15:25:21.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone24': 2024-09-21T15:25:21.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 24 MiB in 5 objects 2024-09-21T15:25:21.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:25:21.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:21.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c44f9b46c6 2024-09-21T15:25:21.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c44f9b46c6 2024-09-21T15:25:21.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:21.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:21.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:21.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:21.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:30 2024 2024-09-21T15:25:21.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:30 2024 2024-09-21T15:25:21.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:30 2024 2024-09-21T15:25:21.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:21.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone23@snap 2024-09-21T15:25:21.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 24 MiB 2024-09-21T15:25:21.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 MiB 2024-09-21T15:25:21.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:25:21.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c44f9b46c6 2024-09-21T15:25:21.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:21.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:21.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 19512931-b55f-4107-8787-bbdcbc6a72f8 2024-09-21T15:25:21.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:21.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0000 [3/270edf45-6738-4fd2-95f6-31351dcf77ee] start: already running 2024-09-21T15:25:21.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0000 [3/270edf45-6738-4fd2-95f6-31351dcf77ee] start: already running 2024-09-21T15:25:21.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0000 [3/270edf45-6738-4fd2-95f6-31351dcf77ee] start: already running 2024-09-21T15:25:21.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1400 [3/38d35746-a904-4bdd-bf2c-f409673624e7] start: already running 2024-09-21T15:25:21.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1400 [3/38d35746-a904-4bdd-bf2c-f409673624e7] start: already running 2024-09-21T15:25:21.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1400 [3/38d35746-a904-4bdd-bf2c-f409673624e7] start: already running 2024-09-21T15:25:21.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0c80 [3/28770fc6-fe31-43ff-8ae6-a1beb20f7e4d] start: already running 2024-09-21T15:25:21.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0c80 [3/28770fc6-fe31-43ff-8ae6-a1beb20f7e4d] start: already running 2024-09-21T15:25:21.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0c80 [3/28770fc6-fe31-43ff-8ae6-a1beb20f7e4d] start: already running 2024-09-21T15:25:21.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f1400 [3/2b696388-ccf4-4874-ae7a-646ab0d69446] start: already running 2024-09-21T15:25:21.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f1400 [3/2b696388-ccf4-4874-ae7a-646ab0d69446] start: already running 2024-09-21T15:25:21.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f1400 [3/2b696388-ccf4-4874-ae7a-646ab0d69446] start: already running 2024-09-21T15:25:21.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7973b80 [3/2356d978-bbcf-4641-a1a5-fa6a827028ca] start: already running 2024-09-21T15:25:21.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7973b80 [3/2356d978-bbcf-4641-a1a5-fa6a827028ca] start: already running 2024-09-21T15:25:21.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7973b80 [3/2356d978-bbcf-4641-a1a5-fa6a827028ca] start: already running 2024-09-21T15:25:21.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4d180 [3/3fdcc685-72aa-4afe-9cdb-1ad60b962a91] start: already running 2024-09-21T15:25:21.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4d180 [3/3fdcc685-72aa-4afe-9cdb-1ad60b962a91] start: already running 2024-09-21T15:25:21.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4d180 [3/3fdcc685-72aa-4afe-9cdb-1ad60b962a91] start: already running 2024-09-21T15:25:21.222 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:21.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:21.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone25 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:21.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:21.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:21.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone25 2024-09-21T15:25:21.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:21.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:21.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:21.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:21.294 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7973400 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:25:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7973400 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:25:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7973400 [3/1fc5fe34-73f0-4032-9686-33e9c5f97af5] start: already running 2024-09-21T15:25:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd1680 [3/5d8470f4-d7d3-4732-8815-2ed1bc60c759] start: already running 2024-09-21T15:25:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc280 [3/24b4fbb0-7c7f-43b3-8add-fc2245c3b143] start: already running 2024-09-21T15:25:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc280 [3/24b4fbb0-7c7f-43b3-8add-fc2245c3b143] start: already running 2024-09-21T15:25:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc280 [3/24b4fbb0-7c7f-43b3-8add-fc2245c3b143] start: already running 2024-09-21T15:25:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4c000 [3/3d2cada1-cdba-4793-9a15-f743b41bee74] start: already running 2024-09-21T15:25:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4c000 [3/3d2cada1-cdba-4793-9a15-f743b41bee74] start: already running 2024-09-21T15:25:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4c000 [3/3d2cada1-cdba-4793-9a15-f743b41bee74] start: already running 2024-09-21T15:25:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6d900 [3/5372d49a-7f62-4cee-a4e4-61183f5854a0] start: already running 2024-09-21T15:25:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6d900 [3/5372d49a-7f62-4cee-a4e4-61183f5854a0] start: already running 2024-09-21T15:25:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6d900 [3/5372d49a-7f62-4cee-a4e4-61183f5854a0] start: already running 2024-09-21T15:25:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dcc80 [3/2e0d532d-d0fa-46dd-8ea2-5577312481b6] start: already running 2024-09-21T15:25:21.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dcc80 [3/2e0d532d-d0fa-46dd-8ea2-5577312481b6] start: already running 2024-09-21T15:25:21.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dcc80 [3/2e0d532d-d0fa-46dd-8ea2-5577312481b6] start: already running 2024-09-21T15:25:21.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6cc80 [3/4f24f6f0-5be2-4ea3-af4f-83dbaa368544] start: already running 2024-09-21T15:25:21.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6cc80 [3/4f24f6f0-5be2-4ea3-af4f-83dbaa368544] start: already running 2024-09-21T15:25:21.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.290+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6cc80 [3/4f24f6f0-5be2-4ea3-af4f-83dbaa368544] start: already running 2024-09-21T15:25:21.344 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:21.337+0000 7f1e9c77a700 -1 reset not still connected to 0x5628956da270 2024-09-21T15:25:21.347 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:21.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8340 2024-09-21T15:25:21.348 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:21.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0a90 2024-09-21T15:25:21.348 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:21.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35415f0 2024-09-21T15:25:21.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:21.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36775f0 2024-09-21T15:25:21.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:21.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455a680 2024-09-21T15:25:21.349 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:21.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2c30 2024-09-21T15:25:21.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f1900 [3/2c920b45-e415-4127-8e5e-84e50ed4265e] start: already running 2024-09-21T15:25:21.391 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f1900 [3/2c920b45-e415-4127-8e5e-84e50ed4265e] start: already running 2024-09-21T15:25:21.391 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f1900 [3/2c920b45-e415-4127-8e5e-84e50ed4265e] start: already running 2024-09-21T15:25:21.392 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510780 [3/0da2d7cc-be3d-48b3-9444-121826b07f97] start: already running 2024-09-21T15:25:21.392 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510780 [3/0da2d7cc-be3d-48b3-9444-121826b07f97] start: already running 2024-09-21T15:25:21.392 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510780 [3/0da2d7cc-be3d-48b3-9444-121826b07f97] start: already running 2024-09-21T15:25:21.392 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510780 [3/0da2d7cc-be3d-48b3-9444-121826b07f97] start: already running 2024-09-21T15:25:21.392 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd0c80 [3/5aef6686-3462-4732-9396-d809d993e90b] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd0c80 [3/5aef6686-3462-4732-9396-d809d993e90b] start: already running 2024-09-21T15:25:21.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd0c80 [3/5aef6686-3462-4732-9396-d809d993e90b] start: already running 2024-09-21T15:25:21.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0f00 [3/2936d0d6-bde0-48c6-807a-b5288242b35d] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0f00 [3/2936d0d6-bde0-48c6-807a-b5288242b35d] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0f00 [3/2936d0d6-bde0-48c6-807a-b5288242b35d] start: already running 2024-09-21T15:25:21.394 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.390+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0f00 [3/2936d0d6-bde0-48c6-807a-b5288242b35d] start: already running 2024-09-21T15:25:21.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0f00 [3/2936d0d6-bde0-48c6-807a-b5288242b35d] start: already running 2024-09-21T15:25:21.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7c52780 [3/61e40bd2-a6f8-4810-904b-d9763ddf6fd0] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7c52780 [3/61e40bd2-a6f8-4810-904b-d9763ddf6fd0] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1900 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1900 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1900 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] start: already running 2024-09-21T15:25:21.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1900 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] start: already running 2024-09-21T15:25:21.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1900 [3/3bc38427-dbd9-4b46-aec1-de91638ca6cd] start: already running 2024-09-21T15:25:21.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a74dac80 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a74dac80 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4cf00 [3/3f55813c-389e-4273-ad96-2ee904d4730d] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4cf00 [3/3f55813c-389e-4273-ad96-2ee904d4730d] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4cf00 [3/3f55813c-389e-4273-ad96-2ee904d4730d] start: already running 2024-09-21T15:25:21.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4cf00 [3/3f55813c-389e-4273-ad96-2ee904d4730d] start: already running 2024-09-21T15:25:21.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4cf00 [3/3f55813c-389e-4273-ad96-2ee904d4730d] start: already running 2024-09-21T15:25:21.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0f00 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0f00 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0f00 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] start: already running 2024-09-21T15:25:21.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0f00 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] start: already running 2024-09-21T15:25:21.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0f00 [3/36de9bdb-aa84-407c-8a36-4edec11ef7e9] start: already running 2024-09-21T15:25:21.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7913900 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7913900 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7913900 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:25:21.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7913900 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:25:21.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7913900 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:25:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7913900 [3/1aa9c1ba-00e1-4a95-ab0e-5a12698846c4] start: already running 2024-09-21T15:25:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7972280 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7972280 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972280 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:25:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972280 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:25:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972280 [3/1c70ef5e-d46a-47ae-a3f1-63ca19b272bb] start: already running 2024-09-21T15:25:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6cf00 [3/50a1f802-df95-4e98-8630-fafd576b3b77] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6cf00 [3/50a1f802-df95-4e98-8630-fafd576b3b77] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6cf00 [3/50a1f802-df95-4e98-8630-fafd576b3b77] start: already running 2024-09-21T15:25:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6cf00 [3/50a1f802-df95-4e98-8630-fafd576b3b77] start: already running 2024-09-21T15:25:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6cf00 [3/50a1f802-df95-4e98-8630-fafd576b3b77] start: already running 2024-09-21T15:25:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7973680 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7973680 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7973680 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7973680 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7973680 [3/202d909b-438b-4fae-87ea-7e1cb2c21dfe] start: already running 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0780 [3/363b13b9-82c8-4420-bc7f-68b6bbdb20b8] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0780 [3/363b13b9-82c8-4420-bc7f-68b6bbdb20b8] start: already running 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0780 [3/363b13b9-82c8-4420-bc7f-68b6bbdb20b8] start: already running 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0780 [3/363b13b9-82c8-4420-bc7f-68b6bbdb20b8] start: already running 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4cc80 [3/3e87a2ed-dc29-47ec-976a-1a33bfabf914] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4cc80 [3/3e87a2ed-dc29-47ec-976a-1a33bfabf914] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4cc80 [3/3e87a2ed-dc29-47ec-976a-1a33bfabf914] start: already running 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4cc80 [3/3e87a2ed-dc29-47ec-976a-1a33bfabf914] start: already running 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4cc80 [3/3e87a2ed-dc29-47ec-976a-1a33bfabf914] start: already running 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7c52c80 [3/637122ca-60c4-4992-9f94-ae01ebaccd0e] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7c52c80 [3/637122ca-60c4-4992-9f94-ae01ebaccd0e] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc780 [3/293432f7-5a81-4489-9831-906269d79354] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc780 [3/293432f7-5a81-4489-9831-906269d79354] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc780 [3/293432f7-5a81-4489-9831-906269d79354] start: already running 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc780 [3/293432f7-5a81-4489-9831-906269d79354] start: already running 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dc780 [3/293432f7-5a81-4489-9831-906269d79354] start: already running 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7972f00 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7972f00 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972f00 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972f00 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972f00 [3/1ecb59c1-cb93-43a1-ba73-214a0037caf9] start: already running 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912280 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912280 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912280 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912280 [3/13756a3d-e2f7-4a06-ad9d-ccc844643439] start: already running 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511900 [3/11fce1ba-4c77-4152-b67e-fce8e444ea05] start: already running 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511900 [3/11fce1ba-4c77-4152-b67e-fce8e444ea05] start: already running 2024-09-21T15:25:21.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511900 [3/11fce1ba-4c77-4152-b67e-fce8e444ea05] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511900 [3/11fce1ba-4c77-4152-b67e-fce8e444ea05] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6d680 [3/536a1fc6-237a-4cc9-9799-f875bd685121] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6d680 [3/536a1fc6-237a-4cc9-9799-f875bd685121] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6d680 [3/536a1fc6-237a-4cc9-9799-f875bd685121] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511b80 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511b80 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511b80 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511b80 [3/125852bb-d5fb-41d4-9c7c-f90dc1e40959] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6c780 [3/4d33624c-dcd8-4157-891c-5b117dfa1f81] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6c780 [3/4d33624c-dcd8-4157-891c-5b117dfa1f81] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6c780 [3/4d33624c-dcd8-4157-891c-5b117dfa1f81] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511400 [3/0fa7a298-927a-43ff-b471-c5ded7e56000] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511400 [3/0fa7a298-927a-43ff-b471-c5ded7e56000] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511400 [3/0fa7a298-927a-43ff-b471-c5ded7e56000] start: already running 2024-09-21T15:25:21.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511400 [3/0fa7a298-927a-43ff-b471-c5ded7e56000] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7973900 [3/2037df74-ba68-4814-bebc-291884a396bb] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7973900 [3/2037df74-ba68-4814-bebc-291884a396bb] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7973900 [3/2037df74-ba68-4814-bebc-291884a396bb] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972a00 [3/1db510c7-c786-462a-b73c-998b902f5c86] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972a00 [3/1db510c7-c786-462a-b73c-998b902f5c86] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972a00 [3/1db510c7-c786-462a-b73c-998b902f5c86] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972780 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972780 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972780 [3/1d81f01f-e156-426e-8eba-235d3f8c7a69] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f1680 [3/2b6dc334-3fe0-49f9-81e0-cb6bcee84c98] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f1680 [3/2b6dc334-3fe0-49f9-81e0-cb6bcee84c98] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f1680 [3/2b6dc334-3fe0-49f9-81e0-cb6bcee84c98] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4d900 [3/43a73e62-4bcf-4dbf-97f4-0fa9db2adcba] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4d900 [3/43a73e62-4bcf-4dbf-97f4-0fa9db2adcba] start: already running 2024-09-21T15:25:21.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4d900 [3/43a73e62-4bcf-4dbf-97f4-0fa9db2adcba] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1180 [3/3858bbd9-acac-4b4f-a8fb-0fd6f0dc3cb9] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1180 [3/3858bbd9-acac-4b4f-a8fb-0fd6f0dc3cb9] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.394+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1180 [3/3858bbd9-acac-4b4f-a8fb-0fd6f0dc3cb9] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510000 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510000 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510000 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510000 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a591d400 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a591d400 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a591d400 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a591d400 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511180 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511180 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511180 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:25:21.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511180 [3/0efbaa1f-200b-4402-80cf-e1832c046762] start: already running 2024-09-21T15:25:21.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7913b80 [3/1ab01511-442c-4ff5-8810-7bb04776a396] start: already running 2024-09-21T15:25:21.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7913b80 [3/1ab01511-442c-4ff5-8810-7bb04776a396] start: already running 2024-09-21T15:25:21.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.398+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7913b80 [3/1ab01511-442c-4ff5-8810-7bb04776a396] start: already running 2024-09-21T15:25:21.450 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.446+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:21.453 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.450+0000 7ff753f07700 -1 reset not still connected to 0x560171cd44e0 2024-09-21T15:25:21.453 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.450+0000 7ff753f07700 -1 reset not still connected to 0x560171f049c0 2024-09-21T15:25:21.453 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.450+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:21.453 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.450+0000 7ff753f07700 -1 reset not still connected to 0x560173e67c70 2024-09-21T15:25:21.453 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.450+0000 7ff753f07700 -1 reset not still connected to 0x560174ec75f0 2024-09-21T15:25:21.453 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.450+0000 7ff753f07700 -1 reset not still connected to 0x56017529aa90 2024-09-21T15:25:21.453 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.450+0000 7ff753f07700 -1 reset not still connected to 0x56017529ac30 2024-09-21T15:25:21.457 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.454+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1860 2024-09-21T15:25:21.457 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.454+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:21.457 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.454+0000 7ff753f07700 -1 reset not still connected to 0x56017a204820 2024-09-21T15:25:21.457 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.454+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f28f0 2024-09-21T15:25:21.457 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.454+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd2b0 2024-09-21T15:25:21.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.458+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd1400 [3/5d512263-1e55-4555-80ca-62bb3f5592fb] start: already running 2024-09-21T15:25:21.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.458+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd1400 [3/5d512263-1e55-4555-80ca-62bb3f5592fb] start: already running 2024-09-21T15:25:21.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.458+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912780 [3/17533440-f958-4ed4-a80c-8e242aef088b] start: already running 2024-09-21T15:25:21.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.458+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912780 [3/17533440-f958-4ed4-a80c-8e242aef088b] start: already running 2024-09-21T15:25:21.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.458+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912780 [3/17533440-f958-4ed4-a80c-8e242aef088b] start: already running 2024-09-21T15:25:21.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.458+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912780 [3/17533440-f958-4ed4-a80c-8e242aef088b] start: already running 2024-09-21T15:25:21.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.542+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd0280 [3/58968828-f010-4fe8-9cec-0eac08331be4] start: already running 2024-09-21T15:25:21.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:21.542+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd0280 [3/58968828-f010-4fe8-9cec-0eac08331be4] start: already running 2024-09-21T15:25:21.687 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.678+0000 7ff753f07700 -1 reset not still connected to 0x56016f162340 2024-09-21T15:25:21.687 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.678+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf2d00 2024-09-21T15:25:21.687 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.678+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:21.687 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.678+0000 7ff753f07700 -1 reset not still connected to 0x560170f65c70 2024-09-21T15:25:21.689 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.682+0000 7ff753f07700 -1 reset not still connected to 0x560171f049c0 2024-09-21T15:25:21.689 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.686+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:21.700 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.694+0000 7ff753f07700 -1 reset not still connected to 0x5601727fac30 2024-09-21T15:25:21.700 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.694+0000 7ff753f07700 -1 reset not still connected to 0x560173b169c0 2024-09-21T15:25:21.707 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.706+0000 7ff753f07700 -1 reset not still connected to 0x560173e67c70 2024-09-21T15:25:21.707 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.706+0000 7ff753f07700 -1 reset not still connected to 0x56017529ac30 2024-09-21T15:25:21.713 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.710+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1860 2024-09-21T15:25:21.713 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.710+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:21.713 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.710+0000 7ff753f07700 -1 reset not still connected to 0x56017a204820 2024-09-21T15:25:21.713 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:21.710+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd2b0 2024-09-21T15:25:22.096 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.090+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6db80 [3/55849911-b935-4c97-b400-325303585d1b] start: already running 2024-09-21T15:25:22.096 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.090+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6db80 [3/55849911-b935-4c97-b400-325303585d1b] start: already running 2024-09-21T15:25:22.096 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.090+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4c280 [3/3dc01151-5655-47e1-a307-fa2b690265ce] start: already running 2024-09-21T15:25:22.096 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.090+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4c280 [3/3dc01151-5655-47e1-a307-fa2b690265ce] start: already running 2024-09-21T15:25:22.097 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.090+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4c280 [3/3dc01151-5655-47e1-a307-fa2b690265ce] start: already running 2024-09-21T15:25:22.097 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.090+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0a00 [3/365611e2-1ad6-4f54-9c58-bf966f5928e7] start: already running 2024-09-21T15:25:22.097 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.090+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0a00 [3/365611e2-1ad6-4f54-9c58-bf966f5928e7] start: already running 2024-09-21T15:25:22.097 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.090+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0a00 [3/365611e2-1ad6-4f54-9c58-bf966f5928e7] start: already running 2024-09-21T15:25:22.098 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.098+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6d400 [3/535b2c9f-8008-4989-b65d-748a5cd23a9b] start: already running 2024-09-21T15:25:22.098 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.098+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6d400 [3/535b2c9f-8008-4989-b65d-748a5cd23a9b] start: already running 2024-09-21T15:25:22.098 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.098+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6d400 [3/535b2c9f-8008-4989-b65d-748a5cd23a9b] start: already running 2024-09-21T15:25:22.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f1180 [3/2961b7ba-9b12-4b85-bd70-b26353c4e0fb] start: already running 2024-09-21T15:25:22.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f1180 [3/2961b7ba-9b12-4b85-bd70-b26353c4e0fb] start: already running 2024-09-21T15:25:22.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f1180 [3/2961b7ba-9b12-4b85-bd70-b26353c4e0fb] start: already running 2024-09-21T15:25:22.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd0f00 [3/5d24c14f-898d-40de-9618-1f90e4165f5d] start: already running 2024-09-21T15:25:22.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4c500 [3/3dfcc7ae-1175-4f2b-8854-b9f69eeda24f] start: already running 2024-09-21T15:25:22.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4c500 [3/3dfcc7ae-1175-4f2b-8854-b9f69eeda24f] start: already running 2024-09-21T15:25:22.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4c500 [3/3dfcc7ae-1175-4f2b-8854-b9f69eeda24f] start: already running 2024-09-21T15:25:22.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dcf00 [3/2ecbd40e-3deb-400c-92b4-6c441ce7dbae] start: already running 2024-09-21T15:25:22.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dcf00 [3/2ecbd40e-3deb-400c-92b4-6c441ce7dbae] start: already running 2024-09-21T15:25:22.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dcf00 [3/2ecbd40e-3deb-400c-92b4-6c441ce7dbae] start: already running 2024-09-21T15:25:22.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dd680 [3/31e98e64-d9b2-447d-bce9-435d3d7cef3a] start: already running 2024-09-21T15:25:22.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dd680 [3/31e98e64-d9b2-447d-bce9-435d3d7cef3a] start: already running 2024-09-21T15:25:22.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dd680 [3/31e98e64-d9b2-447d-bce9-435d3d7cef3a] start: already running 2024-09-21T15:25:22.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22a00 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:25:22.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22a00 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:25:22.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22a00 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:25:22.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22a00 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:25:22.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22a00 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:25:22.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6ca00 [3/4db41bcc-01af-44fc-9cb1-aedfd7a02660] start: already running 2024-09-21T15:25:22.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6ca00 [3/4db41bcc-01af-44fc-9cb1-aedfd7a02660] start: already running 2024-09-21T15:25:22.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6ca00 [3/4db41bcc-01af-44fc-9cb1-aedfd7a02660] start: already running 2024-09-21T15:25:22.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23180 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:25:22.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23180 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:25:22.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23180 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:25:22.127 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23180 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:25:22.127 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.122+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23180 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:25:22.139 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:22.138+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:22.160 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:22.154+0000 7ff753f07700 -1 reset not still connected to 0x560174ec75f0 2024-09-21T15:25:22.170 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:22.166+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:25:22.170 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:22.166+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cf70 2024-09-21T15:25:22.171 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:22.166+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d520 2024-09-21T15:25:22.171 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:22.166+0000 7ff753f07700 -1 reset not still connected to 0x560177984820 2024-09-21T15:25:22.171 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:22.166+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:22.185 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:22.178+0000 7ff753f07700 -1 reset not still connected to 0x56017a2052b0 2024-09-21T15:25:22.185 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:22.178+0000 7ff753f07700 -1 reset not still connected to 0x56017a2055f0 2024-09-21T15:25:22.185 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:22.178+0000 7ff753f07700 -1 reset not still connected to 0x56017a2056c0 2024-09-21T15:25:22.185 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:22.178+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b20d0 2024-09-21T15:25:22.185 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:22.182+0000 7ff753f07700 -1 reset not still connected to 0x56017a8ccea0 2024-09-21T15:25:22.185 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:22.182+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cda00 2024-09-21T15:25:22.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:22.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22c80 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:25:22.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22c80 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:25:22.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22c80 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:25:22.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22c80 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:25:22.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22c80 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:25:22.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22c80 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:25:22.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23b80 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:25:22.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23b80 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:25:22.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23b80 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:25:22.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23b80 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:25:22.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23b80 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:25:22.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23b80 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:25:22.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd0500 [3/59c4deec-1cba-4460-94d5-6bed35911cea] start: already running 2024-09-21T15:25:22.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76000 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:25:22.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76000 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:25:22.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76000 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:25:22.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76000 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:25:22.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76000 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:25:22.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76000 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:25:22.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23680 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:25:22.275 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23680 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:25:22.275 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23680 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:25:22.275 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23680 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:25:22.275 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23680 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:25:22.275 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23680 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:25:22.275 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a79dd400 [3/30daac8e-2d9f-4da1-a5a1-1fa7d734a3e5] start: already running 2024-09-21T15:25:22.275 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a79dd400 [3/30daac8e-2d9f-4da1-a5a1-1fa7d734a3e5] start: already running 2024-09-21T15:25:22.275 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a79dd400 [3/30daac8e-2d9f-4da1-a5a1-1fa7d734a3e5] start: already running 2024-09-21T15:25:22.275 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.270+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd0780 [3/59c93a57-c7d1-4245-95e1-c3b4a05e2c1a] start: already running 2024-09-21T15:25:22.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.366+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fbad0 2024-09-21T15:25:22.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.370+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7a680 2024-09-21T15:25:22.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.370+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ba0 2024-09-21T15:25:22.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.370+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b91a00 2024-09-21T15:25:22.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.370+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1a00 2024-09-21T15:25:22.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.370+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3110 2024-09-21T15:25:22.383 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.374+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be627110 2024-09-21T15:25:22.384 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.378+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc535f0 2024-09-21T15:25:22.386 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.378+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920680 2024-09-21T15:25:22.388 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.378+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf110 2024-09-21T15:25:22.389 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.382+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:25:22.390 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.382+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf930 2024-09-21T15:25:22.390 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.382+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cafad0 2024-09-21T15:25:22.390 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.382+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30000 2024-09-21T15:25:22.390 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.382+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30b60 2024-09-21T15:25:22.390 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.382+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31ba0 2024-09-21T15:25:22.390 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.382+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:25:22.414 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone25': 2024-09-21T15:25:22.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:25:22.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:25:22.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:22.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4d71c139f 2024-09-21T15:25:22.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4d71c139f 2024-09-21T15:25:22.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:22.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:22.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:22.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:22.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:11:58 2024 2024-09-21T15:25:22.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:11:58 2024 2024-09-21T15:25:22.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:58 2024 2024-09-21T15:25:22.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:22.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:25:22.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:25:22.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4d71c139f 2024-09-21T15:25:22.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:22.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:22.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 276535f4-9168-47d5-a517-d2edfbcc99eb 2024-09-21T15:25:22.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:22.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.418+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1680 [3/3b97819c-ef2b-4fc6-91d4-dcc334a34235] start: already running 2024-09-21T15:25:22.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.418+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1680 [3/3b97819c-ef2b-4fc6-91d4-dcc334a34235] start: already running 2024-09-21T15:25:22.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.418+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1680 [3/3b97819c-ef2b-4fc6-91d4-dcc334a34235] start: already running 2024-09-21T15:25:22.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:22.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:22.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone26 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:22.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:22.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:22.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone26 2024-09-21T15:25:22.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:22.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:22.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:22.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:22.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.482+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7913400 [3/19512931-b55f-4107-8787-bbdcbc6a72f8] start: already running 2024-09-21T15:25:22.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.482+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7913400 [3/19512931-b55f-4107-8787-bbdcbc6a72f8] start: already running 2024-09-21T15:25:22.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.482+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7913400 [3/19512931-b55f-4107-8787-bbdcbc6a72f8] start: already running 2024-09-21T15:25:22.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.482+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7913400 [3/19512931-b55f-4107-8787-bbdcbc6a72f8] start: already running 2024-09-21T15:25:22.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.482+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:22.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.482+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:22.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:25:22.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77900 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77900 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77900 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77900 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7c7aa00 [3/72133ade-d434-4fb0-892a-d55cec4945c3] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7c7aa00 [3/72133ade-d434-4fb0-892a-d55cec4945c3] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:25:22.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:25:22.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:25:22.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:25:22.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:25:22.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.486+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76280 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:25:22.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77680 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:25:22.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77680 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:25:22.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6c500 [3/4bd5f744-bf83-4824-98f0-d27d9f1c8197] start: already running 2024-09-21T15:25:22.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6c500 [3/4bd5f744-bf83-4824-98f0-d27d9f1c8197] start: already running 2024-09-21T15:25:22.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6c500 [3/4bd5f744-bf83-4824-98f0-d27d9f1c8197] start: already running 2024-09-21T15:25:22.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8780 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:25:22.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8780 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:25:22.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76a00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:25:22.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76a00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:25:22.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76a00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:25:22.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76a00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:25:22.547 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76a00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:25:22.547 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76a00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:25:22.547 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76a00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:25:22.547 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.542+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76a00 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:25:22.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23400 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:25:22.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23400 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:25:22.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23400 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:25:22.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23400 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:25:22.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23400 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:25:22.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23400 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:25:22.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23400 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:25:22.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23400 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:25:22.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9400 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:25:22.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302780 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:25:22.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302780 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:25:22.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302780 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:25:22.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302780 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:25:22.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.726+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302780 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:25:22.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.782+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0780 [3/27b12a21-b493-4095-b7d3-cfe660cb3dbd] start: already running 2024-09-21T15:25:22.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.782+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0780 [3/27b12a21-b493-4095-b7d3-cfe660cb3dbd] start: already running 2024-09-21T15:25:22.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.782+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0780 [3/27b12a21-b493-4095-b7d3-cfe660cb3dbd] start: already running 2024-09-21T15:25:22.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.782+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7913680 [3/195f6116-53dd-4f4c-9885-eb0d620dc00c] start: already running 2024-09-21T15:25:22.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.782+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7913680 [3/195f6116-53dd-4f4c-9885-eb0d620dc00c] start: already running 2024-09-21T15:25:22.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.782+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7913680 [3/195f6116-53dd-4f4c-9885-eb0d620dc00c] start: already running 2024-09-21T15:25:22.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.782+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7913680 [3/195f6116-53dd-4f4c-9885-eb0d620dc00c] start: already running 2024-09-21T15:25:22.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.782+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa315400 [3/f033ad39-c053-43aa-829a-9160c2473e5a] start: already running 2024-09-21T15:25:22.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.782+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8f00 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:25:22.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.782+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8f00 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:25:22.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.782+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8f00 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:25:22.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.782+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8f00 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:25:22.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.782+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8f00 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:25:22.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.934+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3ab180 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:25:22.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.934+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3ab180 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:25:22.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.934+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3ab180 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:25:22.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9900 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:25:22.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9900 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:25:22.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9900 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:25:22.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9900 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:25:22.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9900 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:25:22.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9900 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:25:22.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9900 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:25:22.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302280 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:25:22.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302280 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:25:22.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302280 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:25:22.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302280 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:25:22.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302280 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:25:22.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aac80 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:25:22.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aac80 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:25:22.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aac80 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:25:22.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba000 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:25:22.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba000 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:25:22.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba000 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:25:22.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba000 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:25:22.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba000 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:25:22.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba000 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:25:22.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba000 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:25:22.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa314500 [3/e6c1e46d-943e-48ab-b899-f1d65ff8944a] start: already running 2024-09-21T15:25:22.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8c80 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:25:22.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8c80 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:25:22.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8c80 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:25:22.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8c80 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:25:22.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8c80 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:25:22.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa314a00 [3/ee5e1490-4a11-4636-ab8f-ee0651bb84e7] start: already running 2024-09-21T15:25:22.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba500 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:25:22.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba500 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:25:22.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba500 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:25:22.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba500 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:25:22.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba500 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:25:22.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba500 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:25:22.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba500 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:25:22.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302f00 [3/e11bf669-24bd-415f-9833-0c4630550c23] start: already running 2024-09-21T15:25:22.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.938+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302f00 [3/e11bf669-24bd-415f-9833-0c4630550c23] start: already running 2024-09-21T15:25:22.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.942+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa303b80 [3/e513238f-c4c4-4cbc-8a2f-c21215922f5f] start: already running 2024-09-21T15:25:22.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.942+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aa780 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:25:22.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.942+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aa780 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:25:22.946 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.942+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aa780 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:25:22.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.946+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb400 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:25:22.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.946+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb400 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:25:22.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.946+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb400 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:25:22.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.946+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb400 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:25:22.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.946+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb400 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:25:22.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:22.946+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb400 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:25:22.967 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.958+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0c750 2024-09-21T15:25:22.967 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.958+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aefba0 2024-09-21T15:25:22.967 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.962+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1a00 2024-09-21T15:25:22.985 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3110 2024-09-21T15:25:22.986 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b4d00 2024-09-21T15:25:22.986 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b4ea0 2024-09-21T15:25:22.993 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.986+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:25:22.993 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.986+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd52c30 2024-09-21T15:25:22.995 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.986+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e750 2024-09-21T15:25:22.995 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.986+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5fba0 2024-09-21T15:25:22.995 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.986+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6264e0 2024-09-21T15:25:22.995 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.986+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6265b0 2024-09-21T15:25:22.995 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.986+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be627110 2024-09-21T15:25:22.995 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.986+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a340 2024-09-21T15:25:22.997 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.994+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bee0 2024-09-21T15:25:22.997 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.994+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52d00 2024-09-21T15:25:22.998 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.994+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008680 2024-09-21T15:25:22.998 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.994+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c09209c0 2024-09-21T15:25:22.998 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.994+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caed00 2024-09-21T15:25:22.998 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.994+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf930 2024-09-21T15:25:22.998 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.994+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cafad0 2024-09-21T15:25:22.998 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.994+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:25:22.998 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.994+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e315f0 2024-09-21T15:25:22.998 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:22.994+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7380 2024-09-21T15:25:23.143 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aaf00 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:25:23.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aaf00 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:25:23.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aaf00 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:25:23.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9180 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:25:23.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9180 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:25:23.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9180 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:25:23.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9180 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:25:23.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9180 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:25:23.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa302a00 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:25:23.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa302a00 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:25:23.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa302a00 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:25:23.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa302a00 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:25:23.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa302a00 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:25:23.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba780 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba780 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba780 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba780 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba780 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba780 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a93ba780 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb900 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb900 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb900 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb900 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb900 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aa500 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aa500 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aa500 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8000 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:25:23.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8000 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8000 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8000 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8000 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa303680 [3/e4a35a0f-eabb-4389-9239-82ff9a0828e6] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa314f00 [3/eee89f94-874b-48ea-bcd4-804b53f039c0] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa314280 [3/e6696bd8-9005-4eeb-8e44-c70647860921] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4c780 [3/3e3bdb4c-3bdb-49bc-8680-3d524894c052] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4c780 [3/3e3bdb4c-3bdb-49bc-8680-3d524894c052] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4c780 [3/3e3bdb4c-3bdb-49bc-8680-3d524894c052] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0500 [3/347ff7bb-17b6-437e-9043-ee0191f8394d] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0500 [3/347ff7bb-17b6-437e-9043-ee0191f8394d] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0500 [3/347ff7bb-17b6-437e-9043-ee0191f8394d] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a591cc80 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a591cc80 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:25:23.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a591cc80 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:25:23.147 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a591cc80 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:25:23.147 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a591cc80 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:25:23.147 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.138+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa315900 [3/f5f9a344-230e-4e5b-b1a4-3e4b4fc4cc86] start: already running 2024-09-21T15:25:23.182 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.166+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e48f0 2024-09-21T15:25:23.184 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.170+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f5110 2024-09-21T15:25:23.185 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.170+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a680 2024-09-21T15:25:23.185 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.170+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77c70 2024-09-21T15:25:23.185 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.170+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a270 2024-09-21T15:25:23.185 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.170+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013110 2024-09-21T15:25:23.185 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.170+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821a4e0 2024-09-21T15:25:23.185 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.170+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821a9c0 2024-09-21T15:25:23.185 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.170+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821b790 2024-09-21T15:25:23.186 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.178+0000 7f52f1ba9700 -1 reset not still connected to 0x557148f53ee0 2024-09-21T15:25:23.186 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.178+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a1a0 2024-09-21T15:25:23.187 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.178+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a8f0 2024-09-21T15:25:23.187 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.178+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29aea0 2024-09-21T15:25:23.187 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.178+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf0d00 2024-09-21T15:25:23.187 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.178+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb35f0 2024-09-21T15:25:23.187 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.178+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3ee0 2024-09-21T15:25:23.187 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.178+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07e9c0 2024-09-21T15:25:23.187 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.182+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07eea0 2024-09-21T15:25:23.188 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.186+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07ef70 2024-09-21T15:25:23.188 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.186+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07fa00 2024-09-21T15:25:23.190 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:23.190+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb12a90 2024-09-21T15:25:23.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:23.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a591d180 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:25:23.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a591d180 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:25:23.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a591db80 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:25:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510f00 [3/0edcfa49-d8f9-4e7d-966d-6871597811e6] start: already running 2024-09-21T15:25:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7511680 [3/107eff09-cb63-4786-8ede-67a702996f4d] start: already running 2024-09-21T15:25:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd1180 [3/5d444500-7ead-4909-a696-94bdbd9f7e8c] start: already running 2024-09-21T15:25:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd1180 [3/5d444500-7ead-4909-a696-94bdbd9f7e8c] start: already running 2024-09-21T15:25:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76f00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:25:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76f00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:25:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76f00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:25:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76f00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:25:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76f00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:25:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76f00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:25:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76f00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:25:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76f00 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:25:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4d680 [3/43028d32-4202-4ac6-b083-241946f596da] start: already running 2024-09-21T15:25:23.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4d680 [3/43028d32-4202-4ac6-b083-241946f596da] start: already running 2024-09-21T15:25:23.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4d680 [3/43028d32-4202-4ac6-b083-241946f596da] start: already running 2024-09-21T15:25:23.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6c280 [3/4b9face3-5cac-4c8c-ab5f-f75cbc0915bc] start: already running 2024-09-21T15:25:23.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6c280 [3/4b9face3-5cac-4c8c-ab5f-f75cbc0915bc] start: already running 2024-09-21T15:25:23.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6c280 [3/4b9face3-5cac-4c8c-ab5f-f75cbc0915bc] start: already running 2024-09-21T15:25:23.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0a00 [3/284dc960-2660-419d-b060-d0e1013bae61] start: already running 2024-09-21T15:25:23.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0a00 [3/284dc960-2660-419d-b060-d0e1013bae61] start: already running 2024-09-21T15:25:23.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.446+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79f0a00 [3/284dc960-2660-419d-b060-d0e1013bae61] start: already running 2024-09-21T15:25:23.569 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.566+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510500 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:25:23.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.566+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a591ca00 [3/0111f35b-69c8-4614-8b36-510c97864eec] start: already running 2024-09-21T15:25:23.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.566+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a591ca00 [3/0111f35b-69c8-4614-8b36-510c97864eec] start: already running 2024-09-21T15:25:23.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.566+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22f00 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:25:23.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.566+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22f00 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:25:23.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.566+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22f00 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:25:23.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.566+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22f00 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:25:23.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.566+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22f00 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:25:23.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.566+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22f00 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:25:23.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.566+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22f00 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:25:23.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.566+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22f00 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:25:23.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.566+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22f00 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:25:23.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.614+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa302c80 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:25:23.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.614+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa302c80 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:25:23.615 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.614+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa302c80 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:25:23.615 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.614+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa302c80 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:25:23.619 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.618+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8280 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:25:23.619 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.618+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8280 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:25:23.622 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:23.609+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:25:23.622 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:23.609+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f509c0 2024-09-21T15:25:23.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.626+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93baa00 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:25:23.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.626+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93baa00 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:25:23.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.626+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93baa00 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:25:23.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.626+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93baa00 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:25:23.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.630+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93baa00 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:25:23.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.630+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93baa00 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:25:23.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.630+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93baa00 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:25:23.631 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:23.621+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde276c0 2024-09-21T15:25:23.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.630+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bbb80 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:25:23.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.630+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bbb80 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:25:23.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.630+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bbb80 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:25:23.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.630+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bbb80 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:25:23.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.630+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bbb80 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:25:23.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.630+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa303900 [3/e4d1114b-ada5-4ff8-999f-0119c103708f] start: already running 2024-09-21T15:25:23.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone26': 2024-09-21T15:25:23.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:25:23.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:25:23.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:23.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4c6abcf97 2024-09-21T15:25:23.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4c6abcf97 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4c6abcf97 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:23.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: ace09410-303f-4cc6-8fa7-c5190a4c62e6 2024-09-21T15:25:23.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:23.649 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:23.649 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:23.649 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone27 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:23.649 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:23.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:23.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone27 2024-09-21T15:25:23.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:23.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:23.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:23.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:23.708 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.706+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa315180 [3/ef79be89-94fa-4d0c-a9a8-2fd05127bdc5] start: already running 2024-09-21T15:25:23.805 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.802+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa314780 [3/ed8f9c7d-1492-4fbd-ae77-4c3bfa2f3787] start: already running 2024-09-21T15:25:23.806 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.802+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7c7b680 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:23.806 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.802+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7c7b680 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:23.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.838+0000 7fde11ef9700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561b16cc700 get_replay_status: replay not running 2024-09-21T15:25:23.850 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.846+0000 7fde11ef9700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561a7b36000 get_replay_status: replay not running 2024-09-21T15:25:23.851 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.850+0000 7fde11ef9700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561a8f6ae00 get_replay_status: replay not running 2024-09-21T15:25:23.901 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:23.889+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc26ecc410 2024-09-21T15:25:23.901 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:23.889+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2750 2024-09-21T15:25:23.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.926+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7510a00 [3/0e38c267-ca71-47c8-85c5-6e571f45254e] start: already running 2024-09-21T15:25:23.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.930+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76500 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:25:23.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.930+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76500 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:25:23.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.930+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76500 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:25:23.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.930+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76500 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:25:23.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.930+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76500 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:25:23.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.930+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76500 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:25:23.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.930+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76500 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:25:23.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.930+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76500 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:25:23.932 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.930+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd0a00 [3/5a2bda13-d29d-4620-a6e7-180dd2cee0a8] start: already running 2024-09-21T15:25:23.932 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:23.930+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd0a00 [3/5a2bda13-d29d-4620-a6e7-180dd2cee0a8] start: already running 2024-09-21T15:25:23.942 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:23.933+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc217125b0 2024-09-21T15:25:23.942 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:23.933+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc22b7a8f0 2024-09-21T15:25:23.944 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:23.937+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc22b7b110 2024-09-21T15:25:23.945 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:23.937+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363ad00 2024-09-21T15:25:23.949 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:23.941+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0d2b0 2024-09-21T15:25:23.949 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:23.941+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb450 2024-09-21T15:25:23.949 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:23.941+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc26ecc410 2024-09-21T15:25:23.949 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:23.941+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2750 2024-09-21T15:25:23.953 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:23.945+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e3450 2024-09-21T15:25:24.118 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:24.090+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7a680 2024-09-21T15:25:24.119 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:24.090+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3110 2024-09-21T15:25:24.119 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:24.090+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5fba0 2024-09-21T15:25:24.164 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.162+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a29c0 2024-09-21T15:25:24.178 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.174+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:25:24.210 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.190+0000 7ff753f07700 -1 reset not still connected to 0x56016fe911e0 2024-09-21T15:25:24.210 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.190+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:24.217 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.206+0000 7ff753f07700 -1 reset not still connected to 0x5601709b95f0 2024-09-21T15:25:24.217 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.206+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:25:24.217 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.206+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:24.217 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.206+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:25:24.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:25:24.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x5601727fb930 2024-09-21T15:25:24.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x560173d87040 2024-09-21T15:25:24.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x560174554340 2024-09-21T15:25:24.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x56017529a4e0 2024-09-21T15:25:24.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d2b0 2024-09-21T15:25:24.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d380 2024-09-21T15:25:24.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d450 2024-09-21T15:25:24.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d860 2024-09-21T15:25:24.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1450 2024-09-21T15:25:24.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1860 2024-09-21T15:25:24.221 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x560177272ea0 2024-09-21T15:25:24.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x560177273520 2024-09-21T15:25:24.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccd00 2024-09-21T15:25:24.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccdd0 2024-09-21T15:25:24.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x560177984ea0 2024-09-21T15:25:24.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x560178048c30 2024-09-21T15:25:24.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x560178049520 2024-09-21T15:25:24.223 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:24.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x56017a16f6c0 2024-09-21T15:25:24.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x56017a204820 2024-09-21T15:25:24.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x56017a204dd0 2024-09-21T15:25:24.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x56017a205040 2024-09-21T15:25:24.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:25:24.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2ea0 2024-09-21T15:25:24.224 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.218+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd2b0 2024-09-21T15:25:24.245 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.238+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ad1fa00 2024-09-21T15:25:24.264 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c1548f0 2024-09-21T15:25:24.264 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cf7d110 2024-09-21T15:25:24.264 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x55713cfa6680 2024-09-21T15:25:24.264 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da80820 2024-09-21T15:25:24.264 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81ba0 2024-09-21T15:25:24.264 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cde10 2024-09-21T15:25:24.264 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e48f0 2024-09-21T15:25:24.264 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034d5f0 2024-09-21T15:25:24.264 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f5110 2024-09-21T15:25:24.265 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17d40 2024-09-21T15:25:24.265 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb1e0 2024-09-21T15:25:24.265 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76a90 2024-09-21T15:25:24.265 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77c70 2024-09-21T15:25:24.265 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a270 2024-09-21T15:25:24.265 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417b1e0 2024-09-21T15:25:24.265 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.258+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af68f0 2024-09-21T15:25:24.265 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af7790 2024-09-21T15:25:24.266 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765d40 2024-09-21T15:25:24.266 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821a9c0 2024-09-21T15:25:24.266 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x557148f52680 2024-09-21T15:25:24.266 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x557148f529c0 2024-09-21T15:25:24.266 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a1a0 2024-09-21T15:25:24.266 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a8f0 2024-09-21T15:25:24.266 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29b860 2024-09-21T15:25:24.266 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf0d00 2024-09-21T15:25:24.266 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb2a90 2024-09-21T15:25:24.266 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3ee0 2024-09-21T15:25:24.266 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74f70 2024-09-21T15:25:24.267 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07e9c0 2024-09-21T15:25:24.267 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07eea0 2024-09-21T15:25:24.267 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07ef70 2024-09-21T15:25:24.267 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f930 2024-09-21T15:25:24.267 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1252b0 2024-09-21T15:25:24.267 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ff1e0 2024-09-21T15:25:24.267 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ffc70 2024-09-21T15:25:24.267 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.262+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb129c0 2024-09-21T15:25:24.277 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.274+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13ad0 2024-09-21T15:25:24.277 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:25:24.274+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13ba0 2024-09-21T15:25:24.401 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.398+0000 7ff753f07700 -1 reset not still connected to 0x56016f1b7110 2024-09-21T15:25:24.429 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.422+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:25:24.432 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:25:24.432 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:25:24.432 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99860 2024-09-21T15:25:24.432 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd8c30 2024-09-21T15:25:24.432 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x56016fe90c30 2024-09-21T15:25:24.433 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x56016fe911e0 2024-09-21T15:25:24.433 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:24.433 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x5601709b95f0 2024-09-21T15:25:24.434 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:25:24.434 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x560171cd44e0 2024-09-21T15:25:24.434 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:24.435 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x56017219e5b0 2024-09-21T15:25:24.435 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:25:24.435 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x5601727fb930 2024-09-21T15:25:24.435 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x560173d87040 2024-09-21T15:25:24.435 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x560174554340 2024-09-21T15:25:24.435 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x56017529a4e0 2024-09-21T15:25:24.435 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0c30 2024-09-21T15:25:24.435 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d2b0 2024-09-21T15:25:24.435 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d380 2024-09-21T15:25:24.435 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d450 2024-09-21T15:25:24.435 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d860 2024-09-21T15:25:24.435 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1450 2024-09-21T15:25:24.435 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1860 2024-09-21T15:25:24.436 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x560177272ea0 2024-09-21T15:25:24.436 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x560177273520 2024-09-21T15:25:24.436 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.430+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccd00 2024-09-21T15:25:24.436 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.434+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccdd0 2024-09-21T15:25:24.437 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.434+0000 7ff753f07700 -1 reset not still connected to 0x560177984ea0 2024-09-21T15:25:24.437 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.434+0000 7ff753f07700 -1 reset not still connected to 0x560178048c30 2024-09-21T15:25:24.437 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.434+0000 7ff753f07700 -1 reset not still connected to 0x560178049520 2024-09-21T15:25:24.437 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.434+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:24.439 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.438+0000 7ff753f07700 -1 reset not still connected to 0x560178191e10 2024-09-21T15:25:24.439 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.438+0000 7ff753f07700 -1 reset not still connected to 0x56017a16f6c0 2024-09-21T15:25:24.439 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.438+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fc70 2024-09-21T15:25:24.439 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.438+0000 7ff753f07700 -1 reset not still connected to 0x56017a204820 2024-09-21T15:25:24.440 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.438+0000 7ff753f07700 -1 reset not still connected to 0x56017a204dd0 2024-09-21T15:25:24.440 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.438+0000 7ff753f07700 -1 reset not still connected to 0x56017a205040 2024-09-21T15:25:24.440 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.438+0000 7ff753f07700 -1 reset not still connected to 0x56017a205ad0 2024-09-21T15:25:24.440 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.438+0000 7ff753f07700 -1 reset not still connected to 0x56017a205d40 2024-09-21T15:25:24.440 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.438+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2ea0 2024-09-21T15:25:24.441 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.438+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:25:24.441 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.438+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2ea0 2024-09-21T15:25:24.441 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.438+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd2b0 2024-09-21T15:25:24.618 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:24.618+0000 7fde126fa700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561b42ac000 get_replay_status: replay not running 2024-09-21T15:25:24.635 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:24.634+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4d400 [3/4026d3a9-81ff-4074-aa36-3ae99da1306d] start: already running 2024-09-21T15:25:24.636 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:24.634+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4d400 [3/4026d3a9-81ff-4074-aa36-3ae99da1306d] start: already running 2024-09-21T15:25:24.636 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:24.634+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4d400 [3/4026d3a9-81ff-4074-aa36-3ae99da1306d] start: already running 2024-09-21T15:25:24.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:24.759 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.754+0000 7ff753f07700 -1 reset not still connected to 0x56016fe911e0 2024-09-21T15:25:24.759 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.754+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:24.759 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.754+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d450 2024-09-21T15:25:24.759 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:24.754+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccd00 2024-09-21T15:25:25.047 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.042+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af9c0340 2024-09-21T15:25:25.048 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.042+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddc70 2024-09-21T15:25:25.048 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.042+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:25:25.048 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.046+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b28585b0 2024-09-21T15:25:25.049 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.046+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50f70 2024-09-21T15:25:25.049 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.046+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686270 2024-09-21T15:25:25.051 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.046+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:25:25.070 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.062+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:25:25.072 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.066+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:25:25.072 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.066+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8eea0 2024-09-21T15:25:25.072 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.066+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:25:25.072 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.066+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eab60 2024-09-21T15:25:25.073 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.066+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eaf70 2024-09-21T15:25:25.075 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.070+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0c8f0 2024-09-21T15:25:25.075 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.070+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7a680 2024-09-21T15:25:25.075 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.070+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7ac30 2024-09-21T15:25:25.075 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.070+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d96c0 2024-09-21T15:25:25.075 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.070+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ba0 2024-09-21T15:25:25.075 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.070+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:25:25.075 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.070+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783930 2024-09-21T15:25:25.080 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:25:25.080 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9380 2024-09-21T15:25:25.080 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47e10 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aee340 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aefad0 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387ee0 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83ccea0 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc4e0 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc8f0 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0d00 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c12b0 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1a00 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1d40 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5790 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3110 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:25:25.081 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b4340 2024-09-21T15:25:25.082 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26cc30 2024-09-21T15:25:25.082 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:25:25.082 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e1a0 2024-09-21T15:25:25.082 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e340 2024-09-21T15:25:25.082 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e750 2024-09-21T15:25:25.082 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5fba0 2024-09-21T15:25:25.082 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6260d0 2024-09-21T15:25:25.082 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6272b0 2024-09-21T15:25:25.082 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.074+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91ad00 2024-09-21T15:25:25.082 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.078+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52340 2024-09-21T15:25:25.082 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.078+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52410 2024-09-21T15:25:25.084 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.082+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52680 2024-09-21T15:25:25.084 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.082+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:25:25.084 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.082+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52d00 2024-09-21T15:25:25.084 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.082+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008680 2024-09-21T15:25:25.084 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.082+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:25:25.085 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.082+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caed00 2024-09-21T15:25:25.086 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.082+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf110 2024-09-21T15:25:25.086 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.082+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:25:25.086 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.082+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31110 2024-09-21T15:25:25.086 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.082+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31520 2024-09-21T15:25:25.086 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:25.082+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693790 2024-09-21T15:25:25.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.110+0000 7fde126fa700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561b524ca80 get_replay_status: replay not running 2024-09-21T15:25:25.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone27': 2024-09-21T15:25:25.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 1.8 MiB in 5 objects 2024-09-21T15:25:25.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:25:25.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:25.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4251c5f98 2024-09-21T15:25:25.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4251c5f98 2024-09-21T15:25:25.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:25.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:25.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:25.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:25.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:25:25.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:25:25.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:25:25.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:25.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone26@snap 2024-09-21T15:25:25.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 1.8 MiB 2024-09-21T15:25:25.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:25:25.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:25:25.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4251c5f98 2024-09-21T15:25:25.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:25.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:25.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 1e99ad07-beb0-48a8-b81e-3cc939897a52 2024-09-21T15:25:25.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:25.351 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.350+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa314c80 [3/ee8573b9-7a14-470f-b519-004503b68b59] start: already running 2024-09-21T15:25:25.353 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.350+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6d180 [3/533f49cb-9e85-487d-a73d-6b891eb8fdc6] start: already running 2024-09-21T15:25:25.353 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.350+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6d180 [3/533f49cb-9e85-487d-a73d-6b891eb8fdc6] start: already running 2024-09-21T15:25:25.353 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.350+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b6d180 [3/533f49cb-9e85-487d-a73d-6b891eb8fdc6] start: already running 2024-09-21T15:25:25.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:25.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:25.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone28 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:25.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:25.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:25.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone28 2024-09-21T15:25:25.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:25.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:25.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:25.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:25.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972500 [3/1d800fca-0dcf-4dff-bf70-934acbfb5464] start: already running 2024-09-21T15:25:25.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972500 [3/1d800fca-0dcf-4dff-bf70-934acbfb5464] start: already running 2024-09-21T15:25:25.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7972500 [3/1d800fca-0dcf-4dff-bf70-934acbfb5464] start: already running 2024-09-21T15:25:25.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa315680 [3/f2dae9ca-5e22-44e6-90a3-2cbebe5fa594] start: already running 2024-09-21T15:25:25.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa314000 [3/e51aede5-de84-423f-9449-2f9e9884385e] start: already running 2024-09-21T15:25:25.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9680 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:25:25.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9680 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:25:25.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9680 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:25:25.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9680 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:25:25.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9680 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:25:25.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9680 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:25:25.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9680 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:25:25.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dca00 [3/2df7d008-2aa8-45c9-992d-6135bdf46eec] start: already running 2024-09-21T15:25:25.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dca00 [3/2df7d008-2aa8-45c9-992d-6135bdf46eec] start: already running 2024-09-21T15:25:25.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.354+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a79dca00 [3/2df7d008-2aa8-45c9-992d-6135bdf46eec] start: already running 2024-09-21T15:25:25.590 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.590+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93baf00 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:25:25.590 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.590+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93baf00 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:25:25.591 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.590+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93baf00 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:25:25.591 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.590+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93baf00 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:25:25.591 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.590+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93baf00 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:25:25.591 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.590+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93baf00 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:25:25.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23180 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:25:25.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23180 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:25:25.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23180 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:25:25.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22780 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:25:25.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22c80 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:25:25.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22c80 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:25:25.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22a00 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:25:25.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22a00 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:25:25.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f22a00 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:25:25.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76000 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:25:25.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23b80 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:25:25.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23b80 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:25:25.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23680 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:25:25.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.646+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23680 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:25:25.671 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.670+0000 7fde11ef9700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561b524d880 get_replay_status: replay not running 2024-09-21T15:25:25.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.722+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9b80 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:25:25.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.722+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9b80 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:25:25.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.722+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9b80 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:25:25.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.722+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9b80 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:25:25.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.722+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9b80 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:25:25.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.722+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9b80 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:25:25.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.722+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a81d9b80 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:25:25.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.722+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb180 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:25:25.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.722+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb180 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:25:25.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.722+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb180 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:25:25.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.722+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb180 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:25:25.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.722+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb180 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:25:25.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.722+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb180 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:25:25.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.742+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aa280 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:25:25.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.742+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aa280 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:25:25.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.742+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aa280 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:25:25.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.742+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302500 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:25:25.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.742+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302500 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:25:25.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.742+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302500 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:25:25.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.742+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302500 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:25:25.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.742+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa302500 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:25:25.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.834+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76c80 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:25:25.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.834+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76c80 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:25:25.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.838+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76c80 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:25:25.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.838+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76c80 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:25:25.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.838+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76c80 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:25:25.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.838+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76c80 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:25:25.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.838+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76c80 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:25:25.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.838+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76c80 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:25:25.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.838+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa302000 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:25:25.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.838+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa302000 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:25:25.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.838+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa302000 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:25:25.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.838+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa302000 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:25:25.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.838+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561aa302000 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:25:25.876 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1b80 [3/3c2f36af-e877-40dc-8246-6729625140b2] start: already running 2024-09-21T15:25:25.876 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1b80 [3/3c2f36af-e877-40dc-8246-6729625140b2] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa1b80 [3/3c2f36af-e877-40dc-8246-6729625140b2] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a79dd180 [3/30273c29-bc9f-490c-9701-443a18e6e419] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a79dd180 [3/30273c29-bc9f-490c-9701-443a18e6e419] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a79dd180 [3/30273c29-bc9f-490c-9701-443a18e6e419] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7972c80 [3/1e99ad07-beb0-48a8-b81e-3cc939897a52] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7972c80 [3/1e99ad07-beb0-48a8-b81e-3cc939897a52] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7972c80 [3/1e99ad07-beb0-48a8-b81e-3cc939897a52] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76780 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76780 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76780 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76780 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76780 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76780 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76780 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:25:25.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.874+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7f76780 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:25:25.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.954+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bac80 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:25:25.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.954+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bac80 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:25:25.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.954+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bac80 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:25:25.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.954+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bac80 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:25:25.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.954+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bac80 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:25:25.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.954+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bac80 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:25:25.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.954+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bac80 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:25:25.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.954+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa303400 [3/e33347f9-479f-4080-b33f-92c69acaa835] start: already running 2024-09-21T15:25:25.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.954+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0000 [3/33006863-7504-40fd-b7bf-bdaf3c7c6daa] start: already running 2024-09-21T15:25:25.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.954+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0000 [3/33006863-7504-40fd-b7bf-bdaf3c7c6daa] start: already running 2024-09-21T15:25:25.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:25.954+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0000 [3/33006863-7504-40fd-b7bf-bdaf3c7c6daa] start: already running 2024-09-21T15:25:26.369 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:26.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:26.402+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a79ddb80 [3/266a11c0-43fd-491b-83b0-d9425e9362e1] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:26.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:26.402+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a79ddb80 [3/266a11c0-43fd-491b-83b0-d9425e9362e1] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:26.412 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:26.410+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a79ddb80 [3/266a11c0-43fd-491b-83b0-d9425e9362e1] start: already running 2024-09-21T15:25:26.412 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:26.410+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a79ddb80 [3/266a11c0-43fd-491b-83b0-d9425e9362e1] start: already running 2024-09-21T15:25:26.412 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:26.410+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a79ddb80 [3/266a11c0-43fd-491b-83b0-d9425e9362e1] start: already running 2024-09-21T15:25:26.589 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:26.586+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a591cf00 [3/02c68625-9e68-49b7-9164-c8fd75eb654b] start: already running 2024-09-21T15:25:26.589 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:26.586+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a591cf00 [3/02c68625-9e68-49b7-9164-c8fd75eb654b] start: already running 2024-09-21T15:25:26.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:26.590+0000 7fde126fa700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561ad847500 get_replay_status: replay not running 2024-09-21T15:25:26.685 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:26.678+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:25:26.690 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:26.678+0000 7ff753f07700 -1 reset not still connected to 0x5601727fb930 2024-09-21T15:25:26.694 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:26.694+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d2b0 2024-09-21T15:25:26.722 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:26.714+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d450 2024-09-21T15:25:26.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:26.714+0000 7ff753f07700 -1 reset not still connected to 0x560177272ea0 2024-09-21T15:25:26.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:26.714+0000 7ff753f07700 -1 reset not still connected to 0x560177273520 2024-09-21T15:25:26.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:26.714+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccd00 2024-09-21T15:25:26.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:26.714+0000 7ff753f07700 -1 reset not still connected to 0x560178048c30 2024-09-21T15:25:26.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:26.714+0000 7ff753f07700 -1 reset not still connected to 0x56017a205040 2024-09-21T15:25:26.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:26.714+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:25:26.725 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:26.714+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd2b0 2024-09-21T15:25:26.792 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:26.790+0000 7fde11ef9700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561ad847c00 get_replay_status: replay not running 2024-09-21T15:25:26.807 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:26.806+0000 7fde11ef9700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561b562e000 get_replay_status: replay not running 2024-09-21T15:25:26.911 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.901+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7ee0 2024-09-21T15:25:26.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.905+0000 7f1e9c77a700 -1 reset not still connected to 0x5628956dbe10 2024-09-21T15:25:26.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.905+0000 7f1e9c77a700 -1 reset not still connected to 0x562895933ba0 2024-09-21T15:25:26.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:26.922+0000 7fde11ef9700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561b562ea80 get_replay_status: replay not running 2024-09-21T15:25:26.925 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.917+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9cc30 2024-09-21T15:25:26.926 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.917+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:25:26.926 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.917+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a92b0 2024-09-21T15:25:26.933 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.925+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a9c70 2024-09-21T15:25:26.933 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.925+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288410 2024-09-21T15:25:26.933 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.925+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2891e0 2024-09-21T15:25:26.933 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.925+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:25:26.944 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289d40 2024-09-21T15:25:26.947 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.941+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad1d4a90 2024-09-21T15:25:26.947 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.941+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:25:26.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone28': 2024-09-21T15:25:26.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 109 MiB in 56 objects 2024-09-21T15:25:26.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:25:26.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:26.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c466c89cfd 2024-09-21T15:25:26.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c466c89cfd 2024-09-21T15:25:26.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:26.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:26.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:26.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:26.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:14:59 2024 2024-09-21T15:25:26.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:14:59 2024 2024-09-21T15:25:26.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:14:59 2024 2024-09-21T15:25:26.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:26.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone27@snap 2024-09-21T15:25:26.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 109 MiB 2024-09-21T15:25:26.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:25:26.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 4 2024-09-21T15:25:26.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c466c89cfd 2024-09-21T15:25:26.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:26.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:26.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 8b3fb276-65d9-4307-be3d-8481e9d99405 2024-09-21T15:25:26.959 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:26.964 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.953+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00d00 2024-09-21T15:25:26.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:26.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:26.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone29 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:26.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:26.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:26.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone29 2024-09-21T15:25:26.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:26.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:26.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:26.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:26.973 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.965+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:25:26.974 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.965+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68c30 2024-09-21T15:25:26.974 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.965+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:25:26.982 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.973+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe40820 2024-09-21T15:25:26.996 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.985+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a270 2024-09-21T15:25:26.996 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.985+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b790 2024-09-21T15:25:26.996 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.985+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9860 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.985+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b00e7ee0 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.985+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f2000 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f29c0 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f3c70 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2340 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d28f0 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d32b0 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0d00 2024-09-21T15:25:26.997 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541ad0 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676340 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676b60 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677450 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677520 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528340 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45284e0 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b455ac30 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2000 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b20d0 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3380 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3930 2024-09-21T15:25:26.998 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd61a0 2024-09-21T15:25:26.999 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7380 2024-09-21T15:25:26.999 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7450 2024-09-21T15:25:26.999 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:26.989+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7520 2024-09-21T15:25:27.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.070+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa303180 [3/e2c7112f-7834-4998-b6f4-09f9fd94ae24] start: already running 2024-09-21T15:25:27.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.070+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:25:27.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.070+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:25:27.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.070+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:25:27.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.070+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:25:27.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.070+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:25:27.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.070+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:25:27.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.070+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:25:27.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.070+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77180 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:25:27.127 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.126+0000 7fde11ef9700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561b562fc00 get_replay_status: replay not running 2024-09-21T15:25:27.134 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.130+0000 7fde11ef9700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561b714f880 get_replay_status: replay not running 2024-09-21T15:25:27.198 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912c80 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:25:27.198 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912c80 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:25:27.198 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912c80 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:25:27.198 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.194+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912c80 [3/1857f2cd-7b23-459e-b47e-de455e02aabc] start: already running 2024-09-21T15:25:27.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.206+0000 7fde11ef9700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561b714e700 get_replay_status: replay not running 2024-09-21T15:25:27.387 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.381+0000 7f7fd044c700 -1 reset not still connected to 0x5636a4b15860 2024-09-21T15:25:27.397 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.389+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670750 2024-09-21T15:25:27.408 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.401+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa0ba1a0 2024-09-21T15:25:27.408 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.401+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa0ba8f0 2024-09-21T15:25:27.409 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.401+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa0bb520 2024-09-21T15:25:27.409 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.401+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef03e10 2024-09-21T15:25:27.409 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.401+0000 7f7fd044c700 -1 reset not still connected to 0x5636b0b3f520 2024-09-21T15:25:27.409 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.401+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e92b0 2024-09-21T15:25:27.409 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.401+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41aa000 2024-09-21T15:25:27.416 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.405+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e0d0 2024-09-21T15:25:27.416 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.405+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678ef70 2024-09-21T15:25:27.416 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.405+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678f2b0 2024-09-21T15:25:27.416 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.405+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678fe10 2024-09-21T15:25:27.416 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.405+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc9a3e10 2024-09-21T15:25:27.416 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.405+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff641a0 2024-09-21T15:25:27.416 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.405+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:25:27.416 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.405+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f0f70 2024-09-21T15:25:27.416 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.405+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45056c0 2024-09-21T15:25:27.416 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.405+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:25:27.416 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.405+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5ad0 2024-09-21T15:25:27.416 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.405+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:25:27.417 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.409+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c84e0 2024-09-21T15:25:27.417 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.409+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:25:27.417 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.409+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9790 2024-09-21T15:25:27.418 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9e10 2024-09-21T15:25:27.418 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:25:27.420 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ad0 2024-09-21T15:25:27.420 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:25:27.420 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335860 2024-09-21T15:25:27.420 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335e10 2024-09-21T15:25:27.421 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636c83e2b60 2024-09-21T15:25:27.421 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:25:27.421 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966410 2024-09-21T15:25:27.421 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966820 2024-09-21T15:25:27.421 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967040 2024-09-21T15:25:27.421 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89672b0 2024-09-21T15:25:27.421 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:25:27.421 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.413+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde26410 2024-09-21T15:25:27.422 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.417+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde276c0 2024-09-21T15:25:27.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.422+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912a00 [3/17d4ffa8-0813-4494-8b4e-ee40ecedca48] start: already running 2024-09-21T15:25:27.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.422+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912a00 [3/17d4ffa8-0813-4494-8b4e-ee40ecedca48] start: already running 2024-09-21T15:25:27.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.422+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912a00 [3/17d4ffa8-0813-4494-8b4e-ee40ecedca48] start: already running 2024-09-21T15:25:27.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.422+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7912a00 [3/17d4ffa8-0813-4494-8b4e-ee40ecedca48] start: already running 2024-09-21T15:25:27.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.430+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8a00 [3/c09cc5be-efe7-4ded-a908-526878332ee8] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:27.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.430+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8a00 [3/c09cc5be-efe7-4ded-a908-526878332ee8] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:25:27.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.430+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8a00 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:25:27.433 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.430+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a81d8a00 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:25:27.452 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4db80 [3/447d408d-afd0-42db-aef7-f284975751e4] start: already running 2024-09-21T15:25:27.452 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4db80 [3/447d408d-afd0-42db-aef7-f284975751e4] start: already running 2024-09-21T15:25:27.452 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4db80 [3/447d408d-afd0-42db-aef7-f284975751e4] start: already running 2024-09-21T15:25:27.452 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0c80 [3/36cc0788-436b-4847-beeb-ef7205663578] start: already running 2024-09-21T15:25:27.452 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0c80 [3/36cc0788-436b-4847-beeb-ef7205663578] start: already running 2024-09-21T15:25:27.452 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0c80 [3/36cc0788-436b-4847-beeb-ef7205663578] start: already running 2024-09-21T15:25:27.452 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb680 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:25:27.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb680 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:25:27.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb680 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:25:27.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb680 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:25:27.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a93bb680 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:25:27.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa315b80 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:25:27.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa315b80 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:25:27.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.450+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561aa315b80 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:25:27.650 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.650+0000 7fde11ef9700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561b620dc00 get_replay_status: replay not running 2024-09-21T15:25:27.735 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.729+0000 7f7fd044c700 -1 reset not still connected to 0x5636a3bcf1e0 2024-09-21T15:25:27.735 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.729+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670750 2024-09-21T15:25:27.735 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.729+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef03e10 2024-09-21T15:25:27.737 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.729+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc9a3e10 2024-09-21T15:25:27.738 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.729+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:25:27.756 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.749+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c84e0 2024-09-21T15:25:27.756 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.749+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:25:27.763 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.757+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:25:27.763 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.757+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:25:27.763 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.757+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335860 2024-09-21T15:25:27.766 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.757+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:25:27.766 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.757+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8767520 2024-09-21T15:25:27.767 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.757+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966410 2024-09-21T15:25:27.767 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.757+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967040 2024-09-21T15:25:27.767 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.757+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967110 2024-09-21T15:25:27.767 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.757+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89672b0 2024-09-21T15:25:27.767 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.761+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:25:27.770 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:27.761+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde26410 2024-09-21T15:25:27.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.794+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd0000 [3/55c2a1c2-e5de-4bcb-8d07-45955fdc4e18] start: already running 2024-09-21T15:25:27.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.794+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7bd0000 [3/55c2a1c2-e5de-4bcb-8d07-45955fdc4e18] start: already running 2024-09-21T15:25:27.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.850+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aaa00 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:25:27.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.850+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aaa00 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:25:27.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.850+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aaa00 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:25:27.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:28.000 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.998+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77b80 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:25:28.000 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:27.998+0000 7fde126fa700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77b80 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:25:28.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone29': 2024-09-21T15:25:28.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 192 MiB in 54 objects 2024-09-21T15:25:28.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:25:28.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:28.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9975d4334 2024-09-21T15:25:28.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9975d4334 2024-09-21T15:25:28.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:28.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:28.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:28.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:28.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:25:28.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:25:28.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:25:28.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:28.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:25:28.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 9 2024-09-21T15:25:28.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9975d4334 2024-09-21T15:25:28.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:28.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:28.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 95e3897d-ea8f-4598-980b-426864d1bc5d 2024-09-21T15:25:28.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:28.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:28.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:28.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone3 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:28.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:28.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:28.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone3 2024-09-21T15:25:28.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:28.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:28.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:28.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:28.337 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.321+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa0ba8f0 2024-09-21T15:25:28.340 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.333+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef03e10 2024-09-21T15:25:28.341 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.333+0000 7f7fd044c700 -1 reset not still connected to 0x5636b0b3f520 2024-09-21T15:25:28.369 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.361+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e9520 2024-09-21T15:25:28.372 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41aa000 2024-09-21T15:25:28.372 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678f2b0 2024-09-21T15:25:28.372 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678fe10 2024-09-21T15:25:28.372 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc9a3e10 2024-09-21T15:25:28.372 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65e10 2024-09-21T15:25:28.373 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:25:28.373 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:25:28.373 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbba00 2024-09-21T15:25:28.381 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.369+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:25:28.395 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.381+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c84e0 2024-09-21T15:25:28.395 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.381+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:25:28.395 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.381+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9790 2024-09-21T15:25:28.395 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.385+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:25:28.395 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.385+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:25:28.395 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.385+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335860 2024-09-21T15:25:28.395 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.385+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:25:28.395 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.385+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8767520 2024-09-21T15:25:28.395 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.385+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966410 2024-09-21T15:25:28.395 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.385+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967040 2024-09-21T15:25:28.396 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.385+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:25:28.396 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.385+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde26410 2024-09-21T15:25:28.396 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:28.385+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde276c0 2024-09-21T15:25:28.666 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:28.666+0000 7fde126fa700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561af006000 get_replay_status: replay not running 2024-09-21T15:25:28.674 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:28.670+0000 7fde126fa700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561af006380 get_replay_status: replay not running 2024-09-21T15:25:28.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:28.730+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aa000 [3/f7c87bd3-b914-47e1-bfe3-31c0275bb492] start: already running 2024-09-21T15:25:28.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:28.730+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aa000 [3/f7c87bd3-b914-47e1-bfe3-31c0275bb492] start: already running 2024-09-21T15:25:28.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:28.730+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561aa3aa000 [3/f7c87bd3-b914-47e1-bfe3-31c0275bb492] start: already running 2024-09-21T15:25:29.007 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.002+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caed00 2024-09-21T15:25:29.008 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.006+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf110 2024-09-21T15:25:29.043 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.034+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:25:29.043 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.034+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf790 2024-09-21T15:25:29.051 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.042+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:25:29.051 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.042+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31520 2024-09-21T15:25:29.051 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.042+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31860 2024-09-21T15:25:29.052 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.042+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31930 2024-09-21T15:25:29.056 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.054+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31c70 2024-09-21T15:25:29.056 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.054+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6680 2024-09-21T15:25:29.056 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.054+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c16925b0 2024-09-21T15:25:29.056 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.054+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692750 2024-09-21T15:25:29.065 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.062+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693790 2024-09-21T15:25:29.065 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.062+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:25:29.065 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.062+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693c70 2024-09-21T15:25:29.096 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.094+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7a680 2024-09-21T15:25:29.096 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.094+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d96c0 2024-09-21T15:25:29.102 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.102+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:25:29.118 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.114+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783930 2024-09-21T15:25:29.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.114+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:25:29.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.122+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9380 2024-09-21T15:25:29.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.122+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de95f0 2024-09-21T15:25:29.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.122+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47e10 2024-09-21T15:25:29.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.122+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aee340 2024-09-21T15:25:29.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.122+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8370dd0 2024-09-21T15:25:29.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.122+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387ee0 2024-09-21T15:25:29.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.122+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cc5b0 2024-09-21T15:25:29.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.122+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83ccea0 2024-09-21T15:25:29.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.122+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc4e0 2024-09-21T15:25:29.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.126+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc8f0 2024-09-21T15:25:29.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.126+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9011e10 2024-09-21T15:25:29.129 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.126+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0d00 2024-09-21T15:25:29.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:29.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1a00 2024-09-21T15:25:29.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1d40 2024-09-21T15:25:29.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:25:29.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4dd0 2024-09-21T15:25:29.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:25:29.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5790 2024-09-21T15:25:29.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.142+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5860 2024-09-21T15:25:29.154 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.150+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:25:29.154 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.150+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3110 2024-09-21T15:25:29.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3860 2024-09-21T15:25:29.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e6c30 2024-09-21T15:25:29.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:25:29.161 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72e4e0 2024-09-21T15:25:29.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:25:29.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d68f0 2024-09-21T15:25:29.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf035f0 2024-09-21T15:25:29.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf036c0 2024-09-21T15:25:29.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc425d40 2024-09-21T15:25:29.162 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.158+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b4340 2024-09-21T15:25:29.180 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:25:29.180 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3516c0 2024-09-21T15:25:29.180 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351ba0 2024-09-21T15:25:29.180 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.178+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd528f0 2024-09-21T15:25:29.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.190+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd52dd0 2024-09-21T15:25:29.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.190+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:25:29.195 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.190+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e0d0 2024-09-21T15:25:29.208 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.206+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e1a0 2024-09-21T15:25:29.208 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.206+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e340 2024-09-21T15:25:29.208 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.206+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e750 2024-09-21T15:25:29.208 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.206+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f450 2024-09-21T15:25:29.208 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.206+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f790 2024-09-21T15:25:29.220 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.214+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:25:29.228 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.226+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5fba0 2024-09-21T15:25:29.229 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.226+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6260d0 2024-09-21T15:25:29.243 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:25:29.244 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be627520 2024-09-21T15:25:29.249 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a750 2024-09-21T15:25:29.249 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91ad00 2024-09-21T15:25:29.251 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b1e0 2024-09-21T15:25:29.251 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b380 2024-09-21T15:25:29.251 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bad0 2024-09-21T15:25:29.251 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52340 2024-09-21T15:25:29.251 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52410 2024-09-21T15:25:29.257 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.246+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52680 2024-09-21T15:25:29.269 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.258+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:25:29.285 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.282+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52d00 2024-09-21T15:25:29.296 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.286+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52dd0 2024-09-21T15:25:29.296 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.286+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008410 2024-09-21T15:25:29.296 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.286+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008680 2024-09-21T15:25:29.303 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:29.302+0000 7fde11ef9700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561b755ca80 get_replay_status: replay not running 2024-09-21T15:25:29.303 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:29.302+0000 7fde11ef9700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561b755ce00 get_replay_status: replay not running 2024-09-21T15:25:29.318 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.310+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008ea0 2024-09-21T15:25:29.319 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.310+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:25:29.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.314+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c00096c0 2024-09-21T15:25:29.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.314+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009860 2024-09-21T15:25:29.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.314+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009d40 2024-09-21T15:25:29.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.314+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:25:29.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.314+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:25:29.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.314+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:25:29.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.314+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ee0 2024-09-21T15:25:29.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.314+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:25:29.324 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.318+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caec30 2024-09-21T15:25:29.324 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.318+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caed00 2024-09-21T15:25:29.325 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.318+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf110 2024-09-21T15:25:29.325 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.318+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:25:29.327 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.326+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf790 2024-09-21T15:25:29.328 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.326+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:25:29.328 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.326+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30f70 2024-09-21T15:25:29.328 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.326+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31520 2024-09-21T15:25:29.328 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.326+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31860 2024-09-21T15:25:29.330 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.326+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31930 2024-09-21T15:25:29.333 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.330+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31c70 2024-09-21T15:25:29.333 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.330+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6680 2024-09-21T15:25:29.334 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.330+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c16925b0 2024-09-21T15:25:29.334 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.330+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692750 2024-09-21T15:25:29.334 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.330+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693790 2024-09-21T15:25:29.334 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.330+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:25:29.334 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.330+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693c70 2024-09-21T15:25:29.358 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ade4e9c0 2024-09-21T15:25:29.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580adec24e0 2024-09-21T15:25:29.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c5ba0 2024-09-21T15:25:29.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25aa90 2024-09-21T15:25:29.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae3452b0 2024-09-21T15:25:29.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1cdd0 2024-09-21T15:25:29.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2bc70 2024-09-21T15:25:29.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aedb7790 2024-09-21T15:25:29.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af9c0340 2024-09-21T15:25:29.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb18000 2024-09-21T15:25:29.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb18270 2024-09-21T15:25:29.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddc70 2024-09-21T15:25:29.359 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4c8f0 2024-09-21T15:25:29.360 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b10492b0 2024-09-21T15:25:29.360 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6820 2024-09-21T15:25:29.360 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:25:29.363 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f508f0 2024-09-21T15:25:29.363 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50f70 2024-09-21T15:25:29.363 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f512b0 2024-09-21T15:25:29.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:25:29.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51860 2024-09-21T15:25:29.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51c70 2024-09-21T15:25:29.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3100410 2024-09-21T15:25:29.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31009c0 2024-09-21T15:25:29.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686270 2024-09-21T15:25:29.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b388fee0 2024-09-21T15:25:29.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:25:29.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3935c70 2024-09-21T15:25:29.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76680 2024-09-21T15:25:29.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76f70 2024-09-21T15:25:29.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77930 2024-09-21T15:25:29.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:25:29.365 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:25:29.365 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8eea0 2024-09-21T15:25:29.365 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d8d00 2024-09-21T15:25:29.365 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:25:29.365 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eab60 2024-09-21T15:25:29.365 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0c8f0 2024-09-21T15:25:29.365 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0d040 2024-09-21T15:25:29.365 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0d520 2024-09-21T15:25:29.365 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0dee0 2024-09-21T15:25:29.365 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7a680 2024-09-21T15:25:29.365 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7ac30 2024-09-21T15:25:29.365 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d96c0 2024-09-21T15:25:29.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ba0 2024-09-21T15:25:29.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:25:29.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:25:29.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783930 2024-09-21T15:25:29.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:25:29.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:25:29.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9380 2024-09-21T15:25:29.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de95f0 2024-09-21T15:25:29.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47e10 2024-09-21T15:25:29.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aee340 2024-09-21T15:25:29.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8370dd0 2024-09-21T15:25:29.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387ee0 2024-09-21T15:25:29.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cc5b0 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83ccea0 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc4e0 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc8f0 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca340 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9011e10 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0d00 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c16c0 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1a00 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1d40 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4dd0 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5790 2024-09-21T15:25:29.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5860 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3110 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3860 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e6c30 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72e4e0 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d68f0 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf035f0 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf036c0 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc425d40 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b4340 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:25:29.368 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3516c0 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351ba0 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd528f0 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd52dd0 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e0d0 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e1a0 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e340 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e750 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f450 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f790 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5fba0 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6260d0 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:25:29.369 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be627520 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a750 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91ad00 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b1e0 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b380 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bad0 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52340 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52410 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52680 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52d00 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52dd0 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008410 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008680 2024-09-21T15:25:29.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:25:29.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c00096c0 2024-09-21T15:25:29.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009860 2024-09-21T15:25:29.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009d40 2024-09-21T15:25:29.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:25:29.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:25:29.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:25:29.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ee0 2024-09-21T15:25:29.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:25:29.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caec30 2024-09-21T15:25:29.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caed00 2024-09-21T15:25:29.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf110 2024-09-21T15:25:29.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:25:29.371 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf790 2024-09-21T15:25:29.372 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:25:29.372 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31520 2024-09-21T15:25:29.372 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31860 2024-09-21T15:25:29.372 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31930 2024-09-21T15:25:29.372 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31c70 2024-09-21T15:25:29.372 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c16925b0 2024-09-21T15:25:29.372 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692750 2024-09-21T15:25:29.372 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693790 2024-09-21T15:25:29.372 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:25:29.372 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693c70 2024-09-21T15:25:29.378 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:29.374+0000 7fde126fa700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x5561b755d180 get_replay_status: replay not running 2024-09-21T15:25:29.469 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.466+0000 7ff753f07700 -1 reset not still connected to 0x560171cd44e0 2024-09-21T15:25:29.479 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.470+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:29.479 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.470+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:25:29.479 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.470+0000 7ff753f07700 -1 reset not still connected to 0x56017219fad0 2024-09-21T15:25:29.479 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.470+0000 7ff753f07700 -1 reset not still connected to 0x5601727fb930 2024-09-21T15:25:29.491 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.482+0000 7ff753f07700 -1 reset not still connected to 0x560173d87040 2024-09-21T15:25:29.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.482+0000 7ff753f07700 -1 reset not still connected to 0x560173d87450 2024-09-21T15:25:29.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.490+0000 7ff753f07700 -1 reset not still connected to 0x560173d87520 2024-09-21T15:25:29.508 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.506+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0c30 2024-09-21T15:25:29.516 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.510+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1d40 2024-09-21T15:25:29.517 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.514+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cea0 2024-09-21T15:25:29.517 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.514+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d2b0 2024-09-21T15:25:29.517 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.514+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d380 2024-09-21T15:25:29.517 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.514+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d450 2024-09-21T15:25:29.517 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.514+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d860 2024-09-21T15:25:29.519 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.514+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1450 2024-09-21T15:25:29.526 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.522+0000 7ff753f07700 -1 reset not still connected to 0x560177272ea0 2024-09-21T15:25:29.526 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.522+0000 7ff753f07700 -1 reset not still connected to 0x560177273520 2024-09-21T15:25:29.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.522+0000 7ff753f07700 -1 reset not still connected to 0x560177273a00 2024-09-21T15:25:29.529 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.522+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccd00 2024-09-21T15:25:29.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.526+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccdd0 2024-09-21T15:25:29.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.526+0000 7ff753f07700 -1 reset not still connected to 0x5601774cd5f0 2024-09-21T15:25:29.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.526+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdba0 2024-09-21T15:25:29.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.526+0000 7ff753f07700 -1 reset not still connected to 0x560177984820 2024-09-21T15:25:29.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.526+0000 7ff753f07700 -1 reset not still connected to 0x560177984ea0 2024-09-21T15:25:29.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.526+0000 7ff753f07700 -1 reset not still connected to 0x560178048c30 2024-09-21T15:25:29.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.526+0000 7ff753f07700 -1 reset not still connected to 0x560178049790 2024-09-21T15:25:29.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.526+0000 7ff753f07700 -1 reset not still connected to 0x560178049ba0 2024-09-21T15:25:29.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.526+0000 7ff753f07700 -1 reset not still connected to 0x560178190c30 2024-09-21T15:25:29.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.526+0000 7ff753f07700 -1 reset not still connected to 0x560178191930 2024-09-21T15:25:29.538 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.534+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:29.538 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.534+0000 7ff753f07700 -1 reset not still connected to 0x560178191e10 2024-09-21T15:25:29.543 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.538+0000 7ff753f07700 -1 reset not still connected to 0x56017a16f6c0 2024-09-21T15:25:29.543 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.538+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fc70 2024-09-21T15:25:29.543 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.538+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fe10 2024-09-21T15:25:29.543 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a204340 2024-09-21T15:25:29.543 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a2044e0 2024-09-21T15:25:29.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a204750 2024-09-21T15:25:29.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a204820 2024-09-21T15:25:29.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a204dd0 2024-09-21T15:25:29.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a205040 2024-09-21T15:25:29.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a205ad0 2024-09-21T15:25:29.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2820 2024-09-21T15:25:29.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b29c0 2024-09-21T15:25:29.544 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2dd0 2024-09-21T15:25:29.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2ea0 2024-09-21T15:25:29.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:25:29.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f21a0 2024-09-21T15:25:29.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2410 2024-09-21T15:25:29.545 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:25:29.548 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2ea0 2024-09-21T15:25:29.548 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3860 2024-09-21T15:25:29.548 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ee0 2024-09-21T15:25:29.548 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd040 2024-09-21T15:25:29.549 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd2b0 2024-09-21T15:25:29.549 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:29.542+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd380 2024-09-21T15:25:29.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone3': 2024-09-21T15:25:29.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 195 MiB in 100 objects 2024-09-21T15:25:29.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 21 (2 MiB objects) 2024-09-21T15:25:29.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:29.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b99ee959d1 2024-09-21T15:25:29.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b99ee959d1 2024-09-21T15:25:29.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:29.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:29.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:29.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:29.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:29.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:29.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:29.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:29.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone2@snap 2024-09-21T15:25:29.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 21 MiB 2024-09-21T15:25:29.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 1 MiB 2024-09-21T15:25:29.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:25:29.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b99ee959d1 2024-09-21T15:25:29.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:29.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:29.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 93b14c97-3746-461a-9848-33b07d7ddb85 2024-09-21T15:25:29.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:29.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:29.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:29.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone30 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:29.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:29.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:29.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone30 2024-09-21T15:25:29.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:29.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:29.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:29.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:29.889 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.874+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:25:29.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eab60 2024-09-21T15:25:29.894 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.890+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0c8f0 2024-09-21T15:25:29.943 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.942+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7a680 2024-09-21T15:25:29.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.942+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d96c0 2024-09-21T15:25:29.947 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.942+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ba0 2024-09-21T15:25:29.952 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.946+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:25:29.954 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:25:29.954 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783930 2024-09-21T15:25:29.954 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:25:29.954 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:25:29.954 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9380 2024-09-21T15:25:29.954 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de95f0 2024-09-21T15:25:29.954 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47e10 2024-09-21T15:25:29.954 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aee340 2024-09-21T15:25:29.954 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8370dd0 2024-09-21T15:25:29.954 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387ee0 2024-09-21T15:25:29.954 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cc5b0 2024-09-21T15:25:29.955 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83ccea0 2024-09-21T15:25:29.955 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc4e0 2024-09-21T15:25:29.955 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc8f0 2024-09-21T15:25:29.955 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca340 2024-09-21T15:25:29.955 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9011e10 2024-09-21T15:25:29.955 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0d00 2024-09-21T15:25:29.955 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1a00 2024-09-21T15:25:29.955 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1d40 2024-09-21T15:25:29.955 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:25:29.955 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4dd0 2024-09-21T15:25:29.955 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.950+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:25:29.957 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5790 2024-09-21T15:25:29.957 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5860 2024-09-21T15:25:29.958 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:25:29.958 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3110 2024-09-21T15:25:29.958 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3860 2024-09-21T15:25:29.958 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e6c30 2024-09-21T15:25:29.958 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:25:29.958 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72e4e0 2024-09-21T15:25:29.958 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:25:29.958 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d68f0 2024-09-21T15:25:29.959 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf02270 2024-09-21T15:25:29.959 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf035f0 2024-09-21T15:25:29.959 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf036c0 2024-09-21T15:25:29.959 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc425d40 2024-09-21T15:25:29.959 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b4340 2024-09-21T15:25:29.960 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.954+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c000 2024-09-21T15:25:29.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.966+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:25:29.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.966+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3516c0 2024-09-21T15:25:29.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.966+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351ba0 2024-09-21T15:25:29.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.966+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd528f0 2024-09-21T15:25:29.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.966+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd52dd0 2024-09-21T15:25:29.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.966+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e0d0 2024-09-21T15:25:29.969 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.966+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e1a0 2024-09-21T15:25:29.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e270 2024-09-21T15:25:29.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e340 2024-09-21T15:25:29.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e750 2024-09-21T15:25:29.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f450 2024-09-21T15:25:29.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f790 2024-09-21T15:25:29.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:25:29.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5fba0 2024-09-21T15:25:29.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6260d0 2024-09-21T15:25:29.973 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626680 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be627520 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a750 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91ad00 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b1e0 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b380 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bad0 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52340 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52410 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52680 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52d00 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52dd0 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008410 2024-09-21T15:25:29.974 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.970+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008680 2024-09-21T15:25:29.975 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:25:29.978 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c00096c0 2024-09-21T15:25:29.978 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009860 2024-09-21T15:25:29.978 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009d40 2024-09-21T15:25:29.978 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:25:29.978 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:25:29.978 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:25:29.978 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ee0 2024-09-21T15:25:29.978 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:25:29.979 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae5b0 2024-09-21T15:25:29.979 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caec30 2024-09-21T15:25:29.979 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caed00 2024-09-21T15:25:29.979 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf110 2024-09-21T15:25:29.979 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:25:29.979 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf790 2024-09-21T15:25:29.979 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.974+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e304e0 2024-09-21T15:25:29.980 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:25:29.980 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30f70 2024-09-21T15:25:29.980 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31520 2024-09-21T15:25:29.980 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31860 2024-09-21T15:25:29.980 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31930 2024-09-21T15:25:29.980 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31c70 2024-09-21T15:25:29.981 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6680 2024-09-21T15:25:29.981 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c16925b0 2024-09-21T15:25:29.981 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692750 2024-09-21T15:25:29.981 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693790 2024-09-21T15:25:29.981 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:25:29.981 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:29.978+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693c70 2024-09-21T15:25:30.176 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.170+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:25:30.201 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.198+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50f70 2024-09-21T15:25:30.201 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.198+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f512b0 2024-09-21T15:25:30.204 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.198+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:25:30.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.202+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51c70 2024-09-21T15:25:30.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.202+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3100410 2024-09-21T15:25:30.207 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.202+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686270 2024-09-21T15:25:30.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.218+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:25:30.225 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.218+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3935c70 2024-09-21T15:25:30.228 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.226+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:25:30.229 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.226+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:25:30.229 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.226+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:25:30.237 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.234+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eab60 2024-09-21T15:25:30.237 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.234+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0c8f0 2024-09-21T15:25:30.237 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.234+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0d040 2024-09-21T15:25:30.237 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.234+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0d520 2024-09-21T15:25:30.237 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.234+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0dee0 2024-09-21T15:25:30.237 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.234+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7a680 2024-09-21T15:25:30.237 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.234+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d96c0 2024-09-21T15:25:30.238 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.234+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ba0 2024-09-21T15:25:30.239 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.234+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:25:30.239 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.234+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783930 2024-09-21T15:25:30.258 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:25:30.258 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9380 2024-09-21T15:25:30.258 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47e10 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aee340 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeeea0 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8370dd0 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387ee0 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cc5b0 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83ccea0 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc4e0 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc8f0 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca340 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9011e10 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0d00 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c16c0 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1a00 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1d40 2024-09-21T15:25:30.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4dd0 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5790 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3110 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3860 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e6c30 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d68f0 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf035f0 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf036c0 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc425d40 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b4340 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3516c0 2024-09-21T15:25:30.260 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351ba0 2024-09-21T15:25:30.261 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd528f0 2024-09-21T15:25:30.261 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:25:30.261 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e0d0 2024-09-21T15:25:30.261 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e1a0 2024-09-21T15:25:30.261 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e340 2024-09-21T15:25:30.261 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e750 2024-09-21T15:25:30.261 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f790 2024-09-21T15:25:30.261 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5fba0 2024-09-21T15:25:30.261 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6260d0 2024-09-21T15:25:30.261 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.242+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:25:30.262 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.250+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be627520 2024-09-21T15:25:30.262 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.250+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a750 2024-09-21T15:25:30.262 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.250+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91ad00 2024-09-21T15:25:30.262 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.250+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b1e0 2024-09-21T15:25:30.262 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.250+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b380 2024-09-21T15:25:30.262 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.250+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bad0 2024-09-21T15:25:30.264 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52340 2024-09-21T15:25:30.264 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52410 2024-09-21T15:25:30.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:25:30.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52d00 2024-09-21T15:25:30.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52dd0 2024-09-21T15:25:30.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008410 2024-09-21T15:25:30.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.254+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008680 2024-09-21T15:25:30.265 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.262+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008a90 2024-09-21T15:25:30.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.266+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:25:30.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.266+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c00096c0 2024-09-21T15:25:30.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.266+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009860 2024-09-21T15:25:30.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.266+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009d40 2024-09-21T15:25:30.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.266+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:25:30.268 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.266+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:25:30.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.270+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ee0 2024-09-21T15:25:30.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.270+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:25:30.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.270+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caec30 2024-09-21T15:25:30.271 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.270+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caed00 2024-09-21T15:25:30.286 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.282+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf110 2024-09-21T15:25:30.286 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.282+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:25:30.290 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.286+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf790 2024-09-21T15:25:30.292 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.290+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:25:30.292 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.290+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30f70 2024-09-21T15:25:30.292 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.290+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31520 2024-09-21T15:25:30.292 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.290+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31860 2024-09-21T15:25:30.292 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.290+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31930 2024-09-21T15:25:30.292 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.290+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c16925b0 2024-09-21T15:25:30.292 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.290+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:25:30.293 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.290+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693c70 2024-09-21T15:25:30.323 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.318+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aeb2bc70 2024-09-21T15:25:30.335 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.322+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aedb7790 2024-09-21T15:25:30.335 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.322+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af9c0340 2024-09-21T15:25:30.336 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.322+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afb18000 2024-09-21T15:25:30.336 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.322+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddc70 2024-09-21T15:25:30.336 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.326+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b10492b0 2024-09-21T15:25:30.342 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.334+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b202dba0 2024-09-21T15:25:30.351 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.350+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50f70 2024-09-21T15:25:30.358 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f512b0 2024-09-21T15:25:30.362 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f516c0 2024-09-21T15:25:30.362 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51860 2024-09-21T15:25:30.363 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f51c70 2024-09-21T15:25:30.363 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3100410 2024-09-21T15:25:30.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.362+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686270 2024-09-21T15:25:30.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.362+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:25:30.370 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.362+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3935c70 2024-09-21T15:25:30.377 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.370+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76680 2024-09-21T15:25:30.377 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.370+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3040 2024-09-21T15:25:30.380 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.370+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd35f0 2024-09-21T15:25:30.383 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.374+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8eea0 2024-09-21T15:25:30.391 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:25:30.391 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff860 2024-09-21T15:25:30.391 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b59eab60 2024-09-21T15:25:30.391 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0c8f0 2024-09-21T15:25:30.391 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0d040 2024-09-21T15:25:30.392 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0d520 2024-09-21T15:25:30.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0dee0 2024-09-21T15:25:30.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7a680 2024-09-21T15:25:30.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7ac30 2024-09-21T15:25:30.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d96c0 2024-09-21T15:25:30.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ba0 2024-09-21T15:25:30.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:25:30.399 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6782000 2024-09-21T15:25:30.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783930 2024-09-21T15:25:30.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:25:30.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de8750 2024-09-21T15:25:30.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9380 2024-09-21T15:25:30.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de95f0 2024-09-21T15:25:30.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47e10 2024-09-21T15:25:30.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aee340 2024-09-21T15:25:30.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeeea0 2024-09-21T15:25:30.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8370dd0 2024-09-21T15:25:30.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387ee0 2024-09-21T15:25:30.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cc5b0 2024-09-21T15:25:30.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83ccea0 2024-09-21T15:25:30.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc4e0 2024-09-21T15:25:30.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc8f0 2024-09-21T15:25:30.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca340 2024-09-21T15:25:30.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9010340 2024-09-21T15:25:30.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9011e10 2024-09-21T15:25:30.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0d00 2024-09-21T15:25:30.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c16c0 2024-09-21T15:25:30.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1a00 2024-09-21T15:25:30.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1d40 2024-09-21T15:25:30.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:25:30.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4dd0 2024-09-21T15:25:30.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:25:30.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5790 2024-09-21T15:25:30.405 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5860 2024-09-21T15:25:30.405 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:25:30.405 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3110 2024-09-21T15:25:30.405 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3860 2024-09-21T15:25:30.405 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e6c30 2024-09-21T15:25:30.405 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:25:30.405 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72e4e0 2024-09-21T15:25:30.405 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:25:30.405 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.394+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d68f0 2024-09-21T15:25:30.405 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.402+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf02270 2024-09-21T15:25:30.406 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.402+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf035f0 2024-09-21T15:25:30.406 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.402+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf036c0 2024-09-21T15:25:30.406 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.402+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc425d40 2024-09-21T15:25:30.406 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.402+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b4340 2024-09-21T15:25:30.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.410+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26de10 2024-09-21T15:25:30.417 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:25:30.417 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:25:30.417 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3516c0 2024-09-21T15:25:30.417 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351ba0 2024-09-21T15:25:30.417 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd528f0 2024-09-21T15:25:30.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd52dd0 2024-09-21T15:25:30.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:25:30.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e0d0 2024-09-21T15:25:30.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e1a0 2024-09-21T15:25:30.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e270 2024-09-21T15:25:30.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e340 2024-09-21T15:25:30.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e750 2024-09-21T15:25:30.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f450 2024-09-21T15:25:30.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f790 2024-09-21T15:25:30.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5fba0 2024-09-21T15:25:30.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6260d0 2024-09-21T15:25:30.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626680 2024-09-21T15:25:30.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:25:30.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be627520 2024-09-21T15:25:30.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a750 2024-09-21T15:25:30.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91ad00 2024-09-21T15:25:30.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b1e0 2024-09-21T15:25:30.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b380 2024-09-21T15:25:30.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b6c0 2024-09-21T15:25:30.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bad0 2024-09-21T15:25:30.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52340 2024-09-21T15:25:30.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52410 2024-09-21T15:25:30.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52680 2024-09-21T15:25:30.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:25:30.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52d00 2024-09-21T15:25:30.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52dd0 2024-09-21T15:25:30.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008410 2024-09-21T15:25:30.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008680 2024-09-21T15:25:30.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008750 2024-09-21T15:25:30.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008a90 2024-09-21T15:25:30.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008ea0 2024-09-21T15:25:30.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:25:30.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c00096c0 2024-09-21T15:25:30.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009860 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009d40 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921110 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ee0 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae0d0 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae5b0 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caec30 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caed00 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf110 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:25:30.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf790 2024-09-21T15:25:30.424 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e304e0 2024-09-21T15:25:30.425 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:25:30.425 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30f70 2024-09-21T15:25:30.425 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31520 2024-09-21T15:25:30.425 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31860 2024-09-21T15:25:30.425 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31930 2024-09-21T15:25:30.425 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31c70 2024-09-21T15:25:30.425 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6680 2024-09-21T15:25:30.426 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c16925b0 2024-09-21T15:25:30.426 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692750 2024-09-21T15:25:30.426 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693790 2024-09-21T15:25:30.426 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:25:30.426 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:30.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693c70 2024-09-21T15:25:30.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:30.742 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:30.734+0000 7ff753f07700 -1 reset not still connected to 0x560177273520 2024-09-21T15:25:30.745 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:30.734+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccd00 2024-09-21T15:25:30.745 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:30.734+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccdd0 2024-09-21T15:25:30.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:30.738+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:30.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:30.738+0000 7ff753f07700 -1 reset not still connected to 0x56017a204820 2024-09-21T15:25:30.746 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:30.738+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:25:30.866 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:30.862+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:30.895 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:30.894+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:25:30.909 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:30.906+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:25:30.909 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:30.906+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd2b0 2024-09-21T15:25:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone30': 2024-09-21T15:25:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 110 MiB in 448 objects 2024-09-21T15:25:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:25:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9bd25987e 2024-09-21T15:25:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9bd25987e 2024-09-21T15:25:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:25:31.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:25:31.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:09:58 2024 2024-09-21T15:25:31.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:31.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:25:31.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:25:31.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9bd25987e 2024-09-21T15:25:31.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:31.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:31.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31 2024-09-21T15:25:31.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:31.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:31.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:31.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone31 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:31.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:31.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:31.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone31 2024-09-21T15:25:31.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:31.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:31.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:31.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:31.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.082+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:25:31.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.082+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:25:31.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.082+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:25:31.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.082+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:25:31.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.082+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:25:31.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.082+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:25:31.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.082+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:25:31.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.082+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:25:31.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.082+0000 7fde056e0700 -1 rbd::mirror::ImageReplayer: 0x5561a7f23900 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:25:31.329 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.326+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbddc70 2024-09-21T15:25:31.332 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.330+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0c8f0 2024-09-21T15:25:31.334 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.330+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7a680 2024-09-21T15:25:31.344 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:31.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:25:31.344 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:31.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335860 2024-09-21T15:25:31.346 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.338+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ba0 2024-09-21T15:25:31.347 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:31.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636c83e2b60 2024-09-21T15:25:31.347 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:31.337+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:25:31.348 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783930 2024-09-21T15:25:31.348 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.346+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783ad0 2024-09-21T15:25:31.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:31.341+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:25:31.351 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:31.341+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde26410 2024-09-21T15:25:31.352 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:31.345+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde276c0 2024-09-21T15:25:31.364 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.354+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9380 2024-09-21T15:25:31.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47e10 2024-09-21T15:25:31.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aee340 2024-09-21T15:25:31.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8370dd0 2024-09-21T15:25:31.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387ee0 2024-09-21T15:25:31.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83ccea0 2024-09-21T15:25:31.367 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.358+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8bbc4e0 2024-09-21T15:25:31.378 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.370+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9011e10 2024-09-21T15:25:31.391 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.386+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0d00 2024-09-21T15:25:31.395 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1a00 2024-09-21T15:25:31.396 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c1d40 2024-09-21T15:25:31.396 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:25:31.396 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4dd0 2024-09-21T15:25:31.396 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e52b0 2024-09-21T15:25:31.396 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5790 2024-09-21T15:25:31.396 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5860 2024-09-21T15:25:31.397 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d3110 2024-09-21T15:25:31.397 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e6c30 2024-09-21T15:25:31.397 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:25:31.397 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d68f0 2024-09-21T15:25:31.397 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.390+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf035f0 2024-09-21T15:25:31.402 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.398+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b4340 2024-09-21T15:25:31.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.402+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c750 2024-09-21T15:25:31.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.402+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:25:31.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.402+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351ba0 2024-09-21T15:25:31.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.402+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd528f0 2024-09-21T15:25:31.404 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.402+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:25:31.406 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.402+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e0d0 2024-09-21T15:25:31.412 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.410+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e1a0 2024-09-21T15:25:31.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.410+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e340 2024-09-21T15:25:31.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.410+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e750 2024-09-21T15:25:31.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.410+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f790 2024-09-21T15:25:31.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.410+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:25:31.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.410+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5fba0 2024-09-21T15:25:31.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.410+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6260d0 2024-09-21T15:25:31.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.410+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:25:31.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be627520 2024-09-21T15:25:31.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91ad00 2024-09-21T15:25:31.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b1e0 2024-09-21T15:25:31.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b380 2024-09-21T15:25:31.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bad0 2024-09-21T15:25:31.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52340 2024-09-21T15:25:31.416 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52410 2024-09-21T15:25:31.416 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:25:31.416 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52d00 2024-09-21T15:25:31.416 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc52dd0 2024-09-21T15:25:31.416 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008680 2024-09-21T15:25:31.416 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c00096c0 2024-09-21T15:25:31.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009860 2024-09-21T15:25:31.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009d40 2024-09-21T15:25:31.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.414+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:25:31.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:25:31.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:25:31.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caec30 2024-09-21T15:25:31.422 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caed00 2024-09-21T15:25:31.427 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.418+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf110 2024-09-21T15:25:31.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:25:31.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf790 2024-09-21T15:25:31.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:25:31.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30680 2024-09-21T15:25:31.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31520 2024-09-21T15:25:31.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31860 2024-09-21T15:25:31.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e31930 2024-09-21T15:25:31.432 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c16925b0 2024-09-21T15:25:31.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692f70 2024-09-21T15:25:31.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.430+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693790 2024-09-21T15:25:31.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.430+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:25:31.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:25:31.430+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693c70 2024-09-21T15:25:31.502 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.498+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0280 [3/346bfe3b-fa53-4f73-a11c-fc429615fca9] start: already running 2024-09-21T15:25:31.502 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.498+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0280 [3/346bfe3b-fa53-4f73-a11c-fc429615fca9] start: already running 2024-09-21T15:25:31.502 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.498+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7aa0280 [3/346bfe3b-fa53-4f73-a11c-fc429615fca9] start: already running 2024-09-21T15:25:31.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.530+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77400 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:25:31.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.530+0000 7fde11ef9700 -1 rbd::mirror::ImageReplayer: 0x5561a7f77400 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:25:31.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.538+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4ca00 [3/3e4c42b2-b54b-4fa5-a521-076c70c59b4f] start: already running 2024-09-21T15:25:31.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.538+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4ca00 [3/3e4c42b2-b54b-4fa5-a521-076c70c59b4f] start: already running 2024-09-21T15:25:31.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:25:31.538+0000 7fde04edf700 -1 rbd::mirror::ImageReplayer: 0x5561a7b4ca00 [3/3e4c42b2-b54b-4fa5-a521-076c70c59b4f] start: already running 2024-09-21T15:25:32.047 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:32.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone31': 2024-09-21T15:25:32.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 13 MiB in 6 objects 2024-09-21T15:25:32.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 23 (8 MiB objects) 2024-09-21T15:25:32.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:32.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c47b6287ce 2024-09-21T15:25:32.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c47b6287ce 2024-09-21T15:25:32.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:32.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:32.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:32.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:32.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:25:32.127 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:25:32.127 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:22 2024 2024-09-21T15:25:32.127 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:32.127 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone30@snap 2024-09-21T15:25:32.127 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 13 MiB 2024-09-21T15:25:32.127 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:25:32.127 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 6 2024-09-21T15:25:32.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c47b6287ce 2024-09-21T15:25:32.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:32.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:32.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: a15513b2-9cf9-4c80-b9b1-ea6973791935 2024-09-21T15:25:32.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:32.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:32.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:32.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone32 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:32.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:32.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:32.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone32 2024-09-21T15:25:32.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:32.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:32.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:32.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:33.134 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone32': 2024-09-21T15:25:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 92 MiB in 94 objects 2024-09-21T15:25:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:25:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4ddd7730d 2024-09-21T15:25:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4ddd7730d 2024-09-21T15:25:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:25:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:25:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:25:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:25:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:25:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4ddd7730d 2024-09-21T15:25:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 72133ade-d434-4fb0-892a-d55cec4945c3 2024-09-21T15:25:33.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:33.209 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:33.210 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:33.210 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone33 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:33.210 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:33.210 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:33.210 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone33 2024-09-21T15:25:33.210 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:33.210 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:33.210 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:33.210 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:34.211 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:34.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone33': 2024-09-21T15:25:34.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 23 MiB in 30 objects 2024-09-21T15:25:34.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:25:34.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:34.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4832549ec 2024-09-21T15:25:34.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4832549ec 2024-09-21T15:25:34.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:34.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:34.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:34.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:34.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:25:34.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:25:34.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:21 2024 2024-09-21T15:25:34.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:34.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:25:34.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:25:34.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4832549ec 2024-09-21T15:25:34.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:34.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:34.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 0da2d7cc-be3d-48b3-9444-121826b07f97 2024-09-21T15:25:34.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:34.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:34.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:34.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone34 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:34.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:34.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:34.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone34 2024-09-21T15:25:34.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:34.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:34.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:34.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:34.792 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.780+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1fdeb5f0 2024-09-21T15:25:34.792 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.784+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2106fee0 2024-09-21T15:25:34.794 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.788+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc217125b0 2024-09-21T15:25:34.810 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.800+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc217135f0 2024-09-21T15:25:34.823 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.808+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21738820 2024-09-21T15:25:34.823 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.808+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc217391e0 2024-09-21T15:25:34.823 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.808+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21eb2c30 2024-09-21T15:25:34.823 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.808+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc22b7b110 2024-09-21T15:25:34.823 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.808+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363b380 2024-09-21T15:25:34.824 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.808+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363b450 2024-09-21T15:25:34.824 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.808+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc238284e0 2024-09-21T15:25:34.824 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.808+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc23829d40 2024-09-21T15:25:34.824 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.808+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0d110 2024-09-21T15:25:34.824 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.808+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0d2b0 2024-09-21T15:25:34.824 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.808+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0dee0 2024-09-21T15:25:34.824 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.808+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264ea270 2024-09-21T15:25:34.824 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.808+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eaea0 2024-09-21T15:25:34.824 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.812+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb450 2024-09-21T15:25:34.824 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.812+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb6c0 2024-09-21T15:25:34.824 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.812+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264ebc70 2024-09-21T15:25:34.824 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.812+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc26ecc410 2024-09-21T15:25:34.824 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.812+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e29c0 2024-09-21T15:25:34.825 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.812+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc288f51e0 2024-09-21T15:25:34.825 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:25:34.812+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc288f52b0 2024-09-21T15:25:35.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:35.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone34': 2024-09-21T15:25:35.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 1.6 MiB in 2 objects 2024-09-21T15:25:35.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:25:35.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:35.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c47614ad7e 2024-09-21T15:25:35.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c47614ad7e 2024-09-21T15:25:35.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:35.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:35.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:35.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:35.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:29 2024 2024-09-21T15:25:35.366 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:29 2024 2024-09-21T15:25:35.366 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:10:29 2024 2024-09-21T15:25:35.366 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:35.366 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone33@snap 2024-09-21T15:25:35.366 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 1.6 MiB 2024-09-21T15:25:35.366 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:25:35.366 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:25:35.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c47614ad7e 2024-09-21T15:25:35.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:35.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:35.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 9899b7e1-7c24-4bdd-b213-241bfd0956fd 2024-09-21T15:25:35.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:35.371 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:35.371 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:35.371 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone35 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:35.371 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:35.371 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:35.371 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone35 2024-09-21T15:25:35.371 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:35.371 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:35.372 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:35.372 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:35.420 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.404+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa0ba8f0 2024-09-21T15:25:35.429 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.420+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef03e10 2024-09-21T15:25:35.429 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.420+0000 7f7fd044c700 -1 reset not still connected to 0x5636b0b3f520 2024-09-21T15:25:35.429 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.420+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e9520 2024-09-21T15:25:35.429 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.420+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41aa000 2024-09-21T15:25:35.430 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.420+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e0d0 2024-09-21T15:25:35.430 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.420+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678f2b0 2024-09-21T15:25:35.430 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.420+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678fe10 2024-09-21T15:25:35.430 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.420+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc9a3e10 2024-09-21T15:25:35.430 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.420+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff641a0 2024-09-21T15:25:35.430 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.420+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65e10 2024-09-21T15:25:35.430 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.420+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:25:35.430 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.420+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4750 2024-09-21T15:25:35.430 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.420+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f0ea0 2024-09-21T15:25:35.437 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.424+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45056c0 2024-09-21T15:25:35.437 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.424+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:25:35.437 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.424+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eea0 2024-09-21T15:25:35.437 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.428+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5ad0 2024-09-21T15:25:35.437 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.428+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:25:35.437 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.428+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c84e0 2024-09-21T15:25:35.444 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.436+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:25:35.445 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.436+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c92b0 2024-09-21T15:25:35.445 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.436+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9790 2024-09-21T15:25:35.445 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.436+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9e10 2024-09-21T15:25:35.445 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.436+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:25:35.445 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.436+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:25:35.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.440+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:25:35.447 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.440+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ad0 2024-09-21T15:25:35.447 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.440+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:25:35.447 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.440+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335860 2024-09-21T15:25:35.449 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.440+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335e10 2024-09-21T15:25:35.449 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.440+0000 7f7fd044c700 -1 reset not still connected to 0x5636c83e2b60 2024-09-21T15:25:35.449 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.440+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:25:35.449 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.440+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766ea0 2024-09-21T15:25:35.449 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.440+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8767ba0 2024-09-21T15:25:35.449 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.440+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966410 2024-09-21T15:25:35.450 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.440+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966820 2024-09-21T15:25:35.450 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.444+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966ea0 2024-09-21T15:25:35.450 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.444+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967040 2024-09-21T15:25:35.451 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.444+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89671e0 2024-09-21T15:25:35.451 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.444+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967790 2024-09-21T15:25:35.451 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.444+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:25:35.453 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.444+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51c70 2024-09-21T15:25:35.453 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.444+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde26410 2024-09-21T15:25:35.453 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:25:35.444+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde276c0 2024-09-21T15:25:35.671 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.0 2024-09-21T15:25:35.672 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Sent signal 15 2024-09-21T15:25:35.672 INFO:tasks.rbd_mirror_thrash:waiting for 1 secs before reviving daemons 2024-09-21T15:25:35.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:25:35.670+0000 7ffb2e424700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 (PID: 65516) UID: 1000 2024-09-21T15:25:36.372 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:36.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone35': 2024-09-21T15:25:36.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 4.4 MiB in 1 objects 2024-09-21T15:25:36.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:25:36.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:36.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c467b5007a 2024-09-21T15:25:36.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c467b5007a 2024-09-21T15:25:36.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:11:58 2024 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:11:58 2024 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:58 2024 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone34@snap 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 4.4 MiB 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 MiB 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c467b5007a 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:36.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:36.472 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 06206359-a5f6-4376-970d-9f794536ac14 2024-09-21T15:25:36.472 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:36.479 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:36.479 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:36.479 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone36 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:36.479 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:36.479 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:36.479 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone36 2024-09-21T15:25:36.479 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:36.479 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:36.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:36.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:36.673 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.0 2024-09-21T15:25:36.673 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:25:36.673 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.0 2024-09-21T15:25:36.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Restarting daemon 2024-09-21T15:25:36.673 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 2024-09-21T15:25:36.676 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Started 2024-09-21T15:25:36.676 INFO:tasks.rbd_mirror_thrash:waiting for 93 secs before thrashing 2024-09-21T15:25:37.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:37.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone36': 2024-09-21T15:25:37.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 780 KiB in 4 objects 2024-09-21T15:25:37.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 24 (16 MiB objects) 2024-09-21T15:25:37.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:37.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c49e9b0f00 2024-09-21T15:25:37.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c49e9b0f00 2024-09-21T15:25:37.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:37.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:37.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:37.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:25:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:25:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:13:28 2024 2024-09-21T15:25:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone35@snap 2024-09-21T15:25:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 780 KiB 2024-09-21T15:25:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 256 KiB 2024-09-21T15:25:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 5 2024-09-21T15:25:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c49e9b0f00 2024-09-21T15:25:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:37.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:37.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: daaa2558-921a-4582-8589-6037454cf77e 2024-09-21T15:25:37.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:37.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:37.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:37.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone37 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:37.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:37.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:37.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone37 2024-09-21T15:25:37.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:37.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:37.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:37.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:38.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:38.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone37': 2024-09-21T15:25:38.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 32 MiB in 128 objects 2024-09-21T15:25:38.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:25:38.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:38.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c41a4c86b2 2024-09-21T15:25:38.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c41a4c86b2 2024-09-21T15:25:38.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:38.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:38.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:38.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:38.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:25:38.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:25:38.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:14:28 2024 2024-09-21T15:25:38.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:38.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone36@snap 2024-09-21T15:25:38.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 32 MiB 2024-09-21T15:25:38.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:25:38.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:25:38.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c41a4c86b2 2024-09-21T15:25:38.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:38.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:38.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 937229a7-e2f3-4109-a1c5-4cd12b947e67 2024-09-21T15:25:38.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:38.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:38.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:38.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone38 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:38.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:38.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:38.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone38 2024-09-21T15:25:38.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:38.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:38.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:38.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:39.744 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:40.070 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone38': 2024-09-21T15:25:40.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 6.7 MiB in 14 objects 2024-09-21T15:25:40.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:25:40.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:40.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4767a0790 2024-09-21T15:25:40.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4767a0790 2024-09-21T15:25:40.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:40.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:40.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:40.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:40.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:14:58 2024 2024-09-21T15:25:40.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:14:58 2024 2024-09-21T15:25:40.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:14:58 2024 2024-09-21T15:25:40.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:40.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone37@snap 2024-09-21T15:25:40.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 6.7 MiB 2024-09-21T15:25:40.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 128 KiB 2024-09-21T15:25:40.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:25:40.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4767a0790 2024-09-21T15:25:40.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:40.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:40.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 5dd347e3-98d3-46ab-aac5-65babaab9ae6 2024-09-21T15:25:40.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:40.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:40.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:40.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone39 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:40.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:40.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:40.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone39 2024-09-21T15:25:40.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:40.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:40.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:40.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:41.082 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:41.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone39': 2024-09-21T15:25:41.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 19 MiB in 3 objects 2024-09-21T15:25:41.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 25 (32 MiB objects) 2024-09-21T15:25:41.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:41.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c432fcc8ca 2024-09-21T15:25:41.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c432fcc8ca 2024-09-21T15:25:41.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:41.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:41.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:41.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:41.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:15:28 2024 2024-09-21T15:25:41.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:15:28 2024 2024-09-21T15:25:41.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:15:28 2024 2024-09-21T15:25:41.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:41.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone38@snap 2024-09-21T15:25:41.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 19 MiB 2024-09-21T15:25:41.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 MiB 2024-09-21T15:25:41.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 6 2024-09-21T15:25:41.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c432fcc8ca 2024-09-21T15:25:41.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:41.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:41.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 1d800fca-0dcf-4dff-bf70-934acbfb5464 2024-09-21T15:25:41.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:41.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:41.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:41.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone4 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:41.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:41.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:41.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone4 2024-09-21T15:25:41.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:41.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:41.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:41.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:42.247 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:42.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone4': 2024-09-21T15:25:42.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 16 MiB in 66 objects 2024-09-21T15:25:42.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:25:42.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:42.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9702fb884 2024-09-21T15:25:42.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9702fb884 2024-09-21T15:25:42.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:42.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:42.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:42.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:42.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:42.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:42.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:42.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:42.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone3@snap 2024-09-21T15:25:42.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 16 MiB 2024-09-21T15:25:42.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 32 KiB 2024-09-21T15:25:42.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 2 2024-09-21T15:25:42.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9702fb884 2024-09-21T15:25:42.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:42.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:42.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 1fc5fe34-73f0-4032-9686-33e9c5f97af5 2024-09-21T15:25:42.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:42.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:42.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:42.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone40 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:42.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:42.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:42.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone40 2024-09-21T15:25:42.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:42.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:42.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:42.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:43.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:43.426 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone40': 2024-09-21T15:25:43.426 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 231 MiB in 60 objects 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 1 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10c4a17e00fe 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10c4a17e00fe 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:10:43 2024 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:10:43 2024 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:11:53 2024 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 512 KiB 2024-09-21T15:25:43.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:25:43.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10c4a17e00fe 2024-09-21T15:25:43.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:43.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:43.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: e6c1e46d-943e-48ab-b899-f1d65ff8944a 2024-09-21T15:25:43.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone5 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone5 2024-09-21T15:25:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:43.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:43.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:44.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:44.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone5': 2024-09-21T15:25:44.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 451 KiB in 7 objects 2024-09-21T15:25:44.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:25:44.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:44.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9497977be 2024-09-21T15:25:44.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9497977be 2024-09-21T15:25:44.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:44.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:44.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:44.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:44.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:59 2024 2024-09-21T15:25:44.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:59 2024 2024-09-21T15:25:44.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:59 2024 2024-09-21T15:25:44.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:44.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone4@snap 2024-09-21T15:25:44.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 451 KiB 2024-09-21T15:25:44.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:25:44.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:25:44.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9497977be 2024-09-21T15:25:44.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:44.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:44.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: e33347f9-479f-4080-b33f-92c69acaa835 2024-09-21T15:25:44.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:44.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:44.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:44.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone6 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:44.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:44.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:44.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone6 2024-09-21T15:25:44.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:44.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:44.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:44.563 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:45.563 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:45.628 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone6': 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 215 MiB in 56 objects 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 22 (4 MiB objects) 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b95291a1f0 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b95291a1f0 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 2 MiB 2024-09-21T15:25:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 14 2024-09-21T15:25:45.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b95291a1f0 2024-09-21T15:25:45.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:45.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:45.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: dc948c13-8322-4be7-a64b-971b33e1e040 2024-09-21T15:25:45.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:45.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:45.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:45.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone7 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:45.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:45.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:45.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone7 2024-09-21T15:25:45.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:45.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:45.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:45.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:46.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone7': 2024-09-21T15:25:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 193 MiB in 200 objects 2024-09-21T15:25:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 20 (1 MiB objects) 2024-09-21T15:25:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9d025f63f 2024-09-21T15:25:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9d025f63f 2024-09-21T15:25:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:46.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:00 2024 2024-09-21T15:25:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 8 KiB 2024-09-21T15:25:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 10 2024-09-21T15:25:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9d025f63f 2024-09-21T15:25:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: b629791b-e5ec-467e-8292-716555419015 2024-09-21T15:25:46.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone8 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone8 2024-09-21T15:25:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:46.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:47.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:47.778 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone8': 2024-09-21T15:25:47.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 0 B in 0 objects 2024-09-21T15:25:47.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 19 (512 KiB objects) 2024-09-21T15:25:47.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:47.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b915c1498f 2024-09-21T15:25:47.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b915c1498f 2024-09-21T15:25:47.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:47.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:47.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:47.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:47.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:47.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:47.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:28 2024 2024-09-21T15:25:47.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:47.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 4 KiB 2024-09-21T15:25:47.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 7 2024-09-21T15:25:47.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b915c1498f 2024-09-21T15:25:47.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:47.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:47.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 5d512263-1e55-4555-80ca-62bb3f5592fb 2024-09-21T15:25:47.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:47.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:47.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:47.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ wait_for_snap_present cluster2 mirror image_cluster1.client.mirror.5-clone9 4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:47.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:25:47.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:47.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone9 2024-09-21T15:25:47.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local snap_name=4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:47.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local s 2024-09-21T15:25:47.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2024-09-21T15:25:47.786 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ sleep 1 2024-09-21T15:25:48.786 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 info mirror/image_cluster1.client.mirror.5-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 2024-09-21T15:25:48.881 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:rbd image 'image_cluster1.client.mirror.5-clone9': 2024-09-21T15:25:48.881 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: size 3.4 MiB in 22 objects 2024-09-21T15:25:48.881 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: order 18 (256 KiB objects) 2024-09-21T15:25:48.881 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: snapshot_count: 2 2024-09-21T15:25:48.882 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: id: 10b9ceba3ab6 2024-09-21T15:25:48.882 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: block_name_prefix: rbd_data.10b9ceba3ab6 2024-09-21T15:25:48.882 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: format: 2 2024-09-21T15:25:48.882 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: features: layering, striping, exclusive-lock, object-map, fast-diff, deep-flatten, journaling 2024-09-21T15:25:48.882 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: op_features: 2024-09-21T15:25:48.882 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: flags: 2024-09-21T15:25:48.882 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: create_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:25:48.882 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: access_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:25:48.882 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: modify_timestamp: Sat Sep 21 15:08:58 2024 2024-09-21T15:25:48.882 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: protected: False 2024-09-21T15:25:48.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: parent: mirror/image_cluster1.client.mirror.5-clone8@snap 2024-09-21T15:25:48.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: overlap: 3.4 MiB 2024-09-21T15:25:48.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe unit: 64 KiB 2024-09-21T15:25:48.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: stripe count: 11 2024-09-21T15:25:48.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: journal: 10b9ceba3ab6 2024-09-21T15:25:48.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring state: enabled 2024-09-21T15:25:48.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring mode: journal 2024-09-21T15:25:48.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring global id: 62263722-a51f-40ca-9cc5-1ab605e9bb14 2024-09-21T15:25:48.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout: mirroring primary: false 2024-09-21T15:25:48.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:48.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ testlog 'TEST: compare image snapshots' 2024-09-21T15:25:48.889 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ tee -a /tmp/tmp.ZUZ2ADv8z3/rbd-mirror.test.log 2024-09-21T15:25:48.889 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ date '+%F %T' 2024-09-21T15:25:48.890 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ echo 2024-09-21 15:25:48 TEST: compare image snapshots 2024-09-21T15:25:48.890 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:2024-09-21 15:25:48 TEST: compare image snapshots 2024-09-21T15:25:48.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --pool mirror ls 2024-09-21T15:25:48.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:48.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0 2024-09-21T15:25:48.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:48.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0 2024-09-21T15:25:48.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:25:48.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0.export 2024-09-21T15:25:48.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0.export 2024-09-21T15:25:48.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0 2024-09-21T15:25:48.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:25:48.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:25:49.031 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:49.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0.export 2024-09-21T15:25:49.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0.export 2024-09-21T15:25:49.117 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 27% complete... Exporting image: 34% complete... Exporting image: 41% complete... Exporting image: 48% complete... Exporting image: 55% complete... Exporting image: 62% complete... Exporting image: 69% complete... Exporting image: 76% complete... Exporting image: 83% complete... Exporting image: 90% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:49.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0.export 2024-09-21T15:25:49.210 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 27% complete... Exporting image: 34% complete... Exporting image: 41% complete... Exporting image: 48% complete... Exporting image: 55% complete... Exporting image: 62% complete... Exporting image: 69% complete... Exporting image: 76% complete... Exporting image: 83% complete... Exporting image: 90% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:49.215 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0.export 2024-09-21T15:25:49.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:49.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0.export 2024-09-21T15:25:49.288 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0.export 2024-09-21T15:25:49.363 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 27% complete... Exporting image: 34% complete... Exporting image: 41% complete... Exporting image: 48% complete... Exporting image: 55% complete... Exporting image: 62% complete... Exporting image: 69% complete... Exporting image: 76% complete... Exporting image: 83% complete... Exporting image: 90% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:49.371 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0.export 2024-09-21T15:25:49.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 27% complete... Exporting image: 34% complete... Exporting image: 41% complete... Exporting image: 48% complete... Exporting image: 55% complete... Exporting image: 62% complete... Exporting image: 69% complete... Exporting image: 76% complete... Exporting image: 83% complete... Exporting image: 90% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:49.452 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0.export 2024-09-21T15:25:49.510 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0.export 2024-09-21T15:25:49.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:49.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:49.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone1 2024-09-21T15:25:49.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:49.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone1 2024-09-21T15:25:49.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:25:49.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone1.export 2024-09-21T15:25:49.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone1.export 2024-09-21T15:25:49.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone1 2024-09-21T15:25:49.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:25:49.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:25:49.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:49.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone1.export 2024-09-21T15:25:49.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone1@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone1.export 2024-09-21T15:25:49.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:25:49.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone1@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone1.export 2024-09-21T15:25:49.787 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:25:49.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone1.export 2024-09-21T15:25:49.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:49.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone1.export 2024-09-21T15:25:49.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone1.export 2024-09-21T15:25:49.899 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:25:49.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone1.export 2024-09-21T15:25:49.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:25:50.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone1.export 2024-09-21T15:25:50.018 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone1.export 2024-09-21T15:25:50.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:50.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:50.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone10 2024-09-21T15:25:50.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:50.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone10 2024-09-21T15:25:50.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:25:50.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone10.export 2024-09-21T15:25:50.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone10.export 2024-09-21T15:25:50.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone10 2024-09-21T15:25:50.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:25:50.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:25:50.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:50.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone10.export 2024-09-21T15:25:50.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone10@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone10.export 2024-09-21T15:25:50.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 14% complete... Exporting image: 28% complete... Exporting image: 42% complete... Exporting image: 56% complete... Exporting image: 70% complete... Exporting image: 84% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:50.443 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone10@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone10.export 2024-09-21T15:25:50.485 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.481+0000 7ff753f07700 -1 reset not still connected to 0x560169401520 2024-09-21T15:25:50.504 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.497+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f75f0 2024-09-21T15:25:50.505 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.497+0000 7ff753f07700 -1 reset not still connected to 0x56016b469ba0 2024-09-21T15:25:50.505 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.497+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:25:50.505 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.497+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b85b0 2024-09-21T15:25:50.505 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.497+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:25:50.516 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.513+0000 7ff753f07700 -1 reset not still connected to 0x56016d18f520 2024-09-21T15:25:50.525 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.513+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:25:50.526 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.521+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77a00 2024-09-21T15:25:50.539 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.533+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:25:50.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.537+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a24e0 2024-09-21T15:25:50.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.537+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a29c0 2024-09-21T15:25:50.547 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.537+0000 7ff753f07700 -1 reset not still connected to 0x56016ea1e340 2024-09-21T15:25:50.562 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.557+0000 7ff753f07700 -1 reset not still connected to 0x56016ebed6c0 2024-09-21T15:25:50.562 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.557+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2750 2024-09-21T15:25:50.562 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.557+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d32b0 2024-09-21T15:25:50.562 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.557+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:25:50.567 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.565+0000 7ff753f07700 -1 reset not still connected to 0x56016f1620d0 2024-09-21T15:25:50.567 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.565+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:25:50.568 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.565+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:25:50.568 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.565+0000 7ff753f07700 -1 reset not still connected to 0x56016f163930 2024-09-21T15:25:50.568 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.565+0000 7ff753f07700 -1 reset not still connected to 0x56016f1b61a0 2024-09-21T15:25:50.568 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.565+0000 7ff753f07700 -1 reset not still connected to 0x56016f1b7110 2024-09-21T15:25:50.568 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.565+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:25:50.575 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.573+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:25:50.576 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.573+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98c30 2024-09-21T15:25:50.576 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.573+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:25:50.577 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.573+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:25:50.577 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.573+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99860 2024-09-21T15:25:50.577 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.573+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd8c30 2024-09-21T15:25:50.577 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.573+0000 7ff753f07700 -1 reset not still connected to 0x56016fe911e0 2024-09-21T15:25:50.580 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.577+0000 7ff753f07700 -1 reset not still connected to 0x56016feb45b0 2024-09-21T15:25:50.585 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.581+0000 7ff753f07700 -1 reset not still connected to 0x56016fefea90 2024-09-21T15:25:50.586 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.581+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:25:50.586 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.581+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:50.586 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.581+0000 7ff753f07700 -1 reset not still connected to 0x5601709b8a90 2024-09-21T15:25:50.586 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.581+0000 7ff753f07700 -1 reset not still connected to 0x5601709b95f0 2024-09-21T15:25:50.586 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.581+0000 7ff753f07700 -1 reset not still connected to 0x56017157c8f0 2024-09-21T15:25:50.586 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.581+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:25:50.586 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.581+0000 7ff753f07700 -1 reset not still connected to 0x560171cd44e0 2024-09-21T15:25:50.586 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.581+0000 7ff753f07700 -1 reset not still connected to 0x560171f04750 2024-09-21T15:25:50.593 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.589+0000 7ff753f07700 -1 reset not still connected to 0x560171f95110 2024-09-21T15:25:50.593 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.589+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:50.593 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.589+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:25:50.593 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.589+0000 7ff753f07700 -1 reset not still connected to 0x56017219fad0 2024-09-21T15:25:50.597 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601727fb930 2024-09-21T15:25:50.597 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560173b169c0 2024-09-21T15:25:50.597 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560173b171e0 2024-09-21T15:25:50.597 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560173d864e0 2024-09-21T15:25:50.597 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560173d869c0 2024-09-21T15:25:50.597 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560173d87040 2024-09-21T15:25:50.597 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560173d87450 2024-09-21T15:25:50.597 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560173d87520 2024-09-21T15:25:50.597 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560173d87790 2024-09-21T15:25:50.597 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560173d87ad0 2024-09-21T15:25:50.598 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560173e67c70 2024-09-21T15:25:50.598 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2ea0 2024-09-21T15:25:50.598 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560174554340 2024-09-21T15:25:50.598 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7380 2024-09-21T15:25:50.598 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560174ec76c0 2024-09-21T15:25:50.598 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7d40 2024-09-21T15:25:50.598 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0270 2024-09-21T15:25:50.598 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0c30 2024-09-21T15:25:50.598 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1ad0 2024-09-21T15:25:50.598 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1d40 2024-09-21T15:25:50.598 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cea0 2024-09-21T15:25:50.598 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d2b0 2024-09-21T15:25:50.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d380 2024-09-21T15:25:50.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d450 2024-09-21T15:25:50.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d790 2024-09-21T15:25:50.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d860 2024-09-21T15:25:50.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd040 2024-09-21T15:25:50.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601762fdba0 2024-09-21T15:25:50.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601762fdc70 2024-09-21T15:25:50.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0820 2024-09-21T15:25:50.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1450 2024-09-21T15:25:50.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560177272680 2024-09-21T15:25:50.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560177272ea0 2024-09-21T15:25:50.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560177273520 2024-09-21T15:25:50.600 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560177273a00 2024-09-21T15:25:50.600 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccd00 2024-09-21T15:25:50.600 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccdd0 2024-09-21T15:25:50.600 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601774cd5f0 2024-09-21T15:25:50.600 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdba0 2024-09-21T15:25:50.600 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x5601779841a0 2024-09-21T15:25:50.600 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560177984820 2024-09-21T15:25:50.601 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560177984ea0 2024-09-21T15:25:50.601 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.593+0000 7ff753f07700 -1 reset not still connected to 0x560178048c30 2024-09-21T15:25:50.601 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.597+0000 7ff753f07700 -1 reset not still connected to 0x560178049790 2024-09-21T15:25:50.601 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.597+0000 7ff753f07700 -1 reset not still connected to 0x560178049ba0 2024-09-21T15:25:50.602 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.597+0000 7ff753f07700 -1 reset not still connected to 0x5601781909c0 2024-09-21T15:25:50.602 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.597+0000 7ff753f07700 -1 reset not still connected to 0x560178190c30 2024-09-21T15:25:50.602 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.597+0000 7ff753f07700 -1 reset not still connected to 0x560178191930 2024-09-21T15:25:50.602 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.597+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:50.602 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.597+0000 7ff753f07700 -1 reset not still connected to 0x560178191e10 2024-09-21T15:25:50.602 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.597+0000 7ff753f07700 -1 reset not still connected to 0x56017a16f6c0 2024-09-21T15:25:50.603 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a16f930 2024-09-21T15:25:50.603 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fc70 2024-09-21T15:25:50.603 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fe10 2024-09-21T15:25:50.603 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a2041a0 2024-09-21T15:25:50.603 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a204340 2024-09-21T15:25:50.604 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a2044e0 2024-09-21T15:25:50.604 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a204750 2024-09-21T15:25:50.604 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a204820 2024-09-21T15:25:50.604 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a2049c0 2024-09-21T15:25:50.604 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a204b60 2024-09-21T15:25:50.604 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a204dd0 2024-09-21T15:25:50.604 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a205040 2024-09-21T15:25:50.604 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a205790 2024-09-21T15:25:50.604 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a205ad0 2024-09-21T15:25:50.604 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2820 2024-09-21T15:25:50.604 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b29c0 2024-09-21T15:25:50.604 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2dd0 2024-09-21T15:25:50.605 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2ea0 2024-09-21T15:25:50.605 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:25:50.605 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f21a0 2024-09-21T15:25:50.605 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2410 2024-09-21T15:25:50.605 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:25:50.605 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2ea0 2024-09-21T15:25:50.605 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3860 2024-09-21T15:25:50.605 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ee0 2024-09-21T15:25:50.605 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cc410 2024-09-21T15:25:50.605 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd040 2024-09-21T15:25:50.605 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd2b0 2024-09-21T15:25:50.605 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd380 2024-09-21T15:25:50.605 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x560169401520 2024-09-21T15:25:50.606 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56016a1f75f0 2024-09-21T15:25:50.606 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56016b469ba0 2024-09-21T15:25:50.606 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56016c1b4680 2024-09-21T15:25:50.606 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b85b0 2024-09-21T15:25:50.606 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8b60 2024-09-21T15:25:50.606 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56016d18f520 2024-09-21T15:25:50.606 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:25:50.606 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77a00 2024-09-21T15:25:50.606 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.601+0000 7ff753f07700 -1 reset not still connected to 0x56016e36f1e0 2024-09-21T15:25:50.608 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a24e0 2024-09-21T15:25:50.608 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a29c0 2024-09-21T15:25:50.608 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016ea1e340 2024-09-21T15:25:50.609 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d2750 2024-09-21T15:25:50.609 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d32b0 2024-09-21T15:25:50.609 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3520 2024-09-21T15:25:50.609 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016f1620d0 2024-09-21T15:25:50.609 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016f1621a0 2024-09-21T15:25:50.609 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:25:50.609 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016f163930 2024-09-21T15:25:50.609 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016f1b61a0 2024-09-21T15:25:50.609 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016f1b7110 2024-09-21T15:25:50.609 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e3110 2024-09-21T15:25:50.610 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98f70 2024-09-21T15:25:50.610 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99450 2024-09-21T15:25:50.610 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016fc99860 2024-09-21T15:25:50.610 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016fcd8c30 2024-09-21T15:25:50.610 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016fe911e0 2024-09-21T15:25:50.610 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:25:50.610 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56017063fc70 2024-09-21T15:25:50.610 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x5601709b95f0 2024-09-21T15:25:50.610 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56017157cdd0 2024-09-21T15:25:50.610 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x560171cd44e0 2024-09-21T15:25:50.610 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x560171f95860 2024-09-21T15:25:50.611 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56017219f520 2024-09-21T15:25:50.611 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x56017219fad0 2024-09-21T15:25:50.611 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x5601727fb930 2024-09-21T15:25:50.611 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x560173d87040 2024-09-21T15:25:50.611 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x560173d87450 2024-09-21T15:25:50.611 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x560173d87520 2024-09-21T15:25:50.611 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.605+0000 7ff753f07700 -1 reset not still connected to 0x560173e67c70 2024-09-21T15:25:50.612 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560174554340 2024-09-21T15:25:50.612 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0c30 2024-09-21T15:25:50.612 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x5601757d1d40 2024-09-21T15:25:50.612 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cea0 2024-09-21T15:25:50.612 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d2b0 2024-09-21T15:25:50.612 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d380 2024-09-21T15:25:50.612 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d450 2024-09-21T15:25:50.612 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d790 2024-09-21T15:25:50.612 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d860 2024-09-21T15:25:50.612 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0820 2024-09-21T15:25:50.612 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1450 2024-09-21T15:25:50.612 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560177272680 2024-09-21T15:25:50.613 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560177272ea0 2024-09-21T15:25:50.613 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560177273520 2024-09-21T15:25:50.613 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccd00 2024-09-21T15:25:50.613 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x5601774ccdd0 2024-09-21T15:25:50.613 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x5601779841a0 2024-09-21T15:25:50.613 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560177984ea0 2024-09-21T15:25:50.613 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560178048c30 2024-09-21T15:25:50.613 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560178191d40 2024-09-21T15:25:50.613 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x560178191e10 2024-09-21T15:25:50.613 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x56017a16f6c0 2024-09-21T15:25:50.613 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fe10 2024-09-21T15:25:50.614 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x56017a204750 2024-09-21T15:25:50.614 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x56017a204820 2024-09-21T15:25:50.614 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x56017a205040 2024-09-21T15:25:50.614 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b29c0 2024-09-21T15:25:50.614 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:25:50.614 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:25:50.614 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2ea0 2024-09-21T15:25:50.614 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:25:50.609+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd2b0 2024-09-21T15:25:50.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 14% complete... Exporting image: 28% complete... Exporting image: 42% complete... Exporting image: 56% complete... Exporting image: 70% complete... Exporting image: 84% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:50.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone10.export 2024-09-21T15:25:50.918 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:50.918 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone10.export 2024-09-21T15:25:50.965 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone10.export 2024-09-21T15:25:51.057 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:25:51.065 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone10.export 2024-09-21T15:25:51.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:25:51.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone10.export 2024-09-21T15:25:51.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone10.export 2024-09-21T15:25:51.195 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:51.195 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:51.195 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone11 2024-09-21T15:25:51.195 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:51.196 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone11 2024-09-21T15:25:51.196 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:25:51.196 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone11.export 2024-09-21T15:25:51.196 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone11.export 2024-09-21T15:25:51.196 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone11 2024-09-21T15:25:51.196 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:25:51.196 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:25:51.330 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:51.330 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone11.export 2024-09-21T15:25:51.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone11@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone11.export 2024-09-21T15:25:51.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:25:51.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone11@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone11.export 2024-09-21T15:25:51.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:25:51.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone11.export 2024-09-21T15:25:52.077 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:52.077 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone11.export 2024-09-21T15:25:52.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone11.export 2024-09-21T15:25:52.284 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:25:52.293 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone11.export 2024-09-21T15:25:52.481 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:25:52.487 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone11.export 2024-09-21T15:25:52.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone11.export 2024-09-21T15:25:52.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:52.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:52.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone12 2024-09-21T15:25:52.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:52.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone12 2024-09-21T15:25:52.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:25:52.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone12.export 2024-09-21T15:25:52.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone12.export 2024-09-21T15:25:52.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:25:52.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone12 2024-09-21T15:25:52.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:25:52.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:52.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone12.export 2024-09-21T15:25:52.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone12@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone12.export 2024-09-21T15:25:52.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 17% complete... Exporting image: 20% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 55% complete... Exporting image: 58% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 86% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:52.889 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone12@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone12.export 2024-09-21T15:25:53.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 17% complete... Exporting image: 20% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 55% complete... Exporting image: 58% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 86% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:53.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone12.export 2024-09-21T15:25:53.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:53.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone12.export 2024-09-21T15:25:53.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone12.export 2024-09-21T15:25:53.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 28% complete... Exporting image: 56% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:53.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone12.export 2024-09-21T15:25:53.635 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.632+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f6f70 2024-09-21T15:25:53.635 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.632+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7110 2024-09-21T15:25:53.637 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.632+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7ee0 2024-09-21T15:25:53.642 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.632+0000 7f1e9c77a700 -1 reset not still connected to 0x56288661cc30 2024-09-21T15:25:53.654 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.644+0000 7f1e9c77a700 -1 reset not still connected to 0x56289b659930 2024-09-21T15:25:53.655 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.648+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9d6c0 2024-09-21T15:25:53.660 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.652+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aa86eb60 2024-09-21T15:25:53.689 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.676+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:25:53.689 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.676+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:25:53.689 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.676+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:25:53.689 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.676+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab18c1a0 2024-09-21T15:25:53.692 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.684+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:25:53.692 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.684+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab2749c0 2024-09-21T15:25:53.692 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.684+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a92b0 2024-09-21T15:25:53.692 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.684+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a9c70 2024-09-21T15:25:53.698 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.692+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288410 2024-09-21T15:25:53.698 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.692+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:25:53.698 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.692+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2895f0 2024-09-21T15:25:53.698 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.692+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289d40 2024-09-21T15:25:53.698 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.692+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad1d4a90 2024-09-21T15:25:53.698 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.692+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad1d5ba0 2024-09-21T15:25:53.698 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.692+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad8dedd0 2024-09-21T15:25:53.704 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.696+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf8750 2024-09-21T15:25:53.704 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.696+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00d00 2024-09-21T15:25:53.704 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.696+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68c30 2024-09-21T15:25:53.704 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.696+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:25:53.704 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.696+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac51e0 2024-09-21T15:25:53.704 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.696+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac5ad0 2024-09-21T15:25:53.704 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.696+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afb6b5f0 2024-09-21T15:25:53.704 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.696+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe40820 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.696+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe41d40 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a270 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b790 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef91e0 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9520 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9860 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b00e7380 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b00e7ee0 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57c70 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57e10 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f2000 2024-09-21T15:25:53.705 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f29c0 2024-09-21T15:25:53.706 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f3790 2024-09-21T15:25:53.706 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f3c70 2024-09-21T15:25:53.706 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2340 2024-09-21T15:25:53.706 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d25b0 2024-09-21T15:25:53.706 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d28f0 2024-09-21T15:25:53.706 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:25:53.706 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:25:53.706 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:25:53.706 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d32b0 2024-09-21T15:25:53.706 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3450 2024-09-21T15:25:53.706 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:25:53.706 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:25:53.706 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0d00 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540a90 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541ad0 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676b60 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36772b0 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677450 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36775f0 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45281a0 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528340 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45284e0 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528750 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528d00 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529d40 2024-09-21T15:25:53.707 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2000 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b20d0 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3380 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3520 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3930 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3ad0 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59ca0d0 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59ca1a0 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59ca820 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59caa90 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd61a0 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7450 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7520 2024-09-21T15:25:53.708 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x562872f37a00 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f669c0 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f6f70 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7110 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aa86eb60 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a92b0 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f2000 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f29c0 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f3c70 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d32b0 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0d00 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676b60 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677450 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45281a0 2024-09-21T15:25:53.709 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:25:53.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7520 2024-09-21T15:25:53.813 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 28% complete... Exporting image: 56% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:53.824 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone12.export 2024-09-21T15:25:53.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone12.export 2024-09-21T15:25:53.859 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:53.859 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:53.859 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone13 2024-09-21T15:25:53.859 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:53.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone13 2024-09-21T15:25:53.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:25:53.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone13.export 2024-09-21T15:25:53.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone13.export 2024-09-21T15:25:53.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone13 2024-09-21T15:25:53.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:25:53.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:25:53.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:53.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone13.export 2024-09-21T15:25:53.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone13@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone13.export 2024-09-21T15:25:54.077 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 22% complete... Exporting image: 29% complete... Exporting image: 36% complete... Exporting image: 44% complete... Exporting image: 51% complete... Exporting image: 59% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 81% complete... Exporting image: 88% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:54.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone13@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone13.export 2024-09-21T15:25:54.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 22% complete... Exporting image: 29% complete... Exporting image: 36% complete... Exporting image: 44% complete... Exporting image: 51% complete... Exporting image: 59% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 81% complete... Exporting image: 88% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:54.231 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone13.export 2024-09-21T15:25:54.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:54.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone13.export 2024-09-21T15:25:54.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone13.export 2024-09-21T15:25:54.538 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 22% complete... Exporting image: 29% complete... Exporting image: 36% complete... Exporting image: 44% complete... Exporting image: 51% complete... Exporting image: 59% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 81% complete... Exporting image: 88% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:54.544 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone13.export 2024-09-21T15:25:54.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 22% complete... Exporting image: 29% complete... Exporting image: 36% complete... Exporting image: 44% complete... Exporting image: 51% complete... Exporting image: 59% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 81% complete... Exporting image: 88% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:54.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone13.export 2024-09-21T15:25:54.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone13.export 2024-09-21T15:25:54.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:54.872 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:54.872 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone14 2024-09-21T15:25:54.872 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:54.872 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone14 2024-09-21T15:25:54.872 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:25:54.872 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone14.export 2024-09-21T15:25:54.872 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone14.export 2024-09-21T15:25:54.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone14 2024-09-21T15:25:54.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:25:54.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:25:54.944 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:54.945 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone14.export 2024-09-21T15:25:54.945 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone14@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone14.export 2024-09-21T15:25:55.209 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 44% complete... Exporting image: 89% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:55.218 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone14@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone14.export 2024-09-21T15:25:55.497 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 44% complete... Exporting image: 89% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:55.502 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone14.export 2024-09-21T15:25:55.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:55.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone14.export 2024-09-21T15:25:55.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone14.export 2024-09-21T15:25:55.959 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 44% complete... Exporting image: 89% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:55.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone14.export 2024-09-21T15:25:56.244 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 44% complete... Exporting image: 89% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:56.249 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone14.export 2024-09-21T15:25:56.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone14.export 2024-09-21T15:25:56.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:56.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:56.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone15 2024-09-21T15:25:56.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:56.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone15 2024-09-21T15:25:56.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:25:56.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone15.export 2024-09-21T15:25:56.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone15.export 2024-09-21T15:25:56.452 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone15 2024-09-21T15:25:56.452 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:25:56.452 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:25:56.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:56.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone15.export 2024-09-21T15:25:56.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone15@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone15.export 2024-09-21T15:25:56.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:56.723 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone15@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone15.export 2024-09-21T15:25:56.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:56.859 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone15.export 2024-09-21T15:25:56.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:56.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone15.export 2024-09-21T15:25:56.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone15.export 2024-09-21T15:25:57.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:57.117 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone15.export 2024-09-21T15:25:57.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:57.258 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone15.export 2024-09-21T15:25:57.361 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone15.export 2024-09-21T15:25:57.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:57.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:57.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone16 2024-09-21T15:25:57.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:57.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone16 2024-09-21T15:25:57.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:25:57.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone16.export 2024-09-21T15:25:57.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone16.export 2024-09-21T15:25:57.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone16 2024-09-21T15:25:57.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:25:57.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:25:57.481 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:57.481 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone16.export 2024-09-21T15:25:57.482 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone16@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone16.export 2024-09-21T15:25:57.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 90% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:57.825 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone16@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone16.export 2024-09-21T15:25:58.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 90% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:58.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone16.export 2024-09-21T15:25:58.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:58.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone16.export 2024-09-21T15:25:58.309 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone16.export 2024-09-21T15:25:58.441 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:25:58.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone16.export 2024-09-21T15:25:58.597 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:25:58.603 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone16.export 2024-09-21T15:25:58.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone16.export 2024-09-21T15:25:58.645 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:58.645 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:58.645 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone17 2024-09-21T15:25:58.645 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:58.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone17 2024-09-21T15:25:58.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:25:58.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone17.export 2024-09-21T15:25:58.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone17.export 2024-09-21T15:25:58.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone17 2024-09-21T15:25:58.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:25:58.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:25:58.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:58.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone17.export 2024-09-21T15:25:58.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone17@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone17.export 2024-09-21T15:25:58.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 33% complete... Exporting image: 67% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:58.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone17@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone17.export 2024-09-21T15:25:59.086 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 33% complete... Exporting image: 67% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:59.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone17.export 2024-09-21T15:25:59.174 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:59.174 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone17.export 2024-09-21T15:25:59.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone17.export 2024-09-21T15:25:59.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 33% complete... Exporting image: 67% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:59.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone17.export 2024-09-21T15:25:59.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 33% complete... Exporting image: 67% complete... Exporting image: 100% complete...done. 2024-09-21T15:25:59.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone17.export 2024-09-21T15:25:59.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone17.export 2024-09-21T15:25:59.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:25:59.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:25:59.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone18 2024-09-21T15:25:59.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:25:59.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone18 2024-09-21T15:25:59.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:25:59.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone18.export 2024-09-21T15:25:59.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone18.export 2024-09-21T15:25:59.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:25:59.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone18 2024-09-21T15:25:59.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:25:59.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:25:59.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone18.export 2024-09-21T15:25:59.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone18@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone18.export 2024-09-21T15:26:00.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:00.121 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone18@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone18.export 2024-09-21T15:26:00.414 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.400+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef03e10 2024-09-21T15:26:00.423 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.412+0000 7f7fd044c700 -1 reset not still connected to 0x5636b41aa000 2024-09-21T15:26:00.459 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.456+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad1d4a90 2024-09-21T15:26:00.459 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.456+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad1d5ba0 2024-09-21T15:26:00.460 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.456+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:26:00.461 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.456+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac5ad0 2024-09-21T15:26:00.461 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.456+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe40820 2024-09-21T15:26:00.468 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.456+0000 7f7fd044c700 -1 reset not still connected to 0x5636bc9a3e10 2024-09-21T15:26:00.475 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.468+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b790 2024-09-21T15:26:00.479 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.476+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9520 2024-09-21T15:26:00.479 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.476+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9860 2024-09-21T15:26:00.479 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.476+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:26:00.479 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.476+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b00e7ee0 2024-09-21T15:26:00.479 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.476+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57c70 2024-09-21T15:26:00.479 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.476+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57e10 2024-09-21T15:26:00.479 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.476+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f2000 2024-09-21T15:26:00.486 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.464+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff641a0 2024-09-21T15:26:00.487 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.480+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65e10 2024-09-21T15:26:00.487 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.480+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc41a0 2024-09-21T15:26:00.488 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.480+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffc4750 2024-09-21T15:26:00.488 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.480+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f0ea0 2024-09-21T15:26:00.488 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.480+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483eb60 2024-09-21T15:26:00.488 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.480+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5ad0 2024-09-21T15:26:00.488 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.480+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54000 2024-09-21T15:26:00.488 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.480+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c84e0 2024-09-21T15:26:00.488 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.480+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c89c0 2024-09-21T15:26:00.488 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.480+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9790 2024-09-21T15:26:00.488 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.480+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:26:00.489 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.484+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ad0 2024-09-21T15:26:00.489 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.484+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6691ee0 2024-09-21T15:26:00.489 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.484+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335860 2024-09-21T15:26:00.490 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.484+0000 7f7fd044c700 -1 reset not still connected to 0x5636c83e2b60 2024-09-21T15:26:00.490 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.484+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766c30 2024-09-21T15:26:00.490 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.484+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966410 2024-09-21T15:26:00.496 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.476+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f29c0 2024-09-21T15:26:00.501 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.492+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f3c70 2024-09-21T15:26:00.501 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.492+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2340 2024-09-21T15:26:00.501 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.492+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d28f0 2024-09-21T15:26:00.501 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.492+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:26:00.502 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.492+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:26:00.502 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.492+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:26:00.502 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.492+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d32b0 2024-09-21T15:26:00.502 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.496+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3450 2024-09-21T15:26:00.502 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.496+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:26:00.502 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.496+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:26:00.502 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.496+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0d00 2024-09-21T15:26:00.502 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.496+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:26:00.502 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.496+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540a90 2024-09-21T15:26:00.502 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.496+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541ad0 2024-09-21T15:26:00.509 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676b60 2024-09-21T15:26:00.509 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677450 2024-09-21T15:26:00.509 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45281a0 2024-09-21T15:26:00.509 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528340 2024-09-21T15:26:00.510 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45284e0 2024-09-21T15:26:00.510 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528750 2024-09-21T15:26:00.511 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2000 2024-09-21T15:26:00.511 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b20d0 2024-09-21T15:26:00.511 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:26:00.511 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3380 2024-09-21T15:26:00.511 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3520 2024-09-21T15:26:00.511 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3930 2024-09-21T15:26:00.511 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3ad0 2024-09-21T15:26:00.512 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59ca0d0 2024-09-21T15:26:00.512 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59ca820 2024-09-21T15:26:00.512 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd61a0 2024-09-21T15:26:00.512 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7450 2024-09-21T15:26:00.512 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:00.504+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7520 2024-09-21T15:26:00.516 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.500+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:26:00.516 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.500+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51c70 2024-09-21T15:26:00.516 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.500+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde26410 2024-09-21T15:26:00.516 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:00.500+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde276c0 2024-09-21T15:26:00.677 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:00.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone18.export 2024-09-21T15:26:00.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:00.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone18.export 2024-09-21T15:26:00.797 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone18.export 2024-09-21T15:26:01.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:01.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone18.export 2024-09-21T15:26:01.466 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:01.460+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967040 2024-09-21T15:26:01.470 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:01.464+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:26:01.470 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:01.464+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde26410 2024-09-21T15:26:01.470 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:01.464+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde276c0 2024-09-21T15:26:01.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:01.579 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone18.export 2024-09-21T15:26:01.667 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone18.export 2024-09-21T15:26:01.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:01.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:01.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone19 2024-09-21T15:26:01.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:01.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone19 2024-09-21T15:26:01.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:01.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone19.export 2024-09-21T15:26:01.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone19.export 2024-09-21T15:26:01.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone19 2024-09-21T15:26:01.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:01.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:01.834 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:01.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone19.export 2024-09-21T15:26:01.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone19@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone19.export 2024-09-21T15:26:02.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:02.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone19@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone19.export 2024-09-21T15:26:02.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:02.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone19.export 2024-09-21T15:26:02.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:02.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone19.export 2024-09-21T15:26:02.712 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone19.export 2024-09-21T15:26:02.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:02.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone19.export 2024-09-21T15:26:02.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:02.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone19.export 2024-09-21T15:26:03.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone19.export 2024-09-21T15:26:03.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:03.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:03.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone2 2024-09-21T15:26:03.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:03.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone2 2024-09-21T15:26:03.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:03.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone2.export 2024-09-21T15:26:03.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone2.export 2024-09-21T15:26:03.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone2 2024-09-21T15:26:03.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:03.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:03.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:03.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone2.export 2024-09-21T15:26:03.085 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone2@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone2.export 2024-09-21T15:26:03.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 73% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:03.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone2@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone2.export 2024-09-21T15:26:03.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 73% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:03.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone2.export 2024-09-21T15:26:03.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:03.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone2.export 2024-09-21T15:26:03.241 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone2.export 2024-09-21T15:26:03.299 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 73% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:03.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone2.export 2024-09-21T15:26:03.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 73% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:03.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone2.export 2024-09-21T15:26:03.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone2.export 2024-09-21T15:26:03.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:03.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:03.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone20 2024-09-21T15:26:03.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:03.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone20 2024-09-21T15:26:03.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:03.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone20.export 2024-09-21T15:26:03.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone20.export 2024-09-21T15:26:03.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone20 2024-09-21T15:26:03.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:03.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:03.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:03.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone20.export 2024-09-21T15:26:03.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone20@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone20.export 2024-09-21T15:26:03.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 19% complete... Exporting image: 29% complete... Exporting image: 39% complete... Exporting image: 49% complete... Exporting image: 59% complete... Exporting image: 69% complete... Exporting image: 79% complete... Exporting image: 89% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:03.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone20@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone20.export 2024-09-21T15:26:04.058 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 19% complete... Exporting image: 29% complete... Exporting image: 39% complete... Exporting image: 49% complete... Exporting image: 59% complete... Exporting image: 69% complete... Exporting image: 79% complete... Exporting image: 89% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:04.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone20.export 2024-09-21T15:26:04.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:04.202 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone20.export 2024-09-21T15:26:04.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone20.export 2024-09-21T15:26:04.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:04.309 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone20.export 2024-09-21T15:26:04.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:04.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone20.export 2024-09-21T15:26:04.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone20.export 2024-09-21T15:26:04.386 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:04.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:04.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone21 2024-09-21T15:26:04.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:04.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone21 2024-09-21T15:26:04.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:04.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone21.export 2024-09-21T15:26:04.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone21.export 2024-09-21T15:26:04.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone21 2024-09-21T15:26:04.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:04.388 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:04.457 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:04.457 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone21.export 2024-09-21T15:26:04.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone21@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone21.export 2024-09-21T15:26:04.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 26% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:04.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone21@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone21.export 2024-09-21T15:26:04.890 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 26% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:04.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone21.export 2024-09-21T15:26:05.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:05.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone21.export 2024-09-21T15:26:05.105 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone21.export 2024-09-21T15:26:05.304 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 26% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:05.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone21.export 2024-09-21T15:26:05.437 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:05.433+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f7a680 2024-09-21T15:26:05.443 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:05.441+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5fba0 2024-09-21T15:26:05.445 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:05.441+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caed00 2024-09-21T15:26:05.446 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:05.441+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:26:05.615 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 26% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:05.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone21.export 2024-09-21T15:26:05.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone21.export 2024-09-21T15:26:05.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone22 2024-09-21T15:26:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone22 2024-09-21T15:26:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone22.export 2024-09-21T15:26:05.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone22.export 2024-09-21T15:26:05.830 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone22 2024-09-21T15:26:05.830 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:05.830 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:05.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:05.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone22.export 2024-09-21T15:26:05.922 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone22@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone22.export 2024-09-21T15:26:06.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:06.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone22@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone22.export 2024-09-21T15:26:06.785 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.776+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:26:06.808 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.804+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac5ad0 2024-09-21T15:26:06.808 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.804+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe40820 2024-09-21T15:26:06.808 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.804+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe41d40 2024-09-21T15:26:06.809 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.804+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a270 2024-09-21T15:26:06.809 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.804+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b790 2024-09-21T15:26:06.809 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.804+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:26:06.821 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.808+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9520 2024-09-21T15:26:06.821 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.808+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9860 2024-09-21T15:26:06.821 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.808+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:26:06.821 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.808+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b00e7ee0 2024-09-21T15:26:06.821 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.808+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57c70 2024-09-21T15:26:06.821 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.808+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57e10 2024-09-21T15:26:06.821 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.808+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f2000 2024-09-21T15:26:06.822 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.808+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f29c0 2024-09-21T15:26:06.822 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.808+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f3c70 2024-09-21T15:26:06.825 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.820+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2340 2024-09-21T15:26:06.825 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.820+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d28f0 2024-09-21T15:26:06.825 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.820+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:26:06.825 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.820+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:26:06.825 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.820+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:26:06.825 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.820+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d32b0 2024-09-21T15:26:06.835 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3450 2024-09-21T15:26:06.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:26:06.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:26:06.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0d00 2024-09-21T15:26:06.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:26:06.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540a90 2024-09-21T15:26:06.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541ad0 2024-09-21T15:26:06.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676b60 2024-09-21T15:26:06.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36772b0 2024-09-21T15:26:06.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677450 2024-09-21T15:26:06.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45281a0 2024-09-21T15:26:06.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528340 2024-09-21T15:26:06.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45284e0 2024-09-21T15:26:06.836 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528750 2024-09-21T15:26:06.837 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529d40 2024-09-21T15:26:06.837 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2000 2024-09-21T15:26:06.837 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b20d0 2024-09-21T15:26:06.837 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:26:06.837 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3380 2024-09-21T15:26:06.837 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3520 2024-09-21T15:26:06.837 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3930 2024-09-21T15:26:06.838 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3ad0 2024-09-21T15:26:06.838 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59ca0d0 2024-09-21T15:26:06.838 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59ca820 2024-09-21T15:26:06.838 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd61a0 2024-09-21T15:26:06.838 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7450 2024-09-21T15:26:06.838 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.828+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7520 2024-09-21T15:26:06.862 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.860+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:26:06.875 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.868+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:26:06.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:06.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone22.export 2024-09-21T15:26:06.893 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.884+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a92b0 2024-09-21T15:26:06.893 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.884+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a9c70 2024-09-21T15:26:06.897 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.892+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288410 2024-09-21T15:26:06.902 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.896+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:26:06.902 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.896+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289d40 2024-09-21T15:26:06.909 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.900+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad1d4a90 2024-09-21T15:26:06.915 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.904+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad1d5ba0 2024-09-21T15:26:06.920 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.916+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68c30 2024-09-21T15:26:06.920 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.916+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:26:06.928 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.920+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac5ad0 2024-09-21T15:26:06.928 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.920+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe40820 2024-09-21T15:26:06.929 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.920+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe41d40 2024-09-21T15:26:06.930 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.924+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a270 2024-09-21T15:26:06.930 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.924+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b790 2024-09-21T15:26:06.930 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.924+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:26:06.938 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.936+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef91e0 2024-09-21T15:26:06.939 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.936+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9520 2024-09-21T15:26:06.939 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.936+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9860 2024-09-21T15:26:06.939 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.936+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:26:06.939 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.936+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b00e7380 2024-09-21T15:26:06.939 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.936+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b00e7ee0 2024-09-21T15:26:06.941 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.936+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57c70 2024-09-21T15:26:06.941 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.936+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57e10 2024-09-21T15:26:06.941 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.936+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f2000 2024-09-21T15:26:06.942 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.940+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f29c0 2024-09-21T15:26:06.942 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.940+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f3790 2024-09-21T15:26:06.952 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f3c70 2024-09-21T15:26:06.952 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2340 2024-09-21T15:26:06.952 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d28f0 2024-09-21T15:26:06.952 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:26:06.952 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:26:06.952 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d32b0 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3450 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0d00 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540a90 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541ad0 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676b60 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36772b0 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677450 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36775f0 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45281a0 2024-09-21T15:26:06.953 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528340 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45284e0 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528750 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528d00 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529d40 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2000 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b20d0 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3380 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3520 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3930 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3ad0 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59ca0d0 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59ca1a0 2024-09-21T15:26:06.954 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59ca820 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd61a0 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7450 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7520 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x562872f37a00 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f669c0 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67860 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f6f70 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7110 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7ee0 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x56288661cc30 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e340 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x562895933ba0 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9cc30 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9d2b0 2024-09-21T15:26:06.955 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9d6c0 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aa86eb60 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab1e1a0 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a92b0 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab8a9c70 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288410 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289d40 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ad1d5ba0 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe40820 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b790 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9860 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57e10 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f2000 2024-09-21T15:26:06.956 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.944+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f29c0 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f3c70 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d28f0 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d32b0 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3ee0 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0d00 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541ad0 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676b60 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677450 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45281a0 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528340 2024-09-21T15:26:06.957 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45284e0 2024-09-21T15:26:06.958 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:26:06.958 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3520 2024-09-21T15:26:06.958 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3930 2024-09-21T15:26:06.958 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3ad0 2024-09-21T15:26:06.958 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59ca820 2024-09-21T15:26:06.958 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd61a0 2024-09-21T15:26:06.958 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:06.948+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7520 2024-09-21T15:26:07.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:07.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone22.export 2024-09-21T15:26:07.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone22.export 2024-09-21T15:26:07.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 15% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 31% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 57% complete... Exporting image: 62% complete... Exporting image: 67% complete... Exporting image: 72% complete... Exporting image: 77% complete... Exporting image: 82% complete... Exporting image: 88% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:07.385 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone22.export 2024-09-21T15:26:07.617 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 15% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 31% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 57% complete... Exporting image: 62% complete... Exporting image: 67% complete... Exporting image: 72% complete... Exporting image: 77% complete... Exporting image: 82% complete... Exporting image: 88% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:07.624 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone22.export 2024-09-21T15:26:07.662 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone22.export 2024-09-21T15:26:07.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:07.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:07.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone23 2024-09-21T15:26:07.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:07.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone23 2024-09-21T15:26:07.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:07.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone23.export 2024-09-21T15:26:07.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone23.export 2024-09-21T15:26:07.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:07.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone23 2024-09-21T15:26:07.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:07.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:07.746 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone23.export 2024-09-21T15:26:07.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone23@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone23.export 2024-09-21T15:26:08.037 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:08.042 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone23@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone23.export 2024-09-21T15:26:08.361 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:08.367 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone23.export 2024-09-21T15:26:08.477 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:08.477 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone23.export 2024-09-21T15:26:08.521 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone23.export 2024-09-21T15:26:08.816 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:08.821 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone23.export 2024-09-21T15:26:09.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:09.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone23.export 2024-09-21T15:26:09.262 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone23.export 2024-09-21T15:26:09.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:09.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:09.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone24 2024-09-21T15:26:09.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:09.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone24 2024-09-21T15:26:09.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:09.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone24.export 2024-09-21T15:26:09.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone24.export 2024-09-21T15:26:09.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone24 2024-09-21T15:26:09.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:09.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:09.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:09.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone24.export 2024-09-21T15:26:09.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone24@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone24.export 2024-09-21T15:26:09.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:09.518 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone24@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone24.export 2024-09-21T15:26:09.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:09.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone24.export 2024-09-21T15:26:09.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:09.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone24.export 2024-09-21T15:26:09.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone24.export 2024-09-21T15:26:10.017 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:10.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone24.export 2024-09-21T15:26:10.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:10.159 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone24.export 2024-09-21T15:26:10.365 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone24.export 2024-09-21T15:26:10.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:10.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:10.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone25 2024-09-21T15:26:10.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:10.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone25 2024-09-21T15:26:10.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:10.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone25.export 2024-09-21T15:26:10.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone25.export 2024-09-21T15:26:10.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:10.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone25 2024-09-21T15:26:10.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:10.465 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:10.465 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone25.export 2024-09-21T15:26:10.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone25@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone25.export 2024-09-21T15:26:10.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 19% complete... Exporting image: 38% complete... Exporting image: 57% complete... Exporting image: 77% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:10.610 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone25@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone25.export 2024-09-21T15:26:10.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 19% complete... Exporting image: 38% complete... Exporting image: 57% complete... Exporting image: 77% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:10.752 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone25.export 2024-09-21T15:26:10.826 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:10.826 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone25.export 2024-09-21T15:26:10.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone25.export 2024-09-21T15:26:10.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 19% complete... Exporting image: 38% complete... Exporting image: 57% complete... Exporting image: 77% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:10.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone25.export 2024-09-21T15:26:11.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 19% complete... Exporting image: 38% complete... Exporting image: 57% complete... Exporting image: 77% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:11.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone25.export 2024-09-21T15:26:11.217 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone25.export 2024-09-21T15:26:11.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:11.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:11.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone26 2024-09-21T15:26:11.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:11.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone26 2024-09-21T15:26:11.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:11.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone26.export 2024-09-21T15:26:11.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone26.export 2024-09-21T15:26:11.247 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone26 2024-09-21T15:26:11.247 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:11.247 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:11.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:11.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone26.export 2024-09-21T15:26:11.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone26@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone26.export 2024-09-21T15:26:11.625 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 29% complete... Exporting image: 58% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:11.632 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone26@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone26.export 2024-09-21T15:26:11.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 29% complete... Exporting image: 58% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:11.980 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone26.export 2024-09-21T15:26:12.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:12.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone26.export 2024-09-21T15:26:12.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone26.export 2024-09-21T15:26:12.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:12.293 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone26.export 2024-09-21T15:26:12.452 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:12.460 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone26.export 2024-09-21T15:26:12.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone26.export 2024-09-21T15:26:12.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone27 2024-09-21T15:26:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone27 2024-09-21T15:26:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone27.export 2024-09-21T15:26:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone27.export 2024-09-21T15:26:12.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone27 2024-09-21T15:26:12.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:12.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:12.581 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:12.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone27.export 2024-09-21T15:26:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone27@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone27.export 2024-09-21T15:26:12.838 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:12.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone27@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone27.export 2024-09-21T15:26:13.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:13.111 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone27.export 2024-09-21T15:26:13.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:13.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone27.export 2024-09-21T15:26:13.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone27.export 2024-09-21T15:26:13.506 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:13.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone27.export 2024-09-21T15:26:13.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:13.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone27.export 2024-09-21T15:26:13.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone27.export 2024-09-21T15:26:13.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:13.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:13.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone28 2024-09-21T15:26:13.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:13.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone28 2024-09-21T15:26:13.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:13.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone28.export 2024-09-21T15:26:13.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone28.export 2024-09-21T15:26:13.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone28 2024-09-21T15:26:13.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:13.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:14.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:14.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone28.export 2024-09-21T15:26:14.008 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone28@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone28.export 2024-09-21T15:26:14.241 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 23% complete... Exporting image: 29% complete... Exporting image: 35% complete... Exporting image: 41% complete... Exporting image: 47% complete... Exporting image: 53% complete... Exporting image: 59% complete... Exporting image: 65% complete... Exporting image: 71% complete... Exporting image: 77% complete... Exporting image: 83% complete... Exporting image: 89% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:14.247 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone28@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone28.export 2024-09-21T15:26:14.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 23% complete... Exporting image: 29% complete... Exporting image: 35% complete... Exporting image: 41% complete... Exporting image: 47% complete... Exporting image: 53% complete... Exporting image: 59% complete... Exporting image: 65% complete... Exporting image: 71% complete... Exporting image: 77% complete... Exporting image: 83% complete... Exporting image: 89% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:14.473 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone28.export 2024-09-21T15:26:14.645 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:14.645 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone28.export 2024-09-21T15:26:14.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone28.export 2024-09-21T15:26:14.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:14.770 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone28.export 2024-09-21T15:26:14.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:14.859 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone28.export 2024-09-21T15:26:14.861 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone28.export 2024-09-21T15:26:14.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:14.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:14.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone29 2024-09-21T15:26:14.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:14.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone29 2024-09-21T15:26:14.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:14.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone29.export 2024-09-21T15:26:14.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone29.export 2024-09-21T15:26:14.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone29 2024-09-21T15:26:14.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:14.865 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:14.940 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:14.940 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone29.export 2024-09-21T15:26:14.941 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone29@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone29.export 2024-09-21T15:26:15.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:15.558 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone29@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone29.export 2024-09-21T15:26:16.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:16.082 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone29.export 2024-09-21T15:26:16.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:16.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone29.export 2024-09-21T15:26:16.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone29.export 2024-09-21T15:26:16.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:16.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone29.export 2024-09-21T15:26:16.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:16.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone29.export 2024-09-21T15:26:16.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone29.export 2024-09-21T15:26:16.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:16.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:16.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone3 2024-09-21T15:26:16.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:16.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone3 2024-09-21T15:26:16.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:16.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone3.export 2024-09-21T15:26:16.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone3.export 2024-09-21T15:26:16.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone3 2024-09-21T15:26:16.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:16.402 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:16.493 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:16.493 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone3.export 2024-09-21T15:26:16.494 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone3@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone3.export 2024-09-21T15:26:16.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:16.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone3@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone3.export 2024-09-21T15:26:16.795 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:16.801 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone3.export 2024-09-21T15:26:16.823 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.819+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f29c0 2024-09-21T15:26:16.823 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.819+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f3c70 2024-09-21T15:26:16.827 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.819+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:26:16.831 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.827+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7520 2024-09-21T15:26:16.831 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.827+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab17450 2024-09-21T15:26:16.837 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.831+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b790 2024-09-21T15:26:16.837 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.831+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f29c0 2024-09-21T15:26:16.837 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.831+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f3c70 2024-09-21T15:26:16.837 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.831+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:26:16.837 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.831+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7520 2024-09-21T15:26:16.860 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.851+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b24f3c70 2024-09-21T15:26:16.861 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.851+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d32b0 2024-09-21T15:26:16.861 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.851+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:26:16.861 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:16.851+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd7520 2024-09-21T15:26:16.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:16.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone3.export 2024-09-21T15:26:17.018 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone3.export 2024-09-21T15:26:17.093 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:17.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone3.export 2024-09-21T15:26:17.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:17.200 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone3.export 2024-09-21T15:26:17.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone3.export 2024-09-21T15:26:17.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:17.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:17.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone30 2024-09-21T15:26:17.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:17.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone30 2024-09-21T15:26:17.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:17.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone30.export 2024-09-21T15:26:17.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone30.export 2024-09-21T15:26:17.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone30 2024-09-21T15:26:17.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:17.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:17.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:17.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone30.export 2024-09-21T15:26:17.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone30@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone30.export 2024-09-21T15:26:17.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 47% complete... Exporting image: 55% complete... Exporting image: 63% complete... Exporting image: 71% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:17.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone30@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone30.export 2024-09-21T15:26:18.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 47% complete... Exporting image: 55% complete... Exporting image: 63% complete... Exporting image: 71% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:18.330 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone30.export 2024-09-21T15:26:18.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:18.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone30.export 2024-09-21T15:26:18.518 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone30.export 2024-09-21T15:26:19.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 18% complete... Exporting image: 37% complete... Exporting image: 56% complete... Exporting image: 75% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:19.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone30.export 2024-09-21T15:26:19.599 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 18% complete... Exporting image: 37% complete... Exporting image: 56% complete... Exporting image: 75% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:19.607 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone30.export 2024-09-21T15:26:19.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone30.export 2024-09-21T15:26:19.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:19.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:19.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone31 2024-09-21T15:26:19.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:19.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone31 2024-09-21T15:26:19.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:19.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone31.export 2024-09-21T15:26:19.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone31.export 2024-09-21T15:26:19.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone31 2024-09-21T15:26:19.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:19.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:19.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:19.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone31.export 2024-09-21T15:26:19.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone31@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone31.export 2024-09-21T15:26:19.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 18% complete... Exporting image: 28% complete... Exporting image: 37% complete... Exporting image: 46% complete... Exporting image: 56% complete... Exporting image: 65% complete... Exporting image: 74% complete... Exporting image: 84% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:19.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone31@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone31.export 2024-09-21T15:26:20.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 18% complete... Exporting image: 28% complete... Exporting image: 37% complete... Exporting image: 46% complete... Exporting image: 56% complete... Exporting image: 65% complete... Exporting image: 74% complete... Exporting image: 84% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:20.193 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone31.export 2024-09-21T15:26:20.309 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:20.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone31.export 2024-09-21T15:26:20.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone31.export 2024-09-21T15:26:20.442 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:20.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone31.export 2024-09-21T15:26:20.504 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:20.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone31.export 2024-09-21T15:26:20.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone31.export 2024-09-21T15:26:20.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:20.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:20.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone32 2024-09-21T15:26:20.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:20.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone32 2024-09-21T15:26:20.515 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:20.515 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone32.export 2024-09-21T15:26:20.515 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone32.export 2024-09-21T15:26:20.515 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone32 2024-09-21T15:26:20.515 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:20.515 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:20.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:20.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone32.export 2024-09-21T15:26:20.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone32@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone32.export 2024-09-21T15:26:20.778 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 26% complete... Exporting image: 39% complete... Exporting image: 52% complete... Exporting image: 66% complete... Exporting image: 79% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:20.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone32@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone32.export 2024-09-21T15:26:20.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 26% complete... Exporting image: 39% complete... Exporting image: 52% complete... Exporting image: 66% complete... Exporting image: 79% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:20.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone32.export 2024-09-21T15:26:21.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:21.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone32.export 2024-09-21T15:26:21.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone32.export 2024-09-21T15:26:21.379 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 26% complete... Exporting image: 39% complete... Exporting image: 52% complete... Exporting image: 66% complete... Exporting image: 79% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:21.386 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone32.export 2024-09-21T15:26:21.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 26% complete... Exporting image: 39% complete... Exporting image: 52% complete... Exporting image: 66% complete... Exporting image: 79% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:21.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone32.export 2024-09-21T15:26:21.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone32.export 2024-09-21T15:26:21.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:21.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:21.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone33 2024-09-21T15:26:21.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:21.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone33 2024-09-21T15:26:21.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:21.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone33.export 2024-09-21T15:26:21.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone33.export 2024-09-21T15:26:21.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone33 2024-09-21T15:26:21.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:21.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:21.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:21.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone33.export 2024-09-21T15:26:21.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone33@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone33.export 2024-09-21T15:26:22.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:22.019 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone33@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone33.export 2024-09-21T15:26:22.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:22.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone33.export 2024-09-21T15:26:22.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:22.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone33.export 2024-09-21T15:26:22.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone33.export 2024-09-21T15:26:22.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:22.443 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone33.export 2024-09-21T15:26:22.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:22.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone33.export 2024-09-21T15:26:22.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone33.export 2024-09-21T15:26:22.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:22.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:22.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone34 2024-09-21T15:26:22.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:22.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone34 2024-09-21T15:26:22.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:22.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone34.export 2024-09-21T15:26:22.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone34.export 2024-09-21T15:26:22.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone34 2024-09-21T15:26:22.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:22.549 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:22.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:22.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone34.export 2024-09-21T15:26:22.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone34@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone34.export 2024-09-21T15:26:22.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:22.980 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone34@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone34.export 2024-09-21T15:26:23.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:23.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone34.export 2024-09-21T15:26:23.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:23.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone34.export 2024-09-21T15:26:23.520 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone34.export 2024-09-21T15:26:23.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:23.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone34.export 2024-09-21T15:26:24.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:24.160 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone34.export 2024-09-21T15:26:24.298 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone34.export 2024-09-21T15:26:24.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:24.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:24.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone35 2024-09-21T15:26:24.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:24.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone35 2024-09-21T15:26:24.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:24.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone35.export 2024-09-21T15:26:24.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone35.export 2024-09-21T15:26:24.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone35 2024-09-21T15:26:24.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:24.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:24.414 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:24.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone35.export 2024-09-21T15:26:24.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone35@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone35.export 2024-09-21T15:26:24.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:24.557 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone35@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone35.export 2024-09-21T15:26:24.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:24.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone35.export 2024-09-21T15:26:24.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:24.865 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone35.export 2024-09-21T15:26:24.878 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.6203719319349364) > weight (0.25) 2024-09-21T15:26:24.878 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.1 2024-09-21T15:26:24.878 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Sent signal 15 2024-09-21T15:26:24.879 INFO:tasks.rbd_mirror_thrash:waiting for 3 secs before reviving daemons 2024-09-21T15:26:24.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:26:24.877+0000 7fde12efb700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 46663) UID: 1000 2024-09-21T15:26:24.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone35.export 2024-09-21T15:26:25.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:25.057 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone35.export 2024-09-21T15:26:25.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:25.216 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone35.export 2024-09-21T15:26:25.404 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone35.export 2024-09-21T15:26:25.473 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:25.473 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone36 2024-09-21T15:26:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone36 2024-09-21T15:26:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone36.export 2024-09-21T15:26:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone36.export 2024-09-21T15:26:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:25.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone36 2024-09-21T15:26:25.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:25.578 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:25.579 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone36.export 2024-09-21T15:26:25.579 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone36@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone36.export 2024-09-21T15:26:25.722 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 26% complete... Exporting image: 33% complete... Exporting image: 40% complete... Exporting image: 46% complete... Exporting image: 53% complete... Exporting image: 60% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:25.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone36@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone36.export 2024-09-21T15:26:25.889 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 26% complete... Exporting image: 33% complete... Exporting image: 40% complete... Exporting image: 46% complete... Exporting image: 53% complete... Exporting image: 60% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:25.898 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone36.export 2024-09-21T15:26:26.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:26.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone36.export 2024-09-21T15:26:26.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone36.export 2024-09-21T15:26:26.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 26% complete... Exporting image: 33% complete... Exporting image: 40% complete... Exporting image: 46% complete... Exporting image: 53% complete... Exporting image: 60% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:26.237 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone36.export 2024-09-21T15:26:26.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 26% complete... Exporting image: 33% complete... Exporting image: 40% complete... Exporting image: 46% complete... Exporting image: 53% complete... Exporting image: 60% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:26.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone36.export 2024-09-21T15:26:26.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone36.export 2024-09-21T15:26:26.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:26.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:26.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone37 2024-09-21T15:26:26.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:26.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone37 2024-09-21T15:26:26.746 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:26.746 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone37.export 2024-09-21T15:26:26.746 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone37.export 2024-09-21T15:26:26.746 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:26.746 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:26.746 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone37 2024-09-21T15:26:26.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:26.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone37.export 2024-09-21T15:26:26.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone37@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone37.export 2024-09-21T15:26:27.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 13% complete... Exporting image: 17% complete... Exporting image: 22% complete... Exporting image: 26% complete... Exporting image: 31% complete... Exporting image: 35% complete... Exporting image: 40% complete... Exporting image: 44% complete... Exporting image: 49% complete... Exporting image: 53% complete... Exporting image: 57% complete... Exporting image: 62% complete... Exporting image: 66% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 80% complete... Exporting image: 84% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:27.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone37@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone37.export 2024-09-21T15:26:27.255 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:27.249+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b9011ee0 2024-09-21T15:26:27.255 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:27.249+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc425d40 2024-09-21T15:26:27.258 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:27.253+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351040 2024-09-21T15:26:27.258 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:27.253+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5e0d0 2024-09-21T15:26:27.264 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:27.261+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:26:27.367 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:26:27.363+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afac5ad0 2024-09-21T15:26:27.510 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 13% complete... Exporting image: 17% complete... Exporting image: 22% complete... Exporting image: 26% complete... Exporting image: 31% complete... Exporting image: 35% complete... Exporting image: 40% complete... Exporting image: 44% complete... Exporting image: 49% complete... Exporting image: 53% complete... Exporting image: 57% complete... Exporting image: 62% complete... Exporting image: 66% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 80% complete... Exporting image: 84% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:27.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone37.export 2024-09-21T15:26:27.675 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:27.675 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone37.export 2024-09-21T15:26:27.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone37.export 2024-09-21T15:26:27.868 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 13% complete... Exporting image: 17% complete... Exporting image: 22% complete... Exporting image: 26% complete... Exporting image: 31% complete... Exporting image: 35% complete... Exporting image: 40% complete... Exporting image: 44% complete... Exporting image: 49% complete... Exporting image: 53% complete... Exporting image: 57% complete... Exporting image: 62% complete... Exporting image: 66% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 80% complete... Exporting image: 84% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:27.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone37.export 2024-09-21T15:26:27.879 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.1 2024-09-21T15:26:27.879 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:26:27.880 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.1 2024-09-21T15:26:27.880 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2024-09-21T15:26:27.880 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2024-09-21T15:26:27.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2024-09-21T15:26:27.882 INFO:tasks.rbd_mirror_thrash:waiting for 70 secs before thrashing 2024-09-21T15:26:28.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 13% complete... Exporting image: 17% complete... Exporting image: 22% complete... Exporting image: 26% complete... Exporting image: 31% complete... Exporting image: 35% complete... Exporting image: 40% complete... Exporting image: 44% complete... Exporting image: 49% complete... Exporting image: 53% complete... Exporting image: 57% complete... Exporting image: 62% complete... Exporting image: 66% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 80% complete... Exporting image: 84% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:28.039 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone37.export 2024-09-21T15:26:28.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone37.export 2024-09-21T15:26:28.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:28.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:28.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone38 2024-09-21T15:26:28.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:28.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone38 2024-09-21T15:26:28.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:28.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone38.export 2024-09-21T15:26:28.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone38.export 2024-09-21T15:26:28.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone38 2024-09-21T15:26:28.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:28.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:28.297 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:28.297 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone38.export 2024-09-21T15:26:28.298 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone38@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone38.export 2024-09-21T15:26:28.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 61% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:28.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone38@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone38.export 2024-09-21T15:26:28.635 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 61% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:28.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone38.export 2024-09-21T15:26:28.722 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:28.723 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone38.export 2024-09-21T15:26:28.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone38.export 2024-09-21T15:26:28.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 61% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:28.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone38.export 2024-09-21T15:26:29.087 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 61% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:29.093 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone38.export 2024-09-21T15:26:29.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone38.export 2024-09-21T15:26:29.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:29.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:29.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone39 2024-09-21T15:26:29.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:29.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone39 2024-09-21T15:26:29.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:29.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone39.export 2024-09-21T15:26:29.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone39.export 2024-09-21T15:26:29.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone39 2024-09-21T15:26:29.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:29.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:29.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:29.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone39.export 2024-09-21T15:26:29.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone39.export 2024-09-21T15:26:29.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 7% complete... Exporting image: 11% complete... Exporting image: 15% complete... Exporting image: 19% complete... Exporting image: 23% complete... Exporting image: 27% complete... Exporting image: 31% complete... Exporting image: 35% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 47% complete... Exporting image: 51% complete... Exporting image: 55% complete... Exporting image: 59% complete... Exporting image: 63% complete... Exporting image: 67% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 83% complete... Exporting image: 87% complete... Exporting image: 91% complete... Exporting image: 95% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:29.445 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone39.export 2024-09-21T15:26:29.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 7% complete... Exporting image: 11% complete... Exporting image: 15% complete... Exporting image: 19% complete... Exporting image: 23% complete... Exporting image: 27% complete... Exporting image: 31% complete... Exporting image: 35% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 47% complete... Exporting image: 51% complete... Exporting image: 55% complete... Exporting image: 59% complete... Exporting image: 63% complete... Exporting image: 67% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 83% complete... Exporting image: 87% complete... Exporting image: 91% complete... Exporting image: 95% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:29.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone39.export 2024-09-21T15:26:29.775 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone39.export 2024-09-21T15:26:29.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:29.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:29.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone4 2024-09-21T15:26:29.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:29.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone4 2024-09-21T15:26:29.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:29.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone4.export 2024-09-21T15:26:29.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone4.export 2024-09-21T15:26:29.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone4 2024-09-21T15:26:29.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:29.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:29.880 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:29.880 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone4.export 2024-09-21T15:26:29.881 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone4@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone4.export 2024-09-21T15:26:30.096 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 14% complete... Exporting image: 28% complete... Exporting image: 42% complete... Exporting image: 57% complete... Exporting image: 71% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:30.105 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone4@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone4.export 2024-09-21T15:26:30.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 14% complete... Exporting image: 28% complete... Exporting image: 42% complete... Exporting image: 57% complete... Exporting image: 71% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:30.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone4.export 2024-09-21T15:26:30.493 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:30.493 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone4.export 2024-09-21T15:26:30.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone4.export 2024-09-21T15:26:30.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:30.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone4.export 2024-09-21T15:26:30.659 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:30.666 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone4.export 2024-09-21T15:26:30.667 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone4.export 2024-09-21T15:26:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone5 2024-09-21T15:26:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone5 2024-09-21T15:26:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:30.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone5.export 2024-09-21T15:26:30.670 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone5.export 2024-09-21T15:26:30.670 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone5 2024-09-21T15:26:30.670 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:30.670 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:30.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:30.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone5.export 2024-09-21T15:26:30.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone5@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone5.export 2024-09-21T15:26:31.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 28% complete... Exporting image: 57% complete... Exporting image: 86% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:31.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone5@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone5.export 2024-09-21T15:26:31.407 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 28% complete... Exporting image: 57% complete... Exporting image: 86% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:31.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone5.export 2024-09-21T15:26:31.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:31.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone5.export 2024-09-21T15:26:31.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone5.export 2024-09-21T15:26:31.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 28% complete... Exporting image: 57% complete... Exporting image: 86% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:31.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone5.export 2024-09-21T15:26:32.253 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.248+0000 7ff753f07700 -1 reset not still connected to 0x56016d985860 2024-09-21T15:26:32.254 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.248+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2a90 2024-09-21T15:26:32.267 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.260+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:32.267 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.260+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:32.267 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.260+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:32.268 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.264+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:26:32.268 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.264+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:32.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 28% complete... Exporting image: 57% complete... Exporting image: 86% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:32.506 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone5.export 2024-09-21T15:26:32.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone5.export 2024-09-21T15:26:32.658 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.648+0000 7ff753f07700 -1 reset not still connected to 0x56016b24e820 2024-09-21T15:26:32.658 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.648+0000 7ff753f07700 -1 reset not still connected to 0x56016d985860 2024-09-21T15:26:32.658 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.648+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:26:32.658 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.648+0000 7ff753f07700 -1 reset not still connected to 0x56016e36ea90 2024-09-21T15:26:32.661 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.652+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2a90 2024-09-21T15:26:32.671 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.656+0000 7ff753f07700 -1 reset not still connected to 0x560170f64b60 2024-09-21T15:26:32.677 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.664+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:26:32.677 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.664+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:26:32.677 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.664+0000 7ff753f07700 -1 reset not still connected to 0x56017219fba0 2024-09-21T15:26:32.677 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.664+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:26:32.677 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.664+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:32.677 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.664+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:32.677 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.664+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:26:32.677 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.664+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d1e0 2024-09-21T15:26:32.677 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.664+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:32.678 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.664+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc9c0 2024-09-21T15:26:32.678 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.664+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:32.678 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.664+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:32.684 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.676+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:26:32.684 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.676+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f25b0 2024-09-21T15:26:32.684 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.676+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:26:32.685 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.676+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:32.717 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:32.717 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:32.717 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone6 2024-09-21T15:26:32.717 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:32.717 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone6 2024-09-21T15:26:32.717 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:32.717 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone6.export 2024-09-21T15:26:32.717 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone6.export 2024-09-21T15:26:32.717 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone6 2024-09-21T15:26:32.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:32.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:32.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:26:32.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:26:32.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x56017219fba0 2024-09-21T15:26:32.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:26:32.735 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:32.738 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:32.738 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:26:32.738 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d1e0 2024-09-21T15:26:32.738 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:32.738 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc9c0 2024-09-21T15:26:32.738 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:32.739 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:32.739 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f25b0 2024-09-21T15:26:32.739 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:32.732+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:32.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:32.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone6.export 2024-09-21T15:26:32.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone6@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone6.export 2024-09-21T15:26:33.199 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ea58dd0 2024-09-21T15:26:33.199 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:26:33.199 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x5571404c0a90 2024-09-21T15:26:33.199 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:26:33.199 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb110 2024-09-21T15:26:33.199 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbe10 2024-09-21T15:26:33.199 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a0d0 2024-09-21T15:26:33.200 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a9c0 2024-09-21T15:26:33.200 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x5571426288f0 2024-09-21T15:26:33.200 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8680 2024-09-21T15:26:33.200 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8dd0 2024-09-21T15:26:33.200 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb91e0 2024-09-21T15:26:33.200 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601c70 2024-09-21T15:26:33.200 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77a00 2024-09-21T15:26:33.200 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77c70 2024-09-21T15:26:33.200 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a270 2024-09-21T15:26:33.200 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af6c30 2024-09-21T15:26:33.200 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af7e10 2024-09-21T15:26:33.200 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.192+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012ea0 2024-09-21T15:26:33.200 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bc70 2024-09-21T15:26:33.201 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29ad00 2024-09-21T15:26:33.203 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29bd40 2024-09-21T15:26:33.203 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29be10 2024-09-21T15:26:33.204 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1040 2024-09-21T15:26:33.204 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1d40 2024-09-21T15:26:33.204 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3c70 2024-09-21T15:26:33.204 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f6c0 2024-09-21T15:26:33.204 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1241a0 2024-09-21T15:26:33.204 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124680 2024-09-21T15:26:33.204 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1252b0 2024-09-21T15:26:33.204 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe8f0 2024-09-21T15:26:33.204 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ffa00 2024-09-21T15:26:33.204 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb12d00 2024-09-21T15:26:33.204 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:33.196+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13040 2024-09-21T15:26:33.241 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.232+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:26:33.246 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.232+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77520 2024-09-21T15:26:33.246 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.232+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8eea0 2024-09-21T15:26:33.246 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.232+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d9c70 2024-09-21T15:26:33.256 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.240+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:26:33.256 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.240+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff860 2024-09-21T15:26:33.257 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.240+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0c9c0 2024-09-21T15:26:33.257 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.244+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:26:33.257 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.244+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83716c0 2024-09-21T15:26:33.258 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.244+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:26:33.258 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.244+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:26:33.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.248+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c09c0 2024-09-21T15:26:33.289 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:26:33.289 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165110 2024-09-21T15:26:33.289 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:26:33.290 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:26:33.290 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:26:33.290 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:26:33.300 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35dc70 2024-09-21T15:26:33.300 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:26:33.300 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:26:33.300 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ed00 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a750 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:26:33.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6820 2024-09-21T15:26:33.302 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:33.302 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:33.302 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:33.302 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:26:33.302 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:26:33.302 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:26:33.302 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:26:33.302 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:26:33.310 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.296+0000 7ff753f07700 -1 reset not still connected to 0x56016d985860 2024-09-21T15:26:33.318 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.296+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:26:33.319 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.300+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:26:33.330 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.316+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:26:33.331 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.316+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:26:33.331 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.316+0000 7ff753f07700 -1 reset not still connected to 0x560173e671e0 2024-09-21T15:26:33.331 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.316+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:26:33.332 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.320+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:33.349 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.336+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:33.350 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.340+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:33.353 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.340+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc9c0 2024-09-21T15:26:33.353 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.340+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:33.354 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.348+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:33.358 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.348+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:26:33.358 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.348+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:26:33.358 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.348+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:26:33.358 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.348+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:33.366 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.348+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ad639ad0 2024-09-21T15:26:33.375 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.364+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47f930 2024-09-21T15:26:33.375 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.364+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:26:33.376 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.364+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc9c0 2024-09-21T15:26:33.376 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.364+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:26:33.382 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.364+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fa8f0 2024-09-21T15:26:33.382 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.364+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:26:33.391 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.384+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:26:33.411 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.396+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dfba0 2024-09-21T15:26:33.411 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.396+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4e8eea0 2024-09-21T15:26:33.412 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.396+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d9c70 2024-09-21T15:26:33.412 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.396+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:26:33.412 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.396+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff860 2024-09-21T15:26:33.412 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.396+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0c9c0 2024-09-21T15:26:33.412 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.396+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:26:33.412 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.396+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83716c0 2024-09-21T15:26:33.412 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.396+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:26:33.412 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.396+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:26:33.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca340 2024-09-21T15:26:33.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:26:33.414 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165110 2024-09-21T15:26:33.414 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:26:33.414 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:26:33.414 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:26:33.414 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35dc70 2024-09-21T15:26:33.414 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:26:33.414 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:26:33.414 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:26:33.414 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:26:33.414 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:26:33.414 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:33.414 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:26:33.414 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ed00 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a750 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920680 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:26:33.415 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:26:33.498 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:33.498 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:33.498 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x560177272680 2024-09-21T15:26:33.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:26:33.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:26:33.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:26:33.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cc680 2024-09-21T15:26:33.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:26:33.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x56016d985860 2024-09-21T15:26:33.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:26:33.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:26:33.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:26:33.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:33.499 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:33.492+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:33.514 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.508+0000 7ff13c00d700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x561aef14ae00 get_replay_status: replay not running 2024-09-21T15:26:33.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.560+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2c80 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:26:33.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.560+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2c80 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:26:33.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.560+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2c80 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:26:33.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.560+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2c80 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:26:33.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.560+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2c80 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:26:33.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.560+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2c80 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:26:33.566 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 40% complete... Exporting image: 61% complete... Exporting image: 81% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:33.572 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone6@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone6.export 2024-09-21T15:26:33.662 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.660+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3b80 [3/791a4288-2321-4776-a51f-ba5428b8b556] start: already running 2024-09-21T15:26:33.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.660+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3b80 [3/791a4288-2321-4776-a51f-ba5428b8b556] start: already running 2024-09-21T15:26:33.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.660+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3b80 [3/791a4288-2321-4776-a51f-ba5428b8b556] start: already running 2024-09-21T15:26:33.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.660+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3b80 [3/791a4288-2321-4776-a51f-ba5428b8b556] start: already running 2024-09-21T15:26:33.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.660+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3b80 [3/791a4288-2321-4776-a51f-ba5428b8b556] start: already running 2024-09-21T15:26:33.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.660+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3b80 [3/791a4288-2321-4776-a51f-ba5428b8b556] start: already running 2024-09-21T15:26:33.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.660+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3b80 [3/791a4288-2321-4776-a51f-ba5428b8b556] start: already running 2024-09-21T15:26:33.725 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:26:33.725 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:26:33.725 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:26:33.725 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:26:33.725 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:33.725 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:33.725 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:26:33.725 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:26:33.725 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:33.726 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:26:33.726 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:33.726 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:33.726 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:33.726 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:33.726 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:26:33.726 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.720+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:26:33.747 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.736+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fa8f0 2024-09-21T15:26:33.749 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.740+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:26:33.751 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.744+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:26:33.756 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.748+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:26:33.756 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.748+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:33.756 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.748+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:33.756 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.748+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:26:33.761 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.756+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:33.761 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.756+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:33.761 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.756+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:33.761 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:33.756+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:33.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.804+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577680 [3/ace09410-303f-4cc6-8fa7-c5190a4c62e6] start: already running 2024-09-21T15:26:33.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.804+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577680 [3/ace09410-303f-4cc6-8fa7-c5190a4c62e6] start: already running 2024-09-21T15:26:33.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.804+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577680 [3/ace09410-303f-4cc6-8fa7-c5190a4c62e6] start: already running 2024-09-21T15:26:33.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.804+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577680 [3/ace09410-303f-4cc6-8fa7-c5190a4c62e6] start: already running 2024-09-21T15:26:33.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.804+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577680 [3/ace09410-303f-4cc6-8fa7-c5190a4c62e6] start: already running 2024-09-21T15:26:33.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.880+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef28af00 [3/637122ca-60c4-4992-9f94-ae01ebaccd0e] start: already running 2024-09-21T15:26:33.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.880+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef28af00 [3/637122ca-60c4-4992-9f94-ae01ebaccd0e] start: already running 2024-09-21T15:26:33.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576500 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:26:33.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576500 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:26:33.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576500 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:26:33.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576500 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:26:33.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576500 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:26:33.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576500 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:26:33.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576a00 [3/a88a0c18-875d-4624-b7df-602dca14305c] start: already running 2024-09-21T15:26:33.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576a00 [3/a88a0c18-875d-4624-b7df-602dca14305c] start: already running 2024-09-21T15:26:33.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576a00 [3/a88a0c18-875d-4624-b7df-602dca14305c] start: already running 2024-09-21T15:26:33.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576a00 [3/a88a0c18-875d-4624-b7df-602dca14305c] start: already running 2024-09-21T15:26:33.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576a00 [3/a88a0c18-875d-4624-b7df-602dca14305c] start: already running 2024-09-21T15:26:33.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2f00 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:26:33.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2f00 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:26:33.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2f00 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:26:33.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2f00 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:26:33.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:33.884+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2f00 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:26:34.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.004+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef41ca00 [3/7de4521f-65c0-4d27-870f-8b5a840e1a42] start: already running 2024-09-21T15:26:34.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.004+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef41ca00 [3/7de4521f-65c0-4d27-870f-8b5a840e1a42] start: already running 2024-09-21T15:26:34.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.004+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef41ca00 [3/7de4521f-65c0-4d27-870f-8b5a840e1a42] start: already running 2024-09-21T15:26:34.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.004+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef41ca00 [3/7de4521f-65c0-4d27-870f-8b5a840e1a42] start: already running 2024-09-21T15:26:34.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.004+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef41ca00 [3/7de4521f-65c0-4d27-870f-8b5a840e1a42] start: already running 2024-09-21T15:26:34.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.004+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef41ca00 [3/7de4521f-65c0-4d27-870f-8b5a840e1a42] start: already running 2024-09-21T15:26:34.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.004+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef41ca00 [3/7de4521f-65c0-4d27-870f-8b5a840e1a42] start: already running 2024-09-21T15:26:34.057 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 40% complete... Exporting image: 61% complete... Exporting image: 81% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:34.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.060+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef577b80 [3/af962aab-237c-497b-989c-5a6f03523f73] start: already running 2024-09-21T15:26:34.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.060+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef577b80 [3/af962aab-237c-497b-989c-5a6f03523f73] start: already running 2024-09-21T15:26:34.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.060+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef577b80 [3/af962aab-237c-497b-989c-5a6f03523f73] start: already running 2024-09-21T15:26:34.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.060+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef577b80 [3/af962aab-237c-497b-989c-5a6f03523f73] start: already running 2024-09-21T15:26:34.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.060+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef577b80 [3/af962aab-237c-497b-989c-5a6f03523f73] start: already running 2024-09-21T15:26:34.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.064+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2500 [3/6db0eab9-313d-45bf-828c-bf42d15aefce] start: already running 2024-09-21T15:26:34.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.064+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2500 [3/6db0eab9-313d-45bf-828c-bf42d15aefce] start: already running 2024-09-21T15:26:34.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.064+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2500 [3/6db0eab9-313d-45bf-828c-bf42d15aefce] start: already running 2024-09-21T15:26:34.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.064+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2500 [3/6db0eab9-313d-45bf-828c-bf42d15aefce] start: already running 2024-09-21T15:26:34.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.064+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2500 [3/6db0eab9-313d-45bf-828c-bf42d15aefce] start: already running 2024-09-21T15:26:34.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.064+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2500 [3/6db0eab9-313d-45bf-828c-bf42d15aefce] start: already running 2024-09-21T15:26:34.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.064+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2500 [3/6db0eab9-313d-45bf-828c-bf42d15aefce] start: already running 2024-09-21T15:26:34.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone6.export 2024-09-21T15:26:34.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.068+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2780 [3/6dcfb50f-6365-4e2b-904c-11572f8ea5c9] start: already running 2024-09-21T15:26:34.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.068+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2780 [3/6dcfb50f-6365-4e2b-904c-11572f8ea5c9] start: already running 2024-09-21T15:26:34.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.068+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2780 [3/6dcfb50f-6365-4e2b-904c-11572f8ea5c9] start: already running 2024-09-21T15:26:34.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.068+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2780 [3/6dcfb50f-6365-4e2b-904c-11572f8ea5c9] start: already running 2024-09-21T15:26:34.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.068+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2780 [3/6dcfb50f-6365-4e2b-904c-11572f8ea5c9] start: already running 2024-09-21T15:26:34.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.068+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2780 [3/6dcfb50f-6365-4e2b-904c-11572f8ea5c9] start: already running 2024-09-21T15:26:34.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.068+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2780 [3/6dcfb50f-6365-4e2b-904c-11572f8ea5c9] start: already running 2024-09-21T15:26:34.080 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.076+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:26:34.103 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.100+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:26:34.111 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.108+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:26:34.114 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.108+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c0d0 2024-09-21T15:26:34.114 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.108+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:26:34.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.124+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:26:34.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.124+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:26:34.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.124+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350680 2024-09-21T15:26:34.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.124+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:26:34.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.124+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:34.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.124+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:26:34.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.124+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:26:34.131 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.124+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ed00 2024-09-21T15:26:34.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.124+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:34.132 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.124+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5fad0 2024-09-21T15:26:34.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:26:34.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:26:34.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91ab60 2024-09-21T15:26:34.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b450 2024-09-21T15:26:34.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008dd0 2024-09-21T15:26:34.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:26:34.145 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:26:34.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009ee0 2024-09-21T15:26:34.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:26:34.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920680 2024-09-21T15:26:34.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c09208f0 2024-09-21T15:26:34.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:34.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:26:34.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:34.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:26:34.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30ea0 2024-09-21T15:26:34.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f60d0 2024-09-21T15:26:34.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6820 2024-09-21T15:26:34.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f71e0 2024-09-21T15:26:34.146 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.140+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:34.147 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.144+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692340 2024-09-21T15:26:34.147 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.144+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:34.147 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.144+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:34.147 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.144+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:26:34.147 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.144+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:26:34.147 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.144+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:26:34.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.144+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:26:34.148 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:34.144+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:26:34.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.168+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487b80 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:26:34.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.168+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487b80 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:26:34.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.168+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487b80 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:26:34.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.168+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487b80 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:26:34.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.168+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487b80 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:26:34.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.168+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487b80 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:26:34.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.168+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487b80 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:26:34.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.280+0000 7ff753f07700 -1 reset not still connected to 0x56016d985860 2024-09-21T15:26:34.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.280+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:26:34.296 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.292+0000 7ff753f07700 -1 reset not still connected to 0x560170f64b60 2024-09-21T15:26:34.296 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.292+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:26:34.296 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.292+0000 7ff753f07700 -1 reset not still connected to 0x560171f95110 2024-09-21T15:26:34.297 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.292+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:26:34.297 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.292+0000 7ff753f07700 -1 reset not still connected to 0x560173e671e0 2024-09-21T15:26:34.298 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.292+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:26:34.298 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.292+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:34.298 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.296+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:34.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:34.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone6.export 2024-09-21T15:26:34.306 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.296+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:34.306 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.296+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:34.307 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.304+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:26:34.310 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.304+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:26:34.310 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.304+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:34.419 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.412+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:34.431 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.424+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:34.443 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.440+0000 7ff753f07700 -1 reset not still connected to 0x560177272680 2024-09-21T15:26:34.443 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.440+0000 7ff753f07700 -1 reset not still connected to 0x5601772732b0 2024-09-21T15:26:34.443 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.440+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:34.443 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.440+0000 7ff753f07700 -1 reset not still connected to 0x56017a204b60 2024-09-21T15:26:34.443 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.440+0000 7ff753f07700 -1 reset not still connected to 0x56017a2055f0 2024-09-21T15:26:34.443 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.440+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:26:34.444 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.440+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b25b0 2024-09-21T15:26:34.444 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.440+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:26:34.444 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.440+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:26:34.447 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.444+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:34.447 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.444+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:26:34.449 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.444+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cc680 2024-09-21T15:26:34.449 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.444+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cc9c0 2024-09-21T15:26:34.450 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:34.444+0000 7ff753f07700 -1 reset not still connected to 0x56017a8ccdd0 2024-09-21T15:26:34.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone6.export 2024-09-21T15:26:34.538 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:34.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone6.export 2024-09-21T15:26:34.578 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.576+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c7b80 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:26:34.579 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.576+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef28b400 [3/66ab926c-550e-47ad-ad7b-e61c7dbbcd06] start: already running 2024-09-21T15:26:34.579 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.576+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef28b400 [3/66ab926c-550e-47ad-ad7b-e61c7dbbcd06] start: already running 2024-09-21T15:26:34.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef576280 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] start: already running 2024-09-21T15:26:34.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef576280 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] start: already running 2024-09-21T15:26:34.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef576280 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] start: already running 2024-09-21T15:26:34.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef576280 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] start: already running 2024-09-21T15:26:34.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef576280 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] start: already running 2024-09-21T15:26:34.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef576280 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] start: already running 2024-09-21T15:26:34.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486000 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:26:34.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486000 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:26:34.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486000 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:26:34.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486000 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:26:34.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486000 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:26:34.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486000 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:26:34.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486000 [3/887dd3d1-67f5-4f70-aa57-03b613724dc3] start: already running 2024-09-21T15:26:34.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef677400 [3/d38f5425-d707-492a-a5ac-85995dac41f4] start: already running 2024-09-21T15:26:34.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.624+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef677400 [3/d38f5425-d707-492a-a5ac-85995dac41f4] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:26:34.632 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:34.638 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone6.export 2024-09-21T15:26:34.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone6.export 2024-09-21T15:26:34.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.648+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef636500 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:26:34.654 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:34.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:34.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone7 2024-09-21T15:26:34.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:34.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone7 2024-09-21T15:26:34.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:34.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone7.export 2024-09-21T15:26:34.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone7.export 2024-09-21T15:26:34.656 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:34.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.656+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2a00 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:26:34.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.656+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2a00 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:26:34.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.656+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2a00 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:26:34.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.656+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2a00 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:26:34.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.656+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2a00 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:26:34.662 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:34.662 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone7 2024-09-21T15:26:34.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.660+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef636f00 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:26:34.730 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.724+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef28aa00 [3/61e40bd2-a6f8-4810-904b-d9763ddf6fd0] start: already running 2024-09-21T15:26:34.730 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.724+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef28aa00 [3/61e40bd2-a6f8-4810-904b-d9763ddf6fd0] start: already running 2024-09-21T15:26:34.789 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.780+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3b80 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:26:34.790 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.780+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3b80 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:26:34.790 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.780+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3b80 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:26:34.790 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.780+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3b80 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:26:34.790 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.780+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3b80 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:26:34.790 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.780+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3b80 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:26:34.790 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.780+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef864500 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:26:34.790 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.780+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef864500 [3/fa6ea117-5701-4c3c-97d9-547c6b28451e] start: already running 2024-09-21T15:26:34.845 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.840+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2c80 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:26:34.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.840+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2c80 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:26:34.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.840+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2c80 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:26:34.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.840+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2c80 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:26:34.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.840+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2c80 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:26:34.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:34.840+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef676c80 [3/cdc361e2-89eb-4d89-8033-df23aa089fc1] start: already running 2024-09-21T15:26:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:34.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone7.export 2024-09-21T15:26:34.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone7@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone7.export 2024-09-21T15:26:35.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.060+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2780 [3/b0959eb5-273e-4f52-8a00-24247f1f87d2] start: already running 2024-09-21T15:26:35.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.060+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2780 [3/b0959eb5-273e-4f52-8a00-24247f1f87d2] start: already running 2024-09-21T15:26:35.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.060+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2780 [3/b0959eb5-273e-4f52-8a00-24247f1f87d2] start: already running 2024-09-21T15:26:35.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.060+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2780 [3/b0959eb5-273e-4f52-8a00-24247f1f87d2] start: already running 2024-09-21T15:26:35.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.060+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2780 [3/b0959eb5-273e-4f52-8a00-24247f1f87d2] start: already running 2024-09-21T15:26:35.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.060+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef824500 [3/dc948c13-8322-4be7-a64b-971b33e1e040] start: already running 2024-09-21T15:26:35.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.060+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6000 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:26:35.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.060+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6000 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:26:35.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.060+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6000 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:26:35.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.060+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6000 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:26:35.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.060+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6000 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:26:35.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.080+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2c80 [3/72133ade-d434-4fb0-892a-d55cec4945c3] start: already running 2024-09-21T15:26:35.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.080+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2c80 [3/72133ade-d434-4fb0-892a-d55cec4945c3] start: already running 2024-09-21T15:26:35.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.080+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2c80 [3/72133ade-d434-4fb0-892a-d55cec4945c3] start: already running 2024-09-21T15:26:35.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.080+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2c80 [3/72133ade-d434-4fb0-892a-d55cec4945c3] start: already running 2024-09-21T15:26:35.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.080+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2c80 [3/72133ade-d434-4fb0-892a-d55cec4945c3] start: already running 2024-09-21T15:26:35.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.080+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2c80 [3/72133ade-d434-4fb0-892a-d55cec4945c3] start: already running 2024-09-21T15:26:35.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.080+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2c80 [3/72133ade-d434-4fb0-892a-d55cec4945c3] start: already running 2024-09-21T15:26:35.090 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.088+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d900 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:26:35.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.088+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d900 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:26:35.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.088+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d900 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:26:35.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.088+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d900 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:26:35.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.088+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d900 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:26:35.092 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.088+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d900 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:26:35.092 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.088+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d900 [3/872cfdbf-272f-4d9f-a928-da68f2136537] start: already running 2024-09-21T15:26:35.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.112+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef677180 [3/d1ce4217-34a7-462e-a1a0-24ebf7565471] start: already running 2024-09-21T15:26:35.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576780 [3/a886c6ec-95d5-4bec-95d6-90b535ab9694] start: already running 2024-09-21T15:26:35.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576780 [3/a886c6ec-95d5-4bec-95d6-90b535ab9694] start: already running 2024-09-21T15:26:35.123 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576780 [3/a886c6ec-95d5-4bec-95d6-90b535ab9694] start: already running 2024-09-21T15:26:35.123 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576780 [3/a886c6ec-95d5-4bec-95d6-90b535ab9694] start: already running 2024-09-21T15:26:35.123 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576780 [3/a886c6ec-95d5-4bec-95d6-90b535ab9694] start: already running 2024-09-21T15:26:35.123 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d680 [3/867e338b-f348-4ad9-b746-7ff49fa378b8] start: already running 2024-09-21T15:26:35.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d680 [3/867e338b-f348-4ad9-b746-7ff49fa378b8] start: already running 2024-09-21T15:26:35.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d680 [3/867e338b-f348-4ad9-b746-7ff49fa378b8] start: already running 2024-09-21T15:26:35.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d680 [3/867e338b-f348-4ad9-b746-7ff49fa378b8] start: already running 2024-09-21T15:26:35.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d680 [3/867e338b-f348-4ad9-b746-7ff49fa378b8] start: already running 2024-09-21T15:26:35.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d680 [3/867e338b-f348-4ad9-b746-7ff49fa378b8] start: already running 2024-09-21T15:26:35.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41d680 [3/867e338b-f348-4ad9-b746-7ff49fa378b8] start: already running 2024-09-21T15:26:35.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3400 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:26:35.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3400 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:26:35.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3400 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:26:35.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3400 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:26:35.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.120+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3400 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:26:35.139 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.136+0000 7ff753f07700 -1 reset not still connected to 0x560171f95110 2024-09-21T15:26:35.142 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.136+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:35.142 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.136+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:35.142 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.136+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:35.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.208+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef824000 [3/db1aec05-3e9e-4ce0-aee0-ee841cb39971] start: already running 2024-09-21T15:26:35.278 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.260+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:26:35.285 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.280+0000 7ff753f07700 -1 reset not still connected to 0x560171d00dd0 2024-09-21T15:26:35.285 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.280+0000 7ff753f07700 -1 reset not still connected to 0x560171d01d40 2024-09-21T15:26:35.285 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.280+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:26:35.285 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.280+0000 7ff753f07700 -1 reset not still connected to 0x56017219fba0 2024-09-21T15:26:35.285 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.280+0000 7ff753f07700 -1 reset not still connected to 0x560173d87040 2024-09-21T15:26:35.285 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.280+0000 7ff753f07700 -1 reset not still connected to 0x560173e671e0 2024-09-21T15:26:35.286 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.280+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:26:35.286 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.280+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:26:35.286 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.280+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:35.290 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.284+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:35.291 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.288+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:26:35.291 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.288+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d1e0 2024-09-21T15:26:35.292 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.288+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:35.292 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.288+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc9c0 2024-09-21T15:26:35.297 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.292+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0d00 2024-09-21T15:26:35.297 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.292+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:35.297 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.292+0000 7ff753f07700 -1 reset not still connected to 0x5601772732b0 2024-09-21T15:26:35.297 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.292+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:35.297 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e000 2024-09-21T15:26:35.297 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e680 2024-09-21T15:26:35.297 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a16eb60 2024-09-21T15:26:35.297 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:26:35.299 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.296+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:26:35.299 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.296+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:26:35.303 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:35.304 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:26:35.304 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a8ccdd0 2024-09-21T15:26:35.304 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd5f0 2024-09-21T15:26:35.304 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:35.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd930 2024-09-21T15:26:35.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:35.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone7@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone7.export 2024-09-21T15:26:35.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef637680 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:26:35.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef577180 [3/ab585917-bbfb-41ce-a268-5e9596e12ef3] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef577180 [3/ab585917-bbfb-41ce-a268-5e9596e12ef3] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef577180 [3/ab585917-bbfb-41ce-a268-5e9596e12ef3] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef577180 [3/ab585917-bbfb-41ce-a268-5e9596e12ef3] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef577180 [3/ab585917-bbfb-41ce-a268-5e9596e12ef3] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2500 [3/b0925bf1-5012-45a2-afe9-91608ced3c6a] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2500 [3/b0925bf1-5012-45a2-afe9-91608ced3c6a] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2500 [3/b0925bf1-5012-45a2-afe9-91608ced3c6a] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2500 [3/b0925bf1-5012-45a2-afe9-91608ced3c6a] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2500 [3/b0925bf1-5012-45a2-afe9-91608ced3c6a] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576c80 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576c80 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576c80 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576c80 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:26:35.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef576c80 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.352+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef636a00 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef676780 [3/cd2c68f6-f61c-4a24-a394-1bff3bb8adea] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c7900 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3900 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6500 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6500 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6500 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6500 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6500 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2000 [3/afce2605-a8db-416c-a324-7471613e476c] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2000 [3/afce2605-a8db-416c-a324-7471613e476c] start: already running 2024-09-21T15:26:35.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2000 [3/afce2605-a8db-416c-a324-7471613e476c] start: already running 2024-09-21T15:26:35.362 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2000 [3/afce2605-a8db-416c-a324-7471613e476c] start: already running 2024-09-21T15:26:35.362 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.356+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2000 [3/afce2605-a8db-416c-a324-7471613e476c] start: already running 2024-09-21T15:26:35.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.388+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef637900 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:26:35.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.388+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef864f00 [3/ff92add1-cc80-42c3-b549-7eb5463480d3] start: already running 2024-09-21T15:26:35.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.388+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2780 [3/96f7130e-627f-496e-8a7c-886f81d92e20] start: already running 2024-09-21T15:26:35.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.388+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2780 [3/96f7130e-627f-496e-8a7c-886f81d92e20] start: already running 2024-09-21T15:26:35.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.388+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2780 [3/96f7130e-627f-496e-8a7c-886f81d92e20] start: already running 2024-09-21T15:26:35.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.388+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2780 [3/96f7130e-627f-496e-8a7c-886f81d92e20] start: already running 2024-09-21T15:26:35.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.388+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2780 [3/96f7130e-627f-496e-8a7c-886f81d92e20] start: already running 2024-09-21T15:26:35.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.388+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2780 [3/96f7130e-627f-496e-8a7c-886f81d92e20] start: already running 2024-09-21T15:26:35.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.388+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef824c80 [3/e11bf669-24bd-415f-9833-0c4630550c23] start: already running 2024-09-21T15:26:35.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.388+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef677680 [3/d5711052-124e-4725-add4-66cb12cc4034] start: already running 2024-09-21T15:26:35.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.388+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef825900 [3/e513238f-c4c4-4cbc-8a2f-c21215922f5f] start: already running 2024-09-21T15:26:35.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.428+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef825400 [3/e4a35a0f-eabb-4389-9239-82ff9a0828e6] start: already running 2024-09-21T15:26:35.434 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.428+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fa8f0 2024-09-21T15:26:35.446 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.444+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:26:35.447 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.444+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:26:35.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.444+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef824780 [3/dd99a03b-3e52-424a-92c1-99ecc2e48374] start: already running 2024-09-21T15:26:35.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.488+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef841680 [3/f5f9a344-230e-4e5b-b1a4-3e4b4fc4cc86] start: already running 2024-09-21T15:26:35.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.488+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef840780 [3/ee5e1490-4a11-4636-ab8f-ee0651bb84e7] start: already running 2024-09-21T15:26:35.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.488+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef637400 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:26:35.495 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:26:35.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:26:35.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83716c0 2024-09-21T15:26:35.506 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:26:35.506 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:26:35.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:26:35.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:26:35.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:26:35.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d9ba0 2024-09-21T15:26:35.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:26:35.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35dc70 2024-09-21T15:26:35.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:26:35.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:26:35.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:26:35.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:26:35.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6265b0 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b450 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:35.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf110 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f75f0 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692340 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693110 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47f930 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc9c0 2024-09-21T15:26:35.519 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fa8f0 2024-09-21T15:26:35.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:26:35.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:26:35.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:26:35.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:35.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:35.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:35.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:35.504+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:35.739 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:35.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone7.export 2024-09-21T15:26:35.786 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.780+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28b900 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:26:35.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.780+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28b900 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:26:35.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.780+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28b900 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:26:35.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.780+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28b900 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:26:35.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.780+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28b900 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:26:35.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.780+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28b900 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:26:35.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.780+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28b900 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:26:35.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.784+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6280 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:26:35.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.784+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6280 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:26:35.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.784+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6280 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:26:35.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.784+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6280 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:26:35.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.784+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6280 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:26:35.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3400 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:26:35.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3400 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:26:35.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3400 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:26:35.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3400 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:26:35.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3400 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:26:35.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3400 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:26:35.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef840000 [3/e6696bd8-9005-4eeb-8e44-c70647860921] start: already running 2024-09-21T15:26:35.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef841180 [3/f033ad39-c053-43aa-829a-9160c2473e5a] start: already running 2024-09-21T15:26:35.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486f00 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486f00 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486f00 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486f00 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486f00 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486f00 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486f00 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef840280 [3/e6c1e46d-943e-48ab-b899-f1d65ff8944a] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef28b680 [3/69a6bb5f-56ca-4197-9a03-c1f93382494d] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef28b680 [3/69a6bb5f-56ca-4197-9a03-c1f93382494d] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef28b680 [3/69a6bb5f-56ca-4197-9a03-c1f93382494d] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef28b680 [3/69a6bb5f-56ca-4197-9a03-c1f93382494d] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef28b680 [3/69a6bb5f-56ca-4197-9a03-c1f93382494d] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef28b680 [3/69a6bb5f-56ca-4197-9a03-c1f93382494d] start: already running 2024-09-21T15:26:35.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef28b680 [3/69a6bb5f-56ca-4197-9a03-c1f93382494d] start: already running 2024-09-21T15:26:35.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3680 [3/73d4dc39-4c38-488c-8699-cb2c5857bb77] start: already running 2024-09-21T15:26:35.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3680 [3/73d4dc39-4c38-488c-8699-cb2c5857bb77] start: already running 2024-09-21T15:26:35.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3680 [3/73d4dc39-4c38-488c-8699-cb2c5857bb77] start: already running 2024-09-21T15:26:35.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3680 [3/73d4dc39-4c38-488c-8699-cb2c5857bb77] start: already running 2024-09-21T15:26:35.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3680 [3/73d4dc39-4c38-488c-8699-cb2c5857bb77] start: already running 2024-09-21T15:26:35.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3680 [3/73d4dc39-4c38-488c-8699-cb2c5857bb77] start: already running 2024-09-21T15:26:35.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.812+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3680 [3/73d4dc39-4c38-488c-8699-cb2c5857bb77] start: already running 2024-09-21T15:26:35.933 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3680 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:26:35.933 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3680 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:26:35.933 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3680 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:26:35.933 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3680 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:26:35.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3680 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:26:35.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef864c80 [3/fcddc31d-779e-4790-8f04-636821895e73] start: already running 2024-09-21T15:26:35.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2a00 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:26:35.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2a00 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:26:35.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2a00 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:26:35.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2a00 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:26:35.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2a00 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:26:35.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2a00 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:26:35.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2a00 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:26:35.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.928+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef840c80 [3/eee89f94-874b-48ea-bcd4-804b53f039c0] start: already running 2024-09-21T15:26:35.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.952+0000 7ff13c80e700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x561af4b24a80 get_replay_status: replay not running 2024-09-21T15:26:35.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.984+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef864280 [3/f95a7efc-59b9-4291-8e64-f47bf1a0ff4f] start: already running 2024-09-21T15:26:35.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.988+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2280 [3/aff5f3bc-3e8e-4a66-b089-b2f57573290a] start: already running 2024-09-21T15:26:35.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.988+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2280 [3/aff5f3bc-3e8e-4a66-b089-b2f57573290a] start: already running 2024-09-21T15:26:35.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.988+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2280 [3/aff5f3bc-3e8e-4a66-b089-b2f57573290a] start: already running 2024-09-21T15:26:35.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.988+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2280 [3/aff5f3bc-3e8e-4a66-b089-b2f57573290a] start: already running 2024-09-21T15:26:35.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.988+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f2280 [3/aff5f3bc-3e8e-4a66-b089-b2f57573290a] start: already running 2024-09-21T15:26:35.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:35.988+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef677900 [3/d82e23c2-c2b4-4fbc-b384-89a7b6924e53] start: already running 2024-09-21T15:26:36.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:36.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone7.export 2024-09-21T15:26:36.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.040+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef864a00 [3/fc9614b7-402a-4ce0-b4f1-439db186e14d] start: already running 2024-09-21T15:26:36.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone7.export 2024-09-21T15:26:36.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.336+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2a00 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:26:36.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.336+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2a00 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:26:36.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.336+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2a00 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:26:36.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.336+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2a00 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:26:36.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.336+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2a00 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:26:36.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.336+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2a00 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:26:36.549 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:36.559 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone7.export 2024-09-21T15:26:36.593 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef825680 [3/e4d1114b-ada5-4ff8-999f-0119c103708f] start: already running 2024-09-21T15:26:36.593 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d180 [3/8319ade8-0cb1-4b7e-98ca-ced578aceb3e] start: already running 2024-09-21T15:26:36.593 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d180 [3/8319ade8-0cb1-4b7e-98ca-ced578aceb3e] start: already running 2024-09-21T15:26:36.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d180 [3/8319ade8-0cb1-4b7e-98ca-ced578aceb3e] start: already running 2024-09-21T15:26:36.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d180 [3/8319ade8-0cb1-4b7e-98ca-ced578aceb3e] start: already running 2024-09-21T15:26:36.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d180 [3/8319ade8-0cb1-4b7e-98ca-ced578aceb3e] start: already running 2024-09-21T15:26:36.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d180 [3/8319ade8-0cb1-4b7e-98ca-ced578aceb3e] start: already running 2024-09-21T15:26:36.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d180 [3/8319ade8-0cb1-4b7e-98ca-ced578aceb3e] start: already running 2024-09-21T15:26:36.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c280 [3/7a09179e-ea78-49c4-ab31-16f3fb8ff4df] start: already running 2024-09-21T15:26:36.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c280 [3/7a09179e-ea78-49c4-ab31-16f3fb8ff4df] start: already running 2024-09-21T15:26:36.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c280 [3/7a09179e-ea78-49c4-ab31-16f3fb8ff4df] start: already running 2024-09-21T15:26:36.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c280 [3/7a09179e-ea78-49c4-ab31-16f3fb8ff4df] start: already running 2024-09-21T15:26:36.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c280 [3/7a09179e-ea78-49c4-ab31-16f3fb8ff4df] start: already running 2024-09-21T15:26:36.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c280 [3/7a09179e-ea78-49c4-ab31-16f3fb8ff4df] start: already running 2024-09-21T15:26:36.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.588+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c280 [3/7a09179e-ea78-49c4-ab31-16f3fb8ff4df] start: already running 2024-09-21T15:26:36.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.676+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef840500 [3/ed8f9c7d-1492-4fbd-ae77-4c3bfa2f3787] start: already running 2024-09-21T15:26:36.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.676+0000 7ff13c00d700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x561aef6b2e00 get_replay_status: replay not running 2024-09-21T15:26:36.732 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.728+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3180 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:26:36.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.728+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3180 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:26:36.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.728+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3180 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:26:36.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.728+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3180 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:26:36.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.728+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3180 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:26:36.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.728+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3180 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:26:36.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:36.728+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3180 [3/737c0d42-d3d6-4665-a92d-89d76507af57] start: already running 2024-09-21T15:26:36.822 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.812+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:26:36.822 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.812+0000 7ff753f07700 -1 reset not still connected to 0x56016d985860 2024-09-21T15:26:36.824 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.816+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:26:36.827 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.816+0000 7ff753f07700 -1 reset not still connected to 0x56016ea1e340 2024-09-21T15:26:36.827 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.816+0000 7ff753f07700 -1 reset not still connected to 0x56016f162b60 2024-09-21T15:26:36.827 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.816+0000 7ff753f07700 -1 reset not still connected to 0x56016f233ba0 2024-09-21T15:26:36.831 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.820+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2a90 2024-09-21T15:26:36.831 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.820+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:26:36.831 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.820+0000 7ff753f07700 -1 reset not still connected to 0x5601709b80d0 2024-09-21T15:26:36.835 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.824+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:26:36.836 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.824+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:26:36.841 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.836+0000 7ff753f07700 -1 reset not still connected to 0x560173e671e0 2024-09-21T15:26:36.862 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.852+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:26:36.862 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.852+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:26:36.862 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.852+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:36.862 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.852+0000 7ff753f07700 -1 reset not still connected to 0x56017529aea0 2024-09-21T15:26:36.862 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.852+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:36.862 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.852+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0000 2024-09-21T15:26:36.863 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.852+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d930 2024-09-21T15:26:36.863 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.856+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:36.863 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.856+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:36.867 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.860+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:36.867 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.860+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e680 2024-09-21T15:26:36.867 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.860+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:26:36.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:26:36.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:26:36.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:26:36.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:36.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:26:36.871 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd1e0 2024-09-21T15:26:36.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:36.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone7.export 2024-09-21T15:26:36.937 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.932+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:26:36.937 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.932+0000 7ff753f07700 -1 reset not still connected to 0x56016d985860 2024-09-21T15:26:36.944 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.940+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:26:36.958 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.956+0000 7ff753f07700 -1 reset not still connected to 0x56016ea1e340 2024-09-21T15:26:36.965 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.960+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3110 2024-09-21T15:26:36.966 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.960+0000 7ff753f07700 -1 reset not still connected to 0x56016f162b60 2024-09-21T15:26:36.966 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.960+0000 7ff753f07700 -1 reset not still connected to 0x56016f163450 2024-09-21T15:26:36.974 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.968+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:26:36.977 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.972+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2a90 2024-09-21T15:26:36.977 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.972+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:26:36.981 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.976+0000 7ff753f07700 -1 reset not still connected to 0x56016fc981a0 2024-09-21T15:26:36.981 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.976+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:26:36.984 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:26:36.984 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x56017063e1a0 2024-09-21T15:26:36.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x5601709b80d0 2024-09-21T15:26:36.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9520 2024-09-21T15:26:36.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9e10 2024-09-21T15:26:36.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x560170f64b60 2024-09-21T15:26:36.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:26:36.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x560171d00c30 2024-09-21T15:26:36.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x560171f95110 2024-09-21T15:26:36.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:26:36.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x56017219fba0 2024-09-21T15:26:36.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x560173d86a90 2024-09-21T15:26:36.986 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x560173d87040 2024-09-21T15:26:36.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x560173e671e0 2024-09-21T15:26:36.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:26:36.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:26:36.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:36.987 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.980+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7040 2024-09-21T15:26:36.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.984+0000 7ff753f07700 -1 reset not still connected to 0x560174ec76c0 2024-09-21T15:26:36.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.984+0000 7ff753f07700 -1 reset not still connected to 0x56017529ab60 2024-09-21T15:26:36.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.984+0000 7ff753f07700 -1 reset not still connected to 0x56017529aea0 2024-09-21T15:26:36.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.984+0000 7ff753f07700 -1 reset not still connected to 0x56017529b110 2024-09-21T15:26:36.988 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.984+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:36.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.984+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0000 2024-09-21T15:26:36.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.984+0000 7ff753f07700 -1 reset not still connected to 0x5601757d00d0 2024-09-21T15:26:36.995 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.984+0000 7ff753f07700 -1 reset not still connected to 0x5601757d05b0 2024-09-21T15:26:36.998 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.988+0000 7ff753f07700 -1 reset not still connected to 0x560175e1c8f0 2024-09-21T15:26:36.998 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.988+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:26:36.998 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.988+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d1e0 2024-09-21T15:26:36.999 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.992+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d6c0 2024-09-21T15:26:36.999 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.992+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d930 2024-09-21T15:26:36.999 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.992+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:36.999 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.992+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc9c0 2024-09-21T15:26:36.999 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.992+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd860 2024-09-21T15:26:37.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.996+0000 7ff753f07700 -1 reset not still connected to 0x5601766a00d0 2024-09-21T15:26:37.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.996+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0d00 2024-09-21T15:26:37.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.996+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:37.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.996+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1450 2024-09-21T15:26:37.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.996+0000 7ff753f07700 -1 reset not still connected to 0x5601772732b0 2024-09-21T15:26:37.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.996+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:37.003 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:36.996+0000 7ff753f07700 -1 reset not still connected to 0x560177984b60 2024-09-21T15:26:37.007 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.000+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e1a0 2024-09-21T15:26:37.011 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.004+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e680 2024-09-21T15:26:37.015 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.012+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e8f0 2024-09-21T15:26:37.015 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.012+0000 7ff753f07700 -1 reset not still connected to 0x56017a16edd0 2024-09-21T15:26:37.027 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.024+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fad0 2024-09-21T15:26:37.031 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.024+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fe10 2024-09-21T15:26:37.031 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.024+0000 7ff753f07700 -1 reset not still connected to 0x56017a2045b0 2024-09-21T15:26:37.031 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.024+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:26:37.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.024+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2410 2024-09-21T15:26:37.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.024+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:26:37.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.024+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:26:37.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.024+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:26:37.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.024+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:37.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.024+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:26:37.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.024+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ee0 2024-09-21T15:26:37.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.024+0000 7ff753f07700 -1 reset not still connected to 0x56017a8ccdd0 2024-09-21T15:26:37.032 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.024+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd1e0 2024-09-21T15:26:37.040 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.032+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd5f0 2024-09-21T15:26:37.040 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.032+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd6c0 2024-09-21T15:26:37.040 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.032+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd930 2024-09-21T15:26:37.040 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.032+0000 7ff753f07700 -1 reset not still connected to 0x56016878b520 2024-09-21T15:26:37.042 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.036+0000 7ff753f07700 -1 reset not still connected to 0x560169eaa0d0 2024-09-21T15:26:37.042 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.036+0000 7ff753f07700 -1 reset not still connected to 0x560169f10d00 2024-09-21T15:26:37.043 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.040+0000 7ff753f07700 -1 reset not still connected to 0x56016a1c9860 2024-09-21T15:26:37.043 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.040+0000 7ff753f07700 -1 reset not still connected to 0x56016a38c340 2024-09-21T15:26:37.043 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.040+0000 7ff753f07700 -1 reset not still connected to 0x56016ad40c30 2024-09-21T15:26:37.044 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.040+0000 7ff753f07700 -1 reset not still connected to 0x56016b24e820 2024-09-21T15:26:37.044 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.040+0000 7ff753f07700 -1 reset not still connected to 0x56016b9cc1a0 2024-09-21T15:26:37.047 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.040+0000 7ff753f07700 -1 reset not still connected to 0x56016c23aa90 2024-09-21T15:26:37.047 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.040+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:26:37.047 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.040+0000 7ff753f07700 -1 reset not still connected to 0x56016d985860 2024-09-21T15:26:37.050 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.044+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:26:37.050 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.044+0000 7ff753f07700 -1 reset not still connected to 0x56016e8a3380 2024-09-21T15:26:37.050 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.044+0000 7ff753f07700 -1 reset not still connected to 0x56016ea1e340 2024-09-21T15:26:37.050 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.044+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d29c0 2024-09-21T15:26:37.050 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.044+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3110 2024-09-21T15:26:37.050 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.044+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:26:37.050 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.044+0000 7ff753f07700 -1 reset not still connected to 0x56016f162b60 2024-09-21T15:26:37.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.044+0000 7ff753f07700 -1 reset not still connected to 0x56016f163450 2024-09-21T15:26:37.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.044+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:26:37.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.044+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2a90 2024-09-21T15:26:37.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.044+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:26:37.051 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.044+0000 7ff753f07700 -1 reset not still connected to 0x56016fc981a0 2024-09-21T15:26:37.063 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.048+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:26:37.063 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.048+0000 7ff753f07700 -1 reset not still connected to 0x56017063e1a0 2024-09-21T15:26:37.064 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.048+0000 7ff753f07700 -1 reset not still connected to 0x5601709b80d0 2024-09-21T15:26:37.064 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.048+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9520 2024-09-21T15:26:37.065 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.052+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9e10 2024-09-21T15:26:37.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.052+0000 7ff753f07700 -1 reset not still connected to 0x560170f64b60 2024-09-21T15:26:37.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.052+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:26:37.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.052+0000 7ff753f07700 -1 reset not still connected to 0x560171cd5c70 2024-09-21T15:26:37.066 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.052+0000 7ff753f07700 -1 reset not still connected to 0x560171d00c30 2024-09-21T15:26:37.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.060+0000 7ff753f07700 -1 reset not still connected to 0x560171f95110 2024-09-21T15:26:37.067 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.060+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:26:37.068 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.060+0000 7ff753f07700 -1 reset not still connected to 0x56017219fba0 2024-09-21T15:26:37.079 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560173d86a90 2024-09-21T15:26:37.080 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560173d87040 2024-09-21T15:26:37.080 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560173e671e0 2024-09-21T15:26:37.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:26:37.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:26:37.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:37.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7040 2024-09-21T15:26:37.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560174ec76c0 2024-09-21T15:26:37.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017529ab60 2024-09-21T15:26:37.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017529aea0 2024-09-21T15:26:37.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017529b110 2024-09-21T15:26:37.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:37.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0000 2024-09-21T15:26:37.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x5601757d00d0 2024-09-21T15:26:37.081 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x5601757d05b0 2024-09-21T15:26:37.082 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560175e1c8f0 2024-09-21T15:26:37.082 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:26:37.082 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d1e0 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d6c0 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d930 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc9c0 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd860 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x5601766a00d0 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0d00 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1450 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x5601772732b0 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x560177984b60 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e1a0 2024-09-21T15:26:37.083 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e680 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e8f0 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a16edd0 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fad0 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fe10 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a2045b0 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2410 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ee0 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a8ccdd0 2024-09-21T15:26:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd1e0 2024-09-21T15:26:37.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd5f0 2024-09-21T15:26:37.085 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.076+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd930 2024-09-21T15:26:37.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef636280 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:26:37.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2f00 [3/72cf5188-c646-4c84-b151-51750759e12e] start: already running 2024-09-21T15:26:37.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2f00 [3/72cf5188-c646-4c84-b151-51750759e12e] start: already running 2024-09-21T15:26:37.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2f00 [3/72cf5188-c646-4c84-b151-51750759e12e] start: already running 2024-09-21T15:26:37.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2f00 [3/72cf5188-c646-4c84-b151-51750759e12e] start: already running 2024-09-21T15:26:37.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2f00 [3/72cf5188-c646-4c84-b151-51750759e12e] start: already running 2024-09-21T15:26:37.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2f00 [3/72cf5188-c646-4c84-b151-51750759e12e] start: already running 2024-09-21T15:26:37.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2f00 [3/72cf5188-c646-4c84-b151-51750759e12e] start: already running 2024-09-21T15:26:37.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef676f00 [3/ce7fcc29-8d17-41da-ab67-71f2479df285] start: already running 2024-09-21T15:26:37.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487680 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:26:37.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487680 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:26:37.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487680 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:26:37.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487680 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:26:37.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487680 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:26:37.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487680 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:26:37.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.144+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487680 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:26:37.198 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.192+0000 7ff13c00d700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x561afd9c3c00 get_replay_status: replay not running 2024-09-21T15:26:37.209 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone7.export 2024-09-21T15:26:37.248 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.240+0000 7ff13c80e700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x561aefed2000 get_replay_status: replay not running 2024-09-21T15:26:37.248 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.240+0000 7ff13c80e700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x561af53be700 get_replay_status: replay not running 2024-09-21T15:26:37.266 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576000 [3/a15513b2-9cf9-4c80-b9b1-ea6973791935] start: already running 2024-09-21T15:26:37.266 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576000 [3/a15513b2-9cf9-4c80-b9b1-ea6973791935] start: already running 2024-09-21T15:26:37.266 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576000 [3/a15513b2-9cf9-4c80-b9b1-ea6973791935] start: already running 2024-09-21T15:26:37.266 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576000 [3/a15513b2-9cf9-4c80-b9b1-ea6973791935] start: already running 2024-09-21T15:26:37.266 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576000 [3/a15513b2-9cf9-4c80-b9b1-ea6973791935] start: already running 2024-09-21T15:26:37.266 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576000 [3/a15513b2-9cf9-4c80-b9b1-ea6973791935] start: already running 2024-09-21T15:26:37.266 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2f00 [3/9899b7e1-7c24-4bdd-b213-241bfd0956fd] start: already running 2024-09-21T15:26:37.266 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2f00 [3/9899b7e1-7c24-4bdd-b213-241bfd0956fd] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2f00 [3/9899b7e1-7c24-4bdd-b213-241bfd0956fd] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2f00 [3/9899b7e1-7c24-4bdd-b213-241bfd0956fd] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2f00 [3/9899b7e1-7c24-4bdd-b213-241bfd0956fd] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2f00 [3/9899b7e1-7c24-4bdd-b213-241bfd0956fd] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3180 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3180 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3180 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3180 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3180 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3680 [3/9c634cdf-a6f6-482b-a85c-0d163bc3d079] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3680 [3/9c634cdf-a6f6-482b-a85c-0d163bc3d079] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3680 [3/9c634cdf-a6f6-482b-a85c-0d163bc3d079] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3680 [3/9c634cdf-a6f6-482b-a85c-0d163bc3d079] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3680 [3/9c634cdf-a6f6-482b-a85c-0d163bc3d079] start: already running 2024-09-21T15:26:37.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3680 [3/9c634cdf-a6f6-482b-a85c-0d163bc3d079] start: already running 2024-09-21T15:26:37.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef637b80 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:26:37.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576f00 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:26:37.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576f00 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:26:37.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576f00 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:26:37.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576f00 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:26:37.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.260+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef576f00 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:26:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone8 2024-09-21T15:26:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone8 2024-09-21T15:26:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone8.export 2024-09-21T15:26:37.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone8.export 2024-09-21T15:26:37.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone8 2024-09-21T15:26:37.289 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:37.289 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:37.387 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.384+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577900 [3/af7bb590-faa2-4f57-80f6-c5ab02216567] start: already running 2024-09-21T15:26:37.387 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.384+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577900 [3/af7bb590-faa2-4f57-80f6-c5ab02216567] start: already running 2024-09-21T15:26:37.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.384+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577900 [3/af7bb590-faa2-4f57-80f6-c5ab02216567] start: already running 2024-09-21T15:26:37.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.384+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577900 [3/af7bb590-faa2-4f57-80f6-c5ab02216567] start: already running 2024-09-21T15:26:37.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.384+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577900 [3/af7bb590-faa2-4f57-80f6-c5ab02216567] start: already running 2024-09-21T15:26:37.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.384+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3180 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:26:37.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.384+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3180 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:26:37.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.384+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3180 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:26:37.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.384+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3180 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:26:37.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.384+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3180 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:26:37.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.384+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3180 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:26:37.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.384+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef824a00 [3/e0e12844-c372-4352-ae7b-7a7ae05a7f18] start: already running 2024-09-21T15:26:37.423 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.408+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:26:37.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:37.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone8.export 2024-09-21T15:26:37.431 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone8@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone8.export 2024-09-21T15:26:37.468 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.456+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b165b0 2024-09-21T15:26:37.468 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.456+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:26:37.468 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.456+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbad00 2024-09-21T15:26:37.468 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.456+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb110 2024-09-21T15:26:37.469 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.456+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb1e0 2024-09-21T15:26:37.475 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:26:37.475 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0340 2024-09-21T15:26:37.475 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a9c0 2024-09-21T15:26:37.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x5571426288f0 2024-09-21T15:26:37.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:26:37.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8680 2024-09-21T15:26:37.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb91e0 2024-09-21T15:26:37.476 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9d40 2024-09-21T15:26:37.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x557143600c30 2024-09-21T15:26:37.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601110 2024-09-21T15:26:37.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601c70 2024-09-21T15:26:37.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76820 2024-09-21T15:26:37.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b776c0 2024-09-21T15:26:37.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.468+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77a00 2024-09-21T15:26:37.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77c70 2024-09-21T15:26:37.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x557143bf5450 2024-09-21T15:26:37.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a270 2024-09-21T15:26:37.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456c9c0 2024-09-21T15:26:37.478 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456ca90 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af6c30 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f520 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012ea0 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013790 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013930 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bc70 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a820 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29ad00 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29b110 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29bd40 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29be10 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1040 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1860 2024-09-21T15:26:37.479 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1930 2024-09-21T15:26:37.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1d40 2024-09-21T15:26:37.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3520 2024-09-21T15:26:37.480 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.472+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3c70 2024-09-21T15:26:37.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74340 2024-09-21T15:26:37.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74820 2024-09-21T15:26:37.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad75ad0 2024-09-21T15:26:37.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f6c0 2024-09-21T15:26:37.481 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f860 2024-09-21T15:26:37.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07fe10 2024-09-21T15:26:37.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1241a0 2024-09-21T15:26:37.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124680 2024-09-21T15:26:37.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1252b0 2024-09-21T15:26:37.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe270 2024-09-21T15:26:37.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe8f0 2024-09-21T15:26:37.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb12dd0 2024-09-21T15:26:37.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13040 2024-09-21T15:26:37.482 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:37.476+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13ee0 2024-09-21T15:26:37.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.508+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c7180 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:26:37.588 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.584+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef840f00 [3/ef79be89-94fa-4d0c-a9a8-2fd05127bdc5] start: already running 2024-09-21T15:26:37.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 16% complete... Exporting image: 21% complete... Exporting image: 27% complete... Exporting image: 32% complete... Exporting image: 38% complete... Exporting image: 43% complete... Exporting image: 49% complete... Exporting image: 54% complete... Exporting image: 60% complete... Exporting image: 65% complete... Exporting image: 71% complete... Exporting image: 76% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:37.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone8@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone8.export 2024-09-21T15:26:37.714 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.708+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef28ac80 [3/62263722-a51f-40ca-9cc5-1ab605e9bb14] start: already running 2024-09-21T15:26:37.714 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:37.708+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef28ac80 [3/62263722-a51f-40ca-9cc5-1ab605e9bb14] start: already running 2024-09-21T15:26:37.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.772+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:26:37.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.772+0000 7ff753f07700 -1 reset not still connected to 0x56016d985860 2024-09-21T15:26:37.785 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.780+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:26:37.810 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.796+0000 7ff753f07700 -1 reset not still connected to 0x56016ea1e340 2024-09-21T15:26:37.815 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.808+0000 7ff753f07700 -1 reset not still connected to 0x56016f162b60 2024-09-21T15:26:37.815 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.808+0000 7ff753f07700 -1 reset not still connected to 0x56016f163450 2024-09-21T15:26:37.827 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.824+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:26:37.827 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.824+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2a90 2024-09-21T15:26:37.827 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.824+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:26:37.856 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.848+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:26:37.856 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.848+0000 7ff753f07700 -1 reset not still connected to 0x56016fc981a0 2024-09-21T15:26:37.856 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.848+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98b60 2024-09-21T15:26:37.856 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.848+0000 7ff753f07700 -1 reset not still connected to 0x56017063e1a0 2024-09-21T15:26:37.856 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.848+0000 7ff753f07700 -1 reset not still connected to 0x5601709b80d0 2024-09-21T15:26:37.856 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.848+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9520 2024-09-21T15:26:37.865 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x560170f64b60 2024-09-21T15:26:37.865 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:26:37.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x560171d00c30 2024-09-21T15:26:37.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:26:37.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x56017219fba0 2024-09-21T15:26:37.868 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x560173d86a90 2024-09-21T15:26:37.869 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x560173d87040 2024-09-21T15:26:37.869 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x560173e671e0 2024-09-21T15:26:37.869 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:26:37.869 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2b60 2024-09-21T15:26:37.869 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:26:37.869 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:37.869 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x560174ec76c0 2024-09-21T15:26:37.869 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x56017529ab60 2024-09-21T15:26:37.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x56017529aea0 2024-09-21T15:26:37.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:37.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0000 2024-09-21T15:26:37.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x560175e1c8f0 2024-09-21T15:26:37.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:26:37.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d1e0 2024-09-21T15:26:37.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:37.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc9c0 2024-09-21T15:26:37.870 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.856+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd860 2024-09-21T15:26:37.871 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.860+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0d00 2024-09-21T15:26:37.871 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.860+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:37.871 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.860+0000 7ff753f07700 -1 reset not still connected to 0x5601772732b0 2024-09-21T15:26:37.871 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.860+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:37.871 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.860+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e1a0 2024-09-21T15:26:37.871 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.860+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e680 2024-09-21T15:26:37.871 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.860+0000 7ff753f07700 -1 reset not still connected to 0x56017a16edd0 2024-09-21T15:26:37.871 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.860+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fad0 2024-09-21T15:26:37.871 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fe10 2024-09-21T15:26:37.871 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a2045b0 2024-09-21T15:26:37.871 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a204b60 2024-09-21T15:26:37.872 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:26:37.872 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2410 2024-09-21T15:26:37.872 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b3040 2024-09-21T15:26:37.872 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:26:37.872 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.864+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b35f0 2024-09-21T15:26:37.877 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.872+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f20d0 2024-09-21T15:26:37.877 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.872+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:26:37.877 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.872+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:26:37.877 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.872+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:37.878 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.872+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:26:37.878 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.872+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f32b0 2024-09-21T15:26:37.878 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.872+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ad0 2024-09-21T15:26:37.878 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.872+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ba0 2024-09-21T15:26:37.878 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.872+0000 7ff753f07700 -1 reset not still connected to 0x56017a8ccdd0 2024-09-21T15:26:37.878 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.872+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd1e0 2024-09-21T15:26:37.878 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.872+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd5f0 2024-09-21T15:26:37.882 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.876+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd6c0 2024-09-21T15:26:37.892 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:37.888+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd930 2024-09-21T15:26:37.905 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 16% complete... Exporting image: 21% complete... Exporting image: 27% complete... Exporting image: 32% complete... Exporting image: 38% complete... Exporting image: 43% complete... Exporting image: 49% complete... Exporting image: 54% complete... Exporting image: 60% complete... Exporting image: 65% complete... Exporting image: 71% complete... Exporting image: 76% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:37.918 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone8.export 2024-09-21T15:26:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:38.037 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone8.export 2024-09-21T15:26:38.056 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone8.export 2024-09-21T15:26:38.170 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 16% complete... Exporting image: 21% complete... Exporting image: 27% complete... Exporting image: 32% complete... Exporting image: 38% complete... Exporting image: 43% complete... Exporting image: 49% complete... Exporting image: 54% complete... Exporting image: 60% complete... Exporting image: 65% complete... Exporting image: 71% complete... Exporting image: 76% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:38.177 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone8.export 2024-09-21T15:26:38.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.244+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2280 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:26:38.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.244+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2280 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:26:38.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.244+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2280 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:26:38.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.244+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2280 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:26:38.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.244+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2280 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:26:38.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.244+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2280 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:26:38.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.244+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2280 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:26:38.297 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.292+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486500 [3/8a44e3ef-3163-4842-8e5c-c12038e5ac8c] start: already running 2024-09-21T15:26:38.297 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.292+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486500 [3/8a44e3ef-3163-4842-8e5c-c12038e5ac8c] start: already running 2024-09-21T15:26:38.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.292+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486500 [3/8a44e3ef-3163-4842-8e5c-c12038e5ac8c] start: already running 2024-09-21T15:26:38.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.292+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486500 [3/8a44e3ef-3163-4842-8e5c-c12038e5ac8c] start: already running 2024-09-21T15:26:38.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.292+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486500 [3/8a44e3ef-3163-4842-8e5c-c12038e5ac8c] start: already running 2024-09-21T15:26:38.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.292+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486500 [3/8a44e3ef-3163-4842-8e5c-c12038e5ac8c] start: already running 2024-09-21T15:26:38.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.292+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486500 [3/8a44e3ef-3163-4842-8e5c-c12038e5ac8c] start: already running 2024-09-21T15:26:38.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 16% complete... Exporting image: 21% complete... Exporting image: 27% complete... Exporting image: 32% complete... Exporting image: 38% complete... Exporting image: 43% complete... Exporting image: 49% complete... Exporting image: 54% complete... Exporting image: 60% complete... Exporting image: 65% complete... Exporting image: 71% complete... Exporting image: 76% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:38.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.416+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef841400 [3/f2dae9ca-5e22-44e6-90a3-2cbebe5fa594] start: already running 2024-09-21T15:26:38.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.416+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef824280 [3/dc874683-1fb8-422d-a7dc-6396041ed697] start: already running 2024-09-21T15:26:38.426 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone8.export 2024-09-21T15:26:38.443 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.435+0000 7f7fd044c700 -1 reset not still connected to 0x5636a3bce820 2024-09-21T15:26:38.443 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.435+0000 7f7fd044c700 -1 reset not still connected to 0x5636a3bceb60 2024-09-21T15:26:38.454 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.451+0000 7f7fd044c700 -1 reset not still connected to 0x5636a780ed00 2024-09-21T15:26:38.456 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.451+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670680 2024-09-21T15:26:38.456 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.451+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670dd0 2024-09-21T15:26:38.457 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.451+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9e8f520 2024-09-21T15:26:38.461 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.451+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa0baa90 2024-09-21T15:26:38.461 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.451+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:26:38.461 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.451+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e8410 2024-09-21T15:26:38.463 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.455+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:26:38.463 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678f2b0 2024-09-21T15:26:38.463 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:26:38.463 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65110 2024-09-21T15:26:38.464 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff656c0 2024-09-21T15:26:38.464 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65930 2024-09-21T15:26:38.465 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65c70 2024-09-21T15:26:38.465 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbb2b0 2024-09-21T15:26:38.465 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f0ea0 2024-09-21T15:26:38.469 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.463+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1ee0 2024-09-21T15:26:38.469 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.463+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:26:38.469 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.463+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e750 2024-09-21T15:26:38.469 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.463+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbba00 2024-09-21T15:26:38.471 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a8f0 2024-09-21T15:26:38.481 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.475+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f549c0 2024-09-21T15:26:38.481 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.475+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:26:38.481 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.475+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c8f70 2024-09-21T15:26:38.488 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.483+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9ad0 2024-09-21T15:26:38.488 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.483+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9d40 2024-09-21T15:26:38.488 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.483+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:26:38.488 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.483+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:26:38.494 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:26:38.494 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:26:38.494 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c73356c0 2024-09-21T15:26:38.494 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335a00 2024-09-21T15:26:38.494 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335d40 2024-09-21T15:26:38.494 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c83e3ba0 2024-09-21T15:26:38.494 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87661a0 2024-09-21T15:26:38.494 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87676c0 2024-09-21T15:26:38.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8767a00 2024-09-21T15:26:38.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89669c0 2024-09-21T15:26:38.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89672b0 2024-09-21T15:26:38.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967a00 2024-09-21T15:26:38.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:26:38.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:26:38.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51110 2024-09-21T15:26:38.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde261a0 2024-09-21T15:26:38.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde27d40 2024-09-21T15:26:38.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c820 2024-09-21T15:26:38.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c8f0 2024-09-21T15:26:38.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c9c0 2024-09-21T15:26:38.496 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.491+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01cf70 2024-09-21T15:26:38.496 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.491+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d040 2024-09-21T15:26:38.500 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:38.495+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d380 2024-09-21T15:26:38.561 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.556+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef825b80 [3/e51aede5-de84-423f-9449-2f9e9884385e] start: already running 2024-09-21T15:26:38.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone8.export 2024-09-21T15:26:38.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:38.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:38.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.0-clone9 2024-09-21T15:26:38.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:38.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.0-clone9 2024-09-21T15:26:38.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:38.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone9.export 2024-09-21T15:26:38.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone9.export 2024-09-21T15:26:38.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:38.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.0-clone9 2024-09-21T15:26:38.595 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:38.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.612+0000 7ff13c80e700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x561af986e000 get_replay_status: replay not running 2024-09-21T15:26:38.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6780 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:26:38.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6780 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:26:38.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6780 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:26:38.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6780 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:26:38.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6780 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:26:38.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef840a00 [3/ee8573b9-7a14-470f-b519-004503b68b59] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486c80 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486c80 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486c80 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486c80 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486c80 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486c80 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486c80 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef676280 [3/cb06e058-0aca-44b5-9820-87e1992c0207] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cf00 [3/8025792e-3904-4159-9de2-729ebbf24852] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cf00 [3/8025792e-3904-4159-9de2-729ebbf24852] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cf00 [3/8025792e-3904-4159-9de2-729ebbf24852] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cf00 [3/8025792e-3904-4159-9de2-729ebbf24852] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cf00 [3/8025792e-3904-4159-9de2-729ebbf24852] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cf00 [3/8025792e-3904-4159-9de2-729ebbf24852] start: already running 2024-09-21T15:26:38.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cf00 [3/8025792e-3904-4159-9de2-729ebbf24852] start: already running 2024-09-21T15:26:38.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.616+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef637180 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:26:38.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.620+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3900 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] start: already running 2024-09-21T15:26:38.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.620+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3900 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] start: already running 2024-09-21T15:26:38.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.620+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3900 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] start: already running 2024-09-21T15:26:38.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.620+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3900 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] start: already running 2024-09-21T15:26:38.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.620+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3900 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] start: already running 2024-09-21T15:26:38.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.620+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3900 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] start: already running 2024-09-21T15:26:38.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.620+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3900 [3/7709c520-de3e-4233-b3f0-5c64fc1f07b2] start: already running 2024-09-21T15:26:38.786 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:38.787 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone9.export 2024-09-21T15:26:38.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone9@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone9.export 2024-09-21T15:26:38.913 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:38.908+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef864000 [3/f8d89eff-024f-42e6-b9d0-84b0bdc5274c] start: already running 2024-09-21T15:26:38.929 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.924+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b450f70 2024-09-21T15:26:38.955 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.936+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ef80410 2024-09-21T15:26:38.955 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.936+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4410 2024-09-21T15:26:38.978 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.960+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:26:38.978 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.960+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:26:38.978 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.960+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:26:38.978 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.960+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbad00 2024-09-21T15:26:38.978 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.960+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb110 2024-09-21T15:26:38.980 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:26:38.985 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0340 2024-09-21T15:26:38.986 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a9c0 2024-09-21T15:26:38.986 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8680 2024-09-21T15:26:38.986 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb91e0 2024-09-21T15:26:38.986 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601c70 2024-09-21T15:26:38.986 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76820 2024-09-21T15:26:38.986 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77a00 2024-09-21T15:26:38.990 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77c70 2024-09-21T15:26:38.990 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a270 2024-09-21T15:26:38.990 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456ca90 2024-09-21T15:26:38.990 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x557144e6aa90 2024-09-21T15:26:38.990 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af6c30 2024-09-21T15:26:38.990 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.976+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af7930 2024-09-21T15:26:38.990 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.980+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f520 2024-09-21T15:26:38.991 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.980+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012ea0 2024-09-21T15:26:38.991 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.980+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013790 2024-09-21T15:26:38.991 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.980+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013930 2024-09-21T15:26:38.992 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.980+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bc70 2024-09-21T15:26:38.992 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.980+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a820 2024-09-21T15:26:38.992 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.980+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29ad00 2024-09-21T15:26:38.992 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.980+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29b110 2024-09-21T15:26:38.992 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.980+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29bd40 2024-09-21T15:26:38.993 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.980+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29be10 2024-09-21T15:26:38.993 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.980+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1040 2024-09-21T15:26:38.994 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.988+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1930 2024-09-21T15:26:39.001 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.988+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1d40 2024-09-21T15:26:39.005 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.996+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74340 2024-09-21T15:26:39.005 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.996+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad75ad0 2024-09-21T15:26:39.007 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:38.996+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f6c0 2024-09-21T15:26:39.009 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.004+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f860 2024-09-21T15:26:39.009 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.004+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1241a0 2024-09-21T15:26:39.009 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.004+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124680 2024-09-21T15:26:39.009 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.004+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1252b0 2024-09-21T15:26:39.010 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.004+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe270 2024-09-21T15:26:39.010 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.004+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe8f0 2024-09-21T15:26:39.010 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.004+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb12dd0 2024-09-21T15:26:39.010 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.004+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13040 2024-09-21T15:26:39.010 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.004+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13ad0 2024-09-21T15:26:39.102 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.096+0000 7f52f1ba9700 -1 reset not still connected to 0x55713a49cb60 2024-09-21T15:26:39.103 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.096+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b450f70 2024-09-21T15:26:39.103 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.096+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c10c000 2024-09-21T15:26:39.103 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.096+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c213380 2024-09-21T15:26:39.114 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.104+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ba0 2024-09-21T15:26:39.115 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.104+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81ba0 2024-09-21T15:26:39.115 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.104+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cdad0 2024-09-21T15:26:39.116 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.104+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ea58dd0 2024-09-21T15:26:39.116 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.104+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ef80410 2024-09-21T15:26:39.124 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.108+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4410 2024-09-21T15:26:39.124 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.108+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5790 2024-09-21T15:26:39.124 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.108+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:26:39.124 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.108+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:26:39.148 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.136+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:26:39.163 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cea0 2024-09-21T15:26:39.164 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dee0 2024-09-21T15:26:39.164 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.152+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed01a0 2024-09-21T15:26:39.164 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.152+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed1930 2024-09-21T15:26:39.164 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.152+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16b60 2024-09-21T15:26:39.164 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.152+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb0000 2024-09-21T15:26:39.164 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.152+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:26:39.164 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.152+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbad00 2024-09-21T15:26:39.165 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.152+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb110 2024-09-21T15:26:39.166 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.156+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb1e0 2024-09-21T15:26:39.166 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.156+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:26:39.166 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.156+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0340 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.156+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a9c0 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.156+0000 7f52f1ba9700 -1 reset not still connected to 0x5571426288f0 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8680 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb91e0 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557143600c30 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601040 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601110 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601c70 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76820 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76f70 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77380 2024-09-21T15:26:39.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b776c0 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77a00 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77c70 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557143bf5450 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a270 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456c9c0 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456ca90 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456d450 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557144e6aa90 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af6c30 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af7930 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f520 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012ea0 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013790 2024-09-21T15:26:39.168 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013930 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bc70 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a820 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29ad00 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29b110 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29bd40 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29be10 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1040 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1380 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1860 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1930 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1d40 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3520 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3c70 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74340 2024-09-21T15:26:39.169 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74820 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad75ad0 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07e750 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f6c0 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f860 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07fe10 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1241a0 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124680 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1252b0 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714c0c1ad0 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe270 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe8f0 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb12dd0 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13040 2024-09-21T15:26:39.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb136c0 2024-09-21T15:26:39.171 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:39.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13ad0 2024-09-21T15:26:39.332 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.320+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:26:39.394 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.384+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:26:39.396 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.384+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76dd0 2024-09-21T15:26:39.396 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.384+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d9c70 2024-09-21T15:26:39.396 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.384+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5635380 2024-09-21T15:26:39.405 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.392+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:26:39.407 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.392+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:26:39.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:26:39.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46680 2024-09-21T15:26:39.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:26:39.413 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a5b0 2024-09-21T15:26:39.417 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:26:39.417 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:26:39.417 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cdad0 2024-09-21T15:26:39.417 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c09c0 2024-09-21T15:26:39.417 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:26:39.417 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1651e0 2024-09-21T15:26:39.417 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d9ba0 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35dc70 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:26:39.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:39.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:26:39.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53040 2024-09-21T15:26:39.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:26:39.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:26:39.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:39.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:26:39.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:26:39.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:26:39.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:26:39.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:26:39.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:26:39.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:26:39.419 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:26:39.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:39.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:26:39.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:26:39.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:26:39.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:39.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6820 2024-09-21T15:26:39.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:26:39.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:39.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:26:39.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:39.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:39.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:26:39.420 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:26:39.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:26:39.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:26:39.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ad639ad0 2024-09-21T15:26:39.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:26:39.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:26:39.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:39.421 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:26:39.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.480+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:26:39.507 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:26:39.507 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.496+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:26:39.508 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:39.516 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:26:39.516 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:26:39.516 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:39.517 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:26:39.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:39.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:26:39.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:39.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:39.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:26:39.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:39.518 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:39.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.528+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:26:39.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.528+0000 7ff753f07700 -1 reset not still connected to 0x56016cdba000 2024-09-21T15:26:39.538 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.532+0000 7ff753f07700 -1 reset not still connected to 0x56016d985860 2024-09-21T15:26:39.551 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.540+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:26:39.557 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.552+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:26:39.557 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.552+0000 7ff753f07700 -1 reset not still connected to 0x56016ea1e340 2024-09-21T15:26:39.562 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.548+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:26:39.562 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.548+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:39.563 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3110 2024-09-21T15:26:39.563 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x56016f162270 2024-09-21T15:26:39.563 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x56016f162b60 2024-09-21T15:26:39.564 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x56016f163450 2024-09-21T15:26:39.564 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2a90 2024-09-21T15:26:39.564 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:26:39.564 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x5601709b80d0 2024-09-21T15:26:39.572 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9520 2024-09-21T15:26:39.572 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x560170f64b60 2024-09-21T15:26:39.572 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:26:39.572 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:26:39.572 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x560171d00c30 2024-09-21T15:26:39.572 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:26:39.572 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:26:39.572 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x56017219fba0 2024-09-21T15:26:39.572 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x560173d87040 2024-09-21T15:26:39.572 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x560173e671e0 2024-09-21T15:26:39.572 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.560+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:26:39.574 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.568+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2b60 2024-09-21T15:26:39.574 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.568+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:26:39.574 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.568+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:39.574 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.568+0000 7ff753f07700 -1 reset not still connected to 0x56017529aea0 2024-09-21T15:26:39.574 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.568+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:39.574 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.568+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0000 2024-09-21T15:26:39.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:26:39.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:26:39.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:39.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:26:39.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:39.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:26:39.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:39.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:39.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:26:39.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:39.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:39.589 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.580+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:26:39.598 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.584+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:39.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.584+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc9c0 2024-09-21T15:26:39.599 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.584+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd860 2024-09-21T15:26:39.618 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0d00 2024-09-21T15:26:39.618 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:39.618 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x5601772732b0 2024-09-21T15:26:39.618 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:39.618 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e680 2024-09-21T15:26:39.618 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fad0 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a2045b0 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a204b60 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2410 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b3040 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b35f0 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f20d0 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ad0 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a8ccdd0 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd1e0 2024-09-21T15:26:39.619 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:39.612+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd5f0 2024-09-21T15:26:39.751 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:39.755 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.752+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cc80 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] start: already running 2024-09-21T15:26:39.755 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.752+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cc80 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] start: already running 2024-09-21T15:26:39.755 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.752+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cc80 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] start: already running 2024-09-21T15:26:39.755 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.752+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cc80 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] start: already running 2024-09-21T15:26:39.755 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.752+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cc80 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] start: already running 2024-09-21T15:26:39.755 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.752+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cc80 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] start: already running 2024-09-21T15:26:39.755 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.752+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41cc80 [3/7f000672-af45-450e-aaab-fb2ef2b65d33] start: already running 2024-09-21T15:26:39.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone9@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone9.export 2024-09-21T15:26:39.861 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.856+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef676000 [3/cadd6ca4-c18a-4ad2-8262-041d93168f2b] start: already running 2024-09-21T15:26:39.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.856+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28bb80 [3/6af429ba-f735-4db2-8ce0-990e9e419129] start: already running 2024-09-21T15:26:39.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.856+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28bb80 [3/6af429ba-f735-4db2-8ce0-990e9e419129] start: already running 2024-09-21T15:26:39.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.856+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28bb80 [3/6af429ba-f735-4db2-8ce0-990e9e419129] start: already running 2024-09-21T15:26:39.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.856+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28bb80 [3/6af429ba-f735-4db2-8ce0-990e9e419129] start: already running 2024-09-21T15:26:39.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.856+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28bb80 [3/6af429ba-f735-4db2-8ce0-990e9e419129] start: already running 2024-09-21T15:26:39.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.856+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28bb80 [3/6af429ba-f735-4db2-8ce0-990e9e419129] start: already running 2024-09-21T15:26:39.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.856+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28bb80 [3/6af429ba-f735-4db2-8ce0-990e9e419129] start: already running 2024-09-21T15:26:39.903 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.900+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28b180 [3/639e7549-39e6-4963-86db-7a414ac8d909] start: already running 2024-09-21T15:26:39.903 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.900+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef28b180 [3/639e7549-39e6-4963-86db-7a414ac8d909] start: already running 2024-09-21T15:26:39.917 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.912+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c780 [3/7da6e340-1c90-4fa6-9dff-abf5cab1d562] start: already running 2024-09-21T15:26:39.917 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.912+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c780 [3/7da6e340-1c90-4fa6-9dff-abf5cab1d562] start: already running 2024-09-21T15:26:39.917 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.912+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c780 [3/7da6e340-1c90-4fa6-9dff-abf5cab1d562] start: already running 2024-09-21T15:26:39.917 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.912+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c780 [3/7da6e340-1c90-4fa6-9dff-abf5cab1d562] start: already running 2024-09-21T15:26:39.917 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.912+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c780 [3/7da6e340-1c90-4fa6-9dff-abf5cab1d562] start: already running 2024-09-21T15:26:39.918 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.912+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c780 [3/7da6e340-1c90-4fa6-9dff-abf5cab1d562] start: already running 2024-09-21T15:26:39.918 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:39.912+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c780 [3/7da6e340-1c90-4fa6-9dff-abf5cab1d562] start: already running 2024-09-21T15:26:40.005 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:39.996+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:40.006 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:26:40.006 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.000+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:40.020 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.008+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:40.021 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.008+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:40.036 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.032+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:26:40.040 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.032+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:26:40.040 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.032+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:26:40.213 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.208+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:26:40.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.208+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:26:40.214 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.208+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:26:40.233 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.220+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:26:40.233 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.220+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:26:40.234 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.220+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:26:40.234 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.220+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:26:40.234 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.220+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:26:40.234 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.220+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:26:40.234 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.220+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:26:40.234 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.220+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:26:40.234 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.220+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:26:40.239 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.232+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:26:40.239 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.232+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:40.246 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.232+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:26:40.246 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.232+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53040 2024-09-21T15:26:40.246 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.232+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:26:40.246 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.232+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:26:40.246 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.232+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ec30 2024-09-21T15:26:40.246 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.232+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:40.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.244+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:26:40.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.244+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:26:40.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.244+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:26:40.259 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.244+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:26:40.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.260+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:26:40.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.260+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:26:40.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.260+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:26:40.266 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.260+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:40.274 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.264+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:26:40.274 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.264+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:26:40.274 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.264+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:40.274 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.264+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae9c0 2024-09-21T15:26:40.274 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.264+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30d00 2024-09-21T15:26:40.274 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.264+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:26:40.274 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.264+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:26:40.274 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.264+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:40.274 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.264+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:26:40.275 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.264+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:40.275 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.264+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:40.275 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.264+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:26:40.275 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:40.264+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:26:40.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.340+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6f00 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:26:40.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.340+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6a00 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:26:40.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.340+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6a00 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:26:40.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.340+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6a00 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:26:40.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.340+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6a00 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:26:40.345 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.340+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef5c6a00 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:26:40.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:40.394 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone9.export 2024-09-21T15:26:40.474 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.468+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef676500 [3/cb421ca2-8e98-43a7-b278-4fac682f0a47] start: already running 2024-09-21T15:26:40.479 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670680 2024-09-21T15:26:40.479 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670dd0 2024-09-21T15:26:40.479 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9e8f520 2024-09-21T15:26:40.485 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.479+0000 7f7fd044c700 -1 reset not still connected to 0x5636ab3b5d40 2024-09-21T15:26:40.485 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.479+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:26:40.485 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.479+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e8410 2024-09-21T15:26:40.486 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.483+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:26:40.489 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.483+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e1a0 2024-09-21T15:26:40.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678f2b0 2024-09-21T15:26:40.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.487+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb84e0 2024-09-21T15:26:40.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.491+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65110 2024-09-21T15:26:40.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.491+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff656c0 2024-09-21T15:26:40.495 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.491+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65c70 2024-09-21T15:26:40.499 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.491+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbb2b0 2024-09-21T15:26:40.499 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.491+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f0f70 2024-09-21T15:26:40.499 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.491+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1c70 2024-09-21T15:26:40.499 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.495+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1ee0 2024-09-21T15:26:40.510 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.503+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f880d0 2024-09-21T15:26:40.510 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.503+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:26:40.514 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.507+0000 7f7fd044c700 -1 reset not still connected to 0x5636c47095f0 2024-09-21T15:26:40.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.507+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e750 2024-09-21T15:26:40.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.507+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5930 2024-09-21T15:26:40.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.507+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4bbbd40 2024-09-21T15:26:40.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.507+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a8f0 2024-09-21T15:26:40.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.507+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:26:40.515 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.511+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3a00 2024-09-21T15:26:40.519 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9790 2024-09-21T15:26:40.519 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9ad0 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9c70 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7334340 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335a00 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87676c0 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89669c0 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89672b0 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967a00 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:26:40.520 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51110 2024-09-21T15:26:40.521 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde261a0 2024-09-21T15:26:40.521 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde27d40 2024-09-21T15:26:40.521 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636ce7e9790 2024-09-21T15:26:40.521 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c820 2024-09-21T15:26:40.521 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c8f0 2024-09-21T15:26:40.521 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c9c0 2024-09-21T15:26:40.521 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01cf70 2024-09-21T15:26:40.522 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d040 2024-09-21T15:26:40.522 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d2b0 2024-09-21T15:26:40.522 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d380 2024-09-21T15:26:40.522 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636a3bceb60 2024-09-21T15:26:40.522 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e8410 2024-09-21T15:26:40.522 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:26:40.522 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.515+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:26:40.531 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.524+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2000 [3/6c3b3b70-9cbd-4de9-9ecc-2955d67c515d] start: already running 2024-09-21T15:26:40.531 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.524+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2000 [3/6c3b3b70-9cbd-4de9-9ecc-2955d67c515d] start: already running 2024-09-21T15:26:40.531 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.524+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2000 [3/6c3b3b70-9cbd-4de9-9ecc-2955d67c515d] start: already running 2024-09-21T15:26:40.531 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.524+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2000 [3/6c3b3b70-9cbd-4de9-9ecc-2955d67c515d] start: already running 2024-09-21T15:26:40.531 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.524+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2000 [3/6c3b3b70-9cbd-4de9-9ecc-2955d67c515d] start: already running 2024-09-21T15:26:40.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.524+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2000 [3/6c3b3b70-9cbd-4de9-9ecc-2955d67c515d] start: already running 2024-09-21T15:26:40.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.524+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e2000 [3/6c3b3b70-9cbd-4de9-9ecc-2955d67c515d] start: already running 2024-09-21T15:26:40.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.524+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487900 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:26:40.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.524+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef487900 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:26:40.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef487900 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] start: already running 2024-09-21T15:26:40.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef487900 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] start: already running 2024-09-21T15:26:40.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef487900 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] start: already running 2024-09-21T15:26:40.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef487900 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] start: already running 2024-09-21T15:26:40.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef487900 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] start: already running 2024-09-21T15:26:40.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef487900 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] start: already running 2024-09-21T15:26:40.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef487900 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] start: already running 2024-09-21T15:26:40.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef825180 [3/e33347f9-479f-4080-b33f-92c69acaa835] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:26:40.533 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef825180 [3/e33347f9-479f-4080-b33f-92c69acaa835] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:26:40.533 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef825180 [3/e33347f9-479f-4080-b33f-92c69acaa835] start: already running 2024-09-21T15:26:40.533 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef677b80 [3/daaa2558-921a-4582-8589-6037454cf77e] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:26:40.533 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef677b80 [3/daaa2558-921a-4582-8589-6037454cf77e] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:26:40.533 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef677b80 [3/daaa2558-921a-4582-8589-6037454cf77e] start: already running 2024-09-21T15:26:40.533 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef636c80 [3/c2f4442b-fb50-43c3-b857-324706ebb952] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:26:40.533 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef636c80 [3/c2f4442b-fb50-43c3-b857-324706ebb952] register_admin_socket_hook: error registering admin socket commands 2024-09-21T15:26:40.534 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.528+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef636c80 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:26:40.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:40.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone9.export 2024-09-21T15:26:40.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.0-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone9.export 2024-09-21T15:26:40.601 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.587+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670680 2024-09-21T15:26:40.603 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.591+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670dd0 2024-09-21T15:26:40.603 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.591+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9e8f520 2024-09-21T15:26:40.603 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.591+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa0baa90 2024-09-21T15:26:40.603 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.591+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:26:40.603 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.591+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e8410 2024-09-21T15:26:40.603 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.591+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:26:40.603 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.591+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678f2b0 2024-09-21T15:26:40.604 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.591+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65110 2024-09-21T15:26:40.604 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.591+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff656c0 2024-09-21T15:26:40.617 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.611+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65c70 2024-09-21T15:26:40.617 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.611+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbb2b0 2024-09-21T15:26:40.617 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.611+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1c70 2024-09-21T15:26:40.617 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.611+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1ee0 2024-09-21T15:26:40.617 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.611+0000 7f7fd044c700 -1 reset not still connected to 0x5636c45048f0 2024-09-21T15:26:40.617 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.611+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e750 2024-09-21T15:26:40.619 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.611+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4c9a8f0 2024-09-21T15:26:40.619 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.611+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:26:40.620 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.615+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9ad0 2024-09-21T15:26:40.620 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.615+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:26:40.620 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.615+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:26:40.620 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.615+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:26:40.620 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.615+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66912b0 2024-09-21T15:26:40.620 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.615+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:26:40.623 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.615+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335a00 2024-09-21T15:26:40.623 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.615+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766750 2024-09-21T15:26:40.623 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.615+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87676c0 2024-09-21T15:26:40.623 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.615+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89669c0 2024-09-21T15:26:40.623 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.615+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89672b0 2024-09-21T15:26:40.623 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.615+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967a00 2024-09-21T15:26:40.623 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.615+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:26:40.627 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.619+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:26:40.627 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.619+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51110 2024-09-21T15:26:40.627 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.619+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde261a0 2024-09-21T15:26:40.627 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.619+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde27d40 2024-09-21T15:26:40.627 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.619+0000 7f7fd044c700 -1 reset not still connected to 0x5636ce7e9790 2024-09-21T15:26:40.627 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.619+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c820 2024-09-21T15:26:40.627 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.619+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c8f0 2024-09-21T15:26:40.627 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.619+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c9c0 2024-09-21T15:26:40.627 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.619+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01cf70 2024-09-21T15:26:40.627 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.619+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d040 2024-09-21T15:26:40.627 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.619+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d2b0 2024-09-21T15:26:40.628 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:26:40.619+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d380 2024-09-21T15:26:40.648 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.644+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c213380 2024-09-21T15:26:40.663 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.652+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ba0 2024-09-21T15:26:40.678 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.672+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cdad0 2024-09-21T15:26:40.678 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.672+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ea58dd0 2024-09-21T15:26:40.678 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.672+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ef80410 2024-09-21T15:26:40.682 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.676+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4410 2024-09-21T15:26:40.682 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.676+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4a90 2024-09-21T15:26:40.682 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.676+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5790 2024-09-21T15:26:40.682 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.676+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:26:40.682 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.676+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:26:40.682 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.676+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:26:40.682 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.676+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cea0 2024-09-21T15:26:40.683 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.680+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16b60 2024-09-21T15:26:40.683 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.680+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17040 2024-09-21T15:26:40.683 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.680+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:26:40.683 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.680+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbad00 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb110 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb1e0 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0340 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0dd0 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a9c0 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x5571426288f0 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8680 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb91e0 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557143600c30 2024-09-21T15:26:40.691 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601110 2024-09-21T15:26:40.692 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.684+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601c70 2024-09-21T15:26:40.693 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.688+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76820 2024-09-21T15:26:40.693 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.688+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77380 2024-09-21T15:26:40.693 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.688+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b776c0 2024-09-21T15:26:40.693 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.688+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77a00 2024-09-21T15:26:40.695 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.688+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77c70 2024-09-21T15:26:40.696 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.688+0000 7f52f1ba9700 -1 reset not still connected to 0x557143bf5450 2024-09-21T15:26:40.700 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.696+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a270 2024-09-21T15:26:40.700 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.696+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456ca90 2024-09-21T15:26:40.701 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.696+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af6c30 2024-09-21T15:26:40.701 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.696+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af7930 2024-09-21T15:26:40.701 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.696+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f520 2024-09-21T15:26:40.701 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.696+0000 7f52f1ba9700 -1 reset not still connected to 0x5571480005b0 2024-09-21T15:26:40.701 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.696+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012ea0 2024-09-21T15:26:40.701 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.696+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013790 2024-09-21T15:26:40.701 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.696+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013930 2024-09-21T15:26:40.701 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.696+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bba0 2024-09-21T15:26:40.701 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.696+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bc70 2024-09-21T15:26:40.701 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.696+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a820 2024-09-21T15:26:40.704 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29ad00 2024-09-21T15:26:40.705 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29b110 2024-09-21T15:26:40.705 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29bd40 2024-09-21T15:26:40.705 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29be10 2024-09-21T15:26:40.705 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1040 2024-09-21T15:26:40.705 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1520 2024-09-21T15:26:40.705 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1930 2024-09-21T15:26:40.705 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1d40 2024-09-21T15:26:40.705 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3520 2024-09-21T15:26:40.705 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3c70 2024-09-21T15:26:40.705 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74340 2024-09-21T15:26:40.706 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74820 2024-09-21T15:26:40.706 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad75ad0 2024-09-21T15:26:40.706 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f6c0 2024-09-21T15:26:40.706 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f860 2024-09-21T15:26:40.706 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124000 2024-09-21T15:26:40.706 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1241a0 2024-09-21T15:26:40.706 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124680 2024-09-21T15:26:40.706 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1252b0 2024-09-21T15:26:40.706 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714c0c1ad0 2024-09-21T15:26:40.707 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe270 2024-09-21T15:26:40.707 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe8f0 2024-09-21T15:26:40.707 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ff5f0 2024-09-21T15:26:40.707 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ff790 2024-09-21T15:26:40.707 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb12dd0 2024-09-21T15:26:40.707 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13040 2024-09-21T15:26:40.707 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:40.700+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb136c0 2024-09-21T15:26:40.759 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.756+0000 7ff13c80e700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x561afc225880 get_replay_status: replay not running 2024-09-21T15:26:40.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.796+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef841900 [3/f620a0f2-d707-4b9a-9838-275e4f310336] start: already running 2024-09-21T15:26:40.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.796+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c500 [3/7d0b51cc-d698-4c7c-856b-37b97a187993] start: already running 2024-09-21T15:26:40.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.796+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c500 [3/7d0b51cc-d698-4c7c-856b-37b97a187993] start: already running 2024-09-21T15:26:40.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.796+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c500 [3/7d0b51cc-d698-4c7c-856b-37b97a187993] start: already running 2024-09-21T15:26:40.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.796+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c500 [3/7d0b51cc-d698-4c7c-856b-37b97a187993] start: already running 2024-09-21T15:26:40.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.796+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c500 [3/7d0b51cc-d698-4c7c-856b-37b97a187993] start: already running 2024-09-21T15:26:40.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.796+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c500 [3/7d0b51cc-d698-4c7c-856b-37b97a187993] start: already running 2024-09-21T15:26:40.801 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.796+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41c500 [3/7d0b51cc-d698-4c7c-856b-37b97a187993] start: already running 2024-09-21T15:26:40.821 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.816+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d400 [3/85d0a44e-84cb-4cc5-bee6-694533ad4fbd] start: already running 2024-09-21T15:26:40.821 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.816+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d400 [3/85d0a44e-84cb-4cc5-bee6-694533ad4fbd] start: already running 2024-09-21T15:26:40.821 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.816+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d400 [3/85d0a44e-84cb-4cc5-bee6-694533ad4fbd] start: already running 2024-09-21T15:26:40.821 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.816+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d400 [3/85d0a44e-84cb-4cc5-bee6-694533ad4fbd] start: already running 2024-09-21T15:26:40.821 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.816+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d400 [3/85d0a44e-84cb-4cc5-bee6-694533ad4fbd] start: already running 2024-09-21T15:26:40.821 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.816+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d400 [3/85d0a44e-84cb-4cc5-bee6-694533ad4fbd] start: already running 2024-09-21T15:26:40.821 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.816+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef41d400 [3/85d0a44e-84cb-4cc5-bee6-694533ad4fbd] start: already running 2024-09-21T15:26:40.821 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.816+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef676a00 [3/cdafaff4-6b78-454a-b798-210e8f89802f] start: already running 2024-09-21T15:26:40.822 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.816+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c7400 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:26:40.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.836+0000 7ff13c80e700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x561af00b9880 get_replay_status: replay not running 2024-09-21T15:26:40.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.856+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3900 [3/9f1ae171-c261-402d-a90a-2b4cca77a51c] start: already running 2024-09-21T15:26:40.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.856+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3900 [3/9f1ae171-c261-402d-a90a-2b4cca77a51c] start: already running 2024-09-21T15:26:40.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.856+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3900 [3/9f1ae171-c261-402d-a90a-2b4cca77a51c] start: already running 2024-09-21T15:26:40.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.856+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3900 [3/9f1ae171-c261-402d-a90a-2b4cca77a51c] start: already running 2024-09-21T15:26:40.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.856+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3900 [3/9f1ae171-c261-402d-a90a-2b4cca77a51c] start: already running 2024-09-21T15:26:40.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.856+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d3900 [3/9f1ae171-c261-402d-a90a-2b4cca77a51c] start: already running 2024-09-21T15:26:40.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.872+0000 7ff13c80e700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x561af04c6000 get_replay_status: replay not running 2024-09-21T15:26:40.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.876+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef824f00 [3/e2c7112f-7834-4998-b6f4-09f9fd94ae24] start: already running 2024-09-21T15:26:40.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.876+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef636780 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:26:40.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.876+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486a00 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:26:40.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.876+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486a00 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:26:40.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.876+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486a00 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:26:40.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.876+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486a00 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:26:40.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.876+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486a00 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:26:40.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.876+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486a00 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:26:40.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.876+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef486a00 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:26:40.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.896+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3400 [3/73b4e1fe-3f10-4db7-b803-aa7461633260] start: already running 2024-09-21T15:26:40.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.896+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3400 [3/73b4e1fe-3f10-4db7-b803-aa7461633260] start: already running 2024-09-21T15:26:40.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.896+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3400 [3/73b4e1fe-3f10-4db7-b803-aa7461633260] start: already running 2024-09-21T15:26:40.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.896+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3400 [3/73b4e1fe-3f10-4db7-b803-aa7461633260] start: already running 2024-09-21T15:26:40.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.896+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3400 [3/73b4e1fe-3f10-4db7-b803-aa7461633260] start: already running 2024-09-21T15:26:40.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.896+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3400 [3/73b4e1fe-3f10-4db7-b803-aa7461633260] start: already running 2024-09-21T15:26:40.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:40.896+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef2e3400 [3/73b4e1fe-3f10-4db7-b803-aa7461633260] start: already running 2024-09-21T15:26:41.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 40% complete... Exporting image: 80% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:41.096 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.0-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone9.export 2024-09-21T15:26:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487400 [3/937229a7-e2f3-4109-a1c5-4cd12b947e67] start: already running 2024-09-21T15:26:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487400 [3/937229a7-e2f3-4109-a1c5-4cd12b947e67] start: already running 2024-09-21T15:26:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487400 [3/937229a7-e2f3-4109-a1c5-4cd12b947e67] start: already running 2024-09-21T15:26:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487400 [3/937229a7-e2f3-4109-a1c5-4cd12b947e67] start: already running 2024-09-21T15:26:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487400 [3/937229a7-e2f3-4109-a1c5-4cd12b947e67] start: already running 2024-09-21T15:26:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487400 [3/937229a7-e2f3-4109-a1c5-4cd12b947e67] start: already running 2024-09-21T15:26:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487400 [3/937229a7-e2f3-4109-a1c5-4cd12b947e67] start: already running 2024-09-21T15:26:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487180 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:26:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487180 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:26:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487180 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:26:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487180 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:26:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487180 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:26:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487180 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:26:41.193 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.184+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef487180 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:26:41.220 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.204+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3110 2024-09-21T15:26:41.239 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f162b60 2024-09-21T15:26:41.243 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.228+0000 7ff753f07700 -1 reset not still connected to 0x56016f163450 2024-09-21T15:26:41.244 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:26:41.246 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2a90 2024-09-21T15:26:41.246 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.236+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:26:41.246 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.236+0000 7ff753f07700 -1 reset not still connected to 0x56016fbf31e0 2024-09-21T15:26:41.246 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.236+0000 7ff753f07700 -1 reset not still connected to 0x56016fc981a0 2024-09-21T15:26:41.264 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.256+0000 7ff753f07700 -1 reset not still connected to 0x56016fe91ad0 2024-09-21T15:26:41.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.256+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:26:41.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.256+0000 7ff753f07700 -1 reset not still connected to 0x56017063e1a0 2024-09-21T15:26:41.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.256+0000 7ff753f07700 -1 reset not still connected to 0x5601709b80d0 2024-09-21T15:26:41.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.260+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9520 2024-09-21T15:26:41.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.260+0000 7ff753f07700 -1 reset not still connected to 0x560170f64b60 2024-09-21T15:26:41.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.260+0000 7ff753f07700 -1 reset not still connected to 0x560170f656c0 2024-09-21T15:26:41.265 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.260+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:26:41.266 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.260+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:26:41.266 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.260+0000 7ff753f07700 -1 reset not still connected to 0x560171d00c30 2024-09-21T15:26:41.266 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.260+0000 7ff753f07700 -1 reset not still connected to 0x560171f95110 2024-09-21T15:26:41.266 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.260+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:26:41.266 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.260+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:26:41.269 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.264+0000 7ff753f07700 -1 reset not still connected to 0x56017219fba0 2024-09-21T15:26:41.269 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.264+0000 7ff753f07700 -1 reset not still connected to 0x560173d86a90 2024-09-21T15:26:41.270 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.264+0000 7ff753f07700 -1 reset not still connected to 0x560173d86c30 2024-09-21T15:26:41.270 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.264+0000 7ff753f07700 -1 reset not still connected to 0x560173d87040 2024-09-21T15:26:41.270 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.264+0000 7ff753f07700 -1 reset not still connected to 0x560173d87380 2024-09-21T15:26:41.270 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.264+0000 7ff753f07700 -1 reset not still connected to 0x560173e671e0 2024-09-21T15:26:41.270 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.264+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:26:41.271 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.268+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2b60 2024-09-21T15:26:41.271 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.268+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:26:41.272 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.268+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:41.272 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.268+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7040 2024-09-21T15:26:41.280 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.272+0000 7ff753f07700 -1 reset not still connected to 0x560174ec76c0 2024-09-21T15:26:41.280 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.272+0000 7ff753f07700 -1 reset not still connected to 0x56017529a9c0 2024-09-21T15:26:41.280 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.272+0000 7ff753f07700 -1 reset not still connected to 0x56017529ab60 2024-09-21T15:26:41.281 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.272+0000 7ff753f07700 -1 reset not still connected to 0x56017529aea0 2024-09-21T15:26:41.281 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.272+0000 7ff753f07700 -1 reset not still connected to 0x56017529b110 2024-09-21T15:26:41.281 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.272+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:41.282 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0000 2024-09-21T15:26:41.282 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x5601757d00d0 2024-09-21T15:26:41.282 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0340 2024-09-21T15:26:41.282 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x5601757d05b0 2024-09-21T15:26:41.282 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x560175e1c8f0 2024-09-21T15:26:41.282 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:26:41.282 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d1e0 2024-09-21T15:26:41.282 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d6c0 2024-09-21T15:26:41.283 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:41.283 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc9c0 2024-09-21T15:26:41.283 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd860 2024-09-21T15:26:41.283 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0d00 2024-09-21T15:26:41.283 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:41.283 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1450 2024-09-21T15:26:41.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x5601772732b0 2024-09-21T15:26:41.284 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.276+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:41.288 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.284+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdd40 2024-09-21T15:26:41.288 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.284+0000 7ff753f07700 -1 reset not still connected to 0x560177984b60 2024-09-21T15:26:41.292 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.288+0000 7ff753f07700 -1 reset not still connected to 0x560178190000 2024-09-21T15:26:41.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.288+0000 7ff753f07700 -1 reset not still connected to 0x5601781901a0 2024-09-21T15:26:41.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.288+0000 7ff753f07700 -1 reset not still connected to 0x5601781904e0 2024-09-21T15:26:41.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.288+0000 7ff753f07700 -1 reset not still connected to 0x5601781908f0 2024-09-21T15:26:41.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.288+0000 7ff753f07700 -1 reset not still connected to 0x5601781912b0 2024-09-21T15:26:41.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.288+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e1a0 2024-09-21T15:26:41.293 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.288+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e680 2024-09-21T15:26:41.294 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.288+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e8f0 2024-09-21T15:26:41.294 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.288+0000 7ff753f07700 -1 reset not still connected to 0x56017a16edd0 2024-09-21T15:26:41.294 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.288+0000 7ff753f07700 -1 reset not still connected to 0x56017a16f380 2024-09-21T15:26:41.294 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.288+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fad0 2024-09-21T15:26:41.294 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.288+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fe10 2024-09-21T15:26:41.294 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.288+0000 7ff753f07700 -1 reset not still connected to 0x56017a2045b0 2024-09-21T15:26:41.298 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a204a90 2024-09-21T15:26:41.298 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a204b60 2024-09-21T15:26:41.299 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a204c30 2024-09-21T15:26:41.299 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a204f70 2024-09-21T15:26:41.299 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a205040 2024-09-21T15:26:41.299 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a205520 2024-09-21T15:26:41.299 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:26:41.300 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a205d40 2024-09-21T15:26:41.300 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a205e10 2024-09-21T15:26:41.300 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2410 2024-09-21T15:26:41.300 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b3040 2024-09-21T15:26:41.300 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:26:41.300 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.292+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b35f0 2024-09-21T15:26:41.300 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.296+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b3860 2024-09-21T15:26:41.300 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.296+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b3c70 2024-09-21T15:26:41.300 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.296+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f20d0 2024-09-21T15:26:41.300 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.296+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f24e0 2024-09-21T15:26:41.300 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.296+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f25b0 2024-09-21T15:26:41.300 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.296+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:26:41.300 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.296+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:26:41.301 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.296+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:41.301 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.296+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:26:41.302 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3380 2024-09-21T15:26:41.302 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3450 2024-09-21T15:26:41.302 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ad0 2024-09-21T15:26:41.302 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ba0 2024-09-21T15:26:41.303 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3d40 2024-09-21T15:26:41.303 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3e10 2024-09-21T15:26:41.304 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ee0 2024-09-21T15:26:41.304 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a8ccdd0 2024-09-21T15:26:41.304 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd1e0 2024-09-21T15:26:41.304 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd5f0 2024-09-21T15:26:41.304 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.300+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd930 2024-09-21T15:26:41.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 40% complete... Exporting image: 80% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:41.392 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone9.export 2024-09-21T15:26:41.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.0-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.0-clone9.export 2024-09-21T15:26:41.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:41.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:41.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1 2024-09-21T15:26:41.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:41.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1 2024-09-21T15:26:41.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:41.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1.export 2024-09-21T15:26:41.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1.export 2024-09-21T15:26:41.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1 2024-09-21T15:26:41.414 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:41.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:41.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.508+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c000 [3/79702e90-a4fc-44eb-b594-346223325651] start: already running 2024-09-21T15:26:41.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.508+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c000 [3/79702e90-a4fc-44eb-b594-346223325651] start: already running 2024-09-21T15:26:41.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.508+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c000 [3/79702e90-a4fc-44eb-b594-346223325651] start: already running 2024-09-21T15:26:41.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.508+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c000 [3/79702e90-a4fc-44eb-b594-346223325651] start: already running 2024-09-21T15:26:41.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.508+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c000 [3/79702e90-a4fc-44eb-b594-346223325651] start: already running 2024-09-21T15:26:41.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.508+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c000 [3/79702e90-a4fc-44eb-b594-346223325651] start: already running 2024-09-21T15:26:41.512 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.508+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41c000 [3/79702e90-a4fc-44eb-b594-346223325651] start: already running 2024-09-21T15:26:41.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:41.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1.export 2024-09-21T15:26:41.589 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1.export 2024-09-21T15:26:41.610 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.604+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41db80 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:26:41.610 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.604+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41db80 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:26:41.610 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.604+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41db80 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:26:41.610 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.604+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41db80 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:26:41.610 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.604+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41db80 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:26:41.610 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.604+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41db80 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:26:41.610 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.604+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef41db80 [3/8734c6e5-3fa8-4c37-acd9-f56594af88e1] start: already running 2024-09-21T15:26:41.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.640+0000 7ff12eff3700 -1 rbd::mirror::ImageReplayer: 0x561aef864780 [3/fb93addd-a120-4280-8d34-f4656e3d52f5] start: already running 2024-09-21T15:26:41.650 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.644+0000 7ff13c80e700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x561af04f1c00 get_replay_status: replay not running 2024-09-21T15:26:41.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.648+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486280 [3/8973e161-8e97-4797-a3fc-b13855716446] start: already running 2024-09-21T15:26:41.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.648+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486280 [3/8973e161-8e97-4797-a3fc-b13855716446] start: already running 2024-09-21T15:26:41.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.648+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486280 [3/8973e161-8e97-4797-a3fc-b13855716446] start: already running 2024-09-21T15:26:41.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.648+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486280 [3/8973e161-8e97-4797-a3fc-b13855716446] start: already running 2024-09-21T15:26:41.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.648+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486280 [3/8973e161-8e97-4797-a3fc-b13855716446] start: already running 2024-09-21T15:26:41.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.648+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486280 [3/8973e161-8e97-4797-a3fc-b13855716446] start: already running 2024-09-21T15:26:41.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.648+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486280 [3/8973e161-8e97-4797-a3fc-b13855716446] start: already running 2024-09-21T15:26:41.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.648+0000 7ff12f7f4700 -1 rbd::mirror::ImageReplayer: 0x561aef486280 [3/8973e161-8e97-4797-a3fc-b13855716446] start: already running 2024-09-21T15:26:41.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 13% complete... Exporting image: 18% complete... Exporting image: 23% complete... Exporting image: 27% complete... Exporting image: 32% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 55% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 69% complete... Exporting image: 73% complete... Exporting image: 78% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 92% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:41.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.676+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2500 [3/96bdba02-bf8c-4de9-8b36-c42ccdad5cf0] start: already running 2024-09-21T15:26:41.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.676+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2500 [3/96bdba02-bf8c-4de9-8b36-c42ccdad5cf0] start: already running 2024-09-21T15:26:41.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.676+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2500 [3/96bdba02-bf8c-4de9-8b36-c42ccdad5cf0] start: already running 2024-09-21T15:26:41.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.676+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2500 [3/96bdba02-bf8c-4de9-8b36-c42ccdad5cf0] start: already running 2024-09-21T15:26:41.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.676+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2500 [3/96bdba02-bf8c-4de9-8b36-c42ccdad5cf0] start: already running 2024-09-21T15:26:41.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.676+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef4d2500 [3/96bdba02-bf8c-4de9-8b36-c42ccdad5cf0] start: already running 2024-09-21T15:26:41.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1.export 2024-09-21T15:26:41.705 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.688+0000 7ff753f07700 -1 reset not still connected to 0x56016f163450 2024-09-21T15:26:41.705 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.692+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2a90 2024-09-21T15:26:41.705 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.692+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:26:41.710 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.696+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9520 2024-09-21T15:26:41.768 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.740+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:26:41.768 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.744+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:26:41.768 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.744+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:26:41.769 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.744+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:26:41.769 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.744+0000 7ff753f07700 -1 reset not still connected to 0x56017219fba0 2024-09-21T15:26:41.769 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.744+0000 7ff753f07700 -1 reset not still connected to 0x560173d87040 2024-09-21T15:26:41.769 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.744+0000 7ff753f07700 -1 reset not still connected to 0x560173d87380 2024-09-21T15:26:41.769 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.744+0000 7ff753f07700 -1 reset not still connected to 0x560173e671e0 2024-09-21T15:26:41.769 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.744+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:26:41.769 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.744+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:26:41.769 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.744+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:26:41.769 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.760+0000 7ff753f07700 -1 reset not still connected to 0x56017529aea0 2024-09-21T15:26:41.774 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.760+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:41.774 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.760+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0000 2024-09-21T15:26:41.799 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.788+0000 7ff753f07700 -1 reset not still connected to 0x560175e1c8f0 2024-09-21T15:26:41.799 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.788+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:26:41.799 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.788+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d1e0 2024-09-21T15:26:41.799 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.792+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d6c0 2024-09-21T15:26:41.800 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.792+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:26:41.800 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.792+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc9c0 2024-09-21T15:26:41.800 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.792+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd860 2024-09-21T15:26:41.800 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.796+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0d00 2024-09-21T15:26:41.800 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.796+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:26:41.801 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.796+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1450 2024-09-21T15:26:41.812 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:41.808+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef636000 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:26:41.813 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.804+0000 7ff753f07700 -1 reset not still connected to 0x5601772732b0 2024-09-21T15:26:41.813 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.804+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:26:41.821 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.812+0000 7ff753f07700 -1 reset not still connected to 0x5601774cd860 2024-09-21T15:26:41.821 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.812+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdd40 2024-09-21T15:26:41.825 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.820+0000 7ff753f07700 -1 reset not still connected to 0x560177984b60 2024-09-21T15:26:41.826 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.820+0000 7ff753f07700 -1 reset not still connected to 0x560178190000 2024-09-21T15:26:41.826 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.820+0000 7ff753f07700 -1 reset not still connected to 0x5601781901a0 2024-09-21T15:26:41.826 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.820+0000 7ff753f07700 -1 reset not still connected to 0x5601781904e0 2024-09-21T15:26:41.826 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.820+0000 7ff753f07700 -1 reset not still connected to 0x560178190820 2024-09-21T15:26:41.826 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.820+0000 7ff753f07700 -1 reset not still connected to 0x5601781908f0 2024-09-21T15:26:41.830 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.824+0000 7ff753f07700 -1 reset not still connected to 0x5601781912b0 2024-09-21T15:26:41.830 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.824+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e1a0 2024-09-21T15:26:41.830 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.824+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e680 2024-09-21T15:26:41.830 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.824+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e8f0 2024-09-21T15:26:41.830 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.824+0000 7ff753f07700 -1 reset not still connected to 0x56017a16edd0 2024-09-21T15:26:41.830 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.824+0000 7ff753f07700 -1 reset not still connected to 0x56017a16f380 2024-09-21T15:26:41.830 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.824+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fad0 2024-09-21T15:26:41.830 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.824+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fe10 2024-09-21T15:26:41.831 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.824+0000 7ff753f07700 -1 reset not still connected to 0x56017a2045b0 2024-09-21T15:26:41.831 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.824+0000 7ff753f07700 -1 reset not still connected to 0x56017a204b60 2024-09-21T15:26:41.831 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.824+0000 7ff753f07700 -1 reset not still connected to 0x56017a204f70 2024-09-21T15:26:41.832 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.828+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:26:41.832 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.828+0000 7ff753f07700 -1 reset not still connected to 0x56017a205e10 2024-09-21T15:26:41.832 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.828+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2410 2024-09-21T15:26:41.832 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.828+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b3040 2024-09-21T15:26:41.832 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.828+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:26:41.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b35f0 2024-09-21T15:26:41.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b3860 2024-09-21T15:26:41.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b3c70 2024-09-21T15:26:41.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f20d0 2024-09-21T15:26:41.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f24e0 2024-09-21T15:26:41.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:26:41.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:26:41.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:26:41.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:26:41.837 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3380 2024-09-21T15:26:41.838 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3450 2024-09-21T15:26:41.838 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ad0 2024-09-21T15:26:41.838 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ba0 2024-09-21T15:26:41.838 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3d40 2024-09-21T15:26:41.838 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ee0 2024-09-21T15:26:41.838 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a8ccdd0 2024-09-21T15:26:41.838 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd1e0 2024-09-21T15:26:41.838 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd5f0 2024-09-21T15:26:41.838 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:41.832+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd930 2024-09-21T15:26:41.879 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:41.864+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:26:41.879 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:41.864+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13040 2024-09-21T15:26:41.908 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 13% complete... Exporting image: 18% complete... Exporting image: 23% complete... Exporting image: 27% complete... Exporting image: 32% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 55% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 69% complete... Exporting image: 73% complete... Exporting image: 78% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 92% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:41.948 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1.export 2024-09-21T15:26:42.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:42.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1.export 2024-09-21T15:26:42.100 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:42.096+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577400 [3/ab9322e9-f0d3-4e57-ba54-faf9cbd16ee7] start: already running 2024-09-21T15:26:42.100 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:42.096+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577400 [3/ab9322e9-f0d3-4e57-ba54-faf9cbd16ee7] start: already running 2024-09-21T15:26:42.100 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:42.096+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577400 [3/ab9322e9-f0d3-4e57-ba54-faf9cbd16ee7] start: already running 2024-09-21T15:26:42.100 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:42.096+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577400 [3/ab9322e9-f0d3-4e57-ba54-faf9cbd16ee7] start: already running 2024-09-21T15:26:42.100 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:42.096+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef577400 [3/ab9322e9-f0d3-4e57-ba54-faf9cbd16ee7] start: already running 2024-09-21T15:26:42.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1.export 2024-09-21T15:26:42.387 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.368+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d9c70 2024-09-21T15:26:42.403 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.388+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:26:42.408 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.388+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:26:42.409 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.392+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:26:42.409 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.392+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:26:42.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83864e0 2024-09-21T15:26:42.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a5b0 2024-09-21T15:26:42.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:26:42.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cdad0 2024-09-21T15:26:42.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:26:42.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c00d0 2024-09-21T15:26:42.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:26:42.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1651e0 2024-09-21T15:26:42.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:26:42.430 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:26:42.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:26:42.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d9ba0 2024-09-21T15:26:42.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.412+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:26:42.431 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.416+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:26:42.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.440+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:26:42.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.440+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:26:42.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.440+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:26:42.452 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.440+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:26:42.453 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.448+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:26:42.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.448+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:26:42.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.448+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:26:42.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.448+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:42.466 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:26:42.470 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53040 2024-09-21T15:26:42.470 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:26:42.470 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:26:42.470 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:42.470 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:26:42.471 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:26:42.471 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b450 2024-09-21T15:26:42.471 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:26:42.471 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:26:42.475 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.464+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:26:42.475 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.464+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:26:42.476 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.464+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:26:42.476 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.464+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:42.476 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.464+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:26:42.476 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.464+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:26:42.476 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.464+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:26:42.476 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.464+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:42.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.468+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30d00 2024-09-21T15:26:42.481 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.476+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:26:42.484 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.476+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:26:42.484 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.476+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:42.484 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.476+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:26:42.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:42.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:42.509 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.504+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c213380 2024-09-21T15:26:42.509 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.504+0000 7f52f1ba9700 -1 reset not still connected to 0x55713d823ee0 2024-09-21T15:26:42.520 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.508+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da800d0 2024-09-21T15:26:42.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:26:42.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:26:42.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:26:42.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:26:42.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:26:42.526 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ad639ad0 2024-09-21T15:26:42.526 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344750 2024-09-21T15:26:42.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47e820 2024-09-21T15:26:42.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47f930 2024-09-21T15:26:42.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47fc70 2024-09-21T15:26:42.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aedb6270 2024-09-21T15:26:42.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:26:42.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc9c0 2024-09-21T15:26:42.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fa8f0 2024-09-21T15:26:42.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:26:42.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31011e0 2024-09-21T15:26:42.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:26:42.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dfba0 2024-09-21T15:26:42.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d9c70 2024-09-21T15:26:42.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5635380 2024-09-21T15:26:42.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:26:42.529 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:42.524+0000 7ff13c80e700 -1 rbd::mirror::ImageReplayer: 0x561aef841b80 [3/f7c87bd3-b914-47e1-bfe3-31c0275bb492] start: already running 2024-09-21T15:26:42.529 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4410 2024-09-21T15:26:42.529 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:26:42.529 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.512+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:26:42.537 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:26:42.537 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:26:42.537 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:26:42.537 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:26:42.538 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.520+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dee0 2024-09-21T15:26:42.538 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83864e0 2024-09-21T15:26:42.539 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a5b0 2024-09-21T15:26:42.539 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:26:42.539 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cdad0 2024-09-21T15:26:42.539 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:26:42.539 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c00d0 2024-09-21T15:26:42.542 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.528+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:26:42.544 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.532+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8680 2024-09-21T15:26:42.544 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.532+0000 7f52f1ba9700 -1 reset not still connected to 0x557143600c30 2024-09-21T15:26:42.544 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:26:42.551 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1651e0 2024-09-21T15:26:42.551 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:26:42.551 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:26:42.551 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:26:42.551 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d9ba0 2024-09-21T15:26:42.552 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:26:42.552 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:26:42.552 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:26:42.552 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:26:42.552 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:26:42.555 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.548+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:26:42.555 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.548+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:26:42.560 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.544+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601c70 2024-09-21T15:26:42.560 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.544+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76820 2024-09-21T15:26:42.560 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.544+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77380 2024-09-21T15:26:42.560 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.544+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b776c0 2024-09-21T15:26:42.560 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.544+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77a00 2024-09-21T15:26:42.561 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.544+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77c70 2024-09-21T15:26:42.561 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.544+0000 7f52f1ba9700 -1 reset not still connected to 0x557143bf5450 2024-09-21T15:26:42.561 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.544+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a270 2024-09-21T15:26:42.561 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.556+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:26:42.571 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.560+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:26:42.579 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.568+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456c9c0 2024-09-21T15:26:42.579 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.568+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456ca90 2024-09-21T15:26:42.579 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.568+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af6c30 2024-09-21T15:26:42.583 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.580+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af6d00 2024-09-21T15:26:42.584 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.580+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af7930 2024-09-21T15:26:42.584 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.580+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af7ad0 2024-09-21T15:26:42.584 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.580+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f520 2024-09-21T15:26:42.584 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.580+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765e10 2024-09-21T15:26:42.584 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.580+0000 7f52f1ba9700 -1 reset not still connected to 0x5571472268f0 2024-09-21T15:26:42.584 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.580+0000 7f52f1ba9700 -1 reset not still connected to 0x5571480005b0 2024-09-21T15:26:42.584 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.580+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012ea0 2024-09-21T15:26:42.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:42.593 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:26:42.595 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.588+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013790 2024-09-21T15:26:42.601 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53040 2024-09-21T15:26:42.601 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:26:42.602 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:26:42.602 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:42.602 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:26:42.603 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.588+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013930 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.588+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bba0 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.588+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bc70 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.588+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a820 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.588+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29ad00 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.588+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29b110 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.588+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29bd40 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.588+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29be10 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.588+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1040 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.588+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1380 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.588+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1860 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1930 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1d40 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad740d0 2024-09-21T15:26:42.604 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74340 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74820 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad75ad0 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07e750 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f6c0 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f860 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1241a0 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124680 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1252b0 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b125ba0 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714c0c1ad0 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe1a0 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe270 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe680 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ff5f0 2024-09-21T15:26:42.605 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb12dd0 2024-09-21T15:26:42.606 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13040 2024-09-21T15:26:42.606 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:42.592+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb136c0 2024-09-21T15:26:42.614 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:26:42.615 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b450 2024-09-21T15:26:42.615 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:26:42.615 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:26:42.615 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:26:42.615 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.608+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:26:42.629 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.620+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:42.631 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.628+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:26:42.651 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.640+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:26:42.651 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.640+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:26:42.651 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.640+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:42.651 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.640+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30d00 2024-09-21T15:26:42.651 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.640+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:26:42.652 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.640+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:26:42.652 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.640+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:42.652 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.640+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:26:42.660 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.644+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:42.660 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.644+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:42.660 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.648+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:26:42.660 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.648+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:26:42.664 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.656+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ac7c8340 2024-09-21T15:26:42.664 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.656+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580acbd9450 2024-09-21T15:26:42.664 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.656+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ad639ad0 2024-09-21T15:26:42.665 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.656+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c56c0 2024-09-21T15:26:42.665 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.656+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25ac30 2024-09-21T15:26:42.665 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.660+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344410 2024-09-21T15:26:42.665 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.660+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344750 2024-09-21T15:26:42.665 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.660+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47e820 2024-09-21T15:26:42.665 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.660+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47f930 2024-09-21T15:26:42.665 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.660+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47fc70 2024-09-21T15:26:42.665 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.660+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae8d8000 2024-09-21T15:26:42.665 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.660+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1cea0 2024-09-21T15:26:42.665 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.660+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aedb6270 2024-09-21T15:26:42.665 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.660+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aedb7d40 2024-09-21T15:26:42.666 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.660+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:26:42.666 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.660+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc8f0 2024-09-21T15:26:42.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:42.680+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3b80 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:26:42.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:42.680+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3b80 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:26:42.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:42.680+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3b80 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:26:42.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:42.680+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3b80 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:26:42.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:42.680+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aee6f3b80 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:26:42.686 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.680+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc9c0 2024-09-21T15:26:42.686 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.680+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9e8f0 2024-09-21T15:26:42.686 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.680+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:26:42.688 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd00d0 2024-09-21T15:26:42.688 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c410 2024-09-21T15:26:42.689 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fa8f0 2024-09-21T15:26:42.689 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50340 2024-09-21T15:26:42.691 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f504e0 2024-09-21T15:26:42.691 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:26:42.691 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31011e0 2024-09-21T15:26:42.691 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:26:42.691 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:26:42.691 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dfba0 2024-09-21T15:26:42.691 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76dd0 2024-09-21T15:26:42.692 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d9c70 2024-09-21T15:26:42.692 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5635380 2024-09-21T15:26:42.692 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5635790 2024-09-21T15:26:42.692 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe750 2024-09-21T15:26:42.692 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:26:42.692 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.684+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:26:42.694 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0d860 2024-09-21T15:26:42.694 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:26:42.694 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:26:42.694 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:26:42.694 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:26:42.694 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47ee0 2024-09-21T15:26:42.694 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeeea0 2024-09-21T15:26:42.694 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83716c0 2024-09-21T15:26:42.694 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83864e0 2024-09-21T15:26:42.695 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a5b0 2024-09-21T15:26:42.695 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:26:42.695 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:26:42.695 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cdad0 2024-09-21T15:26:42.695 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:26:42.695 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:26:42.695 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c00d0 2024-09-21T15:26:42.695 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0ea0 2024-09-21T15:26:42.695 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.688+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c12b0 2024-09-21T15:26:42.696 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 13% complete... Exporting image: 18% complete... Exporting image: 23% complete... Exporting image: 27% complete... Exporting image: 32% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 55% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 69% complete... Exporting image: 73% complete... Exporting image: 78% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 92% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:42.699 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.692+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:26:42.699 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.692+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164dd0 2024-09-21T15:26:42.699 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.692+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1651e0 2024-09-21T15:26:42.699 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.692+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:26:42.699 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.692+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:26:42.699 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.692+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:26:42.699 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.692+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:26:42.700 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.692+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d9ba0 2024-09-21T15:26:42.700 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.692+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:26:42.700 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.692+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35d450 2024-09-21T15:26:42.703 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35dc70 2024-09-21T15:26:42.703 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e60d0 2024-09-21T15:26:42.703 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:26:42.703 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:26:42.703 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:26:42.703 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:26:42.703 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf02820 2024-09-21T15:26:42.703 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:26:42.704 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5380 2024-09-21T15:26:42.704 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:26:42.704 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5c70 2024-09-21T15:26:42.704 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5ee0 2024-09-21T15:26:42.705 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:26:42.705 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:26:42.705 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d790 2024-09-21T15:26:42.705 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:26:42.705 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:26:42.705 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:26:42.705 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53040 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ec30 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b450 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:26:42.706 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae9c0 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30d00 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30ea0 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6820 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:26:42.707 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:42.708 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:26:42.708 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692340 2024-09-21T15:26:42.708 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:42.708 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:42.708 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:26:42.708 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:26:42.708 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:26:42.708 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:26:42.708 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:26:42.708 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:26:42.708 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:42.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:42.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1.export 2024-09-21T15:26:42.738 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:26:42.724+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:26:42.861 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 13% complete... Exporting image: 18% complete... Exporting image: 23% complete... Exporting image: 27% complete... Exporting image: 32% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 55% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 69% complete... Exporting image: 73% complete... Exporting image: 78% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 92% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:42.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1.export 2024-09-21T15:26:42.952 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1.export 2024-09-21T15:26:42.965 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:42.965 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:42.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone1 2024-09-21T15:26:42.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:42.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone1 2024-09-21T15:26:42.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:42.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone1.export 2024-09-21T15:26:42.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone1.export 2024-09-21T15:26:42.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone1 2024-09-21T15:26:42.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:42.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:43.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:43.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone1.export 2024-09-21T15:26:43.026 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone1@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone1.export 2024-09-21T15:26:43.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 52% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:43.286 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone1@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone1.export 2024-09-21T15:26:43.386 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:43.384+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef5c7680 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:26:43.386 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:43.384+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486780 [3/8b3fb276-65d9-4307-be3d-8481e9d99405] start: already running 2024-09-21T15:26:43.387 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:43.384+0000 7ff13c00d700 -1 rbd::mirror::ImageReplayer: 0x561aef486780 [3/8b3fb276-65d9-4307-be3d-8481e9d99405] start: already running 2024-09-21T15:26:43.711 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:26:43.711 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.696+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:26:43.720 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.700+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:26:43.730 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.724+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:26:43.752 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.740+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:26:43.764 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.752+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:26:43.764 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.752+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d9ba0 2024-09-21T15:26:43.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 52% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:43.776 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.760+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:26:43.776 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.760+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35d450 2024-09-21T15:26:43.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone1.export 2024-09-21T15:26:43.782 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.772+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35dc70 2024-09-21T15:26:43.783 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.776+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:26:43.783 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.776+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:26:43.783 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.776+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:26:43.784 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.776+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:26:43.787 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.784+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:26:43.787 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.784+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf02820 2024-09-21T15:26:43.787 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.784+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:26:43.794 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.788+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:26:43.794 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.788+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5ee0 2024-09-21T15:26:43.794 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.788+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:26:43.794 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.788+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:26:43.802 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.796+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26cb60 2024-09-21T15:26:43.803 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.796+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d450 2024-09-21T15:26:43.803 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.796+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d790 2024-09-21T15:26:43.803 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.796+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:26:43.803 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.796+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:26:43.803 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.796+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:26:43.803 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.800+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3508f0 2024-09-21T15:26:43.803 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.800+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:26:43.803 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.800+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:26:43.829 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.824+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:26:43.829 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.824+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53040 2024-09-21T15:26:43.829 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.824+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:26:43.829 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.824+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:26:43.829 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.824+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ec30 2024-09-21T15:26:43.829 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.824+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:26:43.830 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.824+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:26:43.830 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.824+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:26:43.830 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.824+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a340 2024-09-21T15:26:43.837 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a410 2024-09-21T15:26:43.839 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b450 2024-09-21T15:26:43.839 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:26:43.839 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:26:43.839 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc532b0 2024-09-21T15:26:43.840 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008ea0 2024-09-21T15:26:43.840 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:26:43.842 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c00091e0 2024-09-21T15:26:43.842 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:26:43.842 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009ee0 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae9c0 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30d00 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30ea0 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f60d0 2024-09-21T15:26:43.843 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6820 2024-09-21T15:26:43.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:26:43.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:26:43.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7860 2024-09-21T15:26:43.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:43.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:26:43.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692340 2024-09-21T15:26:43.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:43.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:43.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:26:43.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:26:43.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:26:43.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:26:43.844 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:43.832+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:26:43.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:43.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone1.export 2024-09-21T15:26:43.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone1.export 2024-09-21T15:26:44.096 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:26:44.092+0000 7ff13c80e700 -1 rbd::mirror::image_replayer::journal::Replayer: 0x561af1cc6e00 get_replay_status: replay not running 2024-09-21T15:26:44.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 52% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:44.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone1.export 2024-09-21T15:26:44.482 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:26:44.467+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0d860 2024-09-21T15:26:44.484 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:26:44.467+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0dba0 2024-09-21T15:26:44.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 52% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:44.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone1.export 2024-09-21T15:26:44.782 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone1.export 2024-09-21T15:26:44.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:44.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:44.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone10 2024-09-21T15:26:44.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:44.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone10 2024-09-21T15:26:44.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:44.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone10.export 2024-09-21T15:26:44.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone10.export 2024-09-21T15:26:44.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone10 2024-09-21T15:26:44.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:44.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:44.949 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:44.949 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone10.export 2024-09-21T15:26:44.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone10@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone10.export 2024-09-21T15:26:45.195 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 28% complete... Exporting image: 56% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:45.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone10@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone10.export 2024-09-21T15:26:45.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 28% complete... Exporting image: 56% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:45.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone10.export 2024-09-21T15:26:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:45.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone10.export 2024-09-21T15:26:45.675 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone10.export 2024-09-21T15:26:45.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:45.787 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone10.export 2024-09-21T15:26:45.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:45.940 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone10.export 2024-09-21T15:26:45.948 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone10.export 2024-09-21T15:26:45.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:45.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:45.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone11 2024-09-21T15:26:45.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:45.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone11 2024-09-21T15:26:45.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:45.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone11.export 2024-09-21T15:26:45.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone11.export 2024-09-21T15:26:45.952 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone11 2024-09-21T15:26:45.952 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:45.952 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:46.111 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:46.111 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone11.export 2024-09-21T15:26:46.113 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone11@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone11.export 2024-09-21T15:26:46.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:46.309 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone11@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone11.export 2024-09-21T15:26:46.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:46.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone11.export 2024-09-21T15:26:46.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:46.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone11.export 2024-09-21T15:26:46.640 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone11.export 2024-09-21T15:26:46.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:46.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone11.export 2024-09-21T15:26:46.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:46.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone11.export 2024-09-21T15:26:46.923 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone11.export 2024-09-21T15:26:46.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:46.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:46.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone12 2024-09-21T15:26:46.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:46.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone12 2024-09-21T15:26:46.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:46.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone12.export 2024-09-21T15:26:46.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone12.export 2024-09-21T15:26:46.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone12 2024-09-21T15:26:46.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:46.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:47.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:47.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone12.export 2024-09-21T15:26:47.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone12@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone12.export 2024-09-21T15:26:47.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 80% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:47.284 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone12@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone12.export 2024-09-21T15:26:47.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 80% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:47.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone12.export 2024-09-21T15:26:47.698 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:47.698 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone12.export 2024-09-21T15:26:47.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone12.export 2024-09-21T15:26:47.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:47.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone12.export 2024-09-21T15:26:47.862 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:47.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone12.export 2024-09-21T15:26:47.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone12.export 2024-09-21T15:26:47.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:47.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:47.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone13 2024-09-21T15:26:47.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:47.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone13 2024-09-21T15:26:47.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:47.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone13.export 2024-09-21T15:26:47.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone13.export 2024-09-21T15:26:47.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone13 2024-09-21T15:26:47.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:47.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:48.059 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:48.059 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone13.export 2024-09-21T15:26:48.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone13@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone13.export 2024-09-21T15:26:48.353 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 30% complete... Exporting image: 41% complete... Exporting image: 51% complete... Exporting image: 61% complete... Exporting image: 71% complete... Exporting image: 82% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:48.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone13@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone13.export 2024-09-21T15:26:48.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 30% complete... Exporting image: 41% complete... Exporting image: 51% complete... Exporting image: 61% complete... Exporting image: 71% complete... Exporting image: 82% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:48.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone13.export 2024-09-21T15:26:48.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:48.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone13.export 2024-09-21T15:26:48.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone13.export 2024-09-21T15:26:49.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:49.099 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:49.096+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13040 2024-09-21T15:26:49.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone13.export 2024-09-21T15:26:49.330 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:49.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone13.export 2024-09-21T15:26:49.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone13.export 2024-09-21T15:26:49.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:49.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:49.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone14 2024-09-21T15:26:49.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:49.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone14 2024-09-21T15:26:49.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:49.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone14.export 2024-09-21T15:26:49.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone14.export 2024-09-21T15:26:49.352 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone14 2024-09-21T15:26:49.352 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:49.352 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:49.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:49.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone14.export 2024-09-21T15:26:49.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone14@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone14.export 2024-09-21T15:26:49.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:49.638 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone14@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone14.export 2024-09-21T15:26:49.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:49.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone14.export 2024-09-21T15:26:49.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:49.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone14.export 2024-09-21T15:26:49.940 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone14.export 2024-09-21T15:26:50.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:50.144 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone14.export 2024-09-21T15:26:50.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:26:50.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone14.export 2024-09-21T15:26:50.425 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone14.export 2024-09-21T15:26:50.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:50.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:50.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone15 2024-09-21T15:26:50.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:50.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone15 2024-09-21T15:26:50.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:50.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone15.export 2024-09-21T15:26:50.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone15.export 2024-09-21T15:26:50.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone15 2024-09-21T15:26:50.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:50.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:50.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:50.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone15.export 2024-09-21T15:26:50.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone15@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone15.export 2024-09-21T15:26:51.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:51.698 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone15@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone15.export 2024-09-21T15:26:53.858 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:53.868 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone15.export 2024-09-21T15:26:54.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:54.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone15.export 2024-09-21T15:26:54.135 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.124+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8680 2024-09-21T15:26:54.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone15.export 2024-09-21T15:26:54.145 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.132+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb91e0 2024-09-21T15:26:54.153 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.144+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601c70 2024-09-21T15:26:54.153 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.144+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b776c0 2024-09-21T15:26:54.153 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.144+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77a00 2024-09-21T15:26:54.154 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.148+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77c70 2024-09-21T15:26:54.154 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.148+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a270 2024-09-21T15:26:54.156 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.148+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456ca90 2024-09-21T15:26:54.156 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.148+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af6c30 2024-09-21T15:26:54.156 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.148+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af7930 2024-09-21T15:26:54.156 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.148+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f520 2024-09-21T15:26:54.156 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.148+0000 7f52f1ba9700 -1 reset not still connected to 0x5571472268f0 2024-09-21T15:26:54.157 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.148+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012ea0 2024-09-21T15:26:54.157 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.148+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bc70 2024-09-21T15:26:54.159 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a820 2024-09-21T15:26:54.160 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29ad00 2024-09-21T15:26:54.160 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29bd40 2024-09-21T15:26:54.160 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29be10 2024-09-21T15:26:54.160 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1040 2024-09-21T15:26:54.160 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1930 2024-09-21T15:26:54.160 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1d40 2024-09-21T15:26:54.161 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3c70 2024-09-21T15:26:54.161 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad75ad0 2024-09-21T15:26:54.161 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f6c0 2024-09-21T15:26:54.161 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f860 2024-09-21T15:26:54.161 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.152+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1241a0 2024-09-21T15:26:54.161 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.156+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124680 2024-09-21T15:26:54.161 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.156+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1252b0 2024-09-21T15:26:54.167 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe8f0 2024-09-21T15:26:54.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ff5f0 2024-09-21T15:26:54.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb12dd0 2024-09-21T15:26:54.170 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:26:54.160+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13040 2024-09-21T15:26:55.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 41% complete... Exporting image: 62% complete... Exporting image: 83% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:55.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone15.export 2024-09-21T15:26:56.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 41% complete... Exporting image: 62% complete... Exporting image: 83% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:56.299 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone15.export 2024-09-21T15:26:56.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone15.export 2024-09-21T15:26:56.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:56.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:56.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone16 2024-09-21T15:26:56.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:56.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone16 2024-09-21T15:26:56.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:56.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone16.export 2024-09-21T15:26:56.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone16.export 2024-09-21T15:26:56.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone16 2024-09-21T15:26:56.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:56.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:56.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:56.430 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone16.export 2024-09-21T15:26:56.431 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone16@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone16.export 2024-09-21T15:26:56.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 46% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:56.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone16@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone16.export 2024-09-21T15:26:57.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 46% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:57.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone16.export 2024-09-21T15:26:57.192 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:57.193 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone16.export 2024-09-21T15:26:57.249 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone16.export 2024-09-21T15:26:57.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 46% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:57.544 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone16.export 2024-09-21T15:26:57.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 46% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:57.909 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone16.export 2024-09-21T15:26:58.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone16.export 2024-09-21T15:26:58.094 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:58.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:58.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone17 2024-09-21T15:26:58.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:58.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone17 2024-09-21T15:26:58.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:58.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone17.export 2024-09-21T15:26:58.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone17.export 2024-09-21T15:26:58.096 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone17 2024-09-21T15:26:58.096 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:58.096 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:58.167 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:58.167 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone17.export 2024-09-21T15:26:58.168 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone17@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone17.export 2024-09-21T15:26:58.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:58.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone17@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone17.export 2024-09-21T15:26:58.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:58.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone17.export 2024-09-21T15:26:58.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:58.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone17.export 2024-09-21T15:26:58.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone17.export 2024-09-21T15:26:59.103 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.096+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:26:59.104 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.096+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:26:59.104 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.100+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:26:59.114 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.108+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30ea0 2024-09-21T15:26:59.121 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.112+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6820 2024-09-21T15:26:59.121 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.112+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:26:59.121 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.116+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:26:59.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.116+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:26:59.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.116+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692340 2024-09-21T15:26:59.122 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.116+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:26:59.123 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.116+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:26:59.123 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.116+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:26:59.123 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.116+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:26:59.123 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.116+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:26:59.126 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.120+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:26:59.128 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:26:59.124+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:26:59.202 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:59.225 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone17.export 2024-09-21T15:26:59.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:26:59.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone17.export 2024-09-21T15:26:59.632 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone17.export 2024-09-21T15:26:59.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:26:59.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:26:59.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone18 2024-09-21T15:26:59.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:26:59.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone18 2024-09-21T15:26:59.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:26:59.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone18.export 2024-09-21T15:26:59.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone18.export 2024-09-21T15:26:59.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone18 2024-09-21T15:26:59.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:26:59.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:26:59.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:26:59.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone18.export 2024-09-21T15:26:59.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone18@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone18.export 2024-09-21T15:27:00.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:00.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone18@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone18.export 2024-09-21T15:27:00.295 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:00.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone18.export 2024-09-21T15:27:00.443 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:00.443 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone18.export 2024-09-21T15:27:00.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone18.export 2024-09-21T15:27:00.746 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:00.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone18.export 2024-09-21T15:27:01.017 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:01.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone18.export 2024-09-21T15:27:01.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone18.export 2024-09-21T15:27:01.219 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone19 2024-09-21T15:27:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone19 2024-09-21T15:27:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone19.export 2024-09-21T15:27:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone19.export 2024-09-21T15:27:01.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone19 2024-09-21T15:27:01.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:01.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:01.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:01.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone19.export 2024-09-21T15:27:01.293 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone19@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone19.export 2024-09-21T15:27:01.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:01.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone19@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone19.export 2024-09-21T15:27:01.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:01.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone19.export 2024-09-21T15:27:01.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:01.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone19.export 2024-09-21T15:27:01.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone19.export 2024-09-21T15:27:01.959 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:01.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone19.export 2024-09-21T15:27:02.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:02.112 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone19.export 2024-09-21T15:27:02.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone19.export 2024-09-21T15:27:02.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:02.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:02.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone2 2024-09-21T15:27:02.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:02.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone2 2024-09-21T15:27:02.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:02.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone2.export 2024-09-21T15:27:02.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone2.export 2024-09-21T15:27:02.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone2 2024-09-21T15:27:02.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:02.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:02.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:02.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone2.export 2024-09-21T15:27:02.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone2@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone2.export 2024-09-21T15:27:02.519 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:02.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone2@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone2.export 2024-09-21T15:27:02.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:02.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone2.export 2024-09-21T15:27:02.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:02.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone2.export 2024-09-21T15:27:02.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone2.export 2024-09-21T15:27:02.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:02.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone2.export 2024-09-21T15:27:03.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:03.112 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone2.export 2024-09-21T15:27:03.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone2.export 2024-09-21T15:27:03.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:03.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:03.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone20 2024-09-21T15:27:03.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:03.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone20 2024-09-21T15:27:03.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:03.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone20.export 2024-09-21T15:27:03.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone20.export 2024-09-21T15:27:03.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone20 2024-09-21T15:27:03.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:03.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:03.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:03.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone20.export 2024-09-21T15:27:03.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone20@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone20.export 2024-09-21T15:27:03.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:03.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone20@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone20.export 2024-09-21T15:27:03.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:03.739 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone20.export 2024-09-21T15:27:03.775 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:03.775 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone20.export 2024-09-21T15:27:03.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone20.export 2024-09-21T15:27:03.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:03.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone20.export 2024-09-21T15:27:03.923 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:03.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone20.export 2024-09-21T15:27:03.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone20.export 2024-09-21T15:27:03.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:03.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:03.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone21 2024-09-21T15:27:03.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:03.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone21 2024-09-21T15:27:03.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:03.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone21.export 2024-09-21T15:27:03.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone21.export 2024-09-21T15:27:03.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone21 2024-09-21T15:27:03.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:03.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:04.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:04.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone21.export 2024-09-21T15:27:04.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone21@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone21.export 2024-09-21T15:27:04.184 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:27:04.174+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0c820 2024-09-21T15:27:04.184 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:27:04.174+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb790 2024-09-21T15:27:04.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 29% complete... Exporting image: 58% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:04.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone21@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone21.export 2024-09-21T15:27:04.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ac7c8340 2024-09-21T15:27:04.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580acbd9450 2024-09-21T15:27:04.534 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ad639ad0 2024-09-21T15:27:04.534 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae1c56c0 2024-09-21T15:27:04.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25ac30 2024-09-21T15:27:04.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344410 2024-09-21T15:27:04.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344750 2024-09-21T15:27:04.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47e1a0 2024-09-21T15:27:04.535 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.524+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47e820 2024-09-21T15:27:04.537 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.532+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47f930 2024-09-21T15:27:04.537 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.532+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47fc70 2024-09-21T15:27:04.537 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.532+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae8d8000 2024-09-21T15:27:04.541 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae9c9930 2024-09-21T15:27:04.541 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1cea0 2024-09-21T15:27:04.541 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aedb6270 2024-09-21T15:27:04.541 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aedb7d40 2024-09-21T15:27:04.541 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aef04b60 2024-09-21T15:27:04.541 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af30a680 2024-09-21T15:27:04.541 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af938680 2024-09-21T15:27:04.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:27:04.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0099ad0 2024-09-21T15:27:04.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b04bbe10 2024-09-21T15:27:04.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc8f0 2024-09-21T15:27:04.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc9c0 2024-09-21T15:27:04.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9e8f0 2024-09-21T15:27:04.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:27:04.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b10492b0 2024-09-21T15:27:04.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd00d0 2024-09-21T15:27:04.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c410 2024-09-21T15:27:04.542 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.536+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fa8f0 2024-09-21T15:27:04.543 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.540+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50340 2024-09-21T15:27:04.543 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.540+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f504e0 2024-09-21T15:27:04.545 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.540+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:27:04.556 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.552+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31009c0 2024-09-21T15:27:04.556 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.552+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31011e0 2024-09-21T15:27:04.557 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.552+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31012b0 2024-09-21T15:27:04.557 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.552+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:27:04.557 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.552+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd110 2024-09-21T15:27:04.563 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.556+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:27:04.563 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.556+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fda00 2024-09-21T15:27:04.563 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.556+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3686270 2024-09-21T15:27:04.563 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.556+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:27:04.563 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.556+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:27:04.563 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.556+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167790 2024-09-21T15:27:04.563 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.556+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:27:04.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.560+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dfba0 2024-09-21T15:27:04.571 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76410 2024-09-21T15:27:04.571 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76dd0 2024-09-21T15:27:04.571 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77790 2024-09-21T15:27:04.571 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77ba0 2024-09-21T15:27:04.571 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d9c70 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5635380 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5635790 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe750 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fed00 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0d860 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9380 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de95f0 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9d40 2024-09-21T15:27:04.572 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:27:04.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:27:04.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47ee0 2024-09-21T15:27:04.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.564+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aee1a0 2024-09-21T15:27:04.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeed00 2024-09-21T15:27:04.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeeea0 2024-09-21T15:27:04.573 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83716c0 2024-09-21T15:27:04.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8371790 2024-09-21T15:27:04.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8371ad0 2024-09-21T15:27:04.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83864e0 2024-09-21T15:27:04.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8386ea0 2024-09-21T15:27:04.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387ee0 2024-09-21T15:27:04.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a5b0 2024-09-21T15:27:04.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:27:04.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cc270 2024-09-21T15:27:04.574 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:27:04.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cd040 2024-09-21T15:27:04.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cdad0 2024-09-21T15:27:04.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90a90 2024-09-21T15:27:04.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:27:04.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90d00 2024-09-21T15:27:04.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:27:04.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.568+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90104e0 2024-09-21T15:27:04.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c09c0 2024-09-21T15:27:04.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0ea0 2024-09-21T15:27:04.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c11e0 2024-09-21T15:27:04.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c12b0 2024-09-21T15:27:04.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c16c0 2024-09-21T15:27:04.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:27:04.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164dd0 2024-09-21T15:27:04.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1651e0 2024-09-21T15:27:04.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165930 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5860 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5ee0 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8d00 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d9ba0 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35d450 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35dc70 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e60d0 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ec820 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:27:04.581 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:27:04.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.572+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:27:04.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:27:04.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf02820 2024-09-21T15:27:04.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf03ad0 2024-09-21T15:27:04.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:27:04.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5380 2024-09-21T15:27:04.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:27:04.582 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5c70 2024-09-21T15:27:04.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5ee0 2024-09-21T15:27:04.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c340 2024-09-21T15:27:04.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:27:04.583 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.576+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:27:04.585 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26cb60 2024-09-21T15:27:04.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d450 2024-09-21T15:27:04.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d790 2024-09-21T15:27:04.586 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:27:04.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:27:04.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:27:04.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350680 2024-09-21T15:27:04.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3508f0 2024-09-21T15:27:04.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:27:04.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:27:04.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:27:04.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53040 2024-09-21T15:27:04.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:27:04.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:27:04.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ec30 2024-09-21T15:27:04.587 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:27:04.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:27:04.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626d00 2024-09-21T15:27:04.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:27:04.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a340 2024-09-21T15:27:04.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a410 2024-09-21T15:27:04.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b450 2024-09-21T15:27:04.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:27:04.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:27:04.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53380 2024-09-21T15:27:04.588 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.580+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008750 2024-09-21T15:27:04.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008ea0 2024-09-21T15:27:04.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:27:04.589 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c00091e0 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009ee0 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ee0 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae1a0 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae9c0 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:27:04.590 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30d00 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30ea0 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f60d0 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6820 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f71e0 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7860 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692340 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:27:04.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:27:04.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693860 2024-09-21T15:27:04.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:27:04.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:27:04.592 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:27:04.584+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693e10 2024-09-21T15:27:04.702 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 29% complete... Exporting image: 58% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:04.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone21.export 2024-09-21T15:27:04.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:04.846 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone21.export 2024-09-21T15:27:04.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone21.export 2024-09-21T15:27:05.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:05.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone21.export 2024-09-21T15:27:05.194 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:05.202 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone21.export 2024-09-21T15:27:05.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone21.export 2024-09-21T15:27:05.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:05.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:05.240 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone22 2024-09-21T15:27:05.240 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:05.240 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone22 2024-09-21T15:27:05.240 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:05.240 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone22.export 2024-09-21T15:27:05.240 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone22.export 2024-09-21T15:27:05.240 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone22 2024-09-21T15:27:05.240 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:05.241 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:05.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:05.316 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone22.export 2024-09-21T15:27:05.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone22@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone22.export 2024-09-21T15:27:05.787 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 41% complete... Exporting image: 54% complete... Exporting image: 68% complete... Exporting image: 82% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:05.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone22@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone22.export 2024-09-21T15:27:06.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 41% complete... Exporting image: 54% complete... Exporting image: 68% complete... Exporting image: 82% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:06.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone22.export 2024-09-21T15:27:06.473 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:06.473 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone22.export 2024-09-21T15:27:06.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone22.export 2024-09-21T15:27:06.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:06.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone22.export 2024-09-21T15:27:06.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:06.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone22.export 2024-09-21T15:27:06.683 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone22.export 2024-09-21T15:27:06.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:06.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:06.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone23 2024-09-21T15:27:06.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:06.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone23 2024-09-21T15:27:06.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:06.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone23.export 2024-09-21T15:27:06.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone23.export 2024-09-21T15:27:06.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:06.686 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone23 2024-09-21T15:27:06.686 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:06.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:06.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone23.export 2024-09-21T15:27:06.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone23@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone23.export 2024-09-21T15:27:07.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:07.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone23@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone23.export 2024-09-21T15:27:07.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:07.522 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone23.export 2024-09-21T15:27:07.648 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:07.648 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone23.export 2024-09-21T15:27:07.702 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone23.export 2024-09-21T15:27:07.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:07.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone23.export 2024-09-21T15:27:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:08.046 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone23.export 2024-09-21T15:27:08.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone23.export 2024-09-21T15:27:08.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone24 2024-09-21T15:27:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone24 2024-09-21T15:27:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone24.export 2024-09-21T15:27:08.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone24.export 2024-09-21T15:27:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone24 2024-09-21T15:27:08.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:08.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:08.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone24.export 2024-09-21T15:27:08.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone24@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone24.export 2024-09-21T15:27:08.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 18% complete... Exporting image: 27% complete... Exporting image: 36% complete... Exporting image: 46% complete... Exporting image: 55% complete... Exporting image: 64% complete... Exporting image: 73% complete... Exporting image: 83% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:08.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone24@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone24.export 2024-09-21T15:27:08.482 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 18% complete... Exporting image: 27% complete... Exporting image: 36% complete... Exporting image: 46% complete... Exporting image: 55% complete... Exporting image: 64% complete... Exporting image: 73% complete... Exporting image: 83% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:08.488 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone24.export 2024-09-21T15:27:08.628 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:08.628 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone24.export 2024-09-21T15:27:08.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone24.export 2024-09-21T15:27:08.830 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 18% complete... Exporting image: 27% complete... Exporting image: 36% complete... Exporting image: 46% complete... Exporting image: 55% complete... Exporting image: 64% complete... Exporting image: 73% complete... Exporting image: 83% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:08.838 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone24.export 2024-09-21T15:27:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 18% complete... Exporting image: 27% complete... Exporting image: 36% complete... Exporting image: 46% complete... Exporting image: 55% complete... Exporting image: 64% complete... Exporting image: 73% complete... Exporting image: 83% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:09.017 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone24.export 2024-09-21T15:27:09.168 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone24.export 2024-09-21T15:27:09.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:09.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:09.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone25 2024-09-21T15:27:09.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:09.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone25 2024-09-21T15:27:09.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:09.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone25.export 2024-09-21T15:27:09.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone25.export 2024-09-21T15:27:09.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:09.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone25 2024-09-21T15:27:09.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:09.504 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:09.504 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone25.export 2024-09-21T15:27:09.505 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone25@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone25.export 2024-09-21T15:27:09.678 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.2810401992033591) > weight (0.25) 2024-09-21T15:27:09.678 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.1 2024-09-21T15:27:09.678 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Sent signal 15 2024-09-21T15:27:09.678 INFO:tasks.rbd_mirror_thrash:waiting for 6 secs before reviving daemons 2024-09-21T15:27:09.679 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:27:09.676+0000 7f263f8f0700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 (PID: 74236) UID: 1000 2024-09-21T15:27:14.145 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.134+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670680 2024-09-21T15:27:14.148 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.142+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670dd0 2024-09-21T15:27:14.148 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.142+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9e8f520 2024-09-21T15:27:14.154 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.146+0000 7f7fd044c700 -1 reset not still connected to 0x5636ab3b5d40 2024-09-21T15:27:14.154 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.146+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:27:14.154 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.146+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e8410 2024-09-21T15:27:14.155 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.146+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:27:14.157 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.150+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678f2b0 2024-09-21T15:27:14.157 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.150+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff656c0 2024-09-21T15:27:14.160 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.154+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65ad0 2024-09-21T15:27:14.160 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.154+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65c70 2024-09-21T15:27:14.160 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.154+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1c70 2024-09-21T15:27:14.160 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.154+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1ee0 2024-09-21T15:27:14.160 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.154+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e750 2024-09-21T15:27:14.162 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.154+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:27:14.166 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.158+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9ad0 2024-09-21T15:27:14.166 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.158+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:27:14.170 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.162+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:27:14.170 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.162+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:27:14.170 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.162+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:27:14.170 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.162+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7334340 2024-09-21T15:27:14.177 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335a00 2024-09-21T15:27:14.177 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335ad0 2024-09-21T15:27:14.177 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766750 2024-09-21T15:27:14.177 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87676c0 2024-09-21T15:27:14.177 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:27:14.177 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89672b0 2024-09-21T15:27:14.177 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967a00 2024-09-21T15:27:14.178 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:27:14.178 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:27:14.178 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51110 2024-09-21T15:27:14.178 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde261a0 2024-09-21T15:27:14.178 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde27d40 2024-09-21T15:27:14.178 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636ce7e9790 2024-09-21T15:27:14.178 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c820 2024-09-21T15:27:14.178 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c8f0 2024-09-21T15:27:14.178 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c9c0 2024-09-21T15:27:14.178 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01cf70 2024-09-21T15:27:14.178 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d040 2024-09-21T15:27:14.178 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:14.166+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d2b0 2024-09-21T15:27:14.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:14.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone25@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone25.export 2024-09-21T15:27:15.679 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.1 2024-09-21T15:27:15.679 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:27:15.679 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.1 2024-09-21T15:27:15.679 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2024-09-21T15:27:15.680 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2024-09-21T15:27:15.681 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2024-09-21T15:27:15.682 INFO:tasks.rbd_mirror_thrash:waiting for 61 secs before thrashing 2024-09-21T15:27:19.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:19.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone25.export 2024-09-21T15:27:20.019 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:20.019 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone25.export 2024-09-21T15:27:20.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone25.export 2024-09-21T15:27:23.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:23.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone25.export 2024-09-21T15:27:27.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:27.082 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone25.export 2024-09-21T15:27:27.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone25.export 2024-09-21T15:27:27.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:27.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:27.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone26 2024-09-21T15:27:27.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:27.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone26 2024-09-21T15:27:27.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:27.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone26.export 2024-09-21T15:27:27.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone26.export 2024-09-21T15:27:27.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone26 2024-09-21T15:27:27.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:27.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:27.331 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:27.331 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone26.export 2024-09-21T15:27:27.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone26@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone26.export 2024-09-21T15:27:27.494 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 8% complete... Exporting image: 11% complete... Exporting image: 14% complete... Exporting image: 17% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 26% complete... Exporting image: 29% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:27.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone26@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone26.export 2024-09-21T15:27:27.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 8% complete... Exporting image: 11% complete... Exporting image: 14% complete... Exporting image: 17% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 26% complete... Exporting image: 29% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:27.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone26.export 2024-09-21T15:27:28.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:28.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone26.export 2024-09-21T15:27:28.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone26.export 2024-09-21T15:27:28.194 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 8% complete... Exporting image: 11% complete... Exporting image: 14% complete... Exporting image: 17% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 26% complete... Exporting image: 29% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:28.200 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone26.export 2024-09-21T15:27:28.362 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 5% complete... Exporting image: 8% complete... Exporting image: 11% complete... Exporting image: 14% complete... Exporting image: 17% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 26% complete... Exporting image: 29% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:28.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone26.export 2024-09-21T15:27:28.529 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone26.export 2024-09-21T15:27:28.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:28.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:28.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone27 2024-09-21T15:27:28.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:28.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone27 2024-09-21T15:27:28.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:28.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone27.export 2024-09-21T15:27:28.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone27.export 2024-09-21T15:27:28.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone27 2024-09-21T15:27:28.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:28.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:28.795 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.790+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:27:28.798 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.790+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:27:28.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:27:28.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:27:28.820 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2881a0 2024-09-21T15:27:28.823 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288c30 2024-09-21T15:27:28.824 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:27:28.824 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:27:28.824 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:27:28.824 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:27:28.824 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af310dd0 2024-09-21T15:27:28.830 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:27:28.830 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:27:28.830 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:27:28.830 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:27:28.830 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:27:28.831 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.822+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:27:28.833 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:27:28.833 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:27:28.833 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676750 2024-09-21T15:27:28.833 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.826+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:27:28.863 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.854+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:27:28.867 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:28.867 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone27.export 2024-09-21T15:27:28.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone27@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone27.export 2024-09-21T15:27:28.880 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.874+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:27:28.893 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:27:28.893 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288000 2024-09-21T15:27:28.893 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2881a0 2024-09-21T15:27:28.893 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288c30 2024-09-21T15:27:28.893 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:27:28.893 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289ee0 2024-09-21T15:27:28.893 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf9d40 2024-09-21T15:27:28.896 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.882+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:27:28.901 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.894+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:27:28.911 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.906+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68dd0 2024-09-21T15:27:28.915 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.906+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68ea0 2024-09-21T15:27:28.916 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69860 2024-09-21T15:27:28.916 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af310dd0 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afb6a820 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7aea0 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7af70 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b1e0 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8410 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8d00 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9860 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:27:28.917 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57c70 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d25b0 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3d40 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676340 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676750 2024-09-21T15:27:28.918 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36775f0 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36776c0 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677930 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677ba0 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677e10 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45280d0 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528410 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45285b0 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45288f0 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528d00 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529860 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b20d0 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b21a0 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2340 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2820 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2ea0 2024-09-21T15:27:28.919 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2f70 2024-09-21T15:27:28.920 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:27:28.920 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3380 2024-09-21T15:27:28.920 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3520 2024-09-21T15:27:28.920 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3ba0 2024-09-21T15:27:28.920 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59cb930 2024-09-21T15:27:28.920 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:27:28.910+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:27:29.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:29.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone27@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone27.export 2024-09-21T15:27:29.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:29.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone27.export 2024-09-21T15:27:29.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:29.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone27.export 2024-09-21T15:27:29.511 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone27.export 2024-09-21T15:27:29.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:29.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone27.export 2024-09-21T15:27:29.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:29.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone27.export 2024-09-21T15:27:30.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone27.export 2024-09-21T15:27:30.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:30.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:30.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone28 2024-09-21T15:27:30.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:30.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone28 2024-09-21T15:27:30.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:30.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone28.export 2024-09-21T15:27:30.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone28.export 2024-09-21T15:27:30.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone28 2024-09-21T15:27:30.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:30.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:30.185 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:30.185 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone28.export 2024-09-21T15:27:30.186 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone28@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone28.export 2024-09-21T15:27:31.882 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 16% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 71% complete... Exporting image: 74% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 88% complete... Exporting image: 91% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:31.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone28@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone28.export 2024-09-21T15:27:32.775 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.766+0000 7f7fd044c700 -1 reset not still connected to 0x5636a780eb60 2024-09-21T15:27:32.775 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.766+0000 7f7fd044c700 -1 reset not still connected to 0x5636a780ed00 2024-09-21T15:27:32.775 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.766+0000 7f7fd044c700 -1 reset not still connected to 0x5636a86705b0 2024-09-21T15:27:32.775 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.766+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670680 2024-09-21T15:27:32.793 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.778+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670dd0 2024-09-21T15:27:32.793 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.778+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9e8f520 2024-09-21T15:27:32.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa0baa90 2024-09-21T15:27:32.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:27:32.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e8410 2024-09-21T15:27:32.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:27:32.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678e5b0 2024-09-21T15:27:32.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678f2b0 2024-09-21T15:27:32.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb84e0 2024-09-21T15:27:32.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:27:32.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff656c0 2024-09-21T15:27:32.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65c70 2024-09-21T15:27:32.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbb2b0 2024-09-21T15:27:32.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1c70 2024-09-21T15:27:32.807 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1ee0 2024-09-21T15:27:32.811 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c47095f0 2024-09-21T15:27:32.811 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.794+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e750 2024-09-21T15:27:32.811 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.798+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:27:32.813 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.802+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:27:32.814 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.802+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:27:32.816 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.802+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:27:32.816 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.802+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:27:32.816 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.802+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335a00 2024-09-21T15:27:32.816 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.802+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335ad0 2024-09-21T15:27:32.816 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.802+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766750 2024-09-21T15:27:32.816 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.802+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87676c0 2024-09-21T15:27:32.817 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.802+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:27:32.817 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.802+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89672b0 2024-09-21T15:27:32.831 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.818+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967a00 2024-09-21T15:27:32.831 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.818+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:27:32.832 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.822+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:27:32.833 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.822+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51110 2024-09-21T15:27:32.833 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.822+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51380 2024-09-21T15:27:32.833 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.822+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde261a0 2024-09-21T15:27:32.833 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.822+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde27d40 2024-09-21T15:27:32.833 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.822+0000 7f7fd044c700 -1 reset not still connected to 0x5636ce7e9790 2024-09-21T15:27:32.833 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.822+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c820 2024-09-21T15:27:32.840 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c8f0 2024-09-21T15:27:32.840 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c9c0 2024-09-21T15:27:32.840 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01cf70 2024-09-21T15:27:32.840 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d040 2024-09-21T15:27:32.840 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:32.830+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d2b0 2024-09-21T15:27:33.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 16% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 71% complete... Exporting image: 74% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 88% complete... Exporting image: 91% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:33.837 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone28.export 2024-09-21T15:27:33.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:33.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone28.export 2024-09-21T15:27:34.028 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone28.export 2024-09-21T15:27:34.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:34.086 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone28.export 2024-09-21T15:27:34.202 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:34.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone28.export 2024-09-21T15:27:34.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone28.export 2024-09-21T15:27:34.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:34.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:34.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone29 2024-09-21T15:27:34.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:34.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone29 2024-09-21T15:27:34.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:34.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone29.export 2024-09-21T15:27:34.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone29.export 2024-09-21T15:27:34.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone29 2024-09-21T15:27:34.209 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:34.209 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:34.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:34.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone29.export 2024-09-21T15:27:34.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone29@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone29.export 2024-09-21T15:27:34.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 46% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:34.488 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone29@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone29.export 2024-09-21T15:27:34.702 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 46% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:34.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone29.export 2024-09-21T15:27:34.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:34.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone29.export 2024-09-21T15:27:34.917 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone29.export 2024-09-21T15:27:35.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 46% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:35.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone29.export 2024-09-21T15:27:35.330 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 46% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:35.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone29.export 2024-09-21T15:27:35.506 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone29.export 2024-09-21T15:27:35.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:35.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:35.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone3 2024-09-21T15:27:35.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:35.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone3 2024-09-21T15:27:35.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:35.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone3.export 2024-09-21T15:27:35.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone3.export 2024-09-21T15:27:35.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone3 2024-09-21T15:27:35.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:35.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:35.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:35.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone3.export 2024-09-21T15:27:35.627 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone3@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone3.export 2024-09-21T15:27:35.813 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:35.821 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone3@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone3.export 2024-09-21T15:27:36.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:36.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone3.export 2024-09-21T15:27:36.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:36.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone3.export 2024-09-21T15:27:36.099 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone3.export 2024-09-21T15:27:36.275 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:36.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone3.export 2024-09-21T15:27:36.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:36.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone3.export 2024-09-21T15:27:36.542 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone3.export 2024-09-21T15:27:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone30 2024-09-21T15:27:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone30 2024-09-21T15:27:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone30.export 2024-09-21T15:27:36.566 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone30.export 2024-09-21T15:27:36.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone30 2024-09-21T15:27:36.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:36.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:36.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:36.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone30.export 2024-09-21T15:27:36.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone30.export 2024-09-21T15:27:36.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:36.778 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone30.export 2024-09-21T15:27:36.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:36.939 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone30.export 2024-09-21T15:27:37.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone30.export 2024-09-21T15:27:37.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:37.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:37.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone4 2024-09-21T15:27:37.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:37.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone4 2024-09-21T15:27:37.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:37.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone4.export 2024-09-21T15:27:37.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone4.export 2024-09-21T15:27:37.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone4 2024-09-21T15:27:37.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:37.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:37.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:37.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone4.export 2024-09-21T15:27:37.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone4@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone4.export 2024-09-21T15:27:37.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 33% complete... Exporting image: 66% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:37.425 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone4@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone4.export 2024-09-21T15:27:37.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 33% complete... Exporting image: 66% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:37.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone4.export 2024-09-21T15:27:37.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:37.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone4.export 2024-09-21T15:27:37.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone4.export 2024-09-21T15:27:37.883 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2024-09-21T15:27:37.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2024-09-21T15:27:37.883 INFO:tasks.rbd_mirror_thrash:waiting for 7 secs before reviving daemons 2024-09-21T15:27:37.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:27:37.879+0000 7f997f458700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 64920) UID: 1000 2024-09-21T15:27:38.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 33% complete... Exporting image: 66% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:38.041 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone4.export 2024-09-21T15:27:38.266 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 33% complete... Exporting image: 66% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:38.271 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone4.export 2024-09-21T15:27:38.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone4.export 2024-09-21T15:27:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone5 2024-09-21T15:27:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone5 2024-09-21T15:27:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone5.export 2024-09-21T15:27:38.443 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone5.export 2024-09-21T15:27:38.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone5 2024-09-21T15:27:38.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:38.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:38.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:38.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone5.export 2024-09-21T15:27:38.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone5@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone5.export 2024-09-21T15:27:38.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:38.825 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone5@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone5.export 2024-09-21T15:27:39.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:39.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone5.export 2024-09-21T15:27:39.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:39.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone5.export 2024-09-21T15:27:39.272 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone5.export 2024-09-21T15:27:39.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:39.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone5.export 2024-09-21T15:27:39.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:39.820 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone5.export 2024-09-21T15:27:39.914 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone5.export 2024-09-21T15:27:39.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:39.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:39.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone6 2024-09-21T15:27:39.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:39.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone6 2024-09-21T15:27:39.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:39.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone6.export 2024-09-21T15:27:39.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone6.export 2024-09-21T15:27:39.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone6 2024-09-21T15:27:39.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:39.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:40.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:40.075 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone6.export 2024-09-21T15:27:40.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone6@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone6.export 2024-09-21T15:27:40.375 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 12% complete... Exporting image: 18% complete... Exporting image: 24% complete... Exporting image: 30% complete... Exporting image: 36% complete... Exporting image: 43% complete... Exporting image: 49% complete... Exporting image: 55% complete... Exporting image: 61% complete... Exporting image: 67% complete... Exporting image: 73% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 92% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:40.385 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone6@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone6.export 2024-09-21T15:27:40.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 12% complete... Exporting image: 18% complete... Exporting image: 24% complete... Exporting image: 30% complete... Exporting image: 36% complete... Exporting image: 43% complete... Exporting image: 49% complete... Exporting image: 55% complete... Exporting image: 61% complete... Exporting image: 67% complete... Exporting image: 73% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 92% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:40.696 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone6.export 2024-09-21T15:27:40.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:40.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone6.export 2024-09-21T15:27:40.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone6.export 2024-09-21T15:27:40.949 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:40.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone6.export 2024-09-21T15:27:41.092 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:41.099 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone6.export 2024-09-21T15:27:41.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone6.export 2024-09-21T15:27:41.113 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:41.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:41.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone7 2024-09-21T15:27:41.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:41.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone7 2024-09-21T15:27:41.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:41.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone7.export 2024-09-21T15:27:41.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone7.export 2024-09-21T15:27:41.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone7 2024-09-21T15:27:41.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:41.115 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:41.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:41.190 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone7.export 2024-09-21T15:27:41.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone7@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone7.export 2024-09-21T15:27:41.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:41.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone7@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone7.export 2024-09-21T15:27:41.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:41.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone7.export 2024-09-21T15:27:41.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:41.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone7.export 2024-09-21T15:27:41.617 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone7.export 2024-09-21T15:27:41.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:41.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone7.export 2024-09-21T15:27:41.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:41.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone7.export 2024-09-21T15:27:41.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone7.export 2024-09-21T15:27:42.018 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:42.018 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:42.018 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone8 2024-09-21T15:27:42.018 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:42.018 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone8 2024-09-21T15:27:42.018 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:42.018 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone8.export 2024-09-21T15:27:42.018 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone8.export 2024-09-21T15:27:42.019 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:42.019 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone8 2024-09-21T15:27:42.019 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:42.093 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:42.093 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone8.export 2024-09-21T15:27:42.094 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone8@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone8.export 2024-09-21T15:27:42.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 18% complete... Exporting image: 23% complete... Exporting image: 28% complete... Exporting image: 33% complete... Exporting image: 37% complete... Exporting image: 42% complete... Exporting image: 47% complete... Exporting image: 52% complete... Exporting image: 56% complete... Exporting image: 61% complete... Exporting image: 66% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 80% complete... Exporting image: 85% complete... Exporting image: 90% complete... Exporting image: 94% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:42.787 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone8@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone8.export 2024-09-21T15:27:43.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 18% complete... Exporting image: 23% complete... Exporting image: 28% complete... Exporting image: 33% complete... Exporting image: 37% complete... Exporting image: 42% complete... Exporting image: 47% complete... Exporting image: 52% complete... Exporting image: 56% complete... Exporting image: 61% complete... Exporting image: 66% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 80% complete... Exporting image: 85% complete... Exporting image: 90% complete... Exporting image: 94% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:43.503 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone8.export 2024-09-21T15:27:43.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:43.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone8.export 2024-09-21T15:27:43.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone8.export 2024-09-21T15:27:43.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:43.718 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone8.export 2024-09-21T15:27:43.778 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:43.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone8.export 2024-09-21T15:27:43.786 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone8.export 2024-09-21T15:27:43.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:43.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:43.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.1-clone9 2024-09-21T15:27:43.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:43.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.1-clone9 2024-09-21T15:27:43.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:43.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone9.export 2024-09-21T15:27:43.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone9.export 2024-09-21T15:27:43.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.1-clone9 2024-09-21T15:27:43.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:43.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:43.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:43.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone9.export 2024-09-21T15:27:43.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone9@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone9.export 2024-09-21T15:27:44.795 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.789+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:27:44.795 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.789+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335a00 2024-09-21T15:27:44.795 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.789+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335ad0 2024-09-21T15:27:44.799 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.789+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766750 2024-09-21T15:27:44.799 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.789+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87676c0 2024-09-21T15:27:44.799 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.789+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:27:44.799 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.789+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89672b0 2024-09-21T15:27:44.808 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.801+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:27:44.811 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.801+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:27:44.811 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.801+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51110 2024-09-21T15:27:44.811 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.801+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde261a0 2024-09-21T15:27:44.811 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.801+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde27d40 2024-09-21T15:27:44.811 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.801+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c820 2024-09-21T15:27:44.812 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.805+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c8f0 2024-09-21T15:27:44.812 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.805+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c9c0 2024-09-21T15:27:44.812 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.805+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01cf70 2024-09-21T15:27:44.812 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.805+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d040 2024-09-21T15:27:44.812 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:44.805+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d2b0 2024-09-21T15:27:44.884 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2024-09-21T15:27:44.885 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:27:44.885 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.0 2024-09-21T15:27:44.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2024-09-21T15:27:44.885 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2024-09-21T15:27:44.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2024-09-21T15:27:44.888 INFO:tasks.rbd_mirror_thrash:waiting for 92 secs before thrashing 2024-09-21T15:27:44.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 30% complete... Exporting image: 40% complete... Exporting image: 50% complete... Exporting image: 60% complete... Exporting image: 71% complete... Exporting image: 81% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:44.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone9@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone9.export 2024-09-21T15:27:46.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 30% complete... Exporting image: 40% complete... Exporting image: 50% complete... Exporting image: 60% complete... Exporting image: 71% complete... Exporting image: 81% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:46.391 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone9.export 2024-09-21T15:27:46.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:46.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone9.export 2024-09-21T15:27:46.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.1-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone9.export 2024-09-21T15:27:47.222 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 50% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:47.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.1-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone9.export 2024-09-21T15:27:47.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 50% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:47.806 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone9.export 2024-09-21T15:27:47.842 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.1-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.1-clone9.export 2024-09-21T15:27:47.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:47.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:47.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2 2024-09-21T15:27:47.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:47.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2 2024-09-21T15:27:47.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:47.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2.export 2024-09-21T15:27:47.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2.export 2024-09-21T15:27:47.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2 2024-09-21T15:27:47.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:47.865 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:47.937 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:47.938 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2.export 2024-09-21T15:27:47.939 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2.export 2024-09-21T15:27:48.047 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:48.056 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2.export 2024-09-21T15:27:48.168 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:48.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2.export 2024-09-21T15:27:48.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:48.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2.export 2024-09-21T15:27:48.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2.export 2024-09-21T15:27:48.686 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:48.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2.export 2024-09-21T15:27:48.825 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:48.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2.export 2024-09-21T15:27:49.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2.export 2024-09-21T15:27:49.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:49.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:49.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone1 2024-09-21T15:27:49.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:49.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone1 2024-09-21T15:27:49.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:49.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone1.export 2024-09-21T15:27:49.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone1.export 2024-09-21T15:27:49.034 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone1 2024-09-21T15:27:49.034 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:49.034 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:49.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:49.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone1.export 2024-09-21T15:27:49.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone1@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone1.export 2024-09-21T15:27:49.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:49.425 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone1@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone1.export 2024-09-21T15:27:49.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:49.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone1.export 2024-09-21T15:27:49.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:49.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone1.export 2024-09-21T15:27:49.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone1.export 2024-09-21T15:27:49.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:49.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone1.export 2024-09-21T15:27:50.047 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:50.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone1.export 2024-09-21T15:27:50.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone1.export 2024-09-21T15:27:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone10 2024-09-21T15:27:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone10 2024-09-21T15:27:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone10.export 2024-09-21T15:27:50.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone10.export 2024-09-21T15:27:50.065 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone10 2024-09-21T15:27:50.065 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:50.065 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:50.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:50.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone10.export 2024-09-21T15:27:50.260 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone10@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone10.export 2024-09-21T15:27:50.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 30% complete... Exporting image: 60% complete... Exporting image: 90% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:50.572 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone10@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone10.export 2024-09-21T15:27:50.575 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:50.565+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670dd0 2024-09-21T15:27:50.575 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:50.565+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e8410 2024-09-21T15:27:50.587 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:50.569+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65c70 2024-09-21T15:27:50.587 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:50.573+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1ee0 2024-09-21T15:27:50.587 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:50.577+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87676c0 2024-09-21T15:27:50.587 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:27:50.577+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:27:50.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 30% complete... Exporting image: 60% complete... Exporting image: 90% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:50.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone10.export 2024-09-21T15:27:51.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:51.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone10.export 2024-09-21T15:27:51.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone10.export 2024-09-21T15:27:51.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:51.193 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone10.export 2024-09-21T15:27:51.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:51.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone10.export 2024-09-21T15:27:51.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone10.export 2024-09-21T15:27:51.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:51.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:51.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone11 2024-09-21T15:27:51.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:51.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone11 2024-09-21T15:27:51.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:51.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone11.export 2024-09-21T15:27:51.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone11.export 2024-09-21T15:27:51.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone11 2024-09-21T15:27:51.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:51.411 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:51.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:51.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone11.export 2024-09-21T15:27:51.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone11@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone11.export 2024-09-21T15:27:51.712 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 26% complete... Exporting image: 52% complete... Exporting image: 79% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:51.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone11@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone11.export 2024-09-21T15:27:51.987 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 26% complete... Exporting image: 52% complete... Exporting image: 79% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:51.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone11.export 2024-09-21T15:27:52.117 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:52.117 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone11.export 2024-09-21T15:27:52.166 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone11.export 2024-09-21T15:27:52.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 26% complete... Exporting image: 52% complete... Exporting image: 79% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:52.397 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone11.export 2024-09-21T15:27:52.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 26% complete... Exporting image: 52% complete... Exporting image: 79% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:52.635 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone11.export 2024-09-21T15:27:52.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone11.export 2024-09-21T15:27:52.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:52.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:52.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone12 2024-09-21T15:27:52.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:52.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone12 2024-09-21T15:27:52.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:52.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone12.export 2024-09-21T15:27:52.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone12.export 2024-09-21T15:27:52.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone12 2024-09-21T15:27:52.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:52.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:52.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:52.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone12.export 2024-09-21T15:27:52.889 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone12@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone12.export 2024-09-21T15:27:53.278 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 36% complete... Exporting image: 72% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:53.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone12@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone12.export 2024-09-21T15:27:53.796 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 36% complete... Exporting image: 72% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:53.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone12.export 2024-09-21T15:27:53.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:53.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone12.export 2024-09-21T15:27:53.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone12.export 2024-09-21T15:27:54.457 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 36% complete... Exporting image: 72% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:54.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone12.export 2024-09-21T15:27:55.018 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 36% complete... Exporting image: 72% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:55.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone12.export 2024-09-21T15:27:55.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone12.export 2024-09-21T15:27:55.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:55.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:55.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone13 2024-09-21T15:27:55.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:55.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone13 2024-09-21T15:27:55.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:55.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone13.export 2024-09-21T15:27:55.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone13.export 2024-09-21T15:27:55.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone13 2024-09-21T15:27:55.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:55.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:55.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:55.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone13.export 2024-09-21T15:27:55.275 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone13@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone13.export 2024-09-21T15:27:55.426 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:55.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone13@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone13.export 2024-09-21T15:27:55.599 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:55.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone13.export 2024-09-21T15:27:55.649 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:55.649 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone13.export 2024-09-21T15:27:55.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone13.export 2024-09-21T15:27:55.817 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:55.826 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone13.export 2024-09-21T15:27:55.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:27:55.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone13.export 2024-09-21T15:27:56.034 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone13.export 2024-09-21T15:27:56.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:56.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:56.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone14 2024-09-21T15:27:56.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:56.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone14 2024-09-21T15:27:56.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:56.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone14.export 2024-09-21T15:27:56.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone14.export 2024-09-21T15:27:56.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:56.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone14 2024-09-21T15:27:56.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:56.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:56.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone14.export 2024-09-21T15:27:56.144 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone14@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone14.export 2024-09-21T15:27:56.309 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:56.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone14@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone14.export 2024-09-21T15:27:56.496 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:56.502 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone14.export 2024-09-21T15:27:56.667 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:56.667 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone14.export 2024-09-21T15:27:56.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone14.export 2024-09-21T15:27:57.044 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:57.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone14.export 2024-09-21T15:27:57.217 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:57.225 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone14.export 2024-09-21T15:27:57.389 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone14.export 2024-09-21T15:27:57.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:57.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:57.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone15 2024-09-21T15:27:57.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:57.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone15 2024-09-21T15:27:57.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:57.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone15.export 2024-09-21T15:27:57.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone15.export 2024-09-21T15:27:57.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone15 2024-09-21T15:27:57.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:57.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:57.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:57.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone15.export 2024-09-21T15:27:57.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone15@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone15.export 2024-09-21T15:27:57.674 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:27:57.667+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0000 2024-09-21T15:27:57.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 18% complete... Exporting image: 36% complete... Exporting image: 55% complete... Exporting image: 73% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:57.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone15@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone15.export 2024-09-21T15:27:58.175 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 18% complete... Exporting image: 36% complete... Exporting image: 55% complete... Exporting image: 73% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:58.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone15.export 2024-09-21T15:27:58.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:58.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone15.export 2024-09-21T15:27:58.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone15.export 2024-09-21T15:27:58.598 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 27% complete... Exporting image: 55% complete... Exporting image: 83% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:58.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone15.export 2024-09-21T15:27:58.849 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 27% complete... Exporting image: 55% complete... Exporting image: 83% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:58.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone15.export 2024-09-21T15:27:58.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone15.export 2024-09-21T15:27:58.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:27:58.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:27:58.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone16 2024-09-21T15:27:58.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:27:58.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone16 2024-09-21T15:27:58.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:27:58.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone16.export 2024-09-21T15:27:58.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone16.export 2024-09-21T15:27:58.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone16 2024-09-21T15:27:58.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:27:58.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:27:59.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:59.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone16.export 2024-09-21T15:27:59.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone16@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone16.export 2024-09-21T15:27:59.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:59.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone16@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone16.export 2024-09-21T15:27:59.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:27:59.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone16.export 2024-09-21T15:27:59.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:27:59.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone16.export 2024-09-21T15:27:59.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone16.export 2024-09-21T15:28:00.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 25% complete... Exporting image: 38% complete... Exporting image: 50% complete... Exporting image: 63% complete... Exporting image: 76% complete... Exporting image: 89% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:00.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone16.export 2024-09-21T15:28:00.240 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 25% complete... Exporting image: 38% complete... Exporting image: 50% complete... Exporting image: 63% complete... Exporting image: 76% complete... Exporting image: 89% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:00.247 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone16.export 2024-09-21T15:28:00.271 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone16.export 2024-09-21T15:28:00.275 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:00.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:00.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone17 2024-09-21T15:28:00.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:00.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone17 2024-09-21T15:28:00.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:00.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone17.export 2024-09-21T15:28:00.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone17.export 2024-09-21T15:28:00.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone17 2024-09-21T15:28:00.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:00.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:00.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:00.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone17.export 2024-09-21T15:28:00.438 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone17@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone17.export 2024-09-21T15:28:00.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 16% complete... Exporting image: 32% complete... Exporting image: 48% complete... Exporting image: 64% complete... Exporting image: 80% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:00.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone17@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone17.export 2024-09-21T15:28:01.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 16% complete... Exporting image: 32% complete... Exporting image: 48% complete... Exporting image: 64% complete... Exporting image: 80% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:01.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone17.export 2024-09-21T15:28:01.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:01.150 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone17.export 2024-09-21T15:28:01.195 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone17.export 2024-09-21T15:28:01.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:01.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone17.export 2024-09-21T15:28:01.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:01.478 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone17.export 2024-09-21T15:28:01.481 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone17.export 2024-09-21T15:28:01.483 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:01.483 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:01.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone18 2024-09-21T15:28:01.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:01.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone18 2024-09-21T15:28:01.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:01.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone18.export 2024-09-21T15:28:01.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone18.export 2024-09-21T15:28:01.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone18 2024-09-21T15:28:01.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:01.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:01.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:01.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone18.export 2024-09-21T15:28:01.651 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone18@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone18.export 2024-09-21T15:28:02.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 49% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:02.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone18@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone18.export 2024-09-21T15:28:02.304 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 49% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:02.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone18.export 2024-09-21T15:28:02.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:02.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone18.export 2024-09-21T15:28:02.381 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone18.export 2024-09-21T15:28:02.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:02.541 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone18.export 2024-09-21T15:28:02.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:02.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone18.export 2024-09-21T15:28:02.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone18.export 2024-09-21T15:28:02.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:02.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:02.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone19 2024-09-21T15:28:02.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:02.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone19 2024-09-21T15:28:02.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:02.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone19.export 2024-09-21T15:28:02.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone19.export 2024-09-21T15:28:02.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone19 2024-09-21T15:28:02.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:02.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:03.166 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:03.166 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone19.export 2024-09-21T15:28:03.167 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone19@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone19.export 2024-09-21T15:28:03.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 15% complete... Exporting image: 31% complete... Exporting image: 46% complete... Exporting image: 62% complete... Exporting image: 77% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:03.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone19@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone19.export 2024-09-21T15:28:03.717 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 15% complete... Exporting image: 31% complete... Exporting image: 46% complete... Exporting image: 62% complete... Exporting image: 77% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:03.726 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone19.export 2024-09-21T15:28:03.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:03.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone19.export 2024-09-21T15:28:03.907 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone19.export 2024-09-21T15:28:04.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 15% complete... Exporting image: 31% complete... Exporting image: 46% complete... Exporting image: 62% complete... Exporting image: 77% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:04.162 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.154+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:28:04.163 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.154+0000 7ff753f07700 -1 reset not still connected to 0x56016d985860 2024-09-21T15:28:04.170 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:28:04.178 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x56016ea1e340 2024-09-21T15:28:04.178 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x56016f163450 2024-09-21T15:28:04.178 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2a90 2024-09-21T15:28:04.178 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:28:04.178 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x5601709b80d0 2024-09-21T15:28:04.178 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x560170f64b60 2024-09-21T15:28:04.179 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:28:04.179 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:28:04.179 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x56017219fba0 2024-09-21T15:28:04.179 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x560173e671e0 2024-09-21T15:28:04.179 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:28:04.179 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:28:04.179 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.162+0000 7ff753f07700 -1 reset not still connected to 0x56017529aea0 2024-09-21T15:28:04.179 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.166+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:28:04.179 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.166+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0000 2024-09-21T15:28:04.179 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.166+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:28:04.179 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.166+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d1e0 2024-09-21T15:28:04.180 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.166+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:28:04.180 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.166+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc9c0 2024-09-21T15:28:04.180 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.166+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:28:04.180 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.166+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:28:04.180 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.166+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e680 2024-09-21T15:28:04.180 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.174+0000 7ff753f07700 -1 reset not still connected to 0x56017a2045b0 2024-09-21T15:28:04.190 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.178+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:28:04.190 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.178+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2410 2024-09-21T15:28:04.190 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.182+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:28:04.190 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.182+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:28:04.191 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.182+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:28:04.192 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.186+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:28:04.192 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.186+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:28:04.192 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:28:04.186+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd1e0 2024-09-21T15:28:04.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone19.export 2024-09-21T15:28:04.573 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 15% complete... Exporting image: 31% complete... Exporting image: 46% complete... Exporting image: 62% complete... Exporting image: 77% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:04.585 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone19.export 2024-09-21T15:28:04.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone19.export 2024-09-21T15:28:04.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:04.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:04.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone2 2024-09-21T15:28:04.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:04.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone2 2024-09-21T15:28:04.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:04.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone2.export 2024-09-21T15:28:04.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone2.export 2024-09-21T15:28:04.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:04.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone2 2024-09-21T15:28:04.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:04.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:04.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone2.export 2024-09-21T15:28:04.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone2@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone2.export 2024-09-21T15:28:05.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:05.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone2@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone2.export 2024-09-21T15:28:05.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:05.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone2.export 2024-09-21T15:28:05.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:05.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone2.export 2024-09-21T15:28:05.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone2.export 2024-09-21T15:28:05.522 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 15% complete... Exporting image: 31% complete... Exporting image: 47% complete... Exporting image: 62% complete... Exporting image: 78% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:05.529 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone2.export 2024-09-21T15:28:05.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 15% complete... Exporting image: 31% complete... Exporting image: 47% complete... Exporting image: 62% complete... Exporting image: 78% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:05.638 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone2.export 2024-09-21T15:28:05.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone2.export 2024-09-21T15:28:05.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:05.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:05.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone20 2024-09-21T15:28:05.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:05.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone20 2024-09-21T15:28:05.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:05.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone20.export 2024-09-21T15:28:05.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone20.export 2024-09-21T15:28:05.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone20 2024-09-21T15:28:05.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:05.648 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:05.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:05.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone20.export 2024-09-21T15:28:05.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone20@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone20.export 2024-09-21T15:28:06.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:06.167 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone20@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone20.export 2024-09-21T15:28:06.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:06.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone20.export 2024-09-21T15:28:06.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:06.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone20.export 2024-09-21T15:28:06.624 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone20.export 2024-09-21T15:28:06.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:06.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone20.export 2024-09-21T15:28:07.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:07.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone20.export 2024-09-21T15:28:07.275 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone20.export 2024-09-21T15:28:07.300 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:07.300 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone21 2024-09-21T15:28:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone21 2024-09-21T15:28:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone21.export 2024-09-21T15:28:07.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone21.export 2024-09-21T15:28:07.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone21 2024-09-21T15:28:07.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:07.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:07.375 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:07.375 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone21.export 2024-09-21T15:28:07.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone21@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone21.export 2024-09-21T15:28:07.522 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:07.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone21@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone21.export 2024-09-21T15:28:07.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:07.695 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone21.export 2024-09-21T15:28:07.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:07.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone21.export 2024-09-21T15:28:07.924 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone21.export 2024-09-21T15:28:08.037 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.029+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:28:08.037 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.029+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:28:08.054 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:08.056 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.049+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:28:08.058 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.049+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf9d40 2024-09-21T15:28:08.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone21.export 2024-09-21T15:28:08.071 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.061+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:28:08.071 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.061+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:28:08.082 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.073+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68dd0 2024-09-21T15:28:08.097 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.089+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:28:08.105 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.093+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af310dd0 2024-09-21T15:28:08.108 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.097+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:28:08.121 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.113+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:28:08.121 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.113+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:28:08.121 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.113+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:28:08.127 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:28:08.127 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:28:08.127 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:28:08.127 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:28:08.127 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:28:08.127 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:08.117+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:28:08.194 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:08.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone21.export 2024-09-21T15:28:08.393 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone21.export 2024-09-21T15:28:08.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:08.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:08.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone22 2024-09-21T15:28:08.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:08.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone22 2024-09-21T15:28:08.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:08.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone22.export 2024-09-21T15:28:08.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone22.export 2024-09-21T15:28:08.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone22 2024-09-21T15:28:08.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:08.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:08.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:08.502 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone22.export 2024-09-21T15:28:08.503 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone22@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone22.export 2024-09-21T15:28:08.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 12% complete... Exporting image: 16% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 33% complete... Exporting image: 37% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 54% complete... Exporting image: 58% complete... Exporting image: 62% complete... Exporting image: 66% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 83% complete... Exporting image: 87% complete... Exporting image: 92% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:08.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone22@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone22.export 2024-09-21T15:28:08.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 12% complete... Exporting image: 16% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 33% complete... Exporting image: 37% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 54% complete... Exporting image: 58% complete... Exporting image: 62% complete... Exporting image: 66% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 83% complete... Exporting image: 87% complete... Exporting image: 92% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:08.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone22.export 2024-09-21T15:28:09.081 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:09.081 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone22.export 2024-09-21T15:28:09.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone22.export 2024-09-21T15:28:09.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 12% complete... Exporting image: 16% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 33% complete... Exporting image: 37% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 54% complete... Exporting image: 58% complete... Exporting image: 62% complete... Exporting image: 66% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 83% complete... Exporting image: 87% complete... Exporting image: 92% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:09.491 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone22.export 2024-09-21T15:28:09.617 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 12% complete... Exporting image: 16% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 33% complete... Exporting image: 37% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 54% complete... Exporting image: 58% complete... Exporting image: 62% complete... Exporting image: 66% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 83% complete... Exporting image: 87% complete... Exporting image: 92% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:09.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone22.export 2024-09-21T15:28:09.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone22.export 2024-09-21T15:28:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone23 2024-09-21T15:28:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone23 2024-09-21T15:28:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone23.export 2024-09-21T15:28:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone23.export 2024-09-21T15:28:09.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone23 2024-09-21T15:28:09.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:09.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:09.825 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:09.825 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone23.export 2024-09-21T15:28:09.826 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone23@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone23.export 2024-09-21T15:28:10.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 52% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:10.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone23@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone23.export 2024-09-21T15:28:10.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 52% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:10.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone23.export 2024-09-21T15:28:10.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:10.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone23.export 2024-09-21T15:28:10.354 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone23.export 2024-09-21T15:28:10.538 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 57% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:10.547 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone23.export 2024-09-21T15:28:10.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 57% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:10.751 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone23.export 2024-09-21T15:28:10.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone23.export 2024-09-21T15:28:10.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:10.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:10.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone24 2024-09-21T15:28:10.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:10.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone24 2024-09-21T15:28:10.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:10.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone24.export 2024-09-21T15:28:10.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone24.export 2024-09-21T15:28:10.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone24 2024-09-21T15:28:10.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:10.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:10.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:10.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone24.export 2024-09-21T15:28:10.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone24@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone24.export 2024-09-21T15:28:11.037 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 15% complete... Exporting image: 31% complete... Exporting image: 46% complete... Exporting image: 62% complete... Exporting image: 78% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:11.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone24@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone24.export 2024-09-21T15:28:11.176 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 15% complete... Exporting image: 31% complete... Exporting image: 46% complete... Exporting image: 62% complete... Exporting image: 78% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:11.185 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone24.export 2024-09-21T15:28:11.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:11.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone24.export 2024-09-21T15:28:11.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone24.export 2024-09-21T15:28:11.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 15% complete... Exporting image: 31% complete... Exporting image: 46% complete... Exporting image: 62% complete... Exporting image: 78% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:11.425 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone24.export 2024-09-21T15:28:11.559 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 15% complete... Exporting image: 31% complete... Exporting image: 46% complete... Exporting image: 62% complete... Exporting image: 78% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:11.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone24.export 2024-09-21T15:28:11.651 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone24.export 2024-09-21T15:28:11.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:11.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:11.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone25 2024-09-21T15:28:11.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:11.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone25 2024-09-21T15:28:11.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:11.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone25.export 2024-09-21T15:28:11.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone25.export 2024-09-21T15:28:11.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:11.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone25 2024-09-21T15:28:11.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:11.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:11.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone25.export 2024-09-21T15:28:11.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone25@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone25.export 2024-09-21T15:28:11.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 40% complete... Exporting image: 54% complete... Exporting image: 67% complete... Exporting image: 81% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:11.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone25@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone25.export 2024-09-21T15:28:12.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 40% complete... Exporting image: 54% complete... Exporting image: 67% complete... Exporting image: 81% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:12.041 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone25.export 2024-09-21T15:28:12.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:12.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone25.export 2024-09-21T15:28:12.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone25.export 2024-09-21T15:28:12.298 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 40% complete... Exporting image: 54% complete... Exporting image: 67% complete... Exporting image: 81% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:12.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone25.export 2024-09-21T15:28:12.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 40% complete... Exporting image: 54% complete... Exporting image: 67% complete... Exporting image: 81% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:12.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone25.export 2024-09-21T15:28:12.555 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone25.export 2024-09-21T15:28:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone26 2024-09-21T15:28:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone26 2024-09-21T15:28:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone26.export 2024-09-21T15:28:12.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone26.export 2024-09-21T15:28:12.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:12.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone26 2024-09-21T15:28:12.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:12.675 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:12.675 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone26.export 2024-09-21T15:28:12.676 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone26@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone26.export 2024-09-21T15:28:12.872 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 14% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:12.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone26@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone26.export 2024-09-21T15:28:13.071 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 14% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 91% complete... Exporting image: 94% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:13.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone26.export 2024-09-21T15:28:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:13.244 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone26.export 2024-09-21T15:28:13.279 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone26.export 2024-09-21T15:28:13.358 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:13.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone26.export 2024-09-21T15:28:13.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:13.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone26.export 2024-09-21T15:28:13.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone26.export 2024-09-21T15:28:13.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone27 2024-09-21T15:28:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone27 2024-09-21T15:28:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone27.export 2024-09-21T15:28:13.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone27.export 2024-09-21T15:28:13.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone27 2024-09-21T15:28:13.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:13.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:13.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:13.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone27.export 2024-09-21T15:28:13.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone27@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone27.export 2024-09-21T15:28:14.495 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:14.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone27@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone27.export 2024-09-21T15:28:15.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:15.369 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone27.export 2024-09-21T15:28:15.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:15.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone27.export 2024-09-21T15:28:15.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone27.export 2024-09-21T15:28:16.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 16% complete... Exporting image: 24% complete... Exporting image: 32% complete... Exporting image: 40% complete... Exporting image: 49% complete... Exporting image: 57% complete... Exporting image: 65% complete... Exporting image: 73% complete... Exporting image: 81% complete... Exporting image: 89% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:16.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone27.export 2024-09-21T15:28:16.682 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.9099269415933076) > weight (0.25) 2024-09-21T15:28:16.683 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.9109661346874545) > weight (0.25) 2024-09-21T15:28:16.683 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.513042657590844) > weight (0.25) 2024-09-21T15:28:16.683 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.3 2024-09-21T15:28:16.683 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Sent signal 15 2024-09-21T15:28:16.683 INFO:tasks.rbd_mirror_thrash:waiting for 3 secs before reviving daemons 2024-09-21T15:28:16.684 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:28:16.682+0000 7fb1e1a23700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.3 (PID: 40768) UID: 1000 2024-09-21T15:28:16.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 16% complete... Exporting image: 24% complete... Exporting image: 32% complete... Exporting image: 40% complete... Exporting image: 49% complete... Exporting image: 57% complete... Exporting image: 65% complete... Exporting image: 73% complete... Exporting image: 81% complete... Exporting image: 89% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:16.850 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone27.export 2024-09-21T15:28:16.872 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone27.export 2024-09-21T15:28:16.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:16.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:16.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone28 2024-09-21T15:28:16.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:16.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone28 2024-09-21T15:28:16.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:16.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone28.export 2024-09-21T15:28:16.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone28.export 2024-09-21T15:28:16.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone28 2024-09-21T15:28:16.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:16.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:16.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:16.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone28.export 2024-09-21T15:28:16.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone28@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone28.export 2024-09-21T15:28:17.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:17.104 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone28@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone28.export 2024-09-21T15:28:17.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:17.249 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone28.export 2024-09-21T15:28:17.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:17.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone28.export 2024-09-21T15:28:17.472 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone28.export 2024-09-21T15:28:17.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:17.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone28.export 2024-09-21T15:28:17.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:17.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone28.export 2024-09-21T15:28:17.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone28.export 2024-09-21T15:28:17.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:17.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:17.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone29 2024-09-21T15:28:17.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:17.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone29 2024-09-21T15:28:17.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:17.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone29.export 2024-09-21T15:28:17.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone29.export 2024-09-21T15:28:17.983 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone29 2024-09-21T15:28:17.983 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:17.983 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:18.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:18.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone29.export 2024-09-21T15:28:18.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone29@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone29.export 2024-09-21T15:28:18.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:18.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone29@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone29.export 2024-09-21T15:28:18.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:18.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone29.export 2024-09-21T15:28:18.529 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:18.529 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone29.export 2024-09-21T15:28:18.565 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone29.export 2024-09-21T15:28:18.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:18.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone29.export 2024-09-21T15:28:18.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:18.838 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone29.export 2024-09-21T15:28:19.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone29.export 2024-09-21T15:28:19.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:19.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:19.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone3 2024-09-21T15:28:19.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:19.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone3 2024-09-21T15:28:19.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:19.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone3.export 2024-09-21T15:28:19.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone3.export 2024-09-21T15:28:19.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone3 2024-09-21T15:28:19.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:19.085 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:19.218 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:19.218 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone3.export 2024-09-21T15:28:19.218 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone3@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone3.export 2024-09-21T15:28:19.441 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 14% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 32% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 68% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 86% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:19.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone3@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone3.export 2024-09-21T15:28:19.684 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.3 2024-09-21T15:28:19.685 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:28:19.685 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.3 2024-09-21T15:28:19.685 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Restarting daemon 2024-09-21T15:28:19.685 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.3 2024-09-21T15:28:19.687 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Started 2024-09-21T15:28:19.687 INFO:tasks.rbd_mirror_thrash:waiting for 67 secs before thrashing 2024-09-21T15:28:19.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 14% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 32% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 68% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 86% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:19.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone3.export 2024-09-21T15:28:19.899 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:19.900 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone3.export 2024-09-21T15:28:19.942 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone3.export 2024-09-21T15:28:19.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:19.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone3.export 2024-09-21T15:28:20.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:20.059 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone3.export 2024-09-21T15:28:20.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone3.export 2024-09-21T15:28:20.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:20.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:20.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone30 2024-09-21T15:28:20.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:20.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone30 2024-09-21T15:28:20.063 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:20.063 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone30.export 2024-09-21T15:28:20.063 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone30.export 2024-09-21T15:28:20.063 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone30 2024-09-21T15:28:20.063 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:20.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:20.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:20.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone30.export 2024-09-21T15:28:20.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone30@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone30.export 2024-09-21T15:28:20.266 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 40% complete... Exporting image: 61% complete... Exporting image: 81% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:20.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone30@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone30.export 2024-09-21T15:28:20.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 40% complete... Exporting image: 61% complete... Exporting image: 81% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:20.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone30.export 2024-09-21T15:28:20.478 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:20.478 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone30.export 2024-09-21T15:28:20.498 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone30.export 2024-09-21T15:28:20.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 40% complete... Exporting image: 61% complete... Exporting image: 81% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:20.639 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone30.export 2024-09-21T15:28:20.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 40% complete... Exporting image: 61% complete... Exporting image: 81% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:20.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone30.export 2024-09-21T15:28:20.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone30.export 2024-09-21T15:28:20.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:20.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:20.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone31 2024-09-21T15:28:20.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:20.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone31 2024-09-21T15:28:20.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:20.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone31.export 2024-09-21T15:28:20.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone31.export 2024-09-21T15:28:20.861 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone31 2024-09-21T15:28:20.861 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:20.861 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:20.952 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:20.952 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone31.export 2024-09-21T15:28:20.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone31@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone31.export 2024-09-21T15:28:21.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 12% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 34% complete... Exporting image: 38% complete... Exporting image: 42% complete... Exporting image: 47% complete... Exporting image: 51% complete... Exporting image: 55% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 68% complete... Exporting image: 72% complete... Exporting image: 77% complete... Exporting image: 81% complete... Exporting image: 85% complete... Exporting image: 89% complete... Exporting image: 94% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:21.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone31@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone31.export 2024-09-21T15:28:21.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 12% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 34% complete... Exporting image: 38% complete... Exporting image: 42% complete... Exporting image: 47% complete... Exporting image: 51% complete... Exporting image: 55% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 68% complete... Exporting image: 72% complete... Exporting image: 77% complete... Exporting image: 81% complete... Exporting image: 85% complete... Exporting image: 89% complete... Exporting image: 94% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:21.290 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone31.export 2024-09-21T15:28:21.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:21.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone31.export 2024-09-21T15:28:21.418 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone31.export 2024-09-21T15:28:21.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 24% complete... Exporting image: 49% complete... Exporting image: 74% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:21.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone31.export 2024-09-21T15:28:21.654 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 24% complete... Exporting image: 49% complete... Exporting image: 74% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:21.661 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone31.export 2024-09-21T15:28:21.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone31.export 2024-09-21T15:28:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone32 2024-09-21T15:28:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone32 2024-09-21T15:28:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:21.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone32.export 2024-09-21T15:28:21.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone32.export 2024-09-21T15:28:21.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone32 2024-09-21T15:28:21.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:21.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:21.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:21.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone32.export 2024-09-21T15:28:21.805 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone32@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone32.export 2024-09-21T15:28:22.034 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:22.041 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone32@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone32.export 2024-09-21T15:28:22.275 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:22.281 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone32.export 2024-09-21T15:28:22.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:22.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone32.export 2024-09-21T15:28:22.386 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone32.export 2024-09-21T15:28:22.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:22.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone32.export 2024-09-21T15:28:22.717 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.705+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363a750 2024-09-21T15:28:22.717 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.705+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363b6c0 2024-09-21T15:28:22.717 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.705+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363b790 2024-09-21T15:28:22.717 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.705+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363b860 2024-09-21T15:28:22.724 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.717+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f2750 2024-09-21T15:28:22.725 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.717+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f31e0 2024-09-21T15:28:22.725 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.717+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24055a00 2024-09-21T15:28:22.725 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.717+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0c820 2024-09-21T15:28:22.725 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.717+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0d040 2024-09-21T15:28:22.725 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.717+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0d860 2024-09-21T15:28:22.725 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.717+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0dba0 2024-09-21T15:28:22.725 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.717+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264ea270 2024-09-21T15:28:22.725 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.717+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb450 2024-09-21T15:28:22.725 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.717+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb520 2024-09-21T15:28:22.727 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.717+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb790 2024-09-21T15:28:22.728 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.721+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264ebd40 2024-09-21T15:28:22.728 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.721+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc26ecc410 2024-09-21T15:28:22.728 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.721+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2340 2024-09-21T15:28:22.728 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.721+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2410 2024-09-21T15:28:22.728 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.721+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e24e0 2024-09-21T15:28:22.728 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.721+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2680 2024-09-21T15:28:22.732 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.725+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2750 2024-09-21T15:28:22.732 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.725+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2820 2024-09-21T15:28:22.732 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.725+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e29c0 2024-09-21T15:28:22.732 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.725+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2d00 2024-09-21T15:28:22.732 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.725+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2f70 2024-09-21T15:28:22.732 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.725+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e3110 2024-09-21T15:28:22.732 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.725+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e3520 2024-09-21T15:28:22.732 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:28:22.725+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e35f0 2024-09-21T15:28:22.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:22.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone32.export 2024-09-21T15:28:22.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:28:22.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:28:22.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.805+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:28:22.826 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.809+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:28:22.826 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.809+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:28:22.826 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.809+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:28:22.829 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.817+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:28:22.834 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.825+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:28:22.834 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.825+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:28:22.834 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.825+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:28:22.834 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.825+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:28:22.834 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.825+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:28:22.834 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.825+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:28:22.847 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.837+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7860 2024-09-21T15:28:22.848 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.841+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:28:22.848 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.841+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:28:22.857 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.849+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:28:22.858 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.849+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:28:22.858 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone32.export 2024-09-21T15:28:22.882 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.873+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67040 2024-09-21T15:28:22.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:22.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:22.883 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone33 2024-09-21T15:28:22.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:22.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone33 2024-09-21T15:28:22.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:22.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone33.export 2024-09-21T15:28:22.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone33.export 2024-09-21T15:28:22.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone33 2024-09-21T15:28:22.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:22.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:22.890 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.877+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67450 2024-09-21T15:28:22.890 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.877+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7860 2024-09-21T15:28:22.890 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.877+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:28:22.898 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.885+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:28:22.907 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.897+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:28:22.907 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.897+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:28:22.908 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.897+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:28:22.908 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.897+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9cc30 2024-09-21T15:28:22.908 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.897+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:28:22.908 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.897+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2881a0 2024-09-21T15:28:22.914 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.905+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288c30 2024-09-21T15:28:22.914 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.905+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:28:22.914 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.905+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf9d40 2024-09-21T15:28:22.928 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.913+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:28:22.928 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.913+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:28:22.928 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.913+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68dd0 2024-09-21T15:28:22.928 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.913+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:28:22.928 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.913+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af310dd0 2024-09-21T15:28:22.928 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.913+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7af70 2024-09-21T15:28:22.933 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.921+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:28:22.935 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.925+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:28:22.935 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.925+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:28:22.935 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.925+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:28:22.935 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.925+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:28:22.936 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.925+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:28:22.937 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:28:22.937 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:28:22.937 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:28:22.937 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676750 2024-09-21T15:28:22.937 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2340 2024-09-21T15:28:22.937 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:28:22.937 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:28:22.937 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67040 2024-09-21T15:28:22.937 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67450 2024-09-21T15:28:22.937 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67ee0 2024-09-21T15:28:22.938 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f6340 2024-09-21T15:28:22.938 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f6b60 2024-09-21T15:28:22.938 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7860 2024-09-21T15:28:22.938 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e270 2024-09-21T15:28:22.938 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:28:22.938 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:28:22.938 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.929+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:28:22.942 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1ba0 2024-09-21T15:28:22.942 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:28:22.942 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:28:22.942 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9cc30 2024-09-21T15:28:22.942 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:28:22.942 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:28:22.942 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288000 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2881a0 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288c30 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289ee0 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf9d40 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68dd0 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af310dd0 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7aea0 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7af70 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b1e0 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:28:22.943 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:28:22.944 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:28:22.944 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:28:22.944 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:28:22.945 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57c70 2024-09-21T15:28:22.945 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d25b0 2024-09-21T15:28:22.945 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:28:22.945 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3d40 2024-09-21T15:28:22.945 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:28:22.945 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:28:22.945 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676340 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676750 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36775f0 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36776c0 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528410 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45285b0 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45288f0 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529860 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b20d0 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2340 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3380 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59cb930 2024-09-21T15:28:22.946 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:22.933+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:28:22.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:22.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone33.export 2024-09-21T15:28:22.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone33@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone33.export 2024-09-21T15:28:23.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:23.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone33@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone33.export 2024-09-21T15:28:24.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:24.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone33.export 2024-09-21T15:28:24.202 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:28:24.193+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:28:24.203 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:28:24.193+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:28:24.206 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:28:24.197+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87676c0 2024-09-21T15:28:24.207 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:28:24.197+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89672b0 2024-09-21T15:28:24.207 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:28:24.197+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:28:24.391 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:24.391 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone33.export 2024-09-21T15:28:24.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone33.export 2024-09-21T15:28:24.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:24.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone33.export 2024-09-21T15:28:24.549 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:24.556 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone33.export 2024-09-21T15:28:24.558 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone33.export 2024-09-21T15:28:24.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:24.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:24.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone34 2024-09-21T15:28:24.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:24.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone34 2024-09-21T15:28:24.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:24.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone34.export 2024-09-21T15:28:24.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone34.export 2024-09-21T15:28:24.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone34 2024-09-21T15:28:24.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:24.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:24.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:24.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone34.export 2024-09-21T15:28:24.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone34@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone34.export 2024-09-21T15:28:25.122 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 12% complete... Exporting image: 18% complete... Exporting image: 24% complete... Exporting image: 30% complete... Exporting image: 37% complete... Exporting image: 43% complete... Exporting image: 49% complete... Exporting image: 55% complete... Exporting image: 61% complete... Exporting image: 68% complete... Exporting image: 74% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 92% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:25.132 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone34@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone34.export 2024-09-21T15:28:25.544 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 12% complete... Exporting image: 18% complete... Exporting image: 24% complete... Exporting image: 30% complete... Exporting image: 37% complete... Exporting image: 43% complete... Exporting image: 49% complete... Exporting image: 55% complete... Exporting image: 61% complete... Exporting image: 68% complete... Exporting image: 74% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 92% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:25.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone34.export 2024-09-21T15:28:25.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:25.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone34.export 2024-09-21T15:28:25.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone34.export 2024-09-21T15:28:25.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 45% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:26.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone34.export 2024-09-21T15:28:26.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 45% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:26.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone34.export 2024-09-21T15:28:26.555 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone34.export 2024-09-21T15:28:26.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:26.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:26.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone35 2024-09-21T15:28:26.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:26.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone35 2024-09-21T15:28:26.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:26.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone35.export 2024-09-21T15:28:26.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone35.export 2024-09-21T15:28:26.570 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone35 2024-09-21T15:28:26.570 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:26.570 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:26.739 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:26.739 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone35.export 2024-09-21T15:28:26.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone35@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone35.export 2024-09-21T15:28:26.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 29% complete... Exporting image: 58% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:26.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone35@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone35.export 2024-09-21T15:28:27.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 29% complete... Exporting image: 58% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:27.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone35.export 2024-09-21T15:28:27.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:27.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone35.export 2024-09-21T15:28:27.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone35.export 2024-09-21T15:28:27.322 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:27.331 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone35.export 2024-09-21T15:28:27.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:27.519 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone35.export 2024-09-21T15:28:27.522 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone35.export 2024-09-21T15:28:27.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:27.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:27.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone36 2024-09-21T15:28:27.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:27.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone36 2024-09-21T15:28:27.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:27.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone36.export 2024-09-21T15:28:27.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone36.export 2024-09-21T15:28:27.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:27.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone36 2024-09-21T15:28:27.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:27.710 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:27.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone36.export 2024-09-21T15:28:27.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone36@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone36.export 2024-09-21T15:28:27.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:27.937 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone36@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone36.export 2024-09-21T15:28:28.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:28.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone36.export 2024-09-21T15:28:28.231 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:28.231 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone36.export 2024-09-21T15:28:28.250 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone36.export 2024-09-21T15:28:28.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:28.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone36.export 2024-09-21T15:28:28.686 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:28.696 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone36.export 2024-09-21T15:28:28.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone36.export 2024-09-21T15:28:28.727 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:28.727 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:28.727 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone37 2024-09-21T15:28:28.727 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:28.727 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone37 2024-09-21T15:28:28.727 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:28.727 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone37.export 2024-09-21T15:28:28.727 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone37.export 2024-09-21T15:28:28.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:28.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone37 2024-09-21T15:28:28.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:28.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:28.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone37.export 2024-09-21T15:28:28.948 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone37@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone37.export 2024-09-21T15:28:29.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:29.718 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone37@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone37.export 2024-09-21T15:28:30.503 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:30.513 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone37.export 2024-09-21T15:28:30.676 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:30.676 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone37.export 2024-09-21T15:28:30.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone37.export 2024-09-21T15:28:31.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 16% complete... Exporting image: 33% complete... Exporting image: 50% complete... Exporting image: 67% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:31.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone37.export 2024-09-21T15:28:32.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 16% complete... Exporting image: 33% complete... Exporting image: 50% complete... Exporting image: 67% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:32.241 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone37.export 2024-09-21T15:28:32.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone37.export 2024-09-21T15:28:32.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:32.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:32.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone38 2024-09-21T15:28:32.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:32.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone38 2024-09-21T15:28:32.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:32.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone38.export 2024-09-21T15:28:32.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone38.export 2024-09-21T15:28:32.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone38 2024-09-21T15:28:32.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:32.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:32.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:32.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone38.export 2024-09-21T15:28:32.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone38@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone38.export 2024-09-21T15:28:32.805 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 16% complete... Exporting image: 33% complete... Exporting image: 49% complete... Exporting image: 66% complete... Exporting image: 83% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:32.820 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone38@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone38.export 2024-09-21T15:28:32.911 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:32.900+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:28:33.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 16% complete... Exporting image: 33% complete... Exporting image: 49% complete... Exporting image: 66% complete... Exporting image: 83% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:33.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone38.export 2024-09-21T15:28:33.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:33.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone38.export 2024-09-21T15:28:33.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone38.export 2024-09-21T15:28:33.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:33.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone38.export 2024-09-21T15:28:33.704 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:33.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone38.export 2024-09-21T15:28:33.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone38.export 2024-09-21T15:28:33.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:33.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:33.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone39 2024-09-21T15:28:33.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:33.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone39 2024-09-21T15:28:33.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:33.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone39.export 2024-09-21T15:28:33.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone39.export 2024-09-21T15:28:33.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone39 2024-09-21T15:28:33.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:33.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:33.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:33.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone39.export 2024-09-21T15:28:33.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone39@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone39.export 2024-09-21T15:28:33.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 41% complete... Exporting image: 61% complete... Exporting image: 82% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:33.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone39@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone39.export 2024-09-21T15:28:34.146 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 41% complete... Exporting image: 61% complete... Exporting image: 82% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:34.166 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone39.export 2024-09-21T15:28:34.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:34.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone39.export 2024-09-21T15:28:34.366 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone39.export 2024-09-21T15:28:34.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 41% complete... Exporting image: 61% complete... Exporting image: 82% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:34.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone39.export 2024-09-21T15:28:34.702 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 41% complete... Exporting image: 61% complete... Exporting image: 82% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:34.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone39.export 2024-09-21T15:28:34.717 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.700+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67040 2024-09-21T15:28:34.718 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.700+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67450 2024-09-21T15:28:34.718 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.700+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67ee0 2024-09-21T15:28:34.718 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f6340 2024-09-21T15:28:34.718 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f6b60 2024-09-21T15:28:34.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7860 2024-09-21T15:28:34.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:28:34.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.700+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:28:34.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.704+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:28:34.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.704+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0410 2024-09-21T15:28:34.719 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.704+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:28:34.730 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.716+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9ca90 2024-09-21T15:28:34.730 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.716+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9cc30 2024-09-21T15:28:34.730 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.716+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aa86fe10 2024-09-21T15:28:34.730 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.716+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab156c0 2024-09-21T15:28:34.730 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.716+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:28:34.730 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.716+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:28:34.730 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.716+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:28:34.730 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.716+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:28:34.734 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.720+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288000 2024-09-21T15:28:34.734 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.720+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2881a0 2024-09-21T15:28:34.736 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.728+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288c30 2024-09-21T15:28:34.736 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.728+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:28:34.736 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.728+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289ee0 2024-09-21T15:28:34.736 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.728+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf9d40 2024-09-21T15:28:34.742 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.732+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:28:34.742 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.732+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:28:34.742 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.732+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68dd0 2024-09-21T15:28:34.749 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68ea0 2024-09-21T15:28:34.749 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69860 2024-09-21T15:28:34.749 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:28:34.749 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:28:34.749 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:28:34.749 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af310dd0 2024-09-21T15:28:34.750 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afb6a820 2024-09-21T15:28:34.750 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a4e0 2024-09-21T15:28:34.750 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7aea0 2024-09-21T15:28:34.750 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7af70 2024-09-21T15:28:34.750 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b1e0 2024-09-21T15:28:34.750 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:28:34.751 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9860 2024-09-21T15:28:34.751 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:28:34.751 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:28:34.751 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:28:34.751 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:28:34.751 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:28:34.751 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57c70 2024-09-21T15:28:34.751 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d25b0 2024-09-21T15:28:34.751 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:28:34.751 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:28:34.751 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3d40 2024-09-21T15:28:34.751 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:28:34.751 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:28:34.752 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:28:34.752 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541a00 2024-09-21T15:28:34.753 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:28:34.753 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.740+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676340 2024-09-21T15:28:34.753 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:28:34.754 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676750 2024-09-21T15:28:34.754 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36775f0 2024-09-21T15:28:34.754 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36776c0 2024-09-21T15:28:34.754 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677930 2024-09-21T15:28:34.754 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677ba0 2024-09-21T15:28:34.754 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677e10 2024-09-21T15:28:34.754 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45280d0 2024-09-21T15:28:34.754 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45285b0 2024-09-21T15:28:34.754 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45288f0 2024-09-21T15:28:34.754 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528d00 2024-09-21T15:28:34.754 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529860 2024-09-21T15:28:34.755 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b20d0 2024-09-21T15:28:34.755 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b21a0 2024-09-21T15:28:34.755 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2340 2024-09-21T15:28:34.755 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2820 2024-09-21T15:28:34.755 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2ea0 2024-09-21T15:28:34.755 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:28:34.755 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3380 2024-09-21T15:28:34.755 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3520 2024-09-21T15:28:34.755 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59cb930 2024-09-21T15:28:34.755 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:28:34.744+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:28:34.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone39.export 2024-09-21T15:28:34.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:34.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:34.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone4 2024-09-21T15:28:34.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:34.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone4 2024-09-21T15:28:34.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:34.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone4.export 2024-09-21T15:28:34.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone4.export 2024-09-21T15:28:34.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone4 2024-09-21T15:28:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:34.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:34.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:34.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone4.export 2024-09-21T15:28:34.948 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone4@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone4.export 2024-09-21T15:28:35.122 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 41% complete... Exporting image: 55% complete... Exporting image: 68% complete... Exporting image: 82% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:35.127 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone4@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone4.export 2024-09-21T15:28:35.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 41% complete... Exporting image: 55% complete... Exporting image: 68% complete... Exporting image: 82% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:35.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone4.export 2024-09-21T15:28:35.513 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:35.513 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone4.export 2024-09-21T15:28:35.555 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone4.export 2024-09-21T15:28:35.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 41% complete... Exporting image: 55% complete... Exporting image: 68% complete... Exporting image: 82% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:35.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone4.export 2024-09-21T15:28:35.938 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 41% complete... Exporting image: 55% complete... Exporting image: 68% complete... Exporting image: 82% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:35.948 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone4.export 2024-09-21T15:28:36.138 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone4.export 2024-09-21T15:28:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:36.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:36.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone40 2024-09-21T15:28:36.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:36.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone40 2024-09-21T15:28:36.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:36.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone40.export 2024-09-21T15:28:36.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone40.export 2024-09-21T15:28:36.181 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone40 2024-09-21T15:28:36.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:36.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:36.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone40.export 2024-09-21T15:28:36.271 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone40.export 2024-09-21T15:28:36.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 24% complete... Exporting image: 36% complete... Exporting image: 49% complete... Exporting image: 61% complete... Exporting image: 73% complete... Exporting image: 86% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:36.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone40.export 2024-09-21T15:28:36.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 24% complete... Exporting image: 36% complete... Exporting image: 49% complete... Exporting image: 61% complete... Exporting image: 73% complete... Exporting image: 86% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:36.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone40.export 2024-09-21T15:28:36.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone40.export 2024-09-21T15:28:36.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:36.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:36.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone5 2024-09-21T15:28:36.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:36.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone5 2024-09-21T15:28:36.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:36.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone5.export 2024-09-21T15:28:36.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone5.export 2024-09-21T15:28:36.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone5 2024-09-21T15:28:36.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:36.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:37.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:37.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone5.export 2024-09-21T15:28:37.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone5@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone5.export 2024-09-21T15:28:37.309 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 72% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:37.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone5@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone5.export 2024-09-21T15:28:37.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 72% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:37.593 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone5.export 2024-09-21T15:28:37.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:37.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone5.export 2024-09-21T15:28:37.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone5.export 2024-09-21T15:28:37.837 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:37.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone5.export 2024-09-21T15:28:37.907 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:37.942 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone5.export 2024-09-21T15:28:37.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone5.export 2024-09-21T15:28:37.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:37.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:37.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone6 2024-09-21T15:28:37.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:37.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone6 2024-09-21T15:28:37.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:37.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone6.export 2024-09-21T15:28:37.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone6.export 2024-09-21T15:28:37.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone6 2024-09-21T15:28:37.944 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:37.944 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:38.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:38.033 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone6.export 2024-09-21T15:28:38.034 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone6@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone6.export 2024-09-21T15:28:38.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 19% complete... Exporting image: 38% complete... Exporting image: 58% complete... Exporting image: 77% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:38.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone6@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone6.export 2024-09-21T15:28:38.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 19% complete... Exporting image: 38% complete... Exporting image: 58% complete... Exporting image: 77% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:38.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone6.export 2024-09-21T15:28:38.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:38.515 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone6.export 2024-09-21T15:28:38.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone6.export 2024-09-21T15:28:38.657 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:38.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone6.export 2024-09-21T15:28:38.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:38.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone6.export 2024-09-21T15:28:38.812 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone6.export 2024-09-21T15:28:38.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:38.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:38.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone7 2024-09-21T15:28:38.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:38.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone7 2024-09-21T15:28:38.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:38.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone7.export 2024-09-21T15:28:38.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone7.export 2024-09-21T15:28:38.824 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone7 2024-09-21T15:28:38.824 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:38.824 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:38.957 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:38.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone7.export 2024-09-21T15:28:38.959 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone7@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone7.export 2024-09-21T15:28:39.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:39.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone7@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone7.export 2024-09-21T15:28:39.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:39.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone7.export 2024-09-21T15:28:39.821 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:39.821 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone7.export 2024-09-21T15:28:39.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone7.export 2024-09-21T15:28:39.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:40.001 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone7.export 2024-09-21T15:28:40.155 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:40.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone7.export 2024-09-21T15:28:40.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone7.export 2024-09-21T15:28:40.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:40.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:40.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone8 2024-09-21T15:28:40.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:40.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone8 2024-09-21T15:28:40.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:40.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone8.export 2024-09-21T15:28:40.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone8.export 2024-09-21T15:28:40.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone8 2024-09-21T15:28:40.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:40.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:40.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:40.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone8.export 2024-09-21T15:28:40.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone8@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone8.export 2024-09-21T15:28:40.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 17% complete... Exporting image: 25% complete... Exporting image: 34% complete... Exporting image: 42% complete... Exporting image: 51% complete... Exporting image: 60% complete... Exporting image: 68% complete... Exporting image: 77% complete... Exporting image: 85% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:40.610 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone8@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone8.export 2024-09-21T15:28:40.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 17% complete... Exporting image: 25% complete... Exporting image: 34% complete... Exporting image: 42% complete... Exporting image: 51% complete... Exporting image: 60% complete... Exporting image: 68% complete... Exporting image: 77% complete... Exporting image: 85% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:40.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone8.export 2024-09-21T15:28:41.038 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:41.038 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone8.export 2024-09-21T15:28:41.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone8.export 2024-09-21T15:28:41.195 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:41.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone8.export 2024-09-21T15:28:41.369 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:41.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone8.export 2024-09-21T15:28:41.385 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone8.export 2024-09-21T15:28:41.391 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:41.391 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:41.391 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.2-clone9 2024-09-21T15:28:41.391 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:41.391 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.2-clone9 2024-09-21T15:28:41.392 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:41.392 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone9.export 2024-09-21T15:28:41.392 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone9.export 2024-09-21T15:28:41.392 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:41.392 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.2-clone9 2024-09-21T15:28:41.392 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:41.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:41.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone9.export 2024-09-21T15:28:41.572 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone9@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone9.export 2024-09-21T15:28:42.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 15% complete... Exporting image: 20% complete... Exporting image: 26% complete... Exporting image: 31% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 47% complete... Exporting image: 52% complete... Exporting image: 57% complete... Exporting image: 62% complete... Exporting image: 68% complete... Exporting image: 73% complete... Exporting image: 78% complete... Exporting image: 83% complete... Exporting image: 88% complete... Exporting image: 94% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:42.063 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone9@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone9.export 2024-09-21T15:28:42.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 15% complete... Exporting image: 20% complete... Exporting image: 26% complete... Exporting image: 31% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 47% complete... Exporting image: 52% complete... Exporting image: 57% complete... Exporting image: 62% complete... Exporting image: 68% complete... Exporting image: 73% complete... Exporting image: 78% complete... Exporting image: 83% complete... Exporting image: 88% complete... Exporting image: 94% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:42.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone9.export 2024-09-21T15:28:42.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:42.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone9.export 2024-09-21T15:28:42.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.2-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone9.export 2024-09-21T15:28:42.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 77% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:42.890 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.2-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone9.export 2024-09-21T15:28:43.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 77% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:43.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone9.export 2024-09-21T15:28:43.090 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.2-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.2-clone9.export 2024-09-21T15:28:43.098 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:43.098 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:43.098 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3 2024-09-21T15:28:43.098 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:43.098 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3 2024-09-21T15:28:43.098 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:43.098 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3.export 2024-09-21T15:28:43.098 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3.export 2024-09-21T15:28:43.099 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3 2024-09-21T15:28:43.099 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:43.099 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:43.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:43.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3.export 2024-09-21T15:28:43.174 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3.export 2024-09-21T15:28:43.271 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 16% complete... Exporting image: 19% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 74% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 83% complete... Exporting image: 86% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:43.278 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3.export 2024-09-21T15:28:43.370 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 16% complete... Exporting image: 19% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 74% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 83% complete... Exporting image: 86% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:43.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3.export 2024-09-21T15:28:43.487 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:43.487 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3.export 2024-09-21T15:28:43.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3.export 2024-09-21T15:28:43.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 16% complete... Exporting image: 19% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 74% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 83% complete... Exporting image: 86% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:43.606 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3.export 2024-09-21T15:28:43.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 16% complete... Exporting image: 19% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 74% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 83% complete... Exporting image: 86% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:43.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3.export 2024-09-21T15:28:43.826 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3.export 2024-09-21T15:28:43.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:43.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:43.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone1 2024-09-21T15:28:43.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:43.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone1 2024-09-21T15:28:43.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:43.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone1.export 2024-09-21T15:28:43.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone1.export 2024-09-21T15:28:43.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone1 2024-09-21T15:28:43.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:43.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:43.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:43.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone1.export 2024-09-21T15:28:43.937 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone1@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone1.export 2024-09-21T15:28:44.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:44.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone1@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone1.export 2024-09-21T15:28:44.473 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:44.478 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone1.export 2024-09-21T15:28:44.550 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:44.550 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone1.export 2024-09-21T15:28:44.585 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone1.export 2024-09-21T15:28:44.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:44.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone1.export 2024-09-21T15:28:44.820 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:28:44.825 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone1.export 2024-09-21T15:28:44.846 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone1.export 2024-09-21T15:28:44.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:44.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:44.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone10 2024-09-21T15:28:44.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:44.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone10 2024-09-21T15:28:44.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:44.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone10.export 2024-09-21T15:28:44.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone10.export 2024-09-21T15:28:44.858 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone10 2024-09-21T15:28:44.858 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:44.858 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:44.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:44.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone10.export 2024-09-21T15:28:44.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone10@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone10.export 2024-09-21T15:28:45.339 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 24% complete... Exporting image: 36% complete... Exporting image: 48% complete... Exporting image: 61% complete... Exporting image: 73% complete... Exporting image: 85% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:45.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone10@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone10.export 2024-09-21T15:28:45.905 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 24% complete... Exporting image: 36% complete... Exporting image: 48% complete... Exporting image: 61% complete... Exporting image: 73% complete... Exporting image: 85% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:45.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone10.export 2024-09-21T15:28:46.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:46.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone10.export 2024-09-21T15:28:46.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone10.export 2024-09-21T15:28:46.585 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 32% complete... Exporting image: 64% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:46.597 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone10.export 2024-09-21T15:28:46.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 32% complete... Exporting image: 64% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:46.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone10.export 2024-09-21T15:28:46.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone10.export 2024-09-21T15:28:46.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:46.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:46.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone11 2024-09-21T15:28:46.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:46.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone11 2024-09-21T15:28:46.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:46.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone11.export 2024-09-21T15:28:46.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone11.export 2024-09-21T15:28:46.983 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone11 2024-09-21T15:28:46.983 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:46.983 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:47.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:47.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone11.export 2024-09-21T15:28:47.134 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone11@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone11.export 2024-09-21T15:28:48.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:48.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone11@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone11.export 2024-09-21T15:28:50.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:50.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone11.export 2024-09-21T15:28:50.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:50.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone11.export 2024-09-21T15:28:50.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone11.export 2024-09-21T15:28:52.925 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:52.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone11.export 2024-09-21T15:28:55.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:55.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone11.export 2024-09-21T15:28:55.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone11.export 2024-09-21T15:28:55.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:55.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:55.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone12 2024-09-21T15:28:55.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:55.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone12 2024-09-21T15:28:55.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:55.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone12.export 2024-09-21T15:28:55.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone12.export 2024-09-21T15:28:55.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone12 2024-09-21T15:28:55.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:55.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:55.518 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:55.519 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone12.export 2024-09-21T15:28:55.520 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone12@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone12.export 2024-09-21T15:28:56.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 12% complete... Exporting image: 18% complete... Exporting image: 24% complete... Exporting image: 30% complete... Exporting image: 36% complete... Exporting image: 43% complete... Exporting image: 49% complete... Exporting image: 55% complete... Exporting image: 61% complete... Exporting image: 67% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 92% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:56.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone12@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone12.export 2024-09-21T15:28:56.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 12% complete... Exporting image: 18% complete... Exporting image: 24% complete... Exporting image: 30% complete... Exporting image: 36% complete... Exporting image: 43% complete... Exporting image: 49% complete... Exporting image: 55% complete... Exporting image: 61% complete... Exporting image: 67% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 92% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:56.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone12.export 2024-09-21T15:28:56.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:56.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone12.export 2024-09-21T15:28:56.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone12.export 2024-09-21T15:28:57.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 16% complete... Exporting image: 32% complete... Exporting image: 48% complete... Exporting image: 64% complete... Exporting image: 81% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:57.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone12.export 2024-09-21T15:28:57.529 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 16% complete... Exporting image: 32% complete... Exporting image: 48% complete... Exporting image: 64% complete... Exporting image: 81% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:57.541 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone12.export 2024-09-21T15:28:57.549 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone12.export 2024-09-21T15:28:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone13 2024-09-21T15:28:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone13 2024-09-21T15:28:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:57.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone13.export 2024-09-21T15:28:57.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone13.export 2024-09-21T15:28:57.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone13 2024-09-21T15:28:57.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:57.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:57.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:57.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone13.export 2024-09-21T15:28:57.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone13@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone13.export 2024-09-21T15:28:57.842 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 31% complete... Exporting image: 41% complete... Exporting image: 52% complete... Exporting image: 62% complete... Exporting image: 73% complete... Exporting image: 83% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:57.848 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone13@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone13.export 2024-09-21T15:28:58.020 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 31% complete... Exporting image: 41% complete... Exporting image: 52% complete... Exporting image: 62% complete... Exporting image: 73% complete... Exporting image: 83% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:58.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone13.export 2024-09-21T15:28:58.156 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:58.157 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone13.export 2024-09-21T15:28:58.195 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone13.export 2024-09-21T15:28:58.369 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 31% complete... Exporting image: 41% complete... Exporting image: 52% complete... Exporting image: 62% complete... Exporting image: 73% complete... Exporting image: 83% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:58.374 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone13.export 2024-09-21T15:28:58.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 31% complete... Exporting image: 41% complete... Exporting image: 52% complete... Exporting image: 62% complete... Exporting image: 73% complete... Exporting image: 83% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:58.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone13.export 2024-09-21T15:28:58.698 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone13.export 2024-09-21T15:28:58.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:58.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:58.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone14 2024-09-21T15:28:58.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:58.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone14 2024-09-21T15:28:58.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:58.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone14.export 2024-09-21T15:28:58.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone14.export 2024-09-21T15:28:58.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone14 2024-09-21T15:28:58.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:58.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:28:58.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:58.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone14.export 2024-09-21T15:28:58.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone14@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone14.export 2024-09-21T15:28:58.939 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:58.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone14@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone14.export 2024-09-21T15:28:59.097 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:59.103 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone14.export 2024-09-21T15:28:59.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:28:59.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone14.export 2024-09-21T15:28:59.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone14.export 2024-09-21T15:28:59.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:59.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone14.export 2024-09-21T15:28:59.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:28:59.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone14.export 2024-09-21T15:28:59.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone14.export 2024-09-21T15:28:59.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:28:59.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:28:59.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone15 2024-09-21T15:28:59.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:28:59.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone15 2024-09-21T15:28:59.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:28:59.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone15.export 2024-09-21T15:28:59.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone15.export 2024-09-21T15:28:59.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone15 2024-09-21T15:28:59.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:28:59.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:00.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:00.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone15.export 2024-09-21T15:29:00.015 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone15@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone15.export 2024-09-21T15:29:00.216 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 16% complete... Exporting image: 19% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 74% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 83% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:00.222 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone15@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone15.export 2024-09-21T15:29:00.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 16% complete... Exporting image: 19% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 74% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 83% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:00.473 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone15.export 2024-09-21T15:29:00.555 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:00.555 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone15.export 2024-09-21T15:29:00.578 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone15.export 2024-09-21T15:29:00.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 88% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:00.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone15.export 2024-09-21T15:29:01.195 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 88% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:01.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone15.export 2024-09-21T15:29:01.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone15.export 2024-09-21T15:29:01.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:01.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:01.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone16 2024-09-21T15:29:01.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:01.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone16 2024-09-21T15:29:01.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:01.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone16.export 2024-09-21T15:29:01.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone16.export 2024-09-21T15:29:01.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone16 2024-09-21T15:29:01.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:01.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:01.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:01.327 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone16.export 2024-09-21T15:29:01.329 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone16@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone16.export 2024-09-21T15:29:01.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 22% complete... Exporting image: 45% complete... Exporting image: 68% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:01.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone16@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone16.export 2024-09-21T15:29:01.885 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:01.868+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:29:01.885 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:01.868+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:29:01.886 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:01.876+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51110 2024-09-21T15:29:01.899 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:01.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde261a0 2024-09-21T15:29:01.899 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:01.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde27d40 2024-09-21T15:29:01.899 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:01.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c8f0 2024-09-21T15:29:01.905 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:01.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c9c0 2024-09-21T15:29:01.905 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:01.896+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01cf70 2024-09-21T15:29:01.906 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:01.900+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d040 2024-09-21T15:29:01.907 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:01.900+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d2b0 2024-09-21T15:29:02.249 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 22% complete... Exporting image: 45% complete... Exporting image: 68% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:02.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone16.export 2024-09-21T15:29:02.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:02.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone16.export 2024-09-21T15:29:02.463 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone16.export 2024-09-21T15:29:02.744 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:02.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone16.export 2024-09-21T15:29:03.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:03.076 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone16.export 2024-09-21T15:29:03.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone16.export 2024-09-21T15:29:03.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:03.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:03.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone17 2024-09-21T15:29:03.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:03.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone17 2024-09-21T15:29:03.148 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:03.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone17.export 2024-09-21T15:29:03.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone17.export 2024-09-21T15:29:03.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone17 2024-09-21T15:29:03.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:03.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:03.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:03.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone17.export 2024-09-21T15:29:03.222 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone17@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone17.export 2024-09-21T15:29:03.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 21% complete... Exporting image: 43% complete... Exporting image: 65% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:03.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone17@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone17.export 2024-09-21T15:29:03.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 21% complete... Exporting image: 43% complete... Exporting image: 65% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:03.651 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone17.export 2024-09-21T15:29:03.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:03.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone17.export 2024-09-21T15:29:03.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone17.export 2024-09-21T15:29:03.848 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:03.854 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone17.export 2024-09-21T15:29:03.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:03.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone17.export 2024-09-21T15:29:03.922 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone17.export 2024-09-21T15:29:03.924 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:03.924 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:03.924 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone18 2024-09-21T15:29:03.924 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:03.924 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone18 2024-09-21T15:29:03.924 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:03.924 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone18.export 2024-09-21T15:29:03.924 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone18.export 2024-09-21T15:29:03.925 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone18 2024-09-21T15:29:03.925 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:03.925 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:04.077 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:04.077 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone18.export 2024-09-21T15:29:04.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone18@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone18.export 2024-09-21T15:29:04.330 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 64% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:04.340 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone18@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone18.export 2024-09-21T15:29:04.504 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 64% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:04.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone18.export 2024-09-21T15:29:04.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:04.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone18.export 2024-09-21T15:29:04.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone18.export 2024-09-21T15:29:04.654 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:04.666 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone18.export 2024-09-21T15:29:04.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:04.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone18.export 2024-09-21T15:29:04.820 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone18.export 2024-09-21T15:29:04.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:04.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:04.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone19 2024-09-21T15:29:04.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:04.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone19 2024-09-21T15:29:04.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:04.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone19.export 2024-09-21T15:29:04.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone19.export 2024-09-21T15:29:04.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone19 2024-09-21T15:29:04.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:04.824 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:04.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:04.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone19.export 2024-09-21T15:29:04.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone19@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone19.export 2024-09-21T15:29:05.267 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:05.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone19@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone19.export 2024-09-21T15:29:05.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:05.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone19.export 2024-09-21T15:29:05.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:05.820 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone19.export 2024-09-21T15:29:05.866 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.856+0000 7f7fd044c700 -1 reset not still connected to 0x5636a3bceb60 2024-09-21T15:29:05.866 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.856+0000 7f7fd044c700 -1 reset not still connected to 0x5636a780eb60 2024-09-21T15:29:05.866 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone19.export 2024-09-21T15:29:05.876 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.864+0000 7f7fd044c700 -1 reset not still connected to 0x5636a86705b0 2024-09-21T15:29:05.877 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.864+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670680 2024-09-21T15:29:05.877 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.864+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670dd0 2024-09-21T15:29:05.877 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.864+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9e8f520 2024-09-21T15:29:05.877 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.864+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:29:05.877 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.864+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e8410 2024-09-21T15:29:05.877 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.864+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:29:05.881 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.876+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678f2b0 2024-09-21T15:29:05.881 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.876+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb84e0 2024-09-21T15:29:05.884 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.880+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff656c0 2024-09-21T15:29:05.885 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.880+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65ad0 2024-09-21T15:29:05.885 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.880+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65c70 2024-09-21T15:29:05.893 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.884+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbb2b0 2024-09-21T15:29:05.893 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.884+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1c70 2024-09-21T15:29:05.894 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.884+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1ee0 2024-09-21T15:29:05.894 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.884+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f880d0 2024-09-21T15:29:05.894 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.884+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e750 2024-09-21T15:29:05.894 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.884+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5930 2024-09-21T15:29:05.895 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.884+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:29:05.895 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.888+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f55040 2024-09-21T15:29:05.895 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.888+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c28f0 2024-09-21T15:29:05.895 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.888+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3a00 2024-09-21T15:29:05.896 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9790 2024-09-21T15:29:05.896 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9ad0 2024-09-21T15:29:05.899 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9d40 2024-09-21T15:29:05.899 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:29:05.899 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:29:05.899 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:29:05.899 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:29:05.899 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7334340 2024-09-21T15:29:05.899 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c73351e0 2024-09-21T15:29:05.899 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335a00 2024-09-21T15:29:05.899 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335ad0 2024-09-21T15:29:05.899 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766750 2024-09-21T15:29:05.900 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87676c0 2024-09-21T15:29:05.900 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:29:05.900 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89672b0 2024-09-21T15:29:05.900 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967a00 2024-09-21T15:29:05.900 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:29:05.900 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:29:05.900 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51040 2024-09-21T15:29:05.900 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51110 2024-09-21T15:29:05.900 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde261a0 2024-09-21T15:29:05.900 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde27d40 2024-09-21T15:29:05.900 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636ce7e9790 2024-09-21T15:29:05.900 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c820 2024-09-21T15:29:05.900 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c8f0 2024-09-21T15:29:05.901 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c9c0 2024-09-21T15:29:05.901 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01cf70 2024-09-21T15:29:05.901 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d040 2024-09-21T15:29:05.901 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:05.892+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d2b0 2024-09-21T15:29:05.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:05.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone19.export 2024-09-21T15:29:06.194 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:06.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone19.export 2024-09-21T15:29:06.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone19.export 2024-09-21T15:29:06.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:06.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:06.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone2 2024-09-21T15:29:06.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:06.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone2 2024-09-21T15:29:06.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:06.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone2.export 2024-09-21T15:29:06.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone2.export 2024-09-21T15:29:06.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone2 2024-09-21T15:29:06.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:06.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:06.282 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:06.282 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone2.export 2024-09-21T15:29:06.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone2@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone2.export 2024-09-21T15:29:06.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:06.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone2@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone2.export 2024-09-21T15:29:07.195 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:07.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone2.export 2024-09-21T15:29:07.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:07.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone2.export 2024-09-21T15:29:07.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone2.export 2024-09-21T15:29:07.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:07.442 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone2.export 2024-09-21T15:29:07.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:07.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone2.export 2024-09-21T15:29:07.515 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone2.export 2024-09-21T15:29:07.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:07.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:07.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone20 2024-09-21T15:29:07.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:07.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone20 2024-09-21T15:29:07.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:07.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone20.export 2024-09-21T15:29:07.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone20.export 2024-09-21T15:29:07.518 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone20 2024-09-21T15:29:07.519 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:07.519 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:07.712 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:07.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone20.export 2024-09-21T15:29:07.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone20@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone20.export 2024-09-21T15:29:09.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:09.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone20@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone20.export 2024-09-21T15:29:14.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:14.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone20.export 2024-09-21T15:29:14.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:14.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone20.export 2024-09-21T15:29:14.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone20.export 2024-09-21T15:29:15.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:15.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone20.export 2024-09-21T15:29:16.889 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2024-09-21T15:29:16.889 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2024-09-21T15:29:16.890 INFO:tasks.rbd_mirror_thrash:waiting for 2 secs before reviving daemons 2024-09-21T15:29:16.891 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:29:16.889+0000 7fdba66db700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 105706) UID: 1000 2024-09-21T15:29:17.497 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:17.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone20.export 2024-09-21T15:29:17.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone20.export 2024-09-21T15:29:17.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:17.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:17.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone21 2024-09-21T15:29:17.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:17.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone21 2024-09-21T15:29:17.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:17.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone21.export 2024-09-21T15:29:17.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone21.export 2024-09-21T15:29:17.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone21 2024-09-21T15:29:17.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:17.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:17.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:17.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone21.export 2024-09-21T15:29:17.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone21@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone21.export 2024-09-21T15:29:17.797 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:17.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone21@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone21.export 2024-09-21T15:29:17.936 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:17.931+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:29:17.938 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:17.931+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:29:17.942 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:17.935+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:29:17.942 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:17.935+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:29:17.950 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:17.943+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af310dd0 2024-09-21T15:29:17.958 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:17.951+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:29:17.966 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:17.959+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:29:17.970 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:17.963+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:29:17.977 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:17.963+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:29:17.977 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:17.963+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:29:17.979 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:17.971+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:29:18.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:18.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone21.export 2024-09-21T15:29:18.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:18.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone21.export 2024-09-21T15:29:18.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone21.export 2024-09-21T15:29:18.415 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:18.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone21.export 2024-09-21T15:29:18.515 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:18.520 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone21.export 2024-09-21T15:29:18.668 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone21.export 2024-09-21T15:29:18.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:18.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:18.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone22 2024-09-21T15:29:18.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:18.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone22 2024-09-21T15:29:18.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:18.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone22.export 2024-09-21T15:29:18.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone22.export 2024-09-21T15:29:18.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone22 2024-09-21T15:29:18.695 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:18.695 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:18.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:18.762 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone22.export 2024-09-21T15:29:18.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone22@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone22.export 2024-09-21T15:29:18.890 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2024-09-21T15:29:18.891 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:29:18.891 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.0 2024-09-21T15:29:18.891 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2024-09-21T15:29:18.891 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2024-09-21T15:29:18.894 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2024-09-21T15:29:18.894 INFO:tasks.rbd_mirror_thrash:waiting for 95 secs before thrashing 2024-09-21T15:29:19.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:19.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone22@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone22.export 2024-09-21T15:29:19.258 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.249+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:29:19.312 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.289+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:29:19.312 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.289+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:29:19.313 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.301+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:29:19.323 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.309+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:29:19.323 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.321+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:29:19.323 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.321+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:29:19.324 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.321+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:29:19.324 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.321+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:29:19.324 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.321+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:29:19.332 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.325+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:29:19.332 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.325+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:29:19.385 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.373+0000 7ff753f07700 -1 reset not still connected to 0x56016ad40c30 2024-09-21T15:29:19.385 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.373+0000 7ff753f07700 -1 reset not still connected to 0x56016b24e820 2024-09-21T15:29:19.385 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.373+0000 7ff753f07700 -1 reset not still connected to 0x56016c8b8340 2024-09-21T15:29:19.385 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.373+0000 7ff753f07700 -1 reset not still connected to 0x56016ca81380 2024-09-21T15:29:19.385 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.373+0000 7ff753f07700 -1 reset not still connected to 0x56016cfb9790 2024-09-21T15:29:19.392 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.385+0000 7ff753f07700 -1 reset not still connected to 0x56016d985860 2024-09-21T15:29:19.394 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.381+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:29:19.394 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.381+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:29:19.394 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.381+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:29:19.394 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.381+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:29:19.394 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.381+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:29:19.394 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:19.381+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:29:19.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:19.403 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.401+0000 7ff753f07700 -1 reset not still connected to 0x56016dd77380 2024-09-21T15:29:19.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.401+0000 7ff753f07700 -1 reset not still connected to 0x56016e328b60 2024-09-21T15:29:19.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.401+0000 7ff753f07700 -1 reset not still connected to 0x56016ea1e340 2024-09-21T15:29:19.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.413+0000 7ff753f07700 -1 reset not still connected to 0x56016f0d3d40 2024-09-21T15:29:19.417 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.413+0000 7ff753f07700 -1 reset not still connected to 0x56016f162b60 2024-09-21T15:29:19.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone22.export 2024-09-21T15:29:19.424 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.421+0000 7ff753f07700 -1 reset not still connected to 0x56016f163450 2024-09-21T15:29:19.424 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.421+0000 7ff753f07700 -1 reset not still connected to 0x56016f1636c0 2024-09-21T15:29:19.424 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.421+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2a90 2024-09-21T15:29:19.424 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.421+0000 7ff753f07700 -1 reset not still connected to 0x56016f3e2c30 2024-09-21T15:29:19.424 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.421+0000 7ff753f07700 -1 reset not still connected to 0x56016fc98d00 2024-09-21T15:29:19.430 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.425+0000 7ff753f07700 -1 reset not still connected to 0x56016feffd40 2024-09-21T15:29:19.430 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.425+0000 7ff753f07700 -1 reset not still connected to 0x56017063e1a0 2024-09-21T15:29:19.430 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.425+0000 7ff753f07700 -1 reset not still connected to 0x5601709b80d0 2024-09-21T15:29:19.432 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.429+0000 7ff753f07700 -1 reset not still connected to 0x5601709b9520 2024-09-21T15:29:19.432 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.429+0000 7ff753f07700 -1 reset not still connected to 0x560170f64b60 2024-09-21T15:29:19.432 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.429+0000 7ff753f07700 -1 reset not still connected to 0x560170f64d00 2024-09-21T15:29:19.450 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.433+0000 7ff753f07700 -1 reset not still connected to 0x56017157c4e0 2024-09-21T15:29:19.451 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.433+0000 7ff753f07700 -1 reset not still connected to 0x560171cd5c70 2024-09-21T15:29:19.451 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.433+0000 7ff753f07700 -1 reset not still connected to 0x560171d009c0 2024-09-21T15:29:19.451 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.433+0000 7ff753f07700 -1 reset not still connected to 0x560171d00c30 2024-09-21T15:29:19.459 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.457+0000 7ff753f07700 -1 reset not still connected to 0x56017219f790 2024-09-21T15:29:19.460 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.457+0000 7ff753f07700 -1 reset not still connected to 0x56017219f860 2024-09-21T15:29:19.460 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.457+0000 7ff753f07700 -1 reset not still connected to 0x56017219fba0 2024-09-21T15:29:19.480 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.477+0000 7ff753f07700 -1 reset not still connected to 0x560173d86a90 2024-09-21T15:29:19.491 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.481+0000 7ff753f07700 -1 reset not still connected to 0x560173d87040 2024-09-21T15:29:19.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.481+0000 7ff753f07700 -1 reset not still connected to 0x560173d87380 2024-09-21T15:29:19.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.481+0000 7ff753f07700 -1 reset not still connected to 0x560173e671e0 2024-09-21T15:29:19.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.481+0000 7ff753f07700 -1 reset not still connected to 0x560173e67380 2024-09-21T15:29:19.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.481+0000 7ff753f07700 -1 reset not still connected to 0x5601743d2b60 2024-09-21T15:29:19.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.481+0000 7ff753f07700 -1 reset not still connected to 0x5601745541a0 2024-09-21T15:29:19.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.481+0000 7ff753f07700 -1 reset not still connected to 0x5601747f4a90 2024-09-21T15:29:19.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.481+0000 7ff753f07700 -1 reset not still connected to 0x560174ec7040 2024-09-21T15:29:19.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.481+0000 7ff753f07700 -1 reset not still connected to 0x560174ec76c0 2024-09-21T15:29:19.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.481+0000 7ff753f07700 -1 reset not still connected to 0x56017529ab60 2024-09-21T15:29:19.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.481+0000 7ff753f07700 -1 reset not still connected to 0x56017529aea0 2024-09-21T15:29:19.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.481+0000 7ff753f07700 -1 reset not still connected to 0x56017529b110 2024-09-21T15:29:19.492 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.481+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:29:19.502 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.497+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0000 2024-09-21T15:29:19.503 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.497+0000 7ff753f07700 -1 reset not still connected to 0x5601757d00d0 2024-09-21T15:29:19.503 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.497+0000 7ff753f07700 -1 reset not still connected to 0x5601757d0340 2024-09-21T15:29:19.503 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.497+0000 7ff753f07700 -1 reset not still connected to 0x5601757d05b0 2024-09-21T15:29:19.505 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.497+0000 7ff753f07700 -1 reset not still connected to 0x560175e1c8f0 2024-09-21T15:29:19.506 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.497+0000 7ff753f07700 -1 reset not still connected to 0x560175e1cdd0 2024-09-21T15:29:19.506 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.497+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d1e0 2024-09-21T15:29:19.506 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.497+0000 7ff753f07700 -1 reset not still connected to 0x560175e1d6c0 2024-09-21T15:29:19.508 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.505+0000 7ff753f07700 -1 reset not still connected to 0x560175e1dba0 2024-09-21T15:29:19.508 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.505+0000 7ff753f07700 -1 reset not still connected to 0x5601762fc9c0 2024-09-21T15:29:19.508 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.505+0000 7ff753f07700 -1 reset not still connected to 0x5601762fd860 2024-09-21T15:29:19.515 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.509+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0d00 2024-09-21T15:29:19.518 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.509+0000 7ff753f07700 -1 reset not still connected to 0x5601766a0f70 2024-09-21T15:29:19.518 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.509+0000 7ff753f07700 -1 reset not still connected to 0x5601766a1450 2024-09-21T15:29:19.519 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.513+0000 7ff753f07700 -1 reset not still connected to 0x5601772732b0 2024-09-21T15:29:19.519 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.513+0000 7ff753f07700 -1 reset not still connected to 0x560177273450 2024-09-21T15:29:19.519 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.513+0000 7ff753f07700 -1 reset not still connected to 0x5601774cca90 2024-09-21T15:29:19.525 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x5601774cdd40 2024-09-21T15:29:19.525 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x560177984b60 2024-09-21T15:29:19.525 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x560178190000 2024-09-21T15:29:19.525 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x5601781901a0 2024-09-21T15:29:19.525 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x5601781904e0 2024-09-21T15:29:19.525 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x5601781908f0 2024-09-21T15:29:19.525 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x5601781912b0 2024-09-21T15:29:19.525 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e1a0 2024-09-21T15:29:19.525 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e680 2024-09-21T15:29:19.525 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e8f0 2024-09-21T15:29:19.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a16edd0 2024-09-21T15:29:19.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a16f380 2024-09-21T15:29:19.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fad0 2024-09-21T15:29:19.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fd40 2024-09-21T15:29:19.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fe10 2024-09-21T15:29:19.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a2045b0 2024-09-21T15:29:19.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a204b60 2024-09-21T15:29:19.527 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a204f70 2024-09-21T15:29:19.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:29:19.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a205e10 2024-09-21T15:29:19.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2410 2024-09-21T15:29:19.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.521+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b3040 2024-09-21T15:29:19.528 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.525+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:29:19.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.529+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b35f0 2024-09-21T15:29:19.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.529+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b3860 2024-09-21T15:29:19.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.529+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f20d0 2024-09-21T15:29:19.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.529+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:29:19.531 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.529+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:29:19.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.529+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:29:19.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.529+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:29:19.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.529+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3380 2024-09-21T15:29:19.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.529+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3450 2024-09-21T15:29:19.534 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.529+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ad0 2024-09-21T15:29:19.539 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.537+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ba0 2024-09-21T15:29:19.539 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.537+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3d40 2024-09-21T15:29:19.539 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.537+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ee0 2024-09-21T15:29:19.539 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.537+0000 7ff753f07700 -1 reset not still connected to 0x56017a8ccdd0 2024-09-21T15:29:19.539 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.537+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd1e0 2024-09-21T15:29:19.539 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.537+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd5f0 2024-09-21T15:29:19.546 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:29:19.541+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd930 2024-09-21T15:29:19.615 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:19.615 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone22.export 2024-09-21T15:29:19.662 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone22.export 2024-09-21T15:29:19.718 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:19.723 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone22.export 2024-09-21T15:29:19.782 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:19.787 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone22.export 2024-09-21T15:29:19.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone22.export 2024-09-21T15:29:19.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:19.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:19.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone23 2024-09-21T15:29:19.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:19.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone23 2024-09-21T15:29:19.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:19.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone23.export 2024-09-21T15:29:19.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone23.export 2024-09-21T15:29:19.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone23 2024-09-21T15:29:19.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:19.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:19.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:19.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone23.export 2024-09-21T15:29:19.865 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone23@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone23.export 2024-09-21T15:29:20.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:20.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone23@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone23.export 2024-09-21T15:29:20.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:20.441 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone23.export 2024-09-21T15:29:20.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:20.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone23.export 2024-09-21T15:29:20.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone23.export 2024-09-21T15:29:20.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:20.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone23.export 2024-09-21T15:29:20.699 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:20.705 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone23.export 2024-09-21T15:29:20.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone23.export 2024-09-21T15:29:20.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:20.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:20.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone24 2024-09-21T15:29:20.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:20.708 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone24 2024-09-21T15:29:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone24.export 2024-09-21T15:29:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone24.export 2024-09-21T15:29:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone24 2024-09-21T15:29:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:20.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:20.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone24.export 2024-09-21T15:29:20.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone24@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone24.export 2024-09-21T15:29:20.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 16% complete... Exporting image: 24% complete... Exporting image: 33% complete... Exporting image: 41% complete... Exporting image: 49% complete... Exporting image: 58% complete... Exporting image: 66% complete... Exporting image: 74% complete... Exporting image: 83% complete... Exporting image: 91% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:20.939 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone24@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone24.export 2024-09-21T15:29:21.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 16% complete... Exporting image: 24% complete... Exporting image: 33% complete... Exporting image: 41% complete... Exporting image: 49% complete... Exporting image: 58% complete... Exporting image: 66% complete... Exporting image: 74% complete... Exporting image: 83% complete... Exporting image: 91% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:21.098 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone24.export 2024-09-21T15:29:21.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:21.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone24.export 2024-09-21T15:29:21.215 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone24.export 2024-09-21T15:29:21.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 16% complete... Exporting image: 24% complete... Exporting image: 33% complete... Exporting image: 41% complete... Exporting image: 49% complete... Exporting image: 58% complete... Exporting image: 66% complete... Exporting image: 74% complete... Exporting image: 83% complete... Exporting image: 91% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:21.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone24.export 2024-09-21T15:29:21.513 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 16% complete... Exporting image: 24% complete... Exporting image: 33% complete... Exporting image: 41% complete... Exporting image: 49% complete... Exporting image: 58% complete... Exporting image: 66% complete... Exporting image: 74% complete... Exporting image: 83% complete... Exporting image: 91% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:21.520 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone24.export 2024-09-21T15:29:21.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone24.export 2024-09-21T15:29:21.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:21.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:21.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone25 2024-09-21T15:29:21.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:21.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone25 2024-09-21T15:29:21.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:21.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone25.export 2024-09-21T15:29:21.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone25.export 2024-09-21T15:29:21.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:21.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone25 2024-09-21T15:29:21.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:21.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:21.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone25.export 2024-09-21T15:29:21.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone25@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone25.export 2024-09-21T15:29:22.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 24% complete... Exporting image: 49% complete... Exporting image: 73% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:22.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone25@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone25.export 2024-09-21T15:29:22.288 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 24% complete... Exporting image: 49% complete... Exporting image: 73% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:22.293 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone25.export 2024-09-21T15:29:22.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:22.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone25.export 2024-09-21T15:29:22.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone25.export 2024-09-21T15:29:22.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 24% complete... Exporting image: 49% complete... Exporting image: 73% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:22.765 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone25.export 2024-09-21T15:29:23.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 24% complete... Exporting image: 49% complete... Exporting image: 73% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:23.035 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone25.export 2024-09-21T15:29:23.186 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone25.export 2024-09-21T15:29:23.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:23.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:23.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone26 2024-09-21T15:29:23.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:23.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone26 2024-09-21T15:29:23.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:23.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone26.export 2024-09-21T15:29:23.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone26.export 2024-09-21T15:29:23.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone26 2024-09-21T15:29:23.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:23.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:23.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:23.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone26.export 2024-09-21T15:29:23.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone26@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone26.export 2024-09-21T15:29:23.493 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 41% complete... Exporting image: 55% complete... Exporting image: 69% complete... Exporting image: 83% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:23.498 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone26@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone26.export 2024-09-21T15:29:23.682 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 41% complete... Exporting image: 55% complete... Exporting image: 69% complete... Exporting image: 83% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:23.687 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone26.export 2024-09-21T15:29:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:23.843 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone26.export 2024-09-21T15:29:23.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone26.export 2024-09-21T15:29:24.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 41% complete... Exporting image: 55% complete... Exporting image: 69% complete... Exporting image: 83% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:24.065 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone26.export 2024-09-21T15:29:24.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 27% complete... Exporting image: 41% complete... Exporting image: 55% complete... Exporting image: 69% complete... Exporting image: 83% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:24.300 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.285+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:29:24.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone26.export 2024-09-21T15:29:24.305 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.289+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:29:24.305 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.289+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:29:24.314 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.301+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:29:24.314 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.301+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:29:24.314 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.301+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:29:24.314 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.301+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:29:24.410 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.405+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dfba0 2024-09-21T15:29:24.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.421+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d9c70 2024-09-21T15:29:24.449 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.437+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:29:24.449 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.437+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0d860 2024-09-21T15:29:24.449 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.437+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:29:24.449 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.437+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:29:24.450 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.445+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47ee0 2024-09-21T15:29:24.451 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.445+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83716c0 2024-09-21T15:29:24.451 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.445+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a5b0 2024-09-21T15:29:24.451 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.445+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:29:24.451 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.445+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:29:24.461 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.449+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cdad0 2024-09-21T15:29:24.462 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.449+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:29:24.462 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.449+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1651e0 2024-09-21T15:29:24.462 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.449+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:29:24.462 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.449+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:29:24.462 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.449+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:29:24.462 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.449+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:29:24.462 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.449+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d9ba0 2024-09-21T15:29:24.463 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.453+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:29:24.470 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.465+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35dc70 2024-09-21T15:29:24.470 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.465+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:29:24.470 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.465+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:29:24.474 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.469+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:29:24.474 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.469+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:29:24.474 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.469+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:29:24.474 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.469+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf02820 2024-09-21T15:29:24.474 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.469+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:29:24.482 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.481+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:29:24.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.481+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5ee0 2024-09-21T15:29:24.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.481+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:29:24.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26cb60 2024-09-21T15:29:24.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d790 2024-09-21T15:29:24.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:29:24.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:29:24.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:29:24.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3508f0 2024-09-21T15:29:24.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:29:24.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:29:24.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:29:24.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53040 2024-09-21T15:29:24.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:29:24.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:29:24.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ec30 2024-09-21T15:29:24.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:29:24.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:29:24.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:29:24.489 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b450 2024-09-21T15:29:24.489 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:29:24.489 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:29:24.489 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009ee0 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30ea0 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f60d0 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6820 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:29:24.490 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:29:24.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:29:24.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:29:24.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692340 2024-09-21T15:29:24.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:29:24.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:29:24.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:29:24.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:29:24.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:29:24.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:29:24.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:24.485+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:29:24.598 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone26.export 2024-09-21T15:29:24.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:24.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:24.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone27 2024-09-21T15:29:24.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:24.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone27 2024-09-21T15:29:24.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:24.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone27.export 2024-09-21T15:29:24.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone27.export 2024-09-21T15:29:24.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone27 2024-09-21T15:29:24.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:24.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:24.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:24.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone27.export 2024-09-21T15:29:24.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone27@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone27.export 2024-09-21T15:29:24.761 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:24.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone27@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone27.export 2024-09-21T15:29:24.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:24.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone27.export 2024-09-21T15:29:24.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:24.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone27.export 2024-09-21T15:29:24.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone27.export 2024-09-21T15:29:24.942 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:24.949 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone27.export 2024-09-21T15:29:25.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:25.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone27.export 2024-09-21T15:29:25.038 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone27.export 2024-09-21T15:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone28 2024-09-21T15:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone28 2024-09-21T15:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone28.export 2024-09-21T15:29:25.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone28.export 2024-09-21T15:29:25.044 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone28 2024-09-21T15:29:25.044 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:25.044 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:25.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:25.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone28.export 2024-09-21T15:29:25.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone28@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone28.export 2024-09-21T15:29:25.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 36% complete... Exporting image: 72% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:25.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone28@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone28.export 2024-09-21T15:29:25.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 36% complete... Exporting image: 72% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:25.549 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone28.export 2024-09-21T15:29:25.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:25.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone28.export 2024-09-21T15:29:25.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone28.export 2024-09-21T15:29:25.796 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:25.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone28.export 2024-09-21T15:29:25.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:25.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone28.export 2024-09-21T15:29:25.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone28.export 2024-09-21T15:29:25.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:25.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:25.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone29 2024-09-21T15:29:25.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:25.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone29 2024-09-21T15:29:25.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:25.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone29.export 2024-09-21T15:29:25.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone29.export 2024-09-21T15:29:25.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone29 2024-09-21T15:29:25.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:25.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:26.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:26.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone29.export 2024-09-21T15:29:26.034 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone29@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone29.export 2024-09-21T15:29:26.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 21% complete... Exporting image: 42% complete... Exporting image: 64% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:26.304 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone29@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone29.export 2024-09-21T15:29:26.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 21% complete... Exporting image: 42% complete... Exporting image: 64% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:26.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone29.export 2024-09-21T15:29:26.688 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.5952356041505286) > weight (0.25) 2024-09-21T15:29:26.688 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.9445987843004148) > weight (0.25) 2024-09-21T15:29:26.688 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.2 2024-09-21T15:29:26.688 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Sent signal 15 2024-09-21T15:29:26.688 INFO:tasks.rbd_mirror_thrash:waiting for 1 secs before reviving daemons 2024-09-21T15:29:26.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:29:26.685+0000 7faa5c3a7700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 (PID: 24799) UID: 1000 2024-09-21T15:29:26.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:26.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone29.export 2024-09-21T15:29:26.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone29.export 2024-09-21T15:29:26.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:26.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone29.export 2024-09-21T15:29:26.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:26.968 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone29.export 2024-09-21T15:29:26.981 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone29.export 2024-09-21T15:29:26.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:26.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:26.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone3 2024-09-21T15:29:26.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:26.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone3 2024-09-21T15:29:26.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:26.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone3.export 2024-09-21T15:29:26.985 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone3.export 2024-09-21T15:29:26.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone3 2024-09-21T15:29:26.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:26.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:27.127 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:27.127 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone3.export 2024-09-21T15:29:27.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone3@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone3.export 2024-09-21T15:29:27.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:27.391 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone3@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone3.export 2024-09-21T15:29:27.662 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:27.668 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone3.export 2024-09-21T15:29:27.689 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.2 2024-09-21T15:29:27.689 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:29:27.689 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.2 2024-09-21T15:29:27.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Restarting daemon 2024-09-21T15:29:27.689 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 2024-09-21T15:29:27.691 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Started 2024-09-21T15:29:27.691 INFO:tasks.rbd_mirror_thrash:waiting for 68 secs before thrashing 2024-09-21T15:29:27.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:27.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone3.export 2024-09-21T15:29:27.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone3.export 2024-09-21T15:29:27.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:27.899 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone3.export 2024-09-21T15:29:28.018 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:28.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone3.export 2024-09-21T15:29:28.031 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone3.export 2024-09-21T15:29:28.035 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:28.035 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:28.035 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone30 2024-09-21T15:29:28.035 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:28.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone30 2024-09-21T15:29:28.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:28.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone30.export 2024-09-21T15:29:28.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone30.export 2024-09-21T15:29:28.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone30 2024-09-21T15:29:28.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:28.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:28.105 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:28.105 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone30.export 2024-09-21T15:29:28.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone30@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone30.export 2024-09-21T15:29:28.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 21% complete... Exporting image: 29% complete... Exporting image: 36% complete... Exporting image: 43% complete... Exporting image: 51% complete... Exporting image: 58% complete... Exporting image: 65% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 87% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:28.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone30@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone30.export 2024-09-21T15:29:28.517 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 21% complete... Exporting image: 29% complete... Exporting image: 36% complete... Exporting image: 43% complete... Exporting image: 51% complete... Exporting image: 58% complete... Exporting image: 65% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 87% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:28.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone30.export 2024-09-21T15:29:28.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:28.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone30.export 2024-09-21T15:29:28.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone30.export 2024-09-21T15:29:28.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 21% complete... Exporting image: 29% complete... Exporting image: 36% complete... Exporting image: 43% complete... Exporting image: 51% complete... Exporting image: 58% complete... Exporting image: 65% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 87% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:28.918 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone30.export 2024-09-21T15:29:29.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 21% complete... Exporting image: 29% complete... Exporting image: 36% complete... Exporting image: 43% complete... Exporting image: 51% complete... Exporting image: 58% complete... Exporting image: 65% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 87% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:29.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone30.export 2024-09-21T15:29:29.251 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.243+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:29:29.256 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e8410 2024-09-21T15:29:29.256 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:29:29.258 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678f2b0 2024-09-21T15:29:29.259 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff656c0 2024-09-21T15:29:29.261 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65c70 2024-09-21T15:29:29.261 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1c70 2024-09-21T15:29:29.261 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1ee0 2024-09-21T15:29:29.261 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e750 2024-09-21T15:29:29.261 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:29:29.261 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335ad0 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766750 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87676c0 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89672b0 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51110 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde261a0 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde27d40 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.251+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c9c0 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.255+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d2b0 2024-09-21T15:29:29.262 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.255+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:29:29.263 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:29:29.255+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:29:29.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone30.export 2024-09-21T15:29:29.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:29.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:29.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone31 2024-09-21T15:29:29.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:29.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone31 2024-09-21T15:29:29.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:29.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone31.export 2024-09-21T15:29:29.350 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone31.export 2024-09-21T15:29:29.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone31 2024-09-21T15:29:29.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:29.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:29.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:29.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone31.export 2024-09-21T15:29:29.441 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone31@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone31.export 2024-09-21T15:29:29.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:29.775 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone31@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone31.export 2024-09-21T15:29:29.988 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:29.979+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:29:30.084 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.075+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9860 2024-09-21T15:29:30.084 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.075+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:29:30.086 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.079+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:29:30.086 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.079+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:29:30.096 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.091+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:29:30.096 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.091+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57c70 2024-09-21T15:29:30.096 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.091+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d25b0 2024-09-21T15:29:30.108 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:29:30.110 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:29:30.110 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:29:30.110 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3d40 2024-09-21T15:29:30.110 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:29:30.110 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:29:30.111 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:29:30.111 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:29:30.111 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676340 2024-09-21T15:29:30.111 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:29:30.111 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676750 2024-09-21T15:29:30.111 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36775f0 2024-09-21T15:29:30.111 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36776c0 2024-09-21T15:29:30.111 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.099+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677930 2024-09-21T15:29:30.111 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.103+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677ba0 2024-09-21T15:29:30.111 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.103+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677e10 2024-09-21T15:29:30.113 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45280d0 2024-09-21T15:29:30.113 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528410 2024-09-21T15:29:30.113 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45285b0 2024-09-21T15:29:30.114 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45288f0 2024-09-21T15:29:30.114 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528d00 2024-09-21T15:29:30.114 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529860 2024-09-21T15:29:30.114 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b20d0 2024-09-21T15:29:30.114 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b21a0 2024-09-21T15:29:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2340 2024-09-21T15:29:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2680 2024-09-21T15:29:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2820 2024-09-21T15:29:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2ea0 2024-09-21T15:29:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:29:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3380 2024-09-21T15:29:30.115 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.107+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3520 2024-09-21T15:29:30.121 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.115+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3ba0 2024-09-21T15:29:30.121 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.115+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59cb930 2024-09-21T15:29:30.121 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:30.115+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:29:30.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:30.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone31.export 2024-09-21T15:29:30.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:30.563 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone31.export 2024-09-21T15:29:30.620 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone31.export 2024-09-21T15:29:30.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:30.805 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone31.export 2024-09-21T15:29:30.950 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:30.945+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f3dcd400 [3/0111f35b-69c8-4614-8b36-510c97864eec] start: already running 2024-09-21T15:29:30.950 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:30.945+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f3dcd400 [3/0111f35b-69c8-4614-8b36-510c97864eec] start: already running 2024-09-21T15:29:30.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:30.945+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5b94500 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:29:30.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:30.945+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5b94500 [3/051f7b8b-b89c-4aa0-83cb-5e738fb8ed75] start: already running 2024-09-21T15:29:30.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:30.945+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5b94780 [3/0548c5e3-c10e-47f9-b0c1-cd5c74547602] start: already running 2024-09-21T15:29:30.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:30.945+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5b94a00 [3/06083b71-7c43-447a-b25c-2ee4be39c803] start: already running 2024-09-21T15:29:30.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:30.945+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5b94c80 [3/06206359-a5f6-4376-970d-9f794536ac14] start: already running 2024-09-21T15:29:30.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:30.945+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5b94f00 [3/0bb25ca5-fa0f-42d0-af66-5ebefa81e993] start: already running 2024-09-21T15:29:30.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:30.945+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5b95180 [3/0da2d7cc-be3d-48b3-9444-121826b07f97] start: already running 2024-09-21T15:29:30.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:30.945+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5b95400 [3/0e38c267-ca71-47c8-85c5-6e571f45254e] start: already running 2024-09-21T15:29:31.033 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.029+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5da1180 [3/3e4c42b2-b54b-4fa5-a521-076c70c59b4f] start: already running 2024-09-21T15:29:31.033 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.029+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5de2000 [3/43028d32-4202-4ac6-b083-241946f596da] start: already running 2024-09-21T15:29:31.033 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.029+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5de2280 [3/43a73e62-4bcf-4dbf-97f4-0fa9db2adcba] start: already running 2024-09-21T15:29:31.047 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5de2780 [3/4a9de63d-2d57-4edb-9b9f-67ede03fdec6] start: already running 2024-09-21T15:29:31.047 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5da1900 [3/3fdcc685-72aa-4afe-9cdb-1ad60b962a91] start: already running 2024-09-21T15:29:31.047 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5da1400 [3/3e87a2ed-dc29-47ec-976a-1a33bfabf914] start: already running 2024-09-21T15:29:31.047 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5da1680 [3/3f55813c-389e-4273-ad96-2ee904d4730d] start: already running 2024-09-21T15:29:31.047 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5da1b80 [3/4026d3a9-81ff-4074-aa36-3ae99da1306d] start: already running 2024-09-21T15:29:31.047 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5de2c80 [3/4bd5f744-bf83-4824-98f0-d27d9f1c8197] start: already running 2024-09-21T15:29:31.047 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e20280 [3/5372d49a-7f62-4cee-a4e4-61183f5854a0] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5de3900 [3/533f49cb-9e85-487d-a73d-6b891eb8fdc6] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e20a00 [3/58968828-f010-4fe8-9cec-0eac08331be4] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e20500 [3/55849911-b935-4c97-b400-325303585d1b] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5de3b80 [3/535b2c9f-8008-4989-b65d-748a5cd23a9b] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5de2a00 [3/4b9face3-5cac-4c8c-ab5f-f75cbc0915bc] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e20f00 [3/59c93a57-c7d1-4245-95e1-c3b4a05e2c1a] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e21680 [3/5d24c14f-898d-40de-9618-1f90e4165f5d] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e21400 [3/5aef6686-3462-4732-9396-d809d993e90b] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5de3400 [3/4f24f6f0-5be2-4ea3-af4f-83dbaa368544] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5de2f00 [3/4d33624c-dcd8-4157-891c-5b117dfa1f81] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5de3680 [3/50a1f802-df95-4e98-8630-fafd576b3b77] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e21900 [3/5d444500-7ead-4909-a696-94bdbd9f7e8c] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5ea6280 [3/5dd347e3-98d3-46ab-aac5-65babaab9ae6] start: already running 2024-09-21T15:29:31.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5de3180 [3/4db41bcc-01af-44fc-9cb1-aedfd7a02660] start: already running 2024-09-21T15:29:31.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5ea6500 [3/5e8b4579-81b1-4cbb-a0ef-7f96494cfc61] start: already running 2024-09-21T15:29:31.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5b94000 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:29:31.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5b94000 [3/04541b78-9209-4691-bb39-3dd6fa0ec333] start: already running 2024-09-21T15:29:31.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5ea6780 [3/6019fe59-e961-41f3-881e-27522f0e43d6] start: already running 2024-09-21T15:29:31.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5b94280 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:29:31.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5b94280 [3/04c38b7c-01bc-4aba-abf6-b06791607e1f] start: already running 2024-09-21T15:29:31.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f3dcd900 [3/02c68625-9e68-49b7-9164-c8fd75eb654b] start: already running 2024-09-21T15:29:31.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f3dcd900 [3/02c68625-9e68-49b7-9164-c8fd75eb654b] start: already running 2024-09-21T15:29:31.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e20c80 [3/59c4deec-1cba-4460-94d5-6bed35911cea] start: already running 2024-09-21T15:29:31.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f3dcd680 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:29:31.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f3dcd680 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:29:31.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.041+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f3dcd680 [3/01f8d37c-a37a-4fbe-af84-d8f7c64de775] start: already running 2024-09-21T15:29:31.057 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.053+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e20000 [3/536a1fc6-237a-4cc9-9799-f875bd685121] start: already running 2024-09-21T15:29:31.057 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.053+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e20780 [3/55c2a1c2-e5de-4bcb-8d07-45955fdc4e18] start: already running 2024-09-21T15:29:31.079 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.077+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5ea6000 [3/5d8470f4-d7d3-4732-8815-2ed1bc60c759] start: already running 2024-09-21T15:29:31.079 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.077+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5ea6000 [3/5d8470f4-d7d3-4732-8815-2ed1bc60c759] start: already running 2024-09-21T15:29:31.079 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.077+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5ea7180 [3/60ee4d91-fe2c-4f38-849f-9f6974471b07] start: already running 2024-09-21T15:29:31.080 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.077+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5fd2c80 [3/69a7130a-5782-4154-a7fd-f0e546ab0ea4] start: already running 2024-09-21T15:29:31.080 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.077+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5fd3900 [3/6dcfb50f-6365-4e2b-904c-11572f8ea5c9] start: already running 2024-09-21T15:29:31.115 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.113+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e21180 [3/5a2bda13-d29d-4620-a6e7-180dd2cee0a8] start: already running 2024-09-21T15:29:31.115 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.113+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e21180 [3/5a2bda13-d29d-4620-a6e7-180dd2cee0a8] start: already running 2024-09-21T15:29:31.153 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.149+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f5fd2280 [3/637122ca-60c4-4992-9f94-ae01ebaccd0e] start: already running 2024-09-21T15:29:31.154 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.149+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f5fd2a00 [3/69a6bb5f-56ca-4197-9a03-c1f93382494d] start: already running 2024-09-21T15:29:31.157 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:31.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone31.export 2024-09-21T15:29:31.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone31.export 2024-09-21T15:29:31.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.189+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e21b80 [3/5d512263-1e55-4555-80ca-62bb3f5592fb] start: already running 2024-09-21T15:29:31.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.189+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5e21b80 [3/5d512263-1e55-4555-80ca-62bb3f5592fb] start: already running 2024-09-21T15:29:31.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.189+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f3dcdb80 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:29:31.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.189+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f3dcdb80 [3/03d84ea6-9ad5-4a5d-beec-ecb0055acb54] start: already running 2024-09-21T15:29:31.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:31.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:31.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone32 2024-09-21T15:29:31.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:31.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone32 2024-09-21T15:29:31.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:31.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone32.export 2024-09-21T15:29:31.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone32.export 2024-09-21T15:29:31.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:31.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:31.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone32 2024-09-21T15:29:31.240 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.237+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f61efb80 [3/8b7051b8-a921-4443-bbf8-fd20e9cbcef1] start: already running 2024-09-21T15:29:31.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.237+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6212a00 [3/93b14c97-3746-461a-9848-33b07d7ddb85] start: already running 2024-09-21T15:29:31.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.237+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6212500 [3/90681343-98ff-49b4-a3fe-5ba10265e680] start: already running 2024-09-21T15:29:31.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.237+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6212c80 [3/958ce416-411d-4e1a-9982-a2ce4771b41b] start: already running 2024-09-21T15:29:31.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.237+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6212f00 [3/95e3897d-ea8f-4598-980b-426864d1bc5d] start: already running 2024-09-21T15:29:31.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.237+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6213680 [3/972ded23-1f92-4c82-9bf1-e3d7050a34a2] start: already running 2024-09-21T15:29:31.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.237+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5fd3400 [3/6c6c57d8-5093-4705-a2fd-c4493902301e] start: already running 2024-09-21T15:29:31.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.237+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6213180 [3/96bdba02-bf8c-4de9-8b36-c42ccdad5cf0] start: already running 2024-09-21T15:29:31.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.237+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6213b80 [3/9899b7e1-7c24-4bdd-b213-241bfd0956fd] start: already running 2024-09-21T15:29:31.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.237+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6213900 [3/9864fae0-3895-4e6e-8b42-30d51bc9fbb9] start: already running 2024-09-21T15:29:31.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.237+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6258500 [3/9c634cdf-a6f6-482b-a85c-0d163bc3d079] start: already running 2024-09-21T15:29:31.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.237+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6258780 [3/9f1ae171-c261-402d-a90a-2b4cca77a51c] start: already running 2024-09-21T15:29:31.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.237+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5fd3b80 [3/71a77f4d-9e83-4fd4-82da-4a34261112d8] start: already running 2024-09-21T15:29:31.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.269+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6258a00 [3/9fbaf0e4-e740-44b5-93a8-aaac75180cbd] start: already running 2024-09-21T15:29:31.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.269+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6258f00 [3/a2db521e-33c9-46f9-be3c-48d613b2d67d] start: already running 2024-09-21T15:29:31.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.269+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6258c80 [3/a15513b2-9cf9-4c80-b9b1-ea6973791935] start: already running 2024-09-21T15:29:31.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.269+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6259180 [3/a77fae66-b2f4-4e7a-be7f-ae0afc3628db] start: already running 2024-09-21T15:29:31.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.269+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5cc8280 [3/ace09410-303f-4cc6-8fa7-c5190a4c62e6] start: already running 2024-09-21T15:29:31.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.269+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f6259680 [3/a88a0c18-875d-4624-b7df-602dca14305c] start: already running 2024-09-21T15:29:31.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.269+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5cc8780 [3/af962aab-237c-497b-989c-5a6f03523f73] start: already running 2024-09-21T15:29:31.276 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.273+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f5cc9900 [3/b1bacb05-0cfc-4685-a814-d83528c58107] start: already running 2024-09-21T15:29:31.276 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.273+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f6259400 [3/a886c6ec-95d5-4bec-95d6-90b535ab9694] start: already running 2024-09-21T15:29:31.276 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.273+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f3dcd180 [3/ab585917-bbfb-41ce-a268-5e9596e12ef3] start: already running 2024-09-21T15:29:31.276 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.273+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f5cc8a00 [3/afce2605-a8db-416c-a324-7471613e476c] start: already running 2024-09-21T15:29:31.280 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.277+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f5cc9680 [3/b12a2538-c933-4f86-af97-4d8a987efe14] start: already running 2024-09-21T15:29:31.280 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.277+0000 7fcf50004700 -1 rbd::mirror::ImageReplayer: 0x5588f62fe780 [3/b427bb8c-404c-4fe5-900a-49a86be3a117] start: already running 2024-09-21T15:29:31.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f5cc9b80 [3/b1ddd406-16bd-4901-9f94-c81bbe5c9ca5] start: already running 2024-09-21T15:29:31.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f6258280 [3/9c035874-7072-4388-9e66-5ac25ff8778b] start: already running 2024-09-21T15:29:31.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f62fe000 [3/b24d1ffe-dcef-44c9-945f-83e9b544edec] start: already running 2024-09-21T15:29:31.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f62fef00 [3/b66f4a27-5eef-427c-b07a-9838403b8c68] start: already running 2024-09-21T15:29:31.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f631e000 [3/bc85cdde-3180-4a2f-9b73-da5029177042] start: already running 2024-09-21T15:29:31.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f62fea00 [3/b4ac21e0-f75d-455c-bcb1-7cd0770cae56] start: already running 2024-09-21T15:29:31.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f631e780 [3/be9e6865-39e3-44bf-bd1a-f7be9c8aac4c] start: already running 2024-09-21T15:29:31.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f631f400 [3/c2e2d487-dc39-4cd9-8a9b-5fbb585dae13] start: already running 2024-09-21T15:29:31.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f631ec80 [3/bf3f3ca1-d259-4e3c-bdf0-c138bfc6a985] start: already running 2024-09-21T15:29:31.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f631ef00 [3/bfe08582-8db2-46ec-bf28-30b92617af81] start: already running 2024-09-21T15:29:31.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f631f900 [3/c637239b-4c59-48dc-b548-11f55d5a1b5b] start: already running 2024-09-21T15:29:31.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f631f180 [3/c09cc5be-efe7-4ded-a908-526878332ee8] start: already running 2024-09-21T15:29:31.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f631e280 [3/bda20847-8fe7-4b87-a2ac-8dd19094ba3d] start: already running 2024-09-21T15:29:31.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f631ea00 [3/bf37d95d-24d5-4e99-b4c0-59c9516621d7] start: already running 2024-09-21T15:29:31.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f635e280 [3/c8fe4afe-785c-497e-a798-bcb2c774854a] start: already running 2024-09-21T15:29:31.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.293+0000 7fcf42fea700 -1 rbd::mirror::ImageReplayer: 0x5588f635e780 [3/cabbf079-1702-448b-b0df-97a6f9e3b176] start: already running 2024-09-21T15:29:31.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:31.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone32.export 2024-09-21T15:29:31.304 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone32@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone32.export 2024-09-21T15:29:31.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.305+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f6259b80 [3/aa9ede85-ca2d-4619-bec9-dd837ea37942] start: already running 2024-09-21T15:29:31.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.305+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f6259900 [3/a8c8bfff-c185-48fa-b5d7-a827841c0373] start: already running 2024-09-21T15:29:31.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.305+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5cc8000 [3/ab9322e9-f0d3-4e57-ba54-faf9cbd16ee7] start: already running 2024-09-21T15:29:31.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.305+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f62fec80 [3/b629791b-e5ec-467e-8292-716555419015] start: already running 2024-09-21T15:29:31.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.305+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f62ffb80 [3/bae74f9d-63e6-459c-8ee7-ebd8fc1516a2] start: already running 2024-09-21T15:29:31.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.305+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f62ff680 [3/ba4344b7-ecea-46ff-9bcf-47fd00e1ad54] start: already running 2024-09-21T15:29:31.311 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.305+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f631fb80 [3/c7b5ea34-ee7c-490c-ba70-f137c71b07e1] start: already running 2024-09-21T15:29:31.311 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.305+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f635e500 [3/c9f982c4-88fc-4116-9ce6-8f33f83a2a54] start: already running 2024-09-21T15:29:31.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.305+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5de2500 [3/447d408d-afd0-42db-aef7-f284975751e4] start: already running 2024-09-21T15:29:31.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5de2500 [3/447d408d-afd0-42db-aef7-f284975751e4] start: already running 2024-09-21T15:29:31.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f62fe280 [3/b2ef3fc2-d848-4545-81e4-ea7b9dcf4d31] start: already running 2024-09-21T15:29:31.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f631e500 [3/be89b0c4-d429-4c57-9087-99c39aa47775] start: already running 2024-09-21T15:29:31.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f635e000 [3/c7ca9d94-2023-4304-8c99-f1168681b43d] start: already running 2024-09-21T15:29:31.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f6258000 [3/9b697614-262c-4e5e-b05c-df51b0c07bbc] start: already running 2024-09-21T15:29:31.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f6212000 [3/8d7a3b11-1cec-4004-b7be-e3f2f5588529] start: already running 2024-09-21T15:29:31.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f6212280 [3/8f177af5-68e5-41b8-a80d-9cc5dddf14c3] start: already running 2024-09-21T15:29:31.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5cc8c80 [3/aff5f3bc-3e8e-4a66-b089-b2f57573290a] start: already running 2024-09-21T15:29:31.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5cc8f00 [3/b0925bf1-5012-45a2-afe9-91608ced3c6a] start: already running 2024-09-21T15:29:31.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5cc8500 [3/af7bb590-faa2-4f57-80f6-c5ab02216567] start: already running 2024-09-21T15:29:31.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf437eb700 -1 rbd::mirror::ImageReplayer: 0x5588f6212780 [3/937229a7-e2f3-4109-a1c5-4cd12b947e67] start: already running 2024-09-21T15:29:31.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf437eb700 -1 rbd::mirror::ImageReplayer: 0x5588f62fe500 [3/b36b8111-2b07-4cfc-b245-f5bbf9b652aa] start: already running 2024-09-21T15:29:31.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf437eb700 -1 rbd::mirror::ImageReplayer: 0x5588f5cc9400 [3/b0fe3ce8-4f26-4eba-bb52-8b3a992a11f1] start: already running 2024-09-21T15:29:31.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf437eb700 -1 rbd::mirror::ImageReplayer: 0x5588f62ff180 [3/b6899c0b-0c70-4f5e-b225-9b2d50e4b05c] start: already running 2024-09-21T15:29:31.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf437eb700 -1 rbd::mirror::ImageReplayer: 0x5588f62ff400 [3/b77b49b0-d5db-407a-b80a-648f56d5ce27] start: already running 2024-09-21T15:29:31.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf437eb700 -1 rbd::mirror::ImageReplayer: 0x5588f62ff900 [3/baa504ab-cf1a-43bc-8e31-d24f1f4d3107] start: already running 2024-09-21T15:29:31.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.309+0000 7fcf437eb700 -1 rbd::mirror::ImageReplayer: 0x5588f631f680 [3/c2f4442b-fb50-43c3-b857-324706ebb952] start: already running 2024-09-21T15:29:31.329 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.325+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f6213400 [3/96f7130e-627f-496e-8a7c-886f81d92e20] start: already running 2024-09-21T15:29:31.329 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:29:31.325+0000 7fcf50805700 -1 rbd::mirror::ImageReplayer: 0x5588f5cc9180 [3/b0959eb5-273e-4f52-8a00-24247f1f87d2] start: already running 2024-09-21T15:29:31.507 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 19% complete... Exporting image: 24% complete... Exporting image: 28% complete... Exporting image: 33% complete... Exporting image: 38% complete... Exporting image: 43% complete... Exporting image: 48% complete... Exporting image: 52% complete... Exporting image: 57% complete... Exporting image: 62% complete... Exporting image: 67% complete... Exporting image: 72% complete... Exporting image: 76% complete... Exporting image: 81% complete... Exporting image: 86% complete... Exporting image: 91% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:31.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone32@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone32.export 2024-09-21T15:29:31.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 19% complete... Exporting image: 24% complete... Exporting image: 28% complete... Exporting image: 33% complete... Exporting image: 38% complete... Exporting image: 43% complete... Exporting image: 48% complete... Exporting image: 52% complete... Exporting image: 57% complete... Exporting image: 62% complete... Exporting image: 67% complete... Exporting image: 72% complete... Exporting image: 76% complete... Exporting image: 81% complete... Exporting image: 86% complete... Exporting image: 91% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:31.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone32.export 2024-09-21T15:29:31.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:31.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone32.export 2024-09-21T15:29:31.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone32.export 2024-09-21T15:29:32.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:32.079 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone32.export 2024-09-21T15:29:32.190 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:32.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone32.export 2024-09-21T15:29:32.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone32.export 2024-09-21T15:29:32.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:32.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:32.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone33 2024-09-21T15:29:32.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:32.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone33 2024-09-21T15:29:32.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:32.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone33.export 2024-09-21T15:29:32.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone33.export 2024-09-21T15:29:32.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone33 2024-09-21T15:29:32.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:32.209 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:32.345 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:32.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone33.export 2024-09-21T15:29:32.347 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone33@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone33.export 2024-09-21T15:29:32.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 12% complete... Exporting image: 16% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 33% complete... Exporting image: 37% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 54% complete... Exporting image: 58% complete... Exporting image: 62% complete... Exporting image: 67% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 83% complete... Exporting image: 87% complete... Exporting image: 92% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:32.494 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone33@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone33.export 2024-09-21T15:29:32.657 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 12% complete... Exporting image: 16% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 33% complete... Exporting image: 37% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 54% complete... Exporting image: 58% complete... Exporting image: 62% complete... Exporting image: 67% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 83% complete... Exporting image: 87% complete... Exporting image: 92% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:32.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone33.export 2024-09-21T15:29:32.752 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:32.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone33.export 2024-09-21T15:29:32.774 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone33.export 2024-09-21T15:29:33.098 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 55% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:33.104 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone33.export 2024-09-21T15:29:33.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 55% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:33.259 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone33.export 2024-09-21T15:29:33.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone33.export 2024-09-21T15:29:33.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:33.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:33.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone34 2024-09-21T15:29:33.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:33.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone34 2024-09-21T15:29:33.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:33.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone34.export 2024-09-21T15:29:33.274 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone34.export 2024-09-21T15:29:33.275 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone34 2024-09-21T15:29:33.275 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:33.275 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:33.431 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:33.431 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone34.export 2024-09-21T15:29:33.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone34@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone34.export 2024-09-21T15:29:33.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 46% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:33.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone34@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone34.export 2024-09-21T15:29:34.097 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 46% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:34.105 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone34.export 2024-09-21T15:29:34.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:34.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone34.export 2024-09-21T15:29:34.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone34.export 2024-09-21T15:29:34.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 14% complete... Exporting image: 28% complete... Exporting image: 43% complete... Exporting image: 57% complete... Exporting image: 71% complete... Exporting image: 86% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:34.473 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone34.export 2024-09-21T15:29:34.658 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 14% complete... Exporting image: 28% complete... Exporting image: 43% complete... Exporting image: 57% complete... Exporting image: 71% complete... Exporting image: 86% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:34.667 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone34.export 2024-09-21T15:29:34.698 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone34.export 2024-09-21T15:29:34.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:34.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:34.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone35 2024-09-21T15:29:34.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:34.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone35 2024-09-21T15:29:34.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:34.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone35.export 2024-09-21T15:29:34.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone35.export 2024-09-21T15:29:34.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone35 2024-09-21T15:29:34.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:34.715 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:34.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:34.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone35.export 2024-09-21T15:29:34.790 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone35@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone35.export 2024-09-21T15:29:35.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 23% complete... Exporting image: 28% complete... Exporting image: 34% complete... Exporting image: 40% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 57% complete... Exporting image: 63% complete... Exporting image: 69% complete... Exporting image: 74% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 92% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:35.072 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone35@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone35.export 2024-09-21T15:29:35.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 23% complete... Exporting image: 28% complete... Exporting image: 34% complete... Exporting image: 40% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 57% complete... Exporting image: 63% complete... Exporting image: 69% complete... Exporting image: 74% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 92% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:35.570 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone35.export 2024-09-21T15:29:35.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:35.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone35.export 2024-09-21T15:29:35.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone35.export 2024-09-21T15:29:35.825 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:35.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone35.export 2024-09-21T15:29:35.900 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:35.907 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone35.export 2024-09-21T15:29:35.908 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone35.export 2024-09-21T15:29:35.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:35.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:35.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone36 2024-09-21T15:29:35.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:35.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone36 2024-09-21T15:29:35.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:35.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone36.export 2024-09-21T15:29:35.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone36.export 2024-09-21T15:29:35.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone36 2024-09-21T15:29:35.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:35.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:35.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:35.983 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone36.export 2024-09-21T15:29:35.983 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone36@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone36.export 2024-09-21T15:29:36.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 17% complete... Exporting image: 34% complete... Exporting image: 51% complete... Exporting image: 68% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:36.256 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone36@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone36.export 2024-09-21T15:29:36.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 17% complete... Exporting image: 34% complete... Exporting image: 51% complete... Exporting image: 68% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:36.529 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone36.export 2024-09-21T15:29:36.674 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:36.674 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone36.export 2024-09-21T15:29:36.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone36.export 2024-09-21T15:29:36.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 17% complete... Exporting image: 34% complete... Exporting image: 51% complete... Exporting image: 68% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:36.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone36.export 2024-09-21T15:29:37.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 17% complete... Exporting image: 34% complete... Exporting image: 51% complete... Exporting image: 68% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:37.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone36.export 2024-09-21T15:29:37.392 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone36.export 2024-09-21T15:29:37.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:37.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:37.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone37 2024-09-21T15:29:37.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:37.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone37 2024-09-21T15:29:37.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:37.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone37.export 2024-09-21T15:29:37.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone37.export 2024-09-21T15:29:37.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone37 2024-09-21T15:29:37.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:37.452 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:37.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:37.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone37.export 2024-09-21T15:29:37.549 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone37@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone37.export 2024-09-21T15:29:37.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 68% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:37.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone37@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone37.export 2024-09-21T15:29:38.299 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 68% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:38.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone37.export 2024-09-21T15:29:38.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:38.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone37.export 2024-09-21T15:29:38.464 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone37.export 2024-09-21T15:29:38.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:38.558 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone37.export 2024-09-21T15:29:38.654 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:38.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone37.export 2024-09-21T15:29:38.667 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone37.export 2024-09-21T15:29:38.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:38.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone38 2024-09-21T15:29:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone38 2024-09-21T15:29:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone38.export 2024-09-21T15:29:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone38.export 2024-09-21T15:29:38.674 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone38 2024-09-21T15:29:38.675 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:38.675 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:38.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:38.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone38.export 2024-09-21T15:29:38.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone38@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone38.export 2024-09-21T15:29:39.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 19% complete... Exporting image: 29% complete... Exporting image: 38% complete... Exporting image: 48% complete... Exporting image: 58% complete... Exporting image: 67% complete... Exporting image: 77% complete... Exporting image: 87% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:39.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone38@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone38.export 2024-09-21T15:29:39.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 19% complete... Exporting image: 29% complete... Exporting image: 38% complete... Exporting image: 48% complete... Exporting image: 58% complete... Exporting image: 67% complete... Exporting image: 77% complete... Exporting image: 87% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:39.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone38.export 2024-09-21T15:29:39.666 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:39.667 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone38.export 2024-09-21T15:29:39.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone38.export 2024-09-21T15:29:39.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 74% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:39.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone38.export 2024-09-21T15:29:40.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 74% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:40.061 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone38.export 2024-09-21T15:29:40.087 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone38.export 2024-09-21T15:29:40.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:40.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:40.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone39 2024-09-21T15:29:40.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:40.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone39 2024-09-21T15:29:40.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:40.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone39.export 2024-09-21T15:29:40.100 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone39.export 2024-09-21T15:29:40.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone39 2024-09-21T15:29:40.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:40.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:40.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:40.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone39.export 2024-09-21T15:29:40.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone39@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone39.export 2024-09-21T15:29:41.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:41.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone39@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone39.export 2024-09-21T15:29:43.614 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:43.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone39.export 2024-09-21T15:29:44.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:44.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone39.export 2024-09-21T15:29:44.210 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone39.export 2024-09-21T15:29:44.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:45.081 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone39.export 2024-09-21T15:29:45.153 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:45.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone39.export 2024-09-21T15:29:45.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone39.export 2024-09-21T15:29:45.164 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:45.164 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:45.164 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone4 2024-09-21T15:29:45.164 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:45.164 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone4 2024-09-21T15:29:45.164 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:45.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone4.export 2024-09-21T15:29:45.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone4.export 2024-09-21T15:29:45.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone4 2024-09-21T15:29:45.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:45.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:45.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:45.445 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone4.export 2024-09-21T15:29:45.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone4@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone4.export 2024-09-21T15:29:45.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 61% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:45.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone4@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone4.export 2024-09-21T15:29:46.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 61% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:46.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone4.export 2024-09-21T15:29:46.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:46.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone4.export 2024-09-21T15:29:46.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone4.export 2024-09-21T15:29:47.459 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:47.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone4.export 2024-09-21T15:29:47.696 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:47.705 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone4.export 2024-09-21T15:29:47.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone4.export 2024-09-21T15:29:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone40 2024-09-21T15:29:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone40 2024-09-21T15:29:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:47.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone40.export 2024-09-21T15:29:47.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone40.export 2024-09-21T15:29:47.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone40 2024-09-21T15:29:47.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:47.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:48.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:48.004 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone40.export 2024-09-21T15:29:48.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone40@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone40.export 2024-09-21T15:29:49.639 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:49.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone40@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone40.export 2024-09-21T15:29:51.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:51.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone40.export 2024-09-21T15:29:51.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:51.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone40.export 2024-09-21T15:29:51.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone40.export 2024-09-21T15:29:52.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:52.746 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone40.export 2024-09-21T15:29:53.576 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:53.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone40.export 2024-09-21T15:29:53.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone40.export 2024-09-21T15:29:53.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:53.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:53.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone41 2024-09-21T15:29:53.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:53.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone41 2024-09-21T15:29:53.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:53.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone41.export 2024-09-21T15:29:53.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone41.export 2024-09-21T15:29:53.670 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone41 2024-09-21T15:29:53.670 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:53.670 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:53.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:53.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone41.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone41.export 2024-09-21T15:29:53.837 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone41@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone41.export 2024-09-21T15:29:54.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 11% complete... Exporting image: 22% complete... Exporting image: 33% complete... Exporting image: 44% complete... Exporting image: 56% complete... Exporting image: 67% complete... Exporting image: 78% complete... Exporting image: 89% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:54.186 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone41@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone41.export 2024-09-21T15:29:54.291 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:29:54.291 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:29:54.291 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:29:54.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.296+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae1a0 2024-09-21T15:29:54.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.296+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:29:54.301 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.296+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:29:54.307 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.300+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae9c0 2024-09-21T15:29:54.309 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.304+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30d00 2024-09-21T15:29:54.309 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.304+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30ea0 2024-09-21T15:29:54.314 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.308+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6820 2024-09-21T15:29:54.319 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.312+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:29:54.319 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.312+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:29:54.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.316+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:29:54.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.316+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:29:54.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.316+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692340 2024-09-21T15:29:54.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.316+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:29:54.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.316+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:29:54.321 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.316+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:29:54.325 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.320+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:29:54.325 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.320+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:29:54.325 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.320+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:29:54.325 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:54.320+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:29:54.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 11% complete... Exporting image: 22% complete... Exporting image: 33% complete... Exporting image: 44% complete... Exporting image: 56% complete... Exporting image: 67% complete... Exporting image: 78% complete... Exporting image: 89% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:54.579 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone41.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone41.export 2024-09-21T15:29:54.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:54.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone41.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone41.export 2024-09-21T15:29:54.786 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone41@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone41.export 2024-09-21T15:29:54.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:54.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone41@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone41.export 2024-09-21T15:29:55.160 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:55.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone41.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone41.export 2024-09-21T15:29:55.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone41.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone41.export 2024-09-21T15:29:55.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:55.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:55.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone42 2024-09-21T15:29:55.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:55.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone42 2024-09-21T15:29:55.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:55.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone42.export 2024-09-21T15:29:55.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone42.export 2024-09-21T15:29:55.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone42 2024-09-21T15:29:55.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:55.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:55.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:55.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone42.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone42.export 2024-09-21T15:29:55.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone42@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone42.export 2024-09-21T15:29:55.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:55.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone42@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone42.export 2024-09-21T15:29:55.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:55.770 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone42.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone42.export 2024-09-21T15:29:55.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:55.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone42.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone42.export 2024-09-21T15:29:56.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone42@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone42.export 2024-09-21T15:29:56.057 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:56.064 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone42@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone42.export 2024-09-21T15:29:56.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:56.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone42.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone42.export 2024-09-21T15:29:56.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone42.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone42.export 2024-09-21T15:29:56.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:56.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:56.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone43 2024-09-21T15:29:56.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:56.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone43 2024-09-21T15:29:56.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:56.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone43.export 2024-09-21T15:29:56.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone43.export 2024-09-21T15:29:56.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone43 2024-09-21T15:29:56.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:56.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:56.211 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:56.211 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone43.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone43.export 2024-09-21T15:29:56.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone43@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone43.export 2024-09-21T15:29:56.542 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 27% complete... Exporting image: 34% complete... Exporting image: 41% complete... Exporting image: 48% complete... Exporting image: 55% complete... Exporting image: 62% complete... Exporting image: 69% complete... Exporting image: 76% complete... Exporting image: 83% complete... Exporting image: 90% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:56.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone43@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone43.export 2024-09-21T15:29:56.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 27% complete... Exporting image: 34% complete... Exporting image: 41% complete... Exporting image: 48% complete... Exporting image: 55% complete... Exporting image: 62% complete... Exporting image: 69% complete... Exporting image: 76% complete... Exporting image: 83% complete... Exporting image: 90% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:29:56.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone43.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone43.export 2024-09-21T15:29:57.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:57.106 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone43.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone43.export 2024-09-21T15:29:57.157 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone43@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone43.export 2024-09-21T15:29:57.215 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:57.219 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone43@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone43.export 2024-09-21T15:29:57.280 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:57.287 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone43.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone43.export 2024-09-21T15:29:57.289 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone43.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone43.export 2024-09-21T15:29:57.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:57.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:57.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone44 2024-09-21T15:29:57.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:57.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone44 2024-09-21T15:29:57.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:57.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone44.export 2024-09-21T15:29:57.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone44.export 2024-09-21T15:29:57.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone44 2024-09-21T15:29:57.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:57.292 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:57.538 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:57.538 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone44.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone44.export 2024-09-21T15:29:57.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone44@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone44.export 2024-09-21T15:29:57.784 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.778+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67040 2024-09-21T15:29:57.810 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.802+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67ee0 2024-09-21T15:29:57.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.806+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f6340 2024-09-21T15:29:57.812 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.806+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f6b60 2024-09-21T15:29:57.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.806+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7860 2024-09-21T15:29:57.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.806+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:29:57.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.806+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:29:57.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.806+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1ba0 2024-09-21T15:29:57.813 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.806+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:29:57.818 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:29:57.818 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9c270 2024-09-21T15:29:57.818 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9cc30 2024-09-21T15:29:57.818 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:29:57.818 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:29:57.818 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:29:57.818 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288000 2024-09-21T15:29:57.818 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2881a0 2024-09-21T15:29:57.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288c30 2024-09-21T15:29:57.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:29:57.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289ee0 2024-09-21T15:29:57.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf9d40 2024-09-21T15:29:57.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:29:57.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:29:57.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68dd0 2024-09-21T15:29:57.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68ea0 2024-09-21T15:29:57.819 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69860 2024-09-21T15:29:57.820 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:29:57.820 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.810+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af310dd0 2024-09-21T15:29:57.822 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.814+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:29:57.822 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.814+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:29:57.822 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.814+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:29:57.823 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.814+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:29:57.823 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.814+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57c70 2024-09-21T15:29:57.827 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:29:57.827 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:29:57.827 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:29:57.828 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:29:57.828 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:29:57.828 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676750 2024-09-21T15:29:57.828 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36776c0 2024-09-21T15:29:57.828 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677e10 2024-09-21T15:29:57.828 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2340 2024-09-21T15:29:57.828 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.818+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2ea0 2024-09-21T15:29:57.831 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.822+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:29:57.831 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.822+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:29:57.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:57.941 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone44@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone44.export 2024-09-21T15:29:57.963 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:29:57.954+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:29:58.387 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:58.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone44.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone44.export 2024-09-21T15:29:58.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:58.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone44.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone44.export 2024-09-21T15:29:58.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone44@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone44.export 2024-09-21T15:29:58.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:58.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone44@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone44.export 2024-09-21T15:29:59.241 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.232+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b450f70 2024-09-21T15:29:59.249 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.244+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c213380 2024-09-21T15:29:59.258 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.248+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c7b6340 2024-09-21T15:29:59.261 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.256+0000 7f52f1ba9700 -1 reset not still connected to 0x55713d823ee0 2024-09-21T15:29:59.261 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.256+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da800d0 2024-09-21T15:29:59.271 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.256+0000 7f52f1ba9700 -1 reset not still connected to 0x55713da81ba0 2024-09-21T15:29:59.272 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.264+0000 7f52f1ba9700 -1 reset not still connected to 0x55713dae09c0 2024-09-21T15:29:59.272 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.264+0000 7f52f1ba9700 -1 reset not still connected to 0x55713df81ba0 2024-09-21T15:29:59.273 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.268+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cdad0 2024-09-21T15:29:59.274 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.268+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ea58dd0 2024-09-21T15:29:59.274 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.268+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ef80410 2024-09-21T15:29:59.274 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.268+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4410 2024-09-21T15:29:59.274 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.268+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4a90 2024-09-21T15:29:59.274 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.268+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5790 2024-09-21T15:29:59.274 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.268+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:29:59.274 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.268+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:29:59.274 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.268+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:29:59.276 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.268+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cea0 2024-09-21T15:29:59.276 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.268+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dee0 2024-09-21T15:29:59.276 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.268+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed01a0 2024-09-21T15:29:59.276 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.268+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed1930 2024-09-21T15:29:59.288 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16b60 2024-09-21T15:29:59.288 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17040 2024-09-21T15:29:59.288 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17d40 2024-09-21T15:29:59.288 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bb0000 2024-09-21T15:29:59.288 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:29:59.289 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbad00 2024-09-21T15:29:59.289 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb110 2024-09-21T15:29:59.289 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb1e0 2024-09-21T15:29:59.289 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:29:59.289 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:29:59.289 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0340 2024-09-21T15:29:59.289 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0dd0 2024-09-21T15:29:59.289 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0f70 2024-09-21T15:29:59.289 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a9c0 2024-09-21T15:29:59.289 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.280+0000 7f52f1ba9700 -1 reset not still connected to 0x5571426288f0 2024-09-21T15:29:59.290 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.284+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:29:59.290 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.284+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:29:59.290 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.284+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb85b0 2024-09-21T15:29:59.290 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.284+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8680 2024-09-21T15:29:59.290 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.284+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb91e0 2024-09-21T15:29:59.290 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.284+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:29:59.294 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.288+0000 7f52f1ba9700 -1 reset not still connected to 0x557143600c30 2024-09-21T15:29:59.314 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.304+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601040 2024-09-21T15:29:59.314 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.304+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601110 2024-09-21T15:29:59.314 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.304+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601c70 2024-09-21T15:29:59.314 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.304+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76820 2024-09-21T15:29:59.315 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76f70 2024-09-21T15:29:59.315 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77380 2024-09-21T15:29:59.315 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b776c0 2024-09-21T15:29:59.315 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77a00 2024-09-21T15:29:59.315 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77c70 2024-09-21T15:29:59.315 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557143bf5450 2024-09-21T15:29:59.315 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a270 2024-09-21T15:29:59.315 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a340 2024-09-21T15:29:59.315 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456c9c0 2024-09-21T15:29:59.315 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456ca90 2024-09-21T15:29:59.320 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456d450 2024-09-21T15:29:59.320 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af6c30 2024-09-21T15:29:59.320 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af7930 2024-09-21T15:29:59.320 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af7ad0 2024-09-21T15:29:59.320 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f520 2024-09-21T15:29:59.320 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765e10 2024-09-21T15:29:59.320 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x5571472268f0 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x5571480005b0 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012ea0 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013790 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013930 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bba0 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bc70 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a820 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29ad00 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29b110 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29bd40 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29be10 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1040 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1380 2024-09-21T15:29:59.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1450 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1520 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1860 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1930 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1ba0 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1d40 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3520 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3ad0 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3c70 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad740d0 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74340 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74820 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74ea0 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad751e0 2024-09-21T15:29:59.322 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad75450 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad75ad0 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07e750 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07ed00 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f6c0 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f860 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07fe10 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124000 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1241a0 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124680 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124820 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1252b0 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b125520 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b125ba0 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714c0c1ad0 2024-09-21T15:29:59.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe1a0 2024-09-21T15:29:59.324 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe270 2024-09-21T15:29:59.324 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe680 2024-09-21T15:29:59.324 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe8f0 2024-09-21T15:29:59.324 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe9c0 2024-09-21T15:29:59.324 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ff1e0 2024-09-21T15:29:59.324 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ff5f0 2024-09-21T15:29:59.324 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb12dd0 2024-09-21T15:29:59.324 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13040 2024-09-21T15:29:59.324 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:29:59.308+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb136c0 2024-09-21T15:29:59.379 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.372+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d9c70 2024-09-21T15:29:59.388 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.384+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:29:59.408 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.400+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:29:59.410 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:29:59.418 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.416+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:29:59.433 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.420+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47ee0 2024-09-21T15:29:59.444 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.440+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83716c0 2024-09-21T15:29:59.444 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.440+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83864e0 2024-09-21T15:29:59.444 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.440+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a5b0 2024-09-21T15:29:59.444 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.440+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:29:59.444 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.440+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:29:59.444 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.440+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cdad0 2024-09-21T15:29:59.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.448+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:29:59.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.448+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0ea0 2024-09-21T15:29:59.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.448+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c12b0 2024-09-21T15:29:59.455 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.448+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:29:59.455 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.448+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1651e0 2024-09-21T15:29:59.455 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.452+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:29:59.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.452+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5860 2024-09-21T15:29:59.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.452+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:29:59.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.452+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:29:59.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.452+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d9ba0 2024-09-21T15:29:59.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.452+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:29:59.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.452+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35d450 2024-09-21T15:29:59.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.452+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35dc70 2024-09-21T15:29:59.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.452+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:29:59.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.452+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:29:59.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.452+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:29:59.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.452+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:29:59.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.452+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:29:59.466 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5380 2024-09-21T15:29:59.466 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:29:59.466 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5c70 2024-09-21T15:29:59.467 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:29:59.467 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:29:59.467 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:29:59.467 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:29:59.474 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.468+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:29:59.475 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.468+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:29:59.475 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.468+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:29:59.475 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.468+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:29:59.475 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.468+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53040 2024-09-21T15:29:59.475 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.468+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:29:59.475 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.468+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:29:59.475 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.468+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ec30 2024-09-21T15:29:59.475 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.468+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:29:59.476 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:29:59.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:29:59.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b450 2024-09-21T15:29:59.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:29:59.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:29:59.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:29:59.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:29:59.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:29:59.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:29:59.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:29:59.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:29:59.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:29:59.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae1a0 2024-09-21T15:29:59.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:29:59.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:29:59.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae9c0 2024-09-21T15:29:59.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30d00 2024-09-21T15:29:59.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30ea0 2024-09-21T15:29:59.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:29:59.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:29:59.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:29:59.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:29:59.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692340 2024-09-21T15:29:59.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:29:59.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:29:59.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:29:59.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:29:59.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:29:59.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:29:59.625 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:29:59.633 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone44.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone44.export 2024-09-21T15:29:59.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone44.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone44.export 2024-09-21T15:29:59.797 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:29:59.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:29:59.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone45 2024-09-21T15:29:59.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:29:59.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone45 2024-09-21T15:29:59.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:29:59.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone45.export 2024-09-21T15:29:59.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone45.export 2024-09-21T15:29:59.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone45 2024-09-21T15:29:59.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:29:59.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:29:59.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:29:59.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone45.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone45.export 2024-09-21T15:29:59.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone45@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone45.export 2024-09-21T15:30:00.213 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 25% complete... Exporting image: 37% complete... Exporting image: 50% complete... Exporting image: 63% complete... Exporting image: 75% complete... Exporting image: 88% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:00.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone45@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone45.export 2024-09-21T15:30:00.625 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 25% complete... Exporting image: 37% complete... Exporting image: 50% complete... Exporting image: 63% complete... Exporting image: 75% complete... Exporting image: 88% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:00.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone45.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone45.export 2024-09-21T15:30:00.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:00.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone45.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone45.export 2024-09-21T15:30:00.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone45@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone45.export 2024-09-21T15:30:00.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:00.900 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone45@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone45.export 2024-09-21T15:30:00.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:00.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone45.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone45.export 2024-09-21T15:30:00.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone45.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone45.export 2024-09-21T15:30:00.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:00.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:00.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone46 2024-09-21T15:30:00.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:00.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone46 2024-09-21T15:30:00.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:00.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone46.export 2024-09-21T15:30:00.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone46.export 2024-09-21T15:30:00.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone46 2024-09-21T15:30:00.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:00.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:01.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:01.050 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone46.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone46.export 2024-09-21T15:30:01.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone46@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone46.export 2024-09-21T15:30:01.216 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 26% complete... Exporting image: 33% complete... Exporting image: 40% complete... Exporting image: 46% complete... Exporting image: 53% complete... Exporting image: 60% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:01.224 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone46@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone46.export 2024-09-21T15:30:01.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 26% complete... Exporting image: 33% complete... Exporting image: 40% complete... Exporting image: 46% complete... Exporting image: 53% complete... Exporting image: 60% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:01.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone46.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone46.export 2024-09-21T15:30:01.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:01.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone46.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone46.export 2024-09-21T15:30:01.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone46@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone46.export 2024-09-21T15:30:01.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 26% complete... Exporting image: 33% complete... Exporting image: 40% complete... Exporting image: 46% complete... Exporting image: 53% complete... Exporting image: 60% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:01.770 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone46@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone46.export 2024-09-21T15:30:01.924 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 20% complete... Exporting image: 26% complete... Exporting image: 33% complete... Exporting image: 40% complete... Exporting image: 46% complete... Exporting image: 53% complete... Exporting image: 60% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:01.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone46.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone46.export 2024-09-21T15:30:02.093 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone46.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone46.export 2024-09-21T15:30:02.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:02.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:02.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone47 2024-09-21T15:30:02.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:02.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone47 2024-09-21T15:30:02.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:02.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone47.export 2024-09-21T15:30:02.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone47.export 2024-09-21T15:30:02.132 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone47 2024-09-21T15:30:02.132 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:02.132 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:02.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:02.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone47.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone47.export 2024-09-21T15:30:02.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone47@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone47.export 2024-09-21T15:30:02.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:02.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone47@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone47.export 2024-09-21T15:30:02.488 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:02.493 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone47.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone47.export 2024-09-21T15:30:02.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:02.665 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone47.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone47.export 2024-09-21T15:30:02.696 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone47@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone47.export 2024-09-21T15:30:02.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:02.779 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone47@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone47.export 2024-09-21T15:30:02.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:02.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone47.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone47.export 2024-09-21T15:30:02.881 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone47.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone47.export 2024-09-21T15:30:02.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:02.884 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:02.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone48 2024-09-21T15:30:02.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:02.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone48 2024-09-21T15:30:02.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:02.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone48.export 2024-09-21T15:30:02.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone48.export 2024-09-21T15:30:02.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone48 2024-09-21T15:30:02.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:02.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:03.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:03.002 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone48.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone48.export 2024-09-21T15:30:03.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone48@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone48.export 2024-09-21T15:30:03.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 47% complete... Exporting image: 55% complete... Exporting image: 63% complete... Exporting image: 70% complete... Exporting image: 78% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:03.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone48@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone48.export 2024-09-21T15:30:03.484 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 47% complete... Exporting image: 55% complete... Exporting image: 63% complete... Exporting image: 70% complete... Exporting image: 78% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:03.491 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone48.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone48.export 2024-09-21T15:30:03.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:03.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone48.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone48.export 2024-09-21T15:30:03.585 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone48@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone48.export 2024-09-21T15:30:03.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 41% complete... Exporting image: 62% complete... Exporting image: 83% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:03.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone48@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone48.export 2024-09-21T15:30:03.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 41% complete... Exporting image: 62% complete... Exporting image: 83% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:03.950 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone48.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone48.export 2024-09-21T15:30:03.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone48.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone48.export 2024-09-21T15:30:03.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:03.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:03.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone49 2024-09-21T15:30:03.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:03.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone49 2024-09-21T15:30:03.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:03.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone49.export 2024-09-21T15:30:03.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone49.export 2024-09-21T15:30:03.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone49 2024-09-21T15:30:03.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:03.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:04.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:04.126 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone49.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone49.export 2024-09-21T15:30:04.127 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone49@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone49.export 2024-09-21T15:30:04.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 21% complete... Exporting image: 28% complete... Exporting image: 36% complete... Exporting image: 43% complete... Exporting image: 50% complete... Exporting image: 57% complete... Exporting image: 65% complete... Exporting image: 72% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:04.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone49@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone49.export 2024-09-21T15:30:05.057 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 21% complete... Exporting image: 28% complete... Exporting image: 36% complete... Exporting image: 43% complete... Exporting image: 50% complete... Exporting image: 57% complete... Exporting image: 65% complete... Exporting image: 72% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:05.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone49.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone49.export 2024-09-21T15:30:05.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:05.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone49.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone49.export 2024-09-21T15:30:05.233 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone49@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone49.export 2024-09-21T15:30:05.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 21% complete... Exporting image: 43% complete... Exporting image: 65% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:05.596 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone49@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone49.export 2024-09-21T15:30:05.926 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 21% complete... Exporting image: 43% complete... Exporting image: 65% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:05.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone49.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone49.export 2024-09-21T15:30:05.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone49.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone49.export 2024-09-21T15:30:05.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:05.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:05.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone5 2024-09-21T15:30:05.987 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:05.987 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone5 2024-09-21T15:30:05.987 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:05.987 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone5.export 2024-09-21T15:30:05.987 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone5.export 2024-09-21T15:30:05.987 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone5 2024-09-21T15:30:05.987 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:05.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:06.372 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:06.372 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone5.export 2024-09-21T15:30:06.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone5@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone5.export 2024-09-21T15:30:06.624 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:06.633 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone5@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone5.export 2024-09-21T15:30:06.948 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:06.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone5.export 2024-09-21T15:30:07.138 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:07.138 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone5.export 2024-09-21T15:30:07.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone5.export 2024-09-21T15:30:07.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 16% complete... Exporting image: 33% complete... Exporting image: 50% complete... Exporting image: 67% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:07.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone5.export 2024-09-21T15:30:07.522 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 16% complete... Exporting image: 33% complete... Exporting image: 50% complete... Exporting image: 67% complete... Exporting image: 84% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:07.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone5.export 2024-09-21T15:30:07.556 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone5.export 2024-09-21T15:30:07.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:07.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:07.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone50 2024-09-21T15:30:07.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:07.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone50 2024-09-21T15:30:07.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:07.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone50.export 2024-09-21T15:30:07.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone50.export 2024-09-21T15:30:07.565 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:07.565 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone50 2024-09-21T15:30:07.565 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:07.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:07.638 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone50.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone50.export 2024-09-21T15:30:07.638 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone50@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone50.export 2024-09-21T15:30:07.746 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 47% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:07.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone50@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone50.export 2024-09-21T15:30:07.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 47% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:07.881 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone50.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone50.export 2024-09-21T15:30:07.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:07.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone50.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone50.export 2024-09-21T15:30:07.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone50@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone50.export 2024-09-21T15:30:08.038 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 47% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:08.046 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone50@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone50.export 2024-09-21T15:30:08.371 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 47% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:08.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone50.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone50.export 2024-09-21T15:30:08.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone50.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone50.export 2024-09-21T15:30:08.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:08.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:08.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone51 2024-09-21T15:30:08.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:08.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone51 2024-09-21T15:30:08.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:08.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone51.export 2024-09-21T15:30:08.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone51.export 2024-09-21T15:30:08.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone51 2024-09-21T15:30:08.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:08.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:08.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:08.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone51.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone51.export 2024-09-21T15:30:08.494 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone51@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone51.export 2024-09-21T15:30:08.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 18% complete... Exporting image: 23% complete... Exporting image: 28% complete... Exporting image: 32% complete... Exporting image: 37% complete... Exporting image: 42% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 56% complete... Exporting image: 60% complete... Exporting image: 65% complete... Exporting image: 70% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 84% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:08.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone51@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone51.export 2024-09-21T15:30:08.787 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 18% complete... Exporting image: 23% complete... Exporting image: 28% complete... Exporting image: 32% complete... Exporting image: 37% complete... Exporting image: 42% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 56% complete... Exporting image: 60% complete... Exporting image: 65% complete... Exporting image: 70% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 84% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:08.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone51.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone51.export 2024-09-21T15:30:08.938 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:08.939 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone51.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone51.export 2024-09-21T15:30:08.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone51@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone51.export 2024-09-21T15:30:09.099 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 18% complete... Exporting image: 23% complete... Exporting image: 28% complete... Exporting image: 32% complete... Exporting image: 37% complete... Exporting image: 42% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 56% complete... Exporting image: 60% complete... Exporting image: 65% complete... Exporting image: 70% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 84% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:09.104 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone51@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone51.export 2024-09-21T15:30:09.271 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.264+0000 7f52f1ba9700 -1 reset not still connected to 0x55713b450f70 2024-09-21T15:30:09.272 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.268+0000 7f52f1ba9700 -1 reset not still connected to 0x55713c213380 2024-09-21T15:30:09.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 18% complete... Exporting image: 23% complete... Exporting image: 28% complete... Exporting image: 32% complete... Exporting image: 37% complete... Exporting image: 42% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 56% complete... Exporting image: 60% complete... Exporting image: 65% complete... Exporting image: 70% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 84% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:09.321 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.304+0000 7f52f1ba9700 -1 reset not still connected to 0x55713e9cdad0 2024-09-21T15:30:09.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.312+0000 7f52f1ba9700 -1 reset not still connected to 0x55713ef80410 2024-09-21T15:30:09.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.312+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4410 2024-09-21T15:30:09.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.312+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e4a90 2024-09-21T15:30:09.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.312+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f4e5790 2024-09-21T15:30:09.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.312+0000 7f52f1ba9700 -1 reset not still connected to 0x55713f5004e0 2024-09-21T15:30:09.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.312+0000 7f52f1ba9700 -1 reset not still connected to 0x55713fb25040 2024-09-21T15:30:09.323 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.312+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034c5b0 2024-09-21T15:30:09.323 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone51.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone51.export 2024-09-21T15:30:09.345 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.336+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034cea0 2024-09-21T15:30:09.345 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.336+0000 7f52f1ba9700 -1 reset not still connected to 0x55714034dee0 2024-09-21T15:30:09.347 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x557140ed1930 2024-09-21T15:30:09.347 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x5571412f55f0 2024-09-21T15:30:09.347 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b16b60 2024-09-21T15:30:09.347 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17040 2024-09-21T15:30:09.347 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x557141b17d40 2024-09-21T15:30:09.348 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbac30 2024-09-21T15:30:09.348 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbad00 2024-09-21T15:30:09.348 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb110 2024-09-21T15:30:09.348 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb1e0 2024-09-21T15:30:09.348 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbb860 2024-09-21T15:30:09.348 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x557141bbbd40 2024-09-21T15:30:09.348 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0340 2024-09-21T15:30:09.348 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x557141ef0dd0 2024-09-21T15:30:09.349 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x55714232a9c0 2024-09-21T15:30:09.349 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x5571426288f0 2024-09-21T15:30:09.349 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.340+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb80d0 2024-09-21T15:30:09.362 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.348+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8270 2024-09-21T15:30:09.364 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.348+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb84e0 2024-09-21T15:30:09.364 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.348+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb8680 2024-09-21T15:30:09.367 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb91e0 2024-09-21T15:30:09.367 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557142eb9380 2024-09-21T15:30:09.367 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557143600c30 2024-09-21T15:30:09.367 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557143600ea0 2024-09-21T15:30:09.367 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601110 2024-09-21T15:30:09.367 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557143601c70 2024-09-21T15:30:09.367 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76820 2024-09-21T15:30:09.367 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b76f70 2024-09-21T15:30:09.367 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77380 2024-09-21T15:30:09.367 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b776c0 2024-09-21T15:30:09.367 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77a00 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557143b77c70 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557143bf5450 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a270 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714417a340 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456c9c0 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456ca90 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714456d450 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af6c30 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af7930 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557145af7ad0 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557145f4f520 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557146765e10 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x5571472268f0 2024-09-21T15:30:09.368 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x5571480005b0 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012ea0 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013790 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x557148013930 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bba0 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bc70 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a820 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29ad00 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29b110 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29bd40 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29be10 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1040 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1380 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1450 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1520 2024-09-21T15:30:09.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.352+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1860 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1930 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1d40 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3c70 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad740d0 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74340 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74820 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74ea0 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad751e0 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad75ad0 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07e750 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07ed00 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f6c0 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f860 2024-09-21T15:30:09.370 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124000 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1241a0 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124680 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124820 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1252b0 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b125520 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b125ba0 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714c0c1ad0 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe1a0 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe270 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe680 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe8f0 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe9c0 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ff1e0 2024-09-21T15:30:09.371 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ff5f0 2024-09-21T15:30:09.372 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb12dd0 2024-09-21T15:30:09.372 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13040 2024-09-21T15:30:09.372 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:30:09.356+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb136c0 2024-09-21T15:30:09.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone51.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone51.export 2024-09-21T15:30:09.570 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:09.570 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:09.570 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone52 2024-09-21T15:30:09.570 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:09.570 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone52 2024-09-21T15:30:09.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:09.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone52.export 2024-09-21T15:30:09.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone52.export 2024-09-21T15:30:09.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone52 2024-09-21T15:30:09.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:09.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:09.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:09.638 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone52.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone52.export 2024-09-21T15:30:09.639 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone52@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone52.export 2024-09-21T15:30:09.723 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:09.728 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone52@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone52.export 2024-09-21T15:30:09.814 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:09.820 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone52.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone52.export 2024-09-21T15:30:09.866 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:09.866 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone52.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone52.export 2024-09-21T15:30:09.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone52@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone52.export 2024-09-21T15:30:09.958 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:09.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone52@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone52.export 2024-09-21T15:30:10.051 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:10.057 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone52.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone52.export 2024-09-21T15:30:10.102 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone52.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone52.export 2024-09-21T15:30:10.118 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:10.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:10.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone53 2024-09-21T15:30:10.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:10.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone53 2024-09-21T15:30:10.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:10.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone53.export 2024-09-21T15:30:10.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone53.export 2024-09-21T15:30:10.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone53 2024-09-21T15:30:10.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:10.120 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:10.186 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:10.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone53.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone53.export 2024-09-21T15:30:10.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone53@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone53.export 2024-09-21T15:30:10.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 23% complete... Exporting image: 29% complete... Exporting image: 35% complete... Exporting image: 41% complete... Exporting image: 47% complete... Exporting image: 53% complete... Exporting image: 59% complete... Exporting image: 65% complete... Exporting image: 71% complete... Exporting image: 77% complete... Exporting image: 83% complete... Exporting image: 89% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:10.364 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone53@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone53.export 2024-09-21T15:30:10.537 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 23% complete... Exporting image: 29% complete... Exporting image: 35% complete... Exporting image: 41% complete... Exporting image: 47% complete... Exporting image: 53% complete... Exporting image: 59% complete... Exporting image: 65% complete... Exporting image: 71% complete... Exporting image: 77% complete... Exporting image: 83% complete... Exporting image: 89% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:10.541 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone53.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone53.export 2024-09-21T15:30:10.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:10.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone53.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone53.export 2024-09-21T15:30:10.752 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone53@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone53.export 2024-09-21T15:30:10.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 23% complete... Exporting image: 29% complete... Exporting image: 35% complete... Exporting image: 41% complete... Exporting image: 47% complete... Exporting image: 53% complete... Exporting image: 59% complete... Exporting image: 65% complete... Exporting image: 71% complete... Exporting image: 77% complete... Exporting image: 83% complete... Exporting image: 89% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:10.899 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone53@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone53.export 2024-09-21T15:30:11.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 23% complete... Exporting image: 29% complete... Exporting image: 35% complete... Exporting image: 41% complete... Exporting image: 47% complete... Exporting image: 53% complete... Exporting image: 59% complete... Exporting image: 65% complete... Exporting image: 71% complete... Exporting image: 77% complete... Exporting image: 83% complete... Exporting image: 89% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:11.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone53.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone53.export 2024-09-21T15:30:11.244 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone53.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone53.export 2024-09-21T15:30:11.284 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:11.284 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:11.284 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone54 2024-09-21T15:30:11.284 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:11.284 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone54 2024-09-21T15:30:11.284 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:11.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone54.export 2024-09-21T15:30:11.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone54.export 2024-09-21T15:30:11.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone54 2024-09-21T15:30:11.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:11.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:11.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:11.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone54.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone54.export 2024-09-21T15:30:11.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone54@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone54.export 2024-09-21T15:30:11.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:11.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone54@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone54.export 2024-09-21T15:30:11.580 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:11.585 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone54.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone54.export 2024-09-21T15:30:11.726 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:11.726 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone54.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone54.export 2024-09-21T15:30:11.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone54@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone54.export 2024-09-21T15:30:11.860 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:11.866 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone54@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone54.export 2024-09-21T15:30:11.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:11.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone54.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone54.export 2024-09-21T15:30:12.130 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone54.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone54.export 2024-09-21T15:30:12.153 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:12.153 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:12.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone55 2024-09-21T15:30:12.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:12.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone55 2024-09-21T15:30:12.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:12.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone55.export 2024-09-21T15:30:12.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone55.export 2024-09-21T15:30:12.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone55 2024-09-21T15:30:12.155 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:12.155 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:12.224 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:12.224 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone55.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone55.export 2024-09-21T15:30:12.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone55@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone55.export 2024-09-21T15:30:12.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:12.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone55@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone55.export 2024-09-21T15:30:12.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:12.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone55.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone55.export 2024-09-21T15:30:12.667 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:12.667 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone55.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone55.export 2024-09-21T15:30:12.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone55@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone55.export 2024-09-21T15:30:12.805 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:12.813 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone55@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone55.export 2024-09-21T15:30:12.928 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:12.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone55.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone55.export 2024-09-21T15:30:13.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone55.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone55.export 2024-09-21T15:30:13.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:13.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:13.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone56 2024-09-21T15:30:13.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:13.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone56 2024-09-21T15:30:13.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:13.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone56.export 2024-09-21T15:30:13.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone56.export 2024-09-21T15:30:13.166 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone56 2024-09-21T15:30:13.166 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:13.166 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:13.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:13.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone56.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone56.export 2024-09-21T15:30:13.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone56@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone56.export 2024-09-21T15:30:13.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 19% complete... Exporting image: 29% complete... Exporting image: 39% complete... Exporting image: 49% complete... Exporting image: 58% complete... Exporting image: 68% complete... Exporting image: 78% complete... Exporting image: 88% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:13.426 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone56@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone56.export 2024-09-21T15:30:13.612 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 19% complete... Exporting image: 29% complete... Exporting image: 39% complete... Exporting image: 49% complete... Exporting image: 58% complete... Exporting image: 68% complete... Exporting image: 78% complete... Exporting image: 88% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:13.618 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone56.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone56.export 2024-09-21T15:30:13.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:13.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone56.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone56.export 2024-09-21T15:30:13.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone56@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone56.export 2024-09-21T15:30:13.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:13.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone56@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone56.export 2024-09-21T15:30:13.869 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:13.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone56.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone56.export 2024-09-21T15:30:13.876 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone56.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone56.export 2024-09-21T15:30:13.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:13.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:13.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone57 2024-09-21T15:30:13.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:13.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone57 2024-09-21T15:30:13.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:13.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone57.export 2024-09-21T15:30:13.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone57.export 2024-09-21T15:30:13.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone57 2024-09-21T15:30:13.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:13.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:13.952 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:13.952 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone57.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone57.export 2024-09-21T15:30:13.954 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone57@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone57.export 2024-09-21T15:30:14.054 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 19% complete... Exporting image: 39% complete... Exporting image: 58% complete... Exporting image: 78% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:14.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone57@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone57.export 2024-09-21T15:30:14.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 19% complete... Exporting image: 39% complete... Exporting image: 58% complete... Exporting image: 78% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:14.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone57.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone57.export 2024-09-21T15:30:14.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone57.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone57.export 2024-09-21T15:30:14.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:14.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:14.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone6 2024-09-21T15:30:14.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:14.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone6 2024-09-21T15:30:14.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:14.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone6.export 2024-09-21T15:30:14.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone6.export 2024-09-21T15:30:14.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:14.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:14.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone6 2024-09-21T15:30:14.283 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:30:14.283 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:30:14.286 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:30:14.286 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:30:14.286 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:30:14.286 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:30:14.286 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:30:14.286 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:30:14.286 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:30:14.287 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:30:14.287 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.276+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:30:14.287 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.280+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47f930 2024-09-21T15:30:14.287 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.280+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc9c0 2024-09-21T15:30:14.287 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.280+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:30:14.287 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.280+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:30:14.288 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.280+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:30:14.288 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.280+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:30:14.289 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.280+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:30:14.290 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:30:14.290 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:30:14.291 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:30:14.291 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:30:14.291 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.284+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:30:14.405 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.396+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:30:14.411 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc8f0 2024-09-21T15:30:14.411 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.408+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc9c0 2024-09-21T15:30:14.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:14.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone6.export 2024-09-21T15:30:14.440 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.432+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:30:14.440 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.432+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b10492b0 2024-09-21T15:30:14.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone6@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone6.export 2024-09-21T15:30:14.449 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.444+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b1cd00d0 2024-09-21T15:30:14.449 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.444+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c410 2024-09-21T15:30:14.449 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.444+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fa8f0 2024-09-21T15:30:14.449 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.444+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:30:14.449 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.444+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31011e0 2024-09-21T15:30:14.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.444+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31012b0 2024-09-21T15:30:14.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.444+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:30:14.454 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.444+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd110 2024-09-21T15:30:14.455 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.444+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:30:14.455 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.448+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fda00 2024-09-21T15:30:14.455 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.448+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:30:14.462 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dfba0 2024-09-21T15:30:14.463 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.456+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76dd0 2024-09-21T15:30:14.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d77ba0 2024-09-21T15:30:14.478 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:30:14.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d9c70 2024-09-21T15:30:14.479 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.472+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5635380 2024-09-21T15:30:14.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5635790 2024-09-21T15:30:14.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe340 2024-09-21T15:30:14.491 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe750 2024-09-21T15:30:14.492 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fed00 2024-09-21T15:30:14.492 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:30:14.492 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:30:14.492 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0d860 2024-09-21T15:30:14.492 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:30:14.492 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:30:14.492 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.484+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9380 2024-09-21T15:30:14.492 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de9d40 2024-09-21T15:30:14.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:30:14.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:30:14.493 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47ee0 2024-09-21T15:30:14.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aee1a0 2024-09-21T15:30:14.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeed00 2024-09-21T15:30:14.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeeea0 2024-09-21T15:30:14.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83716c0 2024-09-21T15:30:14.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8371790 2024-09-21T15:30:14.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8371ad0 2024-09-21T15:30:14.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83864e0 2024-09-21T15:30:14.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8386ea0 2024-09-21T15:30:14.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a5b0 2024-09-21T15:30:14.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cc270 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cdad0 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90a90 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90d00 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b90104e0 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c09c0 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.488+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0ea0 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c11e0 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c12b0 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c16c0 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164dd0 2024-09-21T15:30:14.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1651e0 2024-09-21T15:30:14.499 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:30:14.499 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:30:14.499 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5860 2024-09-21T15:30:14.499 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:30:14.499 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:30:14.499 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:30:14.499 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8d00 2024-09-21T15:30:14.499 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d9ba0 2024-09-21T15:30:14.499 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:30:14.500 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35d450 2024-09-21T15:30:14.500 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35dc70 2024-09-21T15:30:14.500 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.492+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e60d0 2024-09-21T15:30:14.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ec820 2024-09-21T15:30:14.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:30:14.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:30:14.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:30:14.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.500+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:30:14.512 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:30:14.512 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf02820 2024-09-21T15:30:14.512 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:30:14.512 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5380 2024-09-21T15:30:14.512 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:30:14.513 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5c70 2024-09-21T15:30:14.513 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5ee0 2024-09-21T15:30:14.514 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c340 2024-09-21T15:30:14.514 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:30:14.514 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.508+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:30:14.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26cb60 2024-09-21T15:30:14.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d450 2024-09-21T15:30:14.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d790 2024-09-21T15:30:14.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.512+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:30:14.523 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:30:14.523 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:30:14.523 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350680 2024-09-21T15:30:14.523 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3508f0 2024-09-21T15:30:14.523 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:30:14.523 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:30:14.523 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:30:14.523 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53040 2024-09-21T15:30:14.523 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:30:14.523 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:30:14.523 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ec30 2024-09-21T15:30:14.523 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.516+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626d00 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a340 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a410 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b110 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b450 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bd40 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bee0 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc532b0 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53380 2024-09-21T15:30:14.524 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008750 2024-09-21T15:30:14.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008ea0 2024-09-21T15:30:14.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:30:14.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c00091e0 2024-09-21T15:30:14.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:30:14.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:30:14.527 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009ee0 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ee0 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae1a0 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae9c0 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30d00 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30ea0 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f60d0 2024-09-21T15:30:14.528 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6820 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f71e0 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7860 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692340 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:30:14.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:14.520+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693e10 2024-09-21T15:30:14.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 24% complete... Exporting image: 36% complete... Exporting image: 49% complete... Exporting image: 61% complete... Exporting image: 73% complete... Exporting image: 85% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:14.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone6@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone6.export 2024-09-21T15:30:14.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 24% complete... Exporting image: 36% complete... Exporting image: 49% complete... Exporting image: 61% complete... Exporting image: 73% complete... Exporting image: 85% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:14.789 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone6.export 2024-09-21T15:30:14.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:14.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone6.export 2024-09-21T15:30:14.918 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone6.export 2024-09-21T15:30:15.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 24% complete... Exporting image: 36% complete... Exporting image: 49% complete... Exporting image: 61% complete... Exporting image: 73% complete... Exporting image: 85% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:15.057 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone6.export 2024-09-21T15:30:15.195 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 24% complete... Exporting image: 36% complete... Exporting image: 49% complete... Exporting image: 61% complete... Exporting image: 73% complete... Exporting image: 85% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:15.200 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone6.export 2024-09-21T15:30:15.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone6.export 2024-09-21T15:30:15.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:15.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:15.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone7 2024-09-21T15:30:15.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:15.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone7 2024-09-21T15:30:15.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:15.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone7.export 2024-09-21T15:30:15.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone7.export 2024-09-21T15:30:15.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone7 2024-09-21T15:30:15.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:15.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:15.407 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:15.408 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone7.export 2024-09-21T15:30:15.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone7@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone7.export 2024-09-21T15:30:15.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:15.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone7@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone7.export 2024-09-21T15:30:15.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:15.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone7.export 2024-09-21T15:30:16.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:16.091 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone7.export 2024-09-21T15:30:16.121 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone7.export 2024-09-21T15:30:16.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:16.276 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone7.export 2024-09-21T15:30:16.413 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:16.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone7.export 2024-09-21T15:30:16.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone7.export 2024-09-21T15:30:16.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:16.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:16.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone8 2024-09-21T15:30:16.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:16.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone8 2024-09-21T15:30:16.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:16.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone8.export 2024-09-21T15:30:16.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone8.export 2024-09-21T15:30:16.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone8 2024-09-21T15:30:16.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:16.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:16.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:16.720 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone8.export 2024-09-21T15:30:16.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone8@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone8.export 2024-09-21T15:30:16.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 40% complete... Exporting image: 60% complete... Exporting image: 80% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:16.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone8@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone8.export 2024-09-21T15:30:17.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 20% complete... Exporting image: 40% complete... Exporting image: 60% complete... Exporting image: 80% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:17.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone8.export 2024-09-21T15:30:17.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:17.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone8.export 2024-09-21T15:30:17.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone8.export 2024-09-21T15:30:17.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:17.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone8.export 2024-09-21T15:30:17.723 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:17.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone8.export 2024-09-21T15:30:17.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone8.export 2024-09-21T15:30:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.3-clone9 2024-09-21T15:30:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.3-clone9 2024-09-21T15:30:17.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:17.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone9.export 2024-09-21T15:30:17.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone9.export 2024-09-21T15:30:17.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.3-clone9 2024-09-21T15:30:17.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:17.764 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:17.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:17.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone9.export 2024-09-21T15:30:17.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone9@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone9.export 2024-09-21T15:30:18.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:18.216 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone9@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone9.export 2024-09-21T15:30:18.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:18.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone9.export 2024-09-21T15:30:18.599 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:18.599 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone9.export 2024-09-21T15:30:18.633 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.3-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone9.export 2024-09-21T15:30:18.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:18.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.3-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone9.export 2024-09-21T15:30:18.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:18.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone9.export 2024-09-21T15:30:18.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.3-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.3-clone9.export 2024-09-21T15:30:18.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:18.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:18.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4 2024-09-21T15:30:18.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:18.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4 2024-09-21T15:30:18.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:18.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4.export 2024-09-21T15:30:18.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4.export 2024-09-21T15:30:18.922 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4 2024-09-21T15:30:18.922 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:18.922 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:18.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:18.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4.export 2024-09-21T15:30:18.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4.export 2024-09-21T15:30:19.110 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:19.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4.export 2024-09-21T15:30:19.224 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:19.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4.export 2024-09-21T15:30:19.404 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:19.404 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4.export 2024-09-21T15:30:19.438 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4.export 2024-09-21T15:30:19.542 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:19.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4.export 2024-09-21T15:30:19.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:19.684 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4.export 2024-09-21T15:30:19.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4.export 2024-09-21T15:30:19.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:19.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:19.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone1 2024-09-21T15:30:19.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:19.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone1 2024-09-21T15:30:19.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:19.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone1.export 2024-09-21T15:30:19.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone1.export 2024-09-21T15:30:19.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone1 2024-09-21T15:30:19.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:19.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:19.945 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:19.945 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone1.export 2024-09-21T15:30:19.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone1@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone1.export 2024-09-21T15:30:20.020 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:30:20.014+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:30:20.020 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:30:20.014+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:30:20.024 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:30:20.018+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335ad0 2024-09-21T15:30:20.034 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:30:20.026+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87676c0 2024-09-21T15:30:20.034 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:30:20.026+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:30:20.043 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:30:20.034+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:30:20.045 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:30:20.034+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:30:20.045 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:30:20.034+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51110 2024-09-21T15:30:20.045 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:30:20.034+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde261a0 2024-09-21T15:30:20.046 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:30:20.034+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde27d40 2024-09-21T15:30:20.046 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:30:20.034+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c9c0 2024-09-21T15:30:20.046 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:30:20.034+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d040 2024-09-21T15:30:20.046 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:30:20.034+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d2b0 2024-09-21T15:30:20.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:20.170 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone1@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone1.export 2024-09-21T15:30:20.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:20.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone1.export 2024-09-21T15:30:20.496 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:20.497 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone1.export 2024-09-21T15:30:20.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone1.export 2024-09-21T15:30:20.663 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:20.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone1.export 2024-09-21T15:30:20.830 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:20.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone1.export 2024-09-21T15:30:21.030 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone1.export 2024-09-21T15:30:21.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:21.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:21.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone10 2024-09-21T15:30:21.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:21.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone10 2024-09-21T15:30:21.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:21.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone10.export 2024-09-21T15:30:21.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone10.export 2024-09-21T15:30:21.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone10 2024-09-21T15:30:21.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:21.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:21.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:21.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone10.export 2024-09-21T15:30:21.185 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone10@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone10.export 2024-09-21T15:30:21.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 19% complete... Exporting image: 26% complete... Exporting image: 33% complete... Exporting image: 39% complete... Exporting image: 46% complete... Exporting image: 52% complete... Exporting image: 59% complete... Exporting image: 66% complete... Exporting image: 72% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 92% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:21.391 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone10@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone10.export 2024-09-21T15:30:21.594 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 13% complete... Exporting image: 19% complete... Exporting image: 26% complete... Exporting image: 33% complete... Exporting image: 39% complete... Exporting image: 46% complete... Exporting image: 52% complete... Exporting image: 59% complete... Exporting image: 66% complete... Exporting image: 72% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 92% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:21.601 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone10.export 2024-09-21T15:30:21.712 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:21.712 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone10.export 2024-09-21T15:30:21.746 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone10.export 2024-09-21T15:30:21.830 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:21.838 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone10.export 2024-09-21T15:30:21.925 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:21.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone10.export 2024-09-21T15:30:21.940 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone10.export 2024-09-21T15:30:21.942 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:21.942 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:21.942 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone11 2024-09-21T15:30:21.942 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:21.942 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone11 2024-09-21T15:30:21.942 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:21.942 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone11.export 2024-09-21T15:30:21.942 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone11.export 2024-09-21T15:30:21.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone11 2024-09-21T15:30:21.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:21.943 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:22.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:22.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone11.export 2024-09-21T15:30:22.085 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone11@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone11.export 2024-09-21T15:30:22.272 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 26% complete... Exporting image: 39% complete... Exporting image: 52% complete... Exporting image: 65% complete... Exporting image: 78% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:22.278 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone11@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone11.export 2024-09-21T15:30:22.487 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 26% complete... Exporting image: 39% complete... Exporting image: 52% complete... Exporting image: 65% complete... Exporting image: 78% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:22.493 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone11.export 2024-09-21T15:30:22.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:22.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone11.export 2024-09-21T15:30:22.654 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone11.export 2024-09-21T15:30:22.778 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:22.787 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone11.export 2024-09-21T15:30:22.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:22.939 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone11.export 2024-09-21T15:30:22.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone11.export 2024-09-21T15:30:22.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:22.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:22.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone12 2024-09-21T15:30:22.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:22.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone12 2024-09-21T15:30:22.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:22.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone12.export 2024-09-21T15:30:22.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone12.export 2024-09-21T15:30:22.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone12 2024-09-21T15:30:22.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:22.962 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:23.113 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:23.113 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone12.export 2024-09-21T15:30:23.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone12@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone12.export 2024-09-21T15:30:24.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:24.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone12@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone12.export 2024-09-21T15:30:25.478 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:25.485 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone12.export 2024-09-21T15:30:25.703 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:25.704 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone12.export 2024-09-21T15:30:25.741 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone12.export 2024-09-21T15:30:26.980 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:26.987 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone12.export 2024-09-21T15:30:28.032 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:28.042 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone12.export 2024-09-21T15:30:28.111 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone12.export 2024-09-21T15:30:28.122 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:28.122 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:28.122 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone13 2024-09-21T15:30:28.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:28.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone13 2024-09-21T15:30:28.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:28.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone13.export 2024-09-21T15:30:28.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone13.export 2024-09-21T15:30:28.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone13 2024-09-21T15:30:28.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:28.123 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:28.293 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:28.293 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone13.export 2024-09-21T15:30:28.294 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone13@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone13.export 2024-09-21T15:30:28.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:28.718 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone13@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone13.export 2024-09-21T15:30:29.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:29.299 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone13.export 2024-09-21T15:30:29.454 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:29.454 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone13.export 2024-09-21T15:30:29.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone13.export 2024-09-21T15:30:29.662 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:29.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone13.export 2024-09-21T15:30:30.282 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:30.291 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone13.export 2024-09-21T15:30:30.300 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone13.export 2024-09-21T15:30:30.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:30.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:30.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone14 2024-09-21T15:30:30.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:30.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone14 2024-09-21T15:30:30.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:30.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone14.export 2024-09-21T15:30:30.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone14.export 2024-09-21T15:30:30.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone14 2024-09-21T15:30:30.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:30.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:30.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:30.382 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone14.export 2024-09-21T15:30:30.384 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone14@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone14.export 2024-09-21T15:30:30.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:30.639 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone14@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone14.export 2024-09-21T15:30:30.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:30.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone14.export 2024-09-21T15:30:31.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:31.136 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone14.export 2024-09-21T15:30:31.174 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone14.export 2024-09-21T15:30:31.229 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:31.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone14.export 2024-09-21T15:30:31.300 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:31.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone14.export 2024-09-21T15:30:31.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone14.export 2024-09-21T15:30:31.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:31.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:31.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone15 2024-09-21T15:30:31.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:31.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone15 2024-09-21T15:30:31.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:31.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone15.export 2024-09-21T15:30:31.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone15.export 2024-09-21T15:30:31.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone15 2024-09-21T15:30:31.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:31.311 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:31.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:31.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone15.export 2024-09-21T15:30:31.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone15@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone15.export 2024-09-21T15:30:31.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:31.970 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone15@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone15.export 2024-09-21T15:30:32.441 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:32.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone15.export 2024-09-21T15:30:32.580 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:32.581 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone15.export 2024-09-21T15:30:32.641 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone15.export 2024-09-21T15:30:33.046 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:33.054 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone15.export 2024-09-21T15:30:33.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:33.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone15.export 2024-09-21T15:30:33.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone15.export 2024-09-21T15:30:33.746 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:33.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:33.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone16 2024-09-21T15:30:33.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:33.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone16 2024-09-21T15:30:33.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:33.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone16.export 2024-09-21T15:30:33.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone16.export 2024-09-21T15:30:33.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone16 2024-09-21T15:30:33.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:33.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:33.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:33.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone16.export 2024-09-21T15:30:33.983 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone16@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone16.export 2024-09-21T15:30:34.299 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.291+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47f930 2024-09-21T15:30:34.300 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.295+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc9c0 2024-09-21T15:30:34.316 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.303+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dfba0 2024-09-21T15:30:34.343 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.335+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:30:34.346 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.335+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:30:34.346 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.335+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0d860 2024-09-21T15:30:34.389 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.367+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47ee0 2024-09-21T15:30:34.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.383+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aee1a0 2024-09-21T15:30:34.400 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.383+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeed00 2024-09-21T15:30:34.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.395+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83716c0 2024-09-21T15:30:34.401 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.395+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83864e0 2024-09-21T15:30:34.423 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.403+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8386ea0 2024-09-21T15:30:34.424 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.403+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387ee0 2024-09-21T15:30:34.424 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.403+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:30:34.445 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.435+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:30:34.445 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.435+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cd040 2024-09-21T15:30:34.445 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.435+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cdad0 2024-09-21T15:30:34.445 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.435+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:30:34.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.447+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:30:34.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.447+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c09c0 2024-09-21T15:30:34.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.447+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0ea0 2024-09-21T15:30:34.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.447+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c11e0 2024-09-21T15:30:34.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.447+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c16c0 2024-09-21T15:30:34.456 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.447+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:30:34.457 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.447+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164dd0 2024-09-21T15:30:34.457 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.447+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1651e0 2024-09-21T15:30:34.457 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.447+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165930 2024-09-21T15:30:34.458 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.451+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:30:34.458 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.451+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5860 2024-09-21T15:30:34.458 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.451+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5ee0 2024-09-21T15:30:34.458 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.451+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:30:34.459 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.455+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:30:34.460 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.455+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:30:34.460 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.455+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d9ba0 2024-09-21T15:30:34.460 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.455+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:30:34.460 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.455+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35d450 2024-09-21T15:30:34.462 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.455+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35dc70 2024-09-21T15:30:34.462 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.455+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:30:34.465 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.459+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:30:34.465 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.459+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:30:34.469 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.459+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:30:34.469 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.459+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:30:34.473 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.463+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf02820 2024-09-21T15:30:34.474 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.467+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:30:34.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.471+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5380 2024-09-21T15:30:34.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.471+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:30:34.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.475+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5c70 2024-09-21T15:30:34.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.475+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5ee0 2024-09-21T15:30:34.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.475+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:30:34.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.475+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:30:34.487 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.475+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26cb60 2024-09-21T15:30:34.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.479+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d790 2024-09-21T15:30:34.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.479+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:30:34.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.479+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:30:34.488 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.479+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:30:34.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.487+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3508f0 2024-09-21T15:30:34.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.491+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:30:34.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.491+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:30:34.501 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.491+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:30:34.504 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.491+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53040 2024-09-21T15:30:34.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.491+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:30:34.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.491+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:30:34.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.491+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ec30 2024-09-21T15:30:34.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.491+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:30:34.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.491+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:30:34.505 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.491+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:30:34.516 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.503+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a340 2024-09-21T15:30:34.530 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.519+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b450 2024-09-21T15:30:34.530 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.519+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:30:34.548 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.531+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bee0 2024-09-21T15:30:34.549 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.531+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:30:34.552 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.547+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008750 2024-09-21T15:30:34.553 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.547+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:30:34.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:30:34.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:30:34.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009ee0 2024-09-21T15:30:34.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:30:34.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:30:34.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:30:34.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:30:34.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae1a0 2024-09-21T15:30:34.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:30:34.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:30:34.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae9c0 2024-09-21T15:30:34.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:30:34.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30d00 2024-09-21T15:30:34.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.563+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30ea0 2024-09-21T15:30:34.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f60d0 2024-09-21T15:30:34.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6820 2024-09-21T15:30:34.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:30:34.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:30:34.578 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f71e0 2024-09-21T15:30:34.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7860 2024-09-21T15:30:34.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:30:34.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:30:34.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692340 2024-09-21T15:30:34.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:30:34.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:30:34.579 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.571+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:30:34.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:30:34.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:30:34.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:30:34.580 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.575+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:30:34.591 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ac7c8340 2024-09-21T15:30:34.598 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580acbd9450 2024-09-21T15:30:34.598 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ad639ad0 2024-09-21T15:30:34.598 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25a410 2024-09-21T15:30:34.598 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae25ac30 2024-09-21T15:30:34.598 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344410 2024-09-21T15:30:34.599 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae344750 2024-09-21T15:30:34.599 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47e1a0 2024-09-21T15:30:34.599 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47e820 2024-09-21T15:30:34.599 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae47f930 2024-09-21T15:30:34.599 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ae9c9930 2024-09-21T15:30:34.599 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aea1cea0 2024-09-21T15:30:34.599 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580aedb7d40 2024-09-21T15:30:34.599 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580af938680 2024-09-21T15:30:34.599 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580afbdd110 2024-09-21T15:30:34.599 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.587+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0099ad0 2024-09-21T15:30:34.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc8f0 2024-09-21T15:30:34.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b07cc9c0 2024-09-21T15:30:34.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0a9e8f0 2024-09-21T15:30:34.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b0d4d790 2024-09-21T15:30:34.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b10492b0 2024-09-21T15:30:34.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b11e6b60 2024-09-21T15:30:34.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b266c410 2024-09-21T15:30:34.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b27fa8f0 2024-09-21T15:30:34.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f504e0 2024-09-21T15:30:34.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2f50750 2024-09-21T15:30:34.600 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b2fb4ea0 2024-09-21T15:30:34.601 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31009c0 2024-09-21T15:30:34.601 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b31011e0 2024-09-21T15:30:34.601 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3388750 2024-09-21T15:30:34.601 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.591+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd110 2024-09-21T15:30:34.601 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fd790 2024-09-21T15:30:34.603 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b34fda00 2024-09-21T15:30:34.603 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3810750 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b3934b60 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4167790 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dec30 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dfa00 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b45dfba0 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76410 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4d76dd0 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b4dd3c70 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b55d9c70 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5635380 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5635790 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe0d0 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fe750 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fed00 2024-09-21T15:30:34.604 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56fedd0 2024-09-21T15:30:34.605 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:30:34.605 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0d860 2024-09-21T15:30:34.605 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:30:34.605 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8c30 2024-09-21T15:30:34.605 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d9ee0 2024-09-21T15:30:34.605 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:30:34.605 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.595+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6de95f0 2024-09-21T15:30:34.605 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.599+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:30:34.606 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.599+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47ee0 2024-09-21T15:30:34.606 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.599+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aee1a0 2024-09-21T15:30:34.606 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.599+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeed00 2024-09-21T15:30:34.606 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.599+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aeeea0 2024-09-21T15:30:34.608 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.603+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83716c0 2024-09-21T15:30:34.608 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.603+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83864e0 2024-09-21T15:30:34.608 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.603+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8386ea0 2024-09-21T15:30:34.608 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.603+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387ee0 2024-09-21T15:30:34.608 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.603+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a5b0 2024-09-21T15:30:34.609 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.603+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:30:34.610 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.603+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:30:34.610 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.603+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cd040 2024-09-21T15:30:34.610 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.603+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cdad0 2024-09-21T15:30:34.610 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.603+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:30:34.618 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:30:34.618 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c09c0 2024-09-21T15:30:34.618 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0ea0 2024-09-21T15:30:34.618 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c11e0 2024-09-21T15:30:34.618 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c16c0 2024-09-21T15:30:34.618 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:30:34.618 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164dd0 2024-09-21T15:30:34.618 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1651e0 2024-09-21T15:30:34.618 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165930 2024-09-21T15:30:34.618 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:30:34.618 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5860 2024-09-21T15:30:34.618 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5ee0 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d9ba0 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35d450 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35dc70 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf02820 2024-09-21T15:30:34.619 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5380 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5c70 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5ee0 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26cb60 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d790 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3508f0 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:30:34.620 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53040 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ec30 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a340 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b450 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bee0 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:30:34.621 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008750 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009ee0 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae1a0 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae9c0 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30d00 2024-09-21T15:30:34.622 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30ea0 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f60d0 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6820 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f71e0 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692340 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:30:34.623 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:30:34.624 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:34.611+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:30:34.980 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:34.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone16@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone16.export 2024-09-21T15:30:35.692 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.0 2024-09-21T15:30:35.693 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Sent signal 15 2024-09-21T15:30:35.693 INFO:tasks.rbd_mirror_thrash:waiting for 7 secs before reviving daemons 2024-09-21T15:30:35.694 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:30:35.687+0000 7fc23ea8a700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 (PID: 90938) UID: 1000 2024-09-21T15:30:35.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:35.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone16.export 2024-09-21T15:30:36.175 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:36.175 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone16.export 2024-09-21T15:30:36.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone16.export 2024-09-21T15:30:36.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:36.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone16.export 2024-09-21T15:30:37.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:38.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone16.export 2024-09-21T15:30:38.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone16.export 2024-09-21T15:30:38.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:38.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:38.264 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone17 2024-09-21T15:30:38.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:38.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone17 2024-09-21T15:30:38.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:38.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone17.export 2024-09-21T15:30:38.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone17.export 2024-09-21T15:30:38.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone17 2024-09-21T15:30:38.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:38.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:38.515 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:38.515 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone17.export 2024-09-21T15:30:38.516 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone17@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone17.export 2024-09-21T15:30:38.837 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.830+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:30:38.849 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.838+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:30:38.849 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.838+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9cc30 2024-09-21T15:30:38.850 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.842+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:30:38.850 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.842+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2881a0 2024-09-21T15:30:38.850 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.842+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288c30 2024-09-21T15:30:38.850 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.842+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:30:38.860 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.854+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf9d40 2024-09-21T15:30:38.865 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.858+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:30:38.874 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.862+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:30:38.874 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.862+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68dd0 2024-09-21T15:30:38.874 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.862+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:30:38.875 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.862+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af310dd0 2024-09-21T15:30:38.875 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.866+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afb6a820 2024-09-21T15:30:38.875 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.866+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b1e0 2024-09-21T15:30:38.875 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.866+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:30:38.875 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.866+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:30:38.875 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.866+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:30:38.875 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.866+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:30:38.875 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.866+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:30:38.875 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.866+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:30:38.877 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:30:38.877 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:30:38.877 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:30:38.877 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:30:38.877 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676750 2024-09-21T15:30:38.877 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36775f0 2024-09-21T15:30:38.877 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36776c0 2024-09-21T15:30:38.877 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677e10 2024-09-21T15:30:38.877 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45285b0 2024-09-21T15:30:38.877 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45288f0 2024-09-21T15:30:38.877 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529860 2024-09-21T15:30:38.877 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2340 2024-09-21T15:30:38.878 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2820 2024-09-21T15:30:38.878 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:30:38.878 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:30:38.870+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:30:39.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:39.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone17@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone17.export 2024-09-21T15:30:39.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:39.781 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone17.export 2024-09-21T15:30:39.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:39.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone17.export 2024-09-21T15:30:39.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone17.export 2024-09-21T15:30:40.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:40.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone17.export 2024-09-21T15:30:40.775 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:40.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone17.export 2024-09-21T15:30:40.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone17.export 2024-09-21T15:30:40.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:40.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:40.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone18 2024-09-21T15:30:40.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:40.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone18 2024-09-21T15:30:40.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:40.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone18.export 2024-09-21T15:30:40.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone18.export 2024-09-21T15:30:40.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone18 2024-09-21T15:30:40.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:40.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:41.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:41.161 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone18.export 2024-09-21T15:30:41.162 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone18@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone18.export 2024-09-21T15:30:41.726 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 13% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 26% complete... Exporting image: 30% complete... Exporting image: 34% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 47% complete... Exporting image: 52% complete... Exporting image: 56% complete... Exporting image: 60% complete... Exporting image: 65% complete... Exporting image: 69% complete... Exporting image: 73% complete... Exporting image: 78% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 91% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:41.739 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone18@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone18.export 2024-09-21T15:30:42.354 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 13% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 26% complete... Exporting image: 30% complete... Exporting image: 34% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 47% complete... Exporting image: 52% complete... Exporting image: 56% complete... Exporting image: 60% complete... Exporting image: 65% complete... Exporting image: 69% complete... Exporting image: 73% complete... Exporting image: 78% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 91% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:42.369 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone18.export 2024-09-21T15:30:42.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:42.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone18.export 2024-09-21T15:30:42.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone18.export 2024-09-21T15:30:42.694 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.0 2024-09-21T15:30:42.694 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:30:42.694 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.0 2024-09-21T15:30:42.694 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Restarting daemon 2024-09-21T15:30:42.695 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 2024-09-21T15:30:42.697 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Started 2024-09-21T15:30:42.697 INFO:tasks.rbd_mirror_thrash:waiting for 69 secs before thrashing 2024-09-21T15:30:43.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 13% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 26% complete... Exporting image: 30% complete... Exporting image: 34% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 47% complete... Exporting image: 52% complete... Exporting image: 56% complete... Exporting image: 60% complete... Exporting image: 65% complete... Exporting image: 69% complete... Exporting image: 73% complete... Exporting image: 78% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 91% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:43.131 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone18.export 2024-09-21T15:30:43.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 13% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 26% complete... Exporting image: 30% complete... Exporting image: 34% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 47% complete... Exporting image: 52% complete... Exporting image: 56% complete... Exporting image: 60% complete... Exporting image: 65% complete... Exporting image: 69% complete... Exporting image: 73% complete... Exporting image: 78% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 91% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:43.698 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone18.export 2024-09-21T15:30:43.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone18.export 2024-09-21T15:30:43.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:43.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:43.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone19 2024-09-21T15:30:43.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:43.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone19 2024-09-21T15:30:43.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:43.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone19.export 2024-09-21T15:30:43.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone19.export 2024-09-21T15:30:43.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone19 2024-09-21T15:30:43.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:43.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:43.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:43.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone19.export 2024-09-21T15:30:43.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone19@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone19.export 2024-09-21T15:30:44.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:44.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone19@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone19.export 2024-09-21T15:30:44.697 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:44.707 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone19.export 2024-09-21T15:30:44.776 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:44.776 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone19.export 2024-09-21T15:30:44.805 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone19.export 2024-09-21T15:30:44.858 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:44.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone19.export 2024-09-21T15:30:44.925 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:44.932 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone19.export 2024-09-21T15:30:44.933 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone19.export 2024-09-21T15:30:44.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:44.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:44.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone2 2024-09-21T15:30:44.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:44.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone2 2024-09-21T15:30:44.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:44.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone2.export 2024-09-21T15:30:44.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone2.export 2024-09-21T15:30:44.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone2 2024-09-21T15:30:44.936 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:44.937 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:45.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:45.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone2.export 2024-09-21T15:30:45.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone2@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone2.export 2024-09-21T15:30:45.189 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 12% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 34% complete... Exporting image: 38% complete... Exporting image: 42% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 55% complete... Exporting image: 59% complete... Exporting image: 63% complete... Exporting image: 68% complete... Exporting image: 72% complete... Exporting image: 76% complete... Exporting image: 80% complete... Exporting image: 85% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:45.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone2@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone2.export 2024-09-21T15:30:45.390 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 12% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 34% complete... Exporting image: 38% complete... Exporting image: 42% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 55% complete... Exporting image: 59% complete... Exporting image: 63% complete... Exporting image: 68% complete... Exporting image: 72% complete... Exporting image: 76% complete... Exporting image: 80% complete... Exporting image: 85% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:45.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone2.export 2024-09-21T15:30:45.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:45.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone2.export 2024-09-21T15:30:45.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone2.export 2024-09-21T15:30:45.813 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 12% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 34% complete... Exporting image: 38% complete... Exporting image: 42% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 55% complete... Exporting image: 59% complete... Exporting image: 63% complete... Exporting image: 68% complete... Exporting image: 72% complete... Exporting image: 76% complete... Exporting image: 80% complete... Exporting image: 85% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:45.819 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone2.export 2024-09-21T15:30:46.005 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 12% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 29% complete... Exporting image: 34% complete... Exporting image: 38% complete... Exporting image: 42% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 55% complete... Exporting image: 59% complete... Exporting image: 63% complete... Exporting image: 68% complete... Exporting image: 72% complete... Exporting image: 76% complete... Exporting image: 80% complete... Exporting image: 85% complete... Exporting image: 89% complete... Exporting image: 93% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:46.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone2.export 2024-09-21T15:30:46.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone2.export 2024-09-21T15:30:46.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:46.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:46.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone20 2024-09-21T15:30:46.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:46.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone20 2024-09-21T15:30:46.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:46.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone20.export 2024-09-21T15:30:46.245 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone20.export 2024-09-21T15:30:46.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone20 2024-09-21T15:30:46.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:46.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:46.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:46.314 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone20.export 2024-09-21T15:30:46.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone20@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone20.export 2024-09-21T15:30:46.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:46.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone20@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone20.export 2024-09-21T15:30:46.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:46.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone20.export 2024-09-21T15:30:47.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:47.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone20.export 2024-09-21T15:30:47.078 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone20.export 2024-09-21T15:30:47.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:47.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone20.export 2024-09-21T15:30:47.638 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:47.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone20.export 2024-09-21T15:30:47.768 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone20.export 2024-09-21T15:30:47.830 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:47.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:47.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone21 2024-09-21T15:30:47.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:47.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone21 2024-09-21T15:30:47.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:47.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone21.export 2024-09-21T15:30:47.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone21.export 2024-09-21T15:30:47.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone21 2024-09-21T15:30:47.832 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:47.832 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:47.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:47.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone21.export 2024-09-21T15:30:47.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone21@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone21.export 2024-09-21T15:30:48.077 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:48.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone21@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone21.export 2024-09-21T15:30:48.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:48.241 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone21.export 2024-09-21T15:30:48.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:48.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone21.export 2024-09-21T15:30:48.493 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone21.export 2024-09-21T15:30:48.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:48.574 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone21.export 2024-09-21T15:30:48.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:48.668 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone21.export 2024-09-21T15:30:48.670 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone21.export 2024-09-21T15:30:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone22 2024-09-21T15:30:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone22 2024-09-21T15:30:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone22.export 2024-09-21T15:30:48.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone22.export 2024-09-21T15:30:48.674 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone22 2024-09-21T15:30:48.674 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:48.674 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:48.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:48.743 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone22.export 2024-09-21T15:30:48.745 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone22@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone22.export 2024-09-21T15:30:49.018 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 31% complete... Exporting image: 41% complete... Exporting image: 51% complete... Exporting image: 62% complete... Exporting image: 72% complete... Exporting image: 82% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:49.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone22@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone22.export 2024-09-21T15:30:49.300 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 31% complete... Exporting image: 41% complete... Exporting image: 51% complete... Exporting image: 62% complete... Exporting image: 72% complete... Exporting image: 82% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:49.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone22.export 2024-09-21T15:30:49.465 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:49.465 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone22.export 2024-09-21T15:30:49.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone22.export 2024-09-21T15:30:49.558 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:49.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone22.export 2024-09-21T15:30:49.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:49.632 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone22.export 2024-09-21T15:30:49.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone22.export 2024-09-21T15:30:49.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:49.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:49.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone23 2024-09-21T15:30:49.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:49.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone23 2024-09-21T15:30:49.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:49.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone23.export 2024-09-21T15:30:49.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone23.export 2024-09-21T15:30:49.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone23 2024-09-21T15:30:49.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:49.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:49.771 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:49.772 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone23.export 2024-09-21T15:30:49.773 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone23@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone23.export 2024-09-21T15:30:49.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 29% complete... Exporting image: 58% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:49.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone23@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone23.export 2024-09-21T15:30:50.137 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 29% complete... Exporting image: 58% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:50.147 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone23.export 2024-09-21T15:30:50.195 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:50.195 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone23.export 2024-09-21T15:30:50.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone23.export 2024-09-21T15:30:50.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 29% complete... Exporting image: 58% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:50.568 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone23.export 2024-09-21T15:30:50.751 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 29% complete... Exporting image: 58% complete... Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:50.758 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone23.export 2024-09-21T15:30:50.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone23.export 2024-09-21T15:30:50.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:50.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:50.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone24 2024-09-21T15:30:50.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:50.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone24 2024-09-21T15:30:50.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:50.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone24.export 2024-09-21T15:30:50.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone24.export 2024-09-21T15:30:50.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone24 2024-09-21T15:30:50.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:50.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:50.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:50.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone24.export 2024-09-21T15:30:50.987 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone24@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone24.export 2024-09-21T15:30:51.170 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:51.177 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone24@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone24.export 2024-09-21T15:30:51.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:51.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone24.export 2024-09-21T15:30:51.545 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:51.546 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone24.export 2024-09-21T15:30:51.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone24.export 2024-09-21T15:30:51.698 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:51.706 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone24.export 2024-09-21T15:30:51.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:51.868 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone24.export 2024-09-21T15:30:51.870 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone24.export 2024-09-21T15:30:51.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:51.873 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:51.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone25 2024-09-21T15:30:51.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:51.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone25 2024-09-21T15:30:51.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:51.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone25.export 2024-09-21T15:30:51.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone25.export 2024-09-21T15:30:51.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone25 2024-09-21T15:30:51.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:51.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:52.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:52.152 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone25.export 2024-09-21T15:30:52.153 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone25@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone25.export 2024-09-21T15:30:52.304 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 38% complete... Exporting image: 46% complete... Exporting image: 54% complete... Exporting image: 62% complete... Exporting image: 70% complete... Exporting image: 77% complete... Exporting image: 85% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:52.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone25@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone25.export 2024-09-21T15:30:52.443 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 38% complete... Exporting image: 46% complete... Exporting image: 54% complete... Exporting image: 62% complete... Exporting image: 70% complete... Exporting image: 77% complete... Exporting image: 85% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:52.450 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone25.export 2024-09-21T15:30:52.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:52.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone25.export 2024-09-21T15:30:52.614 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone25.export 2024-09-21T15:30:52.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 38% complete... Exporting image: 46% complete... Exporting image: 54% complete... Exporting image: 62% complete... Exporting image: 70% complete... Exporting image: 77% complete... Exporting image: 85% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:52.752 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone25.export 2024-09-21T15:30:52.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 38% complete... Exporting image: 46% complete... Exporting image: 54% complete... Exporting image: 62% complete... Exporting image: 70% complete... Exporting image: 77% complete... Exporting image: 85% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:52.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone25.export 2024-09-21T15:30:53.044 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone25.export 2024-09-21T15:30:53.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:53.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:53.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone26 2024-09-21T15:30:53.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:53.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone26 2024-09-21T15:30:53.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:53.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone26.export 2024-09-21T15:30:53.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone26.export 2024-09-21T15:30:53.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone26 2024-09-21T15:30:53.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:53.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:53.170 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:53.170 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone26.export 2024-09-21T15:30:53.171 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone26@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone26.export 2024-09-21T15:30:53.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:53.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone26@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone26.export 2024-09-21T15:30:53.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:53.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone26.export 2024-09-21T15:30:53.865 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:53.865 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone26.export 2024-09-21T15:30:53.894 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.32221861487636794) > weight (0.25) 2024-09-21T15:30:53.895 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.1 2024-09-21T15:30:53.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Sent signal 15 2024-09-21T15:30:53.895 INFO:tasks.rbd_mirror_thrash:waiting for 7 secs before reviving daemons 2024-09-21T15:30:53.896 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:30:53.891+0000 7f95958c2700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 96862) UID: 1000 2024-09-21T15:30:53.900 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone26.export 2024-09-21T15:30:53.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:53.981 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone26.export 2024-09-21T15:30:54.293 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:54.301 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone26.export 2024-09-21T15:30:54.304 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone26.export 2024-09-21T15:30:54.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:54.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:54.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone27 2024-09-21T15:30:54.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:54.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone27 2024-09-21T15:30:54.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:54.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone27.export 2024-09-21T15:30:54.307 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone27.export 2024-09-21T15:30:54.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone27 2024-09-21T15:30:54.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:54.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:54.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:54.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone27.export 2024-09-21T15:30:54.424 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone27@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone27.export 2024-09-21T15:30:54.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:54.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone27@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone27.export 2024-09-21T15:30:55.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:55.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone27.export 2024-09-21T15:30:55.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:55.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone27.export 2024-09-21T15:30:55.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone27.export 2024-09-21T15:30:55.971 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:55.982 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone27.export 2024-09-21T15:30:56.290 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:56.296 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone27.export 2024-09-21T15:30:56.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone27.export 2024-09-21T15:30:56.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:56.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:56.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone28 2024-09-21T15:30:56.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:56.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone28 2024-09-21T15:30:56.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:56.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone28.export 2024-09-21T15:30:56.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone28.export 2024-09-21T15:30:56.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone28 2024-09-21T15:30:56.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:56.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:56.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:56.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone28.export 2024-09-21T15:30:56.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone28@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone28.export 2024-09-21T15:30:56.835 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 17% complete... Exporting image: 35% complete... Exporting image: 52% complete... Exporting image: 70% complete... Exporting image: 88% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:56.848 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone28@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone28.export 2024-09-21T15:30:57.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 17% complete... Exporting image: 35% complete... Exporting image: 52% complete... Exporting image: 70% complete... Exporting image: 88% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:57.094 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone28.export 2024-09-21T15:30:57.193 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:57.193 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone28.export 2024-09-21T15:30:57.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone28.export 2024-09-21T15:30:57.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:57.357 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone28.export 2024-09-21T15:30:57.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:57.522 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone28.export 2024-09-21T15:30:57.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone28.export 2024-09-21T15:30:57.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone29 2024-09-21T15:30:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone29 2024-09-21T15:30:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone29.export 2024-09-21T15:30:57.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone29.export 2024-09-21T15:30:57.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone29 2024-09-21T15:30:57.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:57.553 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:57.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:57.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone29.export 2024-09-21T15:30:57.620 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone29@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone29.export 2024-09-21T15:30:57.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 23% complete... Exporting image: 29% complete... Exporting image: 35% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 52% complete... Exporting image: 58% complete... Exporting image: 64% complete... Exporting image: 70% complete... Exporting image: 76% complete... Exporting image: 82% complete... Exporting image: 88% complete... Exporting image: 93% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:57.768 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone29@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone29.export 2024-09-21T15:30:57.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 23% complete... Exporting image: 29% complete... Exporting image: 35% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 52% complete... Exporting image: 58% complete... Exporting image: 64% complete... Exporting image: 70% complete... Exporting image: 76% complete... Exporting image: 82% complete... Exporting image: 88% complete... Exporting image: 93% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:57.924 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone29.export 2024-09-21T15:30:58.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:58.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone29.export 2024-09-21T15:30:58.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone29.export 2024-09-21T15:30:58.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 23% complete... Exporting image: 29% complete... Exporting image: 35% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 52% complete... Exporting image: 58% complete... Exporting image: 64% complete... Exporting image: 70% complete... Exporting image: 76% complete... Exporting image: 82% complete... Exporting image: 88% complete... Exporting image: 93% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:58.188 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone29.export 2024-09-21T15:30:58.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 23% complete... Exporting image: 29% complete... Exporting image: 35% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 52% complete... Exporting image: 58% complete... Exporting image: 64% complete... Exporting image: 70% complete... Exporting image: 76% complete... Exporting image: 82% complete... Exporting image: 88% complete... Exporting image: 93% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:58.346 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone29.export 2024-09-21T15:30:58.442 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone29.export 2024-09-21T15:30:58.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:58.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:58.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone3 2024-09-21T15:30:58.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:58.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone3 2024-09-21T15:30:58.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:58.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone3.export 2024-09-21T15:30:58.470 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone3.export 2024-09-21T15:30:58.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone3 2024-09-21T15:30:58.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:58.471 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:58.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:58.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone3.export 2024-09-21T15:30:58.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone3@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone3.export 2024-09-21T15:30:58.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 16% complete... Exporting image: 24% complete... Exporting image: 32% complete... Exporting image: 40% complete... Exporting image: 48% complete... Exporting image: 56% complete... Exporting image: 64% complete... Exporting image: 72% complete... Exporting image: 81% complete... Exporting image: 89% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:58.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone3@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone3.export 2024-09-21T15:30:59.065 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 16% complete... Exporting image: 24% complete... Exporting image: 32% complete... Exporting image: 40% complete... Exporting image: 48% complete... Exporting image: 56% complete... Exporting image: 64% complete... Exporting image: 72% complete... Exporting image: 81% complete... Exporting image: 89% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:30:59.073 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone3.export 2024-09-21T15:30:59.240 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:59.240 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone3.export 2024-09-21T15:30:59.295 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone3.export 2024-09-21T15:30:59.296 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:59.287+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:30:59.296 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:59.287+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:30:59.296 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:59.287+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:30:59.297 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:59.291+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:30:59.297 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:59.291+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:30:59.297 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:30:59.291+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:30:59.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:59.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone3.export 2024-09-21T15:30:59.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:59.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone3.export 2024-09-21T15:30:59.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone3.export 2024-09-21T15:30:59.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:30:59.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:30:59.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone30 2024-09-21T15:30:59.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:30:59.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone30 2024-09-21T15:30:59.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:30:59.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone30.export 2024-09-21T15:30:59.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone30.export 2024-09-21T15:30:59.565 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone30 2024-09-21T15:30:59.565 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:30:59.565 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:30:59.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:30:59.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone30.export 2024-09-21T15:30:59.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone30@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone30.export 2024-09-21T15:30:59.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:30:59.934 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone30@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone30.export 2024-09-21T15:31:00.225 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:00.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone30.export 2024-09-21T15:31:00.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:00.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone30.export 2024-09-21T15:31:00.392 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone30.export 2024-09-21T15:31:00.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:00.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone30.export 2024-09-21T15:31:00.896 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.1 2024-09-21T15:31:00.896 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:31:00.896 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.1 2024-09-21T15:31:00.896 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2024-09-21T15:31:00.896 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2024-09-21T15:31:00.898 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2024-09-21T15:31:00.899 INFO:tasks.rbd_mirror_thrash:waiting for 82 secs before thrashing 2024-09-21T15:31:00.975 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:00.979 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone30.export 2024-09-21T15:31:01.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone30.export 2024-09-21T15:31:01.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:01.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:01.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone31 2024-09-21T15:31:01.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:01.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone31 2024-09-21T15:31:01.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:01.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone31.export 2024-09-21T15:31:01.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone31.export 2024-09-21T15:31:01.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone31 2024-09-21T15:31:01.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:01.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:01.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:01.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone31.export 2024-09-21T15:31:01.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone31@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone31.export 2024-09-21T15:31:01.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:01.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone31@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone31.export 2024-09-21T15:31:01.493 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:01.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone31.export 2024-09-21T15:31:01.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:01.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone31.export 2024-09-21T15:31:01.543 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone31.export 2024-09-21T15:31:01.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:01.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone31.export 2024-09-21T15:31:01.738 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:01.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone31.export 2024-09-21T15:31:01.751 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone31.export 2024-09-21T15:31:01.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:01.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:01.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone32 2024-09-21T15:31:01.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:01.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone32 2024-09-21T15:31:01.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:01.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone32.export 2024-09-21T15:31:01.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone32.export 2024-09-21T15:31:01.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone32 2024-09-21T15:31:01.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:01.757 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:01.830 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:01.830 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone32.export 2024-09-21T15:31:01.831 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone32@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone32.export 2024-09-21T15:31:01.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 15% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 31% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 57% complete... Exporting image: 62% complete... Exporting image: 67% complete... Exporting image: 72% complete... Exporting image: 77% complete... Exporting image: 83% complete... Exporting image: 88% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:02.007 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone32@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone32.export 2024-09-21T15:31:02.200 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 15% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 31% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 57% complete... Exporting image: 62% complete... Exporting image: 67% complete... Exporting image: 72% complete... Exporting image: 77% complete... Exporting image: 83% complete... Exporting image: 88% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:02.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone32.export 2024-09-21T15:31:02.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:02.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone32.export 2024-09-21T15:31:02.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone32.export 2024-09-21T15:31:02.414 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:02.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone32.export 2024-09-21T15:31:02.482 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:02.488 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone32.export 2024-09-21T15:31:02.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone32.export 2024-09-21T15:31:02.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:02.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:02.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone33 2024-09-21T15:31:02.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:02.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone33 2024-09-21T15:31:02.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:02.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone33.export 2024-09-21T15:31:02.492 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone33.export 2024-09-21T15:31:02.493 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone33 2024-09-21T15:31:02.493 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:02.493 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:02.628 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:02.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone33.export 2024-09-21T15:31:02.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone33@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone33.export 2024-09-21T15:31:03.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 19% complete... Exporting image: 24% complete... Exporting image: 29% complete... Exporting image: 34% complete... Exporting image: 39% complete... Exporting image: 44% complete... Exporting image: 49% complete... Exporting image: 54% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 69% complete... Exporting image: 74% complete... Exporting image: 79% complete... Exporting image: 84% complete... Exporting image: 89% complete... Exporting image: 94% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:03.638 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone33@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone33.export 2024-09-21T15:31:04.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 19% complete... Exporting image: 24% complete... Exporting image: 29% complete... Exporting image: 34% complete... Exporting image: 39% complete... Exporting image: 44% complete... Exporting image: 49% complete... Exporting image: 54% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 69% complete... Exporting image: 74% complete... Exporting image: 79% complete... Exporting image: 84% complete... Exporting image: 89% complete... Exporting image: 94% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:04.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone33.export 2024-09-21T15:31:05.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:05.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone33.export 2024-09-21T15:31:05.034 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone33.export 2024-09-21T15:31:06.086 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 19% complete... Exporting image: 24% complete... Exporting image: 29% complete... Exporting image: 34% complete... Exporting image: 39% complete... Exporting image: 44% complete... Exporting image: 49% complete... Exporting image: 54% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 69% complete... Exporting image: 74% complete... Exporting image: 79% complete... Exporting image: 84% complete... Exporting image: 89% complete... Exporting image: 94% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:06.099 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone33.export 2024-09-21T15:31:07.040 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 19% complete... Exporting image: 24% complete... Exporting image: 29% complete... Exporting image: 34% complete... Exporting image: 39% complete... Exporting image: 44% complete... Exporting image: 49% complete... Exporting image: 54% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 69% complete... Exporting image: 74% complete... Exporting image: 79% complete... Exporting image: 84% complete... Exporting image: 89% complete... Exporting image: 94% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:07.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone33.export 2024-09-21T15:31:07.174 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone33.export 2024-09-21T15:31:07.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:07.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:07.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone34 2024-09-21T15:31:07.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:07.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone34 2024-09-21T15:31:07.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:07.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone34.export 2024-09-21T15:31:07.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone34.export 2024-09-21T15:31:07.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:07.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone34 2024-09-21T15:31:07.206 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:07.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:07.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone34.export 2024-09-21T15:31:07.379 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone34@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone34.export 2024-09-21T15:31:07.782 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 50% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:07.793 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone34@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone34.export 2024-09-21T15:31:08.309 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 50% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:08.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone34.export 2024-09-21T15:31:08.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:08.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone34.export 2024-09-21T15:31:08.521 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone34.export 2024-09-21T15:31:08.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:08.719 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone34.export 2024-09-21T15:31:08.955 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:08.963 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone34.export 2024-09-21T15:31:08.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone34.export 2024-09-21T15:31:09.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone35 2024-09-21T15:31:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone35 2024-09-21T15:31:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone35.export 2024-09-21T15:31:09.013 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone35.export 2024-09-21T15:31:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone35 2024-09-21T15:31:09.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:09.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:09.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone35.export 2024-09-21T15:31:09.085 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone35@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone35.export 2024-09-21T15:31:09.197 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:09.203 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone35@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone35.export 2024-09-21T15:31:09.320 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.313+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670680 2024-09-21T15:31:09.332 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.317+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670dd0 2024-09-21T15:31:09.332 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.317+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9e8f520 2024-09-21T15:31:09.334 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:09.339 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone35.export 2024-09-21T15:31:09.343 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.333+0000 7f7fd044c700 -1 reset not still connected to 0x5636aa0baa90 2024-09-21T15:31:09.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.341+0000 7f7fd044c700 -1 reset not still connected to 0x5636aef02750 2024-09-21T15:31:09.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.341+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:31:09.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.341+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e8410 2024-09-21T15:31:09.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.341+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:31:09.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.341+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678f2b0 2024-09-21T15:31:09.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.341+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb84e0 2024-09-21T15:31:09.349 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.341+0000 7f7fd044c700 -1 reset not still connected to 0x5636bca1e1a0 2024-09-21T15:31:09.355 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.345+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff656c0 2024-09-21T15:31:09.356 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.349+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65c70 2024-09-21T15:31:09.356 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.349+0000 7f7fd044c700 -1 reset not still connected to 0x5636bffbb2b0 2024-09-21T15:31:09.356 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.349+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1c70 2024-09-21T15:31:09.356 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.349+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1ee0 2024-09-21T15:31:09.356 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.349+0000 7f7fd044c700 -1 reset not still connected to 0x5636c0f880d0 2024-09-21T15:31:09.358 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.349+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e750 2024-09-21T15:31:09.358 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.349+0000 7f7fd044c700 -1 reset not still connected to 0x5636c4ae5930 2024-09-21T15:31:09.358 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.349+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:31:09.366 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.357+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c28f0 2024-09-21T15:31:09.366 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.357+0000 7f7fd044c700 -1 reset not still connected to 0x5636c62c3a00 2024-09-21T15:31:09.367 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.361+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9790 2024-09-21T15:31:09.369 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.361+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9ad0 2024-09-21T15:31:09.369 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.361+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9d40 2024-09-21T15:31:09.370 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.361+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:31:09.370 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.361+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:31:09.370 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.361+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:31:09.370 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.361+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:31:09.370 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.361+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7334340 2024-09-21T15:31:09.370 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.361+0000 7f7fd044c700 -1 reset not still connected to 0x5636c73351e0 2024-09-21T15:31:09.371 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.361+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335a00 2024-09-21T15:31:09.371 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.361+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335ad0 2024-09-21T15:31:09.371 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.361+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766750 2024-09-21T15:31:09.372 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87676c0 2024-09-21T15:31:09.372 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:31:09.372 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89672b0 2024-09-21T15:31:09.372 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967a00 2024-09-21T15:31:09.372 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:31:09.372 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:31:09.373 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51040 2024-09-21T15:31:09.374 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51110 2024-09-21T15:31:09.374 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51380 2024-09-21T15:31:09.375 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde261a0 2024-09-21T15:31:09.375 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde27d40 2024-09-21T15:31:09.375 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636ce7e9790 2024-09-21T15:31:09.375 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c820 2024-09-21T15:31:09.375 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c8f0 2024-09-21T15:31:09.375 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c9c0 2024-09-21T15:31:09.375 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01cf70 2024-09-21T15:31:09.375 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d040 2024-09-21T15:31:09.375 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:31:09.365+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d2b0 2024-09-21T15:31:09.472 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:09.472 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone35.export 2024-09-21T15:31:09.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone35.export 2024-09-21T15:31:09.619 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:09.626 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone35.export 2024-09-21T15:31:09.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:09.756 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone35.export 2024-09-21T15:31:09.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone35.export 2024-09-21T15:31:09.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:09.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:09.916 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone36 2024-09-21T15:31:09.916 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:09.916 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone36 2024-09-21T15:31:09.916 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:09.916 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone36.export 2024-09-21T15:31:09.916 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone36.export 2024-09-21T15:31:09.916 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone36 2024-09-21T15:31:09.917 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:09.917 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:10.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:10.009 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone36.export 2024-09-21T15:31:10.010 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone36@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone36.export 2024-09-21T15:31:10.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:10.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone36@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone36.export 2024-09-21T15:31:10.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:10.643 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone36.export 2024-09-21T15:31:10.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:10.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone36.export 2024-09-21T15:31:10.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone36.export 2024-09-21T15:31:11.113 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:11.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone36.export 2024-09-21T15:31:11.427 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:11.432 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone36.export 2024-09-21T15:31:11.556 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone36.export 2024-09-21T15:31:11.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:11.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:11.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone37 2024-09-21T15:31:11.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:11.610 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone37 2024-09-21T15:31:11.610 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:11.610 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone37.export 2024-09-21T15:31:11.610 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone37.export 2024-09-21T15:31:11.610 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone37 2024-09-21T15:31:11.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:11.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:11.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:11.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone37.export 2024-09-21T15:31:11.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone37@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone37.export 2024-09-21T15:31:11.874 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 16% complete... Exporting image: 25% complete... Exporting image: 33% complete... Exporting image: 42% complete... Exporting image: 50% complete... Exporting image: 59% complete... Exporting image: 67% complete... Exporting image: 76% complete... Exporting image: 84% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:11.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone37@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone37.export 2024-09-21T15:31:12.054 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 16% complete... Exporting image: 25% complete... Exporting image: 33% complete... Exporting image: 42% complete... Exporting image: 50% complete... Exporting image: 59% complete... Exporting image: 67% complete... Exporting image: 76% complete... Exporting image: 84% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:12.060 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone37.export 2024-09-21T15:31:12.216 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:12.216 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone37.export 2024-09-21T15:31:12.253 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone37.export 2024-09-21T15:31:12.404 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 16% complete... Exporting image: 25% complete... Exporting image: 33% complete... Exporting image: 42% complete... Exporting image: 50% complete... Exporting image: 59% complete... Exporting image: 67% complete... Exporting image: 76% complete... Exporting image: 84% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:12.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone37.export 2024-09-21T15:31:12.599 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 8% complete... Exporting image: 16% complete... Exporting image: 25% complete... Exporting image: 33% complete... Exporting image: 42% complete... Exporting image: 50% complete... Exporting image: 59% complete... Exporting image: 67% complete... Exporting image: 76% complete... Exporting image: 84% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:12.606 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone37.export 2024-09-21T15:31:12.759 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone37.export 2024-09-21T15:31:12.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:12.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:12.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone38 2024-09-21T15:31:12.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:12.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone38 2024-09-21T15:31:12.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:12.801 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone38.export 2024-09-21T15:31:12.801 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone38.export 2024-09-21T15:31:12.801 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone38 2024-09-21T15:31:12.801 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:12.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:12.891 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:12.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone38.export 2024-09-21T15:31:12.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone38@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone38.export 2024-09-21T15:31:13.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 47% complete... Exporting image: 55% complete... Exporting image: 63% complete... Exporting image: 71% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:13.312 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone38@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone38.export 2024-09-21T15:31:13.552 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 47% complete... Exporting image: 55% complete... Exporting image: 63% complete... Exporting image: 71% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:13.558 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone38.export 2024-09-21T15:31:13.705 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:13.705 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone38.export 2024-09-21T15:31:13.752 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone38.export 2024-09-21T15:31:13.965 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 47% complete... Exporting image: 55% complete... Exporting image: 63% complete... Exporting image: 71% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:13.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone38.export 2024-09-21T15:31:14.211 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 47% complete... Exporting image: 55% complete... Exporting image: 63% complete... Exporting image: 71% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:14.218 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone38.export 2024-09-21T15:31:14.336 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.325+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b1e0 2024-09-21T15:31:14.344 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.338+0000 7ff753f07700 -1 reset not still connected to 0x5601781912b0 2024-09-21T15:31:14.351 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9860 2024-09-21T15:31:14.351 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.341+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:31:14.353 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.345+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:31:14.353 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.345+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:31:14.359 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.349+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:31:14.359 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.349+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57c70 2024-09-21T15:31:14.360 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.350+0000 7ff753f07700 -1 reset not still connected to 0x56017a16e680 2024-09-21T15:31:14.361 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.354+0000 7ff753f07700 -1 reset not still connected to 0x56017a16edd0 2024-09-21T15:31:14.368 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.357+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d25b0 2024-09-21T15:31:14.369 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.357+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:31:14.369 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.357+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2dd0 2024-09-21T15:31:14.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.365+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3110 2024-09-21T15:31:14.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.365+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3d40 2024-09-21T15:31:14.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.365+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:31:14.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.365+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:31:14.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.365+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:31:14.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.365+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541a00 2024-09-21T15:31:14.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.369+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676270 2024-09-21T15:31:14.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.369+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676340 2024-09-21T15:31:14.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.369+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:31:14.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.369+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676750 2024-09-21T15:31:14.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.369+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36775f0 2024-09-21T15:31:14.379 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.369+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36776c0 2024-09-21T15:31:14.382 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.373+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677930 2024-09-21T15:31:14.382 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.373+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677ba0 2024-09-21T15:31:14.382 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.373+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677e10 2024-09-21T15:31:14.382 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.373+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45280d0 2024-09-21T15:31:14.382 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.373+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528410 2024-09-21T15:31:14.382 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.373+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45285b0 2024-09-21T15:31:14.385 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528680 2024-09-21T15:31:14.385 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45288f0 2024-09-21T15:31:14.385 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528b60 2024-09-21T15:31:14.385 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528d00 2024-09-21T15:31:14.385 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529860 2024-09-21T15:31:14.387 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529e10 2024-09-21T15:31:14.387 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b20d0 2024-09-21T15:31:14.387 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b21a0 2024-09-21T15:31:14.387 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2340 2024-09-21T15:31:14.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2680 2024-09-21T15:31:14.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2820 2024-09-21T15:31:14.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b28f0 2024-09-21T15:31:14.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2ea0 2024-09-21T15:31:14.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:31:14.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3380 2024-09-21T15:31:14.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3520 2024-09-21T15:31:14.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3ba0 2024-09-21T15:31:14.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59cb930 2024-09-21T15:31:14.388 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:14.377+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:31:14.392 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone38.export 2024-09-21T15:31:14.403 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.386+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fad0 2024-09-21T15:31:14.403 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.386+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fd40 2024-09-21T15:31:14.404 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.386+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fe10 2024-09-21T15:31:14.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.402+0000 7ff753f07700 -1 reset not still connected to 0x56017a2045b0 2024-09-21T15:31:14.408 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.402+0000 7ff753f07700 -1 reset not still connected to 0x56017a204b60 2024-09-21T15:31:14.411 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.402+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:31:14.420 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.414+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2410 2024-09-21T15:31:14.420 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.414+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b3040 2024-09-21T15:31:14.420 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.414+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:31:14.420 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.414+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b35f0 2024-09-21T15:31:14.420 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.414+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f20d0 2024-09-21T15:31:14.421 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.414+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:31:14.421 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.414+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:31:14.421 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.414+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:31:14.421 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.414+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:31:14.421 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.414+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3450 2024-09-21T15:31:14.421 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.414+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ad0 2024-09-21T15:31:14.421 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.414+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ba0 2024-09-21T15:31:14.451 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.446+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ee0 2024-09-21T15:31:14.451 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.446+0000 7ff753f07700 -1 reset not still connected to 0x56017a8ccdd0 2024-09-21T15:31:14.451 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.446+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd1e0 2024-09-21T15:31:14.457 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.450+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd5f0 2024-09-21T15:31:14.458 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:14.450+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd930 2024-09-21T15:31:14.518 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:14.518 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:14.518 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone39 2024-09-21T15:31:14.518 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:14.518 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone39 2024-09-21T15:31:14.518 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:14.518 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone39.export 2024-09-21T15:31:14.519 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone39.export 2024-09-21T15:31:14.519 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:14.525 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:14.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone39 2024-09-21T15:31:14.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone39.export 2024-09-21T15:31:14.691 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone39@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone39.export 2024-09-21T15:31:14.890 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 21% complete... Exporting image: 28% complete... Exporting image: 36% complete... Exporting image: 43% complete... Exporting image: 50% complete... Exporting image: 57% complete... Exporting image: 64% complete... Exporting image: 72% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:14.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone39@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone39.export 2024-09-21T15:31:15.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 21% complete... Exporting image: 28% complete... Exporting image: 36% complete... Exporting image: 43% complete... Exporting image: 50% complete... Exporting image: 57% complete... Exporting image: 64% complete... Exporting image: 72% complete... Exporting image: 79% complete... Exporting image: 86% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:15.121 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone39.export 2024-09-21T15:31:15.241 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:15.241 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone39.export 2024-09-21T15:31:15.283 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone39.export 2024-09-21T15:31:15.371 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:15.377 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone39.export 2024-09-21T15:31:15.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:15.495 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone39.export 2024-09-21T15:31:15.498 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone39.export 2024-09-21T15:31:15.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:15.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:15.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone4 2024-09-21T15:31:15.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:15.502 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone4 2024-09-21T15:31:15.502 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:15.502 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone4.export 2024-09-21T15:31:15.502 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone4.export 2024-09-21T15:31:15.502 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone4 2024-09-21T15:31:15.503 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:15.503 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:15.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:15.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone4.export 2024-09-21T15:31:15.572 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone4@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone4.export 2024-09-21T15:31:15.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 25% complete... Exporting image: 37% complete... Exporting image: 50% complete... Exporting image: 63% complete... Exporting image: 75% complete... Exporting image: 88% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:15.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone4@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone4.export 2024-09-21T15:31:16.027 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 12% complete... Exporting image: 25% complete... Exporting image: 37% complete... Exporting image: 50% complete... Exporting image: 63% complete... Exporting image: 75% complete... Exporting image: 88% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:16.034 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone4.export 2024-09-21T15:31:16.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:16.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone4.export 2024-09-21T15:31:16.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone4.export 2024-09-21T15:31:16.216 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:16.221 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone4.export 2024-09-21T15:31:16.487 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:16.495 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone4.export 2024-09-21T15:31:16.496 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone4.export 2024-09-21T15:31:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:16.498 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:16.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone40 2024-09-21T15:31:16.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:16.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone40 2024-09-21T15:31:16.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:16.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone40.export 2024-09-21T15:31:16.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone40.export 2024-09-21T15:31:16.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone40 2024-09-21T15:31:16.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:16.500 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:16.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:16.644 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone40.export 2024-09-21T15:31:16.645 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone40@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone40.export 2024-09-21T15:31:16.822 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 19% complete... Exporting image: 29% complete... Exporting image: 38% complete... Exporting image: 48% complete... Exporting image: 58% complete... Exporting image: 68% complete... Exporting image: 77% complete... Exporting image: 87% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:16.830 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone40@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone40.export 2024-09-21T15:31:17.038 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 19% complete... Exporting image: 29% complete... Exporting image: 38% complete... Exporting image: 48% complete... Exporting image: 58% complete... Exporting image: 68% complete... Exporting image: 77% complete... Exporting image: 87% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:17.047 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone40.export 2024-09-21T15:31:17.081 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:17.081 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone40.export 2024-09-21T15:31:17.094 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone40.export 2024-09-21T15:31:17.248 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 22% complete... Exporting image: 45% complete... Exporting image: 67% complete... Exporting image: 90% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:17.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone40.export 2024-09-21T15:31:17.460 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 22% complete... Exporting image: 45% complete... Exporting image: 67% complete... Exporting image: 90% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:17.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone40.export 2024-09-21T15:31:17.482 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone40.export 2024-09-21T15:31:17.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:17.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:17.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone41 2024-09-21T15:31:17.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:17.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone41 2024-09-21T15:31:17.489 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:17.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone41.export 2024-09-21T15:31:17.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone41.export 2024-09-21T15:31:17.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone41 2024-09-21T15:31:17.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:17.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:17.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:17.652 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone41.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone41.export 2024-09-21T15:31:17.653 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone41@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone41.export 2024-09-21T15:31:18.124 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 68% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:18.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone41@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone41.export 2024-09-21T15:31:18.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 68% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:18.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone41.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone41.export 2024-09-21T15:31:18.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:18.570 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone41.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone41.export 2024-09-21T15:31:18.615 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone41@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone41.export 2024-09-21T15:31:18.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:18.739 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone41@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone41.export 2024-09-21T15:31:18.898 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:18.908 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone41.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone41.export 2024-09-21T15:31:18.915 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone41.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone41.export 2024-09-21T15:31:18.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:18.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:18.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone42 2024-09-21T15:31:18.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:18.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone42 2024-09-21T15:31:18.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:18.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone42.export 2024-09-21T15:31:18.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone42.export 2024-09-21T15:31:18.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone42 2024-09-21T15:31:18.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:18.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:19.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:19.141 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone42.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone42.export 2024-09-21T15:31:19.142 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone42@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone42.export 2024-09-21T15:31:19.336 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.334+0000 7f52f1ba9700 -1 reset not still connected to 0x5571472268f0 2024-09-21T15:31:19.340 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.334+0000 7f52f1ba9700 -1 reset not still connected to 0x557148012ea0 2024-09-21T15:31:19.341 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.334+0000 7f52f1ba9700 -1 reset not still connected to 0x55714821bc70 2024-09-21T15:31:19.346 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.334+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29a820 2024-09-21T15:31:19.353 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.346+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29ad00 2024-09-21T15:31:19.355 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.354+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29bd40 2024-09-21T15:31:19.355 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.354+0000 7f52f1ba9700 -1 reset not still connected to 0x55714a29be10 2024-09-21T15:31:19.357 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.354+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1040 2024-09-21T15:31:19.357 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.354+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1450 2024-09-21T15:31:19.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.366+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1930 2024-09-21T15:31:19.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.366+0000 7f52f1ba9700 -1 reset not still connected to 0x55714abf1d40 2024-09-21T15:31:19.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.366+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3520 2024-09-21T15:31:19.369 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.366+0000 7f52f1ba9700 -1 reset not still connected to 0x55714acb3c70 2024-09-21T15:31:19.374 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.370+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74340 2024-09-21T15:31:19.383 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.374+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad74820 2024-09-21T15:31:19.383 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.374+0000 7f52f1ba9700 -1 reset not still connected to 0x55714ad75ad0 2024-09-21T15:31:19.399 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.394+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f6c0 2024-09-21T15:31:19.399 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.394+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07f860 2024-09-21T15:31:19.399 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.394+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b07fe10 2024-09-21T15:31:19.399 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.394+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1241a0 2024-09-21T15:31:19.426 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.422+0000 7ff753f07700 -1 reset not still connected to 0x56017529bad0 2024-09-21T15:31:19.432 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.430+0000 7ff753f07700 -1 reset not still connected to 0x5601781912b0 2024-09-21T15:31:19.435 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b124680 2024-09-21T15:31:19.436 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b1252b0 2024-09-21T15:31:19.437 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714b125ba0 2024-09-21T15:31:19.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714c0c1ad0 2024-09-21T15:31:19.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe1a0 2024-09-21T15:31:19.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe270 2024-09-21T15:31:19.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe680 2024-09-21T15:31:19.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe8f0 2024-09-21T15:31:19.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3fe9c0 2024-09-21T15:31:19.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ff1e0 2024-09-21T15:31:19.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714f3ff5f0 2024-09-21T15:31:19.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb12dd0 2024-09-21T15:31:19.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb13040 2024-09-21T15:31:19.438 INFO:tasks.ceph.cluster2.osd.1.smithi161.stderr:2024-09-21T15:31:19.434+0000 7f52f1ba9700 -1 reset not still connected to 0x55714fb136c0 2024-09-21T15:31:19.439 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.434+0000 7ff753f07700 -1 reset not still connected to 0x56017a16fd40 2024-09-21T15:31:19.443 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.438+0000 7ff753f07700 -1 reset not still connected to 0x56017a204b60 2024-09-21T15:31:19.444 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.442+0000 7ff753f07700 -1 reset not still connected to 0x56017a205a00 2024-09-21T15:31:19.445 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.442+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b2410 2024-09-21T15:31:19.445 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.442+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b3040 2024-09-21T15:31:19.463 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.458+0000 7ff753f07700 -1 reset not still connected to 0x56017a5b31e0 2024-09-21T15:31:19.463 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.458+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2a90 2024-09-21T15:31:19.463 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.458+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2c30 2024-09-21T15:31:19.463 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.458+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f2dd0 2024-09-21T15:31:19.463 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.458+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3110 2024-09-21T15:31:19.463 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.458+0000 7ff753f07700 -1 reset not still connected to 0x56017a5f3ad0 2024-09-21T15:31:19.488 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.482+0000 7ff753f07700 -1 reset not still connected to 0x56017a8ccdd0 2024-09-21T15:31:19.488 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.482+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd1e0 2024-09-21T15:31:19.488 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.486+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd5f0 2024-09-21T15:31:19.490 INFO:tasks.ceph.cluster2.osd.2.smithi161.stderr:2024-09-21T15:31:19.486+0000 7ff753f07700 -1 reset not still connected to 0x56017a8cd930 2024-09-21T15:31:19.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 27% complete... Exporting image: 55% complete... Exporting image: 83% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:19.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone42@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone42.export 2024-09-21T15:31:19.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 27% complete... Exporting image: 55% complete... Exporting image: 83% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:19.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone42.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone42.export 2024-09-21T15:31:20.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:20.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone42.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone42.export 2024-09-21T15:31:20.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone42@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone42.export 2024-09-21T15:31:20.557 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 27% complete... Exporting image: 55% complete... Exporting image: 83% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:20.564 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone42@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone42.export 2024-09-21T15:31:20.935 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 27% complete... Exporting image: 55% complete... Exporting image: 83% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:20.942 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone42.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone42.export 2024-09-21T15:31:21.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone42.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone42.export 2024-09-21T15:31:21.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:21.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:21.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone43 2024-09-21T15:31:21.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:21.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone43 2024-09-21T15:31:21.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:21.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone43.export 2024-09-21T15:31:21.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone43.export 2024-09-21T15:31:21.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone43 2024-09-21T15:31:21.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:21.140 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:21.329 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:21.329 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone43.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone43.export 2024-09-21T15:31:21.331 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone43@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone43.export 2024-09-21T15:31:21.710 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:21.722 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone43@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone43.export 2024-09-21T15:31:21.884 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.873+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc00546680 2024-09-21T15:31:21.884 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.873+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc0659de10 2024-09-21T15:31:21.884 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.873+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1661af70 2024-09-21T15:31:21.884 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.873+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc17b46b60 2024-09-21T15:31:21.887 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.877+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1bfce270 2024-09-21T15:31:21.887 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.877+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1cf59d40 2024-09-21T15:31:21.888 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.877+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc1f299e10 2024-09-21T15:31:21.903 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.881+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21709c70 2024-09-21T15:31:21.903 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.881+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21712000 2024-09-21T15:31:21.911 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.901+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc21713930 2024-09-21T15:31:21.911 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.901+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2182a5b0 2024-09-21T15:31:21.911 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.901+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc221132b0 2024-09-21T15:31:21.911 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.901+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc22b7a4e0 2024-09-21T15:31:21.911 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.901+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363a410 2024-09-21T15:31:21.918 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363b2b0 2024-09-21T15:31:21.918 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc2363b790 2024-09-21T15:31:21.918 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f2750 2024-09-21T15:31:21.918 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc236f31e0 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0c820 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0d040 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0d860 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc24f0dba0 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb450 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb520 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc264eb790 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2340 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2410 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e24e0 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2680 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2820 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e29c0 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2d00 2024-09-21T15:31:21.919 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e2f70 2024-09-21T15:31:21.920 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e3110 2024-09-21T15:31:21.920 INFO:tasks.ceph.cluster1.osd.1.smithi082.stderr:2024-09-21T15:31:21.909+0000 7f2ef42ce700 -1 reset not still connected to 0x55dc272e35f0 2024-09-21T15:31:22.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:22.186 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone43.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone43.export 2024-09-21T15:31:22.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:22.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone43.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone43.export 2024-09-21T15:31:22.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone43@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone43.export 2024-09-21T15:31:22.664 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 58% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:22.676 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone43@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone43.export 2024-09-21T15:31:23.017 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 58% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:23.027 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone43.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone43.export 2024-09-21T15:31:23.107 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone43.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone43.export 2024-09-21T15:31:23.150 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:23.150 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:23.150 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone44 2024-09-21T15:31:23.150 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:23.150 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone44 2024-09-21T15:31:23.150 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:23.150 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone44.export 2024-09-21T15:31:23.150 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone44.export 2024-09-21T15:31:23.151 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone44 2024-09-21T15:31:23.151 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:23.151 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:23.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:23.223 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone44.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone44.export 2024-09-21T15:31:23.224 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone44@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone44.export 2024-09-21T15:31:23.493 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:23.502 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone44@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone44.export 2024-09-21T15:31:23.793 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:23.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone44.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone44.export 2024-09-21T15:31:23.917 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:23.917 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone44.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone44.export 2024-09-21T15:31:23.965 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone44@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone44.export 2024-09-21T15:31:24.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:24.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone44@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone44.export 2024-09-21T15:31:24.510 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:24.519 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone44.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone44.export 2024-09-21T15:31:24.628 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone44.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone44.export 2024-09-21T15:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone45 2024-09-21T15:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone45 2024-09-21T15:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone45.export 2024-09-21T15:31:24.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone45.export 2024-09-21T15:31:24.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone45 2024-09-21T15:31:24.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:24.679 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:24.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:24.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone45.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone45.export 2024-09-21T15:31:24.750 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone45@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone45.export 2024-09-21T15:31:24.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:24.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone45@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone45.export 2024-09-21T15:31:24.947 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:24.952 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone45.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone45.export 2024-09-21T15:31:24.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:24.969 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone45.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone45.export 2024-09-21T15:31:24.978 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone45@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone45.export 2024-09-21T15:31:25.063 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:25.068 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone45@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone45.export 2024-09-21T15:31:25.167 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:25.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone45.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone45.export 2024-09-21T15:31:25.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone45.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone45.export 2024-09-21T15:31:25.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:25.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:25.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone46 2024-09-21T15:31:25.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:25.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone46 2024-09-21T15:31:25.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:25.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone46.export 2024-09-21T15:31:25.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone46.export 2024-09-21T15:31:25.202 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone46 2024-09-21T15:31:25.202 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:25.202 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:25.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:25.277 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone46.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone46.export 2024-09-21T15:31:25.279 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone46@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone46.export 2024-09-21T15:31:25.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 30% complete... Exporting image: 38% complete... Exporting image: 46% complete... Exporting image: 53% complete... Exporting image: 61% complete... Exporting image: 69% complete... Exporting image: 77% complete... Exporting image: 84% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:25.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone46@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone46.export 2024-09-21T15:31:25.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 30% complete... Exporting image: 38% complete... Exporting image: 46% complete... Exporting image: 53% complete... Exporting image: 61% complete... Exporting image: 69% complete... Exporting image: 77% complete... Exporting image: 84% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:25.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone46.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone46.export 2024-09-21T15:31:25.697 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:25.697 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone46.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone46.export 2024-09-21T15:31:25.725 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone46@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone46.export 2024-09-21T15:31:25.775 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:25.782 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone46@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone46.export 2024-09-21T15:31:25.847 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:25.853 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone46.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone46.export 2024-09-21T15:31:25.855 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone46.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone46.export 2024-09-21T15:31:25.856 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:25.856 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:25.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone47 2024-09-21T15:31:25.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:25.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone47 2024-09-21T15:31:25.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:25.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone47.export 2024-09-21T15:31:25.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone47.export 2024-09-21T15:31:25.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone47 2024-09-21T15:31:25.858 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:25.858 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:26.185 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:26.186 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone47.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone47.export 2024-09-21T15:31:26.187 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone47@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone47.export 2024-09-21T15:31:26.451 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 19% complete... Exporting image: 38% complete... Exporting image: 57% complete... Exporting image: 76% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:26.458 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone47@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone47.export 2024-09-21T15:31:26.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 19% complete... Exporting image: 38% complete... Exporting image: 57% complete... Exporting image: 76% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:26.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone47.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone47.export 2024-09-21T15:31:26.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:26.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone47.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone47.export 2024-09-21T15:31:26.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone47@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone47.export 2024-09-21T15:31:27.094 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:27.102 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone47@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone47.export 2024-09-21T15:31:27.246 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:27.252 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone47.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone47.export 2024-09-21T15:31:27.273 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone47.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone47.export 2024-09-21T15:31:27.284 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:27.284 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:27.284 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone48 2024-09-21T15:31:27.284 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:27.284 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone48 2024-09-21T15:31:27.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:27.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone48.export 2024-09-21T15:31:27.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone48.export 2024-09-21T15:31:27.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone48 2024-09-21T15:31:27.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:27.285 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:27.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:27.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone48.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone48.export 2024-09-21T15:31:27.356 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone48@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone48.export 2024-09-21T15:31:27.494 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 14% complete... Exporting image: 28% complete... Exporting image: 42% complete... Exporting image: 57% complete... Exporting image: 71% complete... Exporting image: 85% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:27.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone48@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone48.export 2024-09-21T15:31:27.637 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 14% complete... Exporting image: 28% complete... Exporting image: 42% complete... Exporting image: 57% complete... Exporting image: 71% complete... Exporting image: 85% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:27.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone48.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone48.export 2024-09-21T15:31:27.725 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:27.725 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone48.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone48.export 2024-09-21T15:31:27.751 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone48@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone48.export 2024-09-21T15:31:27.871 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 14% complete... Exporting image: 28% complete... Exporting image: 42% complete... Exporting image: 57% complete... Exporting image: 71% complete... Exporting image: 85% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:27.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone48@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone48.export 2024-09-21T15:31:28.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 14% complete... Exporting image: 28% complete... Exporting image: 42% complete... Exporting image: 57% complete... Exporting image: 71% complete... Exporting image: 85% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:28.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone48.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone48.export 2024-09-21T15:31:28.308 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone48.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone48.export 2024-09-21T15:31:28.335 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:28.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:28.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone49 2024-09-21T15:31:28.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:28.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone49 2024-09-21T15:31:28.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:28.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone49.export 2024-09-21T15:31:28.336 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone49.export 2024-09-21T15:31:28.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone49 2024-09-21T15:31:28.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:28.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:28.411 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:28.411 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone49.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone49.export 2024-09-21T15:31:28.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone49@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone49.export 2024-09-21T15:31:28.597 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 69% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:28.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone49@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone49.export 2024-09-21T15:31:28.781 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 69% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:28.788 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone49.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone49.export 2024-09-21T15:31:28.981 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:28.981 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone49.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone49.export 2024-09-21T15:31:29.016 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone49@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone49.export 2024-09-21T15:31:29.200 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 69% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:29.210 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone49@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone49.export 2024-09-21T15:31:29.400 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 42% complete... Exporting image: 45% complete... Exporting image: 48% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 69% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:29.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone49.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone49.export 2024-09-21T15:31:29.599 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone49.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone49.export 2024-09-21T15:31:29.645 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:29.645 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:29.645 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone5 2024-09-21T15:31:29.645 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:29.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone5 2024-09-21T15:31:29.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:29.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone5.export 2024-09-21T15:31:29.646 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone5.export 2024-09-21T15:31:29.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone5 2024-09-21T15:31:29.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:29.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:29.776 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:29.776 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone5.export 2024-09-21T15:31:29.778 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone5@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone5.export 2024-09-21T15:31:29.999 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:30.006 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone5@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone5.export 2024-09-21T15:31:30.243 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 87% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:30.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone5.export 2024-09-21T15:31:30.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:30.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone5.export 2024-09-21T15:31:30.474 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone5.export 2024-09-21T15:31:30.579 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:30.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone5.export 2024-09-21T15:31:30.726 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:30.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone5.export 2024-09-21T15:31:30.744 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone5.export 2024-09-21T15:31:30.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:30.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:30.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone50 2024-09-21T15:31:30.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:30.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone50 2024-09-21T15:31:30.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:30.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone50.export 2024-09-21T15:31:30.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone50.export 2024-09-21T15:31:30.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone50 2024-09-21T15:31:30.748 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:30.749 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:30.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:30.840 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone50.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone50.export 2024-09-21T15:31:30.841 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone50@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone50.export 2024-09-21T15:31:31.026 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 12% complete... Exporting image: 18% complete... Exporting image: 24% complete... Exporting image: 30% complete... Exporting image: 36% complete... Exporting image: 42% complete... Exporting image: 48% complete... Exporting image: 54% complete... Exporting image: 60% complete... Exporting image: 66% complete... Exporting image: 72% complete... Exporting image: 78% complete... Exporting image: 85% complete... Exporting image: 91% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:31.031 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone50@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone50.export 2024-09-21T15:31:31.216 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 6% complete... Exporting image: 12% complete... Exporting image: 18% complete... Exporting image: 24% complete... Exporting image: 30% complete... Exporting image: 36% complete... Exporting image: 42% complete... Exporting image: 48% complete... Exporting image: 54% complete... Exporting image: 60% complete... Exporting image: 66% complete... Exporting image: 72% complete... Exporting image: 78% complete... Exporting image: 85% complete... Exporting image: 91% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:31.222 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone50.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone50.export 2024-09-21T15:31:31.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:31.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone50.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone50.export 2024-09-21T15:31:31.354 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone50@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone50.export 2024-09-21T15:31:31.505 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 22% complete... Exporting image: 30% complete... Exporting image: 37% complete... Exporting image: 45% complete... Exporting image: 53% complete... Exporting image: 60% complete... Exporting image: 68% complete... Exporting image: 75% complete... Exporting image: 83% complete... Exporting image: 91% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:31.513 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone50@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone50.export 2024-09-21T15:31:31.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 22% complete... Exporting image: 30% complete... Exporting image: 37% complete... Exporting image: 45% complete... Exporting image: 53% complete... Exporting image: 60% complete... Exporting image: 68% complete... Exporting image: 75% complete... Exporting image: 83% complete... Exporting image: 91% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:31.696 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone50.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone50.export 2024-09-21T15:31:31.778 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone50.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone50.export 2024-09-21T15:31:31.806 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:31.806 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:31.806 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone51 2024-09-21T15:31:31.806 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:31.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone51 2024-09-21T15:31:31.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:31.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone51.export 2024-09-21T15:31:31.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone51.export 2024-09-21T15:31:31.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:31.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone51 2024-09-21T15:31:31.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:31.918 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:31.918 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone51.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone51.export 2024-09-21T15:31:31.919 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone51@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone51.export 2024-09-21T15:31:32.542 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 31% complete... Exporting image: 62% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:32.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone51@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone51.export 2024-09-21T15:31:33.217 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 31% complete... Exporting image: 62% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:33.227 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone51.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone51.export 2024-09-21T15:31:33.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone51.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone51.export 2024-09-21T15:31:33.374 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:33.375 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:33.375 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone6 2024-09-21T15:31:33.375 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:33.375 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone6 2024-09-21T15:31:33.375 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:33.375 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone6.export 2024-09-21T15:31:33.375 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone6.export 2024-09-21T15:31:33.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone6 2024-09-21T15:31:33.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:33.376 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:33.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:33.447 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone6.export 2024-09-21T15:31:33.448 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone6@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone6.export 2024-09-21T15:31:33.655 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 26% complete... Exporting image: 39% complete... Exporting image: 52% complete... Exporting image: 65% complete... Exporting image: 78% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:33.662 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone6@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone6.export 2024-09-21T15:31:33.913 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 13% complete... Exporting image: 26% complete... Exporting image: 39% complete... Exporting image: 52% complete... Exporting image: 65% complete... Exporting image: 78% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:33.925 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone6.export 2024-09-21T15:31:34.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:34.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone6.export 2024-09-21T15:31:34.045 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone6.export 2024-09-21T15:31:34.098 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:34.104 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone6.export 2024-09-21T15:31:34.172 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:34.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone6.export 2024-09-21T15:31:34.180 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone6.export 2024-09-21T15:31:34.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:34.182 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:34.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone7 2024-09-21T15:31:34.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:34.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone7 2024-09-21T15:31:34.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:34.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone7.export 2024-09-21T15:31:34.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone7.export 2024-09-21T15:31:34.183 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone7 2024-09-21T15:31:34.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:34.184 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:34.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b56ff1e0 2024-09-21T15:31:34.442 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.426+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b5f0d860 2024-09-21T15:31:34.447 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.434+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b61d8750 2024-09-21T15:31:34.459 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.446+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b6783c70 2024-09-21T15:31:34.459 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.446+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46340 2024-09-21T15:31:34.459 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.446+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a46c30 2024-09-21T15:31:34.466 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.462+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7a47ee0 2024-09-21T15:31:34.477 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.462+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b7aee1a0 2024-09-21T15:31:34.486 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.482+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83716c0 2024-09-21T15:31:34.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.486+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8371ad0 2024-09-21T15:31:34.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.486+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83864e0 2024-09-21T15:31:34.496 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.490+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8386ea0 2024-09-21T15:31:34.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.490+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8387ee0 2024-09-21T15:31:34.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.490+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839a5b0 2024-09-21T15:31:34.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.490+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b839ad00 2024-09-21T15:31:34.497 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.490+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cca90 2024-09-21T15:31:34.507 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.498+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b83cdad0 2024-09-21T15:31:34.514 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.510+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90a90 2024-09-21T15:31:34.514 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.510+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90c30 2024-09-21T15:31:34.514 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.510+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8b90d00 2024-09-21T15:31:34.520 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.518+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b8fca820 2024-09-21T15:31:34.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.518+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c09c0 2024-09-21T15:31:34.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.518+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c0ea0 2024-09-21T15:31:34.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.518+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c11e0 2024-09-21T15:31:34.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.518+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c12b0 2024-09-21T15:31:34.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.518+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580b95c16c0 2024-09-21T15:31:34.521 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.518+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164000 2024-09-21T15:31:34.522 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.518+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba164dd0 2024-09-21T15:31:34.522 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.518+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1651e0 2024-09-21T15:31:34.522 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.518+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba165930 2024-09-21T15:31:34.522 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.518+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba1f3930 2024-09-21T15:31:34.529 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.518+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4000 2024-09-21T15:31:34.531 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.526+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e4410 2024-09-21T15:31:34.531 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.526+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5860 2024-09-21T15:31:34.531 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.526+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba6e5ee0 2024-09-21T15:31:34.531 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.526+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71f2b0 2024-09-21T15:31:34.531 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.526+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba71fe10 2024-09-21T15:31:34.532 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.526+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8820 2024-09-21T15:31:34.532 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.526+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d8d00 2024-09-21T15:31:34.532 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.526+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580ba7d9ba0 2024-09-21T15:31:34.532 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.530+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb1d28f0 2024-09-21T15:31:34.537 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.534+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35d450 2024-09-21T15:31:34.537 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.534+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb35dc70 2024-09-21T15:31:34.537 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.534+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6e60d0 2024-09-21T15:31:34.537 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.534+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ec820 2024-09-21T15:31:34.537 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.534+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed520 2024-09-21T15:31:34.538 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.534+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb6ed860 2024-09-21T15:31:34.538 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.534+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb72fba0 2024-09-21T15:31:34.538 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.534+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915790 2024-09-21T15:31:34.538 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.534+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb915860 2024-09-21T15:31:34.538 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.534+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bb9d7ba0 2024-09-21T15:31:34.538 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.534+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bbf02820 2024-09-21T15:31:34.538 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.534+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bc4255f0 2024-09-21T15:31:34.541 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.538+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5380 2024-09-21T15:31:34.543 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.542+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b56c0 2024-09-21T15:31:34.543 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.542+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5ad0 2024-09-21T15:31:34.543 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.542+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5c70 2024-09-21T15:31:34.543 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.542+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd1b5ee0 2024-09-21T15:31:34.543 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.542+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c340 2024-09-21T15:31:34.544 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.542+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c4e0 2024-09-21T15:31:34.544 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.542+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26c9c0 2024-09-21T15:31:34.545 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.542+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26cb60 2024-09-21T15:31:34.545 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.542+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d450 2024-09-21T15:31:34.545 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.542+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26d790 2024-09-21T15:31:34.545 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.542+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd26dee0 2024-09-21T15:31:34.547 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.542+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350410 2024-09-21T15:31:34.549 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.546+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3504e0 2024-09-21T15:31:34.549 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.546+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3505b0 2024-09-21T15:31:34.557 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.550+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd350680 2024-09-21T15:31:34.557 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.550+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3508f0 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.550+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd351110 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.550+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bd3511e0 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.550+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd524e0 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.550+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53040 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.550+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd531e0 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.550+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bdd53520 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.550+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5ec30 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.550+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bde5f930 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.554+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626340 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.554+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6268f0 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.554+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be626d00 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.554+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580be6271e0 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.554+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a340 2024-09-21T15:31:34.558 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.554+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a410 2024-09-21T15:31:34.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:34.561 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone7.export 2024-09-21T15:31:34.565 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.554+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91a750 2024-09-21T15:31:34.565 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.554+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b040 2024-09-21T15:31:34.565 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.554+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b110 2024-09-21T15:31:34.565 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.554+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b1e0 2024-09-21T15:31:34.565 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.554+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b450 2024-09-21T15:31:34.565 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.554+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91b520 2024-09-21T15:31:34.565 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bd40 2024-09-21T15:31:34.565 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bf91bee0 2024-09-21T15:31:34.565 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc529c0 2024-09-21T15:31:34.565 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc532b0 2024-09-21T15:31:34.565 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580bfc53380 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008750 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008ea0 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0008f70 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c00091e0 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009c70 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009e10 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0009ee0 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920000 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920680 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0920b60 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921860 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ba0 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0921ee0 2024-09-21T15:31:34.566 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae1a0 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae4e0 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae680 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0cae9c0 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0caf6c0 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e305b0 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30d00 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c0e30ea0 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.558+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f60d0 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6820 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6d00 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f6f70 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f71e0 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7860 2024-09-21T15:31:34.567 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c15f7c70 2024-09-21T15:31:34.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692000 2024-09-21T15:31:34.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692340 2024-09-21T15:31:34.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692410 2024-09-21T15:31:34.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692820 2024-09-21T15:31:34.568 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1692dd0 2024-09-21T15:31:34.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693380 2024-09-21T15:31:34.569 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693450 2024-09-21T15:31:34.570 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone7@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone7.export 2024-09-21T15:31:34.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693860 2024-09-21T15:31:34.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ad0 2024-09-21T15:31:34.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693ba0 2024-09-21T15:31:34.570 INFO:tasks.ceph.cluster2.osd.0.smithi161.stderr:2024-09-21T15:31:34.562+0000 7f6c2fd4d700 -1 reset not still connected to 0x5580c1693e10 2024-09-21T15:31:34.793 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:34.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone7@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone7.export 2024-09-21T15:31:35.080 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:35.093 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone7.export 2024-09-21T15:31:35.300 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:35.300 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone7.export 2024-09-21T15:31:35.338 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone7.export 2024-09-21T15:31:35.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 23% complete... Exporting image: 46% complete... Exporting image: 69% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:35.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone7.export 2024-09-21T15:31:35.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 23% complete... Exporting image: 46% complete... Exporting image: 69% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:35.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone7.export 2024-09-21T15:31:35.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone7.export 2024-09-21T15:31:35.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:35.798 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:35.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone8 2024-09-21T15:31:35.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:35.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone8 2024-09-21T15:31:35.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:35.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone8.export 2024-09-21T15:31:35.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone8.export 2024-09-21T15:31:35.799 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone8 2024-09-21T15:31:35.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:35.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:35.876 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:35.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone8.export 2024-09-21T15:31:35.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone8@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone8.export 2024-09-21T15:31:35.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 22% complete... Exporting image: 28% complete... Exporting image: 34% complete... Exporting image: 40% complete... Exporting image: 45% complete... Exporting image: 51% complete... Exporting image: 57% complete... Exporting image: 63% complete... Exporting image: 68% complete... Exporting image: 74% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 91% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:35.987 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone8@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone8.export 2024-09-21T15:31:36.079 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 22% complete... Exporting image: 28% complete... Exporting image: 34% complete... Exporting image: 40% complete... Exporting image: 45% complete... Exporting image: 51% complete... Exporting image: 57% complete... Exporting image: 63% complete... Exporting image: 68% complete... Exporting image: 74% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 91% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:36.085 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone8.export 2024-09-21T15:31:36.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:36.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone8.export 2024-09-21T15:31:36.163 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone8.export 2024-09-21T15:31:36.244 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 22% complete... Exporting image: 28% complete... Exporting image: 34% complete... Exporting image: 40% complete... Exporting image: 45% complete... Exporting image: 51% complete... Exporting image: 57% complete... Exporting image: 63% complete... Exporting image: 68% complete... Exporting image: 74% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 91% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:36.255 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone8.export 2024-09-21T15:31:36.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 11% complete... Exporting image: 17% complete... Exporting image: 22% complete... Exporting image: 28% complete... Exporting image: 34% complete... Exporting image: 40% complete... Exporting image: 45% complete... Exporting image: 51% complete... Exporting image: 57% complete... Exporting image: 63% complete... Exporting image: 68% complete... Exporting image: 74% complete... Exporting image: 80% complete... Exporting image: 86% complete... Exporting image: 91% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:36.348 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone8.export 2024-09-21T15:31:36.411 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone8.export 2024-09-21T15:31:36.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:36.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:36.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.4-clone9 2024-09-21T15:31:36.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:36.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.4-clone9 2024-09-21T15:31:36.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:36.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone9.export 2024-09-21T15:31:36.428 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone9.export 2024-09-21T15:31:36.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.4-clone9 2024-09-21T15:31:36.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:36.429 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:36.497 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:36.497 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone9.export 2024-09-21T15:31:36.498 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone9@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone9.export 2024-09-21T15:31:36.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 18% complete... Exporting image: 23% complete... Exporting image: 28% complete... Exporting image: 33% complete... Exporting image: 37% complete... Exporting image: 42% complete... Exporting image: 47% complete... Exporting image: 51% complete... Exporting image: 56% complete... Exporting image: 61% complete... Exporting image: 66% complete... Exporting image: 70% complete... Exporting image: 75% complete... Exporting image: 80% complete... Exporting image: 85% complete... Exporting image: 89% complete... Exporting image: 94% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:36.769 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone9@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone9.export 2024-09-21T15:31:37.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 9% complete... Exporting image: 14% complete... Exporting image: 18% complete... Exporting image: 23% complete... Exporting image: 28% complete... Exporting image: 33% complete... Exporting image: 37% complete... Exporting image: 42% complete... Exporting image: 47% complete... Exporting image: 51% complete... Exporting image: 56% complete... Exporting image: 61% complete... Exporting image: 66% complete... Exporting image: 70% complete... Exporting image: 75% complete... Exporting image: 80% complete... Exporting image: 85% complete... Exporting image: 89% complete... Exporting image: 94% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:37.035 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone9.export 2024-09-21T15:31:37.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:37.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone9.export 2024-09-21T15:31:37.193 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.4-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone9.export 2024-09-21T15:31:37.249 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:37.254 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.4-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone9.export 2024-09-21T15:31:37.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:37.324 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone9.export 2024-09-21T15:31:37.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.4-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.4-clone9.export 2024-09-21T15:31:37.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:37.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:37.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5 2024-09-21T15:31:37.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:37.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5 2024-09-21T15:31:37.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:37.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5.export 2024-09-21T15:31:37.328 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5.export 2024-09-21T15:31:37.329 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5 2024-09-21T15:31:37.329 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:37.329 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:37.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:37.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5.export 2024-09-21T15:31:37.401 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5.export 2024-09-21T15:31:37.556 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:37.562 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5.export 2024-09-21T15:31:37.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:37.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5.export 2024-09-21T15:31:37.909 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:37.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5.export 2024-09-21T15:31:37.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5.export 2024-09-21T15:31:38.114 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:38.119 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5.export 2024-09-21T15:31:38.305 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:38.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5.export 2024-09-21T15:31:38.491 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5.export 2024-09-21T15:31:38.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:38.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:38.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone1 2024-09-21T15:31:38.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:38.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone1 2024-09-21T15:31:38.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:38.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone1.export 2024-09-21T15:31:38.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone1.export 2024-09-21T15:31:38.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone1 2024-09-21T15:31:38.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:38.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:38.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:38.622 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone1.export 2024-09-21T15:31:38.623 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone1@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone1.export 2024-09-21T15:31:38.852 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 47% complete... Exporting image: 55% complete... Exporting image: 63% complete... Exporting image: 71% complete... Exporting image: 78% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:38.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone1@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone1.export 2024-09-21T15:31:39.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 47% complete... Exporting image: 55% complete... Exporting image: 63% complete... Exporting image: 71% complete... Exporting image: 78% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:39.052 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone1.export 2024-09-21T15:31:39.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:39.125 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone1.export 2024-09-21T15:31:39.150 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone1.export 2024-09-21T15:31:39.399 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 47% complete... Exporting image: 55% complete... Exporting image: 63% complete... Exporting image: 71% complete... Exporting image: 78% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:39.407 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone1@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone1.export 2024-09-21T15:31:39.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 47% complete... Exporting image: 55% complete... Exporting image: 63% complete... Exporting image: 71% complete... Exporting image: 78% complete... Exporting image: 86% complete... Exporting image: 94% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:39.599 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone1.export 2024-09-21T15:31:39.668 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone1.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone1.export 2024-09-21T15:31:39.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:39.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:39.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone10 2024-09-21T15:31:39.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:39.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone10 2024-09-21T15:31:39.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:39.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone10.export 2024-09-21T15:31:39.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone10.export 2024-09-21T15:31:39.695 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone10 2024-09-21T15:31:39.695 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:39.695 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:39.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:39.766 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone10.export 2024-09-21T15:31:39.767 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone10@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone10.export 2024-09-21T15:31:39.974 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 16% complete... Exporting image: 32% complete... Exporting image: 48% complete... Exporting image: 65% complete... Exporting image: 81% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:39.981 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone10@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone10.export 2024-09-21T15:31:40.228 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 16% complete... Exporting image: 32% complete... Exporting image: 48% complete... Exporting image: 65% complete... Exporting image: 81% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:40.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone10.export 2024-09-21T15:31:40.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:40.349 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone10.export 2024-09-21T15:31:40.383 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone10.export 2024-09-21T15:31:40.437 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:40.444 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone10@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone10.export 2024-09-21T15:31:40.502 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:40.508 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone10.export 2024-09-21T15:31:40.510 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone10.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone10.export 2024-09-21T15:31:40.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:40.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:40.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone11 2024-09-21T15:31:40.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:40.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone11 2024-09-21T15:31:40.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:40.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone11.export 2024-09-21T15:31:40.512 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone11.export 2024-09-21T15:31:40.513 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone11 2024-09-21T15:31:40.513 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:40.513 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:40.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:40.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone11.export 2024-09-21T15:31:40.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone11@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone11.export 2024-09-21T15:31:40.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:40.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone11@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone11.export 2024-09-21T15:31:41.211 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:41.217 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone11.export 2024-09-21T15:31:41.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:41.368 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone11.export 2024-09-21T15:31:41.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone11.export 2024-09-21T15:31:41.606 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:41.616 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone11@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone11.export 2024-09-21T15:31:41.814 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 51% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:41.824 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone11.export 2024-09-21T15:31:41.973 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone11.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone11.export 2024-09-21T15:31:42.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:42.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:42.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone12 2024-09-21T15:31:42.014 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:42.015 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone12 2024-09-21T15:31:42.015 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:42.015 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone12.export 2024-09-21T15:31:42.015 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone12.export 2024-09-21T15:31:42.015 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone12 2024-09-21T15:31:42.015 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:42.015 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:42.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:42.083 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone12.export 2024-09-21T15:31:42.084 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone12@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone12.export 2024-09-21T15:31:42.341 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 41% complete... Exporting image: 83% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:42.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone12@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone12.export 2024-09-21T15:31:42.650 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 41% complete... Exporting image: 83% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:42.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone12.export 2024-09-21T15:31:42.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:42.783 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone12.export 2024-09-21T15:31:42.839 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone12.export 2024-09-21T15:31:42.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:42.918 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone12@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone12.export 2024-09-21T15:31:42.981 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:42.988 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone12.export 2024-09-21T15:31:42.990 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone12.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone12.export 2024-09-21T15:31:42.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:42.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:42.991 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone13 2024-09-21T15:31:42.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:42.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone13 2024-09-21T15:31:42.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:42.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone13.export 2024-09-21T15:31:42.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone13.export 2024-09-21T15:31:42.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone13 2024-09-21T15:31:42.992 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:42.993 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:43.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:43.101 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone13.export 2024-09-21T15:31:43.102 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone13@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone13.export 2024-09-21T15:31:43.302 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:43.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone13@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone13.export 2024-09-21T15:31:43.510 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:43.519 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone13.export 2024-09-21T15:31:43.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:43.567 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone13.export 2024-09-21T15:31:43.592 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone13.export 2024-09-21T15:31:43.680 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:43.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone13@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone13.export 2024-09-21T15:31:43.796 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:43.805 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone13.export 2024-09-21T15:31:43.807 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone13.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone13.export 2024-09-21T15:31:43.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:43.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:43.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone14 2024-09-21T15:31:43.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:43.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone14 2024-09-21T15:31:43.809 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:43.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone14.export 2024-09-21T15:31:43.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone14.export 2024-09-21T15:31:43.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone14 2024-09-21T15:31:43.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:43.811 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:43.945 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:43.945 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone14.export 2024-09-21T15:31:43.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone14@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone14.export 2024-09-21T15:31:44.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 24% complete... Exporting image: 48% complete... Exporting image: 72% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:44.204 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone14@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone14.export 2024-09-21T15:31:44.491 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 24% complete... Exporting image: 48% complete... Exporting image: 72% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:44.499 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone14.export 2024-09-21T15:31:44.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:44.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone14.export 2024-09-21T15:31:44.677 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone14.export 2024-09-21T15:31:44.929 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 24% complete... Exporting image: 48% complete... Exporting image: 72% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:44.941 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone14@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone14.export 2024-09-21T15:31:45.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 24% complete... Exporting image: 48% complete... Exporting image: 72% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:45.241 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone14.export 2024-09-21T15:31:45.374 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone14.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone14.export 2024-09-21T15:31:45.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:45.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:45.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone15 2024-09-21T15:31:45.421 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:45.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone15 2024-09-21T15:31:45.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:45.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone15.export 2024-09-21T15:31:45.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone15.export 2024-09-21T15:31:45.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone15 2024-09-21T15:31:45.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:45.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:45.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:45.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone15.export 2024-09-21T15:31:45.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone15@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone15.export 2024-09-21T15:31:45.927 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:45.939 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone15@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone15.export 2024-09-21T15:31:46.303 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:46.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone15.export 2024-09-21T15:31:46.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:46.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone15.export 2024-09-21T15:31:46.465 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone15.export 2024-09-21T15:31:46.573 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:46.582 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone15@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone15.export 2024-09-21T15:31:46.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:46.744 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone15.export 2024-09-21T15:31:46.751 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone15.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone15.export 2024-09-21T15:31:46.754 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:46.754 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:46.754 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone16 2024-09-21T15:31:46.754 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:46.754 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone16 2024-09-21T15:31:46.754 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:46.754 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone16.export 2024-09-21T15:31:46.754 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone16.export 2024-09-21T15:31:46.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone16 2024-09-21T15:31:46.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:46.755 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:46.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:46.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone16.export 2024-09-21T15:31:46.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone16@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone16.export 2024-09-21T15:31:47.017 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 46% complete... Exporting image: 54% complete... Exporting image: 62% complete... Exporting image: 70% complete... Exporting image: 78% complete... Exporting image: 85% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:47.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone16@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone16.export 2024-09-21T15:31:47.405 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 46% complete... Exporting image: 54% complete... Exporting image: 62% complete... Exporting image: 70% complete... Exporting image: 78% complete... Exporting image: 85% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:47.412 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone16.export 2024-09-21T15:31:47.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:47.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone16.export 2024-09-21T15:31:47.575 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone16.export 2024-09-21T15:31:47.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 46% complete... Exporting image: 54% complete... Exporting image: 62% complete... Exporting image: 70% complete... Exporting image: 78% complete... Exporting image: 85% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:47.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone16@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone16.export 2024-09-21T15:31:47.917 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 15% complete... Exporting image: 23% complete... Exporting image: 31% complete... Exporting image: 39% complete... Exporting image: 46% complete... Exporting image: 54% complete... Exporting image: 62% complete... Exporting image: 70% complete... Exporting image: 78% complete... Exporting image: 85% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:47.924 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone16.export 2024-09-21T15:31:48.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone16.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone16.export 2024-09-21T15:31:48.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:48.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:48.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone17 2024-09-21T15:31:48.088 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone17 2024-09-21T15:31:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone17.export 2024-09-21T15:31:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone17.export 2024-09-21T15:31:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone17 2024-09-21T15:31:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:48.089 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:48.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:48.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone17.export 2024-09-21T15:31:48.158 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone17@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone17.export 2024-09-21T15:31:48.234 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:48.239 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone17@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone17.export 2024-09-21T15:31:48.311 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:31:48.311 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:31:48.311 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.304+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:31:48.313 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.308+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:31:48.313 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.308+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:31:48.313 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.308+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:31:48.318 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:31:48.318 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.312+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:31:48.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:48.328 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.324+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677e10 2024-09-21T15:31:48.332 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone17.export 2024-09-21T15:31:48.341 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.336+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2340 2024-09-21T15:31:48.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:48.344 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone17.export 2024-09-21T15:31:48.346 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.336+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2ea0 2024-09-21T15:31:48.346 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.336+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:31:48.346 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.336+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:31:48.351 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone17.export 2024-09-21T15:31:48.433 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:48.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone17@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone17.export 2024-09-21T15:31:48.518 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.512+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:31:48.518 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.512+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:31:48.518 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.512+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9cc30 2024-09-21T15:31:48.518 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.512+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:31:48.518 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.512+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288000 2024-09-21T15:31:48.518 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.512+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2881a0 2024-09-21T15:31:48.527 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.524+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288c30 2024-09-21T15:31:48.534 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.524+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:31:48.534 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.524+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf9d40 2024-09-21T15:31:48.534 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.524+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:31:48.546 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.536+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:31:48.548 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.540+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68dd0 2024-09-21T15:31:48.560 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.556+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:31:48.560 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.556+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af310dd0 2024-09-21T15:31:48.561 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.556+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afb6a820 2024-09-21T15:31:48.565 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.560+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7aea0 2024-09-21T15:31:48.568 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.564+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7af70 2024-09-21T15:31:48.568 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.564+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b1e0 2024-09-21T15:31:48.568 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.564+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:31:48.568 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.564+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:31:48.576 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.572+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:31:48.576 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.572+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57c70 2024-09-21T15:31:48.579 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.572+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d25b0 2024-09-21T15:31:48.579 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.572+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:31:48.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.572+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3d40 2024-09-21T15:31:48.580 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.572+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:31:48.585 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.580+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:31:48.586 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.580+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:31:48.589 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.584+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676340 2024-09-21T15:31:48.589 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.584+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:31:48.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:48.610 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone17.export 2024-09-21T15:31:48.612 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676750 2024-09-21T15:31:48.612 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36775f0 2024-09-21T15:31:48.612 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36776c0 2024-09-21T15:31:48.612 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528410 2024-09-21T15:31:48.612 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45285b0 2024-09-21T15:31:48.613 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45288f0 2024-09-21T15:31:48.613 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529860 2024-09-21T15:31:48.613 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b20d0 2024-09-21T15:31:48.613 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2340 2024-09-21T15:31:48.613 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:31:48.613 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3380 2024-09-21T15:31:48.613 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59cb930 2024-09-21T15:31:48.613 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:31:48.614 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f66c30 2024-09-21T15:31:48.614 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67040 2024-09-21T15:31:48.614 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67450 2024-09-21T15:31:48.614 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x562873f67ee0 2024-09-21T15:31:48.615 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f6340 2024-09-21T15:31:48.615 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f6b60 2024-09-21T15:31:48.615 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7790 2024-09-21T15:31:48.615 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x5628806f7860 2024-09-21T15:31:48.615 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.608+0000 7f1e9c77a700 -1 reset not still connected to 0x56288f28e270 2024-09-21T15:31:48.617 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.612+0000 7f1e9c77a700 -1 reset not still connected to 0x56289f998270 2024-09-21T15:31:48.618 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.612+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a33235f0 2024-09-21T15:31:48.618 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.612+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4072000 2024-09-21T15:31:48.618 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.612+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a4580dd0 2024-09-21T15:31:48.618 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.612+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a6ec6410 2024-09-21T15:31:48.620 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a89d1ba0 2024-09-21T15:31:48.620 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f0410 2024-09-21T15:31:48.620 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f16c0 2024-09-21T15:31:48.621 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a98f1c70 2024-09-21T15:31:48.621 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone17.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone17.export 2024-09-21T15:31:48.624 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628a9c9cc30 2024-09-21T15:31:48.624 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aa86fe10 2024-09-21T15:31:48.624 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aab16410 2024-09-21T15:31:48.624 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab1e96c0 2024-09-21T15:31:48.624 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab235380 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ab274c30 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288000 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2881a0 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac288c30 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac2892b0 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628ac289ee0 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeaf9d40 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb00270 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aeb01040 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68dd0 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee68ea0 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69860 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628aee69c70 2024-09-21T15:31:48.625 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26cdd0 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af26d860 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628af310dd0 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afb6a820 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7a4e0 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7aea0 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7af70 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afe7b1e0 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef8b60 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9860 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9a00 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628afef9d40 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:31:48.626 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f57c70 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d25b0 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d3d40 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3541a00 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676340 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676750 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36775f0 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b36776c0 2024-09-21T15:31:48.627 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677930 2024-09-21T15:31:48.628 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3677e10 2024-09-21T15:31:48.628 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45280d0 2024-09-21T15:31:48.628 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528410 2024-09-21T15:31:48.628 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45285b0 2024-09-21T15:31:48.628 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b45288f0 2024-09-21T15:31:48.628 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4528d00 2024-09-21T15:31:48.628 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b4529860 2024-09-21T15:31:48.628 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b20d0 2024-09-21T15:31:48.628 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2340 2024-09-21T15:31:48.628 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b2ea0 2024-09-21T15:31:48.628 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b32b0 2024-09-21T15:31:48.628 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b48b3380 2024-09-21T15:31:48.628 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b59cb930 2024-09-21T15:31:48.629 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:31:48.616+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:31:48.629 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:48.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:48.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone18 2024-09-21T15:31:48.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:48.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone18 2024-09-21T15:31:48.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:48.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone18.export 2024-09-21T15:31:48.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone18.export 2024-09-21T15:31:48.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:48.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone18 2024-09-21T15:31:48.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:48.723 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:48.723 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone18.export 2024-09-21T15:31:48.725 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone18@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone18.export 2024-09-21T15:31:48.989 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 19% complete... Exporting image: 28% complete... Exporting image: 38% complete... Exporting image: 48% complete... Exporting image: 57% complete... Exporting image: 67% complete... Exporting image: 77% complete... Exporting image: 86% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:48.996 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone18@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone18.export 2024-09-21T15:31:49.261 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 9% complete... Exporting image: 19% complete... Exporting image: 28% complete... Exporting image: 38% complete... Exporting image: 48% complete... Exporting image: 57% complete... Exporting image: 67% complete... Exporting image: 77% complete... Exporting image: 86% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:49.268 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone18.export 2024-09-21T15:31:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:49.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone18.export 2024-09-21T15:31:49.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone18.export 2024-09-21T15:31:49.614 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:49.620 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone18@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone18.export 2024-09-21T15:31:49.729 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:49.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone18.export 2024-09-21T15:31:49.747 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone18.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone18.export 2024-09-21T15:31:49.752 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:49.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:49.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone19 2024-09-21T15:31:49.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:49.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone19 2024-09-21T15:31:49.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:49.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone19.export 2024-09-21T15:31:49.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone19.export 2024-09-21T15:31:49.753 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone19 2024-09-21T15:31:49.754 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:49.754 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:49.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:49.828 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone19.export 2024-09-21T15:31:49.829 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone19@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone19.export 2024-09-21T15:31:49.953 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 16% complete... Exporting image: 21% complete... Exporting image: 27% complete... Exporting image: 32% complete... Exporting image: 37% complete... Exporting image: 43% complete... Exporting image: 48% complete... Exporting image: 54% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 70% complete... Exporting image: 75% complete... Exporting image: 81% complete... Exporting image: 86% complete... Exporting image: 91% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:49.961 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone19@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone19.export 2024-09-21T15:31:50.154 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 16% complete... Exporting image: 21% complete... Exporting image: 27% complete... Exporting image: 32% complete... Exporting image: 37% complete... Exporting image: 43% complete... Exporting image: 48% complete... Exporting image: 54% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 70% complete... Exporting image: 75% complete... Exporting image: 81% complete... Exporting image: 86% complete... Exporting image: 91% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:50.168 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone19.export 2024-09-21T15:31:50.272 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:50.272 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone19.export 2024-09-21T15:31:50.293 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone19.export 2024-09-21T15:31:50.398 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 16% complete... Exporting image: 21% complete... Exporting image: 27% complete... Exporting image: 32% complete... Exporting image: 37% complete... Exporting image: 43% complete... Exporting image: 48% complete... Exporting image: 54% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 70% complete... Exporting image: 75% complete... Exporting image: 81% complete... Exporting image: 86% complete... Exporting image: 91% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:50.403 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone19@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone19.export 2024-09-21T15:31:50.524 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 16% complete... Exporting image: 21% complete... Exporting image: 27% complete... Exporting image: 32% complete... Exporting image: 37% complete... Exporting image: 43% complete... Exporting image: 48% complete... Exporting image: 54% complete... Exporting image: 59% complete... Exporting image: 64% complete... Exporting image: 70% complete... Exporting image: 75% complete... Exporting image: 81% complete... Exporting image: 86% complete... Exporting image: 91% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:50.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone19.export 2024-09-21T15:31:50.636 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone19.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone19.export 2024-09-21T15:31:50.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:50.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:50.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone2 2024-09-21T15:31:50.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:50.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone2 2024-09-21T15:31:50.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:50.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone2.export 2024-09-21T15:31:50.660 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone2.export 2024-09-21T15:31:50.661 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone2 2024-09-21T15:31:50.661 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:50.661 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:50.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:50.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone2.export 2024-09-21T15:31:50.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone2@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone2.export 2024-09-21T15:31:50.857 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:50.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone2@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone2.export 2024-09-21T15:31:50.997 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:51.008 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone2.export 2024-09-21T15:31:51.176 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:51.176 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone2.export 2024-09-21T15:31:51.211 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone2.export 2024-09-21T15:31:51.333 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:51.339 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone2@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone2.export 2024-09-21T15:31:51.462 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:51.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone2.export 2024-09-21T15:31:51.633 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone2.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone2.export 2024-09-21T15:31:51.667 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:51.667 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:51.668 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone20 2024-09-21T15:31:51.668 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:51.668 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone20 2024-09-21T15:31:51.668 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:51.668 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone20.export 2024-09-21T15:31:51.668 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone20.export 2024-09-21T15:31:51.668 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone20 2024-09-21T15:31:51.668 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:51.669 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:51.698 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.6119832699343983) > weight (0.25) 2024-09-21T15:31:51.698 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.1 2024-09-21T15:31:51.698 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Sent signal 15 2024-09-21T15:31:51.699 INFO:tasks.rbd_mirror_thrash:waiting for 2 secs before reviving daemons 2024-09-21T15:31:51.699 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:31:51.697+0000 7f442df36700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 (PID: 103329) UID: 1000 2024-09-21T15:31:51.733 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:51.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone20.export 2024-09-21T15:31:51.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone20@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone20.export 2024-09-21T15:31:51.887 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:51.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone20@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone20.export 2024-09-21T15:31:52.251 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:52.257 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone20.export 2024-09-21T15:31:52.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:52.380 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone20.export 2024-09-21T15:31:52.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone20.export 2024-09-21T15:31:52.536 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:52.542 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone20@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone20.export 2024-09-21T15:31:52.703 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:52.709 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone20.export 2024-09-21T15:31:52.833 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone20.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone20.export 2024-09-21T15:31:52.862 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:52.862 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:52.862 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone21 2024-09-21T15:31:52.862 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:52.862 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone21 2024-09-21T15:31:52.862 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:52.862 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone21.export 2024-09-21T15:31:52.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone21.export 2024-09-21T15:31:52.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone21 2024-09-21T15:31:52.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:52.863 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:52.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:52.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone21.export 2024-09-21T15:31:52.952 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone21@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone21.export 2024-09-21T15:31:53.059 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:53.065 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone21@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone21.export 2024-09-21T15:31:53.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 66% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:53.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone21.export 2024-09-21T15:31:53.329 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:53.330 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone21.export 2024-09-21T15:31:53.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone21.export 2024-09-21T15:31:53.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:53.423 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone21@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone21.export 2024-09-21T15:31:53.519 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:53.527 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone21.export 2024-09-21T15:31:53.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone21.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone21.export 2024-09-21T15:31:53.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:53.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:53.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone22 2024-09-21T15:31:53.533 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:53.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone22 2024-09-21T15:31:53.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:53.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone22.export 2024-09-21T15:31:53.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone22.export 2024-09-21T15:31:53.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone22 2024-09-21T15:31:53.534 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:53.535 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:53.645 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:53.645 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone22.export 2024-09-21T15:31:53.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone22@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone22.export 2024-09-21T15:31:53.699 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.1 2024-09-21T15:31:53.699 INFO:teuthology.orchestra.run:waiting for 600 2024-09-21T15:31:53.699 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.1 2024-09-21T15:31:53.699 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2024-09-21T15:31:53.700 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2024-09-21T15:31:53.702 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2024-09-21T15:31:53.702 INFO:tasks.rbd_mirror_thrash:waiting for 106 secs before thrashing 2024-09-21T15:31:53.880 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 33% complete... Exporting image: 67% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:53.890 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone22@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone22.export 2024-09-21T15:31:54.108 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 33% complete... Exporting image: 67% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:54.116 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone22.export 2024-09-21T15:31:54.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:54.226 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone22.export 2024-09-21T15:31:54.263 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone22.export 2024-09-21T15:31:54.396 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:54.404 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone22@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone22.export 2024-09-21T15:31:54.557 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:54.563 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone22.export 2024-09-21T15:31:54.586 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone22.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone22.export 2024-09-21T15:31:54.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:54.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:54.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone23 2024-09-21T15:31:54.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:54.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone23 2024-09-21T15:31:54.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:54.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone23.export 2024-09-21T15:31:54.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone23.export 2024-09-21T15:31:54.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone23 2024-09-21T15:31:54.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:54.606 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:54.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:54.740 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone23.export 2024-09-21T15:31:54.742 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone23@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone23.export 2024-09-21T15:31:54.972 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 13% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 26% complete... Exporting image: 30% complete... Exporting image: 34% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 48% complete... Exporting image: 52% complete... Exporting image: 56% complete... Exporting image: 61% complete... Exporting image: 65% complete... Exporting image: 69% complete... Exporting image: 74% complete... Exporting image: 78% complete... Exporting image: 83% complete... Exporting image: 87% complete... Exporting image: 91% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:54.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone23@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone23.export 2024-09-21T15:31:55.272 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 4% complete... Exporting image: 8% complete... Exporting image: 13% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 26% complete... Exporting image: 30% complete... Exporting image: 34% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 48% complete... Exporting image: 52% complete... Exporting image: 56% complete... Exporting image: 61% complete... Exporting image: 65% complete... Exporting image: 69% complete... Exporting image: 74% complete... Exporting image: 78% complete... Exporting image: 83% complete... Exporting image: 87% complete... Exporting image: 91% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:55.282 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone23.export 2024-09-21T15:31:55.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:55.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone23.export 2024-09-21T15:31:55.442 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone23.export 2024-09-21T15:31:55.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:55.566 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone23@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone23.export 2024-09-21T15:31:55.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:55.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone23.export 2024-09-21T15:31:55.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone23.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone23.export 2024-09-21T15:31:55.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:55.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:55.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone24 2024-09-21T15:31:55.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:55.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone24 2024-09-21T15:31:55.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:55.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone24.export 2024-09-21T15:31:55.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone24.export 2024-09-21T15:31:55.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone24 2024-09-21T15:31:55.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:55.738 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:55.890 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:55.890 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone24.export 2024-09-21T15:31:55.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone24@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone24.export 2024-09-21T15:31:56.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 64% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:56.143 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone24@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone24.export 2024-09-21T15:31:56.431 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 64% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:56.439 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone24.export 2024-09-21T15:31:56.529 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:56.529 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone24.export 2024-09-21T15:31:56.560 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone24.export 2024-09-21T15:31:56.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:56.732 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone24@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone24.export 2024-09-21T15:31:56.937 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:56.945 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone24.export 2024-09-21T15:31:56.964 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone24.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone24.export 2024-09-21T15:31:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone25 2024-09-21T15:31:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone25 2024-09-21T15:31:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:56.976 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone25.export 2024-09-21T15:31:56.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone25.export 2024-09-21T15:31:56.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone25 2024-09-21T15:31:56.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:56.977 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:57.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:57.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone25.export 2024-09-21T15:31:57.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone25@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone25.export 2024-09-21T15:31:57.354 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 44% complete... Exporting image: 89% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:57.366 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone25@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone25.export 2024-09-21T15:31:57.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 44% complete... Exporting image: 89% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:57.681 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone25.export 2024-09-21T15:31:57.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:57.760 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone25.export 2024-09-21T15:31:57.794 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone25.export 2024-09-21T15:31:57.845 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:57.851 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone25@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone25.export 2024-09-21T15:31:57.909 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:57.917 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone25.export 2024-09-21T15:31:57.918 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone25.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone25.export 2024-09-21T15:31:57.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:57.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:57.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone26 2024-09-21T15:31:57.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:57.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone26 2024-09-21T15:31:57.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:57.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone26.export 2024-09-21T15:31:57.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone26.export 2024-09-21T15:31:57.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone26 2024-09-21T15:31:57.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:57.921 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:57.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:57.994 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone26.export 2024-09-21T15:31:57.995 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone26@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone26.export 2024-09-21T15:31:58.200 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:58.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone26@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone26.export 2024-09-21T15:31:58.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:58.495 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone26.export 2024-09-21T15:31:58.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:58.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone26.export 2024-09-21T15:31:58.541 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone26.export 2024-09-21T15:31:58.599 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:58.605 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone26@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone26.export 2024-09-21T15:31:58.677 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:58.685 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone26.export 2024-09-21T15:31:58.686 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone26.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone26.export 2024-09-21T15:31:58.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:31:58.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:31:58.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone27 2024-09-21T15:31:58.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:31:58.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone27 2024-09-21T15:31:58.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:31:58.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone27.export 2024-09-21T15:31:58.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone27.export 2024-09-21T15:31:58.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone27 2024-09-21T15:31:58.689 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:31:58.690 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:31:58.909 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:58.909 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone27.export 2024-09-21T15:31:58.910 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone27@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone27.export 2024-09-21T15:31:59.139 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 14% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 42% complete... Exporting image: 46% complete... Exporting image: 49% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 74% complete... Exporting image: 77% complete... Exporting image: 81% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:59.149 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone27@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone27.export 2024-09-21T15:31:59.501 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 14% complete... Exporting image: 17% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 35% complete... Exporting image: 38% complete... Exporting image: 42% complete... Exporting image: 46% complete... Exporting image: 49% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 74% complete... Exporting image: 77% complete... Exporting image: 81% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:31:59.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone27.export 2024-09-21T15:31:59.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:31:59.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone27.export 2024-09-21T15:31:59.657 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone27.export 2024-09-21T15:31:59.808 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:31:59.818 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone27@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone27.export 2024-09-21T15:32:00.036 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:00.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone27.export 2024-09-21T15:32:00.053 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone27.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone27.export 2024-09-21T15:32:00.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:00.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:00.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone28 2024-09-21T15:32:00.055 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:00.056 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone28 2024-09-21T15:32:00.056 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:00.056 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone28.export 2024-09-21T15:32:00.056 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone28.export 2024-09-21T15:32:00.056 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone28 2024-09-21T15:32:00.056 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:00.056 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:00.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:00.434 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone28.export 2024-09-21T15:32:00.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone28@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone28.export 2024-09-21T15:32:00.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 14% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 32% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 61% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 83% complete... Exporting image: 86% complete... Exporting image: 90% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:00.912 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone28@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone28.export 2024-09-21T15:32:01.406 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 7% complete... Exporting image: 10% complete... Exporting image: 14% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 32% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 54% complete... Exporting image: 57% complete... Exporting image: 61% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 72% complete... Exporting image: 75% complete... Exporting image: 79% complete... Exporting image: 83% complete... Exporting image: 86% complete... Exporting image: 90% complete... Exporting image: 94% complete... Exporting image: 97% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:01.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone28.export 2024-09-21T15:32:01.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:01.587 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone28.export 2024-09-21T15:32:01.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone28.export 2024-09-21T15:32:02.008 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 22% complete... Exporting image: 29% complete... Exporting image: 36% complete... Exporting image: 44% complete... Exporting image: 51% complete... Exporting image: 58% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 88% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:02.017 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone28@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone28.export 2024-09-21T15:32:02.426 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 7% complete... Exporting image: 14% complete... Exporting image: 22% complete... Exporting image: 29% complete... Exporting image: 36% complete... Exporting image: 44% complete... Exporting image: 51% complete... Exporting image: 58% complete... Exporting image: 66% complete... Exporting image: 73% complete... Exporting image: 80% complete... Exporting image: 88% complete... Exporting image: 95% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:02.435 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone28.export 2024-09-21T15:32:02.509 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone28.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone28.export 2024-09-21T15:32:02.538 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:02.538 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:02.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone29 2024-09-21T15:32:02.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:02.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone29 2024-09-21T15:32:02.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:02.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone29.export 2024-09-21T15:32:02.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone29.export 2024-09-21T15:32:02.539 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone29 2024-09-21T15:32:02.540 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:02.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:02.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone29.export 2024-09-21T15:32:02.610 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone29@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone29.export 2024-09-21T15:32:02.777 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 18% complete... Exporting image: 37% complete... Exporting image: 56% complete... Exporting image: 75% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:02.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone29@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone29.export 2024-09-21T15:32:02.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 18% complete... Exporting image: 37% complete... Exporting image: 56% complete... Exporting image: 75% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:02.956 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone29.export 2024-09-21T15:32:03.111 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:03.112 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone29.export 2024-09-21T15:32:03.151 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone29.export 2024-09-21T15:32:03.320 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 18% complete... Exporting image: 37% complete... Exporting image: 56% complete... Exporting image: 75% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:03.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone29@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone29.export 2024-09-21T15:32:03.504 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 18% complete... Exporting image: 37% complete... Exporting image: 56% complete... Exporting image: 75% complete... Exporting image: 93% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:03.513 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone29.export 2024-09-21T15:32:03.661 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone29.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone29.export 2024-09-21T15:32:03.692 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:03.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:03.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone3 2024-09-21T15:32:03.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:03.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone3 2024-09-21T15:32:03.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:03.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone3.export 2024-09-21T15:32:03.693 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone3.export 2024-09-21T15:32:03.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone3 2024-09-21T15:32:03.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:03.694 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:03.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:03.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone3.export 2024-09-21T15:32:03.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone3@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone3.export 2024-09-21T15:32:03.998 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 30% complete... Exporting image: 41% complete... Exporting image: 51% complete... Exporting image: 61% complete... Exporting image: 71% complete... Exporting image: 82% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:04.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone3@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone3.export 2024-09-21T15:32:04.207 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 30% complete... Exporting image: 41% complete... Exporting image: 51% complete... Exporting image: 61% complete... Exporting image: 71% complete... Exporting image: 82% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:04.212 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone3.export 2024-09-21T15:32:04.373 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:04.374 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone3.export 2024-09-21T15:32:04.409 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone3.export 2024-09-21T15:32:04.602 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 30% complete... Exporting image: 41% complete... Exporting image: 51% complete... Exporting image: 61% complete... Exporting image: 71% complete... Exporting image: 82% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:04.611 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone3@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone3.export 2024-09-21T15:32:04.823 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 30% complete... Exporting image: 41% complete... Exporting image: 51% complete... Exporting image: 61% complete... Exporting image: 71% complete... Exporting image: 82% complete... Exporting image: 92% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:04.832 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone3.export 2024-09-21T15:32:04.984 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone3.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone3.export 2024-09-21T15:32:05.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:05.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:05.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone30 2024-09-21T15:32:05.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:05.025 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone30 2024-09-21T15:32:05.026 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:05.026 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone30.export 2024-09-21T15:32:05.026 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone30.export 2024-09-21T15:32:05.026 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone30 2024-09-21T15:32:05.026 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:05.027 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:05.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:05.095 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone30.export 2024-09-21T15:32:05.096 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone30@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone30.export 2024-09-21T15:32:05.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 19% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 57% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 69% complete... Exporting image: 72% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:05.205 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone30@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone30.export 2024-09-21T15:32:05.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 19% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 57% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 69% complete... Exporting image: 72% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:05.321 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone30.export 2024-09-21T15:32:05.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:05.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone30.export 2024-09-21T15:32:05.441 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone30.export 2024-09-21T15:32:05.548 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 19% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 57% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 69% complete... Exporting image: 72% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:05.554 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone30@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone30.export 2024-09-21T15:32:05.672 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 19% complete... Exporting image: 22% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 44% complete... Exporting image: 47% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 57% complete... Exporting image: 60% complete... Exporting image: 63% complete... Exporting image: 66% complete... Exporting image: 69% complete... Exporting image: 72% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 82% complete... Exporting image: 85% complete... Exporting image: 88% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:05.678 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone30.export 2024-09-21T15:32:05.775 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone30.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone30.export 2024-09-21T15:32:05.801 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:05.801 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:05.801 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone31 2024-09-21T15:32:05.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:05.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone31 2024-09-21T15:32:05.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:05.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone31.export 2024-09-21T15:32:05.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone31.export 2024-09-21T15:32:05.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone31 2024-09-21T15:32:05.802 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:05.803 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:05.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:05.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone31.export 2024-09-21T15:32:05.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone31@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone31.export 2024-09-21T15:32:06.059 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 39% complete... Exporting image: 79% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:06.066 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone31@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone31.export 2024-09-21T15:32:06.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 39% complete... Exporting image: 79% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:06.240 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone31.export 2024-09-21T15:32:06.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:06.337 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone31.export 2024-09-21T15:32:06.355 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone31.export 2024-09-21T15:32:06.446 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:06.453 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone31@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone31.export 2024-09-21T15:32:06.569 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:06.577 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone31.export 2024-09-21T15:32:06.590 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone31.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone31.export 2024-09-21T15:32:06.597 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:06.598 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:06.598 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone32 2024-09-21T15:32:06.598 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:06.598 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone32 2024-09-21T15:32:06.598 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:06.599 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone32.export 2024-09-21T15:32:06.599 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone32.export 2024-09-21T15:32:06.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone32 2024-09-21T15:32:06.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:06.600 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:06.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:06.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone32.export 2024-09-21T15:32:06.673 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone32@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone32.export 2024-09-21T15:32:06.778 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:06.785 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone32@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone32.export 2024-09-21T15:32:06.896 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:06.901 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone32.export 2024-09-21T15:32:06.980 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:06.980 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone32.export 2024-09-21T15:32:07.003 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone32.export 2024-09-21T15:32:07.103 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:07.109 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone32@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone32.export 2024-09-21T15:32:07.230 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 2% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 19% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 30% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 38% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 49% complete... Exporting image: 51% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:07.236 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone32.export 2024-09-21T15:32:07.319 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone32.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone32.export 2024-09-21T15:32:07.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:07.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:07.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone33 2024-09-21T15:32:07.342 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:07.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone33 2024-09-21T15:32:07.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:07.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone33.export 2024-09-21T15:32:07.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone33.export 2024-09-21T15:32:07.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:07.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone33 2024-09-21T15:32:07.343 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:07.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:07.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone33.export 2024-09-21T15:32:07.417 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone33@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone33.export 2024-09-21T15:32:07.505 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:07.513 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone33@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone33.export 2024-09-21T15:32:07.604 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:07.609 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone33.export 2024-09-21T15:32:07.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:07.631 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone33.export 2024-09-21T15:32:07.642 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone33.export 2024-09-21T15:32:07.727 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:07.734 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone33@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone33.export 2024-09-21T15:32:07.836 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 42% complete... Exporting image: 85% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:07.844 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone33.export 2024-09-21T15:32:07.864 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone33.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone33.export 2024-09-21T15:32:07.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:07.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:07.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone34 2024-09-21T15:32:07.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:07.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone34 2024-09-21T15:32:07.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:07.875 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone34.export 2024-09-21T15:32:07.876 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone34.export 2024-09-21T15:32:07.876 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:07.876 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone34 2024-09-21T15:32:07.876 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:07.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:07.966 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone34.export 2024-09-21T15:32:07.967 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone34@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone34.export 2024-09-21T15:32:08.232 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 14% complete... Exporting image: 28% complete... Exporting image: 42% complete... Exporting image: 56% complete... Exporting image: 70% complete... Exporting image: 84% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:08.238 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone34@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone34.export 2024-09-21T15:32:08.514 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 14% complete... Exporting image: 28% complete... Exporting image: 42% complete... Exporting image: 56% complete... Exporting image: 70% complete... Exporting image: 84% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:08.521 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone34.export 2024-09-21T15:32:08.677 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:08.677 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone34.export 2024-09-21T15:32:08.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone34.export 2024-09-21T15:32:08.792 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:08.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone34@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone34.export 2024-09-21T15:32:08.881 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:08.888 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone34.export 2024-09-21T15:32:08.892 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone34.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone34.export 2024-09-21T15:32:08.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:08.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:08.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone35 2024-09-21T15:32:08.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:08.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone35 2024-09-21T15:32:08.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:08.894 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone35.export 2024-09-21T15:32:08.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone35.export 2024-09-21T15:32:08.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone35 2024-09-21T15:32:08.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:08.895 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:09.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:09.011 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone35.export 2024-09-21T15:32:09.012 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone35@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone35.export 2024-09-21T15:32:09.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:09.208 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone35@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone35.export 2024-09-21T15:32:09.416 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:09.422 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone35.export 2024-09-21T15:32:09.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:09.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone35.export 2024-09-21T15:32:09.494 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone35.export 2024-09-21T15:32:09.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:09.590 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone35@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone35.export 2024-09-21T15:32:09.714 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:09.724 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone35.export 2024-09-21T15:32:09.731 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone35.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone35.export 2024-09-21T15:32:09.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone36 2024-09-21T15:32:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone36 2024-09-21T15:32:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone36.export 2024-09-21T15:32:09.736 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone36.export 2024-09-21T15:32:09.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone36 2024-09-21T15:32:09.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:09.737 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:09.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:09.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone36.export 2024-09-21T15:32:09.879 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone36@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone36.export 2024-09-21T15:32:10.214 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:10.220 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone36@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone36.export 2024-09-21T15:32:10.584 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 34% complete... Exporting image: 69% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:10.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone36.export 2024-09-21T15:32:10.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:10.721 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone36.export 2024-09-21T15:32:10.782 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone36.export 2024-09-21T15:32:10.877 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:10.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone36@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone36.export 2024-09-21T15:32:11.017 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:11.024 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone36.export 2024-09-21T15:32:11.026 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone36.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone36.export 2024-09-21T15:32:11.028 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:11.028 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:11.028 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone37 2024-09-21T15:32:11.028 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:11.028 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone37 2024-09-21T15:32:11.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:11.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone37.export 2024-09-21T15:32:11.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone37.export 2024-09-21T15:32:11.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone37 2024-09-21T15:32:11.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:11.029 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:11.190 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:11.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone37.export 2024-09-21T15:32:11.192 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone37@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone37.export 2024-09-21T15:32:11.944 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:11.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone37@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone37.export 2024-09-21T15:32:13.067 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:13.074 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone37.export 2024-09-21T15:32:13.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:13.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone37.export 2024-09-21T15:32:13.191 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone37.export 2024-09-21T15:32:13.791 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:13.800 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone37@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone37.export 2024-09-21T15:32:14.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:14.647 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone37.export 2024-09-21T15:32:14.688 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone37.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone37.export 2024-09-21T15:32:14.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:14.700 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:14.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone38 2024-09-21T15:32:14.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:14.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone38 2024-09-21T15:32:14.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:14.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone38.export 2024-09-21T15:32:14.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone38.export 2024-09-21T15:32:14.701 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone38 2024-09-21T15:32:14.702 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:14.702 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:14.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:14.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone38.export 2024-09-21T15:32:14.886 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone38@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone38.export 2024-09-21T15:32:15.160 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 25% complete... Exporting image: 50% complete... Exporting image: 75% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:15.169 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone38@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone38.export 2024-09-21T15:32:15.727 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 25% complete... Exporting image: 50% complete... Exporting image: 75% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:15.735 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone38.export 2024-09-21T15:32:15.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:15.902 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone38.export 2024-09-21T15:32:15.952 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone38.export 2024-09-21T15:32:16.102 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:16.113 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone38@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone38.export 2024-09-21T15:32:16.300 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:16.310 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone38.export 2024-09-21T15:32:16.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone38.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone38.export 2024-09-21T15:32:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone39 2024-09-21T15:32:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone39 2024-09-21T15:32:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone39.export 2024-09-21T15:32:16.325 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone39.export 2024-09-21T15:32:16.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone39 2024-09-21T15:32:16.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:16.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:16.529 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:16.529 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone39.export 2024-09-21T15:32:16.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone39@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone39.export 2024-09-21T15:32:16.906 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 81% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:16.920 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone39@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone39.export 2024-09-21T15:32:17.081 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:32:17.075+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56680 2024-09-21T15:32:17.082 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:32:17.075+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56820 2024-09-21T15:32:17.082 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:32:17.075+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b0f56b60 2024-09-21T15:32:17.096 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:32:17.083+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b27d2b60 2024-09-21T15:32:17.096 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:32:17.083+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b28f0410 2024-09-21T15:32:17.096 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:32:17.083+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3540000 2024-09-21T15:32:17.096 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:32:17.083+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b35405b0 2024-09-21T15:32:17.096 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:32:17.083+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b3676680 2024-09-21T15:32:17.096 INFO:tasks.ceph.cluster1.osd.0.smithi082.stderr:2024-09-21T15:32:17.083+0000 7f1e9c77a700 -1 reset not still connected to 0x5628b6fd76c0 2024-09-21T15:32:17.410 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 81% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:17.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone39.export 2024-09-21T15:32:17.570 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:17.571 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone39.export 2024-09-21T15:32:17.628 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone39.export 2024-09-21T15:32:17.827 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:17.837 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone39@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone39.export 2024-09-21T15:32:18.090 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:18.103 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone39.export 2024-09-21T15:32:18.122 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone39.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone39.export 2024-09-21T15:32:18.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:18.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:18.133 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone4 2024-09-21T15:32:18.134 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:18.134 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone4 2024-09-21T15:32:18.134 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:18.134 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone4.export 2024-09-21T15:32:18.134 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone4.export 2024-09-21T15:32:18.134 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone4 2024-09-21T15:32:18.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:18.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:18.298 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:18.298 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone4.export 2024-09-21T15:32:18.299 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone4@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone4.export 2024-09-21T15:32:18.475 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:18.480 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone4@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone4.export 2024-09-21T15:32:18.671 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:18.677 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone4.export 2024-09-21T15:32:18.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:18.893 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone4.export 2024-09-21T15:32:18.930 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone4.export 2024-09-21T15:32:19.038 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 83% complete... Exporting image: 86% complete... Exporting image: 89% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:19.043 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone4@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone4.export 2024-09-21T15:32:19.167 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 24% complete... Exporting image: 27% complete... Exporting image: 30% complete... Exporting image: 33% complete... Exporting image: 36% complete... Exporting image: 39% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 49% complete... Exporting image: 52% complete... Exporting image: 55% complete... Exporting image: 58% complete... Exporting image: 61% complete... Exporting image: 64% complete... Exporting image: 67% complete... Exporting image: 70% complete... Exporting image: 73% complete... Exporting image: 76% complete... Exporting image: 79% complete... Exporting image: 83% complete... Exporting image: 86% complete... Exporting image: 89% complete... Exporting image: 92% complete... Exporting image: 95% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:19.173 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone4.export 2024-09-21T15:32:19.192 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone4.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone4.export 2024-09-21T15:32:19.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:19.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:19.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone40 2024-09-21T15:32:19.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:19.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone40 2024-09-21T15:32:19.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:19.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone40.export 2024-09-21T15:32:19.198 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone40.export 2024-09-21T15:32:19.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone40 2024-09-21T15:32:19.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:19.199 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:19.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:19.269 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone40.export 2024-09-21T15:32:19.270 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone40.export 2024-09-21T15:32:19.513 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 17% complete... Exporting image: 34% complete... Exporting image: 51% complete... Exporting image: 69% complete... Exporting image: 86% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:19.526 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone40@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone40.export 2024-09-21T15:32:19.810 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 17% complete... Exporting image: 34% complete... Exporting image: 51% complete... Exporting image: 69% complete... Exporting image: 86% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:19.814 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone40.export 2024-09-21T15:32:19.986 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone40.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone40.export 2024-09-21T15:32:20.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:20.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:20.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone5 2024-09-21T15:32:20.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:20.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone5 2024-09-21T15:32:20.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:20.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone5.export 2024-09-21T15:32:20.062 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone5.export 2024-09-21T15:32:20.063 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:20.063 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:20.063 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone5 2024-09-21T15:32:20.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:20.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone5.export 2024-09-21T15:32:20.179 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone5@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone5.export 2024-09-21T15:32:20.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:20.370 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone5@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone5.export 2024-09-21T15:32:20.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 8% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 27% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 58% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 77% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:20.591 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone5.export 2024-09-21T15:32:20.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:20.763 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone5.export 2024-09-21T15:32:20.804 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone5.export 2024-09-21T15:32:20.903 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:20.911 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone5@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone5.export 2024-09-21T15:32:21.034 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:21.044 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone5.export 2024-09-21T15:32:21.046 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone5.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone5.export 2024-09-21T15:32:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone6 2024-09-21T15:32:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone6 2024-09-21T15:32:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone6.export 2024-09-21T15:32:21.048 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone6.export 2024-09-21T15:32:21.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone6 2024-09-21T15:32:21.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:21.049 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:21.127 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:21.128 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone6.export 2024-09-21T15:32:21.129 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone6@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone6.export 2024-09-21T15:32:21.353 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 26% complete... Exporting image: 52% complete... Exporting image: 78% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:21.360 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone6@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone6.export 2024-09-21T15:32:21.583 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 26% complete... Exporting image: 52% complete... Exporting image: 78% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:21.588 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone6.export 2024-09-21T15:32:21.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:21.730 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone6.export 2024-09-21T15:32:21.784 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone6.export 2024-09-21T15:32:22.023 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 26% complete... Exporting image: 52% complete... Exporting image: 78% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:22.031 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone6@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone6.export 2024-09-21T15:32:22.261 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 26% complete... Exporting image: 52% complete... Exporting image: 78% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:22.265 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone6.export 2024-09-21T15:32:22.407 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone6.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone6.export 2024-09-21T15:32:22.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:22.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:22.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone7 2024-09-21T15:32:22.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:22.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone7 2024-09-21T15:32:22.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:22.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone7.export 2024-09-21T15:32:22.455 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone7.export 2024-09-21T15:32:22.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone7 2024-09-21T15:32:22.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:22.456 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:22.529 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:22.529 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone7.export 2024-09-21T15:32:22.530 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone7@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone7.export 2024-09-21T15:32:22.716 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 15% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 31% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 56% complete... Exporting image: 62% complete... Exporting image: 67% complete... Exporting image: 72% complete... Exporting image: 77% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:22.722 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone7@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone7.export 2024-09-21T15:32:22.900 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.9756858116535547) > weight (0.25) 2024-09-21T15:32:22.900 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.38387463421597945) > weight (0.25) 2024-09-21T15:32:22.900 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.2 with skip (0.551954078200834) > weight (0.25) 2024-09-21T15:32:22.900 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.3 with skip (0.6822462902305778) > weight (0.25) 2024-09-21T15:32:22.900 INFO:tasks.rbd_mirror_thrash:waiting for 82 secs before thrashing 2024-09-21T15:32:22.946 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 15% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 31% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 56% complete... Exporting image: 62% complete... Exporting image: 67% complete... Exporting image: 72% complete... Exporting image: 77% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:22.951 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone7.export 2024-09-21T15:32:23.087 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:23.087 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone7.export 2024-09-21T15:32:23.135 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone7.export 2024-09-21T15:32:23.326 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 15% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 31% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 56% complete... Exporting image: 62% complete... Exporting image: 67% complete... Exporting image: 72% complete... Exporting image: 77% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:23.331 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone7@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone7.export 2024-09-21T15:32:23.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 5% complete... Exporting image: 10% complete... Exporting image: 15% complete... Exporting image: 20% complete... Exporting image: 25% complete... Exporting image: 31% complete... Exporting image: 36% complete... Exporting image: 41% complete... Exporting image: 46% complete... Exporting image: 51% complete... Exporting image: 56% complete... Exporting image: 62% complete... Exporting image: 67% complete... Exporting image: 72% complete... Exporting image: 77% complete... Exporting image: 82% complete... Exporting image: 87% complete... Exporting image: 93% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:23.531 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone7.export 2024-09-21T15:32:23.667 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone7.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone7.export 2024-09-21T15:32:23.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:23.711 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:23.712 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone8 2024-09-21T15:32:23.712 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:23.712 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone8 2024-09-21T15:32:23.712 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:23.712 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone8.export 2024-09-21T15:32:23.712 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone8.export 2024-09-21T15:32:23.712 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone8 2024-09-21T15:32:23.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:23.713 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:23.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:23.780 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone8.export 2024-09-21T15:32:23.782 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone8@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone8.export 2024-09-21T15:32:23.897 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 30% complete... Exporting image: 40% complete... Exporting image: 50% complete... Exporting image: 61% complete... Exporting image: 71% complete... Exporting image: 81% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:23.904 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone8@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone8.export 2024-09-21T15:32:24.132 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 30% complete... Exporting image: 40% complete... Exporting image: 50% complete... Exporting image: 61% complete... Exporting image: 71% complete... Exporting image: 81% complete... Exporting image: 91% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:24.138 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone8.export 2024-09-21T15:32:24.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:24.165 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone8.export 2024-09-21T15:32:24.178 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone8.export 2024-09-21T15:32:24.235 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:24.242 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone8@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone8.export 2024-09-21T15:32:24.306 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 100% complete...done. 2024-09-21T15:32:24.313 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone8.export 2024-09-21T15:32:24.315 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone8.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone8.export 2024-09-21T15:32:24.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:24.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for image in $(rbd --cluster ${CLUSTER1} --pool ${POOL} ls) 2024-09-21T15:32:24.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ compare_image_snapshots mirror image_cluster1.client.mirror.5-clone9 2024-09-21T15:32:24.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local pool=mirror 2024-09-21T15:32:24.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local image=image_cluster1.client.mirror.5-clone9 2024-09-21T15:32:24.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local ret=0 2024-09-21T15:32:24.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local rmt_export=/tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone9.export 2024-09-21T15:32:24.317 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local loc_export=/tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone9.export 2024-09-21T15:32:24.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ rbd --cluster cluster1 --format xml snap list mirror/image_cluster1.client.mirror.5-clone9 2024-09-21T15:32:24.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ xmlstarlet sel -t -v //snapshot/name 2024-09-21T15:32:24.318 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ grep -E -v '^\.rbd-mirror\.' 2024-09-21T15:32:24.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636a3bce820 2024-09-21T15:32:24.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636a3bcfa00 2024-09-21T15:32:24.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636a780eb60 2024-09-21T15:32:24.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636a86705b0 2024-09-21T15:32:24.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670680 2024-09-21T15:32:24.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636a8670dd0 2024-09-21T15:32:24.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636a9e8f520 2024-09-21T15:32:24.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636b29e6270 2024-09-21T15:32:24.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636b32e8410 2024-09-21T15:32:24.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636b3550270 2024-09-21T15:32:24.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636b678f2b0 2024-09-21T15:32:24.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636b8fb84e0 2024-09-21T15:32:24.446 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff656c0 2024-09-21T15:32:24.447 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636bff65c70 2024-09-21T15:32:24.447 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1c70 2024-09-21T15:32:24.447 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636c06f1ee0 2024-09-21T15:32:24.447 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.439+0000 7f7fd044c700 -1 reset not still connected to 0x5636c483e750 2024-09-21T15:32:24.467 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.459+0000 7f7fd044c700 -1 reset not still connected to 0x5636c5f54b60 2024-09-21T15:32:24.472 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c65c9ad0 2024-09-21T15:32:24.472 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66904e0 2024-09-21T15:32:24.472 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c6690a90 2024-09-21T15:32:24.472 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66911e0 2024-09-21T15:32:24.472 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c66916c0 2024-09-21T15:32:24.474 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c7335ad0 2024-09-21T15:32:24.474 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.467+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8766750 2024-09-21T15:32:24.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c87676c0 2024-09-21T15:32:24.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8966000 2024-09-21T15:32:24.476 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89672b0 2024-09-21T15:32:24.478 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8967a00 2024-09-21T15:32:24.478 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c89c8a90 2024-09-21T15:32:24.478 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f500d0 2024-09-21T15:32:24.478 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636c8f51110 2024-09-21T15:32:24.478 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde261a0 2024-09-21T15:32:24.478 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636cde27d40 2024-09-21T15:32:24.478 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636ce7e9790 2024-09-21T15:32:24.478 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c8f0 2024-09-21T15:32:24.478 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01c9c0 2024-09-21T15:32:24.478 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01cf70 2024-09-21T15:32:24.479 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d040 2024-09-21T15:32:24.479 INFO:tasks.ceph.cluster1.osd.2.smithi082.stderr:2024-09-21T15:32:24.471+0000 7f7fd044c700 -1 reset not still connected to 0x5636cf01d2b0 2024-09-21T15:32:24.550 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:24.550 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone9.export 2024-09-21T15:32:24.551 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone9@snap /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone9.export 2024-09-21T15:32:24.878 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:24.885 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone9@snap /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone9.export 2024-09-21T15:32:25.193 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 5% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 11% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 16% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 22% complete... Exporting image: 24% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 33% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 41% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 52% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 61% complete... Exporting image: 63% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 69% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 74% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 80% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 91% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 97% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:25.201 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone9.export 2024-09-21T15:32:25.330 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for snap_name in $(rbd --cluster ${CLUSTER1} --format xml snap list ${pool}/${image} | $XMLSTARLET sel -t -v "//snapshot/name" | grep -E -v "^\.rbd-mirror\.") 2024-09-21T15:32:25.330 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone9.export 2024-09-21T15:32:25.359 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster2 export mirror/image_cluster1.client.mirror.5-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone9.export 2024-09-21T15:32:25.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 79% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:25.482 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rbd --cluster cluster1 export mirror/image_cluster1.client.mirror.5-clone9@4d195cbe-4564-40fc-8265-15b81d941c73 /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone9.export 2024-09-21T15:32:25.617 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr: Exporting image: 79% complete... Exporting image: 100% complete...done. 2024-09-21T15:32:25.624 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cmp /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone9.export 2024-09-21T15:32:25.630 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -f /tmp/tmp.ZUZ2ADv8z3/cluster2-mirror-image_cluster1.client.mirror.5-clone9.export /tmp/tmp.ZUZ2ADv8z3/cluster1-mirror-image_cluster1.client.mirror.5-clone9.export 2024-09-21T15:32:25.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 0 2024-09-21T15:32:25.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ cleanup 0 2024-09-21T15:32:25.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local error_code=0 2024-09-21T15:32:25.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ set +e 2024-09-21T15:32:25.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 0 -ne 0 ']' 2024-09-21T15:32:25.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -z '' ']' 2024-09-21T15:32:25.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster instance 2024-09-21T15:32:25.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:32:25.634 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ ceph --cluster cluster1 osd pool rm mirror mirror --yes-i-really-really-mean-it 2024-09-21T15:32:26.523 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:pool 'mirror' does not exist 2024-09-21T15:32:26.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:32:26.532 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ ceph --cluster cluster2 osd pool rm mirror mirror --yes-i-really-really-mean-it 2024-09-21T15:32:26.915 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:26.909+0000 7fcf50004700 -1 rbd::mirror::LeaderWatcher: 0x5588f4e6e900 handle_notify_heartbeat: error notifying heartbeat: (2) No such file or directory, releasing leader 2024-09-21T15:32:26.916 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:26.913+0000 7fcf49ff8700 -1 rbd::mirror::image_deleter::TrashWatcher: 0x5588f53f8000 handle_unregister_watcher: error unregistering watcher for trash directory: (2) No such file or directory 2024-09-21T15:32:26.916 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:26.913+0000 7fcf49ff8700 -1 rbd::mirror::image_deleter::TrashWatcher: 0x5588f4ee4240 handle_unregister_watcher: error unregistering watcher for trash directory: (2) No such file or directory 2024-09-21T15:32:26.916 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:26.913+0000 7fcf497f7700 -1 rbd::mirror::image_deleter::TrashWatcher: 0x5588f4de5200 handle_unregister_watcher: error unregistering watcher for trash directory: (2) No such file or directory 2024-09-21T15:32:26.916 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:26.913+0000 7fcf49ff8700 -1 rbd::mirror::PoolWatcher: 0x5588f3d6e5a0 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-21T15:32:26.916 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:26.913+0000 7fcf49ff8700 -1 rbd::mirror::PoolWatcher: 0x5588f3d6ed20 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-21T15:32:26.917 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:26.913+0000 7fcf49ff8700 -1 rbd::mirror::PoolWatcher: 0x5588f3d6f4a0 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-21T15:32:26.936 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:26.933+0000 7fcf50004700 -1 rbd::mirror::LeaderWatcher: 0x5588f4e6e900 handle_notify_lock_released: error notifying leader lock released: (2) No such file or directory 2024-09-21T15:32:26.936 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:26.933+0000 7fcf50004700 -1 rbd::mirror::LeaderWatcher: 0x5588f4e6e900 handle_release_leader_lock: error releasing lock: (2) No such file or directory 2024-09-21T15:32:27.476 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:pool 'mirror' does not exist 2024-09-21T15:32:27.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:32:27.490 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ ceph --cluster cluster1 osd pool rm mirror_parent mirror_parent --yes-i-really-really-mean-it 2024-09-21T15:32:27.877 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.873+0000 7fcff93f7700 -1 rbd::mirror::RemotePoolPoller: 0x556e84af0d00 handle_mirror_peer_ping: failed to ping remote mirror peer: (2) No such file or directory 2024-09-21T15:32:27.877 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.873+0000 7fcff93f7700 -1 rbd::mirror::RemotePoolPoller: 0x556e84af0d00 handle_mirror_peer_list: failed to retrieve mirror peers: (2) No such file or directory 2024-09-21T15:32:27.877 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.873+0000 7fcff93f7700 -1 rbd::mirror::PoolReplayer: 0x556e858eef00 handle_remote_pool_meta_updated: remote pool metadata updated unexpectedly 2024-09-21T15:32:27.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.873+0000 7fd006411700 -1 rbd::mirror::InstanceWatcher: 0x556e85be6380 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6488 object: (2) No such file or directory 2024-09-21T15:32:27.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.873+0000 7fd006411700 -1 rbd::mirror::InstanceWatcher: 0x556e85be6700 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6488 object: (2) No such file or directory 2024-09-21T15:32:27.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.873+0000 7fcfff403700 -1 rbd::mirror::InstanceWatcher: 0x556e85be6380 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:27.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.873+0000 7fcfff403700 -1 rbd::mirror::InstanceWatcher: 0x556e85be6700 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:27.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.873+0000 7fcff93f7700 -1 rbd::mirror::MirrorStatusUpdater 0x556e85c2e360 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:27.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.873+0000 7fcff93f7700 -1 rbd::mirror::MirrorStatusUpdater 0x556e85c2e5a0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:27.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.873+0000 7fd006411700 -1 rbd::mirror::NamespaceReplayer: 0x556e85bde820 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:27.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.873+0000 7fd006411700 -1 rbd::mirror::NamespaceReplayer: 0x556e85bde9c0 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:27.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.877+0000 7fcfffc04700 -1 rbd::mirror::MirrorStatusUpdater 0x556e85c2e000 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:27.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.877+0000 7fd005c10700 -1 rbd::mirror::NamespaceReplayer: 0x556e85bde820 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:27.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.877+0000 7fcfffc04700 -1 rbd::mirror::MirrorStatusUpdater 0x556e85c2e120 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:27.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:27.877+0000 7fd006411700 -1 rbd::mirror::NamespaceReplayer: 0x556e85bde9c0 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:28.317 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:28.313+0000 7fd005c10700 -1 rbd::mirror::LeaderWatcher: 0x556e85bc2900 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:28.318 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:28.313+0000 7fd005c10700 -1 rbd::mirror::InstanceWatcher: 0x556e85be6000 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6488 object: (2) No such file or directory 2024-09-21T15:32:28.319 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:28.317+0000 7fcfff403700 -1 rbd::mirror::InstanceWatcher: 0x556e85be6000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:28.320 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:28.317+0000 7fcff93f7700 -1 rbd::mirror::MirrorStatusUpdater 0x556e859a06c0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:28.320 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:28.317+0000 7fd005c10700 -1 rbd::mirror::NamespaceReplayer: 0x556e85bde000 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:28.321 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:28.317+0000 7fcfff403700 -1 rbd::mirror::MirrorStatusUpdater 0x556e865786c0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:28.321 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:28.317+0000 7fd006411700 -1 rbd::mirror::NamespaceReplayer: 0x556e85bde000 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:28.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:28.533+0000 7ff13c00d700 -1 rbd::mirror::LeaderWatcher: 0x561aee034900 handle_notify_heartbeat: error notifying heartbeat: (2) No such file or directory, releasing leader 2024-09-21T15:32:28.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:28.533+0000 7ff136001700 -1 rbd::mirror::image_deleter::TrashWatcher: 0x561aee542900 handle_unregister_watcher: error unregistering watcher for trash directory: (2) No such file or directory 2024-09-21T15:32:28.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:28.533+0000 7ff136001700 -1 rbd::mirror::image_deleter::TrashWatcher: 0x561aee3f8240 handle_unregister_watcher: error unregistering watcher for trash directory: (2) No such file or directory 2024-09-21T15:32:28.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:28.533+0000 7ff136001700 -1 rbd::mirror::image_deleter::TrashWatcher: 0x561aedfd0240 handle_unregister_watcher: error unregistering watcher for trash directory: (2) No such file or directory 2024-09-21T15:32:28.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:28.533+0000 7ff136001700 -1 rbd::mirror::PoolWatcher: 0x561aecf1de00 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-21T15:32:28.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:28.533+0000 7ff135800700 -1 rbd::mirror::PoolWatcher: 0x561aecf1d860 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-21T15:32:28.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:28.533+0000 7ff135800700 -1 rbd::mirror::PoolWatcher: 0x561aecf1da40 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-21T15:32:28.539 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:28.533+0000 7ff12eff3700 -1 rbd::mirror::PoolWatcher: 0x561aee5363c0 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-21T15:32:28.539 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:28.533+0000 7ff12eff3700 -1 rbd::mirror::PoolWatcher: 0x561aecf1dc20 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-21T15:32:28.539 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:28.533+0000 7ff12eff3700 -1 rbd::mirror::PoolWatcher: 0x561aecf1c960 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-21T15:32:28.544 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:pool 'mirror_parent' does not exist 2024-09-21T15:32:28.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:28.541+0000 7ff135800700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:28.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:28.541+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:28.557 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ CEPH_ARGS= 2024-09-21T15:32:28.557 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ ceph --cluster cluster2 osd pool rm mirror_parent mirror_parent --yes-i-really-really-mean-it 2024-09-21T15:32:29.407 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:pool 'mirror_parent' does not exist 2024-09-21T15:32:29.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for cluster in "${CLUSTER1}" "${CLUSTER2}" 2024-09-21T15:32:29.419 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ stop_mirrors cluster1 2024-09-21T15:32:29.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1 2024-09-21T15:32:29.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local sig= 2024-09-21T15:32:29.420 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ seq 0 1 2024-09-21T15:32:29.465 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2024-09-21T15:32:29.465 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ stop_mirror cluster1:0 '' 2024-09-21T15:32:29.465 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1:0 2024-09-21T15:32:29.465 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local sig= 2024-09-21T15:32:29.465 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ test -n 1 2024-09-21T15:32:29.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 2024-09-21T15:32:29.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2024-09-21T15:32:29.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ stop_mirror cluster1:1 '' 2024-09-21T15:32:29.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster1:1 2024-09-21T15:32:29.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local sig= 2024-09-21T15:32:29.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ test -n 1 2024-09-21T15:32:29.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 2024-09-21T15:32:29.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for cluster in "${CLUSTER1}" "${CLUSTER2}" 2024-09-21T15:32:29.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ stop_mirrors cluster2 2024-09-21T15:32:29.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2 2024-09-21T15:32:29.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local sig= 2024-09-21T15:32:29.466 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:++ seq 0 1 2024-09-21T15:32:29.467 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2024-09-21T15:32:29.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ stop_mirror cluster2:0 '' 2024-09-21T15:32:29.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2:0 2024-09-21T15:32:29.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local sig= 2024-09-21T15:32:29.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ test -n 1 2024-09-21T15:32:29.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 2024-09-21T15:32:29.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2024-09-21T15:32:29.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ stop_mirror cluster2:1 '' 2024-09-21T15:32:29.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local cluster=cluster2:1 2024-09-21T15:32:29.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ local sig= 2024-09-21T15:32:29.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ test -n 1 2024-09-21T15:32:29.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ return 2024-09-21T15:32:29.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' -z 1 ']' 2024-09-21T15:32:29.468 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ test '' = /tmp/tmp.ZUZ2ADv8z3 2024-09-21T15:32:29.469 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ rm -Rf /tmp/tmp.ZUZ2ADv8z3 2024-09-21T15:32:29.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ '[' 0 -eq 0 ']' 2024-09-21T15:32:29.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ echo OK 2024-09-21T15:32:29.486 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stdout:OK 2024-09-21T15:32:29.487 INFO:tasks.workunit.cluster1.client.mirror.smithi161.stderr:+ exit 0 2024-09-21T15:32:29.488 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T15:32:29.488 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp 2024-09-21T15:32:29.673 INFO:tasks.workunit:Stopping ['rbd/rbd_mirror_fsx_compare.sh'] on cluster1.client.mirror... 2024-09-21T15:32:29.673 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.cluster1.client.mirror /home/ubuntu/cephtest/clone.cluster1.client.mirror 2024-09-21T15:32:29.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.789+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.789+0000 7ff12eff3700 -1 rbd::mirror::RemotePoolPoller: 0x561aecf46d00 handle_mirror_peer_ping: failed to ping remote mirror peer: (2) No such file or directory 2024-09-21T15:32:29.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.789+0000 7ff121fd9700 -1 rbd::mirror::RemotePoolPoller: 0x561aecf47790 handle_mirror_peer_ping: failed to ping remote mirror peer: (2) No such file or directory 2024-09-21T15:32:29.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.793+0000 7ff12f7f4700 -1 rbd::mirror::RemotePoolPoller: 0x561aecf46d00 handle_mirror_peer_list: failed to retrieve mirror peers: (2) No such file or directory 2024-09-21T15:32:29.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.793+0000 7ff12f7f4700 -1 rbd::mirror::PoolReplayer: 0x561aedd44f00 handle_remote_pool_meta_updated: remote pool metadata updated unexpectedly 2024-09-21T15:32:29.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.793+0000 7ff121fd9700 -1 rbd::mirror::RemotePoolPoller: 0x561aecf47790 handle_mirror_peer_list: failed to retrieve mirror peers: (2) No such file or directory 2024-09-21T15:32:29.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.793+0000 7ff121fd9700 -1 rbd::mirror::PoolReplayer: 0x561aee034c00 handle_remote_pool_meta_updated: remote pool metadata updated unexpectedly 2024-09-21T15:32:29.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.793+0000 7ff136001700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.805 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.801+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.805+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.805+0000 7ff135800700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.809+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.812 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.809+0000 7ff12eff3700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.814 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.809+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.814 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.813+0000 7ff136001700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.816 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.813+0000 7ff136001700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.821 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.817+0000 7ff12eff3700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.822 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.817+0000 7ff135800700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.823 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.817+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.823 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff135800700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.823 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.823 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff135800700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff135800700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff12eff3700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff135800700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff135800700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.825 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.825 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff136001700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.825 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.826 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff136001700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.826 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff12eff3700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.826 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.821+0000 7ff135800700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.827 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.825+0000 7ff12eff3700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.829 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.825+0000 7ff136001700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.830 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.825+0000 7ff12eff3700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.833 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.829+0000 7ff136001700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.833 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.829+0000 7ff12eff3700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.833 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.829+0000 7ff136001700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.833 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.829+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_update_task: failed to update mirror image statuses: (2) No such file or directory 2024-09-21T15:32:29.834 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.829+0000 7ff13c80e700 -1 rbd::mirror::InstanceWatcher: 0x561aee04c380 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.4924 object: (2) No such file or directory 2024-09-21T15:32:29.834 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.829+0000 7ff13c00d700 -1 rbd::mirror::LeaderWatcher: 0x561aee034900 handle_notify_lock_released: error notifying leader lock released: (2) No such file or directory 2024-09-21T15:32:29.834 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.829+0000 7ff13c00d700 -1 rbd::mirror::InstanceWatcher: 0x561aee04c700 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.4924 object: (2) No such file or directory 2024-09-21T15:32:29.834 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.829+0000 7ff13c00d700 -1 rbd::mirror::LeaderWatcher: 0x561aee034900 handle_release_leader_lock: error releasing lock: (2) No such file or directory 2024-09-21T15:32:29.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.829+0000 7ff136001700 -1 rbd::mirror::InstanceWatcher: 0x561aee04c380 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:29.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.829+0000 7ff136001700 -1 rbd::mirror::InstanceWatcher: 0x561aee04c700 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:29.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aee12e360 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:29.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff13c00d700 -1 rbd::mirror::NamespaceReplayer: 0x561aee048820 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:29.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aee12e480 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:29.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff13c80e700 -1 rbd::mirror::NamespaceReplayer: 0x561aee0489c0 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:29.836 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff135800700 -1 rbd::mirror::MirrorStatusUpdater 0x561aee12e000 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:29.836 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff135800700 -1 rbd::mirror::MirrorStatusUpdater 0x561aee12e120 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:29.836 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff13c00d700 -1 rbd::mirror::NamespaceReplayer: 0x561aee048820 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:29.836 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff13c00d700 -1 rbd::mirror::NamespaceReplayer: 0x561aee0489c0 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:29.836 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff13c00d700 -1 rbd::mirror::LeaderWatcher: 0x561aee034900 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:29.836 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff13c00d700 -1 rbd::mirror::InstanceWatcher: 0x561aee04c000 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.4924 object: (2) No such file or directory 2024-09-21T15:32:29.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff136001700 -1 rbd::mirror::InstanceWatcher: 0x561aee04c000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:29.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff12f7f4700 -1 rbd::mirror::MirrorStatusUpdater 0x561aedfc0480 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:29.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff13c00d700 -1 rbd::mirror::NamespaceReplayer: 0x561aee048000 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:29.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff136001700 -1 rbd::mirror::MirrorStatusUpdater 0x561aede00900 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:29.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.833+0000 7ff13c80e700 -1 rbd::mirror::NamespaceReplayer: 0x561aee048000 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:29.845 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.841+0000 7ff1287e6700 -1 rbd::mirror::PoolWatcher: 0x561aecf1d4a0 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-21T15:32:29.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.841+0000 7ff1217d8700 -1 rbd::mirror::PoolWatcher: 0x561aecf1cd20 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-21T15:32:29.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.841+0000 7ff13c00d700 -1 rbd::mirror::LeaderWatcher: 0x561aee3faf00 handle_notify_lock_released: error notifying leader lock released: (2) No such file or directory 2024-09-21T15:32:29.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.841+0000 7ff13c00d700 -1 rbd::mirror::LeaderWatcher: 0x561aee3faf00 handle_shut_down_leader_lock: error shutting down leader lock: (2) No such file or directory 2024-09-21T15:32:29.847 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.845+0000 7ff13c80e700 -1 rbd::mirror::LeaderWatcher: 0x561aee3faf00 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:29.847 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.845+0000 7ff13c80e700 -1 rbd::mirror::InstanceWatcher: 0x561aee51c000 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.4926 object: (2) No such file or directory 2024-09-21T15:32:29.847 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.845+0000 7ff127fe5700 -1 rbd::mirror::InstanceWatcher: 0x561aee51c000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:29.848 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.845+0000 7ff121fd9700 -1 rbd::mirror::MirrorStatusUpdater 0x561aee12e900 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:29.848 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.845+0000 7ff13c80e700 -1 rbd::mirror::NamespaceReplayer: 0x561aee3d4820 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:29.848 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.845+0000 7ff127fe5700 -1 rbd::mirror::MirrorStatusUpdater 0x561aee3046c0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:29.848 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:29.845+0000 7ff13c00d700 -1 rbd::mirror::NamespaceReplayer: 0x561aee3d4820 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.012 DEBUG:teuthology.parallel:result is None 2024-09-21T15:32:30.013 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror 2024-09-21T15:32:30.026 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror 2024-09-21T15:32:30.027 DEBUG:teuthology.orchestra.run.smithi161:> rmdir -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2024-09-21T15:32:30.038 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror 2024-09-21T15:32:30.038 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-21T15:32:30.049 DEBUG:teuthology.run_tasks:Unwinding manager rbd-mirror-thrash 2024-09-21T15:32:30.075 INFO:tasks.rbd_mirror_thrash:joining rbd_mirror_thrash 2024-09-21T15:32:30.075 INFO:tasks.rbd_mirror_thrash:stat['kill'] = 13 2024-09-21T15:32:30.076 INFO:tasks.rbd_mirror_thrash:done joining 2024-09-21T15:32:30.076 DEBUG:teuthology.run_tasks:Unwinding manager rbd-mirror-thrash 2024-09-21T15:32:30.109 INFO:tasks.rbd_mirror_thrash:joining rbd_mirror_thrash 2024-09-21T15:32:30.109 INFO:tasks.rbd_mirror_thrash:stat['kill'] = 15 2024-09-21T15:32:30.110 INFO:tasks.rbd_mirror_thrash:done joining 2024-09-21T15:32:30.110 DEBUG:teuthology.run_tasks:Unwinding manager rbd-mirror 2024-09-21T15:32:30.142 DEBUG:tasks.rbd_mirror.cluster2.client.mirror.3:waiting for process to exit 2024-09-21T15:32:30.142 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:32:30.143 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.141+0000 7ff13d00f700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.3 (PID: 77231) UID: 1000 2024-09-21T15:32:30.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Stopped 2024-09-21T15:32:30.169 DEBUG:teuthology.run_tasks:Unwinding manager rbd-mirror 2024-09-21T15:32:30.179 DEBUG:tasks.rbd_mirror.cluster2.client.mirror.2:waiting for process to exit 2024-09-21T15:32:30.179 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:32:30.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.209+0000 7f4992b14700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 (PID: 87441) UID: 1000 2024-09-21T15:32:30.212 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.209+0000 7f4991b12700 -1 rbd::mirror::LeaderWatcher: 0x55e522f91800 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:30.213 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.209+0000 7f4992313700 -1 rbd::mirror::InstanceWatcher: 0x55e522fa0000 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.5230 object: (2) No such file or directory 2024-09-21T15:32:30.213 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.209+0000 7f4992313700 -1 rbd::mirror::InstanceWatcher: 0x55e522fa0380 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.5230 object: (2) No such file or directory 2024-09-21T15:32:30.214 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.209+0000 7f4992313700 -1 rbd::mirror::InstanceWatcher: 0x55e522fa0700 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.5233 object: (2) No such file or directory 2024-09-21T15:32:30.214 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.209+0000 7f498b305700 -1 rbd::mirror::InstanceWatcher: 0x55e522fa0000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.214 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.209+0000 7f498b305700 -1 rbd::mirror::InstanceWatcher: 0x55e522fa0380 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.213+0000 7f497daea700 -1 rbd::mirror::InstanceWatcher: 0x55e522fa0700 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.213+0000 7f49852f9700 -1 rbd::mirror::MirrorStatusUpdater 0x55e522f04360 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.213+0000 7f49852f9700 -1 rbd::mirror::MirrorStatusUpdater 0x55e522f045a0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.213+0000 7f4992313700 -1 rbd::mirror::NamespaceReplayer: 0x55e522e48820 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.213+0000 7f4992313700 -1 rbd::mirror::NamespaceReplayer: 0x55e522e489c0 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.213+0000 7f498bb06700 -1 rbd::mirror::MirrorStatusUpdater 0x55e522f04000 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.213+0000 7f4977ade700 -1 rbd::mirror::MirrorStatusUpdater 0x55e5232ce480 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.213+0000 7f4991b12700 -1 rbd::mirror::NamespaceReplayer: 0x55e522e48820 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.213+0000 7f498bb06700 -1 rbd::mirror::MirrorStatusUpdater 0x55e522f04120 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.213+0000 7f4991b12700 -1 rbd::mirror::NamespaceReplayer: 0x55e5231d8680 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.213+0000 7f4991b12700 -1 rbd::mirror::NamespaceReplayer: 0x55e522e489c0 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.217 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.213+0000 7f497e2eb700 -1 rbd::mirror::MirrorStatusUpdater 0x55e5230fe5a0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.217 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.213+0000 7f4992313700 -1 rbd::mirror::NamespaceReplayer: 0x55e5231d8680 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.217+0000 7f4991b12700 -1 rbd::mirror::LeaderWatcher: 0x55e522d27800 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:30.222 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.217+0000 7f4991b12700 -1 rbd::mirror::InstanceWatcher: 0x55e523651500 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.5230 object: (2) No such file or directory 2024-09-21T15:32:30.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.221+0000 7f498bb06700 -1 rbd::mirror::InstanceWatcher: 0x55e523651500 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.221+0000 7f49852f9700 -1 rbd::mirror::MirrorStatusUpdater 0x55e52378ed80 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.221+0000 7f4991b12700 -1 rbd::mirror::NamespaceReplayer: 0x55e522e48000 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.221+0000 7f498b305700 -1 rbd::mirror::MirrorStatusUpdater 0x55e52378f320 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.221+0000 7f4992313700 -1 rbd::mirror::NamespaceReplayer: 0x55e522e48000 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.246 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Stopped 2024-09-21T15:32:30.246 DEBUG:teuthology.run_tasks:Unwinding manager rbd-mirror 2024-09-21T15:32:30.257 DEBUG:tasks.rbd_mirror.cluster2.client.mirror.1:waiting for process to exit 2024-09-21T15:32:30.257 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:32:30.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.253+0000 7f1408463700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 128270) UID: 1000 2024-09-21T15:32:30.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1407461700 -1 rbd::mirror::LeaderWatcher: 0x55eb5aba5500 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:30.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1407461700 -1 rbd::mirror::InstanceWatcher: 0x55eb5aa68380 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6488 object: (2) No such file or directory 2024-09-21T15:32:30.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1407461700 -1 rbd::mirror::InstanceWatcher: 0x55eb5aa68a80 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6488 object: (2) No such file or directory 2024-09-21T15:32:30.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1407c62700 -1 rbd::mirror::InstanceWatcher: 0x55eb5af1a000 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6494 object: (2) No such file or directory 2024-09-21T15:32:30.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1400c54700 -1 rbd::mirror::InstanceWatcher: 0x55eb5aa68380 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.261 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1400c54700 -1 rbd::mirror::InstanceWatcher: 0x55eb5aa68a80 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.261 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f13f3439700 -1 rbd::mirror::InstanceWatcher: 0x55eb5af1a000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.261 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f13fa447700 -1 rbd::mirror::MirrorStatusUpdater 0x55eb5aab66c0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.262 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f13fa447700 -1 rbd::mirror::MirrorStatusUpdater 0x55eb5aab65a0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.262 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1407461700 -1 rbd::mirror::NamespaceReplayer: 0x55eb5aab4000 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.262 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1407461700 -1 rbd::mirror::NamespaceReplayer: 0x55eb5aab41a0 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f13ecc2c700 -1 rbd::mirror::MirrorStatusUpdater 0x55eb5aab6b40 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1407c62700 -1 rbd::mirror::NamespaceReplayer: 0x55eb5af0c000 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1400c54700 -1 rbd::mirror::MirrorStatusUpdater 0x55eb5aab6000 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1400c54700 -1 rbd::mirror::MirrorStatusUpdater 0x55eb5aab6120 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1407461700 -1 rbd::mirror::NamespaceReplayer: 0x55eb5aab4000 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1407461700 -1 rbd::mirror::NamespaceReplayer: 0x55eb5aab41a0 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f13f3439700 -1 rbd::mirror::MirrorStatusUpdater 0x55eb5ac8c480 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.257+0000 7f1407c62700 -1 rbd::mirror::NamespaceReplayer: 0x55eb5af0c000 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.265+0000 7f1407461700 -1 rbd::mirror::LeaderWatcher: 0x55eb5a833500 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:30.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.265+0000 7f1407461700 -1 rbd::mirror::InstanceWatcher: 0x55eb5aa68000 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6488 object: (2) No such file or directory 2024-09-21T15:32:30.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.265+0000 7f1400c54700 -1 rbd::mirror::InstanceWatcher: 0x55eb5aa68000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.269 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.265+0000 7f13fa447700 -1 rbd::mirror::MirrorStatusUpdater 0x55eb5a8465a0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.269 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.265+0000 7f1407461700 -1 rbd::mirror::NamespaceReplayer: 0x55eb5a9bc340 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.269 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.265+0000 7f1400c54700 -1 rbd::mirror::MirrorStatusUpdater 0x55eb5a7f47e0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.269 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.265+0000 7f1407c62700 -1 rbd::mirror::NamespaceReplayer: 0x55eb5a9bc340 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.288 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Stopped 2024-09-21T15:32:30.289 DEBUG:teuthology.run_tasks:Unwinding manager rbd-mirror 2024-09-21T15:32:30.304 DEBUG:tasks.rbd_mirror.cluster2.client.mirror.0:waiting for process to exit 2024-09-21T15:32:30.305 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:32:30.306 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.301+0000 7f416bbff700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 115158) UID: 1000 2024-09-21T15:32:30.307 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f416b3fe700 -1 rbd::mirror::LeaderWatcher: 0x558f65d45500 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:30.308 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f416b3fe700 -1 rbd::mirror::InstanceWatcher: 0x558f65bf8380 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6069 object: (2) No such file or directory 2024-09-21T15:32:30.308 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f416b3fe700 -1 rbd::mirror::InstanceWatcher: 0x558f65bf9c00 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6069 object: (2) No such file or directory 2024-09-21T15:32:30.308 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f4156bd5700 -1 rbd::mirror::InstanceWatcher: 0x558f660c2000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.309 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f41643f0700 -1 rbd::mirror::InstanceWatcher: 0x558f65bf8380 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.309 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f4164bf1700 -1 rbd::mirror::InstanceWatcher: 0x558f65bf9c00 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.309 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f4156bd5700 -1 rbd::mirror::MirrorStatusUpdater 0x558f65e08120 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.310 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f416b3fe700 -1 rbd::mirror::NamespaceReplayer: 0x558f65f724e0 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.310 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f415dbe3700 -1 rbd::mirror::MirrorStatusUpdater 0x558f65c44a20 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.310 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f415dbe3700 -1 rbd::mirror::MirrorStatusUpdater 0x558f65c445a0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.310 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f416b3fe700 -1 rbd::mirror::NamespaceReplayer: 0x558f65bf09c0 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.310 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f416b3fe700 -1 rbd::mirror::NamespaceReplayer: 0x558f65bf0b60 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.310 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f4164bf1700 -1 rbd::mirror::MirrorStatusUpdater 0x558f65c44000 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.310 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f4164bf1700 -1 rbd::mirror::MirrorStatusUpdater 0x558f65c44120 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.310 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f416abfd700 -1 rbd::mirror::NamespaceReplayer: 0x558f65bf09c0 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.311 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.305+0000 7f416abfd700 -1 rbd::mirror::NamespaceReplayer: 0x558f65bf0b60 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.314 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.309+0000 7f416abfd700 -1 rbd::mirror::LeaderWatcher: 0x558f659a1500 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:30.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.313+0000 7f416abfd700 -1 rbd::mirror::InstanceWatcher: 0x558f65bf8000 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6069 object: (2) No such file or directory 2024-09-21T15:32:30.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.313+0000 7f4164bf1700 -1 rbd::mirror::InstanceWatcher: 0x558f65bf8000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.316 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.313+0000 7f415dbe3700 -1 rbd::mirror::MirrorStatusUpdater 0x558f65b7a480 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.316 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.313+0000 7f416abfd700 -1 rbd::mirror::NamespaceReplayer: 0x558f65bf0000 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.316 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.313+0000 7f41643f0700 -1 rbd::mirror::MirrorStatusUpdater 0x558f659ae900 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.317 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.313+0000 7f416b3fe700 -1 rbd::mirror::NamespaceReplayer: 0x558f65bf0000 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Stopped 2024-09-21T15:32:30.334 DEBUG:teuthology.run_tasks:Unwinding manager rbd-mirror 2024-09-21T15:32:30.352 DEBUG:tasks.rbd_mirror.cluster1.client.mirror.3:waiting for process to exit 2024-09-21T15:32:30.353 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:32:30.378 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.373+0000 7fcf35fd0700 -1 rbd::mirror::PoolWatcher: 0x5588f5477860 operator(): error unregistering watcher for rbd_mirroring object: (2) No such file or directory 2024-09-21T15:32:30.378 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.373+0000 7fcf51006700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.3 (PID: 109461) UID: 1000 2024-09-21T15:32:30.379 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf50805700 -1 rbd::mirror::LeaderWatcher: 0x5588f5200f00 handle_notify_lock_released: error notifying leader lock released: (2) No such file or directory 2024-09-21T15:32:30.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf50805700 -1 rbd::mirror::InstanceWatcher: 0x5588f4e8a380 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6108 object: (2) No such file or directory 2024-09-21T15:32:30.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf50805700 -1 rbd::mirror::InstanceWatcher: 0x5588f4e8aa80 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6108 object: (2) No such file or directory 2024-09-21T15:32:30.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf49ff8700 -1 rbd::mirror::InstanceWatcher: 0x5588f4e8a380 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.381 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf497f7700 -1 rbd::mirror::InstanceWatcher: 0x5588f4e8aa80 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.381 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf3c7dd700 -1 rbd::mirror::InstanceWatcher: 0x5588f533e000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.381 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf42fea700 -1 rbd::mirror::MirrorStatusUpdater 0x5588f4f02480 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf50004700 -1 rbd::mirror::NamespaceReplayer: 0x5588f4e86820 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf42fea700 -1 rbd::mirror::MirrorStatusUpdater 0x5588f4f02360 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf357cf700 -1 rbd::mirror::MirrorStatusUpdater 0x5588f4f026c0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf50805700 -1 rbd::mirror::NamespaceReplayer: 0x5588f4e869c0 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf50805700 -1 rbd::mirror::NamespaceReplayer: 0x5588f51ec680 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf49ff8700 -1 rbd::mirror::MirrorStatusUpdater 0x5588f4f02000 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf50805700 -1 rbd::mirror::NamespaceReplayer: 0x5588f4e86820 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf49ff8700 -1 rbd::mirror::MirrorStatusUpdater 0x5588f4f02120 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.383 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.377+0000 7fcf50805700 -1 rbd::mirror::NamespaceReplayer: 0x5588f4e869c0 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.386 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.385+0000 7fcf50805700 -1 rbd::mirror::LeaderWatcher: 0x5588f4e6e900 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:30.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.385+0000 7fcf50805700 -1 rbd::mirror::InstanceWatcher: 0x5588f4e8a000 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6108 object: (2) No such file or directory 2024-09-21T15:32:30.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.385+0000 7fcf49ff8700 -1 rbd::mirror::InstanceWatcher: 0x5588f4e8a000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.385+0000 7fcf437eb700 -1 rbd::mirror::MirrorStatusUpdater 0x5588f4c646c0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.385+0000 7fcf50805700 -1 rbd::mirror::NamespaceReplayer: 0x5588f4e86000 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.390 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.385+0000 7fcf49ff8700 -1 rbd::mirror::MirrorStatusUpdater 0x5588f58186c0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.390 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi161.stderr:2024-09-21T15:32:30.385+0000 7fcf50004700 -1 rbd::mirror::NamespaceReplayer: 0x5588f4e86000 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.414 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Stopped 2024-09-21T15:32:30.415 DEBUG:teuthology.run_tasks:Unwinding manager rbd-mirror 2024-09-21T15:32:30.425 DEBUG:tasks.rbd_mirror.cluster1.client.mirror.2:waiting for process to exit 2024-09-21T15:32:30.425 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:32:30.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.457+0000 7fd006c12700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 (PID: 116134) UID: 1000 2024-09-21T15:32:30.460 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.457+0000 7fd005c10700 -1 rbd::mirror::LeaderWatcher: 0x556e85f76f00 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:30.462 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.457+0000 7fd005c10700 -1 rbd::mirror::InstanceWatcher: 0x556e85be6a80 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6494 object: (2) No such file or directory 2024-09-21T15:32:30.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.461+0000 7fcff23e9700 -1 rbd::mirror::InstanceWatcher: 0x556e85be6a80 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.461+0000 7fcfebbdc700 -1 rbd::mirror::MirrorStatusUpdater 0x556e85e427e0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.461+0000 7fd005c10700 -1 rbd::mirror::NamespaceReplayer: 0x556e860084e0 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.461+0000 7fcff23e9700 -1 rbd::mirror::MirrorStatusUpdater 0x556e85e36120 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi161.stderr:2024-09-21T15:32:30.461+0000 7fd006411700 -1 rbd::mirror::NamespaceReplayer: 0x556e860084e0 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.486 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Stopped 2024-09-21T15:32:30.486 DEBUG:teuthology.run_tasks:Unwinding manager rbd-mirror 2024-09-21T15:32:30.497 DEBUG:tasks.rbd_mirror.cluster1.client.mirror.1:waiting for process to exit 2024-09-21T15:32:30.497 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:32:30.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.493+0000 7f209d430700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 (PID: 135005) UID: 1000 2024-09-21T15:32:30.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f209c42e700 -1 rbd::mirror::LeaderWatcher: 0x55914f040f00 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:30.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f209c42e700 -1 rbd::mirror::InstanceWatcher: 0x55914ecb4a80 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.7418 object: (2) No such file or directory 2024-09-21T15:32:30.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f209c42e700 -1 rbd::mirror::InstanceWatcher: 0x55914ecb4380 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.7418 object: (2) No such file or directory 2024-09-21T15:32:30.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f2088c07700 -1 rbd::mirror::InstanceWatcher: 0x55914f184000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f2096422700 -1 rbd::mirror::InstanceWatcher: 0x55914ecb4a80 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f2096422700 -1 rbd::mirror::InstanceWatcher: 0x55914ecb4380 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f2081bf9700 -1 rbd::mirror::MirrorStatusUpdater 0x55914ecec900 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f209c42e700 -1 rbd::mirror::NamespaceReplayer: 0x55914f02e680 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f208f414700 -1 rbd::mirror::MirrorStatusUpdater 0x55914ecec480 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f208f414700 -1 rbd::mirror::MirrorStatusUpdater 0x55914ecec360 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f209cc2f700 -1 rbd::mirror::NamespaceReplayer: 0x55914ecb0820 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f209cc2f700 -1 rbd::mirror::NamespaceReplayer: 0x55914ecb09c0 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f2088c07700 -1 rbd::mirror::MirrorStatusUpdater 0x55914eed6480 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f209c42e700 -1 rbd::mirror::NamespaceReplayer: 0x55914f02e680 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f2096422700 -1 rbd::mirror::MirrorStatusUpdater 0x55914ecec000 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f2096422700 -1 rbd::mirror::MirrorStatusUpdater 0x55914ecec120 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f209cc2f700 -1 rbd::mirror::NamespaceReplayer: 0x55914ecb0820 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.497+0000 7f209cc2f700 -1 rbd::mirror::NamespaceReplayer: 0x55914ecb09c0 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.506 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.501+0000 7f209cc2f700 -1 rbd::mirror::LeaderWatcher: 0x55914ebfe900 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:30.507 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.505+0000 7f209cc2f700 -1 rbd::mirror::InstanceWatcher: 0x55914ecb4000 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.7418 object: (2) No such file or directory 2024-09-21T15:32:30.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.505+0000 7f2095c21700 -1 rbd::mirror::InstanceWatcher: 0x55914ecb4000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.505+0000 7f208f414700 -1 rbd::mirror::MirrorStatusUpdater 0x55914ec30480 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.505+0000 7f209cc2f700 -1 rbd::mirror::NamespaceReplayer: 0x55914ecb0000 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.505+0000 7f2095c21700 -1 rbd::mirror::MirrorStatusUpdater 0x55914ea76900 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi161.stderr:2024-09-21T15:32:30.505+0000 7f209c42e700 -1 rbd::mirror::NamespaceReplayer: 0x55914ecb0000 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.526 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Stopped 2024-09-21T15:32:30.527 DEBUG:teuthology.run_tasks:Unwinding manager rbd-mirror 2024-09-21T15:32:30.538 DEBUG:tasks.rbd_mirror.cluster1.client.mirror.0:waiting for process to exit 2024-09-21T15:32:30.538 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:32:30.539 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.537+0000 7f07e10d3700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 (PID: 125595) UID: 1000 2024-09-21T15:32:30.540 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.537+0000 7f07e00d1700 -1 rbd::mirror::LeaderWatcher: 0x562507e52f00 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:30.540 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.537+0000 7f07e08d2700 -1 rbd::mirror::InstanceWatcher: 0x562507ad8380 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6896 object: (2) No such file or directory 2024-09-21T15:32:30.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.537+0000 7f07e08d2700 -1 rbd::mirror::InstanceWatcher: 0x562507ad8a80 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6896 object: (2) No such file or directory 2024-09-21T15:32:30.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.537+0000 7f07e08d2700 -1 rbd::mirror::InstanceWatcher: 0x562507f94000 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6902 object: (2) No such file or directory 2024-09-21T15:32:30.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.537+0000 7f07da0c5700 -1 rbd::mirror::InstanceWatcher: 0x562507ad8380 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.537+0000 7f07da0c5700 -1 rbd::mirror::InstanceWatcher: 0x562507ad8a80 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.537+0000 7f07cc8aa700 -1 rbd::mirror::InstanceWatcher: 0x562507f94000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.537+0000 7f07d38b8700 -1 rbd::mirror::MirrorStatusUpdater 0x562507b1a360 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.537+0000 7f07d38b8700 -1 rbd::mirror::MirrorStatusUpdater 0x562507b1a480 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.537+0000 7f07e00d1700 -1 rbd::mirror::NamespaceReplayer: 0x562507ad4820 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.537+0000 7f07e00d1700 -1 rbd::mirror::NamespaceReplayer: 0x562507ad49c0 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.537+0000 7f07c589c700 -1 rbd::mirror::MirrorStatusUpdater 0x562507b1a6c0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.541+0000 7f07e08d2700 -1 rbd::mirror::NamespaceReplayer: 0x562507e40680 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.541+0000 7f07da0c5700 -1 rbd::mirror::MirrorStatusUpdater 0x562507b1a000 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.541+0000 7f07da0c5700 -1 rbd::mirror::MirrorStatusUpdater 0x562507b1a120 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.541+0000 7f07e00d1700 -1 rbd::mirror::NamespaceReplayer: 0x562507ad4820 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.541+0000 7f07e00d1700 -1 rbd::mirror::NamespaceReplayer: 0x562507ad49c0 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.544 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.541+0000 7f07cc8aa700 -1 rbd::mirror::MirrorStatusUpdater 0x562507cf0120 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.544 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.541+0000 7f07e08d2700 -1 rbd::mirror::NamespaceReplayer: 0x562507e40680 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.545+0000 7f07e00d1700 -1 rbd::mirror::LeaderWatcher: 0x562507abe900 handle_unregister_watch: error unregistering leader watcher for rbd_mirror_leader object: (2) No such file or directory 2024-09-21T15:32:30.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.545+0000 7f07e00d1700 -1 rbd::mirror::InstanceWatcher: 0x562507ad8000 handle_unregister_watch: error unregistering instance watcher for rbd_mirror_instance.6896 object: (2) No such file or directory 2024-09-21T15:32:30.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.545+0000 7f07da0c5700 -1 rbd::mirror::InstanceWatcher: 0x562507ad8000 handle_unregister_instance: error unregistering instance: (2) No such file or directory 2024-09-21T15:32:30.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.545+0000 7f07d30b7700 -1 rbd::mirror::MirrorStatusUpdater 0x56250788c6c0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.545+0000 7f07e00d1700 -1 rbd::mirror::NamespaceReplayer: 0x562507ad4000 handle_shut_down_remote_status_updater: error shutting remote mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.545+0000 7f07d98c4700 -1 rbd::mirror::MirrorStatusUpdater 0x56250847c6c0 handle_shut_down_mirror_status_watcher: failed to shut down mirror status watcher: (2) No such file or directory 2024-09-21T15:32:30.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi161.stderr:2024-09-21T15:32:30.545+0000 7f07e08d2700 -1 rbd::mirror::NamespaceReplayer: 0x562507ad4000 handle_shut_down_local_status_updater: error shutting local mirror status updater down: (2) No such file or directory 2024-09-21T15:32:30.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Stopped 2024-09-21T15:32:30.569 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T15:32:30.580 INFO:tasks.ceph.ceph_manager.cluster2:waiting for clean 2024-09-21T15:32:30.580 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-21T15:32:30.942 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:32:30.945 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-09-21T15:32:30.957 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":1369,"stamp":"2024-09-21T15:32:29.270822+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":232,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1081224,"kb_used_data":177384,"kb_used_omap":4,"kb_used_meta":903803,"kb_avail":282034296,"statfs":{"total":289910292480,"available":288803119104,"internally_reserved":0,"allocated":181641216,"data_stored":1572080460,"data_compressed":102465541,"data_compressed_allocated":116518912,"data_compressed_original":1523556423,"omap_allocated":4782,"internal_metadata":925494610},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7137625278,"num_objects":-10294,"num_object_clones":-3059,"num_object_copies":-20588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10294,"num_whiteouts":-1026,"num_read":-1145442,"num_read_kb":-5291854,"num_write":-91823,"num_write_kb":-1893684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-5,"num_bytes_recovered":-30801,"num_keys_recovered":-2,"num_objects_omap":-539,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.090619"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:48.975432+0000","last_change":"2024-09-21T15:05:48.084470+0000","last_active":"2024-09-21T15:31:48.975432+0000","last_peered":"2024-09-21T15:31:48.975432+0000","last_clean":"2024-09-21T15:31:48.975432+0000","last_became_active":"2024-09-21T15:05:46.074075+0000","last_became_peered":"2024-09-21T15:05:46.074075+0000","last_unstale":"2024-09-21T15:31:48.975432+0000","last_undegraded":"2024-09-21T15:31:48.975432+0000","last_fullsized":"2024-09-21T15:31:48.975432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:27:06.084591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081259799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:48.975405+0000","last_change":"2024-09-21T15:05:48.084948+0000","last_active":"2024-09-21T15:31:48.975405+0000","last_peered":"2024-09-21T15:31:48.975405+0000","last_clean":"2024-09-21T15:31:48.975405+0000","last_became_active":"2024-09-21T15:05:46.070093+0000","last_became_peered":"2024-09-21T15:05:46.070093+0000","last_unstale":"2024-09-21T15:31:48.975405+0000","last_undegraded":"2024-09-21T15:31:48.975405+0000","last_fullsized":"2024-09-21T15:31:48.975405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:44.968622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001263908,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:53.963084+0000","last_change":"2024-09-21T15:05:48.084157+0000","last_active":"2024-09-21T15:30:53.963084+0000","last_peered":"2024-09-21T15:30:53.963084+0000","last_clean":"2024-09-21T15:30:53.963084+0000","last_became_active":"2024-09-21T15:05:46.074031+0000","last_became_peered":"2024-09-21T15:05:46.074031+0000","last_unstale":"2024-09-21T15:30:53.963084+0000","last_undegraded":"2024-09-21T15:30:53.963084+0000","last_fullsized":"2024-09-21T15:30:53.963084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:56.980131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058148599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:48.961731+0000","last_change":"2024-09-21T15:05:48.085081+0000","last_active":"2024-09-21T15:30:48.961731+0000","last_peered":"2024-09-21T15:30:48.961731+0000","last_clean":"2024-09-21T15:30:48.961731+0000","last_became_active":"2024-09-21T15:05:46.073780+0000","last_became_peered":"2024-09-21T15:05:46.073780+0000","last_unstale":"2024-09-21T15:30:48.961731+0000","last_undegraded":"2024-09-21T15:30:48.961731+0000","last_fullsized":"2024-09-21T15:30:48.961731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:08.087343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001316731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:28:44.554262+0000","last_change":"2024-09-21T15:05:48.081253+0000","last_active":"2024-09-21T15:28:44.554262+0000","last_peered":"2024-09-21T15:28:44.554262+0000","last_clean":"2024-09-21T15:28:44.554262+0000","last_became_active":"2024-09-21T15:05:46.068146+0000","last_became_peered":"2024-09-21T15:05:46.068146+0000","last_unstale":"2024-09-21T15:28:44.554262+0000","last_undegraded":"2024-09-21T15:28:44.554262+0000","last_fullsized":"2024-09-21T15:28:44.554262+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:18.171320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001686313,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:48.917011+0000","last_change":"2024-09-21T15:05:48.075744+0000","last_active":"2024-09-21T15:30:48.917011+0000","last_peered":"2024-09-21T15:30:48.917011+0000","last_clean":"2024-09-21T15:30:48.917011+0000","last_became_active":"2024-09-21T15:05:46.071491+0000","last_became_peered":"2024-09-21T15:05:46.071491+0000","last_unstale":"2024-09-21T15:30:48.917011+0000","last_undegraded":"2024-09-21T15:30:48.917011+0000","last_fullsized":"2024-09-21T15:30:48.917011+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:05:19.661233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066534299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":579,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:53.931444+0000","last_change":"2024-09-21T15:05:48.075940+0000","last_active":"2024-09-21T15:31:53.931444+0000","last_peered":"2024-09-21T15:31:53.931444+0000","last_clean":"2024-09-21T15:31:53.931444+0000","last_became_active":"2024-09-21T15:05:46.070050+0000","last_became_peered":"2024-09-21T15:05:46.070050+0000","last_unstale":"2024-09-21T15:31:53.931444+0000","last_undegraded":"2024-09-21T15:31:53.931444+0000","last_fullsized":"2024-09-21T15:31:53.931444+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:29.810140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079646399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":579,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:48.961705+0000","last_change":"2024-09-21T15:05:48.084287+0000","last_active":"2024-09-21T15:30:48.961705+0000","last_peered":"2024-09-21T15:30:48.961705+0000","last_clean":"2024-09-21T15:30:48.961705+0000","last_became_active":"2024-09-21T15:05:46.069593+0000","last_became_peered":"2024-09-21T15:05:46.069593+0000","last_unstale":"2024-09-21T15:30:48.961705+0000","last_undegraded":"2024-09-21T15:30:48.961705+0000","last_fullsized":"2024-09-21T15:30:48.961705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:33:51.293048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067986000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'97","reported_seq":704,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:48.974904+0000","last_change":"2024-09-21T15:05:40.236152+0000","last_active":"2024-09-21T15:31:48.974904+0000","last_peered":"2024-09-21T15:31:48.974904+0000","last_clean":"2024-09-21T15:31:48.974904+0000","last_became_active":"2024-09-21T15:05:40.233945+0000","last_became_peered":"2024-09-21T15:05:40.233945+0000","last_unstale":"2024-09-21T15:31:48.974904+0000","last_undegraded":"2024-09-21T15:31:48.974904+0000","last_fullsized":"2024-09-21T15:31:48.974904+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:39.013738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:39.013738+0000","last_clean_scrub_stamp":"2024-09-21T15:05:39.013738+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:02.256703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60350,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738694,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306428,"kb_used_data":4592,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":94065412,"statfs":{"total":96636764160,"available":96322981888,"internally_reserved":0,"allocated":4702208,"data_stored":2524915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309066182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.55500000000000005,"15min":0.67800000000000005},"min":{"1min":0.28199999999999997,"5min":0.185,"15min":0.185},"max":{"1min":0.69499999999999995,"5min":5.766,"15min":38.828000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.69899999999999995,"15min":0.81799999999999995},"min":{"1min":0.35099999999999998,"5min":0.22600000000000001,"15min":0.20300000000000001},"max":{"1min":0.66800000000000004,"5min":10.754,"15min":38.473999999999997},"last":0.378}]},{"osd":1,"last update":"Sat Sep 21 15:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":1.1779999999999999,"15min":0.85999999999999999},"min":{"1min":0.246,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":0.70999999999999996,"5min":51.167999999999999,"15min":51.167999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.84099999999999997},"min":{"1min":0.31900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.76600000000000001,"5min":2.1059999999999999,"15min":49.823999999999998},"last":0.71399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738693,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314684,"kb_used_data":4656,"kb_used_omap":1,"kb_used_meta":310014,"kb_avail":94057156,"statfs":{"total":96636764160,"available":96314527744,"internally_reserved":0,"allocated":4767744,"data_stored":3115302,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":317454790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":1.347,"15min":0.86199999999999999},"min":{"1min":0.28000000000000003,"5min":0.24099999999999999,"15min":0.17699999999999999},"max":{"1min":1.837,"5min":66.188000000000002,"15min":66.188000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":1.2849999999999999,"15min":1.552},"min":{"1min":0.32600000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.85499999999999998,"5min":66.441999999999993,"15min":66.441999999999993},"last":0.39500000000000002}]},{"osd":2,"last update":"Sat Sep 21 15:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.496,"15min":0.623},"min":{"1min":0.308,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.893,"5min":1.893,"15min":22.704999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.58499999999999996,"15min":0.75},"min":{"1min":0.39000000000000001,"5min":0.30299999999999999,"15min":0.21199999999999999},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":14.817},"last":0.92800000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738696,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":460112,"kb_used_data":168136,"kb_used_omap":1,"kb_used_meta":291966,"kb_avail":93911728,"statfs":{"total":96636764160,"available":96165609472,"internally_reserved":0,"allocated":172171264,"data_stored":1566440243,"data_compressed":102435366,"data_compressed_allocated":116477952,"data_compressed_original":1522982983,"omap_allocated":1594,"internal_metadata":298973638},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 15:31:32 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.67800000000000005,"15min":0.879},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20100000000000001},"max":{"1min":1.2010000000000001,"5min":15.881,"15min":53.292000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.437,"5min":1.4259999999999999,"15min":0.86199999999999999},"min":{"1min":0.29299999999999998,"5min":0.23699999999999999,"15min":0.17599999999999999},"max":{"1min":0.746,"5min":50.317999999999998,"15min":50.317999999999998},"last":0.57999999999999996}]},{"osd":2,"last update":"Sat Sep 21 15:31:32 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.85199999999999998,"15min":0.68300000000000005},"min":{"1min":0.221,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65200000000000002,"5min":21.312999999999999,"15min":21.312999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":1.153,"5min":1.101,"15min":0.80000000000000004},"min":{"1min":0.26800000000000002,"5min":0.245,"15min":0.20599999999999999},"max":{"1min":14.188000000000001,"5min":20.733000000000001,"15min":20.733000000000001},"last":0.505}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:32:30.959 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-21T15:32:31.263 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:32:31.266 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-09-21T15:32:31.277 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":1370,"stamp":"2024-09-21T15:32:31.183301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":232,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1021368,"kb_used_data":99240,"kb_used_omap":4,"kb_used_meta":921851,"kb_avail":282094152,"statfs":{"total":289910292480,"available":288864411648,"internally_reserved":0,"allocated":101621760,"data_stored":881089352,"data_compressed":56438089,"data_compressed_allocated":62365696,"data_compressed_original":853171494,"omap_allocated":4782,"internal_metadata":943975762},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7137625278,"num_objects":-10294,"num_object_clones":-3059,"num_object_copies":-20588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10294,"num_whiteouts":-1026,"num_read":-1145442,"num_read_kb":-5291854,"num_write":-91823,"num_write_kb":-1893684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-5,"num_bytes_recovered":-30801,"num_keys_recovered":-2,"num_objects_omap":-539,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002364"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:48.975432+0000","last_change":"2024-09-21T15:05:48.084470+0000","last_active":"2024-09-21T15:31:48.975432+0000","last_peered":"2024-09-21T15:31:48.975432+0000","last_clean":"2024-09-21T15:31:48.975432+0000","last_became_active":"2024-09-21T15:05:46.074075+0000","last_became_peered":"2024-09-21T15:05:46.074075+0000","last_unstale":"2024-09-21T15:31:48.975432+0000","last_undegraded":"2024-09-21T15:31:48.975432+0000","last_fullsized":"2024-09-21T15:31:48.975432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:27:06.084591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081259799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:48.975405+0000","last_change":"2024-09-21T15:05:48.084948+0000","last_active":"2024-09-21T15:31:48.975405+0000","last_peered":"2024-09-21T15:31:48.975405+0000","last_clean":"2024-09-21T15:31:48.975405+0000","last_became_active":"2024-09-21T15:05:46.070093+0000","last_became_peered":"2024-09-21T15:05:46.070093+0000","last_unstale":"2024-09-21T15:31:48.975405+0000","last_undegraded":"2024-09-21T15:31:48.975405+0000","last_fullsized":"2024-09-21T15:31:48.975405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:44.968622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001263908,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:53.963084+0000","last_change":"2024-09-21T15:05:48.084157+0000","last_active":"2024-09-21T15:30:53.963084+0000","last_peered":"2024-09-21T15:30:53.963084+0000","last_clean":"2024-09-21T15:30:53.963084+0000","last_became_active":"2024-09-21T15:05:46.074031+0000","last_became_peered":"2024-09-21T15:05:46.074031+0000","last_unstale":"2024-09-21T15:30:53.963084+0000","last_undegraded":"2024-09-21T15:30:53.963084+0000","last_fullsized":"2024-09-21T15:30:53.963084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:56.980131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058148599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:48.961731+0000","last_change":"2024-09-21T15:05:48.085081+0000","last_active":"2024-09-21T15:30:48.961731+0000","last_peered":"2024-09-21T15:30:48.961731+0000","last_clean":"2024-09-21T15:30:48.961731+0000","last_became_active":"2024-09-21T15:05:46.073780+0000","last_became_peered":"2024-09-21T15:05:46.073780+0000","last_unstale":"2024-09-21T15:30:48.961731+0000","last_undegraded":"2024-09-21T15:30:48.961731+0000","last_fullsized":"2024-09-21T15:30:48.961731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:08.087343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001316731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":580,"reported_epoch":565,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.503738+0000","last_change":"2024-09-21T15:05:48.081253+0000","last_active":"2024-09-21T15:32:28.503738+0000","last_peered":"2024-09-21T15:32:28.503738+0000","last_clean":"2024-09-21T15:32:28.503738+0000","last_became_active":"2024-09-21T15:05:46.068146+0000","last_became_peered":"2024-09-21T15:05:46.068146+0000","last_unstale":"2024-09-21T15:32:28.503738+0000","last_undegraded":"2024-09-21T15:32:28.503738+0000","last_fullsized":"2024-09-21T15:32:28.503738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:18.171320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001686313,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:48.917011+0000","last_change":"2024-09-21T15:05:48.075744+0000","last_active":"2024-09-21T15:30:48.917011+0000","last_peered":"2024-09-21T15:30:48.917011+0000","last_clean":"2024-09-21T15:30:48.917011+0000","last_became_active":"2024-09-21T15:05:46.071491+0000","last_became_peered":"2024-09-21T15:05:46.071491+0000","last_unstale":"2024-09-21T15:30:48.917011+0000","last_undegraded":"2024-09-21T15:30:48.917011+0000","last_fullsized":"2024-09-21T15:30:48.917011+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:05:19.661233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066534299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":579,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:53.931444+0000","last_change":"2024-09-21T15:05:48.075940+0000","last_active":"2024-09-21T15:31:53.931444+0000","last_peered":"2024-09-21T15:31:53.931444+0000","last_clean":"2024-09-21T15:31:53.931444+0000","last_became_active":"2024-09-21T15:05:46.070050+0000","last_became_peered":"2024-09-21T15:05:46.070050+0000","last_unstale":"2024-09-21T15:31:53.931444+0000","last_undegraded":"2024-09-21T15:31:53.931444+0000","last_fullsized":"2024-09-21T15:31:53.931444+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:29.810140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079646399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":579,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:48.961705+0000","last_change":"2024-09-21T15:05:48.084287+0000","last_active":"2024-09-21T15:30:48.961705+0000","last_peered":"2024-09-21T15:30:48.961705+0000","last_clean":"2024-09-21T15:30:48.961705+0000","last_became_active":"2024-09-21T15:05:46.069593+0000","last_became_peered":"2024-09-21T15:05:46.069593+0000","last_unstale":"2024-09-21T15:30:48.961705+0000","last_undegraded":"2024-09-21T15:30:48.961705+0000","last_fullsized":"2024-09-21T15:30:48.961705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:33:51.293048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067986000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'97","reported_seq":704,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:48.974904+0000","last_change":"2024-09-21T15:05:40.236152+0000","last_active":"2024-09-21T15:31:48.974904+0000","last_peered":"2024-09-21T15:31:48.974904+0000","last_clean":"2024-09-21T15:31:48.974904+0000","last_became_active":"2024-09-21T15:05:40.233945+0000","last_became_peered":"2024-09-21T15:05:40.233945+0000","last_unstale":"2024-09-21T15:31:48.974904+0000","last_undegraded":"2024-09-21T15:31:48.974904+0000","last_fullsized":"2024-09-21T15:31:48.974904+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:39.013738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:39.013738+0000","last_clean_scrub_stamp":"2024-09-21T15:05:39.013738+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:02.256703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60350,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738694,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306428,"kb_used_data":4592,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":94065412,"statfs":{"total":96636764160,"available":96322981888,"internally_reserved":0,"allocated":4702208,"data_stored":2524915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309066182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.55500000000000005,"15min":0.67800000000000005},"min":{"1min":0.28199999999999997,"5min":0.185,"15min":0.185},"max":{"1min":0.69499999999999995,"5min":5.766,"15min":38.828000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.69899999999999995,"15min":0.81799999999999995},"min":{"1min":0.35099999999999998,"5min":0.22600000000000001,"15min":0.20300000000000001},"max":{"1min":0.66800000000000004,"5min":10.754,"15min":38.473999999999997},"last":0.378}]},{"osd":1,"last update":"Sat Sep 21 15:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":1.1779999999999999,"15min":0.85999999999999999},"min":{"1min":0.246,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":0.70999999999999996,"5min":51.167999999999999,"15min":51.167999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.84099999999999997},"min":{"1min":0.31900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.76600000000000001,"5min":2.1059999999999999,"15min":49.823999999999998},"last":0.71399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738693,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314684,"kb_used_data":4656,"kb_used_omap":1,"kb_used_meta":310014,"kb_avail":94057156,"statfs":{"total":96636764160,"available":96314527744,"internally_reserved":0,"allocated":4767744,"data_stored":3115302,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":317454790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":1.347,"15min":0.86199999999999999},"min":{"1min":0.28000000000000003,"5min":0.24099999999999999,"15min":0.17699999999999999},"max":{"1min":1.837,"5min":66.188000000000002,"15min":66.188000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":1.2849999999999999,"15min":1.552},"min":{"1min":0.32600000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.85499999999999998,"5min":66.441999999999993,"15min":66.441999999999993},"last":0.39500000000000002}]},{"osd":2,"last update":"Sat Sep 21 15:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.496,"15min":0.623},"min":{"1min":0.308,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.893,"5min":1.893,"15min":22.704999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.58499999999999996,"15min":0.75},"min":{"1min":0.39000000000000001,"5min":0.30299999999999999,"15min":0.21199999999999999},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":14.817},"last":0.92800000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738697,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":400256,"kb_used_data":89992,"kb_used_omap":1,"kb_used_meta":310014,"kb_avail":93971584,"statfs":{"total":96636764160,"available":96226902016,"internally_reserved":0,"allocated":92151808,"data_stored":875449135,"data_compressed":56407914,"data_compressed_allocated":62324736,"data_compressed_original":852598054,"omap_allocated":1594,"internal_metadata":317454790},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 15:31:32 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.67800000000000005,"15min":0.879},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20100000000000001},"max":{"1min":1.2010000000000001,"5min":15.881,"15min":53.292000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.437,"5min":1.4259999999999999,"15min":0.86199999999999999},"min":{"1min":0.29299999999999998,"5min":0.23699999999999999,"15min":0.17599999999999999},"max":{"1min":0.746,"5min":50.317999999999998,"15min":50.317999999999998},"last":0.44600000000000001}]},{"osd":2,"last update":"Sat Sep 21 15:31:32 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.85199999999999998,"15min":0.68300000000000005},"min":{"1min":0.221,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65200000000000002,"5min":21.312999999999999,"15min":21.312999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":1.153,"5min":1.101,"15min":0.80000000000000004},"min":{"1min":0.26800000000000002,"5min":0.245,"15min":0.20599999999999999},"max":{"1min":14.188000000000001,"5min":20.733000000000001,"15min":20.733000000000001},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:32:31.278 INFO:tasks.ceph.ceph_manager.cluster2:clean! 2024-09-21T15:32:31.278 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-21T15:32:31.579 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:32:31.582 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-09-21T15:32:31.594 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":1370,"stamp":"2024-09-21T15:32:31.183301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":232,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1021368,"kb_used_data":99240,"kb_used_omap":4,"kb_used_meta":921851,"kb_avail":282094152,"statfs":{"total":289910292480,"available":288864411648,"internally_reserved":0,"allocated":101621760,"data_stored":881089352,"data_compressed":56438089,"data_compressed_allocated":62365696,"data_compressed_original":853171494,"omap_allocated":4782,"internal_metadata":943975762},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7137625278,"num_objects":-10294,"num_object_clones":-3059,"num_object_copies":-20588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10294,"num_whiteouts":-1026,"num_read":-1145442,"num_read_kb":-5291854,"num_write":-91823,"num_write_kb":-1893684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-5,"num_bytes_recovered":-30801,"num_keys_recovered":-2,"num_objects_omap":-539,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002364"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:48.975432+0000","last_change":"2024-09-21T15:05:48.084470+0000","last_active":"2024-09-21T15:31:48.975432+0000","last_peered":"2024-09-21T15:31:48.975432+0000","last_clean":"2024-09-21T15:31:48.975432+0000","last_became_active":"2024-09-21T15:05:46.074075+0000","last_became_peered":"2024-09-21T15:05:46.074075+0000","last_unstale":"2024-09-21T15:31:48.975432+0000","last_undegraded":"2024-09-21T15:31:48.975432+0000","last_fullsized":"2024-09-21T15:31:48.975432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:27:06.084591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081259799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:48.975405+0000","last_change":"2024-09-21T15:05:48.084948+0000","last_active":"2024-09-21T15:31:48.975405+0000","last_peered":"2024-09-21T15:31:48.975405+0000","last_clean":"2024-09-21T15:31:48.975405+0000","last_became_active":"2024-09-21T15:05:46.070093+0000","last_became_peered":"2024-09-21T15:05:46.070093+0000","last_unstale":"2024-09-21T15:31:48.975405+0000","last_undegraded":"2024-09-21T15:31:48.975405+0000","last_fullsized":"2024-09-21T15:31:48.975405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:44.968622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001263908,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:53.963084+0000","last_change":"2024-09-21T15:05:48.084157+0000","last_active":"2024-09-21T15:30:53.963084+0000","last_peered":"2024-09-21T15:30:53.963084+0000","last_clean":"2024-09-21T15:30:53.963084+0000","last_became_active":"2024-09-21T15:05:46.074031+0000","last_became_peered":"2024-09-21T15:05:46.074031+0000","last_unstale":"2024-09-21T15:30:53.963084+0000","last_undegraded":"2024-09-21T15:30:53.963084+0000","last_fullsized":"2024-09-21T15:30:53.963084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:56.980131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058148599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:48.961731+0000","last_change":"2024-09-21T15:05:48.085081+0000","last_active":"2024-09-21T15:30:48.961731+0000","last_peered":"2024-09-21T15:30:48.961731+0000","last_clean":"2024-09-21T15:30:48.961731+0000","last_became_active":"2024-09-21T15:05:46.073780+0000","last_became_peered":"2024-09-21T15:05:46.073780+0000","last_unstale":"2024-09-21T15:30:48.961731+0000","last_undegraded":"2024-09-21T15:30:48.961731+0000","last_fullsized":"2024-09-21T15:30:48.961731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:08.087343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001316731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":580,"reported_epoch":565,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.503738+0000","last_change":"2024-09-21T15:05:48.081253+0000","last_active":"2024-09-21T15:32:28.503738+0000","last_peered":"2024-09-21T15:32:28.503738+0000","last_clean":"2024-09-21T15:32:28.503738+0000","last_became_active":"2024-09-21T15:05:46.068146+0000","last_became_peered":"2024-09-21T15:05:46.068146+0000","last_unstale":"2024-09-21T15:32:28.503738+0000","last_undegraded":"2024-09-21T15:32:28.503738+0000","last_fullsized":"2024-09-21T15:32:28.503738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:18.171320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001686313,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:48.917011+0000","last_change":"2024-09-21T15:05:48.075744+0000","last_active":"2024-09-21T15:30:48.917011+0000","last_peered":"2024-09-21T15:30:48.917011+0000","last_clean":"2024-09-21T15:30:48.917011+0000","last_became_active":"2024-09-21T15:05:46.071491+0000","last_became_peered":"2024-09-21T15:05:46.071491+0000","last_unstale":"2024-09-21T15:30:48.917011+0000","last_undegraded":"2024-09-21T15:30:48.917011+0000","last_fullsized":"2024-09-21T15:30:48.917011+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:05:19.661233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066534299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":579,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:53.931444+0000","last_change":"2024-09-21T15:05:48.075940+0000","last_active":"2024-09-21T15:31:53.931444+0000","last_peered":"2024-09-21T15:31:53.931444+0000","last_clean":"2024-09-21T15:31:53.931444+0000","last_became_active":"2024-09-21T15:05:46.070050+0000","last_became_peered":"2024-09-21T15:05:46.070050+0000","last_unstale":"2024-09-21T15:31:53.931444+0000","last_undegraded":"2024-09-21T15:31:53.931444+0000","last_fullsized":"2024-09-21T15:31:53.931444+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:29.810140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079646399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":579,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:48.961705+0000","last_change":"2024-09-21T15:05:48.084287+0000","last_active":"2024-09-21T15:30:48.961705+0000","last_peered":"2024-09-21T15:30:48.961705+0000","last_clean":"2024-09-21T15:30:48.961705+0000","last_became_active":"2024-09-21T15:05:46.069593+0000","last_became_peered":"2024-09-21T15:05:46.069593+0000","last_unstale":"2024-09-21T15:30:48.961705+0000","last_undegraded":"2024-09-21T15:30:48.961705+0000","last_fullsized":"2024-09-21T15:30:48.961705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:33:51.293048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067986000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'97","reported_seq":704,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:48.974904+0000","last_change":"2024-09-21T15:05:40.236152+0000","last_active":"2024-09-21T15:31:48.974904+0000","last_peered":"2024-09-21T15:31:48.974904+0000","last_clean":"2024-09-21T15:31:48.974904+0000","last_became_active":"2024-09-21T15:05:40.233945+0000","last_became_peered":"2024-09-21T15:05:40.233945+0000","last_unstale":"2024-09-21T15:31:48.974904+0000","last_undegraded":"2024-09-21T15:31:48.974904+0000","last_fullsized":"2024-09-21T15:31:48.974904+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:39.013738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:39.013738+0000","last_clean_scrub_stamp":"2024-09-21T15:05:39.013738+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:02.256703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60350,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738694,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306428,"kb_used_data":4592,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":94065412,"statfs":{"total":96636764160,"available":96322981888,"internally_reserved":0,"allocated":4702208,"data_stored":2524915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309066182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.55500000000000005,"15min":0.67800000000000005},"min":{"1min":0.28199999999999997,"5min":0.185,"15min":0.185},"max":{"1min":0.69499999999999995,"5min":5.766,"15min":38.828000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.69899999999999995,"15min":0.81799999999999995},"min":{"1min":0.35099999999999998,"5min":0.22600000000000001,"15min":0.20300000000000001},"max":{"1min":0.66800000000000004,"5min":10.754,"15min":38.473999999999997},"last":0.378}]},{"osd":1,"last update":"Sat Sep 21 15:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":1.1779999999999999,"15min":0.85999999999999999},"min":{"1min":0.246,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":0.70999999999999996,"5min":51.167999999999999,"15min":51.167999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.84099999999999997},"min":{"1min":0.31900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.76600000000000001,"5min":2.1059999999999999,"15min":49.823999999999998},"last":0.71399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738693,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314684,"kb_used_data":4656,"kb_used_omap":1,"kb_used_meta":310014,"kb_avail":94057156,"statfs":{"total":96636764160,"available":96314527744,"internally_reserved":0,"allocated":4767744,"data_stored":3115302,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":317454790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":1.347,"15min":0.86199999999999999},"min":{"1min":0.28000000000000003,"5min":0.24099999999999999,"15min":0.17699999999999999},"max":{"1min":1.837,"5min":66.188000000000002,"15min":66.188000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":1.2849999999999999,"15min":1.552},"min":{"1min":0.32600000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.85499999999999998,"5min":66.441999999999993,"15min":66.441999999999993},"last":0.39500000000000002}]},{"osd":2,"last update":"Sat Sep 21 15:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.496,"15min":0.623},"min":{"1min":0.308,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.893,"5min":1.893,"15min":22.704999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.58499999999999996,"15min":0.75},"min":{"1min":0.39000000000000001,"5min":0.30299999999999999,"15min":0.21199999999999999},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":14.817},"last":0.92800000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738697,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":400256,"kb_used_data":89992,"kb_used_omap":1,"kb_used_meta":310014,"kb_avail":93971584,"statfs":{"total":96636764160,"available":96226902016,"internally_reserved":0,"allocated":92151808,"data_stored":875449135,"data_compressed":56407914,"data_compressed_allocated":62324736,"data_compressed_original":852598054,"omap_allocated":1594,"internal_metadata":317454790},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 15:31:32 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.67800000000000005,"15min":0.879},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20100000000000001},"max":{"1min":1.2010000000000001,"5min":15.881,"15min":53.292000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.437,"5min":1.4259999999999999,"15min":0.86199999999999999},"min":{"1min":0.29299999999999998,"5min":0.23699999999999999,"15min":0.17599999999999999},"max":{"1min":0.746,"5min":50.317999999999998,"15min":50.317999999999998},"last":0.44600000000000001}]},{"osd":2,"last update":"Sat Sep 21 15:31:32 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.85199999999999998,"15min":0.68300000000000005},"min":{"1min":0.221,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65200000000000002,"5min":21.312999999999999,"15min":21.312999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":1.153,"5min":1.101,"15min":0.80000000000000004},"min":{"1min":0.26800000000000002,"5min":0.245,"15min":0.20599999999999999},"max":{"1min":14.188000000000001,"5min":20.733000000000001,"15min":20.733000000000001},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:32:31.595 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2024-09-21T15:32:31.889 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:32:31.889 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":566,"fsid":"8334776e-26c5-4f44-8f06-b169be5e91ca","created":"2024-09-21T15:05:28.839197+0000","modified":"2024-09-21T15:32:29.266943+0000","last_up_change":"2024-09-21T15:05:38.011857+0000","last_in_change":"2024-09-21T15:05:29.699542+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T15:05:38.697784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T15:05:44.115975+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3882a0de-b08f-4844-8b28-46a529e12dc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6809","nonce":770292651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6811","nonce":770292651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6815","nonce":770292651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":770292651},{"type":"v1","addr":"172.21.15.161:6813","nonce":770292651}]},"public_addr":"172.21.15.161:6809/770292651","cluster_addr":"172.21.15.161:6811/770292651","heartbeat_back_addr":"172.21.15.161:6815/770292651","heartbeat_front_addr":"172.21.15.161:6813/770292651","state":["exists","up"]},{"osd":1,"uuid":"96aa5752-0c0b-40a8-ac6d-8780067f5d2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6817","nonce":772781101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6819","nonce":772781101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6823","nonce":772781101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":772781101},{"type":"v1","addr":"172.21.15.161:6821","nonce":772781101}]},"public_addr":"172.21.15.161:6817/772781101","cluster_addr":"172.21.15.161:6819/772781101","heartbeat_back_addr":"172.21.15.161:6823/772781101","heartbeat_front_addr":"172.21.15.161:6821/772781101","state":["exists","up"]},{"osd":2,"uuid":"48d4bf2e-61c6-4adc-b48b-988ba4768f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6801","nonce":4255713326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6803","nonce":4255713326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6807","nonce":4255713326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":4255713326},{"type":"v1","addr":"172.21.15.161:6805","nonce":4255713326}]},"public_addr":"172.21.15.161:6801/4255713326","cluster_addr":"172.21.15.161:6803/4255713326","heartbeat_back_addr":"172.21.15.161:6807/4255713326","heartbeat_front_addr":"172.21.15.161:6805/4255713326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:05:34.876975+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:05:34.692650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:05:34.917712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:32:32.903 INFO:tasks.ceph:Scrubbing cluster2.osd.0 2024-09-21T15:32:32.904 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T15:32:33.065 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-21T15:32:33.065 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T15:32:33.065 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-21T15:32:33.078 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd deep-scrub 0 2024-09-21T15:32:33.395 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T15:32:33.406 INFO:tasks.ceph:Scrubbing cluster2.osd.1 2024-09-21T15:32:33.407 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T15:32:33.555 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-21T15:32:33.555 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T15:32:33.555 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-21T15:32:33.572 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd deep-scrub 1 2024-09-21T15:32:33.873 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T15:32:33.884 INFO:tasks.ceph:Scrubbing cluster2.osd.2 2024-09-21T15:32:33.884 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T15:32:34.032 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-21T15:32:34.032 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T15:32:34.032 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-21T15:32:34.045 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd deep-scrub 2 2024-09-21T15:32:34.356 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T15:32:34.371 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-21T15:32:34.673 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:32:34.678 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-09-21T15:32:34.689 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":1371,"stamp":"2024-09-21T15:32:33.183789+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":232,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1021368,"kb_used_data":99240,"kb_used_omap":4,"kb_used_meta":921851,"kb_avail":282094152,"statfs":{"total":289910292480,"available":288864411648,"internally_reserved":0,"allocated":101621760,"data_stored":881089352,"data_compressed":56438089,"data_compressed_allocated":62365696,"data_compressed_original":853171494,"omap_allocated":4782,"internal_metadata":943975762},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7137625278,"num_objects":-10294,"num_object_clones":-3059,"num_object_copies":-20588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10294,"num_whiteouts":-1026,"num_read":-1149304,"num_read_kb":-5315697,"num_write":-92093,"num_write_kb":-1893954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-5,"num_bytes_recovered":-30801,"num_keys_recovered":-2,"num_objects_omap":-539,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002313"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:48.975432+0000","last_change":"2024-09-21T15:05:48.084470+0000","last_active":"2024-09-21T15:31:48.975432+0000","last_peered":"2024-09-21T15:31:48.975432+0000","last_clean":"2024-09-21T15:31:48.975432+0000","last_became_active":"2024-09-21T15:05:46.074075+0000","last_became_peered":"2024-09-21T15:05:46.074075+0000","last_unstale":"2024-09-21T15:31:48.975432+0000","last_undegraded":"2024-09-21T15:31:48.975432+0000","last_fullsized":"2024-09-21T15:31:48.975432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:27:06.084591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081259799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:48.975405+0000","last_change":"2024-09-21T15:05:48.084948+0000","last_active":"2024-09-21T15:31:48.975405+0000","last_peered":"2024-09-21T15:31:48.975405+0000","last_clean":"2024-09-21T15:31:48.975405+0000","last_became_active":"2024-09-21T15:05:46.070093+0000","last_became_peered":"2024-09-21T15:05:46.070093+0000","last_unstale":"2024-09-21T15:31:48.975405+0000","last_undegraded":"2024-09-21T15:31:48.975405+0000","last_fullsized":"2024-09-21T15:31:48.975405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:44.968622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001263908,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:53.963084+0000","last_change":"2024-09-21T15:05:48.084157+0000","last_active":"2024-09-21T15:30:53.963084+0000","last_peered":"2024-09-21T15:30:53.963084+0000","last_clean":"2024-09-21T15:30:53.963084+0000","last_became_active":"2024-09-21T15:05:46.074031+0000","last_became_peered":"2024-09-21T15:05:46.074031+0000","last_unstale":"2024-09-21T15:30:53.963084+0000","last_undegraded":"2024-09-21T15:30:53.963084+0000","last_fullsized":"2024-09-21T15:30:53.963084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:56.980131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058148599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:48.961731+0000","last_change":"2024-09-21T15:05:48.085081+0000","last_active":"2024-09-21T15:30:48.961731+0000","last_peered":"2024-09-21T15:30:48.961731+0000","last_clean":"2024-09-21T15:30:48.961731+0000","last_became_active":"2024-09-21T15:05:46.073780+0000","last_became_peered":"2024-09-21T15:05:46.073780+0000","last_unstale":"2024-09-21T15:30:48.961731+0000","last_undegraded":"2024-09-21T15:30:48.961731+0000","last_fullsized":"2024-09-21T15:30:48.961731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:08.087343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001316731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":580,"reported_epoch":565,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.503738+0000","last_change":"2024-09-21T15:05:48.081253+0000","last_active":"2024-09-21T15:32:28.503738+0000","last_peered":"2024-09-21T15:32:28.503738+0000","last_clean":"2024-09-21T15:32:28.503738+0000","last_became_active":"2024-09-21T15:05:46.068146+0000","last_became_peered":"2024-09-21T15:05:46.068146+0000","last_unstale":"2024-09-21T15:32:28.503738+0000","last_undegraded":"2024-09-21T15:32:28.503738+0000","last_fullsized":"2024-09-21T15:32:28.503738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:18.171320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001686313,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":578,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:48.917011+0000","last_change":"2024-09-21T15:05:48.075744+0000","last_active":"2024-09-21T15:30:48.917011+0000","last_peered":"2024-09-21T15:30:48.917011+0000","last_clean":"2024-09-21T15:30:48.917011+0000","last_became_active":"2024-09-21T15:05:46.071491+0000","last_became_peered":"2024-09-21T15:05:46.071491+0000","last_unstale":"2024-09-21T15:30:48.917011+0000","last_undegraded":"2024-09-21T15:30:48.917011+0000","last_fullsized":"2024-09-21T15:30:48.917011+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:05:19.661233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066534299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":579,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:53.931444+0000","last_change":"2024-09-21T15:05:48.075940+0000","last_active":"2024-09-21T15:31:53.931444+0000","last_peered":"2024-09-21T15:31:53.931444+0000","last_clean":"2024-09-21T15:31:53.931444+0000","last_became_active":"2024-09-21T15:05:46.070050+0000","last_became_peered":"2024-09-21T15:05:46.070050+0000","last_unstale":"2024-09-21T15:31:53.931444+0000","last_undegraded":"2024-09-21T15:31:53.931444+0000","last_fullsized":"2024-09-21T15:31:53.931444+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:29.810140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079646399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":579,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:30:48.961705+0000","last_change":"2024-09-21T15:05:48.084287+0000","last_active":"2024-09-21T15:30:48.961705+0000","last_peered":"2024-09-21T15:30:48.961705+0000","last_clean":"2024-09-21T15:30:48.961705+0000","last_became_active":"2024-09-21T15:05:46.069593+0000","last_became_peered":"2024-09-21T15:05:46.069593+0000","last_unstale":"2024-09-21T15:30:48.961705+0000","last_undegraded":"2024-09-21T15:30:48.961705+0000","last_fullsized":"2024-09-21T15:30:48.961705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:33:51.293048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067986000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'97","reported_seq":704,"reported_epoch":564,"state":"active+clean","last_fresh":"2024-09-21T15:31:48.974904+0000","last_change":"2024-09-21T15:05:40.236152+0000","last_active":"2024-09-21T15:31:48.974904+0000","last_peered":"2024-09-21T15:31:48.974904+0000","last_clean":"2024-09-21T15:31:48.974904+0000","last_became_active":"2024-09-21T15:05:40.233945+0000","last_became_peered":"2024-09-21T15:05:40.233945+0000","last_unstale":"2024-09-21T15:31:48.974904+0000","last_undegraded":"2024-09-21T15:31:48.974904+0000","last_fullsized":"2024-09-21T15:31:48.974904+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:39.013738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:39.013738+0000","last_clean_scrub_stamp":"2024-09-21T15:05:39.013738+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:02.256703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60350,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738694,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306428,"kb_used_data":4592,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":94065412,"statfs":{"total":96636764160,"available":96322981888,"internally_reserved":0,"allocated":4702208,"data_stored":2524915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309066182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.55500000000000005,"15min":0.67800000000000005},"min":{"1min":0.28199999999999997,"5min":0.185,"15min":0.185},"max":{"1min":0.69499999999999995,"5min":5.766,"15min":38.828000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.69899999999999995,"15min":0.81799999999999995},"min":{"1min":0.35099999999999998,"5min":0.22600000000000001,"15min":0.20300000000000001},"max":{"1min":0.66800000000000004,"5min":10.754,"15min":38.473999999999997},"last":0.378}]},{"osd":1,"last update":"Sat Sep 21 15:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":1.1779999999999999,"15min":0.85999999999999999},"min":{"1min":0.246,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":0.70999999999999996,"5min":51.167999999999999,"15min":51.167999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.84099999999999997},"min":{"1min":0.31900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.76600000000000001,"5min":2.1059999999999999,"15min":49.823999999999998},"last":0.71399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738693,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314684,"kb_used_data":4656,"kb_used_omap":1,"kb_used_meta":310014,"kb_avail":94057156,"statfs":{"total":96636764160,"available":96314527744,"internally_reserved":0,"allocated":4767744,"data_stored":3115302,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":317454790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":1.347,"15min":0.86199999999999999},"min":{"1min":0.28000000000000003,"5min":0.24099999999999999,"15min":0.17699999999999999},"max":{"1min":1.837,"5min":66.188000000000002,"15min":66.188000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":1.2849999999999999,"15min":1.552},"min":{"1min":0.32600000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.85499999999999998,"5min":66.441999999999993,"15min":66.441999999999993},"last":0.39500000000000002}]},{"osd":2,"last update":"Sat Sep 21 15:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.496,"15min":0.623},"min":{"1min":0.308,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.893,"5min":1.893,"15min":22.704999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.58499999999999996,"15min":0.75},"min":{"1min":0.39000000000000001,"5min":0.30299999999999999,"15min":0.21199999999999999},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":14.817},"last":0.92800000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738697,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":400256,"kb_used_data":89992,"kb_used_omap":1,"kb_used_meta":310014,"kb_avail":93971584,"statfs":{"total":96636764160,"available":96226902016,"internally_reserved":0,"allocated":92151808,"data_stored":875449135,"data_compressed":56407914,"data_compressed_allocated":62324736,"data_compressed_original":852598054,"omap_allocated":1594,"internal_metadata":317454790},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 15:31:32 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.67800000000000005,"15min":0.879},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20100000000000001},"max":{"1min":1.2010000000000001,"5min":15.881,"15min":53.292000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.437,"5min":1.4259999999999999,"15min":0.86199999999999999},"min":{"1min":0.29299999999999998,"5min":0.23699999999999999,"15min":0.17599999999999999},"max":{"1min":0.746,"5min":50.317999999999998,"15min":50.317999999999998},"last":0.44600000000000001}]},{"osd":2,"last update":"Sat Sep 21 15:31:32 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.85199999999999998,"15min":0.68300000000000005},"min":{"1min":0.221,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.65200000000000002,"5min":21.312999999999999,"15min":21.312999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":1.153,"5min":1.101,"15min":0.80000000000000004},"min":{"1min":0.26800000000000002,"5min":0.245,"15min":0.20599999999999999},"max":{"1min":14.188000000000001,"5min":20.733000000000001,"15min":20.733000000000001},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:32:34.693 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T15:05:45.038935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:32:34.693 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T15:05:45.038935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:32:34.693 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T15:05:45.038935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:32:34.693 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T15:05:45.038935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:32:34.693 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T15:05:45.038935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:32:34.693 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-21T15:05:45.038935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:32:34.693 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T15:05:45.038935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:32:34.693 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T15:05:45.038935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:32:34.694 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T15:05:39.013738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:32:34.694 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T15:32:54.695 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-21T15:32:55.011 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:32:55.014 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-09-21T15:32:55.025 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":1381,"stamp":"2024-09-21T15:32:53.188975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":953856,"kb_used_data":13928,"kb_used_omap":4,"kb_used_meta":939899,"kb_avail":282161664,"statfs":{"total":289910292480,"available":288933543936,"internally_reserved":0,"allocated":14262272,"data_stored":8766352,"data_compressed":60350,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":962456914},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003152"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":580,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:29.623065+0000","last_change":"2024-09-21T15:05:48.084470+0000","last_active":"2024-09-21T15:32:29.623065+0000","last_peered":"2024-09-21T15:32:29.623065+0000","last_clean":"2024-09-21T15:32:29.623065+0000","last_became_active":"2024-09-21T15:05:46.074075+0000","last_became_peered":"2024-09-21T15:05:46.074075+0000","last_unstale":"2024-09-21T15:32:29.623065+0000","last_undegraded":"2024-09-21T15:32:29.623065+0000","last_fullsized":"2024-09-21T15:32:29.623065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081259799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":580,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:29.620740+0000","last_change":"2024-09-21T15:05:48.084948+0000","last_active":"2024-09-21T15:32:29.620740+0000","last_peered":"2024-09-21T15:32:29.620740+0000","last_clean":"2024-09-21T15:32:29.620740+0000","last_became_active":"2024-09-21T15:05:46.070093+0000","last_became_peered":"2024-09-21T15:05:46.070093+0000","last_unstale":"2024-09-21T15:32:29.620740+0000","last_undegraded":"2024-09-21T15:32:29.620740+0000","last_fullsized":"2024-09-21T15:32:29.620740+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001263908,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":580,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:29.619770+0000","last_change":"2024-09-21T15:05:48.084157+0000","last_active":"2024-09-21T15:32:29.619770+0000","last_peered":"2024-09-21T15:32:29.619770+0000","last_clean":"2024-09-21T15:32:29.619770+0000","last_became_active":"2024-09-21T15:05:46.074031+0000","last_became_peered":"2024-09-21T15:05:46.074031+0000","last_unstale":"2024-09-21T15:32:29.619770+0000","last_undegraded":"2024-09-21T15:32:29.619770+0000","last_fullsized":"2024-09-21T15:32:29.619770+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058148599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":580,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:29.623561+0000","last_change":"2024-09-21T15:05:48.085081+0000","last_active":"2024-09-21T15:32:29.623561+0000","last_peered":"2024-09-21T15:32:29.623561+0000","last_clean":"2024-09-21T15:32:29.623561+0000","last_became_active":"2024-09-21T15:05:46.073780+0000","last_became_peered":"2024-09-21T15:05:46.073780+0000","last_unstale":"2024-09-21T15:32:29.623561+0000","last_undegraded":"2024-09-21T15:32:29.623561+0000","last_fullsized":"2024-09-21T15:32:29.623561+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:45.038935+0000","last_clean_scrub_stamp":"2024-09-21T15:05:45.038935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001316731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"566'3","reported_seq":593,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:41.796469+0000","last_change":"2024-09-21T15:32:41.796714+0000","last_active":"2024-09-21T15:32:41.796469+0000","last_peered":"2024-09-21T15:32:41.796469+0000","last_clean":"2024-09-21T15:32:41.796469+0000","last_became_active":"2024-09-21T15:05:46.068146+0000","last_became_peered":"2024-09-21T15:05:46.068146+0000","last_unstale":"2024-09-21T15:32:41.796469+0000","last_undegraded":"2024-09-21T15:32:41.796469+0000","last_fullsized":"2024-09-21T15:32:41.796469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"566'3","last_scrub_stamp":"2024-09-21T15:32:41.796423+0000","last_deep_scrub":"566'3","last_deep_scrub_stamp":"2024-09-21T15:32:41.796423+0000","last_clean_scrub_stamp":"2024-09-21T15:32:41.796423+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:28.763216+0000","scrub_duration":0.006347414,"objects_trimmed":0,"snaptrim_duration":0.001686313,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":591,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:39.540321+0000","last_change":"2024-09-21T15:32:39.540557+0000","last_active":"2024-09-21T15:32:39.540321+0000","last_peered":"2024-09-21T15:32:39.540321+0000","last_clean":"2024-09-21T15:32:39.540321+0000","last_became_active":"2024-09-21T15:05:46.071491+0000","last_became_peered":"2024-09-21T15:05:46.071491+0000","last_unstale":"2024-09-21T15:32:39.540321+0000","last_undegraded":"2024-09-21T15:32:39.540321+0000","last_fullsized":"2024-09-21T15:32:39.540321+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:32:39.540271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:32:39.540271+0000","last_clean_scrub_stamp":"2024-09-21T15:32:39.540271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:15:35.002201+0000","scrub_duration":0.003313936,"objects_trimmed":0,"snaptrim_duration":0.00066534299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":592,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:35.607055+0000","last_change":"2024-09-21T15:32:35.607305+0000","last_active":"2024-09-21T15:32:35.607055+0000","last_peered":"2024-09-21T15:32:35.607055+0000","last_clean":"2024-09-21T15:32:35.607055+0000","last_became_active":"2024-09-21T15:05:46.070050+0000","last_became_peered":"2024-09-21T15:05:46.070050+0000","last_unstale":"2024-09-21T15:32:35.607055+0000","last_undegraded":"2024-09-21T15:32:35.607055+0000","last_fullsized":"2024-09-21T15:32:35.607055+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:32:35.607010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:32:35.607010+0000","last_clean_scrub_stamp":"2024-09-21T15:32:35.607010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:04:24.712591+0000","scrub_duration":0.0034706519999999999,"objects_trimmed":0,"snaptrim_duration":0.00079646399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"566'2","reported_seq":593,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:48.639129+0000","last_change":"2024-09-21T15:32:48.639363+0000","last_active":"2024-09-21T15:32:48.639129+0000","last_peered":"2024-09-21T15:32:48.639129+0000","last_clean":"2024-09-21T15:32:48.639129+0000","last_became_active":"2024-09-21T15:05:46.069593+0000","last_became_peered":"2024-09-21T15:05:46.069593+0000","last_unstale":"2024-09-21T15:32:48.639129+0000","last_undegraded":"2024-09-21T15:32:48.639129+0000","last_fullsized":"2024-09-21T15:32:48.639129+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"566'2","last_scrub_stamp":"2024-09-21T15:32:48.639076+0000","last_deep_scrub":"566'2","last_deep_scrub_stamp":"2024-09-21T15:32:48.639076+0000","last_clean_scrub_stamp":"2024-09-21T15:32:48.639076+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:48:11.481119+0000","scrub_duration":0.0056801070000000002,"objects_trimmed":0,"snaptrim_duration":0.00067986000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"566'99","reported_seq":719,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:41.661122+0000","last_change":"2024-09-21T15:32:41.661395+0000","last_active":"2024-09-21T15:32:41.661122+0000","last_peered":"2024-09-21T15:32:41.661122+0000","last_clean":"2024-09-21T15:32:41.661122+0000","last_became_active":"2024-09-21T15:05:40.233945+0000","last_became_peered":"2024-09-21T15:05:40.233945+0000","last_unstale":"2024-09-21T15:32:41.661122+0000","last_undegraded":"2024-09-21T15:32:41.661122+0000","last_fullsized":"2024-09-21T15:32:41.661122+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"566'99","last_scrub_stamp":"2024-09-21T15:32:41.661067+0000","last_deep_scrub":"566'99","last_deep_scrub_stamp":"2024-09-21T15:32:41.661067+0000","last_clean_scrub_stamp":"2024-09-21T15:32:41.661067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:57:07.508807+0000","scrub_duration":0.0097300340000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60350,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738698,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306432,"kb_used_data":4600,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":94065408,"statfs":{"total":96636764160,"available":96322977792,"internally_reserved":0,"allocated":4710400,"data_stored":2528526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309066182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.55500000000000005,"15min":0.67800000000000005},"min":{"1min":0.28199999999999997,"5min":0.185,"15min":0.185},"max":{"1min":0.69499999999999995,"5min":5.766,"15min":38.828000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.69899999999999995,"15min":0.81799999999999995},"min":{"1min":0.35099999999999998,"5min":0.22600000000000001,"15min":0.20300000000000001},"max":{"1min":0.66800000000000004,"5min":10.754,"15min":38.473999999999997},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Sep 21 15:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":1.1779999999999999,"15min":0.85999999999999999},"min":{"1min":0.246,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":0.70999999999999996,"5min":51.167999999999999,"15min":51.167999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.84099999999999997},"min":{"1min":0.31900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.76600000000000001,"5min":2.1059999999999999,"15min":49.823999999999998},"last":0.55400000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738697,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314688,"kb_used_data":4664,"kb_used_omap":1,"kb_used_meta":310014,"kb_avail":94057152,"statfs":{"total":96636764160,"available":96314523648,"internally_reserved":0,"allocated":4775936,"data_stored":3118913,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":317454790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":1.347,"15min":0.86199999999999999},"min":{"1min":0.28000000000000003,"5min":0.24099999999999999,"15min":0.17699999999999999},"max":{"1min":1.837,"5min":66.188000000000002,"15min":66.188000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.46999999999999997,"5min":1.2849999999999999,"15min":1.552},"min":{"1min":0.32600000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.85499999999999998,"5min":66.441999999999993,"15min":66.441999999999993},"last":0.61099999999999999}]},{"osd":2,"last update":"Sat Sep 21 15:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.496,"15min":0.623},"min":{"1min":0.308,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.893,"5min":1.893,"15min":22.704999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.58499999999999996,"15min":0.75},"min":{"1min":0.39000000000000001,"5min":0.30299999999999999,"15min":0.21199999999999999},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":14.817},"last":0.64600000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738701,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":332736,"kb_used_data":4664,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":94039104,"statfs":{"total":96636764160,"available":96296042496,"internally_reserved":0,"allocated":4775936,"data_stored":3118913,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":335935942},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 15:32:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.67800000000000005,"15min":0.88100000000000001},"min":{"1min":0.371,"5min":0.20200000000000001,"15min":0.20100000000000001},"max":{"1min":1.657,"5min":15.881,"15min":53.292000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":1.355,"15min":0.85799999999999998},"min":{"1min":0.29299999999999998,"5min":0.28699999999999998,"15min":0.17599999999999999},"max":{"1min":0.57999999999999996,"5min":50.317999999999998,"15min":50.317999999999998},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Sep 21 15:32:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.85299999999999998,"15min":0.67300000000000004},"min":{"1min":0.255,"5min":0.221,"15min":0.19700000000000001},"max":{"1min":0.65400000000000003,"5min":21.312999999999999,"15min":21.312999999999999},"last":0.497},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.97399999999999998,"15min":0.79500000000000004},"min":{"1min":0.32800000000000001,"5min":0.253,"15min":0.20599999999999999},"max":{"1min":0.68000000000000005,"5min":20.733000000000001,"15min":20.733000000000001},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:32:55.026 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T15:05:45.038935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:32:55.027 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T15:05:45.038935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:32:55.027 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T15:05:45.038935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:32:55.027 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T15:05:45.038935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=45, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:32:55.027 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T15:33:15.028 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2024-09-21T15:33:15.331 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-21T15:33:15.334 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-09-21T15:33:15.346 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":1392,"stamp":"2024-09-21T15:33:15.194854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":953856,"kb_used_data":13928,"kb_used_omap":4,"kb_used_meta":939899,"kb_avail":282161664,"statfs":{"total":289910292480,"available":288933543936,"internally_reserved":0,"allocated":14262272,"data_stored":8766352,"data_compressed":60350,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":962456914},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003212"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":591,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:52.554877+0000","last_change":"2024-09-21T15:32:52.555119+0000","last_active":"2024-09-21T15:32:52.554877+0000","last_peered":"2024-09-21T15:32:52.554877+0000","last_clean":"2024-09-21T15:32:52.554877+0000","last_became_active":"2024-09-21T15:05:46.074075+0000","last_became_peered":"2024-09-21T15:05:46.074075+0000","last_unstale":"2024-09-21T15:32:52.554877+0000","last_undegraded":"2024-09-21T15:32:52.554877+0000","last_fullsized":"2024-09-21T15:32:52.554877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:32:52.554831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:32:52.554831+0000","last_clean_scrub_stamp":"2024-09-21T15:32:52.554831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:23:06.710895+0000","scrub_duration":0.0032457039999999999,"objects_trimmed":0,"snaptrim_duration":0.00081259799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":591,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:55.596648+0000","last_change":"2024-09-21T15:32:55.596999+0000","last_active":"2024-09-21T15:32:55.596648+0000","last_peered":"2024-09-21T15:32:55.596648+0000","last_clean":"2024-09-21T15:32:55.596648+0000","last_became_active":"2024-09-21T15:05:46.070093+0000","last_became_peered":"2024-09-21T15:05:46.070093+0000","last_unstale":"2024-09-21T15:32:55.596648+0000","last_undegraded":"2024-09-21T15:32:55.596648+0000","last_fullsized":"2024-09-21T15:32:55.596648+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:32:55.596596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:32:55.596596+0000","last_clean_scrub_stamp":"2024-09-21T15:32:55.596596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:37.664378+0000","scrub_duration":0.0031694679999999999,"objects_trimmed":0,"snaptrim_duration":0.001263908,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":592,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:57.599413+0000","last_change":"2024-09-21T15:32:57.599413+0000","last_active":"2024-09-21T15:32:57.599413+0000","last_peered":"2024-09-21T15:32:57.599413+0000","last_clean":"2024-09-21T15:32:57.599413+0000","last_became_active":"2024-09-21T15:05:46.074031+0000","last_became_peered":"2024-09-21T15:05:46.074031+0000","last_unstale":"2024-09-21T15:32:57.599413+0000","last_undegraded":"2024-09-21T15:32:57.599413+0000","last_fullsized":"2024-09-21T15:32:57.599413+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:32:57.599130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:32:57.599130+0000","last_clean_scrub_stamp":"2024-09-21T15:32:57.599130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:01:12.881170+0000","scrub_duration":0.0030249510000000001,"objects_trimmed":0,"snaptrim_duration":0.00058148599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":592,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:50.597569+0000","last_change":"2024-09-21T15:32:50.597569+0000","last_active":"2024-09-21T15:32:50.597569+0000","last_peered":"2024-09-21T15:32:50.597569+0000","last_clean":"2024-09-21T15:32:50.597569+0000","last_became_active":"2024-09-21T15:05:46.073780+0000","last_became_peered":"2024-09-21T15:05:46.073780+0000","last_unstale":"2024-09-21T15:32:50.597569+0000","last_undegraded":"2024-09-21T15:32:50.597569+0000","last_fullsized":"2024-09-21T15:32:50.597569+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:32:50.597279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:32:50.597279+0000","last_clean_scrub_stamp":"2024-09-21T15:32:50.597279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:40.963230+0000","scrub_duration":0.00324983,"objects_trimmed":0,"snaptrim_duration":0.001316731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"566'3","reported_seq":594,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:41.796714+0000","last_change":"2024-09-21T15:32:41.796714+0000","last_active":"2024-09-21T15:32:41.796714+0000","last_peered":"2024-09-21T15:32:41.796714+0000","last_clean":"2024-09-21T15:32:41.796714+0000","last_became_active":"2024-09-21T15:05:46.068146+0000","last_became_peered":"2024-09-21T15:05:46.068146+0000","last_unstale":"2024-09-21T15:32:41.796714+0000","last_undegraded":"2024-09-21T15:32:41.796714+0000","last_fullsized":"2024-09-21T15:32:41.796714+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"566'3","last_scrub_stamp":"2024-09-21T15:32:41.796423+0000","last_deep_scrub":"566'3","last_deep_scrub_stamp":"2024-09-21T15:32:41.796423+0000","last_clean_scrub_stamp":"2024-09-21T15:32:41.796423+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:28.763216+0000","scrub_duration":0.006347414,"objects_trimmed":0,"snaptrim_duration":0.001686313,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":592,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:39.540557+0000","last_change":"2024-09-21T15:32:39.540557+0000","last_active":"2024-09-21T15:32:39.540557+0000","last_peered":"2024-09-21T15:32:39.540557+0000","last_clean":"2024-09-21T15:32:39.540557+0000","last_became_active":"2024-09-21T15:05:46.071491+0000","last_became_peered":"2024-09-21T15:05:46.071491+0000","last_unstale":"2024-09-21T15:32:39.540557+0000","last_undegraded":"2024-09-21T15:32:39.540557+0000","last_fullsized":"2024-09-21T15:32:39.540557+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:32:39.540271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:32:39.540271+0000","last_clean_scrub_stamp":"2024-09-21T15:32:39.540271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:15:35.002201+0000","scrub_duration":0.003313936,"objects_trimmed":0,"snaptrim_duration":0.00066534299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":592,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:35.607055+0000","last_change":"2024-09-21T15:32:35.607305+0000","last_active":"2024-09-21T15:32:35.607055+0000","last_peered":"2024-09-21T15:32:35.607055+0000","last_clean":"2024-09-21T15:32:35.607055+0000","last_became_active":"2024-09-21T15:05:46.070050+0000","last_became_peered":"2024-09-21T15:05:46.070050+0000","last_unstale":"2024-09-21T15:32:35.607055+0000","last_undegraded":"2024-09-21T15:32:35.607055+0000","last_fullsized":"2024-09-21T15:32:35.607055+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:32:35.607010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:32:35.607010+0000","last_clean_scrub_stamp":"2024-09-21T15:32:35.607010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:04:24.712591+0000","scrub_duration":0.0034706519999999999,"objects_trimmed":0,"snaptrim_duration":0.00079646399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"566'2","reported_seq":594,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:48.639363+0000","last_change":"2024-09-21T15:32:48.639363+0000","last_active":"2024-09-21T15:32:48.639363+0000","last_peered":"2024-09-21T15:32:48.639363+0000","last_clean":"2024-09-21T15:32:48.639363+0000","last_became_active":"2024-09-21T15:05:46.069593+0000","last_became_peered":"2024-09-21T15:05:46.069593+0000","last_unstale":"2024-09-21T15:32:48.639363+0000","last_undegraded":"2024-09-21T15:32:48.639363+0000","last_fullsized":"2024-09-21T15:32:48.639363+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"566'2","last_scrub_stamp":"2024-09-21T15:32:48.639076+0000","last_deep_scrub":"566'2","last_deep_scrub_stamp":"2024-09-21T15:32:48.639076+0000","last_clean_scrub_stamp":"2024-09-21T15:32:48.639076+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:48:11.481119+0000","scrub_duration":0.0056801070000000002,"objects_trimmed":0,"snaptrim_duration":0.00067986000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"566'99","reported_seq":719,"reported_epoch":566,"state":"active+clean","last_fresh":"2024-09-21T15:32:41.661122+0000","last_change":"2024-09-21T15:32:41.661395+0000","last_active":"2024-09-21T15:32:41.661122+0000","last_peered":"2024-09-21T15:32:41.661122+0000","last_clean":"2024-09-21T15:32:41.661122+0000","last_became_active":"2024-09-21T15:05:40.233945+0000","last_became_peered":"2024-09-21T15:05:40.233945+0000","last_unstale":"2024-09-21T15:32:41.661122+0000","last_undegraded":"2024-09-21T15:32:41.661122+0000","last_fullsized":"2024-09-21T15:32:41.661122+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"566'99","last_scrub_stamp":"2024-09-21T15:32:41.661067+0000","last_deep_scrub":"566'99","last_deep_scrub_stamp":"2024-09-21T15:32:41.661067+0000","last_clean_scrub_stamp":"2024-09-21T15:32:41.661067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:57:07.508807+0000","scrub_duration":0.0097300340000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60350,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738703,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306432,"kb_used_data":4600,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":94065408,"statfs":{"total":96636764160,"available":96322977792,"internally_reserved":0,"allocated":4710400,"data_stored":2528526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":309066182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.55500000000000005,"15min":0.67800000000000005},"min":{"1min":0.28199999999999997,"5min":0.185,"15min":0.185},"max":{"1min":0.69499999999999995,"5min":5.766,"15min":38.828000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.69899999999999995,"15min":0.81799999999999995},"min":{"1min":0.35099999999999998,"5min":0.22600000000000001,"15min":0.20300000000000001},"max":{"1min":0.66800000000000004,"5min":10.754,"15min":38.473999999999997},"last":0.60499999999999998}]},{"osd":1,"last update":"Sat Sep 21 15:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":1.1779999999999999,"15min":0.85999999999999999},"min":{"1min":0.246,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":0.70999999999999996,"5min":51.167999999999999,"15min":51.167999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.84099999999999997},"min":{"1min":0.31900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.76600000000000001,"5min":2.1059999999999999,"15min":49.823999999999998},"last":0.63500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738702,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314688,"kb_used_data":4664,"kb_used_omap":1,"kb_used_meta":310014,"kb_avail":94057152,"statfs":{"total":96636764160,"available":96314523648,"internally_reserved":0,"allocated":4775936,"data_stored":3118913,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":317454790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":1.347,"15min":0.86199999999999999},"min":{"1min":0.28000000000000003,"5min":0.24099999999999999,"15min":0.17699999999999999},"max":{"1min":1.837,"5min":66.188000000000002,"15min":66.188000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":1.2849999999999999,"15min":1.552},"min":{"1min":0.32600000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.85499999999999998,"5min":66.441999999999993,"15min":66.441999999999993},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Sep 21 15:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.496,"15min":0.623},"min":{"1min":0.308,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.893,"5min":1.893,"15min":22.704999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.58499999999999996,"15min":0.75},"min":{"1min":0.39000000000000001,"5min":0.30299999999999999,"15min":0.21199999999999999},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":14.817},"last":0.56399999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738706,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":332736,"kb_used_data":4664,"kb_used_omap":1,"kb_used_meta":328062,"kb_avail":94039104,"statfs":{"total":96636764160,"available":96296042496,"internally_reserved":0,"allocated":4775936,"data_stored":3118913,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":335935942},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 15:32:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.67800000000000005,"15min":0.88100000000000001},"min":{"1min":0.371,"5min":0.20200000000000001,"15min":0.20100000000000001},"max":{"1min":1.657,"5min":15.881,"15min":53.292000000000002},"last":0.496},{"interface":"front","average":{"1min":0.45600000000000002,"5min":1.355,"15min":0.85799999999999998},"min":{"1min":0.29299999999999998,"5min":0.28699999999999998,"15min":0.17599999999999999},"max":{"1min":0.57999999999999996,"5min":50.317999999999998,"15min":50.317999999999998},"last":0.54200000000000004}]},{"osd":2,"last update":"Sat Sep 21 15:32:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.85299999999999998,"15min":0.67300000000000004},"min":{"1min":0.255,"5min":0.221,"15min":0.19700000000000001},"max":{"1min":0.65400000000000003,"5min":21.312999999999999,"15min":21.312999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.97399999999999998,"15min":0.79500000000000004},"min":{"1min":0.32800000000000001,"5min":0.253,"15min":0.20599999999999999},"max":{"1min":0.68000000000000005,"5min":20.733000000000001,"15min":20.733000000000001},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30175,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:33:15.347 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster cluster2 config set global mon_health_to_clog false 2024-09-21T15:33:15.675 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T15:33:15.676 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T15:33:15.676 DEBUG:tasks.ceph.cluster2.osd.0:waiting for process to exit 2024-09-21T15:33:15.676 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:33:15.776 INFO:tasks.ceph.cluster2.osd.0:Stopped 2024-09-21T15:33:15.776 DEBUG:tasks.ceph.cluster2.osd.1:waiting for process to exit 2024-09-21T15:33:15.776 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:33:20.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~0s 2024-09-21T15:33:21.878 INFO:tasks.ceph.cluster2.osd.1:Stopped 2024-09-21T15:33:21.878 DEBUG:tasks.ceph.cluster2.osd.2:waiting for process to exit 2024-09-21T15:33:21.879 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:33:21.974 INFO:tasks.ceph.cluster2.osd.2:Stopped 2024-09-21T15:33:21.975 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T15:33:21.975 DEBUG:tasks.ceph.cluster2.mgr.x:waiting for process to exit 2024-09-21T15:33:21.975 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:33:22.026 INFO:tasks.ceph.cluster2.mgr.x:Stopped 2024-09-21T15:33:22.026 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T15:33:22.027 DEBUG:tasks.ceph.cluster2.mon.a:waiting for process to exit 2024-09-21T15:33:22.027 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:33:22.069 INFO:tasks.ceph.cluster2.mon.a:Stopped 2024-09-21T15:33:22.069 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T15:33:22.070 DEBUG:teuthology.orchestra.run.smithi161:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/cluster2.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-21T15:33:22.132 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/cluster2-0 on ubuntu@smithi161.front.sepia.ceph.com 2024-09-21T15:33:22.132 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/cluster2-0 2024-09-21T15:33:22.461 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/cluster2-1 on ubuntu@smithi161.front.sepia.ceph.com 2024-09-21T15:33:22.461 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/cluster2-1 2024-09-21T15:33:22.745 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/cluster2-2 on ubuntu@smithi161.front.sepia.ceph.com 2024-09-21T15:33:22.746 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/cluster2-2 2024-09-21T15:33:22.971 INFO:tasks.ceph:Archiving mon data... 2024-09-21T15:33:22.972 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/mon/cluster2-a to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909963/data/cluster2.mon.a.tgz 2024-09-21T15:33:22.972 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-09-21T15:33:22.982 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.uj1VxS4tQU 2024-09-21T15:33:22.982 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/mon/cluster2-a -- . > /tmp/tmp.uj1VxS4tQU 2024-09-21T15:33:23.159 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.uj1VxS4tQU 2024-09-21T15:33:23.203 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.uj1VxS4tQU is 370KB 2024-09-21T15:33:23.265 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.uj1VxS4tQU 2024-09-21T15:33:23.271 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T15:33:23.272 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /etc/ceph/cluster2.conf /etc/ceph/cluster2.keyring /home/ubuntu/cephtest/cluster2.data /home/ubuntu/cephtest/cluster2.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T15:33:23.274 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/cluster2.conf /etc/ceph/cluster2.keyring /home/ubuntu/cephtest/cluster2.data /home/ubuntu/cephtest/cluster2.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T15:33:23.441 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T15:33:23.452 INFO:tasks.ceph.ceph_manager.cluster1:waiting for clean 2024-09-21T15:33:23.452 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-21T15:33:24.013 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:33:24.016 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-09-21T15:33:24.027 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":1532,"stamp":"2024-09-21T15:33:23.287929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2284016,"kb_used_data":16712,"kb_used_omap":4,"kb_used_meta":2267259,"kb_avail":280831504,"statfs":{"total":289910292480,"available":287571460096,"internally_reserved":0,"allocated":17113088,"data_stored":10316065,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":2321673554},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003063"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":695,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.418567+0000","last_change":"2024-09-21T15:05:09.930127+0000","last_active":"2024-09-21T15:32:28.418567+0000","last_peered":"2024-09-21T15:32:28.418567+0000","last_clean":"2024-09-21T15:32:28.418567+0000","last_became_active":"2024-09-21T15:05:07.916481+0000","last_became_peered":"2024-09-21T15:05:07.916481+0000","last_unstale":"2024-09-21T15:32:28.418567+0000","last_undegraded":"2024-09-21T15:32:28.418567+0000","last_fullsized":"2024-09-21T15:32:28.418567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048236600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":695,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.421647+0000","last_change":"2024-09-21T15:05:09.931310+0000","last_active":"2024-09-21T15:32:28.421647+0000","last_peered":"2024-09-21T15:32:28.421647+0000","last_clean":"2024-09-21T15:32:28.421647+0000","last_became_active":"2024-09-21T15:05:07.916495+0000","last_became_peered":"2024-09-21T15:05:07.916495+0000","last_unstale":"2024-09-21T15:32:28.421647+0000","last_undegraded":"2024-09-21T15:32:28.421647+0000","last_fullsized":"2024-09-21T15:32:28.421647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:25:19.376301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093939900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":695,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.475939+0000","last_change":"2024-09-21T15:05:09.930815+0000","last_active":"2024-09-21T15:32:26.475939+0000","last_peered":"2024-09-21T15:32:26.475939+0000","last_clean":"2024-09-21T15:32:26.475939+0000","last_became_active":"2024-09-21T15:05:07.916830+0000","last_became_peered":"2024-09-21T15:05:07.916830+0000","last_unstale":"2024-09-21T15:32:26.475939+0000","last_undegraded":"2024-09-21T15:32:26.475939+0000","last_fullsized":"2024-09-21T15:32:26.475939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:26.265612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001265777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":695,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.471926+0000","last_change":"2024-09-21T15:05:09.930647+0000","last_active":"2024-09-21T15:32:26.471926+0000","last_peered":"2024-09-21T15:32:26.471926+0000","last_clean":"2024-09-21T15:32:26.471926+0000","last_became_active":"2024-09-21T15:05:07.918599+0000","last_became_peered":"2024-09-21T15:05:07.918599+0000","last_unstale":"2024-09-21T15:32:26.471926+0000","last_undegraded":"2024-09-21T15:32:26.471926+0000","last_fullsized":"2024-09-21T15:32:26.471926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:08:34.822279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000967993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":698,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:27.357147+0000","last_change":"2024-09-21T15:05:09.923617+0000","last_active":"2024-09-21T15:32:27.357147+0000","last_peered":"2024-09-21T15:32:27.357147+0000","last_clean":"2024-09-21T15:32:27.357147+0000","last_became_active":"2024-09-21T15:05:07.916081+0000","last_became_peered":"2024-09-21T15:05:07.916081+0000","last_unstale":"2024-09-21T15:32:27.357147+0000","last_undegraded":"2024-09-21T15:32:27.357147+0000","last_fullsized":"2024-09-21T15:32:27.357147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:33.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095993999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":696,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.412351+0000","last_change":"2024-09-21T15:05:10.686046+0000","last_active":"2024-09-21T15:32:26.412351+0000","last_peered":"2024-09-21T15:32:26.412351+0000","last_clean":"2024-09-21T15:32:26.412351+0000","last_became_active":"2024-09-21T15:05:07.913149+0000","last_became_peered":"2024-09-21T15:05:07.913149+0000","last_unstale":"2024-09-21T15:32:26.412351+0000","last_undegraded":"2024-09-21T15:32:26.412351+0000","last_fullsized":"2024-09-21T15:32:26.412351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:53:47.519519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052522500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":697,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:29.000293+0000","last_change":"2024-09-21T15:05:10.686020+0000","last_active":"2024-09-21T15:32:29.000293+0000","last_peered":"2024-09-21T15:32:29.000293+0000","last_clean":"2024-09-21T15:32:29.000293+0000","last_became_active":"2024-09-21T15:05:07.913759+0000","last_became_peered":"2024-09-21T15:05:07.913759+0000","last_unstale":"2024-09-21T15:32:29.000293+0000","last_undegraded":"2024-09-21T15:32:29.000293+0000","last_fullsized":"2024-09-21T15:32:29.000293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:36:54.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057150799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":696,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.473885+0000","last_change":"2024-09-21T15:05:09.930081+0000","last_active":"2024-09-21T15:32:26.473885+0000","last_peered":"2024-09-21T15:32:26.473885+0000","last_clean":"2024-09-21T15:32:26.473885+0000","last_became_active":"2024-09-21T15:05:07.915480+0000","last_became_peered":"2024-09-21T15:05:07.915480+0000","last_unstale":"2024-09-21T15:32:26.473885+0000","last_undegraded":"2024-09-21T15:32:26.473885+0000","last_fullsized":"2024-09-21T15:32:26.473885+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:32:33.185743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048513700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":821,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.421649+0000","last_change":"2024-09-21T15:05:02.181720+0000","last_active":"2024-09-21T15:32:28.421649+0000","last_peered":"2024-09-21T15:32:28.421649+0000","last_clean":"2024-09-21T15:32:28.421649+0000","last_became_active":"2024-09-21T15:05:02.179509+0000","last_became_peered":"2024-09-21T15:05:02.179509+0000","last_unstale":"2024-09-21T15:32:28.421649+0000","last_undegraded":"2024-09-21T15:32:28.421649+0000","last_fullsized":"2024-09-21T15:32:28.421649+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:00.877892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:00.877892+0000","last_clean_scrub_stamp":"2024-09-21T15:05:00.877892+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:38.099227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673306,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712676,"kb_used_data":5592,"kb_used_omap":1,"kb_used_meta":707070,"kb_avail":93659164,"statfs":{"total":96636764160,"available":95906983936,"internally_reserved":0,"allocated":5726208,"data_stored":3635484,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":724040134},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.66400000000000003,"15min":0.71699999999999997},"min":{"1min":0.21199999999999999,"5min":0.187,"15min":0.184},"max":{"1min":0.78900000000000003,"5min":23.196999999999999,"15min":26.103000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58599999999999997,"15min":0.83199999999999996},"min":{"1min":0.28699999999999998,"5min":0.26900000000000002,"15min":0.20799999999999999},"max":{"1min":0.72299999999999998,"5min":5.2679999999999998,"15min":29.108000000000001},"last":0.625}]},{"osd":2,"last update":"Sat Sep 21 15:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.60499999999999998,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.22900000000000001,"15min":0.20499999999999999},"max":{"1min":0.72199999999999998,"5min":5.6150000000000002,"15min":7.5},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.79000000000000004,"15min":0.76900000000000002},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.20399999999999999},"max":{"1min":0.68700000000000006,"5min":23.242999999999999,"15min":23.242999999999999},"last":0.67200000000000004}]}]},{"osd":0,"up_from":10,"seq":42949673305,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":866920,"kb_used_data":5592,"kb_used_omap":1,"kb_used_meta":861310,"kb_avail":93504920,"statfs":{"total":96636764160,"available":95749038080,"internally_reserved":0,"allocated":5726208,"data_stored":3635484,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":881981894},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 15:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.68100000000000005,"15min":0.56499999999999995},"min":{"1min":0.23899999999999999,"5min":0.19,"15min":0.16300000000000001},"max":{"1min":1.069,"5min":12.762,"15min":12.762},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.82799999999999996,"15min":0.65700000000000003},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.093,"5min":15.173999999999999,"15min":15.173999999999999},"last":0.57199999999999995}]},{"osd":2,"last update":"Sat Sep 21 15:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.628,"5min":5.7359999999999998,"15min":5.7359999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.79500000000000004,"15min":0.67400000000000004},"min":{"1min":0.26300000000000001,"5min":0.26000000000000001,"15min":0.20100000000000001},"max":{"1min":0.75700000000000001,"5min":13.784000000000001,"15min":13.784000000000001},"last":0.51300000000000001}]}]},{"osd":2,"up_from":9,"seq":38654706009,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":704420,"kb_used_data":5528,"kb_used_omap":1,"kb_used_meta":698878,"kb_avail":93667420,"statfs":{"total":96636764160,"available":95915438080,"internally_reserved":0,"allocated":5660672,"data_stored":3045097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":715651526},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.89900000000000002,"15min":0.871},"min":{"1min":0.187,"5min":0.187,"15min":0.185},"max":{"1min":0.751,"5min":26.562999999999999,"15min":56.296999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.96799999999999997,"15min":0.71699999999999997},"min":{"1min":0.24299999999999999,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":1.091,"5min":19.951000000000001,"15min":19.951000000000001},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Sep 21 15:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.3180000000000001,"15min":1.034},"min":{"1min":0.39100000000000001,"5min":0.23799999999999999,"15min":0.23499999999999999},"max":{"1min":0.70599999999999996,"5min":52.966000000000001,"15min":56.350000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.98199999999999998,"15min":0.76200000000000001},"min":{"1min":0.34899999999999998,"5min":0.27700000000000002,"15min":0.224},"max":{"1min":1.1419999999999999,"5min":18.343,"15min":18.343},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:33:24.028 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-21T15:33:24.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:33:24.334+0000 7fefe5d9b700 0 --2- 172.21.15.82:0/4255273056 >> v2:172.21.15.82:3300/0 conn(0x7fefe809f850 0x7fefe806cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-21T15:33:24.537 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:33:24.540 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-09-21T15:33:24.552 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":1532,"stamp":"2024-09-21T15:33:23.287929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2284016,"kb_used_data":16712,"kb_used_omap":4,"kb_used_meta":2267259,"kb_avail":280831504,"statfs":{"total":289910292480,"available":287571460096,"internally_reserved":0,"allocated":17113088,"data_stored":10316065,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":2321673554},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003063"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":695,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.418567+0000","last_change":"2024-09-21T15:05:09.930127+0000","last_active":"2024-09-21T15:32:28.418567+0000","last_peered":"2024-09-21T15:32:28.418567+0000","last_clean":"2024-09-21T15:32:28.418567+0000","last_became_active":"2024-09-21T15:05:07.916481+0000","last_became_peered":"2024-09-21T15:05:07.916481+0000","last_unstale":"2024-09-21T15:32:28.418567+0000","last_undegraded":"2024-09-21T15:32:28.418567+0000","last_fullsized":"2024-09-21T15:32:28.418567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048236600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":695,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.421647+0000","last_change":"2024-09-21T15:05:09.931310+0000","last_active":"2024-09-21T15:32:28.421647+0000","last_peered":"2024-09-21T15:32:28.421647+0000","last_clean":"2024-09-21T15:32:28.421647+0000","last_became_active":"2024-09-21T15:05:07.916495+0000","last_became_peered":"2024-09-21T15:05:07.916495+0000","last_unstale":"2024-09-21T15:32:28.421647+0000","last_undegraded":"2024-09-21T15:32:28.421647+0000","last_fullsized":"2024-09-21T15:32:28.421647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:25:19.376301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093939900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":695,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.475939+0000","last_change":"2024-09-21T15:05:09.930815+0000","last_active":"2024-09-21T15:32:26.475939+0000","last_peered":"2024-09-21T15:32:26.475939+0000","last_clean":"2024-09-21T15:32:26.475939+0000","last_became_active":"2024-09-21T15:05:07.916830+0000","last_became_peered":"2024-09-21T15:05:07.916830+0000","last_unstale":"2024-09-21T15:32:26.475939+0000","last_undegraded":"2024-09-21T15:32:26.475939+0000","last_fullsized":"2024-09-21T15:32:26.475939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:26.265612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001265777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":695,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.471926+0000","last_change":"2024-09-21T15:05:09.930647+0000","last_active":"2024-09-21T15:32:26.471926+0000","last_peered":"2024-09-21T15:32:26.471926+0000","last_clean":"2024-09-21T15:32:26.471926+0000","last_became_active":"2024-09-21T15:05:07.918599+0000","last_became_peered":"2024-09-21T15:05:07.918599+0000","last_unstale":"2024-09-21T15:32:26.471926+0000","last_undegraded":"2024-09-21T15:32:26.471926+0000","last_fullsized":"2024-09-21T15:32:26.471926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:08:34.822279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000967993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":698,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:27.357147+0000","last_change":"2024-09-21T15:05:09.923617+0000","last_active":"2024-09-21T15:32:27.357147+0000","last_peered":"2024-09-21T15:32:27.357147+0000","last_clean":"2024-09-21T15:32:27.357147+0000","last_became_active":"2024-09-21T15:05:07.916081+0000","last_became_peered":"2024-09-21T15:05:07.916081+0000","last_unstale":"2024-09-21T15:32:27.357147+0000","last_undegraded":"2024-09-21T15:32:27.357147+0000","last_fullsized":"2024-09-21T15:32:27.357147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:33.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095993999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":696,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.412351+0000","last_change":"2024-09-21T15:05:10.686046+0000","last_active":"2024-09-21T15:32:26.412351+0000","last_peered":"2024-09-21T15:32:26.412351+0000","last_clean":"2024-09-21T15:32:26.412351+0000","last_became_active":"2024-09-21T15:05:07.913149+0000","last_became_peered":"2024-09-21T15:05:07.913149+0000","last_unstale":"2024-09-21T15:32:26.412351+0000","last_undegraded":"2024-09-21T15:32:26.412351+0000","last_fullsized":"2024-09-21T15:32:26.412351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:53:47.519519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052522500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":697,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:29.000293+0000","last_change":"2024-09-21T15:05:10.686020+0000","last_active":"2024-09-21T15:32:29.000293+0000","last_peered":"2024-09-21T15:32:29.000293+0000","last_clean":"2024-09-21T15:32:29.000293+0000","last_became_active":"2024-09-21T15:05:07.913759+0000","last_became_peered":"2024-09-21T15:05:07.913759+0000","last_unstale":"2024-09-21T15:32:29.000293+0000","last_undegraded":"2024-09-21T15:32:29.000293+0000","last_fullsized":"2024-09-21T15:32:29.000293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:36:54.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057150799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":696,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.473885+0000","last_change":"2024-09-21T15:05:09.930081+0000","last_active":"2024-09-21T15:32:26.473885+0000","last_peered":"2024-09-21T15:32:26.473885+0000","last_clean":"2024-09-21T15:32:26.473885+0000","last_became_active":"2024-09-21T15:05:07.915480+0000","last_became_peered":"2024-09-21T15:05:07.915480+0000","last_unstale":"2024-09-21T15:32:26.473885+0000","last_undegraded":"2024-09-21T15:32:26.473885+0000","last_fullsized":"2024-09-21T15:32:26.473885+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:32:33.185743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048513700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":821,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.421649+0000","last_change":"2024-09-21T15:05:02.181720+0000","last_active":"2024-09-21T15:32:28.421649+0000","last_peered":"2024-09-21T15:32:28.421649+0000","last_clean":"2024-09-21T15:32:28.421649+0000","last_became_active":"2024-09-21T15:05:02.179509+0000","last_became_peered":"2024-09-21T15:05:02.179509+0000","last_unstale":"2024-09-21T15:32:28.421649+0000","last_undegraded":"2024-09-21T15:32:28.421649+0000","last_fullsized":"2024-09-21T15:32:28.421649+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:00.877892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:00.877892+0000","last_clean_scrub_stamp":"2024-09-21T15:05:00.877892+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:38.099227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673306,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712676,"kb_used_data":5592,"kb_used_omap":1,"kb_used_meta":707070,"kb_avail":93659164,"statfs":{"total":96636764160,"available":95906983936,"internally_reserved":0,"allocated":5726208,"data_stored":3635484,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":724040134},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.66400000000000003,"15min":0.71699999999999997},"min":{"1min":0.21199999999999999,"5min":0.187,"15min":0.184},"max":{"1min":0.78900000000000003,"5min":23.196999999999999,"15min":26.103000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58599999999999997,"15min":0.83199999999999996},"min":{"1min":0.28699999999999998,"5min":0.26900000000000002,"15min":0.20799999999999999},"max":{"1min":0.72299999999999998,"5min":5.2679999999999998,"15min":29.108000000000001},"last":0.625}]},{"osd":2,"last update":"Sat Sep 21 15:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.60499999999999998,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.22900000000000001,"15min":0.20499999999999999},"max":{"1min":0.72199999999999998,"5min":5.6150000000000002,"15min":7.5},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.79000000000000004,"15min":0.76900000000000002},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.20399999999999999},"max":{"1min":0.68700000000000006,"5min":23.242999999999999,"15min":23.242999999999999},"last":0.67200000000000004}]}]},{"osd":0,"up_from":10,"seq":42949673305,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":866920,"kb_used_data":5592,"kb_used_omap":1,"kb_used_meta":861310,"kb_avail":93504920,"statfs":{"total":96636764160,"available":95749038080,"internally_reserved":0,"allocated":5726208,"data_stored":3635484,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":881981894},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 15:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.68100000000000005,"15min":0.56499999999999995},"min":{"1min":0.23899999999999999,"5min":0.19,"15min":0.16300000000000001},"max":{"1min":1.069,"5min":12.762,"15min":12.762},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.82799999999999996,"15min":0.65700000000000003},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.093,"5min":15.173999999999999,"15min":15.173999999999999},"last":0.57199999999999995}]},{"osd":2,"last update":"Sat Sep 21 15:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.628,"5min":5.7359999999999998,"15min":5.7359999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.79500000000000004,"15min":0.67400000000000004},"min":{"1min":0.26300000000000001,"5min":0.26000000000000001,"15min":0.20100000000000001},"max":{"1min":0.75700000000000001,"5min":13.784000000000001,"15min":13.784000000000001},"last":0.51300000000000001}]}]},{"osd":2,"up_from":9,"seq":38654706009,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":704420,"kb_used_data":5528,"kb_used_omap":1,"kb_used_meta":698878,"kb_avail":93667420,"statfs":{"total":96636764160,"available":95915438080,"internally_reserved":0,"allocated":5660672,"data_stored":3045097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":715651526},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.89900000000000002,"15min":0.871},"min":{"1min":0.187,"5min":0.187,"15min":0.185},"max":{"1min":0.751,"5min":26.562999999999999,"15min":56.296999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.96799999999999997,"15min":0.71699999999999997},"min":{"1min":0.24299999999999999,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":1.091,"5min":19.951000000000001,"15min":19.951000000000001},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Sep 21 15:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.3180000000000001,"15min":1.034},"min":{"1min":0.39100000000000001,"5min":0.23799999999999999,"15min":0.23499999999999999},"max":{"1min":0.70599999999999996,"5min":52.966000000000001,"15min":56.350000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.98199999999999998,"15min":0.76200000000000001},"min":{"1min":0.34899999999999998,"5min":0.27700000000000002,"15min":0.224},"max":{"1min":1.1419999999999999,"5min":18.343,"15min":18.343},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:33:24.553 INFO:tasks.ceph.ceph_manager.cluster1:clean! 2024-09-21T15:33:24.553 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-21T15:33:24.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-21T15:33:24.862+0000 7f374e59c700 0 --2- 172.21.15.82:0/1213886288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f375006b080 0x7f37500a2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-21T15:33:25.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 has been restored 2024-09-21T15:33:25.060 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:33:25.064 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-09-21T15:33:25.074 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":1532,"stamp":"2024-09-21T15:33:23.287929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2284016,"kb_used_data":16712,"kb_used_omap":4,"kb_used_meta":2267259,"kb_avail":280831504,"statfs":{"total":289910292480,"available":287571460096,"internally_reserved":0,"allocated":17113088,"data_stored":10316065,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":2321673554},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003063"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":695,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.418567+0000","last_change":"2024-09-21T15:05:09.930127+0000","last_active":"2024-09-21T15:32:28.418567+0000","last_peered":"2024-09-21T15:32:28.418567+0000","last_clean":"2024-09-21T15:32:28.418567+0000","last_became_active":"2024-09-21T15:05:07.916481+0000","last_became_peered":"2024-09-21T15:05:07.916481+0000","last_unstale":"2024-09-21T15:32:28.418567+0000","last_undegraded":"2024-09-21T15:32:28.418567+0000","last_fullsized":"2024-09-21T15:32:28.418567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048236600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":695,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.421647+0000","last_change":"2024-09-21T15:05:09.931310+0000","last_active":"2024-09-21T15:32:28.421647+0000","last_peered":"2024-09-21T15:32:28.421647+0000","last_clean":"2024-09-21T15:32:28.421647+0000","last_became_active":"2024-09-21T15:05:07.916495+0000","last_became_peered":"2024-09-21T15:05:07.916495+0000","last_unstale":"2024-09-21T15:32:28.421647+0000","last_undegraded":"2024-09-21T15:32:28.421647+0000","last_fullsized":"2024-09-21T15:32:28.421647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:25:19.376301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093939900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":695,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.475939+0000","last_change":"2024-09-21T15:05:09.930815+0000","last_active":"2024-09-21T15:32:26.475939+0000","last_peered":"2024-09-21T15:32:26.475939+0000","last_clean":"2024-09-21T15:32:26.475939+0000","last_became_active":"2024-09-21T15:05:07.916830+0000","last_became_peered":"2024-09-21T15:05:07.916830+0000","last_unstale":"2024-09-21T15:32:26.475939+0000","last_undegraded":"2024-09-21T15:32:26.475939+0000","last_fullsized":"2024-09-21T15:32:26.475939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:26.265612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001265777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":695,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.471926+0000","last_change":"2024-09-21T15:05:09.930647+0000","last_active":"2024-09-21T15:32:26.471926+0000","last_peered":"2024-09-21T15:32:26.471926+0000","last_clean":"2024-09-21T15:32:26.471926+0000","last_became_active":"2024-09-21T15:05:07.918599+0000","last_became_peered":"2024-09-21T15:05:07.918599+0000","last_unstale":"2024-09-21T15:32:26.471926+0000","last_undegraded":"2024-09-21T15:32:26.471926+0000","last_fullsized":"2024-09-21T15:32:26.471926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:08:34.822279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000967993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":698,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:27.357147+0000","last_change":"2024-09-21T15:05:09.923617+0000","last_active":"2024-09-21T15:32:27.357147+0000","last_peered":"2024-09-21T15:32:27.357147+0000","last_clean":"2024-09-21T15:32:27.357147+0000","last_became_active":"2024-09-21T15:05:07.916081+0000","last_became_peered":"2024-09-21T15:05:07.916081+0000","last_unstale":"2024-09-21T15:32:27.357147+0000","last_undegraded":"2024-09-21T15:32:27.357147+0000","last_fullsized":"2024-09-21T15:32:27.357147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:33.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095993999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":696,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.412351+0000","last_change":"2024-09-21T15:05:10.686046+0000","last_active":"2024-09-21T15:32:26.412351+0000","last_peered":"2024-09-21T15:32:26.412351+0000","last_clean":"2024-09-21T15:32:26.412351+0000","last_became_active":"2024-09-21T15:05:07.913149+0000","last_became_peered":"2024-09-21T15:05:07.913149+0000","last_unstale":"2024-09-21T15:32:26.412351+0000","last_undegraded":"2024-09-21T15:32:26.412351+0000","last_fullsized":"2024-09-21T15:32:26.412351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:53:47.519519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052522500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":697,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:29.000293+0000","last_change":"2024-09-21T15:05:10.686020+0000","last_active":"2024-09-21T15:32:29.000293+0000","last_peered":"2024-09-21T15:32:29.000293+0000","last_clean":"2024-09-21T15:32:29.000293+0000","last_became_active":"2024-09-21T15:05:07.913759+0000","last_became_peered":"2024-09-21T15:05:07.913759+0000","last_unstale":"2024-09-21T15:32:29.000293+0000","last_undegraded":"2024-09-21T15:32:29.000293+0000","last_fullsized":"2024-09-21T15:32:29.000293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:36:54.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057150799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":696,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.473885+0000","last_change":"2024-09-21T15:05:09.930081+0000","last_active":"2024-09-21T15:32:26.473885+0000","last_peered":"2024-09-21T15:32:26.473885+0000","last_clean":"2024-09-21T15:32:26.473885+0000","last_became_active":"2024-09-21T15:05:07.915480+0000","last_became_peered":"2024-09-21T15:05:07.915480+0000","last_unstale":"2024-09-21T15:32:26.473885+0000","last_undegraded":"2024-09-21T15:32:26.473885+0000","last_fullsized":"2024-09-21T15:32:26.473885+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:32:33.185743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048513700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":821,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.421649+0000","last_change":"2024-09-21T15:05:02.181720+0000","last_active":"2024-09-21T15:32:28.421649+0000","last_peered":"2024-09-21T15:32:28.421649+0000","last_clean":"2024-09-21T15:32:28.421649+0000","last_became_active":"2024-09-21T15:05:02.179509+0000","last_became_peered":"2024-09-21T15:05:02.179509+0000","last_unstale":"2024-09-21T15:32:28.421649+0000","last_undegraded":"2024-09-21T15:32:28.421649+0000","last_fullsized":"2024-09-21T15:32:28.421649+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:00.877892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:00.877892+0000","last_clean_scrub_stamp":"2024-09-21T15:05:00.877892+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:38.099227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673306,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712676,"kb_used_data":5592,"kb_used_omap":1,"kb_used_meta":707070,"kb_avail":93659164,"statfs":{"total":96636764160,"available":95906983936,"internally_reserved":0,"allocated":5726208,"data_stored":3635484,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":724040134},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.66400000000000003,"15min":0.71699999999999997},"min":{"1min":0.21199999999999999,"5min":0.187,"15min":0.184},"max":{"1min":0.78900000000000003,"5min":23.196999999999999,"15min":26.103000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58599999999999997,"15min":0.83199999999999996},"min":{"1min":0.28699999999999998,"5min":0.26900000000000002,"15min":0.20799999999999999},"max":{"1min":0.72299999999999998,"5min":5.2679999999999998,"15min":29.108000000000001},"last":0.625}]},{"osd":2,"last update":"Sat Sep 21 15:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.60499999999999998,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.22900000000000001,"15min":0.20499999999999999},"max":{"1min":0.72199999999999998,"5min":5.6150000000000002,"15min":7.5},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.79000000000000004,"15min":0.76900000000000002},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.20399999999999999},"max":{"1min":0.68700000000000006,"5min":23.242999999999999,"15min":23.242999999999999},"last":0.67200000000000004}]}]},{"osd":0,"up_from":10,"seq":42949673305,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":866920,"kb_used_data":5592,"kb_used_omap":1,"kb_used_meta":861310,"kb_avail":93504920,"statfs":{"total":96636764160,"available":95749038080,"internally_reserved":0,"allocated":5726208,"data_stored":3635484,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":881981894},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 15:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.68100000000000005,"15min":0.56499999999999995},"min":{"1min":0.23899999999999999,"5min":0.19,"15min":0.16300000000000001},"max":{"1min":1.069,"5min":12.762,"15min":12.762},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.82799999999999996,"15min":0.65700000000000003},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.093,"5min":15.173999999999999,"15min":15.173999999999999},"last":0.57199999999999995}]},{"osd":2,"last update":"Sat Sep 21 15:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.628,"5min":5.7359999999999998,"15min":5.7359999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.79500000000000004,"15min":0.67400000000000004},"min":{"1min":0.26300000000000001,"5min":0.26000000000000001,"15min":0.20100000000000001},"max":{"1min":0.75700000000000001,"5min":13.784000000000001,"15min":13.784000000000001},"last":0.51300000000000001}]}]},{"osd":2,"up_from":9,"seq":38654706009,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":704420,"kb_used_data":5528,"kb_used_omap":1,"kb_used_meta":698878,"kb_avail":93667420,"statfs":{"total":96636764160,"available":95915438080,"internally_reserved":0,"allocated":5660672,"data_stored":3045097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":715651526},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.89900000000000002,"15min":0.871},"min":{"1min":0.187,"5min":0.187,"15min":0.185},"max":{"1min":0.751,"5min":26.562999999999999,"15min":56.296999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.96799999999999997,"15min":0.71699999999999997},"min":{"1min":0.24299999999999999,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":1.091,"5min":19.951000000000001,"15min":19.951000000000001},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Sep 21 15:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.3180000000000001,"15min":1.034},"min":{"1min":0.39100000000000001,"5min":0.23799999999999999,"15min":0.23499999999999999},"max":{"1min":0.70599999999999996,"5min":52.966000000000001,"15min":56.350000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.98199999999999998,"15min":0.76200000000000001},"min":{"1min":0.34899999999999998,"5min":0.27700000000000002,"15min":0.224},"max":{"1min":1.1419999999999999,"5min":18.343,"15min":18.343},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:33:25.075 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2024-09-21T15:33:25.380 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:33:25.380 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":684,"fsid":"3d5e90c8-5967-4045-8599-22a44e1f8eb4","created":"2024-09-21T15:04:51.454600+0000","modified":"2024-09-21T15:32:28.404828+0000","last_up_change":"2024-09-21T15:04:59.874492+0000","last_in_change":"2024-09-21T15:04:52.304975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T15:05:00.775669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T15:05:06.609957+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"750f15d1-ed0f-415d-8d81-053598e8966f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6809","nonce":3539582657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6811","nonce":3539582657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6815","nonce":3539582657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3539582657},{"type":"v1","addr":"172.21.15.82:6813","nonce":3539582657}]},"public_addr":"172.21.15.82:6809/3539582657","cluster_addr":"172.21.15.82:6811/3539582657","heartbeat_back_addr":"172.21.15.82:6815/3539582657","heartbeat_front_addr":"172.21.15.82:6813/3539582657","state":["exists","up"]},{"osd":1,"uuid":"871323ec-1b6a-401b-9971-073189a1a664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6817","nonce":411510261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6819","nonce":411510261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6823","nonce":411510261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":411510261},{"type":"v1","addr":"172.21.15.82:6821","nonce":411510261}]},"public_addr":"172.21.15.82:6817/411510261","cluster_addr":"172.21.15.82:6819/411510261","heartbeat_back_addr":"172.21.15.82:6823/411510261","heartbeat_front_addr":"172.21.15.82:6821/411510261","state":["exists","up"]},{"osd":2,"uuid":"f249cce2-e258-47b8-88ad-519b283e30c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6801","nonce":2593475992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6803","nonce":2593475992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6807","nonce":2593475992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2593475992},{"type":"v1","addr":"172.21.15.82:6805","nonce":2593475992}]},"public_addr":"172.21.15.82:6801/2593475992","cluster_addr":"172.21.15.82:6803/2593475992","heartbeat_back_addr":"172.21.15.82:6807/2593475992","heartbeat_front_addr":"172.21.15.82:6805/2593475992","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:04:57.485717+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:04:58.927768+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T15:04:56.529375+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T15:33:26.396 INFO:tasks.ceph:Scrubbing cluster1.osd.0 2024-09-21T15:33:26.396 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T15:33:26.560 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-21T15:33:26.560 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T15:33:26.560 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-21T15:33:26.579 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd deep-scrub 0 2024-09-21T15:33:26.893 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T15:33:26.904 INFO:tasks.ceph:Scrubbing cluster1.osd.1 2024-09-21T15:33:26.905 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T15:33:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-21T15:33:27.051 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T15:33:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-21T15:33:27.069 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd deep-scrub 1 2024-09-21T15:33:27.368 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T15:33:27.383 INFO:tasks.ceph:Scrubbing cluster1.osd.2 2024-09-21T15:33:27.383 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T15:33:27.541 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-21T15:33:27.542 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T15:33:27.542 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-21T15:33:27.554 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd deep-scrub 2 2024-09-21T15:33:27.865 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T15:33:27.879 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-21T15:33:28.179 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:33:28.182 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-09-21T15:33:28.194 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":1534,"stamp":"2024-09-21T15:33:27.289026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2284016,"kb_used_data":16712,"kb_used_omap":4,"kb_used_meta":2267259,"kb_avail":280831504,"statfs":{"total":289910292480,"available":287571460096,"internally_reserved":0,"allocated":17113088,"data_stored":10316065,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":2321673554},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003096"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":695,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.418567+0000","last_change":"2024-09-21T15:05:09.930127+0000","last_active":"2024-09-21T15:32:28.418567+0000","last_peered":"2024-09-21T15:32:28.418567+0000","last_clean":"2024-09-21T15:32:28.418567+0000","last_became_active":"2024-09-21T15:05:07.916481+0000","last_became_peered":"2024-09-21T15:05:07.916481+0000","last_unstale":"2024-09-21T15:32:28.418567+0000","last_undegraded":"2024-09-21T15:32:28.418567+0000","last_fullsized":"2024-09-21T15:32:28.418567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:44.024877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048236600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":695,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.421647+0000","last_change":"2024-09-21T15:05:09.931310+0000","last_active":"2024-09-21T15:32:28.421647+0000","last_peered":"2024-09-21T15:32:28.421647+0000","last_clean":"2024-09-21T15:32:28.421647+0000","last_became_active":"2024-09-21T15:05:07.916495+0000","last_became_peered":"2024-09-21T15:05:07.916495+0000","last_unstale":"2024-09-21T15:32:28.421647+0000","last_undegraded":"2024-09-21T15:32:28.421647+0000","last_fullsized":"2024-09-21T15:32:28.421647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:25:19.376301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093939900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":695,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.475939+0000","last_change":"2024-09-21T15:05:09.930815+0000","last_active":"2024-09-21T15:32:26.475939+0000","last_peered":"2024-09-21T15:32:26.475939+0000","last_clean":"2024-09-21T15:32:26.475939+0000","last_became_active":"2024-09-21T15:05:07.916830+0000","last_became_peered":"2024-09-21T15:05:07.916830+0000","last_unstale":"2024-09-21T15:32:26.475939+0000","last_undegraded":"2024-09-21T15:32:26.475939+0000","last_fullsized":"2024-09-21T15:32:26.475939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:06:26.265612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001265777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":695,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.471926+0000","last_change":"2024-09-21T15:05:09.930647+0000","last_active":"2024-09-21T15:32:26.471926+0000","last_peered":"2024-09-21T15:32:26.471926+0000","last_clean":"2024-09-21T15:32:26.471926+0000","last_became_active":"2024-09-21T15:05:07.918599+0000","last_became_peered":"2024-09-21T15:05:07.918599+0000","last_unstale":"2024-09-21T15:32:26.471926+0000","last_undegraded":"2024-09-21T15:32:26.471926+0000","last_fullsized":"2024-09-21T15:32:26.471926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:08:34.822279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000967993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":698,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:27.357147+0000","last_change":"2024-09-21T15:05:09.923617+0000","last_active":"2024-09-21T15:32:27.357147+0000","last_peered":"2024-09-21T15:32:27.357147+0000","last_clean":"2024-09-21T15:32:27.357147+0000","last_became_active":"2024-09-21T15:05:07.916081+0000","last_became_peered":"2024-09-21T15:05:07.916081+0000","last_unstale":"2024-09-21T15:32:27.357147+0000","last_undegraded":"2024-09-21T15:32:27.357147+0000","last_fullsized":"2024-09-21T15:32:27.357147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:44:33.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095993999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":696,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.412351+0000","last_change":"2024-09-21T15:05:10.686046+0000","last_active":"2024-09-21T15:32:26.412351+0000","last_peered":"2024-09-21T15:32:26.412351+0000","last_clean":"2024-09-21T15:32:26.412351+0000","last_became_active":"2024-09-21T15:05:07.913149+0000","last_became_peered":"2024-09-21T15:05:07.913149+0000","last_unstale":"2024-09-21T15:32:26.412351+0000","last_undegraded":"2024-09-21T15:32:26.412351+0000","last_fullsized":"2024-09-21T15:32:26.412351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:53:47.519519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052522500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":697,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:29.000293+0000","last_change":"2024-09-21T15:05:10.686020+0000","last_active":"2024-09-21T15:32:29.000293+0000","last_peered":"2024-09-21T15:32:29.000293+0000","last_clean":"2024-09-21T15:32:29.000293+0000","last_became_active":"2024-09-21T15:05:07.913759+0000","last_became_peered":"2024-09-21T15:05:07.913759+0000","last_unstale":"2024-09-21T15:32:29.000293+0000","last_undegraded":"2024-09-21T15:32:29.000293+0000","last_fullsized":"2024-09-21T15:32:29.000293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:36:54.232636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057150799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":696,"reported_epoch":683,"state":"active+clean","last_fresh":"2024-09-21T15:32:26.473885+0000","last_change":"2024-09-21T15:05:09.930081+0000","last_active":"2024-09-21T15:32:26.473885+0000","last_peered":"2024-09-21T15:32:26.473885+0000","last_clean":"2024-09-21T15:32:26.473885+0000","last_became_active":"2024-09-21T15:05:07.915480+0000","last_became_peered":"2024-09-21T15:05:07.915480+0000","last_unstale":"2024-09-21T15:32:26.473885+0000","last_undegraded":"2024-09-21T15:32:26.473885+0000","last_fullsized":"2024-09-21T15:32:26.473885+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:06.894010+0000","last_clean_scrub_stamp":"2024-09-21T15:05:06.894010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:32:33.185743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048513700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":821,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:32:28.421649+0000","last_change":"2024-09-21T15:05:02.181720+0000","last_active":"2024-09-21T15:32:28.421649+0000","last_peered":"2024-09-21T15:32:28.421649+0000","last_clean":"2024-09-21T15:32:28.421649+0000","last_became_active":"2024-09-21T15:05:02.179509+0000","last_became_peered":"2024-09-21T15:05:02.179509+0000","last_unstale":"2024-09-21T15:32:28.421649+0000","last_undegraded":"2024-09-21T15:32:28.421649+0000","last_fullsized":"2024-09-21T15:32:28.421649+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:05:00.877892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:05:00.877892+0000","last_clean_scrub_stamp":"2024-09-21T15:05:00.877892+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:38.099227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673307,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712676,"kb_used_data":5592,"kb_used_omap":1,"kb_used_meta":707070,"kb_avail":93659164,"statfs":{"total":96636764160,"available":95906983936,"internally_reserved":0,"allocated":5726208,"data_stored":3635484,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":724040134},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.66400000000000003,"15min":0.71699999999999997},"min":{"1min":0.21199999999999999,"5min":0.187,"15min":0.184},"max":{"1min":0.78900000000000003,"5min":23.196999999999999,"15min":26.103000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58599999999999997,"15min":0.83199999999999996},"min":{"1min":0.28699999999999998,"5min":0.26900000000000002,"15min":0.20799999999999999},"max":{"1min":0.72299999999999998,"5min":5.2679999999999998,"15min":29.108000000000001},"last":0.64200000000000002}]},{"osd":2,"last update":"Sat Sep 21 15:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.60499999999999998,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.22900000000000001,"15min":0.20499999999999999},"max":{"1min":0.72199999999999998,"5min":5.6150000000000002,"15min":7.5},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.79000000000000004,"15min":0.76900000000000002},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.20399999999999999},"max":{"1min":0.68700000000000006,"5min":23.242999999999999,"15min":23.242999999999999},"last":0.67600000000000005}]}]},{"osd":0,"up_from":10,"seq":42949673306,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":866920,"kb_used_data":5592,"kb_used_omap":1,"kb_used_meta":861310,"kb_avail":93504920,"statfs":{"total":96636764160,"available":95749038080,"internally_reserved":0,"allocated":5726208,"data_stored":3635484,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":881981894},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 15:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.68100000000000005,"15min":0.56499999999999995},"min":{"1min":0.23899999999999999,"5min":0.19,"15min":0.16300000000000001},"max":{"1min":1.069,"5min":12.762,"15min":12.762},"last":0.62},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.82799999999999996,"15min":0.65700000000000003},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.093,"5min":15.173999999999999,"15min":15.173999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Sep 21 15:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.628,"5min":5.7359999999999998,"15min":5.7359999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.79500000000000004,"15min":0.67400000000000004},"min":{"1min":0.26300000000000001,"5min":0.26000000000000001,"15min":0.20100000000000001},"max":{"1min":0.75700000000000001,"5min":13.784000000000001,"15min":13.784000000000001},"last":0.55000000000000004}]}]},{"osd":2,"up_from":9,"seq":38654706010,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":704420,"kb_used_data":5528,"kb_used_omap":1,"kb_used_meta":698878,"kb_avail":93667420,"statfs":{"total":96636764160,"available":95915438080,"internally_reserved":0,"allocated":5660672,"data_stored":3045097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":715651526},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.89900000000000002,"15min":0.871},"min":{"1min":0.187,"5min":0.187,"15min":0.185},"max":{"1min":0.751,"5min":26.562999999999999,"15min":56.296999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.96799999999999997,"15min":0.71699999999999997},"min":{"1min":0.24299999999999999,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":1.091,"5min":19.951000000000001,"15min":19.951000000000001},"last":0.55700000000000005}]},{"osd":1,"last update":"Sat Sep 21 15:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.3180000000000001,"15min":1.034},"min":{"1min":0.39100000000000001,"5min":0.23799999999999999,"15min":0.23499999999999999},"max":{"1min":0.70599999999999996,"5min":52.966000000000001,"15min":56.350000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.98199999999999998,"15min":0.76200000000000001},"min":{"1min":0.34899999999999998,"5min":0.27700000000000002,"15min":0.224},"max":{"1min":1.1419999999999999,"5min":18.343,"15min":18.343},"last":0.64000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:33:28.195 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T15:05:06.894010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=6, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=33, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:33:28.195 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T15:05:06.894010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=6, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=33, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:33:28.195 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T15:05:06.894010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=6, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=33, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:33:28.196 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T15:05:06.894010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=6, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=33, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:33:28.196 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T15:05:06.894010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=6, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=33, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:33:28.196 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-21T15:05:06.894010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=6, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=33, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:33:28.196 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T15:05:06.894010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=6, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=33, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:33:28.196 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T15:05:06.894010+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=6, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=33, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:33:28.196 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T15:05:00.877892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=5, tm_sec=0, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=15, tm_min=33, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T15:33:28.196 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T15:33:48.197 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2024-09-21T15:33:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-21T15:33:48.512 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-09-21T15:33:48.525 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":1544,"stamp":"2024-09-21T15:33:47.294291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2284000,"kb_used_data":16712,"kb_used_omap":4,"kb_used_meta":2267259,"kb_avail":280831520,"statfs":{"total":289910292480,"available":287571476480,"internally_reserved":0,"allocated":17113088,"data_stored":10316065,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":2321673554},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003227"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":707,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:33:38.108164+0000","last_change":"2024-09-21T15:33:38.108407+0000","last_active":"2024-09-21T15:33:38.108164+0000","last_peered":"2024-09-21T15:33:38.108164+0000","last_clean":"2024-09-21T15:33:38.108164+0000","last_became_active":"2024-09-21T15:05:07.916481+0000","last_became_peered":"2024-09-21T15:05:07.916481+0000","last_unstale":"2024-09-21T15:33:38.108164+0000","last_undegraded":"2024-09-21T15:33:38.108164+0000","last_fullsized":"2024-09-21T15:33:38.108164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:33:38.108118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:33:38.108118+0000","last_clean_scrub_stamp":"2024-09-21T15:33:38.108118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:17.612177+0000","scrub_duration":0.0031153629999999999,"objects_trimmed":0,"snaptrim_duration":0.00048236600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":707,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:33:42.160698+0000","last_change":"2024-09-21T15:33:42.161101+0000","last_active":"2024-09-21T15:33:42.160698+0000","last_peered":"2024-09-21T15:33:42.160698+0000","last_clean":"2024-09-21T15:33:42.160698+0000","last_became_active":"2024-09-21T15:05:07.916495+0000","last_became_peered":"2024-09-21T15:05:07.916495+0000","last_unstale":"2024-09-21T15:33:42.160698+0000","last_undegraded":"2024-09-21T15:33:42.160698+0000","last_fullsized":"2024-09-21T15:33:42.160698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:33:42.160612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:33:42.160612+0000","last_clean_scrub_stamp":"2024-09-21T15:33:42.160612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:55.676675+0000","scrub_duration":0.0030489110000000001,"objects_trimmed":0,"snaptrim_duration":0.00093939900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":707,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:33:41.171088+0000","last_change":"2024-09-21T15:33:41.171377+0000","last_active":"2024-09-21T15:33:41.171088+0000","last_peered":"2024-09-21T15:33:41.171088+0000","last_clean":"2024-09-21T15:33:41.171088+0000","last_became_active":"2024-09-21T15:05:07.916830+0000","last_became_peered":"2024-09-21T15:05:07.916830+0000","last_unstale":"2024-09-21T15:33:41.171088+0000","last_undegraded":"2024-09-21T15:33:41.171088+0000","last_fullsized":"2024-09-21T15:33:41.171088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:33:41.171043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:33:41.171043+0000","last_clean_scrub_stamp":"2024-09-21T15:33:41.171043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:39:20.922029+0000","scrub_duration":0.002917907,"objects_trimmed":0,"snaptrim_duration":0.001265777,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":707,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:33:43.138928+0000","last_change":"2024-09-21T15:33:43.139189+0000","last_active":"2024-09-21T15:33:43.138928+0000","last_peered":"2024-09-21T15:33:43.138928+0000","last_clean":"2024-09-21T15:33:43.138928+0000","last_became_active":"2024-09-21T15:05:07.918599+0000","last_became_peered":"2024-09-21T15:05:07.918599+0000","last_unstale":"2024-09-21T15:33:43.138928+0000","last_undegraded":"2024-09-21T15:33:43.138928+0000","last_fullsized":"2024-09-21T15:33:43.138928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:33:43.138883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:33:43.138883+0000","last_clean_scrub_stamp":"2024-09-21T15:33:43.138883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:43:09.358672+0000","scrub_duration":0.0033893970000000002,"objects_trimmed":0,"snaptrim_duration":0.000967993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"684'3","reported_seq":711,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:33:27.834102+0000","last_change":"2024-09-21T15:33:27.834351+0000","last_active":"2024-09-21T15:33:27.834102+0000","last_peered":"2024-09-21T15:33:27.834102+0000","last_clean":"2024-09-21T15:33:27.834102+0000","last_became_active":"2024-09-21T15:05:07.916081+0000","last_became_peered":"2024-09-21T15:05:07.916081+0000","last_unstale":"2024-09-21T15:33:27.834102+0000","last_undegraded":"2024-09-21T15:33:27.834102+0000","last_fullsized":"2024-09-21T15:33:27.834102+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"684'3","last_scrub_stamp":"2024-09-21T15:33:27.834043+0000","last_deep_scrub":"684'3","last_deep_scrub_stamp":"2024-09-21T15:33:27.834043+0000","last_clean_scrub_stamp":"2024-09-21T15:33:27.834043+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:52:40.657070+0000","scrub_duration":0.0056531919999999996,"objects_trimmed":0,"snaptrim_duration":0.00095993999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":708,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:33:31.066324+0000","last_change":"2024-09-21T15:33:31.066659+0000","last_active":"2024-09-21T15:33:31.066324+0000","last_peered":"2024-09-21T15:33:31.066324+0000","last_clean":"2024-09-21T15:33:31.066324+0000","last_became_active":"2024-09-21T15:05:07.913149+0000","last_became_peered":"2024-09-21T15:05:07.913149+0000","last_unstale":"2024-09-21T15:33:31.066324+0000","last_undegraded":"2024-09-21T15:33:31.066324+0000","last_fullsized":"2024-09-21T15:33:31.066324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:33:31.066278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:33:31.066278+0000","last_clean_scrub_stamp":"2024-09-21T15:33:31.066278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:42:45.054312+0000","scrub_duration":0.0031139000000000002,"objects_trimmed":0,"snaptrim_duration":0.00052522500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":709,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:33:28.999793+0000","last_change":"2024-09-21T15:33:29.000037+0000","last_active":"2024-09-21T15:33:28.999793+0000","last_peered":"2024-09-21T15:33:28.999793+0000","last_clean":"2024-09-21T15:33:28.999793+0000","last_became_active":"2024-09-21T15:05:07.913759+0000","last_became_peered":"2024-09-21T15:05:07.913759+0000","last_unstale":"2024-09-21T15:33:28.999793+0000","last_undegraded":"2024-09-21T15:33:28.999793+0000","last_fullsized":"2024-09-21T15:33:28.999793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T15:33:28.999746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T15:33:28.999746+0000","last_clean_scrub_stamp":"2024-09-21T15:33:28.999746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:22:09.437589+0000","scrub_duration":0.00305617,"objects_trimmed":0,"snaptrim_duration":0.00057150799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"684'2","reported_seq":709,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:33:44.143854+0000","last_change":"2024-09-21T15:33:44.144238+0000","last_active":"2024-09-21T15:33:44.143854+0000","last_peered":"2024-09-21T15:33:44.143854+0000","last_clean":"2024-09-21T15:33:44.143854+0000","last_became_active":"2024-09-21T15:05:07.915480+0000","last_became_peered":"2024-09-21T15:05:07.915480+0000","last_unstale":"2024-09-21T15:33:44.143854+0000","last_undegraded":"2024-09-21T15:33:44.143854+0000","last_fullsized":"2024-09-21T15:33:44.143854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"684'2","last_scrub_stamp":"2024-09-21T15:33:44.143742+0000","last_deep_scrub":"684'2","last_deep_scrub_stamp":"2024-09-21T15:33:44.143742+0000","last_clean_scrub_stamp":"2024-09-21T15:33:44.143742+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:55.223487+0000","scrub_duration":0.0062725769999999997,"objects_trimmed":0,"snaptrim_duration":0.00048513700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"684'99","reported_seq":835,"reported_epoch":684,"state":"active+clean","last_fresh":"2024-09-21T15:33:37.096913+0000","last_change":"2024-09-21T15:33:37.097165+0000","last_active":"2024-09-21T15:33:37.096913+0000","last_peered":"2024-09-21T15:33:37.096913+0000","last_clean":"2024-09-21T15:33:37.096913+0000","last_became_active":"2024-09-21T15:05:02.179509+0000","last_became_peered":"2024-09-21T15:05:02.179509+0000","last_unstale":"2024-09-21T15:33:37.096913+0000","last_undegraded":"2024-09-21T15:33:37.096913+0000","last_fullsized":"2024-09-21T15:33:37.096913+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"684'99","last_scrub_stamp":"2024-09-21T15:33:37.096852+0000","last_deep_scrub":"684'99","last_deep_scrub_stamp":"2024-09-21T15:33:37.096852+0000","last_clean_scrub_stamp":"2024-09-21T15:33:37.096852+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:24:13.156248+0000","scrub_duration":0.0099228630000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":60334,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673311,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712672,"kb_used_data":5592,"kb_used_omap":1,"kb_used_meta":707070,"kb_avail":93659168,"statfs":{"total":96636764160,"available":95906988032,"internally_reserved":0,"allocated":5726208,"data_stored":3635484,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":724040134},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.66400000000000003,"15min":0.71699999999999997},"min":{"1min":0.21199999999999999,"5min":0.187,"15min":0.184},"max":{"1min":0.78900000000000003,"5min":23.196999999999999,"15min":26.103000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58599999999999997,"15min":0.83199999999999996},"min":{"1min":0.28699999999999998,"5min":0.26900000000000002,"15min":0.20799999999999999},"max":{"1min":0.72299999999999998,"5min":5.2679999999999998,"15min":29.108000000000001},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Sep 21 15:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.60499999999999998,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.22900000000000001,"15min":0.20499999999999999},"max":{"1min":0.72199999999999998,"5min":5.6150000000000002,"15min":7.5},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.79000000000000004,"15min":0.76900000000000002},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.20399999999999999},"max":{"1min":0.68700000000000006,"5min":23.242999999999999,"15min":23.242999999999999},"last":0.58799999999999997}]}]},{"osd":0,"up_from":10,"seq":42949673310,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":866912,"kb_used_data":5592,"kb_used_omap":1,"kb_used_meta":861310,"kb_avail":93504928,"statfs":{"total":96636764160,"available":95749046272,"internally_reserved":0,"allocated":5726208,"data_stored":3635484,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":881981894},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 15:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.68100000000000005,"15min":0.56499999999999995},"min":{"1min":0.23899999999999999,"5min":0.19,"15min":0.16300000000000001},"max":{"1min":1.069,"5min":12.762,"15min":12.762},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.82799999999999996,"15min":0.65700000000000003},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.093,"5min":15.173999999999999,"15min":15.173999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Sat Sep 21 15:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.628,"5min":5.7359999999999998,"15min":5.7359999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.79500000000000004,"15min":0.67400000000000004},"min":{"1min":0.26300000000000001,"5min":0.26000000000000001,"15min":0.20100000000000001},"max":{"1min":0.75700000000000001,"5min":13.784000000000001,"15min":13.784000000000001},"last":0.623}]}]},{"osd":2,"up_from":9,"seq":38654706014,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":704416,"kb_used_data":5528,"kb_used_omap":1,"kb_used_meta":698878,"kb_avail":93667424,"statfs":{"total":96636764160,"available":95915442176,"internally_reserved":0,"allocated":5660672,"data_stored":3045097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":715651526},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 15:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.89900000000000002,"15min":0.871},"min":{"1min":0.187,"5min":0.187,"15min":0.185},"max":{"1min":0.751,"5min":26.562999999999999,"15min":56.296999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.96799999999999997,"15min":0.71699999999999997},"min":{"1min":0.24299999999999999,"5min":0.219,"15min":0.20100000000000001},"max":{"1min":1.091,"5min":19.951000000000001,"15min":19.951000000000001},"last":0.52900000000000003}]},{"osd":1,"last update":"Sat Sep 21 15:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.3180000000000001,"15min":1.034},"min":{"1min":0.39100000000000001,"5min":0.23799999999999999,"15min":0.23499999999999999},"max":{"1min":0.70599999999999996,"5min":52.966000000000001,"15min":56.350000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.98199999999999998,"15min":0.76200000000000001},"min":{"1min":0.34899999999999998,"5min":0.27700000000000002,"15min":0.224},"max":{"1min":1.1419999999999999,"5min":18.343,"15min":18.343},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30167,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T15:33:48.526 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster cluster1 config set global mon_health_to_clog false 2024-09-21T15:33:48.854 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T15:33:48.855 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T15:33:48.855 DEBUG:tasks.ceph.cluster1.osd.0:waiting for process to exit 2024-09-21T15:33:48.855 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:33:53.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~0s 2024-09-21T15:33:54.957 INFO:tasks.ceph.cluster1.osd.0:Stopped 2024-09-21T15:33:54.958 DEBUG:tasks.ceph.cluster1.osd.1:waiting for process to exit 2024-09-21T15:33:54.958 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:33:58.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~0s 2024-09-21T15:33:58.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 has been restored 2024-09-21T15:34:01.060 INFO:tasks.ceph.cluster1.osd.1:Stopped 2024-09-21T15:34:01.060 DEBUG:tasks.ceph.cluster1.osd.2:waiting for process to exit 2024-09-21T15:34:01.060 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:34:03.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.2 is failed for ~0s 2024-09-21T15:34:03.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 has been restored 2024-09-21T15:34:07.162 INFO:tasks.ceph.cluster1.osd.2:Stopped 2024-09-21T15:34:07.162 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T15:34:07.163 DEBUG:tasks.ceph.cluster1.mgr.x:waiting for process to exit 2024-09-21T15:34:07.163 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:34:07.196 INFO:tasks.ceph.cluster1.mgr.x:Stopped 2024-09-21T15:34:07.196 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T15:34:07.196 DEBUG:tasks.ceph.cluster1.mon.a:waiting for process to exit 2024-09-21T15:34:07.196 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T15:34:07.254 INFO:tasks.ceph.cluster1.mon.a:Stopped 2024-09-21T15:34:07.254 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T15:34:07.255 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/cluster1.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-21T15:34:07.303 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/cluster1-0 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-21T15:34:07.304 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/cluster1-0 2024-09-21T15:34:07.640 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/cluster1-1 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-21T15:34:07.640 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/cluster1-1 2024-09-21T15:34:07.903 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/cluster1-2 on ubuntu@smithi082.front.sepia.ceph.com 2024-09-21T15:34:07.903 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/cluster1-2 2024-09-21T15:34:08.146 INFO:tasks.ceph:Archiving mon data... 2024-09-21T15:34:08.147 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/mon/cluster1-a to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909963/data/cluster1.mon.a.tgz 2024-09-21T15:34:08.147 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-09-21T15:34:08.167 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.HrcUwBYmMT 2024-09-21T15:34:08.168 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar cz -f - -C /var/lib/ceph/mon/cluster1-a -- . > /tmp/tmp.HrcUwBYmMT 2024-09-21T15:34:08.331 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.HrcUwBYmMT 2024-09-21T15:34:08.378 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.HrcUwBYmMT is 382KB 2024-09-21T15:34:08.441 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.HrcUwBYmMT 2024-09-21T15:34:08.448 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T15:34:08.448 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /etc/ceph/cluster1.conf /etc/ceph/cluster1.keyring /home/ubuntu/cephtest/cluster1.data /home/ubuntu/cephtest/cluster1.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T15:34:08.450 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/cluster1.conf /etc/ceph/cluster1.keyring /home/ubuntu/cephtest/cluster1.data /home/ubuntu/cephtest/cluster1.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T15:34:08.466 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-21T15:34:08.466 DEBUG:teuthology.orchestra.run.smithi082:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-21T15:34:08.468 DEBUG:teuthology.orchestra.run.smithi161:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-21T15:34:08.498 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-21T15:34:08.536 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-21T15:34:08.542 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T15:34:08.544 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909963/remote/smithi082/crash 2024-09-21T15:34:08.545 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T15:34:08.562 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909963/remote/smithi161/crash 2024-09-21T15:34:08.563 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T15:34:08.577 INFO:tasks.ceph:Compressing logs... 2024-09-21T15:34:08.578 DEBUG:teuthology.orchestra.run.smithi082:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T15:34:08.580 DEBUG:teuthology.orchestra.run.smithi161:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T15:34:08.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.2 has been restored 2024-09-21T15:39:28.887 INFO:tasks.ceph:Archiving logs... 2024-09-21T15:39:28.887 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909963/remote/smithi082/log 2024-09-21T15:39:28.888 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T15:39:57.314 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909963/remote/smithi161/log 2024-09-21T15:39:57.315 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T15:40:26.287 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T15:40:26.298 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T15:40:26.298 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T15:40:26.301 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T15:40:26.397 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T15:40:26.408 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T15:40:26.408 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T15:40:26.411 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T15:40:26.514 INFO:teuthology.orchestra.run.smithi082.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T15:40:26.514 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================== 2024-09-21T15:40:26.514 INFO:teuthology.orchestra.run.smithi082.stdout:*hv01.front.sepi 67.205.162.81 3 u 93 128 377 0.179 3.046 0.575 2024-09-21T15:40:26.514 INFO:teuthology.orchestra.run.smithi082.stdout:+hv02.front.sepi 96.245.170.99 3 u 35 128 377 0.169 4.552 0.360 2024-09-21T15:40:26.514 INFO:teuthology.orchestra.run.smithi082.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 128 377 0.183 1.544 0.566 2024-09-21T15:40:26.514 INFO:teuthology.orchestra.run.smithi082.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2024-09-21T15:40:26.540 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T15:40:26.540 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2024-09-21T15:40:26.540 INFO:teuthology.orchestra.run.smithi161.stdout:*hv01.front.sepi 67.205.162.81 3 u 40 128 377 0.077 0.356 0.236 2024-09-21T15:40:26.541 INFO:teuthology.orchestra.run.smithi161.stdout:+hv02.front.sepi 96.245.170.99 3 u 97 128 377 0.079 2.049 0.058 2024-09-21T15:40:26.541 INFO:teuthology.orchestra.run.smithi161.stdout:+hv03.front.sepi 74.6.168.72 3 u 20 128 377 0.112 -0.492 0.244 2024-09-21T15:40:26.541 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2024-09-21T15:40:26.541 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T15:40:26.556 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T15:40:26.557 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T15:40:26.581 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T15:40:26.614 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T15:40:26.648 INFO:teuthology.task.internal:Duration was 2604.641010 seconds 2024-09-21T15:40:26.648 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T15:40:26.681 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T15:40:26.681 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T15:40:26.684 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T15:40:26.843 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T15:40:26.843 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-09-21T15:40:26.843 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T15:40:26.859 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2024-09-21T15:40:26.859 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T15:40:26.876 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T15:40:26.876 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T15:40:26.878 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T15:40:26.963 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T15:40:26.963 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T15:40:26.966 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T15:40:27.134 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T15:40:27.147 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T15:40:27.147 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T15:40:27.191 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T15:40:27.234 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T15:40:27.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T15:40:27.248 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T15:40:27.269 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2024-09-21T15:40:27.313 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-09-21T15:40:27.357 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T15:40:27.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T15:40:27.363 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T15:40:27.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T15:40:27.369 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T15:40:27.387 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T15:40:27.387 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909963/remote/smithi082 2024-09-21T15:40:27.388 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T15:40:27.410 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909963/remote/smithi161 2024-09-21T15:40:27.411 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T15:40:27.538 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T15:40:27.539 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T15:40:27.541 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T15:40:27.586 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T15:40:27.599 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T15:40:27.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T15:40:27.625 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T15:40:27.625 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T15:40:27.627 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T15:40:27.633 INFO:teuthology.orchestra.run.smithi082.stdout: 1048593 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 15:40 /home/ubuntu/cephtest 2024-09-21T15:40:27.635 INFO:teuthology.orchestra.run.smithi161.stdout: 1048593 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 15:40 /home/ubuntu/cephtest 2024-09-21T15:40:27.637 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T15:40:27.657 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T15:40:27.726 INFO:teuthology.run:Summary data: description: rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_20.04} workloads/rbd-mirror-fsx-workunit} duration: 2604.641009569168 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-21T15:40:27.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T15:40:27.806 INFO:teuthology.run:pass